Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 14, 2021 15:18
Show Gist options
  • Save dfarrell07/133882e90d08372b2dc154a2acfc2345 to your computer and use it in GitHub Desktop.
Save dfarrell07/133882e90d08372b2dc154a2acfc2345 to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210713
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-13T00:00:49.2604884Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-13T00:00:49.2604978Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-13T00:00:58.7595466Z Current runner version: '2.278.0'
2021-07-13T00:00:58.7625407Z ##[group]Operating System
2021-07-13T00:00:58.7626550Z Ubuntu
2021-07-13T00:00:58.7627083Z 20.04.2
2021-07-13T00:00:58.7627568Z LTS
2021-07-13T00:00:58.7628088Z ##[endgroup]
2021-07-13T00:00:58.7628729Z ##[group]Virtual Environment
2021-07-13T00:00:58.7629396Z Environment: ubuntu-20.04
2021-07-13T00:00:58.7630012Z Version: 20210628.1
2021-07-13T00:00:58.7631063Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210628.1/images/linux/Ubuntu2004-README.md
2021-07-13T00:00:58.7632576Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210628.1
2021-07-13T00:00:58.7633516Z ##[endgroup]
2021-07-13T00:00:58.7635720Z ##[group]GITHUB_TOKEN Permissions
2021-07-13T00:00:58.7637378Z Actions: write
2021-07-13T00:00:58.7637922Z Checks: write
2021-07-13T00:00:58.7638567Z Contents: write
2021-07-13T00:00:58.7639171Z Deployments: write
2021-07-13T00:00:58.7639935Z Discussions: write
2021-07-13T00:00:58.7640557Z Issues: write
2021-07-13T00:00:58.7641118Z Metadata: read
2021-07-13T00:00:58.7641701Z Packages: write
2021-07-13T00:00:58.7642265Z PullRequests: write
2021-07-13T00:00:58.7642969Z RepositoryProjects: write
2021-07-13T00:00:58.7643629Z SecurityEvents: write
2021-07-13T00:00:58.7644293Z Statuses: write
2021-07-13T00:00:58.7644959Z ##[endgroup]
2021-07-13T00:00:58.7648550Z Prepare workflow directory
2021-07-13T00:00:58.8461493Z Prepare all required actions
2021-07-13T00:00:58.8475050Z Getting action download info
2021-07-13T00:00:59.3391880Z Download action repository 'actions/checkout@v2'
2021-07-13T00:01:01.1617738Z Download action repository 'submariner-io/shipyard@devel'
2021-07-13T00:01:01.7385855Z ##[group]Run actions/checkout@v2
2021-07-13T00:01:01.7386547Z with:
2021-07-13T00:01:01.7387077Z repository: submariner-io/lighthouse
2021-07-13T00:01:01.7388045Z token: ***
2021-07-13T00:01:01.7388459Z ssh-strict: true
2021-07-13T00:01:01.7388970Z persist-credentials: true
2021-07-13T00:01:01.7389494Z clean: true
2021-07-13T00:01:01.7389884Z fetch-depth: 1
2021-07-13T00:01:01.7390283Z lfs: false
2021-07-13T00:01:01.7390671Z submodules: false
2021-07-13T00:01:01.7391088Z ##[endgroup]
2021-07-13T00:01:02.0541025Z Syncing repository: submariner-io/lighthouse
2021-07-13T00:01:02.0542478Z ##[group]Getting Git version info
2021-07-13T00:01:02.0544413Z Working directory is '/home/runner/work/lighthouse/lighthouse'
2021-07-13T00:01:02.0588113Z [command]/usr/bin/git version
2021-07-13T00:01:02.0729938Z git version 2.32.0
2021-07-13T00:01:02.0756425Z ##[endgroup]
2021-07-13T00:01:02.0784599Z Deleting the contents of '/home/runner/work/lighthouse/lighthouse'
2021-07-13T00:01:02.0786512Z ##[group]Initializing the repository
2021-07-13T00:01:02.0787279Z [command]/usr/bin/git init /home/runner/work/lighthouse/lighthouse
2021-07-13T00:01:02.0860697Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-13T00:01:02.6656735Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-13T00:01:02.6681019Z hint: of your new repositories, which will suppress this warning, call:
2021-07-13T00:01:02.6683453Z hint:
2021-07-13T00:01:02.6685597Z hint: git config --global init.defaultBranch <name>
2021-07-13T00:01:02.6686188Z hint:
2021-07-13T00:01:02.6686957Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-13T00:01:02.6688008Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-13T00:01:02.6688909Z hint:
2021-07-13T00:01:02.6689716Z hint: git branch -m <name>
2021-07-13T00:01:02.6690695Z Initialized empty Git repository in /home/runner/work/lighthouse/lighthouse/.git/
2021-07-13T00:01:02.6692190Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/lighthouse
2021-07-13T00:01:02.6693228Z ##[endgroup]
2021-07-13T00:01:02.6693989Z ##[group]Disabling automatic garbage collection
2021-07-13T00:01:02.6695062Z [command]/usr/bin/git config --local gc.auto 0
2021-07-13T00:01:02.6696130Z ##[endgroup]
2021-07-13T00:01:02.6698360Z ##[group]Setting up auth
2021-07-13T00:01:02.6699562Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-13T00:01:02.6701370Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-13T00:01:02.6703191Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-13T00:01:02.6705422Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-13T00:01:02.6707605Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-13T00:01:02.6708688Z ##[endgroup]
2021-07-13T00:01:02.6709353Z ##[group]Fetching the repository
2021-07-13T00:01:02.6711263Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +ab9c63f0e2481e8b3ec4e0fa7128215734ab1f2f:refs/remotes/origin/devel
2021-07-13T00:01:03.4261047Z remote: Enumerating objects: 113, done.
2021-07-13T00:01:03.4262618Z remote: Counting objects: 0% (1/113)
2021-07-13T00:01:03.4263201Z remote: Counting objects: 1% (2/113)
2021-07-13T00:01:03.4263739Z remote: Counting objects: 2% (3/113)
2021-07-13T00:01:03.4264257Z remote: Counting objects: 3% (4/113)
2021-07-13T00:01:03.4264781Z remote: Counting objects: 4% (5/113)
2021-07-13T00:01:03.4265887Z remote: Counting objects: 5% (6/113)
2021-07-13T00:01:03.4266476Z remote: Counting objects: 6% (7/113)
2021-07-13T00:01:03.4267006Z remote: Counting objects: 7% (8/113)
2021-07-13T00:01:03.4267529Z remote: Counting objects: 8% (10/113)
2021-07-13T00:01:03.4268066Z remote: Counting objects: 9% (11/113)
2021-07-13T00:01:03.4268612Z remote: Counting objects: 10% (12/113)
2021-07-13T00:01:03.4269144Z remote: Counting objects: 11% (13/113)
2021-07-13T00:01:03.4269671Z remote: Counting objects: 12% (14/113)
2021-07-13T00:01:03.4270204Z remote: Counting objects: 13% (15/113)
2021-07-13T00:01:03.4270728Z remote: Counting objects: 14% (16/113)
2021-07-13T00:01:03.4271261Z remote: Counting objects: 15% (17/113)
2021-07-13T00:01:03.4271785Z remote: Counting objects: 16% (19/113)
2021-07-13T00:01:03.4272318Z remote: Counting objects: 17% (20/113)
2021-07-13T00:01:03.4272860Z remote: Counting objects: 18% (21/113)
2021-07-13T00:01:03.4273385Z remote: Counting objects: 19% (22/113)
2021-07-13T00:01:03.4273920Z remote: Counting objects: 20% (23/113)
2021-07-13T00:01:03.4274444Z remote: Counting objects: 21% (24/113)
2021-07-13T00:01:03.4274977Z remote: Counting objects: 22% (25/113)
2021-07-13T00:01:03.4275511Z remote: Counting objects: 23% (26/113)
2021-07-13T00:01:03.4276044Z remote: Counting objects: 24% (28/113)
2021-07-13T00:01:03.4276567Z remote: Counting objects: 25% (29/113)
2021-07-13T00:01:03.4277323Z remote: Counting objects: 26% (30/113)
2021-07-13T00:01:03.4277861Z remote: Counting objects: 27% (31/113)
2021-07-13T00:01:03.4278381Z remote: Counting objects: 28% (32/113)
2021-07-13T00:01:03.4278911Z remote: Counting objects: 29% (33/113)
2021-07-13T00:01:03.4279432Z remote: Counting objects: 30% (34/113)
2021-07-13T00:01:03.4279960Z remote: Counting objects: 31% (36/113)
2021-07-13T00:01:03.4280638Z remote: Counting objects: 32% (37/113)
2021-07-13T00:01:03.4281181Z remote: Counting objects: 33% (38/113)
2021-07-13T00:01:03.4281712Z remote: Counting objects: 34% (39/113)
2021-07-13T00:01:03.4282232Z remote: Counting objects: 35% (40/113)
2021-07-13T00:01:03.4282931Z remote: Counting objects: 36% (41/113)
2021-07-13T00:01:03.4283458Z remote: Counting objects: 37% (42/113)
2021-07-13T00:01:03.4283991Z remote: Counting objects: 38% (43/113)
2021-07-13T00:01:03.4284512Z remote: Counting objects: 39% (45/113)
2021-07-13T00:01:03.4285043Z remote: Counting objects: 40% (46/113)
2021-07-13T00:01:03.4285564Z remote: Counting objects: 41% (47/113)
2021-07-13T00:01:03.4286097Z remote: Counting objects: 42% (48/113)
2021-07-13T00:01:03.4286631Z remote: Counting objects: 43% (49/113)
2021-07-13T00:01:03.4287153Z remote: Counting objects: 44% (50/113)
2021-07-13T00:01:03.4287696Z remote: Counting objects: 45% (51/113)
2021-07-13T00:01:03.4288219Z remote: Counting objects: 46% (52/113)
2021-07-13T00:01:03.4288750Z remote: Counting objects: 47% (54/113)
2021-07-13T00:01:03.4289274Z remote: Counting objects: 48% (55/113)
2021-07-13T00:01:03.4291100Z remote: Counting objects: 49% (56/113)
2021-07-13T00:01:03.4291657Z remote: Counting objects: 50% (57/113)
2021-07-13T00:01:03.4298325Z remote: Counting objects: 51% (58/113)
2021-07-13T00:01:03.4299179Z remote: Counting objects: 52% (59/113)
2021-07-13T00:01:03.4299873Z remote: Counting objects: 53% (60/113)
2021-07-13T00:01:03.4300498Z remote: Counting objects: 54% (62/113)
2021-07-13T00:01:03.4301185Z remote: Counting objects: 55% (63/113)
2021-07-13T00:01:03.4301921Z remote: Counting objects: 56% (64/113)
2021-07-13T00:01:03.4304913Z remote: Counting objects: 57% (65/113)
2021-07-13T00:01:03.4306528Z remote: Counting objects: 58% (66/113)
2021-07-13T00:01:03.4308780Z remote: Counting objects: 59% (67/113)
2021-07-13T00:01:03.4309597Z remote: Counting objects: 60% (68/113)
2021-07-13T00:01:03.4312135Z remote: Counting objects: 61% (69/113)
2021-07-13T00:01:03.4313532Z remote: Counting objects: 62% (71/113)
2021-07-13T00:01:03.4314609Z remote: Counting objects: 63% (72/113)
2021-07-13T00:01:03.4316149Z remote: Counting objects: 64% (73/113)
2021-07-13T00:01:03.4317196Z remote: Counting objects: 65% (74/113)
2021-07-13T00:01:03.4320333Z remote: Counting objects: 66% (75/113)
2021-07-13T00:01:03.4324328Z remote: Counting objects: 67% (76/113)
2021-07-13T00:01:03.4324958Z remote: Counting objects: 68% (77/113)
2021-07-13T00:01:03.4325481Z remote: Counting objects: 69% (78/113)
2021-07-13T00:01:03.4326013Z remote: Counting objects: 70% (80/113)
2021-07-13T00:01:03.4326535Z remote: Counting objects: 71% (81/113)
2021-07-13T00:01:03.4328936Z remote: Counting objects: 72% (82/113)
2021-07-13T00:01:03.4331318Z remote: Counting objects: 73% (83/113)
2021-07-13T00:01:03.4331924Z remote: Counting objects: 74% (84/113)
2021-07-13T00:01:03.4332451Z remote: Counting objects: 75% (85/113)
2021-07-13T00:01:03.4333007Z remote: Counting objects: 76% (86/113)
2021-07-13T00:01:03.4333863Z remote: Counting objects: 77% (88/113)
2021-07-13T00:01:03.4334406Z remote: Counting objects: 78% (89/113)
2021-07-13T00:01:03.4334939Z remote: Counting objects: 79% (90/113)
2021-07-13T00:01:03.4335457Z remote: Counting objects: 80% (91/113)
2021-07-13T00:01:03.4335988Z remote: Counting objects: 81% (92/113)
2021-07-13T00:01:03.4336600Z remote: Counting objects: 82% (93/113)
2021-07-13T00:01:03.4338260Z remote: Counting objects: 83% (94/113)
2021-07-13T00:01:03.4342331Z remote: Counting objects: 84% (95/113)
2021-07-13T00:01:03.4342922Z remote: Counting objects: 85% (97/113)
2021-07-13T00:01:03.4344101Z remote: Counting objects: 86% (98/113)
2021-07-13T00:01:03.4347286Z remote: Counting objects: 87% (99/113)
2021-07-13T00:01:03.4348361Z remote: Counting objects: 88% (100/113)
2021-07-13T00:01:03.4349366Z remote: Counting objects: 89% (101/113)
2021-07-13T00:01:03.4351050Z remote: Counting objects: 90% (102/113)
2021-07-13T00:01:03.4351602Z remote: Counting objects: 91% (103/113)
2021-07-13T00:01:03.4352932Z remote: Counting objects: 92% (104/113)
2021-07-13T00:01:03.4353525Z remote: Counting objects: 93% (106/113)
2021-07-13T00:01:03.4354064Z remote: Counting objects: 94% (107/113)
2021-07-13T00:01:03.4354605Z remote: Counting objects: 95% (108/113)
2021-07-13T00:01:03.4355155Z remote: Counting objects: 96% (109/113)
2021-07-13T00:01:03.4355693Z remote: Counting objects: 97% (110/113)
2021-07-13T00:01:03.4357113Z remote: Counting objects: 98% (111/113)
2021-07-13T00:01:03.4358657Z remote: Counting objects: 99% (112/113)
2021-07-13T00:01:03.4359328Z remote: Counting objects: 100% (113/113)
2021-07-13T00:01:03.4359953Z remote: Counting objects: 100% (113/113), done.
2021-07-13T00:01:03.4360631Z remote: Compressing objects: 0% (1/101)
2021-07-13T00:01:03.4361236Z remote: Compressing objects: 1% (2/101)
2021-07-13T00:01:03.4361821Z remote: Compressing objects: 2% (3/101)
2021-07-13T00:01:03.4362796Z remote: Compressing objects: 3% (4/101)
2021-07-13T00:01:03.4363400Z remote: Compressing objects: 4% (5/101)
2021-07-13T00:01:03.4363986Z remote: Compressing objects: 5% (6/101)
2021-07-13T00:01:03.4364559Z remote: Compressing objects: 6% (7/101)
2021-07-13T00:01:03.4365935Z remote: Compressing objects: 7% (8/101)
2021-07-13T00:01:03.4367508Z remote: Compressing objects: 8% (9/101)
2021-07-13T00:01:03.4368340Z remote: Compressing objects: 9% (10/101)
2021-07-13T00:01:03.4368956Z remote: Compressing objects: 10% (11/101)
2021-07-13T00:01:03.4369548Z remote: Compressing objects: 11% (12/101)
2021-07-13T00:01:03.4370125Z remote: Compressing objects: 12% (13/101)
2021-07-13T00:01:03.4370713Z remote: Compressing objects: 13% (14/101)
2021-07-13T00:01:03.4376030Z remote: Compressing objects: 14% (15/101)
2021-07-13T00:01:03.4376623Z remote: Compressing objects: 15% (16/101)
2021-07-13T00:01:03.4378260Z remote: Compressing objects: 16% (17/101)
2021-07-13T00:01:03.4378892Z remote: Compressing objects: 17% (18/101)
2021-07-13T00:01:03.4379481Z remote: Compressing objects: 18% (19/101)
2021-07-13T00:01:03.4380056Z remote: Compressing objects: 19% (20/101)
2021-07-13T00:01:03.4380640Z remote: Compressing objects: 20% (21/101)
2021-07-13T00:01:03.4381212Z remote: Compressing objects: 21% (22/101)
2021-07-13T00:01:03.4381834Z remote: Compressing objects: 22% (23/101)
2021-07-13T00:01:03.4382427Z remote: Compressing objects: 23% (24/101)
2021-07-13T00:01:03.4383000Z remote: Compressing objects: 24% (25/101)
2021-07-13T00:01:03.4383585Z remote: Compressing objects: 25% (26/101)
2021-07-13T00:01:03.4384169Z remote: Compressing objects: 26% (27/101)
2021-07-13T00:01:03.4384755Z remote: Compressing objects: 27% (28/101)
2021-07-13T00:01:03.4385328Z remote: Compressing objects: 28% (29/101)
2021-07-13T00:01:03.4385919Z remote: Compressing objects: 29% (30/101)
2021-07-13T00:01:03.4386493Z remote: Compressing objects: 30% (31/101)
2021-07-13T00:01:03.4387084Z remote: Compressing objects: 31% (32/101)
2021-07-13T00:01:03.4387672Z remote: Compressing objects: 32% (33/101)
2021-07-13T00:01:03.4388250Z remote: Compressing objects: 33% (34/101)
2021-07-13T00:01:03.4388852Z remote: Compressing objects: 34% (35/101)
2021-07-13T00:01:03.4389433Z remote: Compressing objects: 35% (36/101)
2021-07-13T00:01:03.4390018Z remote: Compressing objects: 36% (37/101)
2021-07-13T00:01:03.4390589Z remote: Compressing objects: 37% (38/101)
2021-07-13T00:01:03.4391184Z remote: Compressing objects: 38% (39/101)
2021-07-13T00:01:03.4392091Z remote: Compressing objects: 39% (40/101)
2021-07-13T00:01:03.4392678Z remote: Compressing objects: 40% (41/101)
2021-07-13T00:01:03.4393263Z remote: Compressing objects: 41% (42/101)
2021-07-13T00:01:03.4393840Z remote: Compressing objects: 42% (43/101)
2021-07-13T00:01:03.4394426Z remote: Compressing objects: 43% (44/101)
2021-07-13T00:01:03.4395004Z remote: Compressing objects: 44% (45/101)
2021-07-13T00:01:03.4395586Z remote: Compressing objects: 45% (46/101)
2021-07-13T00:01:03.4396162Z remote: Compressing objects: 46% (47/101)
2021-07-13T00:01:03.4396756Z remote: Compressing objects: 47% (48/101)
2021-07-13T00:01:03.4397625Z remote: Compressing objects: 48% (49/101)
2021-07-13T00:01:03.4398222Z remote: Compressing objects: 49% (50/101)
2021-07-13T00:01:03.4398807Z remote: Compressing objects: 50% (51/101)
2021-07-13T00:01:03.4399382Z remote: Compressing objects: 51% (52/101)
2021-07-13T00:01:03.4399979Z remote: Compressing objects: 52% (53/101)
2021-07-13T00:01:03.4400555Z remote: Compressing objects: 53% (54/101)
2021-07-13T00:01:03.4401140Z remote: Compressing objects: 54% (55/101)
2021-07-13T00:01:03.4401715Z remote: Compressing objects: 55% (56/101)
2021-07-13T00:01:03.4402298Z remote: Compressing objects: 56% (57/101)
2021-07-13T00:01:03.4402871Z remote: Compressing objects: 57% (58/101)
2021-07-13T00:01:03.4403461Z remote: Compressing objects: 58% (59/101)
2021-07-13T00:01:03.4404050Z remote: Compressing objects: 59% (60/101)
2021-07-13T00:01:03.4404737Z remote: Compressing objects: 60% (61/101)
2021-07-13T00:01:03.4405348Z remote: Compressing objects: 61% (62/101)
2021-07-13T00:01:03.4405922Z remote: Compressing objects: 62% (63/101)
2021-07-13T00:01:03.4406505Z remote: Compressing objects: 63% (64/101)
2021-07-13T00:01:03.4407076Z remote: Compressing objects: 64% (65/101)
2021-07-13T00:01:03.4407674Z remote: Compressing objects: 65% (66/101)
2021-07-13T00:01:03.4408249Z remote: Compressing objects: 66% (67/101)
2021-07-13T00:01:03.4408835Z remote: Compressing objects: 67% (68/101)
2021-07-13T00:01:03.4409420Z remote: Compressing objects: 68% (69/101)
2021-07-13T00:01:03.4409994Z remote: Compressing objects: 69% (70/101)
2021-07-13T00:01:03.4410581Z remote: Compressing objects: 70% (71/101)
2021-07-13T00:01:03.4411620Z remote: Compressing objects: 71% (72/101)
2021-07-13T00:01:03.4425866Z remote: Compressing objects: 72% (73/101)
2021-07-13T00:01:03.4458513Z remote: Compressing objects: 73% (74/101)
2021-07-13T00:01:03.4459547Z remote: Compressing objects: 74% (75/101)
2021-07-13T00:01:03.4460312Z remote: Compressing objects: 75% (76/101)
2021-07-13T00:01:03.4462164Z remote: Compressing objects: 76% (77/101)
2021-07-13T00:01:03.4462841Z remote: Compressing objects: 77% (78/101)
2021-07-13T00:01:03.4464722Z remote: Compressing objects: 78% (79/101)
2021-07-13T00:01:03.4465410Z remote: Compressing objects: 79% (80/101)
2021-07-13T00:01:03.4466034Z remote: Compressing objects: 80% (81/101)
2021-07-13T00:01:03.4466615Z remote: Compressing objects: 81% (82/101)
2021-07-13T00:01:03.4467274Z remote: Compressing objects: 82% (83/101)
2021-07-13T00:01:03.4467975Z remote: Compressing objects: 83% (84/101)
2021-07-13T00:01:03.4468550Z remote: Compressing objects: 84% (85/101)
2021-07-13T00:01:03.4469302Z remote: Compressing objects: 85% (86/101)
2021-07-13T00:01:03.4469934Z remote: Compressing objects: 86% (87/101)
2021-07-13T00:01:03.4470720Z remote: Compressing objects: 87% (88/101)
2021-07-13T00:01:03.4471417Z remote: Compressing objects: 88% (89/101)
2021-07-13T00:01:03.4472145Z remote: Compressing objects: 89% (90/101)
2021-07-13T00:01:03.4472957Z remote: Compressing objects: 90% (91/101)
2021-07-13T00:01:03.4473636Z remote: Compressing objects: 91% (92/101)
2021-07-13T00:01:03.4474288Z remote: Compressing objects: 92% (93/101)
2021-07-13T00:01:03.4475024Z remote: Compressing objects: 93% (94/101)
2021-07-13T00:01:03.4475636Z remote: Compressing objects: 94% (95/101)
2021-07-13T00:01:03.4476361Z remote: Compressing objects: 95% (96/101)
2021-07-13T00:01:03.4477203Z remote: Compressing objects: 96% (97/101)
2021-07-13T00:01:03.4477894Z remote: Compressing objects: 97% (98/101)
2021-07-13T00:01:03.4478612Z remote: Compressing objects: 98% (99/101)
2021-07-13T00:01:03.4479338Z remote: Compressing objects: 99% (100/101)
2021-07-13T00:01:03.4480006Z remote: Compressing objects: 100% (101/101)
2021-07-13T00:01:03.4480693Z remote: Compressing objects: 100% (101/101), done.
2021-07-13T00:01:03.4481377Z Receiving objects: 0% (1/113)
2021-07-13T00:01:03.4482041Z Receiving objects: 1% (2/113)
2021-07-13T00:01:03.4482555Z Receiving objects: 2% (3/113)
2021-07-13T00:01:03.4483132Z Receiving objects: 3% (4/113)
2021-07-13T00:01:03.4483641Z Receiving objects: 4% (5/113)
2021-07-13T00:01:03.4484234Z Receiving objects: 5% (6/113)
2021-07-13T00:01:03.4484766Z Receiving objects: 6% (7/113)
2021-07-13T00:01:03.4485325Z Receiving objects: 7% (8/113)
2021-07-13T00:01:03.4485838Z Receiving objects: 8% (10/113)
2021-07-13T00:01:03.4486488Z Receiving objects: 9% (11/113)
2021-07-13T00:01:03.4487076Z Receiving objects: 10% (12/113)
2021-07-13T00:01:03.4487761Z Receiving objects: 11% (13/113)
2021-07-13T00:01:03.4488392Z Receiving objects: 12% (14/113)
2021-07-13T00:01:03.4489071Z Receiving objects: 13% (15/113)
2021-07-13T00:01:03.4489647Z Receiving objects: 14% (16/113)
2021-07-13T00:01:03.4490200Z Receiving objects: 15% (17/113)
2021-07-13T00:01:03.4490806Z Receiving objects: 16% (19/113)
2021-07-13T00:01:03.4491366Z Receiving objects: 17% (20/113)
2021-07-13T00:01:03.4491968Z Receiving objects: 18% (21/113)
2021-07-13T00:01:03.4492481Z Receiving objects: 19% (22/113)
2021-07-13T00:01:03.4493143Z Receiving objects: 20% (23/113)
2021-07-13T00:01:03.4493816Z Receiving objects: 21% (24/113)
2021-07-13T00:01:03.4494347Z Receiving objects: 22% (25/113)
2021-07-13T00:01:03.4494904Z Receiving objects: 23% (26/113)
2021-07-13T00:01:03.4495446Z Receiving objects: 24% (28/113)
2021-07-13T00:01:03.4496011Z Receiving objects: 25% (29/113)
2021-07-13T00:01:03.4496651Z Receiving objects: 26% (30/113)
2021-07-13T00:01:03.4497239Z Receiving objects: 27% (31/113)
2021-07-13T00:01:03.4497795Z Receiving objects: 28% (32/113)
2021-07-13T00:01:03.4504601Z Receiving objects: 29% (33/113)
2021-07-13T00:01:03.4505188Z Receiving objects: 30% (34/113)
2021-07-13T00:01:03.4505764Z Receiving objects: 31% (36/113)
2021-07-13T00:01:03.4510162Z Receiving objects: 32% (37/113)
2021-07-13T00:01:03.4512798Z Receiving objects: 33% (38/113)
2021-07-13T00:01:03.4513987Z Receiving objects: 34% (39/113)
2021-07-13T00:01:03.4517657Z Receiving objects: 35% (40/113)
2021-07-13T00:01:03.4546214Z Receiving objects: 36% (41/113)
2021-07-13T00:01:03.4546838Z Receiving objects: 37% (42/113)
2021-07-13T00:01:03.4547360Z Receiving objects: 38% (43/113)
2021-07-13T00:01:03.4547924Z Receiving objects: 39% (45/113)
2021-07-13T00:01:03.4548499Z Receiving objects: 40% (46/113)
2021-07-13T00:01:03.4549083Z Receiving objects: 41% (47/113)
2021-07-13T00:01:03.4549598Z Receiving objects: 42% (48/113)
2021-07-13T00:01:03.4550158Z Receiving objects: 43% (49/113)
2021-07-13T00:01:03.4550667Z Receiving objects: 44% (50/113)
2021-07-13T00:01:03.4551281Z Receiving objects: 45% (51/113)
2021-07-13T00:01:03.4551873Z Receiving objects: 46% (52/113)
2021-07-13T00:01:03.4552386Z Receiving objects: 47% (54/113)
2021-07-13T00:01:03.4552947Z Receiving objects: 48% (55/113)
2021-07-13T00:01:03.4553478Z Receiving objects: 49% (56/113)
2021-07-13T00:01:03.4554060Z Receiving objects: 50% (57/113)
2021-07-13T00:01:03.4554778Z Receiving objects: 51% (58/113)
2021-07-13T00:01:03.4555342Z Receiving objects: 52% (59/113)
2021-07-13T00:01:03.4556267Z Receiving objects: 53% (60/113)
2021-07-13T00:01:03.4557277Z Receiving objects: 54% (62/113)
2021-07-13T00:01:03.4558057Z Receiving objects: 55% (63/113)
2021-07-13T00:01:03.4558700Z Receiving objects: 56% (64/113)
2021-07-13T00:01:03.4559218Z Receiving objects: 57% (65/113)
2021-07-13T00:01:03.4559781Z Receiving objects: 58% (66/113)
2021-07-13T00:01:03.4560356Z Receiving objects: 59% (67/113)
2021-07-13T00:01:03.4560867Z Receiving objects: 60% (68/113)
2021-07-13T00:01:03.4834511Z Receiving objects: 61% (69/113)
2021-07-13T00:01:03.4838726Z Receiving objects: 62% (71/113)
2021-07-13T00:01:03.4839445Z Receiving objects: 63% (72/113)
2021-07-13T00:01:03.4839970Z Receiving objects: 64% (73/113)
2021-07-13T00:01:03.4840655Z Receiving objects: 65% (74/113)
2021-07-13T00:01:03.4841176Z Receiving objects: 66% (75/113)
2021-07-13T00:01:03.4841781Z Receiving objects: 67% (76/113)
2021-07-13T00:01:03.4842398Z Receiving objects: 68% (77/113)
2021-07-13T00:01:03.4842912Z Receiving objects: 69% (78/113)
2021-07-13T00:01:03.4843499Z Receiving objects: 70% (80/113)
2021-07-13T00:01:03.4844021Z Receiving objects: 71% (81/113)
2021-07-13T00:01:03.4844629Z Receiving objects: 72% (82/113)
2021-07-13T00:01:03.4845154Z Receiving objects: 73% (83/113)
2021-07-13T00:01:03.4845714Z Receiving objects: 74% (84/113)
2021-07-13T00:01:03.4846223Z Receiving objects: 75% (85/113)
2021-07-13T00:01:03.4847806Z Receiving objects: 76% (86/113)
2021-07-13T00:01:03.4848331Z Receiving objects: 77% (88/113)
2021-07-13T00:01:03.4849100Z Receiving objects: 78% (89/113)
2021-07-13T00:01:03.4849689Z Receiving objects: 79% (90/113)
2021-07-13T00:01:03.4850196Z Receiving objects: 80% (91/113)
2021-07-13T00:01:03.4850787Z Receiving objects: 81% (92/113)
2021-07-13T00:01:03.4851317Z Receiving objects: 82% (93/113)
2021-07-13T00:01:03.4851872Z Receiving objects: 83% (94/113)
2021-07-13T00:01:03.4889415Z Receiving objects: 84% (95/113)
2021-07-13T00:01:03.4890082Z Receiving objects: 85% (97/113)
2021-07-13T00:01:03.4890663Z Receiving objects: 86% (98/113)
2021-07-13T00:01:03.4891273Z Receiving objects: 87% (99/113)
2021-07-13T00:01:03.4891839Z Receiving objects: 88% (100/113)
2021-07-13T00:01:03.4892358Z Receiving objects: 89% (101/113)
2021-07-13T00:01:03.4892918Z Receiving objects: 90% (102/113)
2021-07-13T00:01:03.4893458Z Receiving objects: 91% (103/113)
2021-07-13T00:01:03.4894040Z Receiving objects: 92% (104/113)
2021-07-13T00:01:03.4894871Z Receiving objects: 93% (106/113)
2021-07-13T00:01:03.4895486Z Receiving objects: 94% (107/113)
2021-07-13T00:01:03.4909757Z Receiving objects: 95% (108/113)
2021-07-13T00:01:03.4926444Z remote: Total 113 (delta 17), reused 58 (delta 3), pack-reused 0
2021-07-13T00:01:03.4927224Z Receiving objects: 96% (109/113)
2021-07-13T00:01:03.4927749Z Receiving objects: 97% (110/113)
2021-07-13T00:01:03.4928405Z Receiving objects: 98% (111/113)
2021-07-13T00:01:03.4928947Z Receiving objects: 99% (112/113)
2021-07-13T00:01:03.4929562Z Receiving objects: 100% (113/113)
2021-07-13T00:01:03.4930146Z Receiving objects: 100% (113/113), 134.89 KiB | 2.64 MiB/s, done.
2021-07-13T00:01:03.4930839Z Resolving deltas: 0% (0/17)
2021-07-13T00:01:03.4931484Z Resolving deltas: 5% (1/17)
2021-07-13T00:01:03.4931982Z Resolving deltas: 11% (2/17)
2021-07-13T00:01:03.4932551Z Resolving deltas: 17% (3/17)
2021-07-13T00:01:03.4933043Z Resolving deltas: 23% (4/17)
2021-07-13T00:01:03.4933580Z Resolving deltas: 29% (5/17)
2021-07-13T00:01:03.4934085Z Resolving deltas: 35% (6/17)
2021-07-13T00:01:03.4934652Z Resolving deltas: 41% (7/17)
2021-07-13T00:01:03.4935174Z Resolving deltas: 47% (8/17)
2021-07-13T00:01:03.4935716Z Resolving deltas: 52% (9/17)
2021-07-13T00:01:03.4936204Z Resolving deltas: 58% (10/17)
2021-07-13T00:01:03.4936757Z Resolving deltas: 64% (11/17)
2021-07-13T00:01:03.4937249Z Resolving deltas: 70% (12/17)
2021-07-13T00:01:03.4938016Z Resolving deltas: 76% (13/17)
2021-07-13T00:01:03.4938565Z Resolving deltas: 82% (14/17)
2021-07-13T00:01:03.4939070Z Resolving deltas: 88% (15/17)
2021-07-13T00:01:03.4939608Z Resolving deltas: 94% (16/17)
2021-07-13T00:01:03.4940102Z Resolving deltas: 100% (17/17)
2021-07-13T00:01:03.4940687Z Resolving deltas: 100% (17/17), done.
2021-07-13T00:01:03.5048452Z From https://github.com/submariner-io/lighthouse
2021-07-13T00:01:03.5050596Z * [new ref] ab9c63f0e2481e8b3ec4e0fa7128215734ab1f2f -> origin/devel
2021-07-13T00:01:03.5069192Z ##[endgroup]
2021-07-13T00:01:03.5070360Z ##[group]Determining the checkout info
2021-07-13T00:01:03.5071476Z ##[endgroup]
2021-07-13T00:01:03.5072415Z ##[group]Checking out the ref
2021-07-13T00:01:03.5077316Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-13T00:01:03.5208299Z Switched to a new branch 'devel'
2021-07-13T00:01:03.5213292Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-13T00:01:03.5215771Z ##[endgroup]
2021-07-13T00:01:03.5258018Z [command]/usr/bin/git log -1 --format='%H'
2021-07-13T00:01:03.5283089Z 'ab9c63f0e2481e8b3ec4e0fa7128215734ab1f2f'
2021-07-13T00:01:03.5587130Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-13T00:01:03.5587847Z with:
2021-07-13T00:01:03.5588277Z using:
2021-07-13T00:01:03.5588673Z k8s_version: 1.17
2021-07-13T00:01:03.5589245Z working-directory: .
2021-07-13T00:01:03.5589757Z target: e2e
2021-07-13T00:01:03.5590252Z focus: \[.*\]
2021-07-13T00:01:03.5590768Z skip: \[external-dataplane\]
2021-07-13T00:01:03.5691666Z testdir: test/e2e
2021-07-13T00:01:03.5692265Z ##[endgroup]
2021-07-13T00:01:03.5853772Z ##[group]Reclaiming free space
2021-07-13T00:01:17.1884597Z Filesystem Size Used Avail Use% Mounted on
2021-07-13T00:01:17.1885375Z /dev/root 84G 41G 43G 49% /
2021-07-13T00:01:17.1885827Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-13T00:01:17.1886294Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-13T00:01:17.1886753Z tmpfs 696M 1.1M 695M 1% /run
2021-07-13T00:01:17.1887194Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-13T00:01:17.1887741Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-13T00:01:17.1888247Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-13T00:01:17.1888772Z /dev/loop2 33M 33M 0 100% /snap/snapd/12398
2021-07-13T00:01:17.1889287Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-13T00:01:17.1889777Z /dev/loop3 68M 68M 0 100% /snap/lxd/20326
2021-07-13T00:01:17.1890280Z /dev/loop4 33M 33M 0 100% /snap/snapd/12159
2021-07-13T00:01:17.1890831Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-13T00:01:17.1891297Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-13T00:01:17.1892160Z ##[endgroup]
2021-07-13T00:01:17.2054823Z ##[group]Disable swap
2021-07-13T00:01:17.2373120Z ##[endgroup]
2021-07-13T00:01:17.2506139Z ##[group]Report available RAM
2021-07-13T00:01:17.2533556Z total used free shared buff/cache available
2021-07-13T00:01:17.2534386Z Mem: 6.8Gi 491Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-13T00:01:17.2534841Z Swap: 0B 0B 0B
2021-07-13T00:01:17.2535318Z ##[endgroup]
2021-07-13T00:01:17.2885943Z Downloading Makefile.dapper
2021-07-13T00:01:17.3323009Z Downloading dapper
2021-07-13T00:01:17.5727172Z .dapper.tmp version v0.5.6
2021-07-13T00:01:17.5762052Z Downloading Dockerfile.dapper
2021-07-13T00:01:17.6122221Z docker network create -d bridge kind
2021-07-13T00:01:17.9947192Z 8650e449a2207798d40ff4e38513df3f5279c504c0602b7b140a69db8431f31a
2021-07-13T00:01:17.9971272Z ./.dapper -m bind make --debug=b e2e
2021-07-13T00:01:18.1892934Z Sending build context to Docker daemon 5.982MB
2021-07-13T00:01:18.1893982Z
2021-07-13T00:01:18.1956525Z Step 1/8 : ARG BASE_BRANCH
2021-07-13T00:01:18.1958611Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-13T00:01:19.7015434Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-13T00:01:19.7036372Z b1495d80d526: Pulling fs layer
2021-07-13T00:01:19.7040466Z ddb139a01732: Pulling fs layer
2021-07-13T00:01:19.7041423Z 39df7eb7380d: Pulling fs layer
2021-07-13T00:01:19.7042088Z c0fe454e56fd: Pulling fs layer
2021-07-13T00:01:19.7042775Z fb7cbb68a468: Pulling fs layer
2021-07-13T00:01:19.7043441Z ad9bf639bb4f: Pulling fs layer
2021-07-13T00:01:19.7044050Z 80c3983fcf2e: Pulling fs layer
2021-07-13T00:01:19.7044614Z 1458a8fea605: Pulling fs layer
2021-07-13T00:01:19.7045129Z c0fe454e56fd: Waiting
2021-07-13T00:01:19.7045641Z fb7cbb68a468: Waiting
2021-07-13T00:01:19.7046145Z ad9bf639bb4f: Waiting
2021-07-13T00:01:19.7046615Z 80c3983fcf2e: Waiting
2021-07-13T00:01:19.7047085Z 1458a8fea605: Waiting
2021-07-13T00:01:20.7804761Z b1495d80d526: Verifying Checksum
2021-07-13T00:01:20.7805595Z b1495d80d526: Download complete
2021-07-13T00:01:20.8860315Z 39df7eb7380d: Verifying Checksum
2021-07-13T00:01:20.8901690Z 39df7eb7380d: Download complete
2021-07-13T00:01:21.1916192Z c0fe454e56fd: Verifying Checksum
2021-07-13T00:01:21.1916827Z c0fe454e56fd: Download complete
2021-07-13T00:01:21.2686724Z fb7cbb68a468: Verifying Checksum
2021-07-13T00:01:21.2687364Z fb7cbb68a468: Download complete
2021-07-13T00:01:21.5926243Z ad9bf639bb4f: Verifying Checksum
2021-07-13T00:01:21.5926893Z ad9bf639bb4f: Download complete
2021-07-13T00:01:21.6388890Z 80c3983fcf2e: Verifying Checksum
2021-07-13T00:01:21.6398032Z 80c3983fcf2e: Download complete
2021-07-13T00:01:21.9525444Z 1458a8fea605: Verifying Checksum
2021-07-13T00:01:21.9526156Z 1458a8fea605: Download complete
2021-07-13T00:01:24.0697055Z b1495d80d526: Pull complete
2021-07-13T00:01:27.1642402Z ddb139a01732: Verifying Checksum
2021-07-13T00:01:27.1645843Z ddb139a01732: Download complete
2021-07-13T00:01:38.1654810Z ddb139a01732: Pull complete
2021-07-13T00:01:39.6678954Z 39df7eb7380d: Pull complete
2021-07-13T00:01:39.7366933Z c0fe454e56fd: Pull complete
2021-07-13T00:01:39.8115428Z fb7cbb68a468: Pull complete
2021-07-13T00:01:40.0115937Z ad9bf639bb4f: Pull complete
2021-07-13T00:01:40.0830094Z 80c3983fcf2e: Pull complete
2021-07-13T00:01:40.1626127Z 1458a8fea605: Pull complete
2021-07-13T00:01:40.1671519Z Digest: sha256:ffd2825bc97b24a1d03e4d53de76a58fbd5ce44cb795c9b1f571a035a65c3d38
2021-07-13T00:01:40.1731997Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-13T00:01:40.1824083Z ---> 655a9f35d3cf
2021-07-13T00:01:40.1824868Z Step 3/8 : ARG PROJECT
2021-07-13T00:01:40.2291887Z ---> Running in fedae7a03a5e
2021-07-13T00:01:41.3097029Z Removing intermediate container fedae7a03a5e
2021-07-13T00:01:41.3098369Z ---> 7ce2bd8bf02f
2021-07-13T00:01:41.3099968Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-13T00:01:41.3346988Z ---> Running in 14b35fe8f471
2021-07-13T00:01:42.3966861Z Removing intermediate container 14b35fe8f471
2021-07-13T00:01:42.3970689Z ---> 160d6a254756
2021-07-13T00:01:42.3974297Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-13T00:01:42.4165069Z ---> Running in ad42551713ef
2021-07-13T00:01:43.4313956Z Removing intermediate container ad42551713ef
2021-07-13T00:01:43.4321296Z ---> bee26c878fd6
2021-07-13T00:01:43.4321831Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-13T00:01:43.4520834Z ---> Running in 20be4e6ded9d
2021-07-13T00:01:44.5117344Z Removing intermediate container 20be4e6ded9d
2021-07-13T00:01:44.5119003Z ---> f65d9b2ee43e
2021-07-13T00:01:44.5119590Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-13T00:01:44.5276565Z ---> Running in 601e91e4d4ae
2021-07-13T00:01:45.5871163Z Removing intermediate container 601e91e4d4ae
2021-07-13T00:01:45.5872474Z ---> c0eae58c7549
2021-07-13T00:01:45.5872901Z Step 8/8 : CMD ["sh"]
2021-07-13T00:01:45.6073599Z ---> Running in 48f83ba775bd
2021-07-13T00:01:46.6765946Z Removing intermediate container 48f83ba775bd
2021-07-13T00:01:46.6767103Z ---> 1e9c1b61b0e5
2021-07-13T00:01:46.6808084Z Successfully built 1e9c1b61b0e5
2021-07-13T00:01:46.6877197Z Successfully tagged lighthouse:devel
2021-07-13T00:01:47.2182172Z [lighthouse]$ trap chown -R 1001:121 . exit
2021-07-13T00:01:47.2197726Z [lighthouse]$ mkdir -p bin dist output
2021-07-13T00:01:47.2212600Z [lighthouse]$ make --debug=b e2e
2021-07-13T00:01:47.2227906Z GNU Make 4.3
2021-07-13T00:01:47.2229858Z Built for x86_64-redhat-linux-gnu
2021-07-13T00:01:47.2231279Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-13T00:01:47.2232444Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-13T00:01:47.2248268Z This is free software: you are free to change and redistribute it.
2021-07-13T00:01:47.2249223Z There is NO WARRANTY, to the extent permitted by law.
2021-07-13T00:01:47.2250029Z Reading makefiles...
2021-07-13T00:01:47.2774983Z Makefile:38: warning: overriding recipe for target 'deploy'
2021-07-13T00:01:47.2777590Z /opt/shipyard/Makefile.inc:101: warning: ignoring old recipe for target 'deploy'
2021-07-13T00:01:47.2783367Z Updating makefiles....
2021-07-13T00:01:47.2798398Z Updating goal targets....
2021-07-13T00:01:47.2799595Z File 'e2e' does not exist.
2021-07-13T00:01:47.2801834Z Must remake target 'e2e'.
2021-07-13T00:01:47.2802986Z /opt/shipyard/scripts/e2e.sh --focus "\[.*\]" --skip "\[external-dataplane\]" --testdir "test/e2e" cluster1 cluster2 cluster3
2021-07-13T00:01:47.2830790Z Downloading shflags 1.0.3
2021-07-13T00:01:47.2920549Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-13T00:01:47.2924723Z Dload Upload Total Spent Left Speed
2021-07-13T00:01:47.2925135Z
2021-07-13T00:01:47.3216963Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-13T00:01:47.3218242Z 100 31091 100 31091 0 0 948k 0 --:--:-- --:--:-- --:--:-- 948k
2021-07-13T00:01:47.3938658Z [lighthouse]$ source /opt/shipyard/scripts/lib/utils
2021-07-13T00:01:47.3950410Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:01:47.3961397Z [lighthouse]$ script_name=utils
2021-07-13T00:01:47.3971858Z [lighthouse]$ exec_name=e2e.sh
2021-07-13T00:01:47.3989386Z [lighthouse]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-13T00:01:47.4001573Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:01:47.4012812Z [lighthouse]$ script_name=cluster_settings
2021-07-13T00:01:47.4023182Z [lighthouse]$ exec_name=e2e.sh
2021-07-13T00:01:47.4042411Z [lighthouse]$ broker=cluster1
2021-07-13T00:01:47.4065424Z [lighthouse]$ declare -gA cluster_nodes
2021-07-13T00:01:47.4066438Z [lighthouse]$ cluster_nodes[cluster1]=control-plane worker
2021-07-13T00:01:47.4078498Z [lighthouse]$ cluster_nodes[cluster2]=control-plane worker
2021-07-13T00:01:47.4088846Z [lighthouse]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-13T00:01:47.4100225Z [lighthouse]$ declare -gA cluster_subm
2021-07-13T00:01:47.4111999Z [lighthouse]$ cluster_subm[cluster1]=true
2021-07-13T00:01:47.4124323Z [lighthouse]$ cluster_subm[cluster2]=true
2021-07-13T00:01:47.4135722Z [lighthouse]$ cluster_subm[cluster3]=true
2021-07-13T00:01:47.4147283Z [lighthouse]$ declare -gA cluster_cni
2021-07-13T00:01:47.4169799Z [lighthouse]$ cluster_cni[cluster2]=weave
2021-07-13T00:01:47.4174131Z [lighthouse]$ cluster_cni[cluster3]=weave
2021-07-13T00:01:47.4188205Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:01:47.4199319Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:01:47.4210145Z [lighthouse]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-13T00:01:47.4231248Z [lighthouse]$ export KUBECONFIG
2021-07-13T00:01:47.4256839Z [lighthouse]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-13T00:01:47.4267648Z [lighthouse]$ find /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs -type f -printf %p:
2021-07-13T00:01:47.4282645Z find: '/go/src/github.com/submariner-io/lighthouse/output/kubeconfigs': No such file or directory
2021-07-13T00:01:47.4294327Z [lighthouse]$ :
2021-07-13T00:01:47.4319172Z [lighthouse]$ deploy_env_once
2021-07-13T00:01:47.4329647Z [lighthouse]$ deploy_env_once
2021-07-13T00:01:47.4341508Z 
2021-07-13T00:01:47.6763551Z [lighthouse]$ make deploy
2021-07-13T00:01:47.6790294Z GNU Make 4.3
2021-07-13T00:01:47.6791230Z Built for x86_64-redhat-linux-gnu
2021-07-13T00:01:47.6792045Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-13T00:01:47.6792867Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-13T00:01:47.6793696Z This is free software: you are free to change and redistribute it.
2021-07-13T00:01:47.6794460Z There is NO WARRANTY, to the extent permitted by law.
2021-07-13T00:01:47.6795030Z Reading makefiles...
2021-07-13T00:01:47.6796184Z make[1]: Entering directory '/go/src/github.com/submariner-io/lighthouse'
2021-07-13T00:01:47.7339867Z Makefile:38: warning: overriding recipe for target 'deploy'
2021-07-13T00:01:47.7340560Z Updating makefiles....
2021-07-13T00:01:47.7342650Z /opt/shipyard/Makefile.inc:101: warning: ignoring old recipe for target 'deploy'
2021-07-13T00:01:47.7351181Z Updating goal targets....
2021-07-13T00:01:47.7352128Z File 'deploy' does not exist.
2021-07-13T00:01:47.7352794Z File 'images' does not exist.
2021-07-13T00:01:47.7353649Z File 'package/.image.lighthouse-agent' does not exist.
2021-07-13T00:01:47.7406909Z find: 'bin/lighthouse-agent': No such file or directory
2021-07-13T00:01:48.0285460Z File 'FORCE_IMAGE' does not exist.
2021-07-13T00:01:48.0286308Z Must remake target 'FORCE_IMAGE'.
2021-07-13T00:01:48.0287098Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-13T00:01:48.0287950Z File 'bin/lighthouse-agent' does not exist.
2021-07-13T00:01:48.0288775Z File 'vendor/modules.txt' does not exist.
2021-07-13T00:01:48.0289542Z Must remake target 'vendor/modules.txt'.
2021-07-13T00:01:48.0290054Z go mod download
2021-07-13T00:02:20.5781897Z go mod vendor
2021-07-13T00:02:21.7205736Z go mod tidy
2021-07-13T00:02:22.1578253Z Successfully remade target file 'vendor/modules.txt'.
2021-07-13T00:02:22.1615194Z Must remake target 'bin/lighthouse-agent'.
2021-07-13T00:02:22.1616255Z /opt/shipyard/scripts/compile.sh bin/lighthouse-agent pkg/agent/main.go
2021-07-13T00:02:22.2002257Z [lighthouse]$ mkdir -p bin
2021-07-13T00:02:22.2013793Z Building 'bin/lighthouse-agent' (ldflags: '')
2021-07-13T00:02:22.2022915Z [lighthouse]$ ldflags=-s -w 
2021-07-13T00:02:22.2034949Z [lighthouse]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -o bin/lighthouse-agent pkg/agent/main.go
2021-07-13T00:03:30.1071166Z [lighthouse]$ upx bin/lighthouse-agent
2021-07-13T00:03:35.8780737Z Ultimate Packer for eXecutables
2021-07-13T00:03:35.8782150Z Copyright (C) 1996 - 2020
2021-07-13T00:03:35.8782782Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-13T00:03:35.8783222Z
2021-07-13T00:03:35.8783630Z File size Ratio Format Name
2021-07-13T00:03:35.8784380Z -------------------- ------ ----------- -----------
2021-07-13T00:03:35.8785180Z 29569024 -> 8563348 28.96% linux/amd64 lighthouse-agent
2021-07-13T00:03:35.8785569Z
2021-07-13T00:03:35.8785915Z Packed 1 file.
2021-07-13T00:03:35.8786691Z Successfully remade target file 'bin/lighthouse-agent'.
2021-07-13T00:03:35.8787705Z Must remake target 'package/.image.lighthouse-agent'.
2021-07-13T00:03:35.8789272Z /opt/shipyard/scripts/build_image.sh -i lighthouse-agent -f package/Dockerfile.lighthouse-agent -h package/.image.lighthouse-agent
2021-07-13T00:03:35.9178185Z flags:WARN flag short name (h) already defined
2021-07-13T00:03:35.9695652Z [lighthouse]$ set -e
2021-07-13T00:03:35.9707043Z [lighthouse]$ cache_image=quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:35.9715036Z [lighthouse]$ cache_flag=
2021-07-13T00:03:35.9728746Z [lighthouse]$ cache_flag=--cache-from quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:35.9746963Z [lighthouse]$ docker image ls -q quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:36.2392503Z [lighthouse]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:37.9533552Z devel: Pulling from submariner/lighthouse-agent
2021-07-13T00:03:37.9534414Z 24e80574ab61: Pulling fs layer
2021-07-13T00:03:37.9534878Z 977c13f0686c: Pulling fs layer
2021-07-13T00:03:38.3114189Z 24e80574ab61: Download complete
2021-07-13T00:03:38.3874738Z 24e80574ab61: Pull complete
2021-07-13T00:03:38.3996431Z 977c13f0686c: Verifying Checksum
2021-07-13T00:03:38.3997204Z 977c13f0686c: Download complete
2021-07-13T00:03:39.2061340Z 977c13f0686c: Pull complete
2021-07-13T00:03:39.2101557Z Digest: sha256:a98d59631fc7e8719a7069090a8283ccec411cf1ac09b3a23bb24d11a43de085
2021-07-13T00:03:39.2121791Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:39.2150537Z quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:39.2194582Z [lighthouse]$ grep FROM package/Dockerfile.lighthouse-agent
2021-07-13T00:03:39.2203929Z [lighthouse]$ cut -f2 -d 
2021-07-13T00:03:39.2213531Z [lighthouse]$ grep -v scratch
2021-07-13T00:03:39.2215122Z [lighthouse]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-13T00:03:39.2216259Z 
2021-07-13T00:03:39.9674250Z [lighthouse]$ docker buildx use buildx_builder
2021-07-13T00:03:40.6935132Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-13T00:03:40.6969417Z [lighthouse]$ docker buildx create --name buildx_builder --use
2021-07-13T00:03:41.4511235Z buildx_builder
2021-07-13T00:03:41.4546836Z [lighthouse]$ docker buildx build --load -t quay.io/submariner/lighthouse-agent:dev --cache-from quay.io/submariner/lighthouse-agent:devel -f package/Dockerfile.lighthouse-agent --iidfile package/.image.lighthouse-agent --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-13T00:03:42.2044538Z #1 [internal] booting buildkit
2021-07-13T00:03:42.2045622Z #1 sha256:e842de35dc2fd1d97739af29cd15485cfea4f748562c6af703a240768fba15e4
2021-07-13T00:03:42.3548713Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-13T00:03:46.7119634Z #1 pulling image moby/buildkit:buildx-stable-1 4.4s done
2021-07-13T00:03:46.7120419Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-13T00:03:47.0013935Z #1 creating container buildx_buildkit_buildx_builder0 0.4s done
2021-07-13T00:03:47.1494797Z #1 DONE 4.8s
2021-07-13T00:03:47.3001847Z
2021-07-13T00:03:47.3004676Z #2 [internal] load build definition from Dockerfile.lighthouse-agent
2021-07-13T00:03:47.3005981Z #2 sha256:cf5db0ed36e8e02576741d2f675b94a265665762e633eaaa6373c5e2f5db3fdf
2021-07-13T00:03:47.3012112Z #2 transferring dockerfile: 205B done
2021-07-13T00:03:47.3012655Z #2 DONE 0.0s
2021-07-13T00:03:47.3012895Z
2021-07-13T00:03:47.3013318Z #3 [internal] load .dockerignore
2021-07-13T00:03:47.3014166Z #3 sha256:28309162871ab39e7c5a4ab71df856c059359614447c6bc76ad835c9ece3ad8b
2021-07-13T00:03:47.3015022Z #3 transferring context: 2B done
2021-07-13T00:03:47.3015453Z #3 DONE 0.0s
2021-07-13T00:03:47.3015692Z
2021-07-13T00:03:47.3016077Z #5 [internal] load build context
2021-07-13T00:03:47.3016973Z #5 sha256:80eb9d6782f0e853ce107fce4c9303184e0901790b093755081ae98cad27a3ff
2021-07-13T00:03:47.3017782Z #5 DONE 0.0s
2021-07-13T00:03:47.3022262Z
2021-07-13T00:03:47.3023863Z #4 [1/2] WORKDIR /var/submariner
2021-07-13T00:03:47.3024953Z #4 sha256:6eb84d1e358bd8cbe94a67130cc49a41d08c167ae3df7a6c8de330841c136804
2021-07-13T00:03:47.3025923Z #4 DONE 0.0s
2021-07-13T00:03:47.3026158Z
2021-07-13T00:03:47.3027299Z #7 importing cache manifest from quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:47.3028528Z #7 sha256:2b45fbcbc22a9d3436416d460ee509cc9b01372ea022dba9c139193a50b3ba27
2021-07-13T00:03:48.4798342Z #7 DONE 1.1s
2021-07-13T00:03:48.4798695Z
2021-07-13T00:03:48.4799111Z #5 [internal] load build context
2021-07-13T00:03:48.4800000Z #5 sha256:80eb9d6782f0e853ce107fce4c9303184e0901790b093755081ae98cad27a3ff
2021-07-13T00:03:48.6263778Z #5 transferring context: 8.57MB 0.2s done
2021-07-13T00:03:48.6264349Z #5 DONE 0.2s
2021-07-13T00:03:48.6264592Z
2021-07-13T00:03:48.6266094Z #6 [2/2] COPY bin/lighthouse-agent /usr/local/bin/
2021-07-13T00:03:48.6267182Z #6 sha256:30110dbcd4b560cb15fbb1c4c30c82af98537038a3b20fa655d5eb3488d6d445
2021-07-13T00:03:48.6268145Z #6 CACHED
2021-07-13T00:03:48.7761459Z
2021-07-13T00:03:48.7763814Z #8 exporting to oci image format
2021-07-13T00:03:48.7765172Z #8 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:03:48.7766218Z #8 exporting layers done
2021-07-13T00:03:48.7767251Z #8 exporting manifest sha256:e32493d0463b1d17bc53a7f243c8b8595f65f93d5fbc94352d7cd9c92783484c done
2021-07-13T00:03:48.7769357Z #8 exporting config sha256:d3e3c76422573b3e40e0fa6a8548e45e54472ec3d1136875268b38a5f8018685 done
2021-07-13T00:03:48.9270327Z #8 ...
2021-07-13T00:03:48.9270674Z
2021-07-13T00:03:48.9271982Z #6 [2/2] COPY bin/lighthouse-agent /usr/local/bin/
2021-07-13T00:03:48.9273079Z #6 sha256:30110dbcd4b560cb15fbb1c4c30c82af98537038a3b20fa655d5eb3488d6d445
2021-07-13T00:03:48.9274530Z #6 sha256:977c13f0686cbadd072e280781cbd09b90779515bfcd8e593518d126a70f3c8b 0B / 8.30MB 0.2s
2021-07-13T00:03:48.9275991Z #6 sha256:24e80574ab6178a27e3250fe9f2ab83dcf936e88c44ef9847f5ac2963fde395f 0B / 125B 0.2s
2021-07-13T00:03:48.9277145Z #6 CACHED
2021-07-13T00:03:49.0775367Z
2021-07-13T00:03:49.0776890Z #6 [2/2] COPY bin/lighthouse-agent /usr/local/bin/
2021-07-13T00:03:49.0778018Z #6 sha256:30110dbcd4b560cb15fbb1c4c30c82af98537038a3b20fa655d5eb3488d6d445
2021-07-13T00:03:49.0783248Z #6 sha256:24e80574ab6178a27e3250fe9f2ab83dcf936e88c44ef9847f5ac2963fde395f 125B / 125B 0.3s done
2021-07-13T00:03:49.0784406Z #6 CACHED
2021-07-13T00:03:49.0785592Z
2021-07-13T00:03:49.0786020Z #8 exporting to oci image format
2021-07-13T00:03:49.0787010Z #8 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:03:49.2303671Z #8 ...
2021-07-13T00:03:49.2303996Z
2021-07-13T00:03:49.2305094Z #6 [2/2] COPY bin/lighthouse-agent /usr/local/bin/
2021-07-13T00:03:49.2306201Z #6 sha256:30110dbcd4b560cb15fbb1c4c30c82af98537038a3b20fa655d5eb3488d6d445
2021-07-13T00:03:49.2308712Z #6 sha256:977c13f0686cbadd072e280781cbd09b90779515bfcd8e593518d126a70f3c8b 8.30MB / 8.30MB 0.4s done
2021-07-13T00:03:49.2309650Z #6 CACHED
2021-07-13T00:03:49.2309922Z
2021-07-13T00:03:49.2310319Z #8 exporting to oci image format
2021-07-13T00:03:49.2311333Z #8 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:03:49.2312263Z #8 sending tarball
2021-07-13T00:03:49.3137648Z #8 sending tarball 0.2s done
2021-07-13T00:03:49.3138323Z #8 DONE 0.7s
2021-07-13T00:03:49.3138571Z
2021-07-13T00:03:49.3138944Z #10 exporting cache
2021-07-13T00:03:49.3139968Z #10 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-13T00:03:49.3141268Z #10 preparing build cache for export done
2021-07-13T00:03:49.3141786Z #10 DONE 0.0s
2021-07-13T00:03:49.3142023Z
2021-07-13T00:03:49.3148837Z #9 importing to docker
2021-07-13T00:03:49.3149722Z #9 sha256:57ff2cb25b07c94433a3467566a0aa1650b92c943b186127353e3b4efc24968b
2021-07-13T00:03:49.3150517Z #9 DONE 0.0s
2021-07-13T00:03:49.3235921Z [lighthouse]$ docker tag quay.io/submariner/lighthouse-agent:dev quay.io/submariner/lighthouse-agent:devel
2021-07-13T00:03:49.5945633Z Successfully remade target file 'package/.image.lighthouse-agent'.
2021-07-13T00:03:49.5949299Z File 'package/.image.lighthouse-coredns' does not exist.
2021-07-13T00:03:49.5994636Z find: 'bin/lighthouse-coredns': No such file or directory
2021-07-13T00:03:49.8725463Z File 'bin/lighthouse-coredns' does not exist.
2021-07-13T00:03:49.8726523Z Must remake target 'bin/lighthouse-coredns'.
2021-07-13T00:03:49.8727618Z /opt/shipyard/scripts/compile.sh bin/lighthouse-coredns pkg/coredns/main.go
2021-07-13T00:03:49.9209167Z [lighthouse]$ mkdir -p bin
2021-07-13T00:03:49.9225074Z Building 'bin/lighthouse-coredns' (ldflags: '')
2021-07-13T00:03:49.9238399Z [lighthouse]$ ldflags=-s -w 
2021-07-13T00:03:49.9253451Z [lighthouse]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -o bin/lighthouse-coredns pkg/coredns/main.go
2021-07-13T00:04:21.9469042Z [lighthouse]$ upx bin/lighthouse-coredns
2021-07-13T00:04:30.4514322Z Ultimate Packer for eXecutables
2021-07-13T00:04:30.4515893Z Copyright (C) 1996 - 2020
2021-07-13T00:04:30.4516776Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-13T00:04:30.4517740Z
2021-07-13T00:04:30.4518146Z File size Ratio Format Name
2021-07-13T00:04:30.4518967Z -------------------- ------ ----------- -----------
2021-07-13T00:04:30.4519802Z 41758720 -> 12152632 29.10% linux/amd64 lighthouse-coredns
2021-07-13T00:04:30.4520201Z
2021-07-13T00:04:30.4520549Z Packed 1 file.
2021-07-13T00:04:30.4521426Z Successfully remade target file 'bin/lighthouse-coredns'.
2021-07-13T00:04:30.4522487Z Must remake target 'package/.image.lighthouse-coredns'.
2021-07-13T00:04:30.4524171Z /opt/shipyard/scripts/build_image.sh -i lighthouse-coredns -f package/Dockerfile.lighthouse-coredns -h package/.image.lighthouse-coredns
2021-07-13T00:04:30.4899329Z flags:WARN flag short name (h) already defined
2021-07-13T00:04:30.5375458Z [lighthouse]$ set -e
2021-07-13T00:04:30.5389177Z [lighthouse]$ cache_image=quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:30.5400003Z [lighthouse]$ cache_flag=
2021-07-13T00:04:30.5411258Z [lighthouse]$ cache_flag=--cache-from quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:30.5427487Z [lighthouse]$ docker image ls -q quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:30.7996372Z [lighthouse]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:32.4566832Z devel: Pulling from submariner/lighthouse-coredns
2021-07-13T00:04:32.4569681Z 088e56360f76: Pulling fs layer
2021-07-13T00:04:32.4570139Z 5235624ac275: Pulling fs layer
2021-07-13T00:04:32.8252812Z 088e56360f76: Verifying Checksum
2021-07-13T00:04:32.8253369Z 088e56360f76: Download complete
2021-07-13T00:04:32.8923387Z 5235624ac275: Verifying Checksum
2021-07-13T00:04:32.8923930Z 5235624ac275: Download complete
2021-07-13T00:04:32.9670958Z 088e56360f76: Pull complete
2021-07-13T00:04:33.5086376Z 5235624ac275: Pull complete
2021-07-13T00:04:33.5129612Z Digest: sha256:cf701f2930fce733f2c257c8efa6a744a9cf7d32fae99a5b8f5274622d1f840b
2021-07-13T00:04:33.5151234Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:33.5188905Z quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:33.5214948Z [lighthouse]$ grep FROM package/Dockerfile.lighthouse-coredns
2021-07-13T00:04:33.5226339Z [lighthouse]$ cut -f2 -d 
2021-07-13T00:04:33.5227072Z [lighthouse]$ grep -v scratch
2021-07-13T00:04:33.5238117Z [lighthouse]$ cache_flag+= --cache-from debian:stable-slim
2021-07-13T00:04:33.5246122Z [lighthouse]$ docker pull debian:stable-slim
2021-07-13T00:04:35.0807338Z stable-slim: Pulling from library/debian
2021-07-13T00:04:35.4027160Z b858e2d8875f: Pulling fs layer
2021-07-13T00:04:35.9429854Z b858e2d8875f: Verifying Checksum
2021-07-13T00:04:35.9430795Z b858e2d8875f: Download complete
2021-07-13T00:04:36.9871707Z b858e2d8875f: Pull complete
2021-07-13T00:04:36.9916455Z Digest: sha256:ec3cdff4b1445e4d7e5c5c0773a9140ae8eb0d6e70328d67fe56854d1078b61f
2021-07-13T00:04:36.9930149Z Status: Downloaded newer image for debian:stable-slim
2021-07-13T00:04:36.9956272Z docker.io/library/debian:stable-slim
2021-07-13T00:04:36.9967086Z [lighthouse]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-13T00:04:36.9973944Z 
2021-07-13T00:04:37.7369520Z [lighthouse]$ docker buildx use buildx_builder
2021-07-13T00:04:38.4773230Z [lighthouse]$ docker buildx build --load -t quay.io/submariner/lighthouse-coredns:dev --cache-from quay.io/submariner/lighthouse-coredns:devel --cache-from debian:stable-slim -f package/Dockerfile.lighthouse-coredns --iidfile package/.image.lighthouse-coredns --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-13T00:04:39.5052818Z #1 [internal] load build definition from Dockerfile.lighthouse-coredns
2021-07-13T00:04:39.5054157Z #1 sha256:0f3f0f695077005488af2624c31bc9e547cb1987de099d40539e84a79abce7f9
2021-07-13T00:04:39.5057740Z #1 transferring dockerfile: 358B done
2021-07-13T00:04:39.5058305Z #1 DONE 0.0s
2021-07-13T00:04:39.5058550Z
2021-07-13T00:04:39.5058971Z #2 [internal] load .dockerignore
2021-07-13T00:04:39.5060730Z #2 sha256:8e6c8d3b96dbef9827998a4e2ac8f2d5abe03ba4c807364e32ca22ea963c4d64
2021-07-13T00:04:39.5061847Z #2 transferring context: 2B done
2021-07-13T00:04:39.5062280Z #2 DONE 0.0s
2021-07-13T00:04:39.5062517Z
2021-07-13T00:04:39.5063393Z #3 [internal] load metadata for docker.io/library/debian:stable-slim
2021-07-13T00:04:39.5064572Z #3 sha256:1f4135ad7b991da43d62098afc9b590afad696b89ebbcf75e55438bd2aee3a24
2021-07-13T00:04:40.7069451Z #3 DONE 1.2s
2021-07-13T00:04:40.7069853Z
2021-07-13T00:04:40.7070273Z #7 [internal] load build context
2021-07-13T00:04:40.7071305Z #7 sha256:ce10bdbb506354aa872e53f6a3773de34e4a43eca6385d9503b60584bec8859a
2021-07-13T00:04:40.7072252Z #7 DONE 0.0s
2021-07-13T00:04:40.7072492Z
2021-07-13T00:04:40.7074387Z #4 [stage-0 1/2] FROM docker.io/library/debian:stable-slim@sha256:ec3cdff4b1445e4d7e5c5c0773a9140ae8eb0d6e70328d67fe56854d1078b61f
2021-07-13T00:04:40.7076307Z #4 sha256:debd42d4a197be0de6712e114f0c3f17d499becbea24abf7ca5e666de3ee45ad
2021-07-13T00:04:40.7078778Z #4 resolve docker.io/library/debian:stable-slim@sha256:ec3cdff4b1445e4d7e5c5c0773a9140ae8eb0d6e70328d67fe56854d1078b61f done
2021-07-13T00:04:40.7079975Z #4 DONE 0.0s
2021-07-13T00:04:40.7080216Z
2021-07-13T00:04:40.7082162Z #10 importing cache manifest from debian:stable-slim
2021-07-13T00:04:40.7083261Z #10 sha256:62fed8633726c055db6e4cb19ec87fb087be9df6675aa365f73d7ed879b75e2a
2021-07-13T00:04:41.9078467Z #10 ...
2021-07-13T00:04:41.9079258Z
2021-07-13T00:04:41.9080851Z #9 importing cache manifest from quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:41.9082458Z #9 sha256:c9b98271fa5af2c2431700fcceeebcac2d590a6ee86b864b981c88eacf1e99ac
2021-07-13T00:04:41.9083673Z #9 DONE 1.2s
2021-07-13T00:04:42.0580409Z
2021-07-13T00:04:42.0582213Z #10 importing cache manifest from debian:stable-slim
2021-07-13T00:04:42.0583386Z #10 sha256:62fed8633726c055db6e4cb19ec87fb087be9df6675aa365f73d7ed879b75e2a
2021-07-13T00:04:42.1655509Z #10 DONE 1.5s
2021-07-13T00:04:42.1655929Z
2021-07-13T00:04:42.1657946Z #4 [stage-0 1/2] FROM docker.io/library/debian:stable-slim@sha256:ec3cdff4b1445e4d7e5c5c0773a9140ae8eb0d6e70328d67fe56854d1078b61f
2021-07-13T00:04:42.1659876Z #4 sha256:debd42d4a197be0de6712e114f0c3f17d499becbea24abf7ca5e666de3ee45ad
2021-07-13T00:04:42.1660931Z #4 DONE 0.0s
2021-07-13T00:04:42.1664488Z
2021-07-13T00:04:42.1665842Z #7 [internal] load build context
2021-07-13T00:04:42.1668338Z #7 sha256:ce10bdbb506354aa872e53f6a3773de34e4a43eca6385d9503b60584bec8859a
2021-07-13T00:04:42.4297761Z #7 transferring context: 12.16MB 0.3s done
2021-07-13T00:04:42.4298268Z #7 DONE 0.3s
2021-07-13T00:04:42.4298513Z
2021-07-13T00:04:42.4300289Z #5 [stage-0 2/2] RUN apt-get update && apt-get -y install ca-certificates && update-ca-certificates
2021-07-13T00:04:42.4307876Z #5 sha256:7f017e67bd919e3055cb6badbc2b58093137306d3616e1eaa145bf7f91b34f1d
2021-07-13T00:04:42.4308792Z #5 CACHED
2021-07-13T00:04:42.4309042Z
2021-07-13T00:04:42.4310063Z #6 [stage-1 1/2] COPY --from=0 /etc/ssl/certs /etc/ssl/certs
2021-07-13T00:04:42.4311190Z #6 sha256:b2f6916e5d6cfe7f696c481268cd87d4ab5c41ca70eed9940c615deed2a80979
2021-07-13T00:04:42.4312120Z #6 CACHED
2021-07-13T00:04:42.4312362Z
2021-07-13T00:04:42.4313184Z #8 [stage-1 2/2] COPY bin/lighthouse-coredns /usr/local/bin/
2021-07-13T00:04:42.4314240Z #8 sha256:65bc5417b7f29bd6f41287d011b25773a069cd1fb4c867e93ce0cf1b7933deef
2021-07-13T00:04:42.4315077Z #8 CACHED
2021-07-13T00:04:42.4315303Z
2021-07-13T00:04:42.4315717Z #11 exporting to oci image format
2021-07-13T00:04:42.4316725Z #11 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:04:42.4317883Z #11 exporting layers done
2021-07-13T00:04:42.4319714Z #11 exporting manifest sha256:1ff19ca90b00341cbc8a2c2dc18f7b3719ec0432bc9807e384edb1009596c94b 0.0s done
2021-07-13T00:04:42.4321752Z #11 exporting config sha256:26c691eb5e983eacf0a602ef3e48dbde3b3caf68a58cf25658ca13d6211b405f 0.0s done
2021-07-13T00:04:42.7302161Z #11 ...
2021-07-13T00:04:42.7302627Z
2021-07-13T00:04:42.7305066Z #8 [stage-1 2/2] COPY bin/lighthouse-coredns /usr/local/bin/
2021-07-13T00:04:42.7307369Z #8 sha256:65bc5417b7f29bd6f41287d011b25773a069cd1fb4c867e93ce0cf1b7933deef
2021-07-13T00:04:42.7308643Z #8 sha256:5235624ac2751c33b5c94983efe16357e6cd3f6876d60231328de5770b10790d 0B / 11.79MB 0.2s
2021-07-13T00:04:42.7309805Z #8 sha256:088e56360f766989d6a35236ec70a156f42280a7b049a115b75d690d9e460290 0B / 130.45kB 0.2s
2021-07-13T00:04:42.7310605Z #8 CACHED
2021-07-13T00:04:42.8808642Z
2021-07-13T00:04:42.8810080Z #8 [stage-1 2/2] COPY bin/lighthouse-coredns /usr/local/bin/
2021-07-13T00:04:42.8811180Z #8 sha256:65bc5417b7f29bd6f41287d011b25773a069cd1fb4c867e93ce0cf1b7933deef
2021-07-13T00:04:42.8812452Z #8 sha256:088e56360f766989d6a35236ec70a156f42280a7b049a115b75d690d9e460290 130.45kB / 130.45kB 0.3s done
2021-07-13T00:04:42.8813200Z #8 CACHED
2021-07-13T00:04:42.8813442Z
2021-07-13T00:04:42.8813860Z #11 exporting to oci image format
2021-07-13T00:04:42.8814865Z #11 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:04:43.0341604Z #11 ...
2021-07-13T00:04:43.0341922Z
2021-07-13T00:04:43.0373214Z #8 [stage-1 2/2] COPY bin/lighthouse-coredns /usr/local/bin/
2021-07-13T00:04:43.0374360Z #8 sha256:65bc5417b7f29bd6f41287d011b25773a069cd1fb4c867e93ce0cf1b7933deef
2021-07-13T00:04:43.0375645Z #8 sha256:5235624ac2751c33b5c94983efe16357e6cd3f6876d60231328de5770b10790d 11.79MB / 11.79MB 0.5s done
2021-07-13T00:04:43.0376447Z #8 CACHED
2021-07-13T00:04:43.0376700Z
2021-07-13T00:04:43.0377094Z #11 exporting to oci image format
2021-07-13T00:04:43.0378100Z #11 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-13T00:04:43.0379063Z #11 sending tarball
2021-07-13T00:04:43.1869496Z #11 sending tarball 0.3s done
2021-07-13T00:04:43.1870052Z #11 DONE 0.8s
2021-07-13T00:04:43.1870300Z
2021-07-13T00:04:43.1870703Z #13 exporting cache
2021-07-13T00:04:43.1871613Z #13 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-13T00:04:43.1872610Z #13 preparing build cache for export done
2021-07-13T00:04:43.1873066Z #13 DONE 0.0s
2021-07-13T00:04:43.1873308Z
2021-07-13T00:04:43.1873683Z #12 importing to docker
2021-07-13T00:04:43.1874733Z #12 sha256:61ee63dc5fd80bf08e89b71baaf3b8d3f8320f9c75a5a672ea15cc833fbeed48
2021-07-13T00:04:43.1875733Z #12 DONE 0.0s
2021-07-13T00:04:43.1931081Z [lighthouse]$ docker tag quay.io/submariner/lighthouse-coredns:dev quay.io/submariner/lighthouse-coredns:devel
2021-07-13T00:04:43.4618188Z Successfully remade target file 'package/.image.lighthouse-coredns'.
2021-07-13T00:04:43.4619307Z Must remake target 'images'.
2021-07-13T00:04:43.4620050Z Successfully remade target file 'images'.
2021-07-13T00:04:43.4621112Z File 'clusters' does not exist.
2021-07-13T00:04:43.4621780Z Must remake target 'clusters'.
2021-07-13T00:04:43.4623464Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.17" --cluster_settings /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings --cluster_settings /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings
2021-07-13T00:04:43.5340204Z Running with: k8s_version=1.17.17, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings, timeout=5m
2021-07-13T00:04:43.5368897Z [lighthouse]$ source /opt/shipyard/scripts/lib/utils
2021-07-13T00:04:43.5382940Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:04:43.5395502Z [lighthouse]$ script_name=utils
2021-07-13T00:04:43.5407181Z [lighthouse]$ exec_name=clusters.sh
2021-07-13T00:04:43.5427551Z [lighthouse]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-13T00:04:43.5443358Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:04:43.5457440Z [lighthouse]$ script_name=cluster_settings
2021-07-13T00:04:43.5468482Z [lighthouse]$ exec_name=clusters.sh
2021-07-13T00:04:43.5488767Z [lighthouse]$ broker=cluster1
2021-07-13T00:04:43.5499252Z [lighthouse]$ declare -gA cluster_nodes
2021-07-13T00:04:43.5510416Z [lighthouse]$ cluster_nodes[cluster1]=control-plane worker
2021-07-13T00:04:43.5521834Z [lighthouse]$ cluster_nodes[cluster2]=control-plane worker
2021-07-13T00:04:43.5534479Z [lighthouse]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-13T00:04:43.5546126Z [lighthouse]$ declare -gA cluster_subm
2021-07-13T00:04:43.5557245Z [lighthouse]$ cluster_subm[cluster1]=true
2021-07-13T00:04:43.5569315Z [lighthouse]$ cluster_subm[cluster2]=true
2021-07-13T00:04:43.5582235Z [lighthouse]$ cluster_subm[cluster3]=true
2021-07-13T00:04:43.5594577Z [lighthouse]$ declare -gA cluster_cni
2021-07-13T00:04:43.5607402Z [lighthouse]$ cluster_cni[cluster2]=weave
2021-07-13T00:04:43.5619175Z [lighthouse]$ cluster_cni[cluster3]=weave
2021-07-13T00:04:43.5632189Z [lighthouse]$ source /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings
2021-07-13T00:04:43.5644994Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:04:43.5657786Z [lighthouse]$ script_name=cluster_settings
2021-07-13T00:04:43.5670964Z [lighthouse]$ exec_name=clusters.sh
2021-07-13T00:04:43.5692399Z [lighthouse]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-13T00:04:43.5704224Z [lighthouse]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-13T00:04:43.5716538Z [lighthouse]$ cluster_nodes[cluster3]=control-plane worker
2021-07-13T00:04:43.5746997Z [lighthouse]$ cat <<EOM
2021-07-13T00:04:43.5748409Z Cluster settings::
2021-07-13T00:04:43.5749184Z broker - ${broker@Q}
2021-07-13T00:04:43.5749797Z clusters - ${clusters[*]@Q}
2021-07-13T00:04:43.5750500Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-13T00:04:43.5751331Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-13T00:04:43.5752211Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-13T00:04:43.5752864Z EOM
2021-07-13T00:04:43.5774054Z [lighthouse]$ typeset -p cluster_cni
2021-07-13T00:04:43.5788496Z [lighthouse]$ cut -f 2- -d=
2021-07-13T00:04:43.5817697Z [lighthouse]$ typeset -p cluster_nodes
2021-07-13T00:04:43.5832088Z [lighthouse]$ cut -f 2- -d=
2021-07-13T00:04:43.5861017Z [lighthouse]$ typeset -p cluster_subm
2021-07-13T00:04:43.5877886Z [lighthouse]$ cut -f 2- -d=
2021-07-13T00:04:43.5895936Z Cluster settings::
2021-07-13T00:04:43.5896735Z broker - 'cluster1'
2021-07-13T00:04:43.5897472Z clusters - 'cluster1' 'cluster2' 'cluster3'
2021-07-13T00:04:43.5898719Z cni - ([cluster3]="weave" [cluster2]="weave" [cluster1]="weave" )
2021-07-13T00:04:43.5900121Z nodes per cluster - ([cluster3]="control-plane worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-13T00:04:43.5901492Z install submariner - ([cluster3]="true" [cluster2]="true" [cluster1]="true" )
2021-07-13T00:04:43.5914497Z [lighthouse]$ rm -rf /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs
2021-07-13T00:04:43.5933432Z [lighthouse]$ mkdir -p /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs
2021-07-13T00:04:43.5957673Z [lighthouse]$ run_local_registry
2021-07-13T00:04:43.5973841Z [lighthouse]$ run_local_registry
2021-07-13T00:04:43.5983667Z [lighthouse]$ registry_running
2021-07-13T00:04:43.6000615Z [lighthouse]$ registry_running
2021-07-13T00:04:43.6011921Z [lighthouse]$ docker ps --filter name=^/?kind-registry$
2021-07-13T00:04:43.6030164Z [lighthouse]$ grep kind-registry
2021-07-13T00:04:43.8615750Z [lighthouse]$ return 0
2021-07-13T00:04:43.8621891Z Deploying local registry kind-registry to serve images centrally.
2021-07-13T00:04:43.8636070Z [lighthouse]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-13T00:04:43.8648244Z [lighthouse]$ selinuxenabled
2021-07-13T00:04:43.8674782Z [lighthouse]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-13T00:04:44.1243490Z Unable to find image 'registry:2' locally
2021-07-13T00:04:45.4118638Z 2: Pulling from library/registry
2021-07-13T00:04:45.7620959Z ddad3d7c1e96: Already exists
2021-07-13T00:04:45.7640907Z 6eda6749503f: Pulling fs layer
2021-07-13T00:04:45.7643704Z 363ab70c2143: Pulling fs layer
2021-07-13T00:04:45.7644429Z 5b94580856e6: Pulling fs layer
2021-07-13T00:04:45.7645226Z 12008541203a: Pulling fs layer
2021-07-13T00:04:45.7645735Z 12008541203a: Waiting
2021-07-13T00:04:46.1371087Z 6eda6749503f: Download complete
2021-07-13T00:04:46.1684717Z 5b94580856e6: Verifying Checksum
2021-07-13T00:04:46.1685324Z 5b94580856e6: Download complete
2021-07-13T00:04:46.1972241Z 363ab70c2143: Verifying Checksum
2021-07-13T00:04:46.1972848Z 363ab70c2143: Download complete
2021-07-13T00:04:46.4847982Z 12008541203a: Verifying Checksum
2021-07-13T00:04:46.4848654Z 12008541203a: Download complete
2021-07-13T00:04:46.7194068Z 6eda6749503f: Pull complete
2021-07-13T00:04:47.0585449Z 363ab70c2143: Pull complete
2021-07-13T00:04:47.1303264Z 5b94580856e6: Pull complete
2021-07-13T00:04:47.1962497Z 12008541203a: Pull complete
2021-07-13T00:04:47.2016673Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-13T00:04:47.2035942Z Status: Downloaded newer image for registry:2
2021-07-13T00:04:47.2277736Z 6036a4e7d9258f38b8cbd8663cab50851fa8cc1b03fd1960b683db447579efc1
2021-07-13T00:04:47.5881003Z [lighthouse]$ docker network connect kind kind-registry
2021-07-13T00:04:47.9689678Z [lighthouse]$ declare_cidrs
2021-07-13T00:04:47.9701590Z [lighthouse]$ declare_cidrs
2021-07-13T00:04:47.9706427Z [lighthouse]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-13T00:04:47.9714417Z [lighthouse]$ i=1
2021-07-13T00:04:47.9725607Z [lighthouse]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-13T00:04:47.9734260Z [lighthouse]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-13T00:04:47.9745020Z [lighthouse]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-13T00:04:47.9749698Z [lighthouse]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-13T00:04:47.9752394Z [lighthouse]$ [cluster1] i=$(("$i"+1))
2021-07-13T00:04:47.9771684Z [lighthouse]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-13T00:04:47.9790625Z [lighthouse]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-13T00:04:47.9801786Z [lighthouse]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-13T00:04:47.9815778Z [lighthouse]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-13T00:04:47.9827757Z [lighthouse]$ [cluster2] i=$(("$i"+1))
2021-07-13T00:04:47.9842505Z [lighthouse]$ [cluster3] add_cluster_cidrs 3 cluster3
2021-07-13T00:04:47.9855579Z [lighthouse]$ [cluster3] add_cluster_cidrs 3 cluster3
2021-07-13T00:04:47.9868687Z [lighthouse]$ [cluster3] cluster_CIDRs[cluster3]=10.3.0.0/16
2021-07-13T00:04:47.9882155Z [lighthouse]$ [cluster3] service_CIDRs[cluster3]=100.3.0.0/16
2021-07-13T00:04:47.9896475Z [lighthouse]$ [cluster3] i=$(("$i"+1))
2021-07-13T00:04:47.9914442Z [lighthouse]$ [cluster3] run_all_clusters with_retries 3 create_kind_cluster
2021-07-13T00:04:47.9919838Z [lighthouse]$ [cluster3] wait 4555
2021-07-13T00:04:47.9926090Z [lighthouse]$ [cluster3] run_all_clusters with_retries 3 create_kind_cluster
2021-07-13T00:04:47.9936468Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 with_retries 3 create_kind_cluster
2021-07-13T00:04:47.9951465Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 with_retries 3 create_kind_cluster
2021-07-13T00:04:47.9965863Z [lighthouse]$ [cluster3] declare -A pids
2021-07-13T00:04:47.9983960Z [lighthouse]$ [cluster3] eval echo cluster1 cluster2 cluster3
2021-07-13T00:04:48.0003710Z [lighthouse]$ [cluster1] set -o pipefail
2021-07-13T00:04:48.0008584Z [lighthouse]$ [cluster1] pids[cluster1]=4564
2021-07-13T00:04:48.0016919Z [lighthouse]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-13T00:04:48.0031482Z [lighthouse]$ [cluster2] pids[cluster2]=4568
2021-07-13T00:04:48.0049185Z [lighthouse]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-13T00:04:48.0055645Z [lighthouse]$ [cluster2] set -o pipefail
2021-07-13T00:04:48.0068538Z [lighthouse]$ [cluster3] pids[cluster3]=4574
2021-07-13T00:04:48.0082598Z [lighthouse]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-13T00:04:48.0104857Z [lighthouse]$ [cluster3] set -o pipefail
2021-07-13T00:04:48.0111831Z [lighthouse]$ [cluster3] wait 4574
2021-07-13T00:04:48.0121354Z [lighthouse]$ [cluster3] with_retries 3 create_kind_cluster
2021-07-13T00:04:48.0126719Z [lighthouse]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-13T00:04:48.0148800Z [lighthouse]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2021-07-13T00:07:25.6892301Z [lighthouse]$ [cluster3] with_retries
2021-07-13T00:07:25.6893313Z [lighthouse]$ [cluster3] iteration=1
2021-07-13T00:07:25.6894080Z [lighthouse]$ [cluster3] wait 4603
2021-07-13T00:07:25.6894854Z [lighthouse]$ [cluster3] create_kind_cluster
2021-07-13T00:07:25.6896554Z [lighthouse]$ [cluster3] create_kind_cluster
2021-07-13T00:07:25.6898105Z [lighthouse]$ [cluster3] export KUBECONFIG=/go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:07:25.6899845Z [lighthouse]$ [cluster3] rm -f /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:07:25.6901041Z [lighthouse]$ [cluster3] kind get clusters
2021-07-13T00:07:25.6901845Z [lighthouse]$ [cluster3] grep -q ^cluster3$
2021-07-13T00:07:25.6902446Z [cluster3] No kind clusters found.
2021-07-13T00:07:25.6902990Z [cluster3] Creating KIND cluster...
2021-07-13T00:07:25.6903800Z [lighthouse]$ [cluster3] generate_cluster_yaml
2021-07-13T00:07:25.6904642Z [lighthouse]$ [cluster3] generate_cluster_yaml
2021-07-13T00:07:25.6905460Z [lighthouse]$ [cluster3] disable_cni=true
2021-07-13T00:07:25.6906185Z [lighthouse]$ [cluster3] nodes=
2021-07-13T00:07:25.6906907Z [cluster3] - role: control-plane
2021-07-13T00:07:25.6907615Z [lighthouse]$ [cluster3] nodes=
2021-07-13T00:07:25.6908659Z [cluster3] - role: control-plane
2021-07-13T00:07:25.6909343Z [cluster3] - role: worker
2021-07-13T00:07:25.6909912Z [cluster3] 
2021-07-13T00:07:25.6910631Z [cluster3] 
2021-07-13T00:07:25.6911464Z [lighthouse]$ [cluster3] eval "echo \"$(cat $1)\""
2021-07-13T00:07:25.6912591Z [lighthouse]$ [cluster3] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-13T00:07:25.6914107Z [lighthouse]$ [cluster3] image_flag=--image=kindest/node:v1.17.17
2021-07-13T00:07:25.6914983Z [lighthouse]$ [cluster3] kind version
2021-07-13T00:07:25.6915549Z [cluster3] kind v0.11.1 go1.16.4 linux/amd64
2021-07-13T00:07:25.6916567Z [lighthouse]$ [cluster3] cat /opt/shipyard/scripts/resources/cluster3-config.yaml
2021-07-13T00:07:25.6918226Z [cluster3] ---
2021-07-13T00:07:25.6918656Z [cluster3] kind: Cluster
2021-07-13T00:07:25.6919406Z [cluster3] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-13T00:07:25.6919982Z [cluster3] networking:
2021-07-13T00:07:25.6920561Z [cluster3] disableDefaultCNI: true
2021-07-13T00:07:25.6921130Z [cluster3] podSubnet: 10.3.0.0/16
2021-07-13T00:07:25.6922003Z [cluster3] serviceSubnet: 100.3.0.0/16
2021-07-13T00:07:25.6922703Z [cluster3] containerdConfigPatches:
2021-07-13T00:07:25.6923492Z [cluster3] - |-
2021-07-13T00:07:25.6924279Z [cluster3] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-13T00:07:25.6925548Z [cluster3] endpoint = ["http://kind-registry:5000"]
2021-07-13T00:07:25.6926318Z [cluster3] kubeadmConfigPatches:
2021-07-13T00:07:25.6926989Z [cluster3] - |
2021-07-13T00:07:25.6927542Z [cluster3] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-13T00:07:25.6928229Z [cluster3] kind: ClusterConfiguration
2021-07-13T00:07:25.6928808Z [cluster3] metadata:
2021-07-13T00:07:25.6929264Z [cluster3] name: config
2021-07-13T00:07:25.6929738Z [cluster3] networking:
2021-07-13T00:07:25.6930358Z [cluster3] podSubnet: 10.3.0.0/16
2021-07-13T00:07:25.6930911Z [cluster3] serviceSubnet: 100.3.0.0/16
2021-07-13T00:07:25.6931501Z [cluster3] dnsDomain: cluster3.local
2021-07-13T00:07:25.6932023Z [cluster3] nodes:
2021-07-13T00:07:25.6932699Z [cluster3] - role: control-plane
2021-07-13T00:07:25.6933370Z [cluster3] - role: worker
2021-07-13T00:07:25.6934682Z [lighthouse]$ [cluster3] kind create cluster --image=kindest/node:v1.17.17 --name=cluster3 --config=/opt/shipyard/scripts/resources/cluster3-config.yaml
2021-07-13T00:07:25.6935762Z [cluster3] Creating cluster "cluster3" ...
2021-07-13T00:07:25.6938354Z [cluster3] • Ensuring node image (kindest/node:v1.17.17) 🖼 ...
2021-07-13T00:07:25.6939373Z [cluster3] ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-13T00:07:25.6940175Z [cluster3] • Preparing nodes 📦 📦 ...
2021-07-13T00:07:25.6940884Z [cluster3] ✓ Preparing nodes 📦 📦
2021-07-13T00:07:25.6941608Z [cluster3] • Writing configuration 📜 ...
2021-07-13T00:07:25.6942369Z [cluster3] ✓ Writing configuration 📜
2021-07-13T00:07:25.6943248Z [cluster3] • Starting control-plane 🕹️ ...
2021-07-13T00:07:25.6944039Z [cluster3] ✓ Starting control-plane 🕹️
2021-07-13T00:07:25.6944834Z [cluster3] • Installing StorageClass 💾 ...
2021-07-13T00:07:25.6945632Z [cluster3] ✓ Installing StorageClass 💾
2021-07-13T00:07:25.6946373Z [cluster3] • Joining worker nodes 🚜 ...
2021-07-13T00:07:25.6947077Z [cluster3] ✓ Joining worker nodes 🚜
2021-07-13T00:07:25.6947852Z [cluster3] Set kubectl context to "kind-cluster3"
2021-07-13T00:07:25.6948502Z [cluster3] You can now use your cluster with:
2021-07-13T00:07:25.6948986Z [cluster3]
2021-07-13T00:07:25.6949733Z [cluster3] kubectl cluster-info --context kind-cluster3
2021-07-13T00:07:25.6950321Z [cluster3]
2021-07-13T00:07:25.6951356Z [cluster3] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-13T00:07:25.6952633Z [lighthouse]$ [cluster3] kind_fixup_config
2021-07-13T00:07:25.6953445Z [lighthouse]$ [cluster3] kind_fixup_config
2021-07-13T00:07:25.6955175Z [lighthouse]$ [cluster3] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster3-control-plane
2021-07-13T00:07:25.6956462Z [lighthouse]$ [cluster3] head -n 1
2021-07-13T00:07:25.6963545Z [lighthouse]$ [cluster3] sed -i -- s/server: .*/server: https:\/\/172.18.0.11:6443/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:07:25.6965482Z [lighthouse]$ [cluster3] sed -i -- s/user: kind-.*/user: cluster3/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:07:27.5970053Z [lighthouse]$ [cluster3] sed -i -- s/name: kind-.*/name: cl[lighthouse]$ [cluster2] with_retries
2021-07-13T00:07:27.5971222Z [lighthouse]$ [cluster2] iteration=1
2021-07-13T00:07:27.5972042Z [lighthouse]$ [cluster2] wait 4600
2021-07-13T00:07:27.5972930Z [lighthouse]$ [cluster2] create_kind_cluster
2021-07-13T00:07:27.5974841Z [lighthouse]$ [cluster2] create_kind_cluster
2021-07-13T00:07:27.5977263Z [lighthouse]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:07:27.5979575Z [lighthouse]$ [cluster2] rm -f /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:07:27.5980928Z [lighthouse]$ [cluster2] kind get clusters
2021-07-13T00:07:27.5981854Z [lighthouse]$ [cluster2] grep -q ^cluster2$
2021-07-13T00:07:27.5982536Z [cluster2] No kind clusters found.
2021-07-13T00:07:27.5983159Z [cluster2] Creating KIND cluster...
2021-07-13T00:07:27.5984005Z [lighthouse]$ [cluster2] generate_cluster_yaml
2021-07-13T00:07:27.5984950Z [lighthouse]$ [cluster2] generate_cluster_yaml
2021-07-13T00:07:27.5986023Z [lighthouse]$ [cluster2] disable_cni=true
2021-07-13T00:07:27.5986933Z [lighthouse]$ [cluster2] nodes=
2021-07-13T00:07:27.5987716Z [cluster2] - role: control-plane
2021-07-13T00:07:27.5988525Z [lighthouse]$ [cluster2] nodes=
2021-07-13T00:07:27.5989286Z [cluster2] - role: control-plane
2021-07-13T00:07:27.5990061Z [cluster2] - role: worker
2021-07-13T00:07:27.5990795Z [lighthouse]$ [cluster2] nodes=
2021-07-13T00:07:27.5991528Z [cluster2] - role: control-plane
2021-07-13T00:07:27.5992324Z [cluster2] - role: worker
2021-07-13T00:07:27.5993036Z [cluster2] - role: worker
2021-07-13T00:07:27.5993626Z [cluster2] 
2021-07-13T00:07:27.5994251Z [cluster2] 
2021-07-13T00:07:27.5994962Z [lighthouse]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-13T00:07:27.5996179Z [lighthouse]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-13T00:07:27.5997792Z [lighthouse]$ [cluster2] image_flag=--image=kindest/node:v1.17.17
2021-07-13T00:07:27.5998778Z [lighthouse]$ [cluster2] kind version
2021-07-13T00:07:27.5999366Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-13T00:07:27.6000529Z [lighthouse]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-13T00:07:27.6001566Z [cluster2] ---
2021-07-13T00:07:27.6001998Z [cluster2] kind: Cluster
2021-07-13T00:07:27.6002992Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-13T00:07:27.6003574Z [cluster2] networking:
2021-07-13T00:07:27.6004147Z [cluster2] disableDefaultCNI: true
2021-07-13T00:07:27.6004764Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-13T00:07:27.6005306Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-13T00:07:27.6006027Z [cluster2] containerdConfigPatches:
2021-07-13T00:07:27.6006802Z [cluster2] - |-
2021-07-13T00:07:27.6007666Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-13T00:07:27.6008952Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-13T00:07:27.6009729Z [cluster2] kubeadmConfigPatches:
2021-07-13T00:07:27.6010518Z [cluster2] - |
2021-07-13T00:07:27.6011312Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-13T00:07:27.6012005Z [cluster2] kind: ClusterConfiguration
2021-07-13T00:07:27.6012661Z [cluster2] metadata:
2021-07-13T00:07:27.6013121Z [cluster2] name: config
2021-07-13T00:07:27.6013631Z [cluster2] networking:
2021-07-13T00:07:27.6014116Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-13T00:07:27.6014743Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-13T00:07:27.6015479Z [cluster2] dnsDomain: cluster2.local
2021-07-13T00:07:27.6016006Z [cluster2] nodes:
2021-07-13T00:07:27.6016758Z [cluster2] - role: control-plane
2021-07-13T00:07:27.6018466Z [cluster2] - role: worker
2021-07-13T00:07:27.6019298Z [cluster2] - role: worker
2021-07-13T00:07:27.6021533Z [lighthouse]$ [cluster2] kind create cluster --image=kindest/node:v1.17.17 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-13T00:07:27.6022700Z [cluster2] Creating cluster "cluster2" ...
2021-07-13T00:07:27.6024135Z [cluster2] • Ensuring node image (kindest/node:v1.17.17) 🖼 ...
2021-07-13T00:07:27.6025219Z [cluster2] ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-13T00:07:27.6026463Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-13T00:07:27.6027779Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-13T00:07:27.6028679Z [cluster2] • Writing configuration 📜 ...
2021-07-13T00:07:27.6029547Z [cluster2] ✓ Writing configuration 📜
2021-07-13T00:07:27.6030429Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-13T00:07:27.6031316Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-13T00:07:27.6032192Z [cluster2] • Installing StorageClass 💾 ...
2021-07-13T00:07:27.6033029Z [cluster2] ✓ Installing StorageClass 💾
2021-07-13T00:07:27.6033834Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-13T00:07:27.6034606Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-13T00:07:27.6035464Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-13T00:07:27.6036136Z [cluster2] You can now use your cluster with:
2021-07-13T00:07:27.6040037Z [cluster2]
2021-07-13T00:07:27.6042376Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-13T00:07:27.6065701Z [cluster2]
2021-07-13T00:07:27.6067133Z [cluster2] Not sure what to do next? 😅 Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-13T00:07:27.6068325Z [lighthouse]$ [cluster2] kind_fixup_config
2021-07-13T00:07:27.6069189Z [lighthouse]$ [cluster2] kind_fixup_config
2021-07-13T00:07:27.6070808Z [lighthouse]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-13T00:07:27.6072166Z [lighthouse]$ [cluster2] head -n 1
2021-07-13T00:07:27.6073597Z [lighthouse]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:07:34.1505025Z [lighthouse]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2[lighthouse]$ [cluster1] with_retries
2021-07-13T00:07:34.1506226Z [lighthouse]$ [cluster1] iteration=1
2021-07-13T00:07:34.1506979Z [lighthouse]$ [cluster1] wait 4585
2021-07-13T00:07:34.1507777Z [lighthouse]$ [cluster1] create_kind_cluster
2021-07-13T00:07:34.1508619Z [lighthouse]$ [cluster1] create_kind_cluster
2021-07-13T00:07:34.1510019Z [lighthouse]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:07:34.1511697Z [lighthouse]$ [cluster1] rm -f /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:07:34.1512879Z [lighthouse]$ [cluster1] kind get clusters
2021-07-13T00:07:34.1513721Z [lighthouse]$ [cluster1] grep -q ^cluster1$
2021-07-13T00:07:34.1514330Z [cluster1] No kind clusters found.
2021-07-13T00:07:34.1514874Z [cluster1] Creating KIND cluster...
2021-07-13T00:07:34.1515692Z [lighthouse]$ [cluster1] generate_cluster_yaml
2021-07-13T00:07:34.1516825Z [lighthouse]$ [cluster1] generate_cluster_yaml
2021-07-13T00:07:34.1517843Z [lighthouse]$ [cluster1] disable_cni=true
2021-07-13T00:07:34.1518594Z [lighthouse]$ [cluster1] nodes=
2021-07-13T00:07:34.1519305Z [cluster1] - role: control-plane
2021-07-13T00:07:34.1520025Z [lighthouse]$ [cluster1] nodes=
2021-07-13T00:07:34.1520715Z [cluster1] - role: control-plane
2021-07-13T00:07:34.1521382Z [cluster1] - role: worker
2021-07-13T00:07:34.1522032Z [lighthouse]$ [cluster1] nodes=
2021-07-13T00:07:34.1522729Z [cluster1] - role: control-plane
2021-07-13T00:07:34.1523370Z [cluster1] - role: worker
2021-07-13T00:07:34.1523983Z [cluster1] - role: worker
2021-07-13T00:07:34.1524541Z [cluster1] 
2021-07-13T00:07:34.1525078Z [cluster1] 
2021-07-13T00:07:34.1525772Z [lighthouse]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-13T00:07:34.1526863Z [lighthouse]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-13T00:07:34.1528045Z [lighthouse]$ [cluster1] image_flag=--image=kindest/node:v1.17.17
2021-07-13T00:07:34.1529026Z [lighthouse]$ [cluster1] kind version
2021-07-13T00:07:34.1529631Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-13T00:07:34.1530674Z [lighthouse]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-13T00:07:34.1531534Z [cluster1] ---
2021-07-13T00:07:34.1531956Z [cluster1] kind: Cluster
2021-07-13T00:07:34.1532697Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-13T00:07:34.1533287Z [cluster1] networking:
2021-07-13T00:07:34.1533843Z [cluster1] disableDefaultCNI: true
2021-07-13T00:07:34.1534427Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-13T00:07:34.1535120Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-13T00:07:34.1535800Z [cluster1] containerdConfigPatches:
2021-07-13T00:07:34.1536536Z [cluster1] - |-
2021-07-13T00:07:34.1537343Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-13T00:07:34.1538548Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-13T00:07:34.1539315Z [cluster1] kubeadmConfigPatches:
2021-07-13T00:07:34.1539984Z [cluster1] - |
2021-07-13T00:07:34.1540543Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-13T00:07:34.1541229Z [cluster1] kind: ClusterConfiguration
2021-07-13T00:07:34.1541808Z [cluster1] metadata:
2021-07-13T00:07:34.1542273Z [cluster1] name: config
2021-07-13T00:07:34.1542738Z [cluster1] networking:
2021-07-13T00:07:34.1543237Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-13T00:07:34.1543817Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-13T00:07:34.1544416Z [cluster1] dnsDomain: cluster1.local
2021-07-13T00:07:34.1544925Z [cluster1] nodes:
2021-07-13T00:07:34.1545587Z [cluster1] - role: control-plane
2021-07-13T00:07:34.1546300Z [cluster1] - role: worker
2021-07-13T00:07:34.1546900Z [cluster1] - role: worker
2021-07-13T00:07:34.1548188Z [lighthouse]$ [cluster1] kind create cluster --image=kindest/node:v1.17.17 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-13T00:07:34.1549289Z [cluster1] Creating cluster "cluster1" ...
2021-07-13T00:07:34.1550220Z [cluster1] • Ensuring node image (kindest/node:v1.17.17) 🖼 ...
2021-07-13T00:07:34.1551072Z [cluster1] ✓ Ensuring node image (kindest/node:v1.17.17) 🖼
2021-07-13T00:07:34.1551853Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-13T00:07:34.1552544Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-13T00:07:34.1553277Z [cluster1] • Writing configuration 📜 ...
2021-07-13T00:07:34.1554055Z [cluster1] ✓ Writing configuration 📜
2021-07-13T00:07:34.1554839Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-13T00:07:34.1555609Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-13T00:07:34.1556467Z [cluster1] • Installing StorageClass 💾 ...
2021-07-13T00:07:34.1557930Z [cluster1] ✓ Installing StorageClass 💾
2021-07-13T00:07:34.1558693Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-13T00:07:34.1559703Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-13T00:07:34.1560480Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-13T00:07:34.1561348Z [cluster1] You can now use your cluster with:
2021-07-13T00:07:34.1561826Z [cluster1]
2021-07-13T00:07:34.1562629Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-13T00:07:34.1563207Z [cluster1]
2021-07-13T00:07:34.1563812Z [cluster1] Thanks for using kind! 😊
2021-07-13T00:07:34.1564547Z [lighthouse]$ [cluster1] kind_fixup_config
2021-07-13T00:07:34.1565339Z [lighthouse]$ [cluster1] kind_fixup_config
2021-07-13T00:07:34.1566666Z [lighthouse]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-13T00:07:34.1567896Z [lighthouse]$ [cluster1] head -n 1
2021-07-13T00:07:34.1569280Z [lighthouse]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9710116Z [lighthouse]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9712152Z [lighthouse]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9714076Z [lighthouse]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9716128Z [lighthouse]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9719433Z [lighthouse]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1
2021-07-13T00:08:12.9720587Z [lighthouse]$ [cluster1] wait 6463
2021-07-13T00:08:12.9721433Z [lighthouse]$ [cluster1] deploy_cluster_capabilities
2021-07-13T00:08:12.9722516Z [lighthouse]$ [cluster1] deploy_cluster_capabilities
2021-07-13T00:08:12.9723400Z [lighthouse]$ [cluster1] deploy_cni
2021-07-13T00:08:12.9724128Z [lighthouse]$ [cluster1] deploy_cni
2021-07-13T00:08:12.9724926Z [lighthouse]$ [cluster1] eval deploy_weave_cni
2021-07-13T00:08:12.9725726Z [lighthouse]$ [cluster1] deploy_weave_cni
2021-07-13T00:08:12.9726520Z [lighthouse]$ [cluster1] deploy_weave_cni
2021-07-13T00:08:12.9727129Z [cluster1] Applying weave network...
2021-07-13T00:08:12.9728551Z [lighthouse]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-13T00:08:12.9730328Z [lighthouse]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-13T00:08:12.9732139Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-13T00:08:12.9733477Z [cluster1] serviceaccount/weave-net created
2021-07-13T00:08:12.9734672Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:12.9736341Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:12.9737962Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:12.9739362Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:12.9740535Z [cluster1] daemonset.apps/weave-net created
2021-07-13T00:08:12.9741386Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-13T00:08:12.9742542Z [lighthouse]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:12.9743909Z [lighthouse]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:12.9745686Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:12.9746867Z [cluster1] pod/weave-net-2844t condition met
2021-07-13T00:08:12.9747717Z [cluster1] pod/weave-net-6vzt2 condition met
2021-07-13T00:08:12.9748640Z [cluster1] pod/weave-net-qkp62 condition met
2021-07-13T00:08:12.9749518Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-13T00:08:12.9750779Z [lighthouse]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:12.9751996Z [lighthouse]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:12.9753349Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:12.9754482Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-13T00:08:12.9755669Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-13T00:08:12.9756603Z [cluster1] deployment "coredns" successfully rolled out
2021-07-13T00:08:12.9757747Z [lighthouse]$ [cluster1] return 0
2021-07-13T00:08:16.2119166Z /g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:08:16.2120929Z [lighthouse]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:08:16.2122875Z [lighthouse]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:08:16.2125019Z [lighthouse]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:08:16.2127151Z [lighthouse]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2
2021-07-13T00:08:16.2128303Z [lighthouse]$ [cluster2] wait 6343
2021-07-13T00:08:16.2129350Z [lighthouse]$ [cluster2] deploy_cluster_capabilities
2021-07-13T00:08:16.2130548Z [lighthouse]$ [cluster2] deploy_cluster_capabilities
2021-07-13T00:08:16.2131359Z [lighthouse]$ [cluster2] deploy_cni
2021-07-13T00:08:16.2132045Z [lighthouse]$ [cluster2] deploy_cni
2021-07-13T00:08:16.2132789Z [lighthouse]$ [cluster2] eval deploy_weave_cni
2021-07-13T00:08:16.2133532Z [lighthouse]$ [cluster2] deploy_weave_cni
2021-07-13T00:08:16.2134271Z [lighthouse]$ [cluster2] deploy_weave_cni
2021-07-13T00:08:16.2135383Z [cluster2] Applying weave network...
2021-07-13T00:08:16.2136817Z [lighthouse]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-13T00:08:16.2138632Z [lighthouse]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-13T00:08:16.2140297Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-13T00:08:16.2141537Z [cluster2] serviceaccount/weave-net created
2021-07-13T00:08:16.2142775Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:16.2144386Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:16.2145854Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:16.2147155Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:16.2148286Z [cluster2] daemonset.apps/weave-net created
2021-07-13T00:08:16.2149259Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-13T00:08:16.2150701Z [lighthouse]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:16.2152089Z [lighthouse]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:16.2153607Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:16.2154799Z [cluster2] pod/weave-net-7h9tc condition met
2021-07-13T00:08:16.2155639Z [cluster2] pod/weave-net-9rhgb condition met
2021-07-13T00:08:16.2156488Z [cluster2] pod/weave-net-hzdfh condition met
2021-07-13T00:08:16.2157715Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-13T00:08:16.2158899Z [lighthouse]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:16.2160025Z [lighthouse]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:16.2161307Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:16.2162518Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-13T00:08:16.2163516Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-13T00:08:16.2164361Z [cluster2] deployment "coredns" successfully rolled out
2021-07-13T00:08:16.2165221Z [lighthouse]$ [cluster2] return 0
2021-07-13T00:08:18.4389225Z uster3/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:08:18.4391032Z [lighthouse]$ [cluster3] sed -i -- s/cluster: kind-.*/cluster: cluster3/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:08:18.4393321Z [lighthouse]$ [cluster3] sed -i -- s/current-context: .*/current-context: cluster3/g /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:08:18.4395400Z [lighthouse]$ [cluster3] chmod a+r /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3
2021-07-13T00:08:18.4396657Z [lighthouse]$ [cluster3] wait 6278
2021-07-13T00:08:18.4398036Z [lighthouse]$ [cluster3] deploy_cluster_capabilities
2021-07-13T00:08:18.4400367Z [lighthouse]$ [cluster3] deploy_cluster_capabilities
2021-07-13T00:08:18.4401341Z [lighthouse]$ [cluster3] deploy_cni
2021-07-13T00:08:18.4403119Z [lighthouse]$ [cluster3] deploy_cni
2021-07-13T00:08:18.4404060Z [lighthouse]$ [cluster3] eval deploy_weave_cni
2021-07-13T00:08:18.4404883Z [lighthouse]$ [cluster3] deploy_weave_cni
2021-07-13T00:08:18.4405664Z [lighthouse]$ [cluster3] deploy_weave_cni
2021-07-13T00:08:18.4406284Z [cluster3] Applying weave network...
2021-07-13T00:08:18.4407564Z [lighthouse]$ [cluster3] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.3.0.0/16
2021-07-13T00:08:18.4409281Z [lighthouse]$ [cluster3] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.3.0.0/16
2021-07-13T00:08:18.4411082Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.17.17&env.IPALLOC_RANGE=10.3.0.0/16
2021-07-13T00:08:18.4412506Z [cluster3] serviceaccount/weave-net created
2021-07-13T00:08:18.4414024Z [cluster3] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:18.4415714Z [cluster3] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:18.4417239Z [cluster3] role.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:18.4418606Z [cluster3] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-13T00:08:18.4419772Z [cluster3] daemonset.apps/weave-net created
2021-07-13T00:08:18.4420994Z [cluster3] Waiting for weave-net pods to be ready...
2021-07-13T00:08:18.4422153Z [lighthouse]$ [cluster3] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:18.4423791Z [lighthouse]$ [cluster3] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:18.4425294Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-13T00:08:18.4426485Z [cluster3] pod/weave-net-fqpr6 condition met
2021-07-13T00:08:18.4427357Z [cluster3] pod/weave-net-ghzpt condition met
2021-07-13T00:08:18.4428238Z [cluster3] Waiting for core-dns deployment to be ready...
2021-07-13T00:08:18.4429327Z [lighthouse]$ [cluster3] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:18.4430545Z [lighthouse]$ [cluster3] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:18.4431909Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-13T00:08:18.4433178Z [cluster3] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-13T00:08:18.4434268Z [cluster3] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-13T00:08:18.4435182Z [cluster3] deployment "coredns" successfully rolled out
2021-07-13T00:08:18.4436041Z [lighthouse]$ [cluster3] return 0
2021-07-13T00:08:18.4463979Z [lighthouse]$ [cluster3] wait 4568
2021-07-13T00:08:18.4486188Z [lighthouse]$ [cluster3] wait 4564
2021-07-13T00:08:18.4513228Z [lighthouse]$ [cluster3] print_clusters_message
2021-07-13T00:08:18.4531407Z [lighthouse]$ [cluster3] print_clusters_message
2021-07-13T00:08:18.4556187Z [lighthouse]$ [cluster3] cat <<EOM
2021-07-13T00:08:18.4557073Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-13T00:08:18.4557596Z
2021-07-13T00:08:18.4558514Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-13T00:08:18.4559098Z
2021-07-13T00:08:18.4559860Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-13T00:08:18.4560273Z
2021-07-13T00:08:18.4560868Z To clean everthing up, just run: make clean-clusters
2021-07-13T00:08:18.4561425Z EOM
2021-07-13T00:08:18.4590762Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-13T00:08:18.4591281Z
2021-07-13T00:08:18.4592216Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-13T00:08:18.4592752Z
2021-07-13T00:08:18.4593406Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-13T00:08:18.4593815Z
2021-07-13T00:08:18.4594396Z To clean everthing up, just run: make clean-clusters
2021-07-13T00:08:18.4621665Z Successfully remade target file 'clusters'.
2021-07-13T00:08:18.4622584Z File 'preload-images' does not exist.
2021-07-13T00:08:18.4623376Z Must remake target 'preload-images'.
2021-07-13T00:08:18.4627550Z set -e;\
2021-07-13T00:08:18.4628101Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-13T00:08:18.4628718Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-13T00:08:18.4630148Z for image in submariner-gateway submariner-operator submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-13T00:08:18.4631336Z import_image quay.io/submariner/${image};\
2021-07-13T00:08:18.4631797Z done
2021-07-13T00:08:18.4742149Z [lighthouse]$ import_image quay.io/submariner/submariner-gateway
2021-07-13T00:08:18.4752505Z [lighthouse]$ import_image quay.io/submariner/submariner-gateway
2021-07-13T00:08:18.4767010Z [lighthouse]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-13T00:08:18.7698396Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-13T00:08:18.7732912Z [lighthouse]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-13T00:08:20.4734042Z devel: Pulling from submariner/submariner-gateway
2021-07-13T00:08:20.4752049Z 8c741e919b67: Pulling fs layer
2021-07-13T00:08:20.4752663Z 13495efbbac4: Pulling fs layer
2021-07-13T00:08:20.4753122Z 9d49a81b7342: Pulling fs layer
2021-07-13T00:08:20.4753569Z 29d1f59a1a32: Pulling fs layer
2021-07-13T00:08:20.4753995Z c70941767f98: Pulling fs layer
2021-07-13T00:08:20.4754516Z c0336d9c832f: Pulling fs layer
2021-07-13T00:08:20.4754895Z 29d1f59a1a32: Waiting
2021-07-13T00:08:20.4755251Z c70941767f98: Waiting
2021-07-13T00:08:20.4755588Z c0336d9c832f: Waiting
2021-07-13T00:08:20.8458418Z 13495efbbac4: Verifying Checksum
2021-07-13T00:08:20.8459826Z 13495efbbac4: Download complete
2021-07-13T00:08:21.0630976Z 9d49a81b7342: Verifying Checksum
2021-07-13T00:08:21.0633361Z 9d49a81b7342: Download complete
2021-07-13T00:08:21.4072713Z 8c741e919b67: Verifying Checksum
2021-07-13T00:08:21.4073558Z 8c741e919b67: Download complete
2021-07-13T00:08:21.4108677Z 29d1f59a1a32: Verifying Checksum
2021-07-13T00:08:21.4109636Z 29d1f59a1a32: Download complete
2021-07-13T00:08:21.4424568Z c70941767f98: Verifying Checksum
2021-07-13T00:08:21.4425392Z c70941767f98: Download complete
2021-07-13T00:08:21.7755387Z c0336d9c832f: Verifying Checksum
2021-07-13T00:08:21.7756156Z c0336d9c832f: Download complete
2021-07-13T00:08:25.0474268Z 8c741e919b67: Pull complete
2021-07-13T00:08:26.2078482Z 13495efbbac4: Pull complete
2021-07-13T00:08:27.4104394Z 9d49a81b7342: Pull complete
2021-07-13T00:08:27.6312104Z 29d1f59a1a32: Pull complete
2021-07-13T00:08:27.7335535Z c70941767f98: Pull complete
2021-07-13T00:08:27.8229224Z c0336d9c832f: Pull complete
2021-07-13T00:08:27.8299363Z Digest: sha256:155d62f39d8b9194eea59dc605fe8cc8b5077e55fa35c83f9083f1ab5522dc41
2021-07-13T00:08:27.8341631Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-13T00:08:27.8348418Z quay.io/submariner/submariner-gateway:devel
2021-07-13T00:08:27.8399301Z [lighthouse]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-13T00:08:28.1299137Z [lighthouse]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-13T00:08:28.4315459Z [lighthouse]$ docker push localhost:5000/submariner-gateway:local
2021-07-13T00:08:28.7082578Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-13T00:08:28.7410091Z 7655800f9c31: Preparing
2021-07-13T00:08:28.7410898Z 768bac94f978: Preparing
2021-07-13T00:08:28.7411436Z b87fcfa7af22: Preparing
2021-07-13T00:08:28.7411994Z 8a01ec0f4808: Preparing
2021-07-13T00:08:28.7412470Z 00c5f6897675: Preparing
2021-07-13T00:08:28.7413197Z b3b62c837788: Preparing
2021-07-13T00:08:28.7413674Z b3b62c837788: Waiting
2021-07-13T00:08:29.6173352Z 00c5f6897675: Pushed
2021-07-13T00:08:29.6262527Z 7655800f9c31: Pushed
2021-07-13T00:08:29.6409282Z 768bac94f978: Pushed
2021-07-13T00:08:29.7260004Z b87fcfa7af22: Pushed
2021-07-13T00:08:34.1058347Z 8a01ec0f4808: Pushed
2021-07-13T00:08:42.6775018Z b3b62c837788: Pushed
2021-07-13T00:08:42.7006827Z local: digest: sha256:155d62f39d8b9194eea59dc605fe8cc8b5077e55fa35c83f9083f1ab5522dc41 size: 1575
2021-07-13T00:08:42.7063353Z [lighthouse]$ import_image quay.io/submariner/submariner-operator
2021-07-13T00:08:42.7075588Z [lighthouse]$ import_image quay.io/submariner/submariner-operator
2021-07-13T00:08:42.7090903Z [lighthouse]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-13T00:08:42.9778516Z Error response from daemon: No such image: quay.io/submariner/submariner-operator:dev
2021-07-13T00:08:42.9824674Z [lighthouse]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-13T00:08:44.7706125Z devel: Pulling from submariner/submariner-operator
2021-07-13T00:08:44.7707360Z 1505ec41698e: Pulling fs layer
2021-07-13T00:08:45.2496468Z 1505ec41698e: Verifying Checksum
2021-07-13T00:08:45.2497111Z 1505ec41698e: Download complete
2021-07-13T00:08:45.4625402Z 1505ec41698e: Pull complete
2021-07-13T00:08:45.4700850Z Digest: sha256:b516b5019e926dc9c4d4d636be72d45b73eca7e0e3b0939d545213ad75e81f47
2021-07-13T00:08:45.4735713Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-13T00:08:45.4779334Z quay.io/submariner/submariner-operator:devel
2021-07-13T00:08:45.4800392Z [lighthouse]$ docker tag quay.io/submariner/submariner-operator:devel quay.io/submariner/submariner-operator:dev
2021-07-13T00:08:45.7804358Z [lighthouse]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-13T00:08:46.0660779Z [lighthouse]$ docker push localhost:5000/submariner-operator:local
2021-07-13T00:08:46.3564946Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-13T00:08:46.3609190Z cc80e6d21853: Preparing
2021-07-13T00:08:46.9740283Z cc80e6d21853: Pushed
2021-07-13T00:08:47.0059701Z local: digest: sha256:b516b5019e926dc9c4d4d636be72d45b73eca7e0e3b0939d545213ad75e81f47 size: 528
2021-07-13T00:08:47.0116766Z [lighthouse]$ import_image quay.io/submariner/submariner-route-agent
2021-07-13T00:08:47.0135800Z [lighthouse]$ import_image quay.io/submariner/submariner-route-agent
2021-07-13T00:08:47.0151059Z [lighthouse]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-13T00:08:47.2992145Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-13T00:08:47.3071453Z [lighthouse]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-13T00:08:48.9993729Z devel: Pulling from submariner/submariner-route-agent
2021-07-13T00:08:48.9994856Z 8c741e919b67: Already exists
2021-07-13T00:08:49.0023341Z 13495efbbac4: Already exists
2021-07-13T00:08:49.0053291Z 70cc6422093d: Pulling fs layer
2021-07-13T00:08:49.0053998Z cac6010e600e: Pulling fs layer
2021-07-13T00:08:49.0054651Z 4b13beb0bd73: Pulling fs layer
2021-07-13T00:08:49.0055293Z e8fe7da63c21: Pulling fs layer
2021-07-13T00:08:49.0076796Z e8fe7da63c21: Waiting
2021-07-13T00:08:49.3540169Z 4b13beb0bd73: Verifying Checksum
2021-07-13T00:08:49.3540785Z 4b13beb0bd73: Download complete
2021-07-13T00:08:49.4409906Z cac6010e600e: Verifying Checksum
2021-07-13T00:08:49.4410548Z cac6010e600e: Download complete
2021-07-13T00:08:49.5744282Z 70cc6422093d: Verifying Checksum
2021-07-13T00:08:49.5744947Z 70cc6422093d: Download complete
2021-07-13T00:08:49.7236635Z e8fe7da63c21: Verifying Checksum
2021-07-13T00:08:49.7237602Z e8fe7da63c21: Download complete
2021-07-13T00:08:51.2651560Z 70cc6422093d: Pull complete
2021-07-13T00:08:51.5344938Z cac6010e600e: Pull complete
2021-07-13T00:08:51.6260305Z 4b13beb0bd73: Pull complete
2021-07-13T00:08:51.7146524Z e8fe7da63c21: Pull complete
2021-07-13T00:08:51.7235802Z Digest: sha256:a5042bba4163a5d3913525c126215c2e047dc34c896b0da29203769314d5f339
2021-07-13T00:08:51.7258875Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-13T00:08:51.7313345Z quay.io/submariner/submariner-route-agent:devel
2021-07-13T00:08:51.7329817Z [lighthouse]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-13T00:08:52.0173552Z [lighthouse]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-13T00:08:52.3030319Z [lighthouse]$ docker push localhost:5000/submariner-route-agent:local
2021-07-13T00:08:52.5798223Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-13T00:08:52.5866135Z 3116f4590739: Preparing
2021-07-13T00:08:52.5866632Z a14c0089a8aa: Preparing
2021-07-13T00:08:52.5867086Z 179c0de093a1: Preparing
2021-07-13T00:08:52.5867545Z 6931e591f8e2: Preparing
2021-07-13T00:08:52.5868258Z 00c5f6897675: Preparing
2021-07-13T00:08:52.5868709Z b3b62c837788: Preparing
2021-07-13T00:08:52.5869132Z b3b62c837788: Waiting
2021-07-13T00:08:52.6998418Z 00c5f6897675: Mounted from submariner-gateway
2021-07-13T00:08:53.3377624Z 3116f4590739: Pushed
2021-07-13T00:08:53.3495420Z a14c0089a8aa: Pushed
2021-07-13T00:08:53.3585015Z b3b62c837788: Mounted from submariner-gateway
2021-07-13T00:08:53.3721568Z 179c0de093a1: Pushed
2021-07-13T00:08:57.5245693Z 6931e591f8e2: Pushed
2021-07-13T00:08:57.5464121Z local: digest: sha256:a5042bba4163a5d3913525c126215c2e047dc34c896b0da29203769314d5f339 size: 1575
2021-07-13T00:08:57.5622586Z [lighthouse]$ import_image quay.io/submariner/lighthouse-agent
2021-07-13T00:08:57.5639192Z [lighthouse]$ import_image quay.io/submariner/lighthouse-agent
2021-07-13T00:08:57.5650445Z [lighthouse]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-13T00:08:57.8390920Z [lighthouse]$ docker push localhost:5000/lighthouse-agent:local
2021-07-13T00:08:58.1058713Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-13T00:08:58.1103079Z 1724808889be: Preparing
2021-07-13T00:08:58.1103949Z 1f074d552703: Preparing
2021-07-13T00:08:58.1855813Z 1f074d552703: Pushed
2021-07-13T00:08:58.6922544Z 1724808889be: Pushed
2021-07-13T00:08:58.7127589Z local: digest: sha256:a98d59631fc7e8719a7069090a8283ccec411cf1ac09b3a23bb24d11a43de085 size: 735
2021-07-13T00:08:58.7182745Z [lighthouse]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-13T00:08:58.7200523Z [lighthouse]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-13T00:08:58.7210829Z [lighthouse]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-13T00:08:59.0106772Z [lighthouse]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-13T00:08:59.2867732Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-13T00:08:59.2914146Z d33a291fbccc: Preparing
2021-07-13T00:08:59.2914843Z 4fa0ece06e25: Preparing
2021-07-13T00:08:59.3681037Z 4fa0ece06e25: Pushed
2021-07-13T00:09:00.1032807Z d33a291fbccc: Pushed
2021-07-13T00:09:00.1420268Z local: digest: sha256:7293a0a21162a06d5c8496fbd97a6a871fe388c56b5a83eed93bf7329af2d143 size: 739
2021-07-13T00:09:00.1562082Z Successfully remade target file 'preload-images'.
2021-07-13T00:09:00.1562989Z Must remake target 'deploy'.
2021-07-13T00:09:00.1564245Z ./scripts/deploy --cluster_settings /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings --service_discovery
2021-07-13T00:09:00.1659806Z [lighthouse]$ source /opt/shipyard/scripts/lib/utils
2021-07-13T00:09:00.1679822Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:00.1683770Z [lighthouse]$ script_name=utils
2021-07-13T00:09:00.1710278Z [lighthouse]$ exec_name=deploy
2021-07-13T00:09:00.1812870Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:09:00.1849862Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:09:00.1867999Z [lighthouse]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-13T00:09:00.1900783Z [lighthouse]$ export KUBECONFIG
2021-07-13T00:09:00.1953356Z [lighthouse]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-13T00:09:00.1978967Z [lighthouse]$ find /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs -type f -printf %p:
2021-07-13T00:09:00.2066299Z [lighthouse]$ /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings --service_discovery
2021-07-13T00:09:00.3432989Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=true
2021-07-13T00:09:00.3467433Z [lighthouse]$ source /opt/shipyard/scripts/lib/utils
2021-07-13T00:09:00.3481717Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:00.3494738Z [lighthouse]$ script_name=utils
2021-07-13T00:09:00.3507517Z [lighthouse]$ exec_name=deploy.sh
2021-07-13T00:09:00.3545291Z [lighthouse]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-13T00:09:00.3559913Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:00.3572641Z [lighthouse]$ script_name=deploy_funcs
2021-07-13T00:09:00.3587749Z [lighthouse]$ exec_name=deploy.sh
2021-07-13T00:09:00.3608536Z [lighthouse]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-13T00:09:00.3622949Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:00.3650177Z [lighthouse]$ script_name=cluster_settings
2021-07-13T00:09:00.3663737Z [lighthouse]$ exec_name=deploy.sh
2021-07-13T00:09:00.3690687Z [lighthouse]$ broker=cluster1
2021-07-13T00:09:00.3703930Z [lighthouse]$ declare -gA cluster_nodes
2021-07-13T00:09:00.3718343Z [lighthouse]$ cluster_nodes[cluster1]=control-plane worker
2021-07-13T00:09:00.3732917Z [lighthouse]$ cluster_nodes[cluster2]=control-plane worker
2021-07-13T00:09:00.3748373Z [lighthouse]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-13T00:09:00.3761700Z [lighthouse]$ declare -gA cluster_subm
2021-07-13T00:09:00.3775857Z [lighthouse]$ cluster_subm[cluster1]=true
2021-07-13T00:09:00.3787421Z [lighthouse]$ cluster_subm[cluster2]=true
2021-07-13T00:09:00.3802445Z [lighthouse]$ cluster_subm[cluster3]=true
2021-07-13T00:09:00.3817411Z [lighthouse]$ declare -gA cluster_cni
2021-07-13T00:09:00.3830591Z [lighthouse]$ cluster_cni[cluster2]=weave
2021-07-13T00:09:00.3863469Z [lighthouse]$ cluster_cni[cluster3]=weave
2021-07-13T00:09:00.3886021Z [lighthouse]$ source /go/src/github.com/submariner-io/lighthouse/scripts/cluster_settings
2021-07-13T00:09:00.3901084Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:00.3919166Z [lighthouse]$ script_name=cluster_settings
2021-07-13T00:09:00.3937578Z [lighthouse]$ exec_name=deploy.sh
2021-07-13T00:09:00.3978384Z [lighthouse]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-13T00:09:00.4019080Z [lighthouse]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-13T00:09:00.4056503Z [lighthouse]$ cluster_nodes[cluster3]=control-plane worker
2021-07-13T00:09:00.4098289Z [lighthouse]$ declare_cidrs
2021-07-13T00:09:00.4113044Z [lighthouse]$ declare_cidrs
2021-07-13T00:09:00.4126243Z [lighthouse]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-13T00:09:00.4139330Z [lighthouse]$ i=1
2021-07-13T00:09:00.4159999Z [lighthouse]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-13T00:09:00.4173544Z [lighthouse]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-13T00:09:00.4189373Z [lighthouse]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-13T00:09:00.4226062Z [lighthouse]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-13T00:09:00.4248769Z [lighthouse]$ [cluster1] i=$(("$i"+1))
2021-07-13T00:09:00.4264170Z [lighthouse]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-13T00:09:00.4277691Z [lighthouse]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-13T00:09:00.4295991Z [lighthouse]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-13T00:09:00.4309035Z [lighthouse]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-13T00:09:00.4325297Z [lighthouse]$ [cluster2] i=$(("$i"+1))
2021-07-13T00:09:00.4345447Z [lighthouse]$ [cluster3] add_cluster_cidrs 3 cluster3
2021-07-13T00:09:00.4361253Z [lighthouse]$ [cluster3] add_cluster_cidrs 3 cluster3
2021-07-13T00:09:00.4386306Z [lighthouse]$ [cluster3] cluster_CIDRs[cluster3]=10.3.0.0/16
2021-07-13T00:09:00.4414772Z [lighthouse]$ [cluster3] service_CIDRs[cluster3]=100.3.0.0/16
2021-07-13T00:09:00.4429190Z [lighthouse]$ [cluster3] i=$(("$i"+1))
2021-07-13T00:09:00.4441710Z [lighthouse]$ [cluster3] declare_kubeconfig
2021-07-13T00:09:00.4459852Z [lighthouse]$ [cluster3] declare_kubeconfig
2021-07-13T00:09:00.4478286Z [lighthouse]$ [cluster3] source /opt/shipyard/scripts/lib/kubecfg
2021-07-13T00:09:00.4490838Z [lighthouse]$ [cluster3] export KUBECONFIG
2021-07-13T00:09:00.4504842Z [lighthouse]$ [cluster3] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-13T00:09:00.4519605Z [lighthouse]$ [cluster3] find /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs -type f -printf %p:
2021-07-13T00:09:00.4549404Z [lighthouse]$ [cluster3] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-13T00:09:00.6949553Z Installing subctl version devel
2021-07-13T00:09:00.6957982Z OS detected: linux
2021-07-13T00:09:00.6966200Z Architecture detected: amd64
2021-07-13T00:09:00.6972215Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-13T00:09:00.6975083Z
2021-07-13T00:09:00.6975739Z Downloading...
2021-07-13T00:09:01.9107409Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-13T00:09:01.9409997Z This provides subctl version: devel
2021-07-13T00:09:01.9628464Z [lighthouse]$ [cluster3] load_deploytool operator
2021-07-13T00:09:01.9640819Z [lighthouse]$ [cluster3] load_deploytool operator
2021-07-13T00:09:01.9648947Z Will deploy submariner using operator
2021-07-13T00:09:01.9660528Z [lighthouse]$ [cluster3] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-13T00:09:01.9673255Z [lighthouse]$ [cluster3] . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:09:01.9690933Z [lighthouse]$ [cluster3] script_name=deploy_operator
2021-07-13T00:09:01.9710517Z [lighthouse]$ [cluster3] exec_name=deploy.sh
2021-07-13T00:09:01.9732560Z [lighthouse]$ [cluster3] deploytool_prereqs
2021-07-13T00:09:01.9755262Z [lighthouse]$ [cluster3] deploytool_prereqs
2021-07-13T00:09:01.9786476Z 
2021-07-13T00:09:01.9801814Z [lighthouse]$ [cluster3] subctl version
2021-07-13T00:09:02.0029904Z subctl version: devel
2021-07-13T00:09:02.0065104Z [lighthouse]$ [cluster3] run_if_defined pre_deploy
2021-07-13T00:09:02.0079125Z [lighthouse]$ [cluster3] run_if_defined pre_deploy
2021-07-13T00:09:02.0091920Z [lighthouse]$ [cluster3] type -t pre_deploy
2021-07-13T00:09:02.0106553Z [lighthouse]$ [cluster3] grep -q function
2021-07-13T00:09:02.0132820Z [lighthouse]$ [cluster3] return 0
2021-07-13T00:09:02.0147358Z [lighthouse]$ [cluster3] run_subm_clusters prepare_cluster
2021-07-13T00:09:02.0161544Z [lighthouse]$ [cluster3] run_subm_clusters prepare_cluster
2021-07-13T00:09:02.0176215Z [lighthouse]$ [cluster3] declare -a subm_clusters
2021-07-13T00:09:02.0220688Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 prepare_cluster
2021-07-13T00:09:02.0233553Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 prepare_cluster
2021-07-13T00:09:02.0248611Z [lighthouse]$ [cluster3] declare -A pids
2021-07-13T00:09:02.0273406Z [lighthouse]$ [cluster3] eval echo cluster1 cluster2 cluster3
2021-07-13T00:09:02.0297366Z [lighthouse]$ [cluster1] pids[cluster1]=6923
2021-07-13T00:09:02.0302019Z [lighthouse]$ [cluster1] set -o pipefail
2021-07-13T00:09:02.0319152Z [lighthouse]$ [cluster2] pids[cluster2]=6926
2021-07-13T00:09:02.0320230Z [lighthouse]$ [cluster1] prepare_cluster
2021-07-13T00:09:02.0336290Z [lighthouse]$ [cluster2] set -o pipefail
2021-07-13T00:09:02.0346026Z [lighthouse]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-13T00:09:02.0351720Z [lighthouse]$ [cluster3] pids[cluster3]=6930
2021-07-13T00:09:02.0372058Z [lighthouse]$ [cluster3] wait 6930
2021-07-13T00:09:02.0374934Z [lighthouse]$ [cluster2] prepare_cluster
2021-07-13T00:09:02.0389919Z [lighthouse]$ [cluster3] set -o pipefail
2021-07-13T00:09:02.0405839Z [lighthouse]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-13T00:09:02.0420516Z [lighthouse]$ [cluster3] prepare_cluster
2021-07-13T00:09:02.0440821Z [lighthouse]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2021-07-13T00:09:02.4226926Z [lighthouse]$ [cluster3] prepare_cluster
2021-07-13T00:09:02.4227833Z [lighthouse]$ [cluster3] add_subm_gateway_label
2021-07-13T00:09:02.4228676Z [lighthouse]$ [cluster3] add_subm_gateway_label
2021-07-13T00:09:02.4229817Z [lighthouse]$ [cluster3] kubectl label node cluster3-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.4231472Z [lighthouse]$ [cluster3] kubectl label node cluster3-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.4233091Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 label node cluster3-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.4234254Z [cluster3] node/cluster3-worker labeled
2021-07-13T00:09:02.4248752Z [lighthouse]$ [cluster3] wait 6926
2021-07-13T00:09:02.6216266Z [lighthouse]$ [cluster1] prepare_cluster
2021-07-13T00:09:02.6217210Z [lighthouse]$ [cluster1] add_subm_gateway_label
2021-07-13T00:09:02.6218051Z [lighthouse]$ [cluster1] add_subm_gateway_label
2021-07-13T00:09:02.6219179Z [lighthouse]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6221723Z [lighthouse]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6224110Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6225516Z [cluster1] node/cluster1-worker labeled
2021-07-13T00:09:02.6489858Z [lighthouse]$ [cluster2] prepare_cluster
2021-07-13T00:09:02.6490778Z [lighthouse]$ [cluster2] add_subm_gateway_label
2021-07-13T00:09:02.6491621Z [lighthouse]$ [cluster2] add_subm_gateway_label
2021-07-13T00:09:02.6492750Z [lighthouse]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6494202Z [lighthouse]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6495708Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-13T00:09:02.6496970Z [cluster2] node/cluster2-worker labeled
2021-07-13T00:09:02.6503893Z [lighthouse]$ [cluster3] wait 6923
2021-07-13T00:09:02.6519542Z [lighthouse]$ [cluster3] with_context cluster1 setup_broker
2021-07-13T00:09:02.6534201Z [lighthouse]$ [cluster3] with_context cluster1 setup_broker
2021-07-13T00:09:02.6550219Z [lighthouse]$ [cluster1] setup_broker
2021-07-13T00:09:02.6566194Z [lighthouse]$ [cluster1] setup_broker
2021-07-13T00:09:02.6583927Z [lighthouse]$ [cluster1] sd=--components service-discovery,connectivity
2021-07-13T00:09:02.6586378Z Installing broker...
2021-07-13T00:09:02.6598096Z [lighthouse]$ [cluster1] subctlrepver=
2021-07-13T00:09:02.6611957Z [lighthouse]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-13T00:09:02.6644235Z [lighthouse]$ [cluster1] cd /go/src/github.com/submariner-io/lighthouse/output
2021-07-13T00:09:02.6660751Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --components service-discovery,connectivity
2021-07-13T00:09:02.6921552Z • Setting up broker RBAC ...
2021-07-13T00:09:02.8004372Z ✓ Setting up broker RBAC
2021-07-13T00:09:02.8007043Z • Deploying the Submariner operator ...
2021-07-13T00:09:14.2674724Z ✓ Deploying the Submariner operator
2021-07-13T00:09:14.2675498Z ✓ Created operator CRDs
2021-07-13T00:09:14.2676316Z ✓ Created operator namespace: submariner-operator
2021-07-13T00:09:14.2677695Z ✓ Created operator service account and role
2021-07-13T00:09:14.2678502Z ✓ Created lighthouse service account and role
2021-07-13T00:09:14.2679445Z ✓ Created Lighthouse service accounts and roles
2021-07-13T00:09:14.2680339Z ✓ Deployed the operator successfully
2021-07-13T00:09:14.2681057Z • Deploying the broker ...
2021-07-13T00:09:14.2764145Z ✓ Deploying the broker
2021-07-13T00:09:14.2764848Z ✓ The broker has been deployed
2021-07-13T00:09:14.2765583Z • Creating broker-info.subm file ...
2021-07-13T00:09:14.2887948Z ✓ Creating broker-info.subm file
2021-07-13T00:09:14.2888910Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-13T00:09:14.2923661Z [lighthouse]$ [cluster3] install_subm_all_clusters
2021-07-13T00:09:14.2935017Z [lighthouse]$ [cluster3] install_subm_all_clusters
2021-07-13T00:09:14.2946893Z [lighthouse]$ [cluster3] run_subm_clusters subctl_install_subm
2021-07-13T00:09:14.2961618Z [lighthouse]$ [cluster3] run_subm_clusters subctl_install_subm
2021-07-13T00:09:14.2973941Z [lighthouse]$ [cluster3] declare -a subm_clusters
2021-07-13T00:09:14.3019113Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 subctl_install_subm
2021-07-13T00:09:14.3032266Z [lighthouse]$ [cluster3] run_parallel cluster1 cluster2 cluster3 cluster1 cluster2 cluster3 subctl_install_subm
2021-07-13T00:09:14.3044507Z [lighthouse]$ [cluster3] declare -A pids
2021-07-13T00:09:14.3064743Z [lighthouse]$ [cluster3] eval echo cluster1 cluster2 cluster3
2021-07-13T00:09:14.3087480Z [lighthouse]$ [cluster1] set -o pipefail
2021-07-13T00:09:14.3088382Z [lighthouse]$ [cluster1] pids[cluster1]=7008
2021-07-13T00:09:14.3103949Z [lighthouse]$ [cluster1] subctl_install_subm
2021-07-13T00:09:14.3111386Z [lighthouse]$ [cluster2] set -o pipefail
2021-07-13T00:09:14.3142709Z [lighthouse]$ [cluster2] subctl_install_subm
2021-07-13T00:09:14.3166927Z [lighthouse]$ [cluster2] pids[cluster2]=7011
2021-07-13T00:09:14.3251634Z [lighthouse]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-13T00:09:14.3290326Z [lighthouse]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-13T00:09:14.3305468Z [lighthouse]$ [cluster3] pids[cluster3]=7025
2021-07-13T00:09:14.3348768Z [lighthouse]$ [cluster3] wait 7025
2021-07-13T00:09:14.3358415Z [lighthouse]$ [cluster3] set -o pipefail
2021-07-13T00:09:14.3378974Z [lighthouse]$ [cluster3] subctl_install_subm
2021-07-13T00:09:14.3394264Z [lighthouse]$ [cluster3] sed /\[cluster3]/!s/^/[cluster3] /
2021-07-13T00:09:22.1157775Z [lighthouse]$ [cluster1] subctl_install_subm
2021-07-13T00:09:22.1158734Z [lighthouse]$ [cluster1] subctlrepver=
2021-07-13T00:09:22.1159906Z [lighthouse]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-13T00:09:22.1161015Z [lighthouse]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-13T00:09:22.1163602Z [lighthouse]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm
2021-07-13T00:09:22.1166275Z [cluster1] * /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-13T00:09:22.1167584Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-13T00:09:22.1168401Z [cluster1] - cluster1-worker
2021-07-13T00:09:22.1169198Z [cluster1] • Discovering network details ...
2021-07-13T00:09:22.1169975Z [cluster1] Network plugin: weave-net
2021-07-13T00:09:22.1170550Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-13T00:09:22.1171064Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-13T00:09:22.1171799Z [cluster1] ✓ Discovering network details
2021-07-13T00:09:22.1172599Z [cluster1] • Discovering multi cluster details ...
2021-07-13T00:09:22.1173478Z [cluster1] • Validating Globalnet configurations ...
2021-07-13T00:09:22.1174370Z [cluster1] ✓ Validating Globalnet configurations
2021-07-13T00:09:22.1175208Z [cluster1] ✓ Discovering multi cluster details
2021-07-13T00:09:22.1176457Z [cluster1] • Deploying the Submariner operator ...
2021-07-13T00:09:22.1178814Z [cluster1] ✓ Deploying the Submariner operator
2021-07-13T00:09:22.1180056Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-13T00:09:22.1180996Z [cluster1] • Creating SA for cluster ...
2021-07-13T00:09:22.1181917Z [cluster1] ✓ Creating SA for cluster
2021-07-13T00:09:22.1182718Z [cluster1] • Deploying Submariner ...
2021-07-13T00:09:22.1183452Z [cluster1] ✓ Deploying Submariner
2021-07-13T00:09:22.1184175Z [cluster1] ✓ Submariner is up and running
2021-07-13T00:09:31.1532047Z [lighthouse]$ [cluster2] subctl_install_subm
2021-07-13T00:09:31.1532943Z [lighthouse]$ [cluster2] subctlrepver=
2021-07-13T00:09:31.1533979Z [lighthouse]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-13T00:09:31.1535196Z [lighthouse]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-13T00:09:31.1537760Z [lighthouse]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm
2021-07-13T00:09:31.1540625Z [cluster2] * /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-13T00:09:31.1541713Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-13T00:09:31.1542753Z [cluster2] - cluster2-worker
2021-07-13T00:09:31.1543567Z [cluster2] • Discovering network details ...
2021-07-13T00:09:31.1544346Z [cluster2] Network plugin: weave-net
2021-07-13T00:09:31.1545093Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-13T00:09:31.1545615Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-13T00:09:31.1546436Z [cluster2] ✓ Discovering network details
2021-07-13T00:09:31.1547246Z [cluster2] • Discovering multi cluster details ...
2021-07-13T00:09:31.1548215Z [cluster2] • Validating Globalnet configurations ...
2021-07-13T00:09:31.1549164Z [cluster2] ✓ Validating Globalnet configurations
2021-07-13T00:09:31.1550015Z [cluster2] ✓ Discovering multi cluster details
2021-07-13T00:09:31.1550871Z [cluster2] • Deploying the Submariner operator ...
2021-07-13T00:09:31.1551767Z [cluster2] ✓ Deploying the Submariner operator
2021-07-13T00:09:31.1552536Z [cluster2] ✓ Created operator CRDs
2021-07-13T00:09:31.1553441Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-13T00:09:31.1554417Z [cluster2] ✓ Created operator service account and role
2021-07-13T00:09:31.1555303Z [cluster2] ✓ Created lighthouse service account and role
2021-07-13T00:09:31.1556305Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-13T00:09:31.1557355Z [cluster2] ✓ Deployed the operator successfully
2021-07-13T00:09:31.1558184Z [cluster2] • Creating SA for cluster ...
2021-07-13T00:09:31.1558886Z [cluster2] ✓ Creating SA for cluster
2021-07-13T00:09:31.1559668Z [cluster2] • Deploying Submariner ...
2021-07-13T00:09:31.1560767Z [cluster2] ✓ Deploying Submariner
2021-07-13T00:09:31.1561576Z [cluster2] ✓ Submariner is up and running
2021-07-13T00:09:31.3513029Z [lighthouse]$ [cluster3] subctl_install_subm
2021-07-13T00:09:31.3514451Z [lighthouse]$ [cluster3] subctlrepver=
2021-07-13T00:09:31.3515932Z [lighthouse]$ [cluster3] subctlrepver=--repository localhost:5000 --version local
2021-07-13T00:09:31.3517343Z [lighthouse]$ [cluster3] PASS_CIDR_ARGS=false
2021-07-13T00:09:31.3520520Z [lighthouse]$ [cluster3] subctl join --kubeconfig /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs/kind-config-cluster3 --clusterid cluster3 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm
2021-07-13T00:09:31.3530797Z [cluster3] * /go/src/github.com/submariner-io/lighthouse/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-13T00:09:31.3532162Z [cluster3] * There are 1 labeled nodes in the cluster:
2021-07-13T00:09:31.3533517Z [cluster3] - cluster3-worker
2021-07-13T00:09:31.3568832Z [cluster3] • Discovering network details ...
2021-07-13T00:09:31.3570112Z [cluster3] Network plugin: weave-net
2021-07-13T00:09:31.3570719Z [cluster3] Service CIDRs: [100.3.0.0/16]
2021-07-13T00:09:31.3571245Z [cluster3] Cluster CIDRs: [10.3.0.0/16]
2021-07-13T00:09:31.3572042Z [cluster3] ✓ Discovering network details
2021-07-13T00:09:31.3572952Z [cluster3] • Discovering multi cluster details ...
2021-07-13T00:09:31.3573883Z [cluster3] • Validating Globalnet configurations ...
2021-07-13T00:09:31.3574796Z [cluster3] ✓ Validating Globalnet configurations
2021-07-13T00:09:31.3575685Z [cluster3] ✓ Discovering multi cluster details
2021-07-13T00:09:31.3576554Z [cluster3] • Deploying the Submariner operator ...
2021-07-13T00:09:31.3577420Z [cluster3] ✓ Deploying the Submariner operator
2021-07-13T00:09:31.3578248Z [cluster3] ✓ Created operator CRDs
2021-07-13T00:09:31.3579176Z [cluster3] ✓ Created operator namespace: submariner-operator
2021-07-13T00:09:31.3580423Z [cluster3] ✓ Created operator service account and role
2021-07-13T00:09:31.3581353Z [cluster3] ✓ Created lighthouse service account and role
2021-07-13T00:09:31.3582302Z [cluster3] ✓ Created Lighthouse service accounts and roles
2021-07-13T00:09:31.3588685Z [cluster3] ✓ Deployed the operator successfully
2021-07-13T00:09:31.3589696Z [cluster3] • Creating SA for cluster ...
2021-07-13T00:09:31.3590523Z [cluster3] ✓ Creating SA for cluster
2021-07-13T00:09:31.3591268Z [cluster3] • Deploying Submariner ...
2021-07-13T00:09:31.3593830Z [cluster3] ✓ Deploying Submariner
2021-07-13T00:09:31.3595177Z [cluster3] ✓ Submariner is up and running
2021-07-13T00:09:31.3596219Z [lighthouse]$ [cluster3] wait 7011
2021-07-13T00:09:31.3599993Z [lighthouse]$ [cluster3] wait 7008
2021-07-13T00:09:31.3752356Z [lighthouse]$ [cluster3] with_context cluster3 with_retries 30 verify_gw_status
2021-07-13T00:09:31.3773483Z [lighthouse]$ [cluster3] with_context cluster3 with_retries 30 verify_gw_status
2021-07-13T00:09:31.3840278Z [lighthouse]$ [cluster3] with_retries 30 verify_gw_status
2021-07-13T00:09:31.3857944Z [lighthouse]$ [cluster3] with_retries
2021-07-13T00:09:31.3874641Z [lighthouse]$ [cluster3] iteration=1
2021-07-13T00:09:31.3982009Z [lighthouse]$ [cluster3] wait 7070
2021-07-13T00:09:31.4106450Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:31.4169461Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:31.4224336Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:09:31.4273243Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:31.4338065Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:09:31.9311578Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:31.9330160Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:09:32.2268027Z • ...
2021-07-13T00:09:32.3374180Z • ...
2021-07-13T00:09:33.2744508Z • ...
2021-07-13T00:09:33.2768408Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:09:33.2783087Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:09:39.2834304Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:09:39.2881758Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:39.2956537Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:39.2964621Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:09:39.2973876Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:39.3043347Z [lighthouse]$ [cluster3] wait 7096
2021-07-13T00:09:39.3143517Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:09:40.3306089Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:40.3322694Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:09:40.7867732Z • ...
2021-07-13T00:09:40.9301898Z • ...
2021-07-13T00:09:41.0433847Z • ...
2021-07-13T00:09:41.0459371Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:09:41.0471002Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:09:47.2867731Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:09:47.2877236Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:47.2878837Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:47.2879973Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:09:47.2881048Z [lighthouse]$ [cluster3] wait 7122
2021-07-13T00:09:47.2882160Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:47.2883466Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:09:48.2076730Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:48.2098444Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:09:48.4763105Z • ...
2021-07-13T00:09:48.5548679Z • ...
2021-07-13T00:09:48.6630367Z • ...
2021-07-13T00:09:48.6650375Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:09:48.6667035Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:09:54.6692806Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:09:54.6735644Z [lighthouse]$ [cluster3] wait 7148
2021-07-13T00:09:54.6748636Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:54.6764103Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:09:54.6779018Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:09:54.6928700Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:54.7183346Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:09:55.8617662Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:09:55.8638525Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:09:56.6853423Z • ...
2021-07-13T00:09:56.7359843Z • ...
2021-07-13T00:09:57.2828140Z • ...
2021-07-13T00:09:57.2866105Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:09:57.2878598Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:10:03.2893647Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:10:03.2938442Z [lighthouse]$ [cluster3] wait 7174
2021-07-13T00:10:03.2961991Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:03.2983160Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:03.3002377Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:10:03.3046876Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:03.3065657Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:10:04.4318291Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:04.4335863Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:10:04.7873225Z • ...
2021-07-13T00:10:05.0896676Z • ...
2021-07-13T00:10:05.2629481Z • ...
2021-07-13T00:10:05.2651394Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:10:05.2676198Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:10:11.2705474Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:10:11.2742802Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:11.2754753Z [lighthouse]$ [cluster3] wait 7201
2021-07-13T00:10:11.2772664Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:11.2808125Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:10:11.2851748Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:11.2923619Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:10:11.6026312Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:11.6071750Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:10:11.7918932Z • ...
2021-07-13T00:10:11.9156487Z • ...
2021-07-13T00:10:11.9513675Z • ...
2021-07-13T00:10:11.9534537Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:10:11.9546536Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:10:17.9577718Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:10:17.9617760Z [lighthouse]$ [cluster3] wait 7228
2021-07-13T00:10:17.9670766Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:17.9720045Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:17.9807540Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:10:17.9817361Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:17.9873485Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:10:18.2273692Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:18.2294343Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:10:18.4823276Z • ...
2021-07-13T00:10:18.5424404Z • ...
2021-07-13T00:10:18.5750167Z • ...
2021-07-13T00:10:18.5833124Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:10:18.5845274Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:10:24.5890600Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:10:24.5932382Z [lighthouse]$ [cluster3] wait 7254
2021-07-13T00:10:24.5940291Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:24.5951007Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:24.5984323Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:10:24.6021875Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:24.6212428Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:10:25.1541647Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:25.1544785Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:10:25.6158174Z • ...
2021-07-13T00:10:25.6200307Z • ...
2021-07-13T00:10:25.6670641Z • ...
2021-07-13T00:10:25.6699075Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-13T00:10:25.6710900Z [lighthouse]$ [cluster3] sleep 6
2021-07-13T00:10:31.6738796Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:10:31.6829545Z [lighthouse]$ [cluster3] wait 7280
2021-07-13T00:10:31.6846823Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:31.6858660Z [lighthouse]$ [cluster3] verify_gw_status
2021-07-13T00:10:31.6869834Z [lighthouse]$ [cluster3] sleep_duration=6
2021-07-13T00:10:31.6881249Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:31.6961259Z [lighthouse]$ [cluster3] grep the server could not find the requested resource
2021-07-13T00:10:32.4645936Z [lighthouse]$ [cluster3] subctl show connections
2021-07-13T00:10:32.4662818Z [lighthouse]$ [cluster3] grep connected
2021-07-13T00:10:33.1378470Z • ...
2021-07-13T00:10:33.1792856Z • ...
2021-07-13T00:10:33.2315454Z • ...
2021-07-13T00:10:33.2341040Z cluster3-worker cluster3 172.18.0.7 no libreswan 100.3.0.0/16, 10.3.0.0/16 connected 0s
2021-07-13T00:10:33.2342306Z cluster1-worker cluster1 172.18.0.4 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 0s
2021-07-13T00:10:33.2350404Z cluster3-worker cluster3 172.18.0.7 no libreswan 100.3.0.0/16, 10.3.0.0/16 connected 413.283µs
2021-07-13T00:10:33.2352000Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 0s
2021-07-13T00:10:33.2353170Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 0s
2021-07-13T00:10:33.2376769Z [lighthouse]$ [cluster3] return 0
2021-07-13T00:10:33.2401437Z [lighthouse]$ [cluster3] return 0
2021-07-13T00:10:33.2434344Z [lighthouse]$ [cluster3] with_context cluster3 connectivity_tests cluster2
2021-07-13T00:10:33.2455686Z [lighthouse]$ [cluster3] with_context cluster3 connectivity_tests cluster2
2021-07-13T00:10:33.2475568Z [lighthouse]$ [cluster3] connectivity_tests cluster2
2021-07-13T00:10:33.2650875Z [lighthouse]$ [cluster3] connectivity_tests
2021-07-13T00:10:33.2668843Z [lighthouse]$ [cluster3] target_cluster=cluster2
2021-07-13T00:10:33.2696734Z [lighthouse]$ [cluster3] import_image quay.io/submariner/nettest
2021-07-13T00:10:33.2733373Z [lighthouse]$ [cluster3] import_image quay.io/submariner/nettest
2021-07-13T00:10:33.2814274Z [lighthouse]$ [cluster3] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-13T00:10:34.2831427Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-13T00:10:34.2996490Z [lighthouse]$ [cluster3] docker pull quay.io/submariner/nettest:devel
2021-07-13T00:10:36.3536895Z devel: Pulling from submariner/nettest
2021-07-13T00:10:36.3537651Z 5843afab3874: Pulling fs layer
2021-07-13T00:10:36.3538154Z c4e538a54bac: Pulling fs layer
2021-07-13T00:10:36.3538630Z 9a7003ef0c64: Pulling fs layer
2021-07-13T00:10:36.3545662Z 13169dc98b5b: Pulling fs layer
2021-07-13T00:10:36.3546151Z 13169dc98b5b: Waiting
2021-07-13T00:10:36.7419194Z c4e538a54bac: Verifying Checksum
2021-07-13T00:10:36.7419783Z c4e538a54bac: Download complete
2021-07-13T00:10:36.8079854Z 5843afab3874: Verifying Checksum
2021-07-13T00:10:36.8080515Z 5843afab3874: Download complete
2021-07-13T00:10:36.8343561Z 9a7003ef0c64: Verifying Checksum
2021-07-13T00:10:36.8344211Z 9a7003ef0c64: Download complete
2021-07-13T00:10:37.1229879Z 13169dc98b5b: Verifying Checksum
2021-07-13T00:10:37.1231400Z 13169dc98b5b: Download complete
2021-07-13T00:10:37.2052197Z 5843afab3874: Pull complete
2021-07-13T00:10:37.3203369Z c4e538a54bac: Pull complete
2021-07-13T00:10:37.7364745Z 9a7003ef0c64: Pull complete
2021-07-13T00:10:37.8458474Z 13169dc98b5b: Pull complete
2021-07-13T00:10:37.8504657Z Digest: sha256:543b18d6e99bf290e0ad8994eb10b8160b9ceec0c6ab5017a5c6fc06c757906e
2021-07-13T00:10:37.8536506Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-13T00:10:37.8612500Z [lighthouse]$ [cluster3] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-13T00:10:37.8613381Z quay.io/submariner/nettest:devel
2021-07-13T00:10:38.1565753Z [lighthouse]$ [cluster3] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-13T00:10:38.4526530Z [lighthouse]$ [cluster3] docker push localhost:5000/nettest:local
2021-07-13T00:10:38.7444731Z The push refers to repository [localhost:5000/nettest]
2021-07-13T00:10:38.7515905Z 7409cf092f1a: Preparing
2021-07-13T00:10:38.7516506Z cf25153378a9: Preparing
2021-07-13T00:10:38.7517462Z 1fbb10e45b76: Preparing
2021-07-13T00:10:38.7518402Z 72e830a4dff5: Preparing
2021-07-13T00:10:39.3728851Z 1fbb10e45b76: Pushed
2021-07-13T00:10:39.3729401Z 7409cf092f1a: Pushed
2021-07-13T00:10:39.4202598Z 72e830a4dff5: Pushed
2021-07-13T00:10:40.1590729Z cf25153378a9: Pushed
2021-07-13T00:10:40.2085754Z local: digest: sha256:543b18d6e99bf290e0ad8994eb10b8160b9ceec0c6ab5017a5c6fc06c757906e size: 1155
2021-07-13T00:10:40.2190171Z [lighthouse]$ [cluster3] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-13T00:10:40.2205787Z [lighthouse]$ [cluster3] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-13T00:10:40.2261309Z [lighthouse]$ [cluster3] resource_name=$(basename "$resource_file" ".yaml")
2021-07-13T00:10:40.2305355Z [lighthouse]$ [cluster3] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-13T00:10:40.2371658Z [lighthouse]$ [cluster3] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-13T00:10:40.2388259Z [lighthouse]$ [cluster3] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-13T00:10:40.2402347Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-13T00:10:41.0144892Z deployment.apps/netshoot created
2021-07-13T00:10:41.0227335Z Waiting for netshoot pods to be ready.
2021-07-13T00:10:41.0243306Z [lighthouse]$ [cluster3] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-13T00:10:41.0262085Z [lighthouse]$ [cluster3] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-13T00:10:41.0285370Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 rollout status deploy/netshoot --timeout=5m
2021-07-13T00:10:41.3858831Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-13T00:10:43.3982687Z deployment "netshoot" successfully rolled out
2021-07-13T00:10:43.4058924Z [lighthouse]$ [cluster3] with_context cluster2 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:43.4072695Z [lighthouse]$ [cluster3] with_context cluster2 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:43.4092625Z [lighthouse]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:43.4112761Z [lighthouse]$ [cluster2] deploy_resource
2021-07-13T00:10:43.4129546Z [lighthouse]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-13T00:10:43.4146345Z [lighthouse]$ [cluster2] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-13T00:10:43.4170226Z [lighthouse]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:43.4189952Z [lighthouse]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:43.4205363Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-13T00:10:44.1388964Z deployment.apps/nginx-demo created
2021-07-13T00:10:44.1739903Z service/nginx-demo created
2021-07-13T00:10:44.2977465Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-13T00:10:44.3054476Z Waiting for nginx-demo pods to be ready.
2021-07-13T00:10:44.3072258Z [lighthouse]$ [cluster2] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-13T00:10:44.3099854Z [lighthouse]$ [cluster2] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-13T00:10:44.3123735Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/nginx-demo --timeout=5m
2021-07-13T00:10:45.0447579Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-13T00:10:52.4979074Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-13T00:10:52.6844935Z deployment "nginx-demo" successfully rolled out
2021-07-13T00:10:52.6910497Z [lighthouse]$ [cluster3] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-13T00:10:52.6930053Z [lighthouse]$ [cluster3] kubectl get pods -l app=netshoot
2021-07-13T00:10:52.6958050Z [lighthouse]$ [cluster3] awk FNR == 2 {print $1}
2021-07-13T00:10:52.6974511Z [lighthouse]$ [cluster3] kubectl get pods -l app=netshoot
2021-07-13T00:10:52.7002952Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 get pods -l app=netshoot
2021-07-13T00:10:53.0962227Z [lighthouse]$ [cluster3] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-13T00:10:53.0981735Z [lighthouse]$ [cluster3] with_context cluster2 get_svc_ip nginx-demo
2021-07-13T00:10:53.0995407Z [lighthouse]$ [cluster3] with_context cluster2 get_svc_ip nginx-demo
2021-07-13T00:10:53.1012301Z [lighthouse]$ [cluster2] get_svc_ip nginx-demo
2021-07-13T00:10:53.1024193Z [lighthouse]$ [cluster2] get_svc_ip
2021-07-13T00:10:53.1042278Z [lighthouse]$ [cluster2] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-13T00:10:53.1062156Z [lighthouse]$ [cluster2] kubectl --context=cluster2 get svc -l app=nginx-demo
2021-07-13T00:10:53.1077492Z [lighthouse]$ [cluster2] awk FNR == 2 {print $3}
2021-07-13T00:10:53.1085612Z [lighthouse]$ [cluster2] kubectl --context=cluster2 get svc -l app=nginx-demo
2021-07-13T00:10:53.1123543Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get svc -l app=nginx-demo
2021-07-13T00:10:53.4441280Z [lighthouse]$ [cluster3] with_retries 5 test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:10:53.4461893Z [lighthouse]$ [cluster3] with_retries 5 test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:10:53.4478699Z [lighthouse]$ [cluster3] iteration=1
2021-07-13T00:10:53.4510117Z [lighthouse]$ [cluster3] test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:10:53.4514416Z [lighthouse]$ [cluster3] wait 7435
2021-07-13T00:10:53.4527195Z [lighthouse]$ [cluster3] test_connection
2021-07-13T00:10:53.4533966Z Attempting connectivity between clusters - netshoot-789f6cf54f-hgks4 --> 100.2.36.127
2021-07-13T00:10:53.4545382Z [lighthouse]$ [cluster3] wait_time=30
2021-07-13T00:10:53.4558188Z [lighthouse]$ [cluster3] start_time=$(date +%s)
2021-07-13T00:10:53.4582936Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:10:53.4691328Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:10:53.4712256Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:10:53.4726851Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:23.9636646Z command terminated with exit code 28
2021-07-13T00:11:23.9693528Z [lighthouse]$ [cluster3] end_time=$(date +%s)
2021-07-13T00:11:23.9713685Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:11:23.9769071Z [lighthouse]$ [cluster3] execution_time=$(( end_time - start_time))
2021-07-13T00:11:23.9779791Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:11:23.9829362Z [lighthouse]$ [cluster3] wait 7458
2021-07-13T00:11:23.9847296Z [lighthouse]$ [cluster3] test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:11:23.9902024Z [lighthouse]$ [cluster3] test_connection
2021-07-13T00:11:23.9915688Z Attempting connectivity between clusters - netshoot-789f6cf54f-hgks4 --> 100.2.36.127
2021-07-13T00:11:23.9933658Z [lighthouse]$ [cluster3] wait_time=30
2021-07-13T00:11:23.9965791Z [lighthouse]$ [cluster3] start_time=$(date +%s)
2021-07-13T00:11:23.9982216Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:11:24.0007017Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:24.0018293Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:24.0032663Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:54.4410844Z command terminated with exit code 28
2021-07-13T00:11:54.4456797Z [lighthouse]$ [cluster3] end_time=$(date +%s)
2021-07-13T00:11:54.4475587Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:11:54.4501594Z [lighthouse]$ [cluster3] execution_time=$(( end_time - start_time))
2021-07-13T00:11:54.4516317Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:11:54.4564247Z [lighthouse]$ [cluster3] test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:11:54.4565238Z [lighthouse]$ [cluster3] wait 7482
2021-07-13T00:11:54.4578965Z [lighthouse]$ [cluster3] test_connection
2021-07-13T00:11:54.4587215Z Attempting connectivity between clusters - netshoot-789f6cf54f-hgks4 --> 100.2.36.127
2021-07-13T00:11:54.4600013Z [lighthouse]$ [cluster3] wait_time=30
2021-07-13T00:11:54.4613320Z [lighthouse]$ [cluster3] start_time=$(date +%s)
2021-07-13T00:11:54.4628760Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:11:54.4678870Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:54.4700810Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:11:54.4712812Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:24.8829438Z command terminated with exit code 28
2021-07-13T00:12:24.8879622Z [lighthouse]$ [cluster3] end_time=$(date +%s)
2021-07-13T00:12:24.8899220Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:12:24.8931910Z [lighthouse]$ [cluster3] execution_time=$(( end_time - start_time))
2021-07-13T00:12:24.8945718Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:12:24.8991303Z [lighthouse]$ [cluster3] wait 7505
2021-07-13T00:12:24.8999789Z [lighthouse]$ [cluster3] test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:12:24.9022752Z [lighthouse]$ [cluster3] test_connection
2021-07-13T00:12:24.9028969Z Attempting connectivity between clusters - netshoot-789f6cf54f-hgks4 --> 100.2.36.127
2021-07-13T00:12:24.9041469Z [lighthouse]$ [cluster3] wait_time=30
2021-07-13T00:12:24.9054830Z [lighthouse]$ [cluster3] start_time=$(date +%s)
2021-07-13T00:12:24.9072246Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:12:24.9095986Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:24.9112704Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:24.9126878Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:55.3254155Z command terminated with exit code 28
2021-07-13T00:12:55.3297892Z [lighthouse]$ [cluster3] end_time=$(date +%s)
2021-07-13T00:12:55.3316279Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:12:55.3340352Z [lighthouse]$ [cluster3] execution_time=$(( end_time - start_time))
2021-07-13T00:12:55.3357857Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:12:55.3409114Z [lighthouse]$ [cluster3] wait 7528
2021-07-13T00:12:55.3420739Z [lighthouse]$ [cluster3] test_connection netshoot-789f6cf54f-hgks4 100.2.36.127
2021-07-13T00:12:55.3434511Z [lighthouse]$ [cluster3] test_connection
2021-07-13T00:12:55.3446718Z Attempting connectivity between clusters - netshoot-789f6cf54f-hgks4 --> 100.2.36.127
2021-07-13T00:12:55.3519096Z [lighthouse]$ [cluster3] wait_time=30
2021-07-13T00:12:55.3533149Z [lighthouse]$ [cluster3] start_time=$(date +%s)
2021-07-13T00:12:55.3559217Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:12:55.3590804Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:55.3602763Z [lighthouse]$ [cluster3] kubectl exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:12:55.3616208Z [lighthouse]$ [cluster3] command kubectl --context=cluster3 exec netshoot-789f6cf54f-hgks4 -- curl --output /dev/null -m 30 --silent --head --fail 100.2.36.127
2021-07-13T00:13:25.7944495Z command terminated with exit code 28
2021-07-13T00:13:25.8003943Z [lighthouse]$ [cluster3] end_time=$(date +%s)
2021-07-13T00:13:25.8020601Z [lighthouse]$ [cluster3] date +%s
2021-07-13T00:13:25.8064630Z [lighthouse]$ [cluster3] execution_time=$(( end_time - start_time))
2021-07-13T00:13:25.8083222Z [lighthouse]$ [cluster3] return 1
2021-07-13T00:13:25.8114173Z Max attempts reached, failed to run 'test_connection netshoot-789f6cf54f-hgks4 100.2.36.127'!
2021-07-13T00:13:25.8126557Z [lighthouse]$ [cluster3] exit 1
2021-07-13T00:13:25.8144967Z make[1]: *** [Makefile:38: deploy] Error 1
2021-07-13T00:13:25.8149558Z make[1]: Leaving directory '/go/src/github.com/submariner-io/lighthouse'
2021-07-13T00:13:25.8505857Z make: *** [/opt/shipyard/Makefile.inc:106: e2e] Error 2
2021-07-13T00:13:25.8535884Z [lighthouse]$ make --debug=b e2e
2021-07-13T00:13:35.5101130Z time="2021-07-13T00:13:35Z" level=fatal msg="exit status 2"
2021-07-13T00:13:35.5111068Z make: *** [Makefile.dapper:28: e2e] Error 1
2021-07-13T00:13:35.5166483Z ##[error]Process completed with exit code 2.
2021-07-13T00:13:35.5312286Z ##[group]Run submariner-io/shipyard/gh-actions/post-mortem@devel
2021-07-13T00:13:35.5312990Z ##[endgroup]
2021-07-13T00:13:35.6144677Z ##[group]Report available disk space
2021-07-13T00:13:35.6178634Z Filesystem Size Used Avail Use% Mounted on
2021-07-13T00:13:35.6181808Z /dev/root 84G 55G 29G 66% /
2021-07-13T00:13:35.6182271Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-13T00:13:35.6182718Z tmpfs 3.4G 157M 3.3G 5% /dev/shm
2021-07-13T00:13:35.6183153Z tmpfs 696M 1.9M 694M 1% /run
2021-07-13T00:13:35.6183578Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-13T00:13:35.6184049Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-13T00:13:35.6184571Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-13T00:13:35.6185087Z /dev/loop2 33M 33M 0 100% /snap/snapd/12398
2021-07-13T00:13:35.6185581Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-13T00:13:35.6186182Z /dev/loop3 68M 68M 0 100% /snap/lxd/20326
2021-07-13T00:13:35.6186694Z /dev/loop4 33M 33M 0 100% /snap/snapd/12159
2021-07-13T00:13:35.6187189Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-13T00:13:35.6187628Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-13T00:13:35.6188699Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/39415e70da0530f6fbcd0652c39e8e9b0c84315b4b933eb2fe6910337affa4c1/merged
2021-07-13T00:13:35.6190211Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/47376e74071365d8812d075e6f8b2251c2acac882223468cb1104a6080a78e3b/merged
2021-07-13T00:13:35.6191807Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/b112056490f4fe14821863e219282232221f7a5a0bbcebe711e059fd94572e04/merged
2021-07-13T00:13:35.6193508Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/6665451cbba1de2937b818fd691fd7105935e65525e29195f100824286c5d702/merged
2021-07-13T00:13:35.6195215Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/75f41b54b4ad2a94d1d1ab0a5f4f1eff8fd73a4bcd6e2293047a9f355325e804/merged
2021-07-13T00:13:35.6197856Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/b2637a7c9cbe10be1be034800a57ba9e57adc6fca70c07f1c2e7ffab5702f3b8/merged
2021-07-13T00:13:35.6199634Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/0a91752d84537922824e6bdbddf55279feefd87e6e8d86009d23623de282450d/merged
2021-07-13T00:13:35.6201356Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/fad8660bc7335769b25673b1b507e9e80d1fe048f1eff4ed8633d760c3e19158/merged
2021-07-13T00:13:35.6203106Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/884f8ae4f69586cdcad27d1578bf74851fc2821e6cc13f1fe253b9dc6edbd7a2/merged
2021-07-13T00:13:35.6204779Z overlay 84G 55G 29G 66% /var/lib/docker/overlay2/244ad86e60a9ca721745e018b02455b901d12e26a55fba2f8d3481879e970c2a/merged
2021-07-13T00:13:35.6205885Z ##[endgroup]
2021-07-13T00:13:35.6206364Z ##[group]Report available RAM
2021-07-13T00:13:35.6247993Z total used free shared buff/cache available
2021-07-13T00:13:35.6249704Z Mem: 6.8Gi 4.5Gi 181Mi 234Mi 2.1Gi 1.9Gi
2021-07-13T00:13:35.6250159Z Swap: 0B 0B 0B
2021-07-13T00:13:35.6251359Z ##[endgroup]
2021-07-13T00:13:35.6388746Z ##[group]Running post mortem
2021-07-13T00:13:35.6439741Z docker network create -d bridge kind
2021-07-13T00:13:35.6991927Z Error response from daemon: network with name kind already exists
2021-07-13T00:13:35.7046047Z make: [Makefile.dapper:27: post-mortem] Error 1 (ignored)
2021-07-13T00:13:35.7047058Z ./.dapper -m bind make --debug=b post-mortem
2021-07-13T00:13:38.6169151Z Sending build context to Docker daemon 86.05MB
2021-07-13T00:13:38.6169702Z
2021-07-13T00:13:38.6274319Z Step 1/8 : ARG BASE_BRANCH
2021-07-13T00:13:38.6278917Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-13T00:13:38.6286592Z ---> 655a9f35d3cf
2021-07-13T00:13:38.6287323Z Step 3/8 : ARG PROJECT
2021-07-13T00:13:38.6302612Z ---> Using cache
2021-07-13T00:13:38.6303204Z ---> 7ce2bd8bf02f
2021-07-13T00:13:38.6306585Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-13T00:13:38.6320044Z ---> Using cache
2021-07-13T00:13:38.6320628Z ---> 160d6a254756
2021-07-13T00:13:38.6323638Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-13T00:13:38.6339519Z ---> Using cache
2021-07-13T00:13:38.6341989Z ---> bee26c878fd6
2021-07-13T00:13:38.6345322Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-13T00:13:38.6360706Z ---> Using cache
2021-07-13T00:13:38.6362606Z ---> f65d9b2ee43e
2021-07-13T00:13:38.6363169Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-13T00:13:38.6377787Z ---> Using cache
2021-07-13T00:13:38.6378690Z ---> c0eae58c7549
2021-07-13T00:13:38.6379356Z Step 8/8 : CMD ["sh"]
2021-07-13T00:13:38.6388421Z ---> Using cache
2021-07-13T00:13:38.6389063Z ---> 1e9c1b61b0e5
2021-07-13T00:13:38.7727376Z Successfully built 1e9c1b61b0e5
2021-07-13T00:13:38.7801998Z Successfully tagged lighthouse:devel
2021-07-13T00:13:39.5782513Z [lighthouse]$ trap chown -R 1001:121 . exit
2021-07-13T00:13:39.5785635Z [lighthouse]$ mkdir -p bin dist output
2021-07-13T00:13:39.5837514Z [lighthouse]$ make --debug=b post-mortem
2021-07-13T00:13:39.5945558Z GNU Make 4.3
2021-07-13T00:13:39.5946785Z Built for x86_64-redhat-linux-gnu
2021-07-13T00:13:39.5947617Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-13T00:13:39.5948438Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-13T00:13:39.5949645Z This is free software: you are free to change and redistribute it.
2021-07-13T00:13:39.5950366Z There is NO WARRANTY, to the extent permitted by law.
2021-07-13T00:13:39.5967356Z Reading makefiles...
2021-07-13T00:13:39.6839444Z Makefile:38: warning: overriding recipe for target 'deploy'
2021-07-13T00:13:39.6844877Z /opt/shipyard/Makefile.inc:101: warning: ignoring old recipe for target 'deploy'
2021-07-13T00:13:39.6859573Z Updating makefiles....
2021-07-13T00:13:39.6889480Z Updating goal targets....
2021-07-13T00:13:39.6890760Z File 'post-mortem' does not exist.
2021-07-13T00:13:39.6891486Z Must remake target 'post-mortem'.
2021-07-13T00:13:39.6895853Z /opt/shipyard/scripts/post_mortem.sh
2021-07-13T00:13:39.6978661Z [lighthouse]$ source /opt/shipyard/scripts/lib/utils
2021-07-13T00:13:39.6991869Z [lighthouse]$ . /opt/shipyard/scripts/lib/source_only
2021-07-13T00:13:39.7008877Z [lighthouse]$ script_name=utils
2021-07-13T00:13:39.7020892Z [lighthouse]$ exec_name=post_mortem.sh
2021-07-13T00:13:39.7043792Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:13:39.7052333Z [lighthouse]$ declare_kubeconfig
2021-07-13T00:13:39.7061679Z [lighthouse]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-13T00:13:39.7074679Z [lighthouse]$ export KUBECONFIG
2021-07-13T00:13:39.7089022Z [lighthouse]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-13T00:13:39.7120150Z [lighthouse]$ find /go/src/github.com/submariner-io/lighthouse/output/kubeconfigs -type f -printf %p:
2021-07-13T00:13:39.7154270Z [lighthouse]$ kind get clusters
2021-07-13T00:13:40.3658151Z [lighthouse]$ [cluster1] post_analyze
2021-07-13T00:13:40.3670133Z [lighthouse]$ [cluster1] post_analyze
2021-07-13T00:13:40.3689721Z [lighthouse]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-13T00:13:40.3707051Z [lighthouse]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-13T00:13:40.3711848Z ====================================================================
2021-07-13T00:13:40.3716455Z ##[endgroup]
2021-07-13T00:13:40.3722816Z ##[group]* Kubernetes client and server versions in cluster1 *
2021-07-13T00:13:40.3727058Z ======================= * Kubernetes client and server versions in cluster1 * =======================
2021-07-13T00:13:40.3739605Z [lighthouse]$ [cluster1] kubectl version
2021-07-13T00:13:40.3751605Z [lighthouse]$ [cluster1] kubectl version
2021-07-13T00:13:40.3765627Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 version
2021-07-13T00:13:40.6636757Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-13T00:13:40.6639931Z Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.17", GitCommit:"f3abc15296f3a3f54e4ee42e830c61047b13895f", GitTreeState:"clean", BuildDate:"2021-05-28T00:19:02Z", GoVersion:"go1.13.15", Compiler:"gc", Platform:"linux/amd64"}
2021-07-13T00:13:40.6683508Z [lighthouse]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-13T00:13:40.6696896Z [lighthouse]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-13T00:13:40.6703143Z ====================================================================
2021-07-13T00:13:40.6707379Z ##[endgroup]
2021-07-13T00:13:40.6711555Z ##[group]* Overview of all resources in cluster1 *
2021-07-13T00:13:40.6715922Z ======================= * Overview of all resources in cluster1 * =======================
2021-07-13T00:13:40.6729789Z [lighthouse]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-13T00:13:40.6749173Z [lighthouse]$ [cluster1] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-13T00:13:40.6750657Z [lighthouse]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-13T00:13:40.6761536Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 api-resources --verbs=list -o name
2021-07-13T00:13:41.4826530Z NAME STATUS MESSAGE ERROR
2021-07-13T00:13:41.4827581Z componentstatus/scheduler Unhealthy Get http://127.0.0.1:10251/healthz: dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-13T00:13:41.4829808Z componentstatus/controller-manager Unhealthy Get http://127.0.0.1:10252/healthz: dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-13T00:13:41.4834123Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-13T00:13:42.1703585Z NAME ENDPOINTS AGE
2021-07-13T00:13:42.1704221Z endpoints/kubernetes 172.18.0.6:6443 6m55s
2021-07-13T00:13:42.4992234Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-13T00:13:42.4995267Z 7m24s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m24s 7 event/cluster1-control-plane.169130f70dd5acb4
2021-07-13T00:13:42.4999432Z 7m24s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m24s 7 event/cluster1-control-plane.169130f70dd5c35d
2021-07-13T00:13:42.5003210Z 7m24s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m24s 7 event/cluster1-control-plane.169130f70dd5d16d
2021-07-13T00:13:42.5006394Z 6m52s Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 6m52s 1 event/cluster1-control-plane.169130feb1267f34
2021-07-13T00:13:42.5009866Z 6m51s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 6m51s 1 event/cluster1-control-plane.169130febad52e76
2021-07-13T00:13:42.5013482Z 6m51s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 6m51s 1 event/cluster1-control-plane.169130febad545e6
2021-07-13T00:13:42.5017028Z 6m51s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 6m51s 1 event/cluster1-control-plane.169130febad5545a
2021-07-13T00:13:42.5020358Z 6m51s Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 6m51s 1 event/cluster1-control-plane.169130fed8008483
2021-07-13T00:13:42.5023597Z 6m36s Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 6m36s 1 event/cluster1-control-plane.1691310245ec7a16
2021-07-13T00:13:42.5028290Z 6m34s Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 6m34s 1 event/cluster1-control-plane.16913102afe326c6
2021-07-13T00:13:42.5031396Z 5m41s Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 5m41s 1 event/cluster1-control-plane.1691310f13b0f299
2021-07-13T00:13:42.5034406Z 6m20s Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 6m34s 8 event/cluster1-worker.16913102e44e5816
2021-07-13T00:13:42.5037741Z 6m20s Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 6m34s 8 event/cluster1-worker.16913102e44e7b3e
2021-07-13T00:13:42.5040304Z 6m16s Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 6m16s 1 event/cluster1-worker.16913106e1780153
2021-07-13T00:13:42.5042746Z 6m16s Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 6m16s 1 event/cluster1-worker.16913106ee14ec0c
2021-07-13T00:13:42.5045570Z 6m19s Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 6m32s 8 event/cluster1-worker2.1691310328eddd1d
2021-07-13T00:13:42.5048807Z 6m19s Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 6m32s 8 event/cluster1-worker2.1691310328ee1306
2021-07-13T00:13:42.5051731Z 6m16s Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 6m16s 1 event/cluster1-worker2.16913106ee151b50
2021-07-13T00:13:42.5054218Z 6m15s Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 6m15s 1 event/cluster1-worker2.1691310750164589
2021-07-13T00:13:43.1539152Z NAME STATUS AGE
2021-07-13T00:13:43.1539724Z namespace/default Active 6m56s
2021-07-13T00:13:43.1540970Z namespace/kube-node-lease Active 6m57s
2021-07-13T00:13:43.1541965Z namespace/kube-public Active 6m57s
2021-07-13T00:13:43.1542767Z namespace/kube-system Active 6m57s
2021-07-13T00:13:43.1543590Z namespace/local-path-storage Active 6m49s
2021-07-13T00:13:43.1544488Z namespace/submariner-k8s-broker Active 4m41s
2021-07-13T00:13:43.1545413Z namespace/submariner-operator Active 4m40s
2021-07-13T00:13:43.4889787Z NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
2021-07-13T00:13:43.4891660Z node/cluster1-control-plane Ready master 6m54s v1.17.17 172.18.0.6 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:13:43.4897472Z node/cluster1-worker Ready <none> 6m21s v1.17.17 172.18.0.4 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:13:43.4902514Z node/cluster1-worker2 Ready <none> 6m20s v1.17.17 172.18.0.9 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:13:45.5814603Z NAME TYPE DATA AGE
2021-07-13T00:13:45.5816604Z secret/default-token-g9tc8 kubernetes.io/service-account-token 3 6m40s
2021-07-13T00:13:45.8972781Z NAME SECRETS AGE
2021-07-13T00:13:45.8973390Z serviceaccount/default 1 6m40s
2021-07-13T00:13:46.3035445Z NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
2021-07-13T00:13:46.3036277Z service/kubernetes ClusterIP 100.1.0.1 <none> 443/TCP 6m59s <none>
2021-07-13T00:13:47.7042465Z NAME CREATED AT
2021-07-13T00:13:47.7044367Z customresourcedefinition.apiextensions.k8s.io/brokers.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:13:47.7046736Z customresourcedefinition.apiextensions.k8s.io/clusterglobalegressips.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:13:47.7049076Z customresourcedefinition.apiextensions.k8s.io/clusters.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:13:47.7051175Z customresourcedefinition.apiextensions.k8s.io/endpoints.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:13:47.7053280Z customresourcedefinition.apiextensions.k8s.io/gateways.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:13:47.7055469Z customresourcedefinition.apiextensions.k8s.io/globalegressips.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:13:47.7057778Z customresourcedefinition.apiextensions.k8s.io/globalingressips.submariner.io 2021-07-13T00:09:13Z
2021-07-13T00:13:47.7060379Z customresourcedefinition.apiextensions.k8s.io/servicediscoveries.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:13:47.7063154Z customresourcedefinition.apiextensions.k8s.io/serviceexports.multicluster.x-k8s.io 2021-07-13T00:09:11Z
2021-07-13T00:13:47.7065751Z customresourcedefinition.apiextensions.k8s.io/serviceimports.multicluster.x-k8s.io 2021-07-13T00:09:11Z
2021-07-13T00:13:47.7068080Z customresourcedefinition.apiextensions.k8s.io/submariners.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:13:48.1740014Z NAME SERVICE AVAILABLE AGE
2021-07-13T00:13:48.1740981Z apiservice.apiregistration.k8s.io/v1. Local True 7m3s
2021-07-13T00:13:48.1742381Z apiservice.apiregistration.k8s.io/v1.admissionregistration.k8s.io Local True 7m3s
2021-07-13T00:13:48.1743889Z apiservice.apiregistration.k8s.io/v1.apiextensions.k8s.io Local True 7m3s
2021-07-13T00:13:48.1745209Z apiservice.apiregistration.k8s.io/v1.apps Local True 7m2s
2021-07-13T00:13:48.1746694Z apiservice.apiregistration.k8s.io/v1.authentication.k8s.io Local True 7m2s
2021-07-13T00:13:48.1748127Z apiservice.apiregistration.k8s.io/v1.authorization.k8s.io Local True 7m2s
2021-07-13T00:13:48.1749436Z apiservice.apiregistration.k8s.io/v1.autoscaling Local True 7m2s
2021-07-13T00:13:48.1750648Z apiservice.apiregistration.k8s.io/v1.batch Local True 7m2s
2021-07-13T00:13:48.1752052Z apiservice.apiregistration.k8s.io/v1.coordination.k8s.io Local True 7m2s
2021-07-13T00:13:48.1753404Z apiservice.apiregistration.k8s.io/v1.networking.k8s.io Local True 7m2s
2021-07-13T00:13:48.1754862Z apiservice.apiregistration.k8s.io/v1.rbac.authorization.k8s.io Local True 7m2s
2021-07-13T00:13:48.1756525Z apiservice.apiregistration.k8s.io/v1.scheduling.k8s.io Local True 7m2s
2021-07-13T00:13:48.1758162Z apiservice.apiregistration.k8s.io/v1.storage.k8s.io Local True 7m2s
2021-07-13T00:13:48.1759450Z apiservice.apiregistration.k8s.io/v1.submariner.io Local True 4m36s
2021-07-13T00:13:48.1761548Z apiservice.apiregistration.k8s.io/v1alpha1.multicluster.x-k8s.io Local True 4m37s
2021-07-13T00:13:48.1763050Z apiservice.apiregistration.k8s.io/v1alpha1.submariner.io Local True 4m46s
2021-07-13T00:13:48.1764776Z apiservice.apiregistration.k8s.io/v1beta1.admissionregistration.k8s.io Local True 7m3s
2021-07-13T00:13:48.1766415Z apiservice.apiregistration.k8s.io/v1beta1.apiextensions.k8s.io Local True 7m3s
2021-07-13T00:13:48.1767929Z apiservice.apiregistration.k8s.io/v1beta1.authentication.k8s.io Local True 7m2s
2021-07-13T00:13:48.1769955Z apiservice.apiregistration.k8s.io/v1beta1.authorization.k8s.io Local True 7m2s
2021-07-13T00:13:48.1771372Z apiservice.apiregistration.k8s.io/v1beta1.batch Local True 7m2s
2021-07-13T00:13:48.1772720Z apiservice.apiregistration.k8s.io/v1beta1.certificates.k8s.io Local True 7m2s
2021-07-13T00:13:48.1774198Z apiservice.apiregistration.k8s.io/v1beta1.coordination.k8s.io Local True 7m2s
2021-07-13T00:13:48.1775629Z apiservice.apiregistration.k8s.io/v1beta1.discovery.k8s.io Local True 7m2s
2021-07-13T00:13:48.1777006Z apiservice.apiregistration.k8s.io/v1beta1.events.k8s.io Local True 7m2s
2021-07-13T00:13:48.1778343Z apiservice.apiregistration.k8s.io/v1beta1.extensions Local True 7m2s
2021-07-13T00:13:48.1779897Z apiservice.apiregistration.k8s.io/v1beta1.networking.k8s.io Local True 7m2s
2021-07-13T00:13:48.1781274Z apiservice.apiregistration.k8s.io/v1beta1.node.k8s.io Local True 7m2s
2021-07-13T00:13:48.1782720Z apiservice.apiregistration.k8s.io/v1beta1.policy Local True 7m2s
2021-07-13T00:13:48.1784187Z apiservice.apiregistration.k8s.io/v1beta1.rbac.authorization.k8s.io Local True 7m2s
2021-07-13T00:13:48.1785731Z apiservice.apiregistration.k8s.io/v1beta1.scheduling.k8s.io Local True 7m2s
2021-07-13T00:13:48.1787120Z apiservice.apiregistration.k8s.io/v1beta1.storage.k8s.io Local True 7m2s
2021-07-13T00:13:48.1788460Z apiservice.apiregistration.k8s.io/v2beta1.autoscaling Local True 7m2s
2021-07-13T00:13:48.1789768Z apiservice.apiregistration.k8s.io/v2beta2.autoscaling Local True 7m2s
2021-07-13T00:13:51.0102655Z NAME AGE REQUESTOR CONDITION
2021-07-13T00:13:51.0104693Z certificatesigningrequest.certificates.k8s.io/csr-hgjmv 6m43s system:bootstrap:abcdef Approved,Issued
2021-07-13T00:13:51.0106947Z certificatesigningrequest.certificates.k8s.io/csr-tqqpb 6m42s system:bootstrap:abcdef Approved,Issued
2021-07-13T00:13:51.9344423Z NAME ADDRESSTYPE PORTS ENDPOINTS AGE
2021-07-13T00:13:51.9346198Z endpointslice.discovery.k8s.io/nginx-demo-cluster2 IPv4 8080 10.2.0.5,10.2.128.5 3m7s
2021-07-13T00:13:52.3675804Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-13T00:13:52.3679684Z 7m34s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m34s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5acb4
2021-07-13T00:13:52.3683815Z 7m34s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m34s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5c35d
2021-07-13T00:13:52.3687546Z 7m34s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m34s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5d16d
2021-07-13T00:13:52.3690850Z 7m2s Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 7m2s 1 event.events.k8s.io/cluster1-control-plane.169130feb1267f34
2021-07-13T00:13:52.3695405Z 7m1s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m1s 1 event.events.k8s.io/cluster1-control-plane.169130febad52e76
2021-07-13T00:13:52.3699405Z 7m1s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m1s 1 event.events.k8s.io/cluster1-control-plane.169130febad545e6
2021-07-13T00:13:52.3703537Z 7m1s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m1s 1 event.events.k8s.io/cluster1-control-plane.169130febad5545a
2021-07-13T00:13:52.3707704Z 7m1s Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 7m1s 1 event.events.k8s.io/cluster1-control-plane.169130fed8008483
2021-07-13T00:13:52.3711857Z 6m46s Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 6m46s 1 event.events.k8s.io/cluster1-control-plane.1691310245ec7a16
2021-07-13T00:13:52.3715858Z 6m44s Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 6m44s 1 event.events.k8s.io/cluster1-control-plane.16913102afe326c6
2021-07-13T00:13:52.3719398Z 5m51s Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 5m51s 1 event.events.k8s.io/cluster1-control-plane.1691310f13b0f299
2021-07-13T00:13:52.3722629Z 6m30s Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 6m44s 8 event.events.k8s.io/cluster1-worker.16913102e44e5816
2021-07-13T00:13:52.3725692Z 6m30s Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 6m44s 8 event.events.k8s.io/cluster1-worker.16913102e44e7b3e
2021-07-13T00:13:52.3728619Z 6m26s Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 6m26s 1 event.events.k8s.io/cluster1-worker.16913106e1780153
2021-07-13T00:13:52.3731281Z 6m26s Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 6m26s 1 event.events.k8s.io/cluster1-worker.16913106ee14ec0c
2021-07-13T00:13:52.3734312Z 6m29s Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 6m42s 8 event.events.k8s.io/cluster1-worker2.1691310328eddd1d
2021-07-13T00:13:52.3737474Z 6m29s Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 6m42s 8 event.events.k8s.io/cluster1-worker2.1691310328ee1306
2021-07-13T00:13:52.3740509Z 6m26s Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 6m26s 1 event.events.k8s.io/cluster1-worker2.16913106ee151b50
2021-07-13T00:13:52.3743210Z 6m25s Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 6m25s 1 event.events.k8s.io/cluster1-worker2.1691310750164589
2021-07-13T00:13:55.7002101Z NAME AGE
2021-07-13T00:13:55.7004623Z clusterrolebinding.rbac.authorization.k8s.io/cluster-admin 7m9s
2021-07-13T00:13:55.7007741Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:kubelet-bootstrap 7m5s
2021-07-13T00:13:55.7011256Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-bootstrap 7m5s
2021-07-13T00:13:55.7015418Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-certificate-rotation 7m5s
2021-07-13T00:13:55.7018934Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-proxier 7m5s
2021-07-13T00:13:55.7021687Z clusterrolebinding.rbac.authorization.k8s.io/local-path-provisioner-bind 7m1s
2021-07-13T00:13:55.7024880Z clusterrolebinding.rbac.authorization.k8s.io/submariner-gateway 4m48s
2021-07-13T00:13:55.7027803Z clusterrolebinding.rbac.authorization.k8s.io/submariner-globalnet 4m47s
2021-07-13T00:13:55.7030930Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-agent 4m46s
2021-07-13T00:13:55.7033204Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-coredns 4m46s
2021-07-13T00:13:55.7035445Z clusterrolebinding.rbac.authorization.k8s.io/submariner-networkplugin-syncer 4m46s
2021-07-13T00:13:55.7037678Z clusterrolebinding.rbac.authorization.k8s.io/submariner-operator 4m48s
2021-07-13T00:13:55.7039694Z clusterrolebinding.rbac.authorization.k8s.io/submariner-routeagent 4m47s
2021-07-13T00:13:55.7041884Z clusterrolebinding.rbac.authorization.k8s.io/system:basic-user 7m9s
2021-07-13T00:13:55.7043872Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller 7m8s
2021-07-13T00:13:55.7046353Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller 7m8s
2021-07-13T00:13:55.7048810Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 7m8s
2021-07-13T00:13:55.7051098Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller 7m8s
2021-07-13T00:13:55.7053172Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller 7m8s
2021-07-13T00:13:55.7055423Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller 7m8s
2021-07-13T00:13:55.7057547Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller 7m8s
2021-07-13T00:13:55.7059770Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller 7m8s
2021-07-13T00:13:55.7061818Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller 7m8s
2021-07-13T00:13:55.7063940Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 7m8s
2021-07-13T00:13:55.7066130Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 7m8s
2021-07-13T00:13:55.7068218Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller 7m8s
2021-07-13T00:13:55.7070231Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller 7m8s
2021-07-13T00:13:55.7072268Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller 7m8s
2021-07-13T00:13:55.7074355Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 7m8s
2021-07-13T00:13:55.7080598Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 7m8s
2021-07-13T00:13:55.7083018Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pv-protection-controller 7m8s
2021-07-13T00:13:55.7101573Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 7m8s
2021-07-13T00:13:55.7104353Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replicaset-controller 7m8s
2021-07-13T00:13:55.7106830Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replication-controller 7m8s
2021-07-13T00:13:55.7109028Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:resourcequota-controller 7m8s
2021-07-13T00:13:55.7111128Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:route-controller 7m8s
2021-07-13T00:13:55.7113238Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-account-controller 7m8s
2021-07-13T00:13:55.7115382Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-controller 7m8s
2021-07-13T00:13:55.7117643Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:statefulset-controller 7m8s
2021-07-13T00:13:55.7120405Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:ttl-controller 7m8s
2021-07-13T00:13:55.7122111Z clusterrolebinding.rbac.authorization.k8s.io/system:coredns 7m5s
2021-07-13T00:13:55.7123696Z clusterrolebinding.rbac.authorization.k8s.io/system:discovery 7m9s
2021-07-13T00:13:55.7129647Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-controller-manager 7m9s
2021-07-13T00:13:55.7131738Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-dns 7m9s
2021-07-13T00:13:55.7133629Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-scheduler 7m9s
2021-07-13T00:13:55.7135255Z clusterrolebinding.rbac.authorization.k8s.io/system:node 7m8s
2021-07-13T00:13:55.7137432Z clusterrolebinding.rbac.authorization.k8s.io/system:node-proxier 7m9s
2021-07-13T00:13:55.7139398Z clusterrolebinding.rbac.authorization.k8s.io/system:public-info-viewer 7m9s
2021-07-13T00:13:55.7141459Z clusterrolebinding.rbac.authorization.k8s.io/system:volume-scheduler 7m9s
2021-07-13T00:13:55.7159695Z clusterrolebinding.rbac.authorization.k8s.io/weave-net 6m19s
2021-07-13T00:13:56.2392080Z NAME AGE
2021-07-13T00:13:56.2393017Z clusterrole.rbac.authorization.k8s.io/admin 7m10s
2021-07-13T00:13:56.2395024Z clusterrole.rbac.authorization.k8s.io/cluster-admin 7m10s
2021-07-13T00:13:56.2396576Z clusterrole.rbac.authorization.k8s.io/edit 7m10s
2021-07-13T00:13:56.2398477Z clusterrole.rbac.authorization.k8s.io/local-path-provisioner-role 7m2s
2021-07-13T00:13:56.2400264Z clusterrole.rbac.authorization.k8s.io/submariner-gateway 4m51s
2021-07-13T00:13:56.2402637Z clusterrole.rbac.authorization.k8s.io/submariner-globalnet 4m50s
2021-07-13T00:13:56.2404718Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-agent 4m47s
2021-07-13T00:13:56.2406777Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-coredns 4m47s
2021-07-13T00:13:56.2408759Z clusterrole.rbac.authorization.k8s.io/submariner-networkplugin-syncer 4m49s
2021-07-13T00:13:56.2410613Z clusterrole.rbac.authorization.k8s.io/submariner-operator 4m51s
2021-07-13T00:13:56.2412303Z clusterrole.rbac.authorization.k8s.io/submariner-routeagent 4m50s
2021-07-13T00:13:56.2414471Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-admin 7m10s
2021-07-13T00:13:56.2416247Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-edit 7m10s
2021-07-13T00:13:56.2417926Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-view 7m10s
2021-07-13T00:13:56.2419608Z clusterrole.rbac.authorization.k8s.io/system:auth-delegator 7m10s
2021-07-13T00:13:56.2421181Z clusterrole.rbac.authorization.k8s.io/system:basic-user 7m10s
2021-07-13T00:13:56.2422845Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:nodeclient 7m10s
2021-07-13T00:13:56.2424871Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 7m10s
2021-07-13T00:13:56.2427056Z clusterrole.rbac.authorization.k8s.io/system:controller:attachdetach-controller 7m10s
2021-07-13T00:13:56.2428943Z clusterrole.rbac.authorization.k8s.io/system:controller:certificate-controller 7m10s
2021-07-13T00:13:56.2430965Z clusterrole.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 7m10s
2021-07-13T00:13:56.2432960Z clusterrole.rbac.authorization.k8s.io/system:controller:cronjob-controller 7m10s
2021-07-13T00:13:56.2434796Z clusterrole.rbac.authorization.k8s.io/system:controller:daemon-set-controller 7m10s
2021-07-13T00:13:56.2436655Z clusterrole.rbac.authorization.k8s.io/system:controller:deployment-controller 7m10s
2021-07-13T00:13:56.2439008Z clusterrole.rbac.authorization.k8s.io/system:controller:disruption-controller 7m10s
2021-07-13T00:13:56.2440838Z clusterrole.rbac.authorization.k8s.io/system:controller:endpoint-controller 7m10s
2021-07-13T00:13:56.2442623Z clusterrole.rbac.authorization.k8s.io/system:controller:expand-controller 7m10s
2021-07-13T00:13:56.2444484Z clusterrole.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 7m10s
2021-07-13T00:13:56.2446410Z clusterrole.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 7m10s
2021-07-13T00:13:56.2448434Z clusterrole.rbac.authorization.k8s.io/system:controller:job-controller 7m10s
2021-07-13T00:13:56.2450180Z clusterrole.rbac.authorization.k8s.io/system:controller:namespace-controller 7m10s
2021-07-13T00:13:56.2451962Z clusterrole.rbac.authorization.k8s.io/system:controller:node-controller 7m10s
2021-07-13T00:13:56.2453842Z clusterrole.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 7m10s
2021-07-13T00:13:56.2455708Z clusterrole.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 7m10s
2021-07-13T00:13:56.2457579Z clusterrole.rbac.authorization.k8s.io/system:controller:pv-protection-controller 7m10s
2021-07-13T00:13:56.2459480Z clusterrole.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 7m10s
2021-07-13T00:13:56.2461533Z clusterrole.rbac.authorization.k8s.io/system:controller:replicaset-controller 7m10s
2021-07-13T00:13:56.2463393Z clusterrole.rbac.authorization.k8s.io/system:controller:replication-controller 7m10s
2021-07-13T00:13:56.2465442Z clusterrole.rbac.authorization.k8s.io/system:controller:resourcequota-controller 7m10s
2021-07-13T00:13:56.2467399Z clusterrole.rbac.authorization.k8s.io/system:controller:route-controller 7m10s
2021-07-13T00:13:56.2469333Z clusterrole.rbac.authorization.k8s.io/system:controller:service-account-controller 7m10s
2021-07-13T00:13:56.2471224Z clusterrole.rbac.authorization.k8s.io/system:controller:service-controller 7m10s
2021-07-13T00:13:56.2473047Z clusterrole.rbac.authorization.k8s.io/system:controller:statefulset-controller 7m10s
2021-07-13T00:13:56.2474813Z clusterrole.rbac.authorization.k8s.io/system:controller:ttl-controller 7m10s
2021-07-13T00:13:56.2476207Z clusterrole.rbac.authorization.k8s.io/system:coredns 7m6s
2021-07-13T00:13:56.2477684Z clusterrole.rbac.authorization.k8s.io/system:discovery 7m10s
2021-07-13T00:13:56.2479009Z clusterrole.rbac.authorization.k8s.io/system:heapster 7m10s
2021-07-13T00:13:56.2480635Z clusterrole.rbac.authorization.k8s.io/system:kube-aggregator 7m10s
2021-07-13T00:13:56.2482340Z clusterrole.rbac.authorization.k8s.io/system:kube-controller-manager 7m10s
2021-07-13T00:13:56.2485908Z clusterrole.rbac.authorization.k8s.io/system:kube-dns 7m10s
2021-07-13T00:13:56.2487810Z clusterrole.rbac.authorization.k8s.io/system:kube-scheduler 7m10s
2021-07-13T00:13:56.2489480Z clusterrole.rbac.authorization.k8s.io/system:kubelet-api-admin 7m10s
2021-07-13T00:13:56.2492505Z clusterrole.rbac.authorization.k8s.io/system:node 7m10s
2021-07-13T00:13:56.2494207Z clusterrole.rbac.authorization.k8s.io/system:node-bootstrapper 7m10s
2021-07-13T00:13:56.2495939Z clusterrole.rbac.authorization.k8s.io/system:node-problem-detector 7m10s
2021-07-13T00:13:56.2497607Z clusterrole.rbac.authorization.k8s.io/system:node-proxier 7m10s
2021-07-13T00:13:56.2499400Z clusterrole.rbac.authorization.k8s.io/system:persistent-volume-provisioner 7m10s
2021-07-13T00:13:56.2501238Z clusterrole.rbac.authorization.k8s.io/system:public-info-viewer 7m10s
2021-07-13T00:13:56.2504416Z clusterrole.rbac.authorization.k8s.io/system:volume-scheduler 7m10s
2021-07-13T00:13:56.2505798Z clusterrole.rbac.authorization.k8s.io/view 7m10s
2021-07-13T00:13:56.2507370Z clusterrole.rbac.authorization.k8s.io/weave-net 6m20s
2021-07-13T00:13:57.6569868Z NAME VALUE GLOBAL-DEFAULT AGE
2021-07-13T00:13:57.6571207Z priorityclass.scheduling.k8s.io/system-cluster-critical 2000000000 false 7m11s
2021-07-13T00:13:57.6572738Z priorityclass.scheduling.k8s.io/system-node-critical 2000001000 false 7m11s
2021-07-13T00:13:58.5811963Z NAME CREATED AT
2021-07-13T00:13:58.5813424Z csinode.storage.k8s.io/cluster1-control-plane 2021-07-13T00:06:49Z
2021-07-13T00:13:58.5814571Z csinode.storage.k8s.io/cluster1-worker 2021-07-13T00:07:23Z
2021-07-13T00:13:58.5815623Z csinode.storage.k8s.io/cluster1-worker2 2021-07-13T00:07:25Z
2021-07-13T00:13:59.0127007Z NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
2021-07-13T00:13:59.0129697Z storageclass.storage.k8s.io/standard (default) rancher.io/local-path Delete WaitForFirstConsumer false 7m5s
2021-07-13T00:14:03.4488013Z [lighthouse]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-13T00:14:03.4521534Z [lighthouse]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-13T00:14:03.4522336Z ====================================================================
2021-07-13T00:14:03.4523673Z ##[endgroup]
2021-07-13T00:14:03.4525043Z ##[group]* Details of pods with statuses other than Running in cluster1 *
2021-07-13T00:14:03.4526542Z ======================= * Details of pods with statuses other than Running in cluster1 * =======================
2021-07-13T00:14:03.4546642Z [lighthouse]$ [cluster1] kubectl get pods -A
2021-07-13T00:14:03.4588656Z [lighthouse]$ [cluster1] tail -n +2
2021-07-13T00:14:03.4605856Z [lighthouse]$ [cluster1] kubectl get pods -A
2021-07-13T00:14:03.4617808Z [lighthouse]$ [cluster1] grep -v Running
2021-07-13T00:14:03.4643713Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -A
2021-07-13T00:14:03.4663080Z [lighthouse]$ [cluster1] sed s/ */;/g
2021-07-13T00:14:03.8562624Z [lighthouse]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-13T00:14:03.8571625Z [lighthouse]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-13T00:14:03.8572329Z ====================================================================
2021-07-13T00:14:03.8573787Z ##[endgroup]
2021-07-13T00:14:03.8581906Z ##[group]* Kube-proxy pod logs for cluster1 *
2021-07-13T00:14:03.8583036Z [lighthouse]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-13T00:14:03.8584349Z ======================= * Kube-proxy pod logs for cluster1 * =======================
2021-07-13T00:14:03.8600466Z [lighthouse]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-13T00:14:03.8610660Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:03.8624523Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:03.8629214Z ====================================================================
2021-07-13T00:14:03.8633764Z ##[endgroup]
2021-07-13T00:14:03.8639213Z ##[group]** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:03.8642340Z ======================= ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' ** =======================
2021-07-13T00:14:03.8665177Z [lighthouse]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:03.8678243Z [lighthouse]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:03.8695079Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:04.1821968Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-ll888 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:04.1830027Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-ll888 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:04.1859586Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-ll888 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:04.4901622Z [lighthouse]$ [cluster1] print_section *** kube-proxy-ll888 ***
2021-07-13T00:14:04.4916721Z [lighthouse]$ [cluster1] print_section *** kube-proxy-ll888 ***
2021-07-13T00:14:04.4923388Z ====================================================================
2021-07-13T00:14:04.4927237Z ##[endgroup]
2021-07-13T00:14:04.4933982Z ##[group]*** kube-proxy-ll888 ***
2021-07-13T00:14:04.4940240Z ======================= *** kube-proxy-ll888 *** =======================
2021-07-13T00:14:04.4955351Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-ll888
2021-07-13T00:14:04.4967026Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-ll888
2021-07-13T00:14:04.4985028Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-ll888
2021-07-13T00:14:04.8492195Z I0713 00:07:27.933530 1 node.go:135] Successfully retrieved node IP: 172.18.0.9
2021-07-13T00:14:04.8493022Z I0713 00:07:27.933606 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:04.8493695Z I0713 00:07:27.934865 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:04.8495184Z I0713 00:07:27.935337 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:04.8496436Z I0713 00:07:27.935443 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:04.8497287Z I0713 00:07:27.937111 1 config.go:313] Starting service config controller
2021-07-13T00:14:04.8498048Z I0713 00:07:27.937125 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:04.8498844Z I0713 00:07:27.937720 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:04.8499648Z I0713 00:07:27.937735 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:04.8500482Z I0713 00:07:28.037849 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:04.8501287Z I0713 00:07:28.037941 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:04.8593572Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-vvsrv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:04.8609091Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-vvsrv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:04.8622736Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-vvsrv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:05.1624041Z [lighthouse]$ [cluster1] print_section *** kube-proxy-vvsrv ***
2021-07-13T00:14:05.1638314Z [lighthouse]$ [cluster1] print_section *** kube-proxy-vvsrv ***
2021-07-13T00:14:05.1639011Z ====================================================================
2021-07-13T00:14:05.1640734Z ##[endgroup]
2021-07-13T00:14:05.1649779Z ##[group]*** kube-proxy-vvsrv ***
2021-07-13T00:14:05.1650945Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-vvsrv
2021-07-13T00:14:05.1651937Z ======================= *** kube-proxy-vvsrv *** =======================
2021-07-13T00:14:05.1663354Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-vvsrv
2021-07-13T00:14:05.1679301Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-vvsrv
2021-07-13T00:14:05.5241557Z I0713 00:07:26.077402 1 node.go:135] Successfully retrieved node IP: 172.18.0.4
2021-07-13T00:14:05.5242420Z I0713 00:07:26.077477 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:05.5243057Z I0713 00:07:26.077979 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:05.5244695Z I0713 00:07:26.079538 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:05.5245922Z I0713 00:07:26.079621 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:05.5246928Z I0713 00:07:26.083223 1 config.go:313] Starting service config controller
2021-07-13T00:14:05.5247717Z I0713 00:07:26.083233 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:05.5248753Z I0713 00:07:26.083256 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:05.5249584Z I0713 00:07:26.083264 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:05.5250510Z I0713 00:07:26.190934 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:05.5251319Z I0713 00:07:26.191036 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:05.5298230Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-xxbqn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:05.5307775Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-proxy-xxbqn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:05.5320864Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-xxbqn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:05.8731680Z [lighthouse]$ [cluster1] print_section *** kube-proxy-xxbqn ***
2021-07-13T00:14:05.8747768Z [lighthouse]$ [cluster1] print_section *** kube-proxy-xxbqn ***
2021-07-13T00:14:05.8754054Z ====================================================================
2021-07-13T00:14:05.8780546Z ##[endgroup]
2021-07-13T00:14:05.8781858Z ##[group]*** kube-proxy-xxbqn ***
2021-07-13T00:14:05.8783710Z ======================= *** kube-proxy-xxbqn *** =======================
2021-07-13T00:14:05.8802348Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-xxbqn
2021-07-13T00:14:05.8812895Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-proxy-xxbqn
2021-07-13T00:14:05.8828434Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-xxbqn
2021-07-13T00:14:06.3041629Z I0713 00:07:08.066397 1 node.go:135] Successfully retrieved node IP: 172.18.0.6
2021-07-13T00:14:06.3042692Z I0713 00:07:08.066641 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:06.3043366Z I0713 00:07:08.067021 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:06.3044853Z I0713 00:07:08.067516 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:06.3046092Z I0713 00:07:08.067740 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:06.3046932Z I0713 00:07:08.068650 1 config.go:313] Starting service config controller
2021-07-13T00:14:06.3047715Z I0713 00:07:08.069615 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:06.3048700Z I0713 00:07:08.069775 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:06.3049514Z I0713 00:07:08.076590 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:06.3050408Z I0713 00:07:08.173374 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:06.3051206Z I0713 00:07:08.176815 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:06.3099523Z [lighthouse]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-13T00:14:06.3119255Z [lighthouse]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-13T00:14:06.3120085Z ====================================================================
2021-07-13T00:14:06.3120926Z ##[endgroup]
2021-07-13T00:14:06.3122122Z ##[group]* Kube-controller-manager pod logs for cluster1 *
2021-07-13T00:14:06.3123227Z ======================= * Kube-controller-manager pod logs for cluster1 * =======================
2021-07-13T00:14:06.3128812Z [lighthouse]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-13T00:14:06.3138884Z [lighthouse]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-13T00:14:06.3152238Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:06.3165279Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:06.3170687Z ====================================================================
2021-07-13T00:14:06.3175292Z ##[endgroup]
2021-07-13T00:14:06.3180738Z ##[group]** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:06.3185065Z ======================= ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' ** =======================
2021-07-13T00:14:06.3208369Z [lighthouse]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:06.3219489Z [lighthouse]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:06.3235902Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:06.6710509Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:07.3522952Z [lighthouse]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:07.3524605Z ====================================================================
2021-07-13T00:14:07.3526722Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:07.3529662Z [lighthouse]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-13T00:14:07.3531673Z [lighthouse]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-13T00:14:07.3535429Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-13T00:14:07.3537737Z [lighthouse]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-13T00:14:07.3540089Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-13T00:14:07.3542845Z ##[endgroup]
2021-07-13T00:14:07.3545277Z ##[group]*** kube-controller-manager-cluster1-control-plane ***
2021-07-13T00:14:07.3547195Z ======================= *** kube-controller-manager-cluster1-control-plane *** =======================
2021-07-13T00:14:07.4138171Z Flag --port has been deprecated, see --secure-port instead.
2021-07-13T00:14:07.4140757Z I0713 00:06:31.681433 1 serving.go:312] Generated self-signed cert in-memory
2021-07-13T00:14:07.4156495Z I0713 00:06:32.132552 1 controllermanager.go:161] Version: v1.17.17
2021-07-13T00:14:07.4172750Z I0713 00:06:32.133191 1 dynamic_cafile_content.go:166] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
2021-07-13T00:14:07.4178595Z I0713 00:06:32.133277 1 dynamic_cafile_content.go:166] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
2021-07-13T00:14:07.4179643Z I0713 00:06:32.133988 1 secure_serving.go:178] Serving securely on 127.0.0.1:10257
2021-07-13T00:14:07.4181220Z I0713 00:06:32.134065 1 tlsconfig.go:219] Starting DynamicServingCertificateController
2021-07-13T00:14:07.4184140Z I0713 00:06:32.134142 1 leaderelection.go:242] attempting to acquire leader lease kube-system/kube-controller-manager...
2021-07-13T00:14:07.4189366Z E0713 00:06:42.135054 1 leaderelection.go:335] error retrieving resource lock kube-system/kube-controller-manager: Get https://cluster1-control-plane:6443/api/v1/namespaces/kube-system/endpoints/kube-controller-manager?timeout=10s: net/http: request canceled while waiting for connection (Client.Timeout exceeded while awaiting headers)
2021-07-13T00:14:07.4193987Z E0713 00:06:45.847221 1 leaderelection.go:335] error retrieving resource lock kube-system/kube-controller-manager: endpoints "kube-controller-manager" is forbidden: User "system:kube-controller-manager" cannot get resource "endpoints" in API group "" in the namespace "kube-system"
2021-07-13T00:14:07.4198836Z I0713 00:06:49.306823 1 leaderelection.go:252] successfully acquired lease kube-system/kube-controller-manager
2021-07-13T00:14:07.4203076Z I0713 00:06:49.307603 1 event.go:281] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"kube-controller-manager", UID:"ff776171-ea92-425b-9860-34569c4ea872", APIVersion:"v1", ResourceVersion:"165", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster1-control-plane_e54fce38-ac2f-43a9-88d3-a7bcbbfe4c08 became leader
2021-07-13T00:14:07.4207388Z I0713 00:06:49.307641 1 event.go:281] Event(v1.ObjectReference{Kind:"Lease", Namespace:"kube-system", Name:"kube-controller-manager", UID:"90bd6b87-5d11-4304-b442-c9d1a2d782d0", APIVersion:"coordination.k8s.io/v1", ResourceVersion:"166", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster1-control-plane_e54fce38-ac2f-43a9-88d3-a7bcbbfe4c08 became leader
2021-07-13T00:14:07.4209575Z I0713 00:06:49.578870 1 plugins.go:100] No cloud provider specified.
2021-07-13T00:14:07.4210371Z I0713 00:06:49.580311 1 shared_informer.go:197] Waiting for caches to sync for tokens
2021-07-13T00:14:07.4211133Z I0713 00:06:49.680829 1 shared_informer.go:204] Caches are synced for tokens
2021-07-13T00:14:07.4212152Z I0713 00:06:49.694538 1 controllermanager.go:533] Started "bootstrapsigner"
2021-07-13T00:14:07.4213438Z W0713 00:06:49.694754 1 controllermanager.go:525] Skipping "root-ca-cert-publisher"
2021-07-13T00:14:07.4214442Z W0713 00:06:49.694852 1 controllermanager.go:525] Skipping "endpointslice"
2021-07-13T00:14:07.4215316Z I0713 00:06:49.695044 1 shared_informer.go:197] Waiting for caches to sync for bootstrap_signer
2021-07-13T00:14:07.4216175Z I0713 00:06:49.719570 1 controllermanager.go:533] Started "csrapproving"
2021-07-13T00:14:07.4217143Z I0713 00:06:49.719943 1 certificate_controller.go:118] Starting certificate controller "csrapproving"
2021-07-13T00:14:07.4218612Z I0713 00:06:49.720546 1 shared_informer.go:197] Waiting for caches to sync for certificate-csrapproving
2021-07-13T00:14:07.4219596Z I0713 00:06:49.758268 1 controllermanager.go:533] Started "tokencleaner"
2021-07-13T00:14:07.4323073Z I0713 00:06:49.758611 1 tokencleaner.go:117] Starting token cleaner controller
2021-07-13T00:14:07.4323957Z I0713 00:06:49.758715 1 shared_informer.go:197] Waiting for caches to sync for token_cleaner
2021-07-13T00:14:07.4324772Z I0713 00:06:49.758815 1 shared_informer.go:204] Caches are synced for token_cleaner
2021-07-13T00:14:07.4325554Z I0713 00:06:49.792358 1 node_ipam_controller.go:94] Sending events to api server.
2021-07-13T00:14:07.4326334Z I0713 00:06:59.812116 1 range_allocator.go:82] Sending events to api server.
2021-07-13T00:14:07.4327327Z I0713 00:06:59.812419 1 range_allocator.go:116] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses.
2021-07-13T00:14:07.4328356Z I0713 00:06:59.812594 1 controllermanager.go:533] Started "nodeipam"
2021-07-13T00:14:07.4329150Z I0713 00:06:59.812792 1 node_ipam_controller.go:162] Starting ipam controller
2021-07-13T00:14:07.4329893Z I0713 00:06:59.812834 1 shared_informer.go:197] Waiting for caches to sync for node
2021-07-13T00:14:07.4330796Z I0713 00:06:59.853810 1 controllermanager.go:533] Started "replicationcontroller"
2021-07-13T00:14:07.4331941Z I0713 00:06:59.854099 1 replica_set.go:181] Starting replicationcontroller controller
2021-07-13T00:14:07.4333145Z I0713 00:06:59.854137 1 shared_informer.go:197] Waiting for caches to sync for ReplicationController
2021-07-13T00:14:07.4334103Z I0713 00:06:59.908766 1 controllermanager.go:533] Started "deployment"
2021-07-13T00:14:07.4334959Z I0713 00:06:59.909021 1 deployment_controller.go:152] Starting deployment controller
2021-07-13T00:14:07.4335815Z I0713 00:06:59.909081 1 shared_informer.go:197] Waiting for caches to sync for deployment
2021-07-13T00:14:07.4336599Z I0713 00:06:59.961322 1 controllermanager.go:533] Started "cronjob"
2021-07-13T00:14:07.4337511Z I0713 00:06:59.964058 1 cronjob_controller.go:97] Starting CronJob Manager
2021-07-13T00:14:07.4339538Z I0713 00:06:59.989365 1 node_lifecycle_controller.go:388] Sending events to api server.
2021-07-13T00:14:07.4349194Z I0713 00:06:59.989473 1 node_lifecycle_controller.go:423] Controller is using taint based evictions.
2021-07-13T00:14:07.4350048Z I0713 00:06:59.989521 1 taint_manager.go:162] Sending events to api server.
2021-07-13T00:14:07.4350857Z I0713 00:06:59.989586 1 node_lifecycle_controller.go:520] Controller will reconcile labels.
2021-07-13T00:14:07.4351752Z I0713 00:06:59.989615 1 controllermanager.go:533] Started "nodelifecycle"
2021-07-13T00:14:07.4352600Z I0713 00:06:59.989705 1 node_lifecycle_controller.go:554] Starting node controller
2021-07-13T00:14:07.4354440Z I0713 00:06:59.989715 1 shared_informer.go:197] Waiting for caches to sync for taint
2021-07-13T00:14:07.4394452Z I0713 00:07:00.082291 1 controllermanager.go:533] Started "podgc"
2021-07-13T00:14:07.4396275Z W0713 00:07:00.082789 1 core.go:246] configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes.
2021-07-13T00:14:07.4397887Z W0713 00:07:00.082829 1 controllermanager.go:525] Skipping "route"
2021-07-13T00:14:07.4398625Z I0713 00:07:00.082765 1 gc_controller.go:88] Starting GC controller
2021-07-13T00:14:07.4399357Z I0713 00:07:00.083045 1 shared_informer.go:197] Waiting for caches to sync for GC
2021-07-13T00:14:07.4400483Z I0713 00:07:00.134370 1 controllermanager.go:533] Started "pvc-protection"
2021-07-13T00:14:07.4401400Z I0713 00:07:00.134683 1 pvc_protection_controller.go:100] Starting PVC protection controller
2021-07-13T00:14:07.4402294Z I0713 00:07:00.134755 1 shared_informer.go:197] Waiting for caches to sync for PVC protection
2021-07-13T00:14:07.4403355Z I0713 00:07:00.179970 1 controllermanager.go:533] Started "pv-protection"
2021-07-13T00:14:07.4404493Z W0713 00:07:00.182025 1 controllermanager.go:525] Skipping "ttl-after-finished"
2021-07-13T00:14:07.4405440Z I0713 00:07:00.182456 1 pv_protection_controller.go:81] Starting PV protection controller
2021-07-13T00:14:07.4406463Z I0713 00:07:00.182673 1 shared_informer.go:197] Waiting for caches to sync for PV protection
2021-07-13T00:14:07.4442850Z I0713 00:07:00.276758 1 controllermanager.go:533] Started "namespace"
2021-07-13T00:14:07.4443729Z I0713 00:07:00.277073 1 namespace_controller.go:200] Starting namespace controller
2021-07-13T00:14:07.4444573Z I0713 00:07:00.277332 1 shared_informer.go:197] Waiting for caches to sync for namespace
2021-07-13T00:14:07.4445378Z I0713 00:07:00.615583 1 controllermanager.go:533] Started "disruption"
2021-07-13T00:14:07.4446181Z I0713 00:07:00.615953 1 disruption.go:330] Starting disruption controller
2021-07-13T00:14:07.4446976Z I0713 00:07:00.616093 1 shared_informer.go:197] Waiting for caches to sync for disruption
2021-07-13T00:14:07.4447775Z I0713 00:07:00.765516 1 controllermanager.go:533] Started "csrsigning"
2021-07-13T00:14:07.4448698Z I0713 00:07:00.766019 1 certificate_controller.go:118] Starting certificate controller "csrsigning"
2021-07-13T00:14:07.4450136Z I0713 00:07:00.766225 1 shared_informer.go:197] Waiting for caches to sync for certificate-csrsigning
2021-07-13T00:14:07.4451214Z I0713 00:07:01.016560 1 controllermanager.go:533] Started "ttl"
2021-07-13T00:14:07.4451960Z I0713 00:07:01.016855 1 ttl_controller.go:116] Starting TTL controller
2021-07-13T00:14:07.4452697Z I0713 00:07:01.016997 1 shared_informer.go:197] Waiting for caches to sync for TTL
2021-07-13T00:14:07.4453499Z I0713 00:07:01.166609 1 node_lifecycle_controller.go:77] Sending events to api server
2021-07-13T00:14:07.4454400Z E0713 00:07:01.166941 1 core.go:232] failed to start cloud node lifecycle controller: no cloud provider provided
2021-07-13T00:14:07.4455684Z W0713 00:07:01.167053 1 controllermanager.go:525] Skipping "cloud-node-lifecycle"
2021-07-13T00:14:07.4456959Z I0713 00:07:01.417444 1 controllermanager.go:533] Started "persistentvolume-binder"
2021-07-13T00:14:07.4457961Z I0713 00:07:01.417518 1 pv_controller_base.go:294] Starting persistent volume controller
2021-07-13T00:14:07.4458838Z I0713 00:07:01.417537 1 shared_informer.go:197] Waiting for caches to sync for persistent volume
2021-07-13T00:14:07.4459689Z I0713 00:07:01.672737 1 controllermanager.go:533] Started "attachdetach"
2021-07-13T00:14:07.4460560Z I0713 00:07:01.672895 1 attach_detach_controller.go:352] Starting attach detach controller
2021-07-13T00:14:07.4461392Z I0713 00:07:01.672911 1 shared_informer.go:197] Waiting for caches to sync for attach detach
2021-07-13T00:14:07.4462612Z I0713 00:07:01.915302 1 controllermanager.go:533] Started "persistentvolume-expander"
2021-07-13T00:14:07.4463589Z I0713 00:07:01.915970 1 expand_controller.go:303] Starting expand controller
2021-07-13T00:14:07.4464374Z I0713 00:07:01.915987 1 shared_informer.go:197] Waiting for caches to sync for expand
2021-07-13T00:14:07.4465164Z I0713 00:07:02.487516 1 controllermanager.go:533] Started "endpoint"
2021-07-13T00:14:07.4466105Z I0713 00:07:02.487974 1 endpoints_controller.go:181] Starting endpoint controller
2021-07-13T00:14:07.4466934Z I0713 00:07:02.487991 1 shared_informer.go:197] Waiting for caches to sync for endpoint
2021-07-13T00:14:07.4467739Z I0713 00:07:02.599958 1 controllermanager.go:533] Started "statefulset"
2021-07-13T00:14:07.4468539Z I0713 00:07:02.600246 1 stateful_set.go:145] Starting stateful set controller
2021-07-13T00:14:07.4469300Z I0713 00:07:02.600262 1 shared_informer.go:197] Waiting for caches to sync for stateful set
2021-07-13T00:14:07.4470515Z I0713 00:07:02.669273 1 controllermanager.go:533] Started "clusterrole-aggregation"
2021-07-13T00:14:07.4471757Z I0713 00:07:02.669356 1 clusterroleaggregation_controller.go:148] Starting ClusterRoleAggregator
2021-07-13T00:14:07.4472885Z I0713 00:07:02.669492 1 shared_informer.go:197] Waiting for caches to sync for ClusterRoleAggregator
2021-07-13T00:14:07.4473782Z I0713 00:07:02.915062 1 controllermanager.go:533] Started "job"
2021-07-13T00:14:07.4474502Z I0713 00:07:02.915116 1 job_controller.go:144] Starting job controller
2021-07-13T00:14:07.4475239Z I0713 00:07:02.915124 1 shared_informer.go:197] Waiting for caches to sync for job
2021-07-13T00:14:07.4476085Z I0713 00:07:03.828285 1 garbagecollector.go:129] Starting garbage collector controller
2021-07-13T00:14:07.4494253Z I0713 00:07:03.828376 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:07.4495252Z I0713 00:07:03.828330 1 controllermanager.go:533] Started "garbagecollector"
2021-07-13T00:14:07.4496066Z I0713 00:07:03.828623 1 graph_builder.go:282] GraphBuilder running
2021-07-13T00:14:07.4496865Z I0713 00:07:03.871199 1 controllermanager.go:533] Started "serviceaccount"
2021-07-13T00:14:07.4497799Z I0713 00:07:03.871389 1 serviceaccounts_controller.go:116] Starting service account controller
2021-07-13T00:14:07.4498724Z I0713 00:07:03.871407 1 shared_informer.go:197] Waiting for caches to sync for service account
2021-07-13T00:14:07.4499548Z I0713 00:07:03.886341 1 controllermanager.go:533] Started "daemonset"
2021-07-13T00:14:07.4500510Z I0713 00:07:03.886525 1 daemon_controller.go:284] Starting daemon sets controller
2021-07-13T00:14:07.4501333Z I0713 00:07:03.886539 1 shared_informer.go:197] Waiting for caches to sync for daemon sets
2021-07-13T00:14:07.4502138Z I0713 00:07:04.065044 1 controllermanager.go:533] Started "replicaset"
2021-07-13T00:14:07.4502933Z I0713 00:07:04.065137 1 replica_set.go:181] Starting replicaset controller
2021-07-13T00:14:07.4503703Z I0713 00:07:04.065151 1 shared_informer.go:197] Waiting for caches to sync for ReplicaSet
2021-07-13T00:14:07.4504676Z I0713 00:07:04.764371 1 controllermanager.go:533] Started "horizontalpodautoscaling"
2021-07-13T00:14:07.4505592Z I0713 00:07:04.764614 1 horizontal.go:156] Starting HPA controller
2021-07-13T00:14:07.4506310Z I0713 00:07:04.764630 1 shared_informer.go:197] Waiting for caches to sync for HPA
2021-07-13T00:14:07.4507104Z I0713 00:07:04.914743 1 controllermanager.go:533] Started "csrcleaner"
2021-07-13T00:14:07.4507869Z I0713 00:07:04.914806 1 cleaner.go:81] Starting CSR cleaner controller
2021-07-13T00:14:07.4508885Z E0713 00:07:05.164786 1 core.go:91] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail
2021-07-13T00:14:07.4509933Z W0713 00:07:05.164811 1 controllermanager.go:525] Skipping "service"
2021-07-13T00:14:07.4511048Z W0713 00:07:05.667426 1 shared_informer.go:415] resyncPeriod 77912641797904 is smaller than resyncCheckPeriod 81335242751116 and the informer has already started. Changing it to 81335242751116
2021-07-13T00:14:07.4512343Z I0713 00:07:05.667684 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceaccounts
2021-07-13T00:14:07.4513751Z W0713 00:07:05.668147 1 shared_informer.go:415] resyncPeriod 43247902255526 is smaller than resyncCheckPeriod 81335242751116 and the informer has already started. Changing it to 81335242751116
2021-07-13T00:14:07.4515082Z I0713 00:07:05.668292 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for events.events.k8s.io
2021-07-13T00:14:07.4516417Z I0713 00:07:05.668421 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy
2021-07-13T00:14:07.4517821Z I0713 00:07:05.668503 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for jobs.batch
2021-07-13T00:14:07.4519031Z I0713 00:07:05.668532 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
2021-07-13T00:14:07.4520540Z I0713 00:07:05.668580 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
2021-07-13T00:14:07.4521796Z I0713 00:07:05.668650 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for daemonsets.apps
2021-07-13T00:14:07.4523249Z I0713 00:07:05.668686 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
2021-07-13T00:14:07.4524655Z I0713 00:07:05.668733 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for limitranges
2021-07-13T00:14:07.4525764Z I0713 00:07:05.668763 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for statefulsets.apps
2021-07-13T00:14:07.4526910Z I0713 00:07:05.668805 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for cronjobs.batch
2021-07-13T00:14:07.4528040Z I0713 00:07:05.668853 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for replicasets.apps
2021-07-13T00:14:07.4529425Z I0713 00:07:05.668900 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
2021-07-13T00:14:07.4530753Z I0713 00:07:05.668925 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpoints
2021-07-13T00:14:07.4531992Z I0713 00:07:05.668975 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for ingresses.extensions
2021-07-13T00:14:07.4533209Z I0713 00:07:05.669003 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for deployments.apps
2021-07-13T00:14:07.4534525Z I0713 00:07:05.669019 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
2021-07-13T00:14:07.4535820Z I0713 00:07:05.669065 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for podtemplates
2021-07-13T00:14:07.4537227Z I0713 00:07:05.669107 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling
2021-07-13T00:14:07.4538744Z I0713 00:07:05.669159 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for controllerrevisions.apps
2021-07-13T00:14:07.4541506Z I0713 00:07:05.669238 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
2021-07-13T00:14:07.4571209Z I0713 00:07:05.669273 1 controllermanager.go:533] Started "resourcequota"
2021-07-13T00:14:07.4572165Z I0713 00:07:05.670868 1 resource_quota_controller.go:271] Starting resource quota controller
2021-07-13T00:14:07.4576520Z I0713 00:07:05.670887 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:07.4577320Z I0713 00:07:05.671585 1 resource_quota_monitor.go:303] QuotaMonitor running
2021-07-13T00:14:07.4582239Z I0713 00:07:05.680748 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:07.4583221Z I0713 00:07:05.709438 1 shared_informer.go:204] Caches are synced for deployment
2021-07-13T00:14:07.4584326Z I0713 00:07:05.715432 1 shared_informer.go:204] Caches are synced for job
2021-07-13T00:14:07.4585061Z I0713 00:07:05.716362 1 shared_informer.go:204] Caches are synced for expand
2021-07-13T00:14:07.4586478Z I0713 00:07:05.724664 1 shared_informer.go:204] Caches are synced for certificate-csrapproving
2021-07-13T00:14:07.4587575Z I0713 00:07:05.735620 1 shared_informer.go:204] Caches are synced for PVC protection
2021-07-13T00:14:07.4590337Z I0713 00:07:05.744093 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"local-path-storage", Name:"local-path-provisioner", UID:"cd4849e7-f5b3-4a8c-930f-3db8486c3915", APIVersion:"apps/v1", ResourceVersion:"246", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set local-path-provisioner-5bf465b47d to 1
2021-07-13T00:14:07.4594136Z I0713 00:07:05.744124 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"a1d7d211-6b0c-406b-a324-0e6f3cc26899", APIVersion:"apps/v1", ResourceVersion:"204", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-6955765f44 to 2
2021-07-13T00:14:07.4596036Z I0713 00:07:05.754538 1 shared_informer.go:204] Caches are synced for ReplicationController
2021-07-13T00:14:07.4597086Z I0713 00:07:05.765370 1 shared_informer.go:204] Caches are synced for ReplicaSet
2021-07-13T00:14:07.4598279Z I0713 00:07:05.768029 1 shared_informer.go:204] Caches are synced for certificate-csrsigning
2021-07-13T00:14:07.4607415Z I0713 00:07:05.769602 1 shared_informer.go:204] Caches are synced for ClusterRoleAggregator
2021-07-13T00:14:07.4608343Z I0713 00:07:05.773746 1 shared_informer.go:204] Caches are synced for service account
2021-07-13T00:14:07.4611581Z I0713 00:07:05.781395 1 shared_informer.go:204] Caches are synced for namespace
2021-07-13T00:14:07.4612428Z I0713 00:07:05.788101 1 shared_informer.go:204] Caches are synced for PV protection
2021-07-13T00:14:07.4615038Z I0713 00:07:05.793253 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-6955765f44", UID:"17cd19ea-6b96-455a-a797-cbcf75f86282", APIVersion:"apps/v1", ResourceVersion:"344", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-6955765f44-9nnkj
2021-07-13T00:14:07.4617869Z E0713 00:07:05.802651 1 clusterroleaggregation_controller.go:180] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.4620531Z E0713 00:07:05.802476 1 clusterroleaggregation_controller.go:180] view failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "view": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.4629492Z I0713 00:07:05.804522 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"local-path-storage", Name:"local-path-provisioner-5bf465b47d", UID:"fbe4ba51-29dd-48c6-9f73-c1c7fe604d8e", APIVersion:"apps/v1", ResourceVersion:"343", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: local-path-provisioner-5bf465b47d-7xfgd
2021-07-13T00:14:07.4638221Z I0713 00:07:05.805046 1 shared_informer.go:204] Caches are synced for stateful set
2021-07-13T00:14:07.4649716Z I0713 00:07:05.823342 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-6955765f44", UID:"17cd19ea-6b96-455a-a797-cbcf75f86282", APIVersion:"apps/v1", ResourceVersion:"344", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-6955765f44-2mnnb
2021-07-13T00:14:07.4651603Z I0713 00:07:05.899828 1 shared_informer.go:204] Caches are synced for bootstrap_signer
2021-07-13T00:14:07.4652553Z I0713 00:07:05.964776 1 shared_informer.go:204] Caches are synced for HPA
2021-07-13T00:14:07.4653464Z I0713 00:07:06.088141 1 shared_informer.go:204] Caches are synced for endpoint
2021-07-13T00:14:07.4654310Z I0713 00:07:06.116328 1 shared_informer.go:204] Caches are synced for disruption
2021-07-13T00:14:07.4655074Z I0713 00:07:06.116546 1 disruption.go:338] Sending events to api server.
2021-07-13T00:14:07.4656987Z W0713 00:07:06.223203 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-control-plane" does not exist
2021-07-13T00:14:07.4658479Z I0713 00:07:06.228565 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:07.4659542Z I0713 00:07:06.228583 1 garbagecollector.go:138] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
2021-07-13T00:14:07.4660577Z I0713 00:07:06.271079 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:07.4661362Z I0713 00:07:06.273056 1 shared_informer.go:204] Caches are synced for attach detach
2021-07-13T00:14:07.4662153Z I0713 00:07:06.280963 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:07.4662914Z I0713 00:07:06.283203 1 shared_informer.go:204] Caches are synced for GC
2021-07-13T00:14:07.4663647Z I0713 00:07:06.286624 1 shared_informer.go:204] Caches are synced for daemon sets
2021-07-13T00:14:07.4664372Z I0713 00:07:06.289998 1 shared_informer.go:204] Caches are synced for taint
2021-07-13T00:14:07.4665206Z I0713 00:07:06.290294 1 node_lifecycle_controller.go:1443] Initializing eviction metric for zone:
2021-07-13T00:14:07.4666651Z W0713 00:07:06.290486 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster1-control-plane. Assuming now as a timestamp.
2021-07-13T00:14:07.4668477Z I0713 00:07:06.290598 1 node_lifecycle_controller.go:1209] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
2021-07-13T00:14:07.4669654Z I0713 00:07:06.290917 1 taint_manager.go:186] Starting NoExecuteTaintManager
2021-07-13T00:14:07.4672439Z I0713 00:07:06.292148 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster1-control-plane", UID:"bbe3ed2d-bc36-42e8-a158-12b77f190000", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller
2021-07-13T00:14:07.4676012Z I0713 00:07:06.312100 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"b300769d-f0bf-40d8-8819-6f63dba1f0e9", APIVersion:"apps/v1", ResourceVersion:"211", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-xxbqn
2021-07-13T00:14:07.4678165Z I0713 00:07:06.312962 1 shared_informer.go:204] Caches are synced for node
2021-07-13T00:14:07.4678907Z I0713 00:07:06.313050 1 range_allocator.go:172] Starting range CIDR allocator
2021-07-13T00:14:07.4679711Z I0713 00:07:06.313111 1 shared_informer.go:197] Waiting for caches to sync for cidrallocator
2021-07-13T00:14:07.4680551Z I0713 00:07:06.313149 1 shared_informer.go:204] Caches are synced for cidrallocator
2021-07-13T00:14:07.4681302Z I0713 00:07:06.317955 1 shared_informer.go:204] Caches are synced for TTL
2021-07-13T00:14:07.4682466Z I0713 00:07:06.330385 1 range_allocator.go:373] Set node cluster1-control-plane PodCIDR to [10.1.0.0/24]
2021-07-13T00:14:07.4683390Z I0713 00:07:06.337709 1 shared_informer.go:204] Caches are synced for persistent volume
2021-07-13T00:14:07.4795550Z E0713 00:07:06.360564 1 daemon_controller.go:319] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"b300769d-f0bf-40d8-8819-6f63dba1f0e9", ResourceVersion:"211", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731610, loc:(*time.Location)(0x6b97340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc00182a100), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc0017b8840), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00182a120), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc00182a140), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.17.17", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc00182a180)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc0017da5f0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0017dc938), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"beta.kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0015e0de0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc00000fed0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc0017dc978)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.4843424Z I0713 00:07:07.419961 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:07.4844274Z I0713 00:07:07.420123 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:07.4846395Z W0713 00:07:22.415867 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker" does not exist
2021-07-13T00:14:07.4848070Z I0713 00:07:22.438498 1 range_allocator.go:373] Set node cluster1-worker PodCIDR to [10.1.1.0/24]
2021-07-13T00:14:07.4850322Z I0713 00:07:22.479830 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"b300769d-f0bf-40d8-8819-6f63dba1f0e9", APIVersion:"apps/v1", ResourceVersion:"419", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-vvsrv
2021-07-13T00:14:07.4853009Z W0713 00:07:23.778698 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker2" does not exist
2021-07-13T00:14:07.4855765Z I0713 00:07:23.796693 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"b300769d-f0bf-40d8-8819-6f63dba1f0e9", APIVersion:"apps/v1", ResourceVersion:"475", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-ll888
2021-07-13T00:14:07.4857787Z I0713 00:07:23.816387 1 range_allocator.go:373] Set node cluster1-worker2 PodCIDR to [10.1.2.0/24]
2021-07-13T00:14:07.5006168Z E0713 00:07:23.932211 1 daemon_controller.go:319] kube-system/kube-proxy failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"kube-proxy", GenerateName:"", Namespace:"kube-system", SelfLink:"/apis/apps/v1/namespaces/kube-system/daemonsets/kube-proxy", UID:"b300769d-f0bf-40d8-8819-6f63dba1f0e9", ResourceVersion:"489", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731610, loc:(*time.Location)(0x6b97340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc001146c80), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"k8s-app":"kube-proxy"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"kube-proxy", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(0xc0014fa7c0), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001146ca0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001146cc0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"kube-proxy", Image:"k8s.gcr.io/kube-proxy:v1.17.17", Command:[]string{"/usr/local/bin/kube-proxy", "--config=/var/lib/kube-proxy/config.conf", "--hostname-override=$(NODE_NAME)"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001146d00)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"kube-proxy", ReadOnly:false, MountPath:"/var/lib/kube-proxy", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:true, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc000fa1900), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc0015e6b38), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"beta.kubernetes.io/os":"linux"}, ServiceAccountName:"kube-proxy", DeprecatedServiceAccount:"kube-proxy", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0015d99e0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"CriticalAddonsOnly", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0000f1bc8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc0015e6b78)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:2, NumberMisscheduled:0, DesiredNumberScheduled:3, NumberReady:1, ObservedGeneration:1, UpdatedNumberScheduled:2, NumberAvailable:1, NumberUnavailable:2, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "kube-proxy": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.5054676Z W0713 00:07:26.291436 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster1-worker. Assuming now as a timestamp.
2021-07-13T00:14:07.5056216Z W0713 00:07:26.291746 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster1-worker2. Assuming now as a timestamp.
2021-07-13T00:14:07.5059016Z I0713 00:07:26.292372 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster1-worker2", UID:"31a4352a-24fc-45be-90fe-9f2e3b4c7ed2", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller
2021-07-13T00:14:07.5062431Z I0713 00:07:26.292601 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster1-worker", UID:"c7a40744-797c-44af-b224-0a3b88c12fc0", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster1-worker event: Registered Node cluster1-worker in Controller
2021-07-13T00:14:07.5065581Z I0713 00:07:37.010880 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"76056e08-5fd4-462b-9498-f5a1f446f804", APIVersion:"apps/v1", ResourceVersion:"559", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-2844t
2021-07-13T00:14:07.5068563Z I0713 00:07:37.336515 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"76056e08-5fd4-462b-9498-f5a1f446f804", APIVersion:"apps/v1", ResourceVersion:"559", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-qkp62
2021-07-13T00:14:07.5071818Z I0713 00:07:37.370348 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"76056e08-5fd4-462b-9498-f5a1f446f804", APIVersion:"apps/v1", ResourceVersion:"559", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-6vzt2
2021-07-13T00:14:07.5073726Z I0713 00:08:01.304254 1 node_lifecycle_controller.go:1236] Controller detected that some Nodes are Ready. Exiting master disruption mode.
2021-07-13T00:14:07.5074777Z I0713 00:09:07.667432 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:07.5075608Z I0713 00:09:07.867758 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:07.5076659Z I0713 00:09:08.486050 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for brokers.submariner.io
2021-07-13T00:14:07.5078781Z I0713 00:09:08.486132 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for submariners.submariner.io
2021-07-13T00:14:07.5080241Z I0713 00:09:08.486168 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for servicediscoveries.submariner.io
2021-07-13T00:14:07.5081445Z I0713 00:09:08.486203 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:07.5082238Z I0713 00:09:08.486230 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:07.5085016Z I0713 00:09:09.266252 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-operator", UID:"11a2ca68-ad1c-4ff1-b5e5-ebdd0b6ce14e", APIVersion:"apps/v1", ResourceVersion:"1017", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-operator-56f895dd55 to 1
2021-07-13T00:14:07.5089333Z I0713 00:09:09.283363 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-operator-56f895dd55", UID:"10e70b57-5c09-4b54-ad2f-5b77f86f6e10", APIVersion:"apps/v1", ResourceVersion:"1018", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-operator-56f895dd55-69xqf
2021-07-13T00:14:07.5093301Z I0713 00:09:22.276690 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-gateway", UID:"eb9e3052-4650-4059-99c4-ae84a9fefb69", APIVersion:"apps/v1", ResourceVersion:"1145", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-gateway-hb9qm
2021-07-13T00:14:07.5864761Z E0713 00:09:22.362240 1 daemon_controller.go:319] submariner-operator/submariner-gateway failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-gateway", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/apps/v1/namespaces/submariner-operator/daemonsets/submariner-gateway", UID:"eb9e3052-4650-4059-99c4-ae84a9fefb69", ResourceVersion:"1145", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731762, loc:(*time.Location)(0x6b97340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway", "component":"gateway"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"e1467845-e9b1-4518-8303-8baf30a1a57c", Controller:(*bool)(0xc001663637), BlockOwnerDeletion:(*bool)(0xc001663638)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0013caec0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"ipsecd", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc0013caee0), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"ipsecnss", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(nil), EmptyDir:(*v1.EmptyDirVolumeSource)(0xc0013caf00), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-gateway", Image:"localhost:5000/submariner-gateway:local", Command:[]string{"submariner.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort{v1.ContainerPort{Name:"cable-encaps", HostPort:4500, ContainerPort:4500, Protocol:"UDP", HostIP:""}, v1.ContainerPort{Name:"natt-discovery", HostPort:4490, ContainerPort:4490, Protocol:"UDP", HostIP:""}}, EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_COLORCODES", Value:"blue", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NATENABLED", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_BROKER", Value:"k8s", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CABLEDRIVER", Value:"libreswan", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVER", Value:"172.18.0.6:6443", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVERTOKEN", Value:"***", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_REMOTENAMESPACE", Value:"submariner-k8s-broker", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_CA", Value:"LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUN5RENDQWJDZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNekF3TURZd05sb1hEVE14TURjeE1UQXdNRFl3Tmxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTGtUCmY1NUFPTEs2U2xqeDJzYUg1R1ZCc3B6ZktjMVJMNlY5dEhHOXJxREI3NUhoUnZZeG1tOG5kQzh3Tm9OcWxxYjAKYndGSlBLaFoyNXRGcm4xVHgvd3dmby9LcVdydjlUVkxpVkMzTXV3NURmQ0cxck9kdXB6WVNkdnNYMmp2R2I5RwpPQUZ2WjNUMzdxYkRvNFJOaTNXcytDSXJFUmF2bk9VbXBodlh0ZzRDNlJDMkpoc254TzQ0bTZySmtGT0VqbDNDCmFBQktiZ2VPN2p3QXUvRnk1KzhGQ3VLbWorTTd2L2luRTRVandEQVVweSsxamVXak1reW9DcUZEVXNpT2dFSXEKNG00ZVM4LzlnYktKaVRQQlI0OUZ4VEhhenRZQXQxUDhISzJOVVJmUWZtSGh6b1JWenhTMGtQeWl6OCtLTFA1awpNN1YwNjRSVlUrQlY3aGFaM1NNQ0F3RUFBYU1qTUNFd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0RRWUpLb1pJaHZjTkFRRUxCUUFEZ2dFQkFLdVNXT3F1K2h2ZmpoWUhLVmVFZFdHVGQ1RHUKK3ovblZ2WDVuRVFQMVVRSzBCRDBac1dJd3puRU5taExxY1BQSFMzV2VjcjVJMmJXcnkyd1dUdmx4ODhtOStjaAp1WlV3MGNDaWpmYm91dWJqMVRYbFBRTUZPRmI4cU5ERnF1VlVpbm4wTU0wWnlNNDN0NWcwSG9aVUpxZGRyYkxGCkgxckZuOUt2VmtCMnZvSHlhYU5VaTNMU0pnL3V5M3FFcmtrcDd4b1BOTzlZdzZLV0tyVVM4eXhCM2ZORTd2bUgKdzIzNFgzTE5FQ1ZLRU0wUlpIYXFlZ3V0UGpnamhBc1BLVlZQOSt3SXR4cE9ESHFZelFidlNGUHNHendGZHczWAovOHZPamhwWW1IY0VDRHBUL3ZUbnluWXNXTzhwVEZVbmRGMjlreFFic3JNSW1pSjN3RUtIQ2xSQkM4dz0KLS0tLS1FTkQgQ0VSVElGSUNBVEUtLS0tLQo=", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PSK", Value:"BSMW1wdgadmiJ7QzsexEhKpDiapEcdZ/QM++X3Z6PO+embpy3qlb7pQa6/dbk/51", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKENABLED", Value:"true", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKINTERVAL", Value:"1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT", Value:"5", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0013caf20)}, v1.EnvVar{Name:"POD_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0013caf60)}, v1.EnvVar{Name:"CE_IPSEC_IKEPORT", Value:"500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_NATTPORT", Value:"4500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PREFERREDSERVER", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_FORCEENCAPS", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"ipsecd", ReadOnly:false, MountPath:"/etc/ipsec.d", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"ipsecnss", ReadOnly:false, MountPath:"/var/lib/ipsec/nss", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"Always", SecurityContext:(*v1.SecurityContext)(0xc001630dc0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001663948), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"submariner.io/gateway":"true"}, ServiceAccountName:"submariner-gateway", DeprecatedServiceAccount:"submariner-gateway", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc001548060), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(0xc0013cafa0), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0000f1bc0)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc00166396c)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-gateway": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.6393948Z I0713 00:09:22.904273 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"c4a25d8c-bb2c-4850-b4a5-3d0f43620509", APIVersion:"apps/v1", ResourceVersion:"1159", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-74xsc
2021-07-13T00:14:07.6398442Z I0713 00:09:23.029665 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"c4a25d8c-bb2c-4850-b4a5-3d0f43620509", APIVersion:"apps/v1", ResourceVersion:"1159", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-c5rv6
2021-07-13T00:14:07.6402964Z I0713 00:09:23.149099 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-agent-8bcbc988f", UID:"8eb8e370-a97f-4bd2-9c22-d18f8a40509b", APIVersion:"apps/v1", ResourceVersion:"1166", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-agent-8bcbc988f-k4ckn
2021-07-13T00:14:07.6407337Z I0713 00:09:23.149249 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"c4a25d8c-bb2c-4850-b4a5-3d0f43620509", APIVersion:"apps/v1", ResourceVersion:"1159", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-6rpj8
2021-07-13T00:14:07.6411469Z I0713 00:09:23.285549 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-lighthouse-agent", UID:"31b9f335-0109-41b1-ae28-6d9cff870d5b", APIVersion:"apps/v1", ResourceVersion:"1163", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-lighthouse-agent-8bcbc988f to 1
2021-07-13T00:14:07.6489491Z E0713 00:09:23.884437 1 daemon_controller.go:319] submariner-operator/submariner-routeagent failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-routeagent", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/apps/v1/namespaces/submariner-operator/daemonsets/submariner-routeagent", UID:"c4a25d8c-bb2c-4850-b4a5-3d0f43620509", ResourceVersion:"1159", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731762, loc:(*time.Location)(0x6b97340)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"e1467845-e9b1-4518-8303-8baf30a1a57c", Controller:(*bool)(0xc000b8c9aa), BlockOwnerDeletion:(*bool)(0xc000b8c9ab)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc000a564c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"host-run-xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc000a564e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"host-run-openvswitch-db-sock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc000a56500), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}, v1.Volume{Name:"host-sys", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc000a56520), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-routeagent", Image:"localhost:5000/submariner-route-agent:local", Command:[]string{"submariner-route-agent.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NETWORKPLUGIN", Value:"weave-net", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc000a56540)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"host-sys", ReadOnly:true, MountPath:"/sys", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"host-run-xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"host-run-openvswitch-db-sock", ReadOnly:false, MountPath:"/run/openvswitch/db.sock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"Always", SecurityContext:(*v1.SecurityContext)(0xc0017dba40), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000b8d120), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"submariner-routeagent", DeprecatedServiceAccount:"submariner-routeagent", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0012e83c0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc0000f1dd8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc000b8d164)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-routeagent": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:07.6560053Z I0713 00:09:25.632254 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns", UID:"116d4319-21fb-47d3-8218-db85d3156d16", APIVersion:"apps/v1", ResourceVersion:"1208", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-lighthouse-coredns-69d78f6d78 to 2
2021-07-13T00:14:07.6564864Z I0713 00:09:25.647903 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns-69d78f6d78", UID:"85906972-4217-496e-b61d-149b3619cd28", APIVersion:"apps/v1", ResourceVersion:"1209", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-coredns-69d78f6d78-25fgx
2021-07-13T00:14:07.6570045Z I0713 00:09:26.434635 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns-69d78f6d78", UID:"85906972-4217-496e-b61d-149b3619cd28", APIVersion:"apps/v1", ResourceVersion:"1209", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-coredns-69d78f6d78-5sckx
2021-07-13T00:14:07.6572734Z I0713 00:09:38.734742 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:07.6573824Z I0713 00:09:38.950814 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpoints.submariner.io
2021-07-13T00:14:07.6575665Z I0713 00:09:38.950868 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceexports.multicluster.x-k8s.io
2021-07-13T00:14:07.6577243Z W0713 00:09:38.950885 1 shared_informer.go:415] resyncPeriod 45543788466748 is smaller than resyncCheckPeriod 61521738563324 and the informer has already started. Changing it to 61521738563324
2021-07-13T00:14:07.6578715Z I0713 00:09:38.950920 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for globalegressips.submariner.io
2021-07-13T00:14:07.6580762Z I0713 00:09:38.950952 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for globalingressips.submariner.io
2021-07-13T00:14:07.6582242Z W0713 00:09:38.950966 1 shared_informer.go:415] resyncPeriod 54950656846952 is smaller than resyncCheckPeriod 61521738563324 and the informer has already started. Changing it to 61521738563324
2021-07-13T00:14:07.6583598Z I0713 00:09:38.950981 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for clusters.submariner.io
2021-07-13T00:14:07.6585430Z I0713 00:09:38.951001 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceimports.multicluster.x-k8s.io
2021-07-13T00:14:07.6587012Z W0713 00:09:38.951011 1 shared_informer.go:415] resyncPeriod 49699557516255 is smaller than resyncCheckPeriod 61521738563324 and the informer has already started. Changing it to 61521738563324
2021-07-13T00:14:07.6588543Z I0713 00:09:38.951026 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for gateways.submariner.io
2021-07-13T00:14:07.6589596Z I0713 00:09:38.951082 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:07.6590405Z I0713 00:09:41.535009 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:07.6591219Z I0713 00:09:41.551281 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:07.6592529Z [lighthouse]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-13T00:14:07.6593847Z [lighthouse]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-13T00:14:07.6595023Z [lighthouse]$ [cluster1] print_pods_logs submariner-operator
2021-07-13T00:14:07.6596305Z [lighthouse]$ [cluster1] print_pods_logs submariner-operator
2021-07-13T00:14:07.6597743Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:07.6599083Z [lighthouse]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:07.6600525Z [lighthouse]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:07.6602055Z [lighthouse]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:07.6603741Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:07.6604711Z ====================================================================
2021-07-13T00:14:07.6605494Z ##[endgroup]
2021-07-13T00:14:07.6614235Z ##[group]* Submariner-operator pod logs for cluster1 *
2021-07-13T00:14:07.6615458Z ======================= * Submariner-operator pod logs for cluster1 * =======================
2021-07-13T00:14:07.6616067Z ====================================================================
2021-07-13T00:14:07.6616580Z ##[endgroup]
2021-07-13T00:14:07.6634442Z ##[group]** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:07.6635811Z ======================= ** Pods logs for NS submariner-operator using selector '' ** =======================
2021-07-13T00:14:07.9873419Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-hb9qm -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:07.9891159Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-hb9qm -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:07.9907467Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-gateway-hb9qm -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:08.3380714Z [lighthouse]$ [cluster1] print_section *** submariner-gateway-hb9qm ***
2021-07-13T00:14:08.3397495Z [lighthouse]$ [cluster1] print_section *** submariner-gateway-hb9qm ***
2021-07-13T00:14:08.3408491Z ====================================================================
2021-07-13T00:14:08.3409129Z ##[endgroup]
2021-07-13T00:14:08.3410243Z ##[group]*** submariner-gateway-hb9qm ***
2021-07-13T00:14:08.3411251Z ======================= *** submariner-gateway-hb9qm *** =======================
2021-07-13T00:14:08.3422564Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-hb9qm
2021-07-13T00:14:08.3434735Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-hb9qm
2021-07-13T00:14:08.3449031Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-gateway-hb9qm
2021-07-13T00:14:08.6543573Z + trap 'exit 1' SIGTERM SIGINT
2021-07-13T00:14:08.6547335Z + export CHARON_PID_FILE=/var/run/charon.pid
2021-07-13T00:14:08.6552834Z + CHARON_PID_FILE=/var/run/charon.pid
2021-07-13T00:14:08.6554257Z + rm -f /var/run/charon.pid
2021-07-13T00:14:08.6555041Z + SUBMARINER_VERBOSITY=2
2021-07-13T00:14:08.6555908Z + '[' false == true ']'
2021-07-13T00:14:08.6556437Z + DEBUG=-v=2
2021-07-13T00:14:08.6557317Z ++ cat /proc/sys/net/ipv4/conf/all/send_redirects
2021-07-13T00:14:08.6557809Z + [[ 1 = 0 ]]
2021-07-13T00:14:08.6558130Z + echo 0
2021-07-13T00:14:08.6559108Z + exec submariner-gateway -v=2 -alsologtostderr
2021-07-13T00:14:08.6559872Z I0713 00:09:46.121486 1 main.go:92] Starting the submariner gateway engine
2021-07-13T00:14:08.6561171Z W0713 00:09:46.121944 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:08.6562121Z I0713 00:09:46.141428 1 main.go:120] Creating the cable engine
2021-07-13T00:14:08.6562812Z I0713 00:09:47.030702 1 local_endpoint.go:209] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:08.6563560Z I0713 00:09:47.030781 1 local_endpoint.go:209] Interface "weave" has "10.1.0.1" address
2021-07-13T00:14:08.6564420Z I0713 00:09:47.030788 1 local_endpoint.go:214] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:08.6565322Z I0713 00:09:47.030813 1 natdiscovery.go:116] NAT discovery server starting on port 4490
2021-07-13T00:14:08.6566070Z I0713 00:09:47.384853 1 syncer.go:83] CableEngine syncer started
2021-07-13T00:14:08.6567120Z I0713 00:09:47.397440 1 main.go:322] Gateway leader election config values: main.leaderConfig{LeaseDuration:10, RenewDeadline:5, RetryPeriod:2}
2021-07-13T00:14:08.6568589Z I0713 00:09:47.399001 1 main.go:339] Using namespace "submariner-operator" for the leader election lock
2021-07-13T00:14:08.6570134Z I0713 00:09:47.399087 1 leaderelection.go:243] attempting to acquire leader lease submariner-operator/submariner-gateway-lock...
2021-07-13T00:14:08.6571902Z I0713 00:09:47.537119 1 leaderelection.go:253] successfully acquired lease submariner-operator/submariner-gateway-lock
2021-07-13T00:14:08.6573172Z I0713 00:09:47.551215 1 main.go:188] Creating the datastore syncer
2021-07-13T00:14:08.6573847Z I0713 00:09:47.551269 1 libreswan.go:97] Using NATT UDP port 4500
2021-07-13T00:14:08.6574460Z I0713 00:09:47.551337 1 libreswan.go:524] Starting Pluto
2021-07-13T00:14:08.6577064Z I0713 00:09:47.553538 1 event.go:282] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"submariner-operator", Name:"submariner-gateway-lock", UID:"6aed1d48-194e-4072-bbb6-10340c8b2ab4", APIVersion:"v1", ResourceVersion:"1309", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster1-worker-submariner-gateway became leader
2021-07-13T00:14:08.6579240Z /usr/libexec/ipsec/_stackmanager: line 111: pidof: command not found
2021-07-13T00:14:08.6579876Z Initializing NSS database
2021-07-13T00:14:08.6580219Z
2021-07-13T00:14:08.6580624Z nflog ipsec capture disabled
2021-07-13T00:14:08.6581364Z I0713 00:09:49.560375 1 cableengine.go:95] CableEngine controller started, driver: "libreswan"
2021-07-13T00:14:08.6582203Z I0713 00:09:49.560668 1 tunnel.go:36] Starting the tunnel controller
2021-07-13T00:14:08.6582972Z I0713 00:09:49.560871 1 datastoresyncer.go:65] Starting the datastore syncer
2021-07-13T00:14:08.6584064Z I0713 00:09:49.661614 1 healthchecker.go:107] CableEngine HealthChecker started with PingInterval: 1, MaxPacketLossCount: 5
2021-07-13T00:14:08.6585148Z I0713 00:09:50.111475 1 datastoresyncer.go:87] Starting the broker syncer
2021-07-13T00:14:08.6586044Z I0713 00:09:50.321149 1 datastoresyncer.go:140] Ensuring we are the only endpoint active for this cluster
2021-07-13T00:14:08.6587917Z I0713 00:09:50.321245 1 datastoresyncer.go:219] Creating local submariner Cluster: types.SubmarinerCluster{ID:"cluster1", Spec:v1.ClusterSpec{ClusterID:"cluster1", ColorCodes:[]string{"blue"}, ServiceCIDR:[]string{"100.1.0.0/16"}, ClusterCIDR:[]string{"10.1.0.0/16"}, GlobalCIDR:[]string{}}}
2021-07-13T00:14:08.6592190Z I0713 00:09:50.587319 1 datastoresyncer.go:232] Creating local submariner Endpoint: types.SubmarinerEndpoint{Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6627843Z I0713 00:09:50.679553 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6634460Z I0713 00:09:50.679634 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.6636762Z I0713 00:09:50.688752 1 datastoresyncer.go:114] Datastore syncer started
2021-07-13T00:14:08.6646203Z I0713 00:10:19.946547 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6659125Z I0713 00:10:19.946642 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.6668689Z I0713 00:10:25.005835 1 request_handle.go:54] Received request from 172.18.0.7:4490 - REQUEST_NUMBER: 0x637e09a184b2833a, SENDER: "submariner-cable-cluster3-172-18-0-7", RECEIVER: "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:08.6676101Z I0713 00:10:25.005926 1 request_handle.go:118] Sending response to 172.18.0.7:4490 - REQUEST_NUMBER: 0x637e09a184b2833a, RESPONSE: OK, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:08.6691637Z I0713 00:10:25.222609 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6705310Z I0713 00:10:25.222669 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:08.6707484Z I0713 00:10:25.229777 1 pinger.go:80] Starting pinger for IP "10.3.0.1"
2021-07-13T00:14:08.6709241Z I0713 00:10:25.229794 1 healthchecker.go:157] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster3-172-18-0-7" with HealthCheckIP "10.3.0.1"
2021-07-13T00:14:08.6713169Z I0713 00:10:26.099903 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x73bdc4e332deb07c, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster3-172-18-0-7", USING_SRC: 172.18.0.4:4490, USING_DST: 172.18.0.7:4490
2021-07-13T00:14:08.6716739Z I0713 00:10:26.100089 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x73bdc4e332deb07d, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster3-172-18-0-7", USING_SRC: 172.18.0.4:4490, USING_DST: 20.94.215.61:4490
2021-07-13T00:14:08.6720747Z I0713 00:10:26.100370 1 response_handle.go:33] Received response from 172.18.0.7:4490 - REQUEST_NUMBER: 0x73bdc4e332deb07c, RESPONSE: OK, SENDER: "submariner-cable-cluster3-172-18-0-7", RECEIVER: "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:08.6723541Z I0713 00:10:26.100445 1 remote_endpoint.go:179] selected private IP "172.18.0.7" for endpoint "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:08.6726029Z I0713 00:10:26.100486 1 cableengine.go:189] Installing Endpoint cable "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:08.6727061Z 002 listening for IKE messages
2021-07-13T00:14:08.6727929Z 002 adding UDP interface vx-submariner 240.18.0.4:500
2021-07-13T00:14:08.6729514Z 002 adding UDP interface vx-submariner 240.18.0.4:4500
2021-07-13T00:14:08.6730065Z 002 forgetting secrets
2021-07-13T00:14:08.6730626Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-13T00:14:08.6732623Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-13T00:14:08.6746247Z I0713 00:10:26.105900 1 libreswan.go:308] Creating connection(s) for {"metadata":{"name":"cluster3-submariner-cable-cluster3-172-18-0-7","namespace":"submariner-operator","selfLink":"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7","uid":"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a","resourceVersion":"1482","generation":1,"creationTimestamp":"2021-07-13T00:10:25Z","labels":{"submariner-io/clusterID":"cluster3"}},"spec":{"cluster_id":"cluster3","cable_name":"submariner-cable-cluster3-172-18-0-7","healthCheckIP":"10.3.0.1","hostname":"cluster3-worker","subnets":["100.3.0.0/16","10.3.0.0/16"],"private_ip":"172.18.0.7","public_ip":"20.94.215.61","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-13T00:14:08.6753859Z I0713 00:10:26.106079 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-0-0 --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 100.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6755871Z 002 "submariner-cable-cluster3-172-18-0-7-0-0": added IKEv2 connection
2021-07-13T00:14:08.6759374Z 181 "submariner-cable-cluster3-172-18-0-7-0-0" #1: initiating IKEv2 connection
2021-07-13T00:14:08.6767180Z I0713 00:10:26.304473 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-0-1 --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 10.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6770192Z 002 "submariner-cable-cluster3-172-18-0-7-0-1": added IKEv2 connection
2021-07-13T00:14:08.6772373Z 000 "submariner-cable-cluster3-172-18-0-7-0-1": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:08.6776941Z I0713 00:10:26.443293 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-1-0 --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 100.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6780006Z 002 "submariner-cable-cluster3-172-18-0-7-1-0": added IKEv2 connection
2021-07-13T00:14:08.6791095Z 000 "submariner-cable-cluster3-172-18-0-7-1-0": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:08.6793859Z I0713 00:10:26.454935 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-1-1 --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 10.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6796006Z 002 "submariner-cable-cluster3-172-18-0-7-1-1": added IKEv2 connection
2021-07-13T00:14:08.6798478Z 000 "submariner-cable-cluster3-172-18-0-7-1-1": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:08.6800841Z I0713 00:10:26.472874 1 cableengine.go:196] Successfully installed Endpoint cable "submariner-cable-cluster3-172-18-0-7" with remote IP 172.18.0.7
2021-07-13T00:14:08.6811997Z I0713 00:10:26.546009 1 request_handle.go:54] Received request from 172.18.0.5:4490 - REQUEST_NUMBER: 0x3d259f87f18ebd8a, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:08.6818661Z I0713 00:10:26.550674 1 request_handle.go:118] Sending response to 172.18.0.5:4490 - REQUEST_NUMBER: 0x3d259f87f18ebd8a, RESPONSE: OK, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:08.6820352Z I0713 00:10:26.621314 1 pinger.go:80] Starting pinger for IP "10.2.0.1"
2021-07-13T00:14:08.6823311Z I0713 00:10:26.631724 1 healthchecker.go:157] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster2-172-18-0-5" with HealthCheckIP "10.2.0.1"
2021-07-13T00:14:08.6836386Z I0713 00:10:26.621537 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6844769Z I0713 00:10:26.635115 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:08.6848207Z I0713 00:10:27.100427 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x73bdc4e332deb07e, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster2-172-18-0-5", USING_SRC: 172.18.0.4:4490, USING_DST: 172.18.0.5:4490
2021-07-13T00:14:08.6851467Z I0713 00:10:27.103520 1 response_handle.go:33] Received response from 172.18.0.5:4490 - REQUEST_NUMBER: 0x73bdc4e332deb07e, RESPONSE: OK, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:08.6854584Z I0713 00:10:27.103956 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x73bdc4e332deb07f, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster2-172-18-0-5", USING_SRC: 172.18.0.4:4490, USING_DST: 20.94.215.61:4490
2021-07-13T00:14:08.6856994Z I0713 00:10:27.104433 1 remote_endpoint.go:179] selected private IP "172.18.0.5" for endpoint "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:08.6859378Z I0713 00:10:27.105457 1 cableengine.go:189] Installing Endpoint cable "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:08.6860424Z 002 listening for IKE messages
2021-07-13T00:14:08.6860901Z 002 forgetting secrets
2021-07-13T00:14:08.6861465Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-13T00:14:08.6863027Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-13T00:14:08.6880165Z I0713 00:10:27.108031 1 libreswan.go:308] Creating connection(s) for {"metadata":{"name":"cluster2-submariner-cable-cluster2-172-18-0-5","namespace":"submariner-operator","selfLink":"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5","uid":"c4a765b3-8133-453f-ae72-24d9698f9610","resourceVersion":"1488","generation":1,"creationTimestamp":"2021-07-13T00:10:26Z","labels":{"submariner-io/clusterID":"cluster2"}},"spec":{"cluster_id":"cluster2","cable_name":"submariner-cable-cluster2-172-18-0-5","healthCheckIP":"10.2.0.1","hostname":"cluster2-worker","subnets":["100.2.0.0/16","10.2.0.0/16"],"private_ip":"172.18.0.5","public_ip":"20.94.215.61","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-13T00:14:08.6886401Z I0713 00:10:27.109258 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-0 --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6888633Z 002 "submariner-cable-cluster2-172-18-0-5-0-0": added IKEv2 connection
2021-07-13T00:14:08.6890230Z 181 "submariner-cable-cluster2-172-18-0-5-0-0" #8: initiating IKEv2 connection
2021-07-13T00:14:08.6892950Z I0713 00:10:27.273803 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-1 --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6895183Z 002 "submariner-cable-cluster2-172-18-0-5-0-1": added IKEv2 connection
2021-07-13T00:14:08.6897626Z 000 "submariner-cable-cluster2-172-18-0-5-0-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #8 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-13T00:14:08.6900381Z I0713 00:10:27.431994 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-0 --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6902395Z 002 "submariner-cable-cluster2-172-18-0-5-1-0": added IKEv2 connection
2021-07-13T00:14:08.6904557Z 000 "submariner-cable-cluster2-172-18-0-5-1-0": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #8 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-13T00:14:08.6907608Z I0713 00:10:27.476885 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-1 --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-13T00:14:08.6909633Z 002 "submariner-cable-cluster2-172-18-0-5-1-1": added IKEv2 connection
2021-07-13T00:14:08.6911784Z 000 "submariner-cable-cluster2-172-18-0-5-1-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #8 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-13T00:14:08.6924204Z I0713 00:10:27.486714 1 cableengine.go:196] Successfully installed Endpoint cable "submariner-cable-cluster2-172-18-0-5" with remote IP 172.18.0.5
2021-07-13T00:14:08.6937139Z I0713 00:10:29.464665 1 libreswan.go:214] Connection "submariner-cable-cluster2-172-18-0-5-0-1" not found in active connections obtained from whack: map[submariner-cable-cluster2-172-18-0-5-0-0:0 submariner-cable-cluster2-172-18-0-5-1-0:0 submariner-cable-cluster3-172-18-0-7-0-0:0 submariner-cable-cluster3-172-18-0-7-0-1:0 submariner-cable-cluster3-172-18-0-7-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster2-172-18-0-5-0-0:0 submariner-cable-cluster2-172-18-0-5-1-0:0 submariner-cable-cluster3-172-18-0-7-0-0:0 submariner-cable-cluster3-172-18-0-7-0-1:0 submariner-cable-cluster3-172-18-0-7-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:08.6952008Z I0713 00:10:29.464861 1 libreswan.go:214] Connection "submariner-cable-cluster2-172-18-0-5-1-1" not found in active connections obtained from whack: map[submariner-cable-cluster2-172-18-0-5-0-0:0 submariner-cable-cluster2-172-18-0-5-1-0:0 submariner-cable-cluster3-172-18-0-7-0-0:0 submariner-cable-cluster3-172-18-0-7-0-1:0 submariner-cable-cluster3-172-18-0-7-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster2-172-18-0-5-0-0:0 submariner-cable-cluster2-172-18-0-5-1-0:0 submariner-cable-cluster3-172-18-0-7-0-0:0 submariner-cable-cluster3-172-18-0-7-0-1:0 submariner-cable-cluster3-172-18-0-7-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:08.6968116Z I0713 00:10:49.946819 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.6985606Z I0713 00:10:49.946966 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7000880Z I0713 00:10:49.947169 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7009103Z I0713 00:10:49.947215 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7010972Z I0713 00:10:49.947228 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7025625Z I0713 00:10:49.947258 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7032151Z I0713 00:10:49.947275 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7034789Z I0713 00:10:49.947292 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7043934Z I0713 00:11:19.947101 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7051741Z I0713 00:11:19.947166 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7061905Z I0713 00:11:19.947212 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7077332Z I0713 00:11:19.947287 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7099540Z I0713 00:11:19.947331 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7105040Z I0713 00:11:19.947383 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7107769Z I0713 00:11:19.947394 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7110393Z I0713 00:11:19.947403 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7120377Z I0713 00:11:49.947231 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7127142Z I0713 00:11:49.947297 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7138163Z I0713 00:11:49.947381 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7162088Z I0713 00:11:49.947483 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7174666Z I0713 00:11:49.947545 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7177357Z I0713 00:11:49.947563 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7180648Z I0713 00:11:49.947574 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7184337Z I0713 00:11:49.947587 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7194584Z I0713 00:12:19.947904 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7211504Z I0713 00:12:19.948026 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7218214Z I0713 00:12:19.948065 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7226343Z I0713 00:12:19.948104 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7237747Z I0713 00:12:19.948147 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7241290Z I0713 00:12:19.948177 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7244366Z I0713 00:12:19.948188 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7247488Z I0713 00:12:19.948196 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7323269Z I0713 00:12:49.948700 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7339033Z I0713 00:12:49.948831 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7346735Z I0713 00:12:49.948880 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7398454Z I0713 00:12:49.948939 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7401218Z I0713 00:12:49.949069 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7410105Z I0713 00:12:49.949046 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7416931Z I0713 00:12:49.949102 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7419252Z I0713 00:12:49.949088 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7428014Z I0713 00:13:19.949611 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7483241Z I0713 00:13:19.949690 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7495688Z I0713 00:13:19.949737 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7547509Z I0713 00:13:19.949834 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7555666Z I0713 00:13:19.949886 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7571091Z I0713 00:13:19.949927 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7574312Z I0713 00:13:19.949938 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7576965Z I0713 00:13:19.949952 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7626669Z I0713 00:13:49.951615 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"f4bdcd05-9c60-40b5-a328-77d0e0e78212", ResourceVersion:"1332", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731790, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7634687Z I0713 00:13:49.951681 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:08.7643234Z I0713 00:13:49.951834 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"6c2c1788-f38c-4c9d-b2f5-0d60f396b43a", ResourceVersion:"1482", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731825, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7657494Z I0713 00:13:49.951934 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"c4a765b3-8133-453f-ae72-24d9698f9610", ResourceVersion:"1488", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:08.7665259Z I0713 00:13:49.951981 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:25 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:08.7667890Z I0713 00:13:49.952023 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:08.7670472Z I0713 00:13:49.952038 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster2
2021-07-13T00:14:08.7673095Z I0713 00:13:49.952053 1 cableengine.go:171] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-13T00:14:08.7676016Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-8bcbc988f-k4ckn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:08.7747453Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-8bcbc988f-k4ckn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:08.7750604Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-agent-8bcbc988f-k4ckn -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.0266924Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-agent-8bcbc988f-k4ckn ***
2021-07-13T00:14:09.0292341Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-agent-8bcbc988f-k4ckn ***
2021-07-13T00:14:09.0298009Z ====================================================================
2021-07-13T00:14:09.0301851Z ##[endgroup]
2021-07-13T00:14:09.0306695Z ##[group]*** submariner-lighthouse-agent-8bcbc988f-k4ckn ***
2021-07-13T00:14:09.0312436Z ======================= *** submariner-lighthouse-agent-8bcbc988f-k4ckn *** =======================
2021-07-13T00:14:09.0326964Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-8bcbc988f-k4ckn
2021-07-13T00:14:09.0341578Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-8bcbc988f-k4ckn
2021-07-13T00:14:09.0358105Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-agent-8bcbc988f-k4ckn
2021-07-13T00:14:09.3409841Z I0713 00:09:52.202374 1 main.go:70] Arguments: [/usr/local/bin/lighthouse-agent -alsologtostderr -v=2]
2021-07-13T00:14:09.3411475Z I0713 00:09:52.202422 1 main.go:71] AgentSpec: {cluster1 submariner-operator false}
2021-07-13T00:14:09.3412888Z W0713 00:09:52.202511 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:09.3418271Z I0713 00:09:52.349659 1 main.go:98] Starting submariner-lighthouse-agent {cluster1 submariner-operator false}
2021-07-13T00:14:09.3419351Z I0713 00:09:53.309821 1 agent.go:169] Starting Agent controller
2021-07-13T00:14:09.3420002Z I0713 00:09:53.993296 1 agent.go:213] Agent controller started
2021-07-13T00:14:09.3479333Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-25fgx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.3494366Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-25fgx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.3506716Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-25fgx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.6527476Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-coredns-69d78f6d78-25fgx ***
2021-07-13T00:14:09.6540214Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-coredns-69d78f6d78-25fgx ***
2021-07-13T00:14:09.6546093Z ====================================================================
2021-07-13T00:14:09.6548102Z ##[endgroup]
2021-07-13T00:14:09.6552289Z ##[group]*** submariner-lighthouse-coredns-69d78f6d78-25fgx ***
2021-07-13T00:14:09.6554394Z ======================= *** submariner-lighthouse-coredns-69d78f6d78-25fgx *** =======================
2021-07-13T00:14:09.6566173Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-25fgx
2021-07-13T00:14:09.6580905Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-25fgx
2021-07-13T00:14:09.6597703Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-25fgx
2021-07-13T00:14:09.9485401Z W0713 00:10:02.221212 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:09.9486783Z I0713 00:10:02.221432 1 controller.go:65] Starting ServiceImport Controller
2021-07-13T00:14:09.9487667Z I0713 00:10:02.422378 1 controller.go:69] Starting EndpointSlice Controller
2021-07-13T00:14:09.9488541Z I0713 00:10:02.423402 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-13T00:14:09.9489681Z I0713 00:10:02.937974 1 controller.go:97] Starting Gateway status Controller
2021-07-13T00:14:09.9490486Z I0713 00:10:03.138493 1 controller.go:56] Starting Services Controller
2021-07-13T00:14:09.9491119Z clusterset.local.:53
2021-07-13T00:14:09.9491841Z CoreDNS-1.8.3
2021-07-13T00:14:09.9492254Z linux/amd64, go1.16.5,
2021-07-13T00:14:09.9493070Z I0713 00:10:03.139921 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-13T00:14:09.9494136Z I0713 00:10:29.483041 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:09.9561647Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-5sckx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.9591598Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-5sckx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:09.9618460Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-69d78f6d78-5sckx -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:10.3131213Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-coredns-69d78f6d78-5sckx ***
2021-07-13T00:14:10.3147590Z [lighthouse]$ [cluster1] print_section *** submariner-lighthouse-coredns-69d78f6d78-5sckx ***
2021-07-13T00:14:10.3148792Z ====================================================================
2021-07-13T00:14:10.3154644Z ##[endgroup]
2021-07-13T00:14:10.3156220Z ##[group]*** submariner-lighthouse-coredns-69d78f6d78-5sckx ***
2021-07-13T00:14:10.3163550Z ======================= *** submariner-lighthouse-coredns-69d78f6d78-5sckx *** =======================
2021-07-13T00:14:10.3177309Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-5sckx
2021-07-13T00:14:10.3191009Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-5sckx
2021-07-13T00:14:10.3206539Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-69d78f6d78-5sckx
2021-07-13T00:14:10.6334572Z W0713 00:09:54.541053 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:10.6335744Z I0713 00:09:54.545220 1 controller.go:65] Starting ServiceImport Controller
2021-07-13T00:14:10.6336616Z I0713 00:09:54.645590 1 controller.go:69] Starting EndpointSlice Controller
2021-07-13T00:14:10.6337671Z I0713 00:09:54.646651 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-13T00:14:10.6338511Z I0713 00:09:54.741645 1 controller.go:97] Starting Gateway status Controller
2021-07-13T00:14:10.6339320Z I0713 00:09:55.042166 1 controller.go:56] Starting Services Controller
2021-07-13T00:14:10.6340177Z I0713 00:09:55.043428 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-13T00:14:10.6340918Z clusterset.local.:53
2021-07-13T00:14:10.6341607Z CoreDNS-1.8.3
2021-07-13T00:14:10.6342033Z linux/amd64, go1.16.5,
2021-07-13T00:14:10.6342849Z I0713 00:10:29.485405 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:10.6396136Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-56f895dd55-69xqf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:10.6410858Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-56f895dd55-69xqf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:10.6441400Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-operator-56f895dd55-69xqf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:10.9730741Z [lighthouse]$ [cluster1] print_section *** submariner-operator-56f895dd55-69xqf ***
2021-07-13T00:14:10.9743043Z [lighthouse]$ [cluster1] print_section *** submariner-operator-56f895dd55-69xqf ***
2021-07-13T00:14:10.9748575Z ====================================================================
2021-07-13T00:14:10.9753694Z ##[endgroup]
2021-07-13T00:14:10.9759274Z ##[group]*** submariner-operator-56f895dd55-69xqf ***
2021-07-13T00:14:10.9764540Z ======================= *** submariner-operator-56f895dd55-69xqf *** =======================
2021-07-13T00:14:10.9778163Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-56f895dd55-69xqf
2021-07-13T00:14:10.9794043Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-56f895dd55-69xqf
2021-07-13T00:14:10.9812992Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-operator-56f895dd55-69xqf
2021-07-13T00:14:11.3556391Z I0713 00:09:17.763213 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-13T00:14:11.3557622Z I0713 00:09:17.763278 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-13T00:14:11.3558975Z I0713 00:09:17.763286 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-13T00:14:11.3559995Z I0713 00:09:17.763293 1 main.go:80] cmd "msg"="Submariner operator version: devel-a203dc6"
2021-07-13T00:14:11.3560845Z I0713 00:09:17.763447 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-13T00:14:11.3561680Z I0713 00:09:18.171976 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-13T00:14:11.3562808Z I0713 00:09:18.172009 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-13T00:14:11.3564078Z I0713 00:09:18.577430 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-13T00:14:11.3565007Z I0713 00:09:18.577829 1 main.go:129] cmd "msg"="Registering Components."
2021-07-13T00:14:11.3565766Z I0713 00:09:18.578038 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-13T00:14:11.3566724Z I0713 00:09:21.206232 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.3568465Z I0713 00:09:21.206273 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.3569597Z I0713 00:09:21.206322 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-13T00:14:11.3570753Z I0713 00:09:21.206515 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-13T00:14:11.3574091Z I0713 00:09:21.207006 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-13T00:14:11.3577715Z I0713 00:09:21.207363 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-13T00:14:11.3581355Z I0713 00:09:21.207557 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-13T00:14:11.3588111Z I0713 00:09:21.208364 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-13T00:14:11.3596714Z I0713 00:09:21.208788 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-13T00:14:11.3602233Z I0713 00:09:21.307409 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-13T00:14:11.3604884Z I0713 00:09:21.307460 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-13T00:14:11.3607067Z I0713 00:09:21.308639 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3609032Z I0713 00:09:21.308661 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-13T00:14:11.3612406Z I0713 00:09:21.310642 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-13T00:14:11.3616311Z I0713 00:09:21.311093 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-13T00:14:11.3619774Z I0713 00:09:21.311144 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-13T00:14:11.3623629Z I0713 00:09:21.411250 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-13T00:14:11.3626697Z I0713 00:09:21.411381 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-13T00:14:11.3628622Z I0713 00:09:21.411741 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-13T00:14:11.3631246Z E0713 00:09:21.481821 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3633751Z I0713 00:09:21.515761 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-13T00:14:11.3635785Z I0713 00:09:21.515947 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-13T00:14:11.3639488Z I0713 00:09:21.516080 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-13T00:14:11.3641299Z I0713 00:09:21.516170 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-13T00:14:11.3643917Z E0713 00:09:21.527911 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3716100Z E0713 00:09:21.583484 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3719609Z E0713 00:09:21.640317 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3722827Z E0713 00:09:21.797560 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3725998Z E0713 00:09:22.038327 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3728564Z I0713 00:09:22.089744 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.3730831Z I0713 00:09:22.090060 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.3732316Z I0713 00:09:22.181144 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-13T00:14:11.3733936Z I0713 00:09:22.181355 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-13T00:14:11.3735445Z I0713 00:09:22.181462 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.3736723Z I0713 00:09:22.181556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.3738073Z I0713 00:09:22.191073 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-13T00:14:11.3739724Z I0713 00:09:22.191211 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-13T00:14:11.3741063Z I0713 00:09:22.191304 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.3757792Z I0713 00:09:22.191375 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.3760483Z I0713 00:09:22.213206 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.3764150Z E0713 00:09:22.290965 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-13T00:14:11.3767299Z I0713 00:09:22.291324 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.3769031Z I0713 00:09:22.297750 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.3770285Z I0713 00:09:22.297854 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.3772650Z I0713 00:09:22.346568 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.3776395Z E0713 00:09:22.346787 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-13T00:14:11.3787019Z I0713 00:09:22.367428 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.3829176Z I0713 00:09:22.367639 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.3830451Z I0713 00:09:22.368622 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.3832968Z I0713 00:09:22.382344 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.3836221Z I0713 00:09:22.403577 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.3856860Z I0713 00:09:22.405062 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.3859917Z I0713 00:09:22.500308 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.3863088Z E0713 00:09:22.540217 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.3866495Z I0713 00:09:22.808522 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.3869612Z I0713 00:09:22.823453 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4048098Z I0713 00:09:22.847509 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4051554Z I0713 00:09:22.848189 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4056645Z I0713 00:09:22.913314 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4059710Z I0713 00:09:22.952284 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4062246Z I0713 00:09:23.135541 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4063788Z I0713 00:09:23.135591 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4065054Z I0713 00:09:23.135603 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4067612Z I0713 00:09:23.218485 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4070800Z I0713 00:09:23.229694 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-13T00:14:11.4073737Z I0713 00:09:23.686476 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4086084Z E0713 00:09:23.741609 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-13T00:14:11.4089875Z I0713 00:09:23.741661 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4093122Z E0713 00:09:23.798560 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4096244Z I0713 00:09:23.798640 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4097786Z I0713 00:09:23.798674 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4099043Z I0713 00:09:23.798684 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4101355Z I0713 00:09:23.931479 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4104839Z I0713 00:09:23.933527 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4108150Z I0713 00:09:24.271168 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4111563Z I0713 00:09:24.271487 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4115040Z I0713 00:09:24.680334 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4119039Z I0713 00:09:24.680890 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4122314Z I0713 00:09:24.825719 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4125597Z I0713 00:09:25.082703 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-13T00:14:11.4133388Z I0713 00:09:25.083075 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4136562Z I0713 00:09:25.295285 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4140573Z E0713 00:09:25.321804 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-13T00:14:11.4144284Z I0713 00:09:25.321872 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4147438Z I0713 00:09:25.368252 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4150211Z I0713 00:09:25.504534 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4151746Z I0713 00:09:25.504596 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4153563Z I0713 00:09:25.504608 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4156319Z I0713 00:09:25.632321 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4159978Z E0713 00:09:25.636744 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4163040Z I0713 00:09:25.638695 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4166087Z I0713 00:09:25.639099 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4169569Z E0713 00:09:25.711290 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4172385Z I0713 00:09:25.711343 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4173932Z I0713 00:09:25.711385 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4198756Z I0713 00:09:25.711397 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4202856Z I0713 00:09:25.784112 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4206435Z I0713 00:09:25.784431 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4209747Z I0713 00:09:25.936848 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4215211Z I0713 00:09:26.188163 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4218668Z I0713 00:09:26.216855 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4221976Z I0713 00:09:26.338311 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4225261Z I0713 00:09:26.644019 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4228342Z I0713 00:09:26.743316 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4231581Z I0713 00:09:27.039667 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4234951Z I0713 00:09:27.093342 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4242063Z I0713 00:09:27.367451 1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4246342Z I0713 00:09:27.367487 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n"
2021-07-13T00:14:11.4252810Z I0713 00:09:27.376562 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4256898Z I0713 00:09:27.648886 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4258453Z I0713 00:09:27.648946 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4259709Z I0713 00:09:27.648958 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4262036Z I0713 00:09:27.778745 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4267245Z I0713 00:09:28.259579 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4271477Z I0713 00:09:28.306040 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4275198Z I0713 00:09:28.325764 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4280644Z I0713 00:09:28.689482 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4284807Z I0713 00:09:28.929709 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4288858Z I0713 00:09:28.929766 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n"
2021-07-13T00:14:11.4292718Z I0713 00:09:28.947936 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4295534Z I0713 00:09:28.990876 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4298446Z E0713 00:09:29.140590 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4302178Z I0713 00:09:29.259504 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4306972Z I0713 00:09:29.306822 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4310330Z I0713 00:09:29.384713 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4315787Z I0713 00:09:29.419558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4319204Z I0713 00:09:29.710152 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4322609Z I0713 00:09:29.724006 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4326504Z I0713 00:09:29.733864 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4329965Z I0713 00:09:30.156485 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4332936Z I0713 00:09:30.206259 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4336936Z I0713 00:09:30.206316 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n"
2021-07-13T00:14:11.4341289Z E0713 00:09:30.888464 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4344462Z E0713 00:09:33.759300 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4347762Z E0713 00:09:40.236519 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4351261Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-6rpj8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:11.4353439Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-6rpj8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:11.4356478Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-6rpj8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:11.4359214Z I0713 00:09:46.030024 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4360754Z I0713 00:09:46.030206 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4362017Z I0713 00:09:46.030221 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4364328Z I0713 00:09:46.086759 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4367357Z I0713 00:09:46.127161 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4370602Z I0713 00:09:46.536460 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4374704Z I0713 00:09:46.557946 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4377248Z I0713 00:09:46.714333 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4379297Z I0713 00:09:46.714373 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4380572Z I0713 00:09:46.714383 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4382455Z I0713 00:09:46.714884 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4383991Z I0713 00:09:46.714919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4385249Z I0713 00:09:46.714934 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4387542Z I0713 00:09:46.779716 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4391278Z I0713 00:09:46.794379 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4394391Z I0713 00:09:46.946901 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4400104Z I0713 00:09:46.995035 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4403172Z I0713 00:09:47.353361 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4406111Z I0713 00:09:47.396770 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4409200Z I0713 00:09:47.460342 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4412240Z I0713 00:09:47.467116 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4414992Z I0713 00:09:47.936394 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4416527Z I0713 00:09:47.936439 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4417780Z I0713 00:09:47.936450 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4420089Z I0713 00:09:48.064097 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4423126Z I0713 00:09:48.134860 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4426139Z I0713 00:09:48.536442 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4429129Z I0713 00:09:48.548044 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4431661Z I0713 00:09:48.580418 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4433180Z I0713 00:09:48.580473 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4434545Z I0713 00:09:48.580483 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4437227Z I0713 00:09:48.635398 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4440331Z I0713 00:09:48.666934 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4442880Z I0713 00:09:48.667465 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4444430Z I0713 00:09:48.667503 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4445676Z I0713 00:09:48.667513 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4448410Z I0713 00:09:48.764925 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4451575Z I0713 00:09:48.856358 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4455858Z I0713 00:09:49.078511 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4459372Z I0713 00:09:49.217088 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4463076Z I0713 00:09:49.269843 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4466061Z I0713 00:09:49.472646 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4469181Z I0713 00:09:49.621556 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4470723Z I0713 00:09:49.621720 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4471979Z I0713 00:09:49.621734 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4473797Z I0713 00:09:49.694099 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4475569Z I0713 00:09:49.694145 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4477792Z I0713 00:09:49.694189 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4480253Z I0713 00:09:49.866126 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4483241Z I0713 00:09:49.866182 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4486859Z I0713 00:09:50.001137 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4490639Z I0713 00:09:50.279501 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4493657Z I0713 00:09:50.482385 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4497191Z I0713 00:09:50.593002 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4500512Z I0713 00:09:50.758791 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4503505Z I0713 00:09:50.928372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4506389Z I0713 00:09:51.605907 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4509482Z I0713 00:09:51.712196 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4513571Z I0713 00:09:51.819965 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4518005Z E0713 00:09:52.123708 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4521953Z I0713 00:09:52.254109 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4526122Z I0713 00:09:52.564075 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4530342Z I0713 00:09:52.755618 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4533801Z I0713 00:09:53.222063 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4536375Z I0713 00:09:53.502578 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4543748Z I0713 00:09:53.502696 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4545044Z I0713 00:09:53.502750 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4547457Z I0713 00:09:53.618261 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4551501Z I0713 00:09:53.618370 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n"
2021-07-13T00:14:11.4555614Z I0713 00:09:53.833922 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4559448Z I0713 00:09:54.082091 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4562333Z I0713 00:09:54.243798 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4565764Z I0713 00:09:54.248417 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4569364Z I0713 00:09:54.435722 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4572665Z I0713 00:09:54.733898 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4576407Z I0713 00:09:54.836591 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4580043Z I0713 00:09:54.918720 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4582732Z I0713 00:09:55.183665 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4584272Z I0713 00:09:55.183736 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4585532Z I0713 00:09:55.183753 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4588175Z I0713 00:09:55.233534 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4591584Z I0713 00:09:55.253890 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4593133Z I0713 00:09:55.253944 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4594384Z I0713 00:09:55.254059 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4597099Z I0713 00:09:55.387281 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4600198Z I0713 00:09:55.388410 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4603868Z I0713 00:09:55.445091 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4607275Z I0713 00:09:55.504524 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4610368Z I0713 00:09:55.504792 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4620283Z I0713 00:09:55.847980 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4623301Z I0713 00:09:55.896445 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4627549Z I0713 00:09:55.896512 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n"
2021-07-13T00:14:11.4631403Z I0713 00:09:55.907657 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4634329Z I0713 00:09:55.907721 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4637492Z I0713 00:09:56.675652 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4640637Z I0713 00:09:56.680493 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4643168Z I0713 00:10:00.071768 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4644840Z I0713 00:10:00.071883 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4646107Z I0713 00:10:00.071940 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4648447Z I0713 00:10:00.402228 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4651491Z I0713 00:10:00.530574 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4666130Z I0713 00:10:00.935928 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4670294Z I0713 00:10:01.113711 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4673378Z I0713 00:10:02.861237 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4674919Z I0713 00:10:02.861280 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4676182Z I0713 00:10:02.861290 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4679401Z I0713 00:10:02.861684 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4680968Z I0713 00:10:02.861707 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4682217Z I0713 00:10:02.861717 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4685024Z I0713 00:10:02.953569 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4688482Z I0713 00:10:02.958609 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4692057Z I0713 00:10:03.162905 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4695936Z I0713 00:10:03.166775 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4698961Z I0713 00:10:03.577451 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4702595Z I0713 00:10:03.578330 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4706475Z I0713 00:10:03.615401 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4710247Z I0713 00:10:03.713634 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4713856Z I0713 00:10:03.766994 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4719659Z I0713 00:10:03.914958 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4723438Z I0713 00:10:04.026694 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4726871Z I0713 00:10:04.462349 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4730850Z I0713 00:10:04.493828 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-13T00:14:11.4734670Z I0713 00:10:04.535616 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4738518Z I0713 00:10:04.937889 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4742610Z I0713 00:10:04.972710 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4747715Z I0713 00:10:04.972959 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.63.169\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n"
2021-07-13T00:14:11.4751564Z I0713 00:10:08.492034 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4753351Z I0713 00:10:08.492095 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4754625Z I0713 00:10:08.492106 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4759440Z I0713 00:10:08.526253 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4763663Z I0713 00:10:08.547195 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4767046Z I0713 00:10:08.949391 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4770787Z I0713 00:10:08.970900 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4773808Z I0713 00:10:08.987273 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4776087Z I0713 00:10:08.987315 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4777357Z I0713 00:10:08.987325 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4780087Z I0713 00:10:08.994527 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4782107Z I0713 00:10:08.994566 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4783376Z I0713 00:10:08.994575 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4786412Z I0713 00:10:09.018812 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4790354Z I0713 00:10:09.073702 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4795129Z I0713 00:10:09.075958 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4799315Z I0713 00:10:09.224565 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4802751Z I0713 00:10:09.477252 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4807043Z I0713 00:10:09.499458 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4811109Z I0713 00:10:09.627919 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4814896Z I0713 00:10:09.638583 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4819169Z E0713 00:10:12.754575 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.4824171Z I0713 00:10:29.478459 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4825724Z I0713 00:10:29.478572 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4826995Z I0713 00:10:29.478633 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4830091Z I0713 00:10:29.562105 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4834495Z I0713 00:10:29.601090 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4838701Z I0713 00:10:30.003539 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4842335Z I0713 00:10:30.007177 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4845426Z I0713 00:10:30.030598 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4848451Z I0713 00:10:30.031643 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4850709Z I0713 00:10:30.031988 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4852358Z I0713 00:10:30.032059 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4853664Z I0713 00:10:30.032277 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4855672Z I0713 00:10:30.032330 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4860533Z I0713 00:10:30.055517 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4865122Z I0713 00:10:30.056321 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4870060Z I0713 00:10:30.081703 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4873713Z I0713 00:10:30.082269 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4878436Z I0713 00:10:30.484763 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4882901Z I0713 00:10:30.492113 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4886626Z I0713 00:10:30.492816 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4893000Z I0713 00:10:30.506122 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4897757Z I0713 00:10:34.589319 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4901187Z I0713 00:10:34.589379 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4902481Z I0713 00:10:34.589389 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4906671Z I0713 00:10:34.638495 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4909938Z I0713 00:10:34.652796 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4912969Z I0713 00:10:35.054216 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4915970Z I0713 00:10:35.061508 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4918931Z I0713 00:10:35.073520 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4920484Z I0713 00:10:35.073772 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4923923Z I0713 00:10:35.073963 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4927548Z I0713 00:10:35.073928 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4931697Z I0713 00:10:35.074703 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4934601Z I0713 00:10:35.074802 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4937134Z I0713 00:10:35.082227 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4944933Z I0713 00:10:35.087771 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4961384Z I0713 00:10:35.100749 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4968071Z I0713 00:10:35.106792 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4971196Z I0713 00:10:35.489621 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4974199Z I0713 00:10:35.493611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4977203Z I0713 00:10:35.508740 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4980218Z I0713 00:10:35.512251 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4982763Z I0713 00:10:39.656684 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.4984302Z I0713 00:10:39.656759 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.4985576Z I0713 00:10:39.656771 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.4988075Z I0713 00:10:39.684611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.4991145Z I0713 00:10:39.708690 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.4994230Z I0713 00:10:40.110635 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.4997539Z I0713 00:10:40.117911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5001493Z I0713 00:10:40.133120 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5003075Z I0713 00:10:40.133189 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5011672Z I0713 00:10:40.133200 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5013762Z I0713 00:10:40.134634 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5078306Z I0713 00:10:40.134677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5080179Z I0713 00:10:40.134687 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5082974Z I0713 00:10:40.156164 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5085976Z I0713 00:10:40.156316 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5089023Z I0713 00:10:40.170013 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5092122Z I0713 00:10:40.170710 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5095146Z I0713 00:10:40.575226 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5098093Z I0713 00:10:40.577928 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5101281Z I0713 00:10:40.578950 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5104346Z I0713 00:10:40.583644 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5106892Z I0713 00:10:44.711339 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5108437Z I0713 00:10:44.711412 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5109690Z I0713 00:10:44.711424 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5112009Z I0713 00:10:44.750027 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5115049Z I0713 00:10:44.764529 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5119018Z I0713 00:10:45.166431 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5122111Z I0713 00:10:45.169895 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5124771Z I0713 00:10:45.179846 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5126315Z I0713 00:10:45.180032 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5127580Z I0713 00:10:45.180056 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5129448Z I0713 00:10:45.180249 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5130976Z I0713 00:10:45.180406 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5132245Z I0713 00:10:45.180487 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5134549Z I0713 00:10:45.192327 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5137590Z I0713 00:10:45.193556 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5140646Z I0713 00:10:45.199313 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5143885Z I0713 00:10:45.213626 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5146905Z I0713 00:10:45.601426 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5149887Z I0713 00:10:45.605223 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5152887Z I0713 00:10:45.616138 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5155875Z I0713 00:10:45.624416 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5163208Z I0713 00:10:49.762350 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5164767Z I0713 00:10:49.762434 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5166035Z I0713 00:10:49.762516 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5168536Z I0713 00:10:49.785076 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5171673Z I0713 00:10:49.794861 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5174712Z I0713 00:10:50.196195 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5177707Z I0713 00:10:50.199038 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5180479Z I0713 00:10:50.206150 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5182020Z I0713 00:10:50.206192 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5183265Z I0713 00:10:50.206212 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5185086Z I0713 00:10:50.206307 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5186757Z I0713 00:10:50.206420 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5188013Z I0713 00:10:50.206516 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5191635Z I0713 00:10:50.219276 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5198362Z I0713 00:10:50.221962 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5201495Z I0713 00:10:50.243966 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5204577Z I0713 00:10:50.250577 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5207605Z I0713 00:10:50.645867 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5210591Z I0713 00:10:50.648988 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5213830Z I0713 00:10:50.652537 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5216905Z I0713 00:10:50.660925 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5220019Z E0713 00:10:53.828866 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.5222616Z I0713 00:10:54.803994 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5224159Z I0713 00:10:54.804067 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5225434Z I0713 00:10:54.804080 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5227730Z I0713 00:10:54.812004 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5230767Z I0713 00:10:54.814979 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5233983Z I0713 00:10:55.217048 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5237976Z I0713 00:10:55.220443 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5240698Z I0713 00:10:55.230835 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5242242Z I0713 00:10:55.231018 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5243519Z I0713 00:10:55.231031 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5245338Z I0713 00:10:55.231261 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5246870Z I0713 00:10:55.231301 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5248135Z I0713 00:10:55.231311 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5250416Z I0713 00:10:55.248536 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5255679Z I0713 00:10:55.249472 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5258808Z I0713 00:10:55.254361 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5263065Z I0713 00:10:55.266263 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5266147Z I0713 00:10:55.655949 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5269146Z I0713 00:10:55.660063 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5272149Z I0713 00:10:55.669223 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5275207Z I0713 00:10:55.678901 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5278231Z I0713 00:10:59.820219 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5279935Z I0713 00:10:59.820340 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5295353Z I0713 00:10:59.820353 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5298239Z I0713 00:10:59.827051 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5301562Z I0713 00:10:59.831625 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5304828Z I0713 00:11:00.234408 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5307981Z I0713 00:11:00.239383 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5310812Z I0713 00:11:00.247917 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5312511Z I0713 00:11:00.247978 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5314060Z I0713 00:11:00.247995 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5316149Z I0713 00:11:00.249351 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5318893Z I0713 00:11:00.249411 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5320428Z I0713 00:11:00.249422 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5323433Z I0713 00:11:00.265139 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5326622Z I0713 00:11:00.275154 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5329743Z I0713 00:11:00.276424 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5338869Z I0713 00:11:00.289861 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5342576Z I0713 00:11:00.676673 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5345699Z I0713 00:11:00.680226 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5348813Z I0713 00:11:00.691937 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5351941Z I0713 00:11:00.694675 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5354680Z I0713 00:11:04.836407 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5376614Z I0713 00:11:04.836473 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5377923Z I0713 00:11:04.836485 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5380480Z I0713 00:11:04.841590 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5383791Z I0713 00:11:04.846390 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5386953Z I0713 00:11:05.248548 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5390737Z I0713 00:11:05.251969 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5393470Z I0713 00:11:05.258178 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5395081Z I0713 00:11:05.259040 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5396341Z I0713 00:11:05.259107 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5398443Z I0713 00:11:05.260139 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5401740Z I0713 00:11:05.260231 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5403031Z I0713 00:11:05.260737 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5407319Z I0713 00:11:05.265330 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5410514Z I0713 00:11:05.265708 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5413596Z I0713 00:11:05.269325 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5416772Z I0713 00:11:05.270654 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5419848Z I0713 00:11:05.672265 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5422816Z I0713 00:11:05.672344 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5426271Z I0713 00:11:05.678958 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5429791Z I0713 00:11:05.679131 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5432437Z I0713 00:11:09.857207 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5434011Z I0713 00:11:09.857279 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5435280Z I0713 00:11:09.857295 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5442614Z I0713 00:11:09.862292 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5445899Z I0713 00:11:09.865423 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5448987Z I0713 00:11:10.267413 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5451999Z I0713 00:11:10.271583 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5454800Z I0713 00:11:10.281389 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5456336Z I0713 00:11:10.281438 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5457598Z I0713 00:11:10.281449 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5459423Z I0713 00:11:10.281813 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5460953Z I0713 00:11:10.281853 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5463374Z I0713 00:11:10.281863 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5465847Z I0713 00:11:10.286117 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5468873Z I0713 00:11:10.286556 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5471909Z I0713 00:11:10.290135 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5475032Z I0713 00:11:10.291409 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5481137Z I0713 00:11:10.692554 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5484264Z I0713 00:11:10.692554 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5487266Z I0713 00:11:10.696477 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5490396Z I0713 00:11:10.699651 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5492932Z I0713 00:11:14.920819 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5494463Z I0713 00:11:14.920881 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5495714Z I0713 00:11:14.920911 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5498189Z I0713 00:11:14.951369 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5502786Z I0713 00:11:14.960534 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5506000Z I0713 00:11:15.362735 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5509036Z I0713 00:11:15.366074 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5511605Z I0713 00:11:15.372677 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5513143Z I0713 00:11:15.372749 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5514425Z I0713 00:11:15.372769 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5516284Z I0713 00:11:15.374622 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5518000Z I0713 00:11:15.374705 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5519289Z I0713 00:11:15.374722 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5521830Z I0713 00:11:15.377403 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5525602Z I0713 00:11:15.379092 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5528973Z I0713 00:11:15.380944 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5532154Z I0713 00:11:15.384776 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5535258Z I0713 00:11:15.783177 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5538310Z I0713 00:11:15.786964 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5541912Z I0713 00:11:15.790762 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5545184Z I0713 00:11:15.795796 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5547775Z I0713 00:11:19.965507 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5549340Z I0713 00:11:19.965576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5550637Z I0713 00:11:19.965788 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5552990Z I0713 00:11:19.969529 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5556079Z I0713 00:11:19.972870 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5559337Z I0713 00:11:20.374681 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5562654Z I0713 00:11:20.377715 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5566218Z I0713 00:11:20.386610 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5567808Z I0713 00:11:20.386681 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5569086Z I0713 00:11:20.386707 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5571006Z I0713 00:11:20.387524 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5572575Z I0713 00:11:20.387562 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5573854Z I0713 00:11:20.387576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5576229Z I0713 00:11:20.392179 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5579273Z I0713 00:11:20.393276 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5582914Z I0713 00:11:20.397319 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5586356Z I0713 00:11:20.398677 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5589435Z I0713 00:11:20.799085 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5592430Z I0713 00:11:20.799616 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5595505Z I0713 00:11:20.803406 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5598826Z I0713 00:11:20.810956 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5601416Z I0713 00:11:24.976274 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5602960Z I0713 00:11:24.976331 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5604229Z I0713 00:11:24.976449 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5606671Z I0713 00:11:24.981010 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5609867Z I0713 00:11:24.983938 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5612927Z I0713 00:11:25.388110 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5615969Z I0713 00:11:25.391086 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5618521Z I0713 00:11:25.398404 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5620068Z I0713 00:11:25.398475 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5621340Z I0713 00:11:25.398497 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5623176Z I0713 00:11:25.398894 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5624861Z I0713 00:11:25.398933 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5626138Z I0713 00:11:25.398943 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5628501Z I0713 00:11:25.404174 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5631522Z I0713 00:11:25.405616 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5634591Z I0713 00:11:25.407736 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5637833Z I0713 00:11:25.408963 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5640944Z I0713 00:11:25.809776 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5643926Z I0713 00:11:25.812303 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5647079Z I0713 00:11:25.815612 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5650247Z I0713 00:11:25.815964 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5652848Z I0713 00:11:29.987155 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5654421Z I0713 00:11:29.987211 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5655693Z I0713 00:11:29.987221 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5658034Z I0713 00:11:29.994159 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5661105Z I0713 00:11:29.998800 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5664966Z I0713 00:11:30.400265 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5669115Z I0713 00:11:30.403754 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5671686Z I0713 00:11:30.409168 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5673264Z I0713 00:11:30.409227 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5674548Z I0713 00:11:30.409239 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5676390Z I0713 00:11:30.411233 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5679103Z I0713 00:11:30.411268 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5680395Z I0713 00:11:30.411278 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5682795Z I0713 00:11:30.416889 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5685774Z I0713 00:11:30.417372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5688964Z I0713 00:11:30.426045 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5692109Z I0713 00:11:30.445601 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5695136Z I0713 00:11:30.827288 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5698138Z I0713 00:11:30.831043 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5701178Z I0713 00:11:30.848260 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5704784Z I0713 00:11:30.852139 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5707346Z I0713 00:11:35.001013 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5709054Z I0713 00:11:35.001067 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5710310Z I0713 00:11:35.001078 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5712655Z I0713 00:11:35.007399 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5715665Z I0713 00:11:35.011257 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5719105Z I0713 00:11:35.413124 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5722105Z I0713 00:11:35.417123 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5724643Z I0713 00:11:35.426347 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5726163Z I0713 00:11:35.426521 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5727477Z I0713 00:11:35.426652 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5729307Z I0713 00:11:35.427130 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5730976Z I0713 00:11:35.427262 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5732254Z I0713 00:11:35.427374 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5751244Z I0713 00:11:35.434238 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5754688Z I0713 00:11:35.440367 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5757991Z I0713 00:11:35.458603 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5761095Z I0713 00:11:35.461807 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5764126Z I0713 00:11:35.841785 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5768004Z I0713 00:11:35.844748 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5771030Z I0713 00:11:35.862927 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5773993Z I0713 00:11:35.866346 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5776535Z I0713 00:11:40.024107 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5778083Z I0713 00:11:40.024245 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5779339Z I0713 00:11:40.024265 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5781687Z I0713 00:11:40.033283 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5784728Z I0713 00:11:40.040967 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5787898Z I0713 00:11:40.442569 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5790961Z I0713 00:11:40.445259 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5793494Z I0713 00:11:40.452440 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5795017Z I0713 00:11:40.452479 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5796292Z I0713 00:11:40.452489 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5798561Z I0713 00:11:40.452832 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5800128Z I0713 00:11:40.452867 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5801389Z I0713 00:11:40.452877 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5803725Z I0713 00:11:40.455977 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5806886Z I0713 00:11:40.457167 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5809934Z I0713 00:11:40.460409 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5813021Z I0713 00:11:40.460702 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5816035Z I0713 00:11:40.865531 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5818986Z I0713 00:11:40.866670 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5821984Z I0713 00:11:40.870612 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5826587Z I0713 00:11:40.871153 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5829284Z I0713 00:11:45.040408 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5830973Z I0713 00:11:45.040460 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5832249Z I0713 00:11:45.040470 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5834601Z I0713 00:11:45.044238 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5837804Z I0713 00:11:45.047526 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5840887Z I0713 00:11:45.448761 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5843871Z I0713 00:11:45.452027 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5846404Z I0713 00:11:45.463523 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5847943Z I0713 00:11:45.463565 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5849322Z I0713 00:11:45.463576 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5851182Z I0713 00:11:45.470909 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5852707Z I0713 00:11:45.470973 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5853967Z I0713 00:11:45.471000 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5856276Z I0713 00:11:45.478394 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5859296Z I0713 00:11:45.482596 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5862345Z I0713 00:11:45.494852 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5867104Z I0713 00:11:45.514942 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5870287Z I0713 00:11:45.896692 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5873425Z I0713 00:11:45.902926 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5876560Z I0713 00:11:45.920067 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5879925Z I0713 00:11:45.923828 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5882463Z I0713 00:11:50.067768 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5884004Z I0713 00:11:50.067823 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5885268Z I0713 00:11:50.067833 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5887570Z I0713 00:11:50.075011 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5890788Z I0713 00:11:50.080083 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5894036Z I0713 00:11:50.481258 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5897015Z I0713 00:11:50.484562 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5899556Z I0713 00:11:50.490494 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5901095Z I0713 00:11:50.490541 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5902353Z I0713 00:11:50.490553 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5904183Z I0713 00:11:50.491980 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5905721Z I0713 00:11:50.492035 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5906971Z I0713 00:11:50.492053 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5909279Z I0713 00:11:50.496160 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5912389Z I0713 00:11:50.496738 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5915465Z I0713 00:11:50.500420 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5918755Z I0713 00:11:50.501783 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5921821Z I0713 00:11:50.902411 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5924760Z I0713 00:11:50.903830 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5927761Z I0713 00:11:50.906748 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5930826Z I0713 00:11:50.907214 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5934939Z I0713 00:11:55.086976 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5936489Z I0713 00:11:55.087094 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5937750Z I0713 00:11:55.087195 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5940059Z I0713 00:11:55.100774 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5943093Z I0713 00:11:55.107632 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5946108Z I0713 00:11:55.509664 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5949178Z I0713 00:11:55.512942 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5951713Z I0713 00:11:55.521165 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5953243Z I0713 00:11:55.521216 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5954660Z I0713 00:11:55.521227 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5956534Z I0713 00:11:55.522010 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5958213Z I0713 00:11:55.522052 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5959471Z I0713 00:11:55.522068 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5961796Z I0713 00:11:55.531318 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5964781Z I0713 00:11:55.531793 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5968511Z I0713 00:11:55.536261 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5971627Z I0713 00:11:55.537632 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5974866Z I0713 00:11:55.938849 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5977816Z I0713 00:11:55.939190 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.5980803Z I0713 00:11:55.943230 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5983843Z I0713 00:11:55.943973 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5986386Z I0713 00:12:00.114326 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.5987920Z I0713 00:12:00.114381 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.5989163Z I0713 00:12:00.114391 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.5991464Z I0713 00:12:00.121619 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.5994636Z I0713 00:12:00.131026 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.5997988Z I0713 00:12:00.533536 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6001060Z I0713 00:12:00.537553 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6003591Z I0713 00:12:00.545977 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6005120Z I0713 00:12:00.546058 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6006387Z I0713 00:12:00.546072 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6008207Z I0713 00:12:00.552935 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6009727Z I0713 00:12:00.553140 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6010989Z I0713 00:12:00.553314 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6013474Z I0713 00:12:00.554567 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6016501Z I0713 00:12:00.559368 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6019591Z I0713 00:12:00.560654 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6022630Z I0713 00:12:00.574289 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6025656Z I0713 00:12:00.961881 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6028658Z I0713 00:12:00.964922 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6031658Z I0713 00:12:00.976685 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6034790Z I0713 00:12:00.980447 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6037712Z I0713 00:12:05.130552 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6039276Z I0713 00:12:05.130622 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6040541Z I0713 00:12:05.130633 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6042905Z I0713 00:12:05.135314 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6045964Z I0713 00:12:05.138902 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6048978Z I0713 00:12:05.540962 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6051950Z I0713 00:12:05.543945 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6054664Z I0713 00:12:05.551554 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6056202Z I0713 00:12:05.551662 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6057447Z I0713 00:12:05.551768 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6059269Z I0713 00:12:05.552101 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6060803Z I0713 00:12:05.552151 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6062051Z I0713 00:12:05.552168 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6064351Z I0713 00:12:05.557308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6067911Z I0713 00:12:05.558074 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6071523Z I0713 00:12:05.561362 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6074644Z I0713 00:12:05.563931 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6077989Z I0713 00:12:05.963162 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6081045Z I0713 00:12:05.965495 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6084502Z I0713 00:12:05.967457 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6087658Z I0713 00:12:05.969649 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6090253Z I0713 00:12:10.146360 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6091812Z I0713 00:12:10.146410 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6093078Z I0713 00:12:10.146420 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6095589Z I0713 00:12:10.151255 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6098668Z I0713 00:12:10.157583 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6101714Z I0713 00:12:10.559572 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6104710Z I0713 00:12:10.563354 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6107318Z I0713 00:12:10.570634 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6108851Z I0713 00:12:10.570694 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6110150Z I0713 00:12:10.570713 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6112029Z I0713 00:12:10.572129 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6113564Z I0713 00:12:10.572210 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6114849Z I0713 00:12:10.572260 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6118201Z I0713 00:12:10.576319 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6121328Z I0713 00:12:10.577958 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6124391Z I0713 00:12:10.580029 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6127548Z I0713 00:12:10.582601 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6130615Z I0713 00:12:10.988171 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6133583Z I0713 00:12:10.988266 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6136777Z I0713 00:12:10.992906 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6139838Z I0713 00:12:10.997404 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6142421Z I0713 00:12:15.158697 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6143967Z I0713 00:12:15.158751 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6145230Z I0713 00:12:15.158761 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6147579Z I0713 00:12:15.164080 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6150638Z I0713 00:12:15.167605 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6153689Z I0713 00:12:15.569480 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6157845Z I0713 00:12:15.572429 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6160704Z I0713 00:12:15.584856 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6162305Z I0713 00:12:15.585037 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6163616Z I0713 00:12:15.585183 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6165512Z I0713 00:12:15.585093 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6167050Z I0713 00:12:15.585441 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6168317Z I0713 00:12:15.585488 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6171352Z I0713 00:12:15.589269 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6174387Z I0713 00:12:15.589457 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6177478Z I0713 00:12:15.592166 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6181866Z I0713 00:12:15.593255 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6185083Z E0713 00:12:15.857423 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:11.6188202Z I0713 00:12:15.993822 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6191377Z I0713 00:12:15.995824 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6194427Z I0713 00:12:15.999484 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6197698Z I0713 00:12:15.999616 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6200285Z I0713 00:12:20.176359 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6201953Z I0713 00:12:20.176459 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6203280Z I0713 00:12:20.176471 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6205706Z I0713 00:12:20.187089 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6208923Z I0713 00:12:20.192809 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6213201Z I0713 00:12:20.594529 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6216242Z I0713 00:12:20.597748 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6219826Z I0713 00:12:20.604461 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6221746Z I0713 00:12:20.604511 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6224131Z I0713 00:12:20.605956 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6225702Z I0713 00:12:20.604522 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6227189Z I0713 00:12:20.606572 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6228492Z I0713 00:12:20.606593 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6230905Z I0713 00:12:20.610225 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6234057Z I0713 00:12:20.612024 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6237311Z I0713 00:12:20.614061 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6240584Z I0713 00:12:20.625443 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6243677Z I0713 00:12:21.016204 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6246879Z I0713 00:12:21.020479 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6250023Z I0713 00:12:21.026743 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6253053Z I0713 00:12:21.029461 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6255673Z I0713 00:12:25.198364 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6261309Z I0713 00:12:25.198421 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6262627Z I0713 00:12:25.198432 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6265093Z I0713 00:12:25.215638 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6268146Z I0713 00:12:25.220733 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6272443Z I0713 00:12:25.623586 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6275459Z I0713 00:12:25.630663 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6278250Z I0713 00:12:25.638019 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6279779Z I0713 00:12:25.638216 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6281054Z I0713 00:12:25.638266 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6282874Z I0713 00:12:25.640144 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6284390Z I0713 00:12:25.640186 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6285788Z I0713 00:12:25.640201 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6288115Z I0713 00:12:25.642911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6291300Z I0713 00:12:25.646094 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6294405Z I0713 00:12:25.648086 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6297497Z I0713 00:12:25.660128 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6300520Z I0713 00:12:26.049821 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6303626Z I0713 00:12:26.054582 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6306724Z I0713 00:12:26.062659 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6309726Z I0713 00:12:26.072140 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6312454Z I0713 00:12:30.225425 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6313996Z I0713 00:12:30.225493 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6316189Z I0713 00:12:30.225505 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6318815Z I0713 00:12:30.230290 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6321918Z I0713 00:12:30.240344 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6324958Z I0713 00:12:30.641747 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6328004Z I0713 00:12:30.644788 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6330596Z I0713 00:12:30.652138 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6332153Z I0713 00:12:30.652183 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6333578Z I0713 00:12:30.652196 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6335500Z I0713 00:12:30.656001 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6337029Z I0713 00:12:30.656048 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6338312Z I0713 00:12:30.656122 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6340634Z I0713 00:12:30.659011 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6344173Z I0713 00:12:30.663014 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6347236Z I0713 00:12:30.664082 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6350319Z I0713 00:12:30.672584 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6353529Z I0713 00:12:31.065303 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6356538Z I0713 00:12:31.068796 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6359730Z I0713 00:12:31.073801 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6362724Z I0713 00:12:31.077160 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6365263Z I0713 00:12:35.242532 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6366798Z I0713 00:12:35.242587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6368065Z I0713 00:12:35.242599 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6370885Z I0713 00:12:35.248048 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6374223Z I0713 00:12:35.251258 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6377380Z I0713 00:12:35.652460 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6380366Z I0713 00:12:35.655384 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6382899Z I0713 00:12:35.663452 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6384447Z I0713 00:12:35.663511 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6385697Z I0713 00:12:35.663568 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6387513Z I0713 00:12:35.667346 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6389029Z I0713 00:12:35.667415 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6390295Z I0713 00:12:35.667446 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6392816Z I0713 00:12:35.675103 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6395791Z I0713 00:12:35.675817 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6399283Z I0713 00:12:35.682919 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6402380Z I0713 00:12:35.683231 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6405420Z I0713 00:12:36.084964 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6408345Z I0713 00:12:36.085215 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6411341Z I0713 00:12:36.088308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6414516Z I0713 00:12:36.088785 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6417094Z I0713 00:12:40.259967 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6418636Z I0713 00:12:40.260067 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6419898Z I0713 00:12:40.260081 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6422223Z I0713 00:12:40.275597 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6425276Z I0713 00:12:40.281610 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6428291Z I0713 00:12:40.684868 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6431266Z I0713 00:12:40.688354 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6433956Z I0713 00:12:40.694463 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6435496Z I0713 00:12:40.694513 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6436742Z I0713 00:12:40.694524 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6439247Z I0713 00:12:40.698283 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6441755Z I0713 00:12:40.700886 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6443273Z I0713 00:12:40.700930 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6444530Z I0713 00:12:40.701002 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6446944Z I0713 00:12:40.703211 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6449963Z I0713 00:12:40.707301 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6453005Z I0713 00:12:40.717814 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6456142Z I0713 00:12:41.104810 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6459178Z I0713 00:12:41.107838 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6462201Z I0713 00:12:41.118736 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6465243Z I0713 00:12:41.122157 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6467791Z I0713 00:12:45.286758 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6469312Z I0713 00:12:45.286817 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6471585Z I0713 00:12:45.286828 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6474279Z I0713 00:12:45.290791 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6477896Z I0713 00:12:45.294462 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6496583Z I0713 00:12:45.696152 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6499972Z I0713 00:12:45.699276 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6502582Z I0713 00:12:45.707226 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6504124Z I0713 00:12:45.707273 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6505394Z I0713 00:12:45.707284 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6507208Z I0713 00:12:45.707654 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6508745Z I0713 00:12:45.708329 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6509998Z I0713 00:12:45.708352 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6514031Z I0713 00:12:45.713746 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6517650Z I0713 00:12:45.715359 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6520828Z I0713 00:12:45.729611 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6523918Z I0713 00:12:45.735009 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6526947Z I0713 00:12:46.131126 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6529887Z I0713 00:12:46.139059 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6532860Z I0713 00:12:46.144773 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6536136Z I0713 00:12:46.150145 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6538676Z I0713 00:12:50.308213 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6540198Z I0713 00:12:50.308284 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6541459Z I0713 00:12:50.308296 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6543781Z I0713 00:12:50.313811 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6546798Z I0713 00:12:50.321510 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6549823Z I0713 00:12:50.723230 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6552809Z I0713 00:12:50.726683 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6555473Z I0713 00:12:50.734354 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6557243Z I0713 00:12:50.734677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6558527Z I0713 00:12:50.734827 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6560410Z I0713 00:12:50.735770 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6561958Z I0713 00:12:50.735949 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6563224Z I0713 00:12:50.736046 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6565525Z I0713 00:12:50.744066 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6568507Z I0713 00:12:50.744081 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6572426Z I0713 00:12:50.749626 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6575859Z I0713 00:12:50.750056 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6578904Z I0713 00:12:51.151877 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6581845Z I0713 00:12:51.151877 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6584824Z I0713 00:12:51.156246 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6587887Z I0713 00:12:51.157212 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6590472Z I0713 00:12:55.322459 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6592008Z I0713 00:12:55.322510 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6593269Z I0713 00:12:55.322521 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6595680Z I0713 00:12:55.336256 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6599417Z I0713 00:12:55.342255 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6602492Z I0713 00:12:55.747160 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6605538Z I0713 00:12:55.750314 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6608158Z I0713 00:12:55.759865 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6609719Z I0713 00:12:55.760098 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6611010Z I0713 00:12:55.760196 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6612886Z I0713 00:12:55.760703 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6614649Z I0713 00:12:55.760908 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6615943Z I0713 00:12:55.760997 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6618399Z I0713 00:12:55.774503 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6621446Z I0713 00:12:55.782883 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6624554Z I0713 00:12:55.786847 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6627709Z I0713 00:12:55.820982 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6630773Z I0713 00:12:56.193882 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6633851Z I0713 00:12:56.200491 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6637558Z I0713 00:12:56.223350 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6640834Z I0713 00:12:56.227405 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6643412Z I0713 00:13:00.345364 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6644977Z I0713 00:13:00.345438 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6646250Z I0713 00:13:00.345450 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6650419Z I0713 00:13:00.355135 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6654627Z I0713 00:13:00.359884 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6657694Z I0713 00:13:00.762282 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6660958Z I0713 00:13:00.766383 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6663566Z I0713 00:13:00.773874 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6665667Z I0713 00:13:00.773898 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6667215Z I0713 00:13:00.773914 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6668488Z I0713 00:13:00.773924 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6669751Z I0713 00:13:00.773946 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6671024Z I0713 00:13:00.773956 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6674488Z I0713 00:13:00.778040 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6677982Z I0713 00:13:00.779554 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6681337Z I0713 00:13:00.783572 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6684564Z I0713 00:13:00.784676 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6687611Z I0713 00:13:01.185593 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6690659Z I0713 00:13:01.188994 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6693716Z I0713 00:13:01.190313 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6697012Z I0713 00:13:01.193751 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6699648Z I0713 00:13:05.365991 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6701362Z I0713 00:13:05.366049 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6702644Z I0713 00:13:05.366060 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6705941Z I0713 00:13:05.381818 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6710480Z I0713 00:13:05.385225 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6714477Z I0713 00:13:05.787494 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6717941Z I0713 00:13:05.790736 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6720632Z I0713 00:13:05.798481 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6722193Z I0713 00:13:05.798679 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6723453Z I0713 00:13:05.798699 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6725328Z I0713 00:13:05.798488 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6727092Z I0713 00:13:05.798746 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6728427Z I0713 00:13:05.798757 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6730802Z I0713 00:13:05.802873 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6733814Z I0713 00:13:05.802891 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6736938Z I0713 00:13:05.811036 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6740052Z I0713 00:13:05.812258 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6743971Z I0713 00:13:06.212579 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6747120Z I0713 00:13:06.213451 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6750117Z I0713 00:13:06.215797 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6753170Z I0713 00:13:06.219974 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6755696Z I0713 00:13:10.390082 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6757374Z I0713 00:13:10.390137 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6758650Z I0713 00:13:10.390149 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6760971Z I0713 00:13:10.395627 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6764003Z I0713 00:13:10.398600 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6767037Z I0713 00:13:10.801924 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6774272Z I0713 00:13:10.808767 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6777003Z I0713 00:13:10.826752 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6778545Z I0713 00:13:10.826811 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6779792Z I0713 00:13:10.826982 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6781635Z I0713 00:13:10.827504 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6783169Z I0713 00:13:10.827556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6784415Z I0713 00:13:10.827575 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6786719Z I0713 00:13:10.838391 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6789894Z I0713 00:13:10.843231 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6792925Z I0713 00:13:10.846892 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6796018Z I0713 00:13:10.848738 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6799289Z I0713 00:13:11.248785 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6802278Z I0713 00:13:11.250118 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6805278Z I0713 00:13:11.253211 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6808370Z I0713 00:13:11.253718 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6810922Z I0713 00:13:15.405979 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6812572Z I0713 00:13:15.406040 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6813860Z I0713 00:13:15.406051 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6816184Z I0713 00:13:15.410964 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6819225Z I0713 00:13:15.418857 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6822267Z I0713 00:13:15.821042 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6825258Z I0713 00:13:15.823960 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6827783Z I0713 00:13:15.829383 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6829319Z I0713 00:13:15.829452 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6830742Z I0713 00:13:15.829470 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6833083Z I0713 00:13:15.832874 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6835591Z I0713 00:13:15.834922 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6837276Z I0713 00:13:15.834965 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6838545Z I0713 00:13:15.834977 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6840952Z I0713 00:13:15.839184 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6843973Z I0713 00:13:15.840478 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6847012Z I0713 00:13:15.858276 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6850076Z I0713 00:13:16.242052 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6853184Z I0713 00:13:16.247863 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6856237Z I0713 00:13:16.272075 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6859229Z I0713 00:13:16.285801 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6861768Z I0713 00:13:20.419477 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6863290Z I0713 00:13:20.419550 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6864550Z I0713 00:13:20.419561 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6866854Z I0713 00:13:20.424563 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6869882Z I0713 00:13:20.431368 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6873102Z I0713 00:13:20.833295 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6877515Z I0713 00:13:20.837540 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6880139Z I0713 00:13:20.844459 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6881680Z I0713 00:13:20.844524 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6882960Z I0713 00:13:20.844543 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6884774Z I0713 00:13:20.846240 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6886311Z I0713 00:13:20.846282 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6887570Z I0713 00:13:20.846293 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6889859Z I0713 00:13:20.852836 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6892988Z I0713 00:13:20.854806 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6896084Z I0713 00:13:20.861150 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6899158Z I0713 00:13:20.861374 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6902193Z I0713 00:13:21.263602 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6905142Z I0713 00:13:21.263608 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6908148Z I0713 00:13:21.267380 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6913097Z I0713 00:13:21.271383 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6915978Z I0713 00:13:25.435078 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6917742Z I0713 00:13:25.435128 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6919011Z I0713 00:13:25.435139 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6921406Z I0713 00:13:25.439084 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6924471Z I0713 00:13:25.445639 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6927501Z I0713 00:13:25.847588 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6930487Z I0713 00:13:25.852207 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6933020Z I0713 00:13:25.860363 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6934541Z I0713 00:13:25.860408 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6935933Z I0713 00:13:25.860418 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6937803Z I0713 00:13:25.860972 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6939337Z I0713 00:13:25.861098 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6940597Z I0713 00:13:25.861202 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6942889Z I0713 00:13:25.868356 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6945888Z I0713 00:13:25.870735 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6948924Z I0713 00:13:25.874520 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6952087Z I0713 00:13:25.891443 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6955290Z I0713 00:13:26.276425 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6958879Z I0713 00:13:26.279625 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6961973Z I0713 00:13:26.292739 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6964947Z I0713 00:13:26.309925 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6967499Z I0713 00:13:30.464218 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6969030Z I0713 00:13:30.464295 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6970281Z I0713 00:13:30.464307 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6972624Z I0713 00:13:30.479006 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6976485Z I0713 00:13:30.491244 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.6979664Z I0713 00:13:30.894651 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.6982669Z I0713 00:13:30.899933 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6985203Z I0713 00:13:30.910072 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6986734Z I0713 00:13:30.910151 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6987992Z I0713 00:13:30.912874 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6989821Z I0713 00:13:30.913099 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.6991335Z I0713 00:13:30.913171 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.6992649Z I0713 00:13:30.914328 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.6995104Z I0713 00:13:30.922609 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.6998449Z I0713 00:13:30.925188 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7001546Z I0713 00:13:30.930471 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7004637Z I0713 00:13:30.949799 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7007663Z I0713 00:13:31.333266 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7010659Z I0713 00:13:31.338082 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7013664Z I0713 00:13:31.352324 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7016761Z I0713 00:13:31.355893 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7019337Z I0713 00:13:35.482318 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7021946Z I0713 00:13:35.482388 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7023205Z I0713 00:13:35.482406 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7025661Z I0713 00:13:35.487014 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7028733Z I0713 00:13:35.493074 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7031748Z I0713 00:13:35.894812 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7034715Z I0713 00:13:35.901923 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7037600Z I0713 00:13:35.915225 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7039155Z I0713 00:13:35.915282 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7040405Z I0713 00:13:35.915292 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7042259Z I0713 00:13:35.917661 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7043776Z I0713 00:13:35.917704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7045070Z I0713 00:13:35.917714 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7047390Z I0713 00:13:35.927487 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7050363Z I0713 00:13:35.929966 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7053389Z I0713 00:13:35.935334 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7056475Z I0713 00:13:35.977285 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7059615Z I0713 00:13:36.341380 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7062653Z I0713 00:13:36.374313 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7065661Z I0713 00:13:36.390731 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7068658Z I0713 00:13:36.456908 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7071169Z I0713 00:13:40.525654 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7072696Z I0713 00:13:40.525715 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7073963Z I0713 00:13:40.525728 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7077856Z I0713 00:13:40.537665 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7081094Z I0713 00:13:40.551245 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7084125Z I0713 00:13:40.953508 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7087622Z I0713 00:13:40.965018 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7090260Z I0713 00:13:40.988273 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7091794Z I0713 00:13:40.988470 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7093047Z I0713 00:13:40.988597 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7094868Z I0713 00:13:41.002582 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7096408Z I0713 00:13:41.002798 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7097658Z I0713 00:13:41.002892 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7100104Z I0713 00:13:41.010024 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7103281Z I0713 00:13:41.013949 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7106306Z I0713 00:13:41.044063 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7109356Z I0713 00:13:41.049552 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7112388Z I0713 00:13:41.416682 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7115361Z I0713 00:13:41.422564 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7119240Z I0713 00:13:41.451844 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7122422Z I0713 00:13:41.456922 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7124958Z I0713 00:13:45.606492 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7126476Z I0713 00:13:45.606550 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7127736Z I0713 00:13:45.606560 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7130037Z I0713 00:13:45.614687 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7133077Z I0713 00:13:45.620072 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7136088Z I0713 00:13:46.022199 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7139064Z I0713 00:13:46.025729 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7141715Z I0713 00:13:46.032861 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7143271Z I0713 00:13:46.033046 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7144519Z I0713 00:13:46.033069 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7146418Z I0713 00:13:46.032907 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7147960Z I0713 00:13:46.033520 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7149209Z I0713 00:13:46.033540 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7151509Z I0713 00:13:46.042110 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7154492Z I0713 00:13:46.048345 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7157838Z I0713 00:13:46.050904 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7161202Z I0713 00:13:46.060320 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7164224Z I0713 00:13:46.455424 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7167378Z I0713 00:13:46.462484 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7170417Z I0713 00:13:46.466043 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7173408Z I0713 00:13:46.474651 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7175983Z I0713 00:13:50.629484 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7178603Z I0713 00:13:50.629537 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7196862Z I0713 00:13:50.629547 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7199849Z I0713 00:13:50.640989 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7203041Z I0713 00:13:50.645552 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7206071Z I0713 00:13:51.047580 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7209090Z I0713 00:13:51.052877 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7211623Z I0713 00:13:51.069651 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7213206Z I0713 00:13:51.069937 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7214468Z I0713 00:13:51.070146 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7216282Z I0713 00:13:51.088675 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7217953Z I0713 00:13:51.089216 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7219224Z I0713 00:13:51.089425 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7221554Z I0713 00:13:51.109188 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7224549Z I0713 00:13:51.113450 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7227601Z I0713 00:13:51.146229 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7230675Z I0713 00:13:51.146997 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7235202Z I0713 00:13:51.549071 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7238681Z I0713 00:13:51.549119 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7241868Z I0713 00:13:51.553657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7244990Z I0713 00:13:51.559970 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7247518Z I0713 00:13:55.652356 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7249042Z I0713 00:13:55.652442 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7250317Z I0713 00:13:55.652461 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7252779Z I0713 00:13:55.659113 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7255889Z I0713 00:13:55.664030 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7259027Z I0713 00:13:56.066151 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7262333Z I0713 00:13:56.084573 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7264963Z I0713 00:13:56.103006 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7267068Z I0713 00:13:56.103023 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7268632Z I0713 00:13:56.103069 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7269903Z I0713 00:13:56.103081 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7271185Z I0713 00:13:56.103128 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7272475Z I0713 00:13:56.103143 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7274860Z I0713 00:13:56.114717 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7280196Z I0713 00:13:56.115849 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7283850Z I0713 00:13:56.125673 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7287088Z I0713 00:13:56.129160 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7290332Z I0713 00:13:56.527663 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7293321Z I0713 00:13:56.534537 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7296372Z I0713 00:13:56.541818 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7299498Z I0713 00:13:56.553596 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7302070Z I0713 00:14:00.667876 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7303770Z I0713 00:14:00.667934 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7305049Z I0713 00:14:00.667975 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7308849Z I0713 00:14:00.688119 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7311977Z I0713 00:14:00.722111 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7315066Z I0713 00:14:01.124327 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7318282Z I0713 00:14:01.128374 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7321405Z I0713 00:14:01.134636 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7322952Z I0713 00:14:01.134690 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7324212Z I0713 00:14:01.134701 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7326222Z I0713 00:14:01.139422 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7327935Z I0713 00:14:01.139467 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7329743Z I0713 00:14:01.139478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7332187Z I0713 00:14:01.155270 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7335206Z I0713 00:14:01.159632 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7338356Z I0713 00:14:01.167006 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7341851Z I0713 00:14:01.192120 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7345026Z I0713 00:14:01.568731 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7348692Z I0713 00:14:01.572897 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7351752Z I0713 00:14:01.594008 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7354764Z I0713 00:14:01.598323 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7357566Z I0713 00:14:05.706029 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7359133Z I0713 00:14:05.706089 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7360396Z I0713 00:14:05.706099 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7362775Z I0713 00:14:05.720927 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7365870Z I0713 00:14:05.733226 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7369057Z I0713 00:14:06.135097 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7372161Z I0713 00:14:06.139770 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7374768Z I0713 00:14:06.153784 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7376383Z I0713 00:14:06.153851 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7377657Z I0713 00:14:06.153866 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7380140Z I0713 00:14:06.161406 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7381671Z I0713 00:14:06.161456 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7382932Z I0713 00:14:06.161890 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7385283Z I0713 00:14:06.177907 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7388532Z I0713 00:14:06.181148 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7391586Z I0713 00:14:06.198734 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7394737Z I0713 00:14:06.199945 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7398349Z I0713 00:14:06.607454 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7401470Z I0713 00:14:06.610135 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7404525Z I0713 00:14:06.614368 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7407636Z I0713 00:14:06.622714 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7410200Z I0713 00:14:10.799166 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7411923Z I0713 00:14:10.799240 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7413228Z I0713 00:14:10.799258 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7415575Z I0713 00:14:10.808288 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7418651Z I0713 00:14:10.817728 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7421739Z I0713 00:14:11.219568 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:11.7424745Z I0713 00:14:11.227017 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7427322Z I0713 00:14:11.233924 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7428895Z I0713 00:14:11.234039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7430985Z I0713 00:14:11.234054 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7432988Z I0713 00:14:11.241633 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:11.7434528Z I0713 00:14:11.241704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-13T00:14:11.7435790Z I0713 00:14:11.241732 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-13T00:14:11.7438852Z I0713 00:14:11.251906 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7442005Z I0713 00:14:11.266490 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-13T00:14:11.7445079Z I0713 00:14:11.272526 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:11.7448208Z I0713 00:14:11.276125 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-13T00:14:12.0222368Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-6rpj8 ***
2021-07-13T00:14:12.0244294Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-6rpj8 ***
2021-07-13T00:14:12.0247904Z ====================================================================
2021-07-13T00:14:12.0255322Z ##[endgroup]
2021-07-13T00:14:12.0260021Z ##[group]*** submariner-routeagent-6rpj8 ***
2021-07-13T00:14:12.0264790Z ======================= *** submariner-routeagent-6rpj8 *** =======================
2021-07-13T00:14:12.0278462Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-6rpj8
2021-07-13T00:14:12.0303858Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-6rpj8
2021-07-13T00:14:12.0327206Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-6rpj8
2021-07-13T00:14:12.3915362Z + trap 'exit 1' SIGTERM SIGINT
2021-07-13T00:14:12.3916031Z + SUBMARINER_VERBOSITY=2
2021-07-13T00:14:12.3916824Z + '[' false == true ']'
2021-07-13T00:14:12.3918186Z + DEBUG=-v=2
2021-07-13T00:14:12.3924124Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-13T00:14:12.3928498Z I0713 00:10:08.701608 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-13T00:14:12.3931117Z W0713 00:10:08.701981 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:12.3933035Z I0713 00:10:08.703641 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:12.3934503Z I0713 00:10:08.724243 1 cni_iface.go:74] Interface "weave" has "10.1.224.0" address
2021-07-13T00:14:12.3935797Z I0713 00:10:08.724267 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:12.3938464Z I0713 00:10:08.809358 1 cni_iface.go:116] Successfully annotated node "cluster1-control-plane" with cniIfaceIP "10.1.224.0"
2021-07-13T00:14:12.3940598Z I0713 00:10:08.809606 1 registry.go:67] Event handler "logger" added to registry "routeagent_driver".
2021-07-13T00:14:12.3941897Z I0713 00:10:08.813585 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:12.3946785Z I0713 00:10:08.817074 1 cni_iface.go:74] Interface "weave" has "10.1.224.0" address
2021-07-13T00:14:12.3948518Z I0713 00:10:08.817272 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:12.3950395Z I0713 00:10:09.249029 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-13T00:14:12.3952729Z I0713 00:10:09.306335 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-13T00:14:12.3968913Z I0713 00:10:09.366490 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-13T00:14:12.3970457Z I0713 00:10:09.531931 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-13T00:14:12.3971797Z I0713 00:10:09.550096 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-13T00:14:12.3973287Z I0713 00:10:09.588954 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.224.0
2021-07-13T00:14:12.3974843Z I0713 00:10:09.600887 1 registry.go:67] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-13T00:14:12.3976355Z I0713 00:10:09.601013 1 registry.go:69] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-13T00:14:12.3977411Z I0713 00:10:09.601118 1 registry.go:67] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-13T00:14:12.3978497Z I0713 00:10:09.601196 1 registry.go:67] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-13T00:14:12.3979485Z I0713 00:10:09.601264 1 mtuhandler.go:44] Updating configurations for Path MTU
2021-07-13T00:14:12.3980390Z I0713 00:10:09.601769 1 registry.go:67] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-13T00:14:12.3982025Z W0713 00:10:09.602002 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:12.3983083Z I0713 00:10:09.687444 1 controller.go:141] Starting the Event controller...
2021-07-13T00:14:12.3986094Z I0713 00:10:09.802411 1 handler.go:56] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:12.3989011Z I0713 00:10:09.802743 1 endpoint_handler.go:56] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.4
2021-07-13T00:14:12.3989979Z I0713 00:10:09.814725 1 routes_iface.go:175] Reconciling routes to gw: 240.18.0.4
2021-07-13T00:14:12.3990807Z I0713 00:10:09.824432 1 routes_iface.go:191] Processing route {Ifindex: 13 Dst: 240.0.0.0/8 Src: 240.18.0.6 Gw: <nil> Flags: [] Table: 254}
2021-07-13T00:14:12.3991563Z I0713 00:10:09.824955 1 routes_iface.go:194] Found nil gw or dst
2021-07-13T00:14:12.3992203Z I0713 00:10:09.902653 1 controller.go:148] Event controller started
2021-07-13T00:14:12.3994303Z I0713 00:10:09.903819 1 handler.go:89] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:12.4016033Z I0713 00:10:09.904256 1 node_handler.go:30] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:12.4018311Z I0713 00:10:09.904399 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode false
2021-07-13T00:14:12.4020744Z I0713 00:10:09.904664 1 handler.go:89] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:12.4023362Z I0713 00:10:09.904772 1 node_handler.go:30] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:12.4025027Z I0713 00:10:09.904897 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode false
2021-07-13T00:14:12.4028784Z I0713 00:10:09.905185 1 handler.go:89] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:12.4037666Z I0713 00:10:09.905322 1 node_handler.go:30] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:12.4039383Z I0713 00:10:09.905423 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-13T00:14:12.4044934Z I0713 00:10:25.242807 1 handler.go:71] A new Endpoint for remote cluster "cluster3" has been created: v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:12.4048047Z I0713 00:10:25.271264 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.3.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4049316Z I0713 00:10:25.355556 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4050618Z I0713 00:10:25.473215 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.3.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4051929Z I0713 00:10:25.532970 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4058880Z I0713 00:10:26.613541 1 handler.go:71] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:12.4061830Z I0713 00:10:26.618299 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4063078Z I0713 00:10:26.656737 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4064518Z I0713 00:10:26.691078 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4065897Z I0713 00:10:26.731228 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:12.4069747Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-74xsc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:12.4072093Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-74xsc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:12.4074418Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-74xsc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:12.7072969Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-74xsc ***
2021-07-13T00:14:12.7081837Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-74xsc ***
2021-07-13T00:14:12.7093493Z ====================================================================
2021-07-13T00:14:12.7095232Z ##[endgroup]
2021-07-13T00:14:12.7096451Z ##[group]*** submariner-routeagent-74xsc ***
2021-07-13T00:14:12.7097684Z ======================= *** submariner-routeagent-74xsc *** =======================
2021-07-13T00:14:12.7110500Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-74xsc
2021-07-13T00:14:12.7122267Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-74xsc
2021-07-13T00:14:12.7136205Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-74xsc
2021-07-13T00:14:13.0643594Z + trap 'exit 1' SIGTERM SIGINT
2021-07-13T00:14:13.0646754Z + SUBMARINER_VERBOSITY=2
2021-07-13T00:14:13.0647488Z + '[' false == true ']'
2021-07-13T00:14:13.0647992Z + DEBUG=-v=2
2021-07-13T00:14:13.0648823Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-13T00:14:13.0650025Z I0713 00:09:48.985965 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-13T00:14:13.0651470Z W0713 00:09:48.986381 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:13.0654408Z I0713 00:09:49.001933 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:13.0655296Z I0713 00:09:49.002028 1 cni_iface.go:74] Interface "weave" has "10.1.128.0" address
2021-07-13T00:14:13.0656102Z I0713 00:09:49.002154 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:13.0658821Z I0713 00:09:49.258595 1 cni_iface.go:116] Successfully annotated node "cluster1-worker2" with cniIfaceIP "10.1.128.0"
2021-07-13T00:14:13.0661249Z I0713 00:09:49.258627 1 registry.go:67] Event handler "logger" added to registry "routeagent_driver".
2021-07-13T00:14:13.0662054Z I0713 00:09:49.259195 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:13.0662719Z I0713 00:09:49.259269 1 cni_iface.go:74] Interface "weave" has "10.1.128.0" address
2021-07-13T00:14:13.0663531Z I0713 00:09:49.259275 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:13.0665716Z I0713 00:09:49.709560 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-13T00:14:13.0667495Z I0713 00:09:49.905454 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-13T00:14:13.0669388Z I0713 00:09:49.976770 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-13T00:14:13.0670569Z I0713 00:09:50.729939 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-13T00:14:13.0672815Z I0713 00:09:50.779388 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-13T00:14:13.0675298Z I0713 00:09:50.897551 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.128.0
2021-07-13T00:14:13.0678587Z I0713 00:09:51.063363 1 registry.go:67] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.0680376Z I0713 00:09:51.063392 1 registry.go:69] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-13T00:14:13.0682541Z I0713 00:09:51.063401 1 registry.go:67] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-13T00:14:13.0683742Z I0713 00:09:51.063406 1 registry.go:67] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.0685299Z I0713 00:09:51.063412 1 mtuhandler.go:44] Updating configurations for Path MTU
2021-07-13T00:14:13.0686182Z I0713 00:09:51.063513 1 registry.go:67] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.0688353Z W0713 00:09:51.063646 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:13.0689391Z I0713 00:09:51.667657 1 controller.go:141] Starting the Event controller...
2021-07-13T00:14:13.0693665Z I0713 00:09:51.768820 1 handler.go:56] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.0698092Z I0713 00:09:51.768886 1 endpoint_handler.go:56] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.4
2021-07-13T00:14:13.0699167Z I0713 00:09:51.785772 1 routes_iface.go:175] Reconciling routes to gw: 240.18.0.4
2021-07-13T00:14:13.0719339Z I0713 00:09:51.837362 1 routes_iface.go:191] Processing route {Ifindex: 15 Dst: 240.0.0.0/8 Src: 240.18.0.9 Gw: <nil> Flags: [] Table: 254}
2021-07-13T00:14:13.0720172Z I0713 00:09:51.837410 1 routes_iface.go:194] Found nil gw or dst
2021-07-13T00:14:13.0721417Z I0713 00:09:51.881721 1 controller.go:148] Event controller started
2021-07-13T00:14:13.0723643Z I0713 00:09:51.882635 1 handler.go:89] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:13.0727397Z I0713 00:09:51.882668 1 node_handler.go:30] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:13.0729292Z I0713 00:09:51.882682 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode false
2021-07-13T00:14:13.0731460Z I0713 00:09:51.882824 1 handler.go:89] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:13.0734953Z I0713 00:09:51.882834 1 node_handler.go:30] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:13.0736734Z I0713 00:09:51.882843 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode false
2021-07-13T00:14:13.0739285Z I0713 00:09:51.902769 1 handler.go:89] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:13.0743839Z I0713 00:09:51.902923 1 node_handler.go:30] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:13.0746255Z I0713 00:09:51.904600 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-13T00:14:13.0751877Z I0713 00:10:25.224651 1 handler.go:71] A new Endpoint for remote cluster "cluster3" has been created: v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.0755938Z I0713 00:10:25.233424 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.3.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0758915Z I0713 00:10:25.288148 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0760928Z I0713 00:10:25.338878 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.3.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0763666Z I0713 00:10:25.374287 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0769731Z I0713 00:10:26.612874 1 handler.go:71] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.0799755Z I0713 00:10:26.615669 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0801219Z I0713 00:10:26.625057 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0803079Z I0713 00:10:26.675130 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0824414Z I0713 00:10:26.712877 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.0827371Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-c5rv6 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:13.0830286Z [lighthouse]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-c5rv6 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:13.0833520Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-c5rv6 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:13.3920382Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-c5rv6 ***
2021-07-13T00:14:13.3950170Z [lighthouse]$ [cluster1] print_section *** submariner-routeagent-c5rv6 ***
2021-07-13T00:14:13.3953087Z ====================================================================
2021-07-13T00:14:13.3954895Z ##[endgroup]
2021-07-13T00:14:13.3960149Z ##[group]*** submariner-routeagent-c5rv6 ***
2021-07-13T00:14:13.3964414Z ======================= *** submariner-routeagent-c5rv6 *** =======================
2021-07-13T00:14:13.3976173Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-c5rv6
2021-07-13T00:14:13.3987618Z [lighthouse]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-c5rv6
2021-07-13T00:14:13.3999337Z [lighthouse]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-c5rv6
2021-07-13T00:14:13.7296784Z + trap 'exit 1' SIGTERM SIGINT
2021-07-13T00:14:13.7297459Z + SUBMARINER_VERBOSITY=2
2021-07-13T00:14:13.7298182Z + '[' false == true ']'
2021-07-13T00:14:13.7298731Z + DEBUG=-v=2
2021-07-13T00:14:13.7299727Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-13T00:14:13.7301093Z I0713 00:09:59.794670 1 main.go:55] Starting submariner-route-agent using the event framework
2021-07-13T00:14:13.7302573Z W0713 00:09:59.796558 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:13.7303640Z I0713 00:09:59.802027 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:13.7314912Z I0713 00:09:59.802194 1 cni_iface.go:74] Interface "weave" has "10.1.0.1" address
2021-07-13T00:14:13.7315745Z I0713 00:09:59.802237 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:13.7317596Z I0713 00:10:00.390277 1 cni_iface.go:116] Successfully annotated node "cluster1-worker" with cniIfaceIP "10.1.0.1"
2021-07-13T00:14:13.7318613Z I0713 00:10:00.390309 1 registry.go:67] Event handler "logger" added to registry "routeagent_driver".
2021-07-13T00:14:13.7319396Z I0713 00:10:00.391117 1 cni_iface.go:74] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:13.7320111Z I0713 00:10:00.391313 1 cni_iface.go:74] Interface "weave" has "10.1.0.1" address
2021-07-13T00:14:13.7320899Z I0713 00:10:00.391329 1 cni_iface.go:79] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-13T00:14:13.7322170Z I0713 00:10:00.590400 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-13T00:14:13.7323535Z I0713 00:10:00.701530 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-13T00:14:13.7331601Z I0713 00:10:00.746438 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-13T00:14:13.7359159Z I0713 00:10:01.042309 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-13T00:14:13.7360748Z I0713 00:10:01.200500 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-13T00:14:13.7362261Z I0713 00:10:01.284699 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.0.1
2021-07-13T00:14:13.7363996Z I0713 00:10:01.372109 1 registry.go:67] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.7365585Z I0713 00:10:01.372135 1 registry.go:69] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-13T00:14:13.7366666Z I0713 00:10:01.372142 1 registry.go:67] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-13T00:14:13.7367633Z I0713 00:10:01.372146 1 registry.go:67] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.7368570Z I0713 00:10:01.372152 1 mtuhandler.go:44] Updating configurations for Path MTU
2021-07-13T00:14:13.7369660Z I0713 00:10:01.372253 1 registry.go:67] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-13T00:14:13.7371098Z W0713 00:10:01.372397 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:13.7372143Z I0713 00:10:01.970977 1 controller.go:141] Starting the Event controller...
2021-07-13T00:14:13.7375387Z I0713 00:10:02.072112 1 handler.go:56] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.7377733Z I0713 00:10:02.072180 1 handler.go:51] The current node has become a Gateway
2021-07-13T00:14:13.7378486Z I0713 00:10:02.072190 1 gw_transition.go:47] The current node has become a Gateway
2021-07-13T00:14:13.7379540Z I0713 00:10:02.072418 1 routes_iface.go:160] Processing route {Ifindex: 13 Dst: <nil> Src: <nil> Gw: 172.18.0.1 Flags: [] Table: 254}
2021-07-13T00:14:13.7380303Z I0713 00:10:02.072484 1 routes_iface.go:163] Found nil gw or dst
2021-07-13T00:14:13.7381059Z I0713 00:10:02.072488 1 routes_iface.go:160] Processing route {Ifindex: 4 Dst: 10.1.0.0/16 Src: 10.1.0.1 Gw: <nil> Flags: [] Table: 254}
2021-07-13T00:14:13.7381796Z I0713 00:10:02.072591 1 routes_iface.go:163] Found nil gw or dst
2021-07-13T00:14:13.7382685Z I0713 00:10:02.072596 1 routes_iface.go:160] Processing route {Ifindex: 13 Dst: 172.18.0.0/16 Src: 172.18.0.4 Gw: <nil> Flags: [] Table: 254}
2021-07-13T00:14:13.7383622Z I0713 00:10:02.072607 1 routes_iface.go:163] Found nil gw or dst
2021-07-13T00:14:13.7384717Z I0713 00:10:02.072610 1 gw_transition.go:55] Creating the vxlan interface: vx-submariner on the gateway node
2021-07-13T00:14:13.7385992Z I0713 00:10:02.075015 1 vxlan.go:273] Successfully configured reverse path filter to loose mode on "vx-submariner"
2021-07-13T00:14:13.7386871Z I0713 00:10:02.172173 1 controller.go:148] Event controller started
2021-07-13T00:14:13.7388818Z I0713 00:10:02.172992 1 handler.go:89] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:13.7391931Z I0713 00:10:02.173046 1 node_handler.go:30] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-13T00:14:13.7393781Z I0713 00:10:02.173068 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode true
2021-07-13T00:14:13.7394781Z I0713 00:10:02.173257 1 vxlan.go:188] Successfully added the bridge fdb entry 172.18.0.6 00:00:00:00:00:00
2021-07-13T00:14:13.7396653Z I0713 00:10:02.173446 1 handler.go:89] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:13.7399980Z I0713 00:10:02.173480 1 node_handler.go:30] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.4"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-13T00:14:13.7401640Z I0713 00:10:02.173490 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.4, isGatewayNode true
2021-07-13T00:14:13.7402640Z I0713 00:10:02.173545 1 vxlan.go:188] Successfully added the bridge fdb entry 172.18.0.4 00:00:00:00:00:00
2021-07-13T00:14:13.7404609Z I0713 00:10:02.173796 1 handler.go:89] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:13.7407236Z I0713 00:10:02.173814 1 node_handler.go:30] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-13T00:14:13.7409087Z I0713 00:10:02.173844 1 node_handler.go:74] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode true
2021-07-13T00:14:13.7410078Z I0713 00:10:02.173885 1 vxlan.go:188] Successfully added the bridge fdb entry 172.18.0.9 00:00:00:00:00:00
2021-07-13T00:14:13.7415293Z I0713 00:10:25.228722 1 handler.go:71] A new Endpoint for remote cluster "cluster3" has been created: v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.7418187Z I0713 00:10:25.228768 1 routes_iface.go:251] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-13T00:14:13.7419931Z I0713 00:10:25.234706 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.3.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7421191Z I0713 00:10:25.248074 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7422443Z I0713 00:10:25.285188 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.3.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7423670Z I0713 00:10:25.300604 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.3.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7426718Z I0713 00:10:26.624152 1 handler.go:71] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-13T00:14:13.7429714Z I0713 00:10:26.633196 1 routes_iface.go:251] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-13T00:14:13.7431385Z I0713 00:10:26.637996 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7432643Z I0713 00:10:26.718046 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7434034Z I0713 00:10:26.770910 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7435318Z I0713 00:10:26.807347 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-13T00:14:13.7478518Z [lighthouse]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-13T00:14:13.7483249Z [lighthouse]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-13T00:14:13.7486812Z ====================================================================
2021-07-13T00:14:13.7490543Z ##[endgroup]
2021-07-13T00:14:13.7494974Z ##[group]* Output of 'subctl show all' in cluster1 *
2021-07-13T00:14:13.7501128Z ======================= * Output of 'subctl show all' in cluster1 * =======================
2021-07-13T00:14:13.7514771Z [lighthouse]$ [cluster1] subctl show all
2021-07-13T00:14:13.7524597Z /opt/shipyard/scripts/post_mortem.sh: line 57: subctl: command not found
2021-07-13T00:14:13.7549121Z [lighthouse]$ [cluster1] return 0
2021-07-13T00:14:13.7564442Z [lighthouse]$ [cluster2] post_analyze
2021-07-13T00:14:13.7575362Z [lighthouse]$ [cluster2] post_analyze
2021-07-13T00:14:13.7586296Z [lighthouse]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-13T00:14:13.7598639Z [lighthouse]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-13T00:14:13.7601142Z ====================================================================
2021-07-13T00:14:13.7601942Z ##[endgroup]
2021-07-13T00:14:13.7604189Z ##[group]* Kubernetes client and server versions in cluster2 *
2021-07-13T00:14:13.7607251Z ======================= * Kubernetes client and server versions in cluster2 * =======================
2021-07-13T00:14:13.7620163Z [lighthouse]$ [cluster2] kubectl version
2021-07-13T00:14:13.7630386Z [lighthouse]$ [cluster2] kubectl version
2021-07-13T00:14:13.7642095Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 version
2021-07-13T00:14:14.0709185Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-13T00:14:14.0711756Z Server Version: version.Info{Major:"1", Minor:"17", GitVersion:"v1.17.17", GitCommit:"f3abc15296f3a3f54e4ee42e830c61047b13895f", GitTreeState:"clean", BuildDate:"2021-05-28T00:19:02Z", GoVersion:"go1.13.15", Compiler:"gc", Platform:"linux/amd64"}
2021-07-13T00:14:14.0754422Z [lighthouse]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-13T00:14:14.0764552Z [lighthouse]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-13T00:14:14.0768259Z ====================================================================
2021-07-13T00:14:14.0771625Z ##[endgroup]
2021-07-13T00:14:14.0775266Z ##[group]* Overview of all resources in cluster2 *
2021-07-13T00:14:14.0778497Z ======================= * Overview of all resources in cluster2 * =======================
2021-07-13T00:14:14.0789699Z [lighthouse]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-13T00:14:14.0805394Z [lighthouse]$ [cluster2] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-13T00:14:14.0815432Z [lighthouse]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-13T00:14:14.0830200Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 api-resources --verbs=list -o name
2021-07-13T00:14:14.7573725Z NAME STATUS MESSAGE ERROR
2021-07-13T00:14:14.7574881Z componentstatus/scheduler Unhealthy Get http://127.0.0.1:10251/healthz: dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-13T00:14:14.7577235Z componentstatus/controller-manager Unhealthy Get http://127.0.0.1:10252/healthz: dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-13T00:14:14.7589941Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-13T00:14:15.3673833Z NAME ENDPOINTS AGE
2021-07-13T00:14:15.3675371Z endpoints/kubernetes 172.18.0.6:6443 7m28s
2021-07-13T00:14:15.6931661Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-13T00:14:15.6943843Z 7m57s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m57s 7 event/cluster1-control-plane.169130f70dd5acb4
2021-07-13T00:14:15.6948063Z 7m57s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m57s 7 event/cluster1-control-plane.169130f70dd5c35d
2021-07-13T00:14:15.6951989Z 7m57s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m57s 7 event/cluster1-control-plane.169130f70dd5d16d
2021-07-13T00:14:15.6955100Z 7m25s Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 7m25s 1 event/cluster1-control-plane.169130feb1267f34
2021-07-13T00:14:15.6958553Z 7m24s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m24s 1 event/cluster1-control-plane.169130febad52e76
2021-07-13T00:14:15.6962270Z 7m24s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m24s 1 event/cluster1-control-plane.169130febad545e6
2021-07-13T00:14:15.6965965Z 7m24s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m24s 1 event/cluster1-control-plane.169130febad5545a
2021-07-13T00:14:15.6969313Z 7m24s Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 7m24s 1 event/cluster1-control-plane.169130fed8008483
2021-07-13T00:14:15.6972555Z 7m9s Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 7m9s 1 event/cluster1-control-plane.1691310245ec7a16
2021-07-13T00:14:15.6975762Z 7m7s Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 7m7s 1 event/cluster1-control-plane.16913102afe326c6
2021-07-13T00:14:15.6978748Z 6m14s Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 6m14s 1 event/cluster1-control-plane.1691310f13b0f299
2021-07-13T00:14:15.6981748Z 6m53s Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 7m7s 8 event/cluster1-worker.16913102e44e5816
2021-07-13T00:14:15.6984608Z 6m53s Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 7m7s 8 event/cluster1-worker.16913102e44e7b3e
2021-07-13T00:14:15.6987101Z 6m49s Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 6m49s 1 event/cluster1-worker.16913106e1780153
2021-07-13T00:14:15.6989524Z 6m49s Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 6m49s 1 event/cluster1-worker.16913106ee14ec0c
2021-07-13T00:14:15.6992504Z 6m52s Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 7m5s 8 event/cluster1-worker2.1691310328eddd1d
2021-07-13T00:14:15.6995447Z 6m52s Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 7m5s 8 event/cluster1-worker2.1691310328ee1306
2021-07-13T00:14:15.6999039Z 6m49s Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 6m49s 1 event/cluster1-worker2.16913106ee151b50
2021-07-13T00:14:15.7001544Z 6m48s Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 6m48s 1 event/cluster1-worker2.1691310750164589
2021-07-13T00:14:16.3608597Z NAME STATUS AGE
2021-07-13T00:14:16.3609222Z namespace/default Active 7m29s
2021-07-13T00:14:16.3610451Z namespace/kube-node-lease Active 7m30s
2021-07-13T00:14:16.3611283Z namespace/kube-public Active 7m30s
2021-07-13T00:14:16.3612061Z namespace/kube-system Active 7m30s
2021-07-13T00:14:16.3612877Z namespace/local-path-storage Active 7m22s
2021-07-13T00:14:16.3613792Z namespace/submariner-k8s-broker Active 5m14s
2021-07-13T00:14:16.3614966Z namespace/submariner-operator Active 5m13s
2021-07-13T00:14:16.6810567Z NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
2021-07-13T00:14:16.6812282Z node/cluster1-control-plane Ready master 7m27s v1.17.17 172.18.0.6 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:14:16.6817534Z node/cluster1-worker Ready <none> 6m54s v1.17.17 172.18.0.4 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:14:16.6819187Z node/cluster1-worker2 Ready <none> 6m53s v1.17.17 172.18.0.9 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-13T00:14:19.1435410Z NAME TYPE DATA AGE
2021-07-13T00:14:19.1438702Z secret/default-token-g9tc8 kubernetes.io/service-account-token 3 7m14s
2021-07-13T00:14:19.4428863Z NAME SECRETS AGE
2021-07-13T00:14:19.4432055Z serviceaccount/default 1 7m14s
2021-07-13T00:14:19.7500645Z NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
2021-07-13T00:14:19.7501537Z service/kubernetes ClusterIP 100.1.0.1 <none> 443/TCP 7m32s <none>
2021-07-13T00:14:21.0011209Z NAME CREATED AT
2021-07-13T00:14:21.0013751Z customresourcedefinition.apiextensions.k8s.io/brokers.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:14:21.0018147Z customresourcedefinition.apiextensions.k8s.io/clusterglobalegressips.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:14:21.0021115Z customresourcedefinition.apiextensions.k8s.io/clusters.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:14:21.0023310Z customresourcedefinition.apiextensions.k8s.io/endpoints.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:14:21.0025422Z customresourcedefinition.apiextensions.k8s.io/gateways.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:14:21.0027851Z customresourcedefinition.apiextensions.k8s.io/globalegressips.submariner.io 2021-07-13T00:09:12Z
2021-07-13T00:14:21.0030507Z customresourcedefinition.apiextensions.k8s.io/globalingressips.submariner.io 2021-07-13T00:09:13Z
2021-07-13T00:14:21.0033108Z customresourcedefinition.apiextensions.k8s.io/servicediscoveries.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:14:21.0035584Z customresourcedefinition.apiextensions.k8s.io/serviceexports.multicluster.x-k8s.io 2021-07-13T00:09:11Z
2021-07-13T00:14:21.0038785Z customresourcedefinition.apiextensions.k8s.io/serviceimports.multicluster.x-k8s.io 2021-07-13T00:09:11Z
2021-07-13T00:14:21.0041151Z customresourcedefinition.apiextensions.k8s.io/submariners.submariner.io 2021-07-13T00:09:02Z
2021-07-13T00:14:21.4375368Z NAME SERVICE AVAILABLE AGE
2021-07-13T00:14:21.4382294Z apiservice.apiregistration.k8s.io/v1. Local True 7m36s
2021-07-13T00:14:21.4384191Z apiservice.apiregistration.k8s.io/v1.admissionregistration.k8s.io Local True 7m36s
2021-07-13T00:14:21.4385967Z apiservice.apiregistration.k8s.io/v1.apiextensions.k8s.io Local True 7m36s
2021-07-13T00:14:21.4387466Z apiservice.apiregistration.k8s.io/v1.apps Local True 7m35s
2021-07-13T00:14:21.4388986Z apiservice.apiregistration.k8s.io/v1.authentication.k8s.io Local True 7m35s
2021-07-13T00:14:21.4392456Z apiservice.apiregistration.k8s.io/v1.authorization.k8s.io Local True 7m35s
2021-07-13T00:14:21.4393775Z apiservice.apiregistration.k8s.io/v1.autoscaling Local True 7m35s
2021-07-13T00:14:21.4394991Z apiservice.apiregistration.k8s.io/v1.batch Local True 7m35s
2021-07-13T00:14:21.4396392Z apiservice.apiregistration.k8s.io/v1.coordination.k8s.io Local True 7m35s
2021-07-13T00:14:21.4398505Z apiservice.apiregistration.k8s.io/v1.networking.k8s.io Local True 7m35s
2021-07-13T00:14:21.4399935Z apiservice.apiregistration.k8s.io/v1.rbac.authorization.k8s.io Local True 7m35s
2021-07-13T00:14:21.4401541Z apiservice.apiregistration.k8s.io/v1.scheduling.k8s.io Local True 7m35s
2021-07-13T00:14:21.4402882Z apiservice.apiregistration.k8s.io/v1.storage.k8s.io Local True 7m35s
2021-07-13T00:14:21.4404155Z apiservice.apiregistration.k8s.io/v1.submariner.io Local True 5m9s
2021-07-13T00:14:21.4406412Z apiservice.apiregistration.k8s.io/v1alpha1.multicluster.x-k8s.io Local True 5m10s
2021-07-13T00:14:21.4407921Z apiservice.apiregistration.k8s.io/v1alpha1.submariner.io Local True 5m19s
2021-07-13T00:14:21.4409483Z apiservice.apiregistration.k8s.io/v1beta1.admissionregistration.k8s.io Local True 7m36s
2021-07-13T00:14:21.4411141Z apiservice.apiregistration.k8s.io/v1beta1.apiextensions.k8s.io Local True 7m36s
2021-07-13T00:14:21.4412664Z apiservice.apiregistration.k8s.io/v1beta1.authentication.k8s.io Local True 7m35s
2021-07-13T00:14:21.4414253Z apiservice.apiregistration.k8s.io/v1beta1.authorization.k8s.io Local True 7m35s
2021-07-13T00:14:21.4415612Z apiservice.apiregistration.k8s.io/v1beta1.batch Local True 7m35s
2021-07-13T00:14:21.4416974Z apiservice.apiregistration.k8s.io/v1beta1.certificates.k8s.io Local True 7m35s
2021-07-13T00:14:21.4418466Z apiservice.apiregistration.k8s.io/v1beta1.coordination.k8s.io Local True 7m35s
2021-07-13T00:14:21.4419906Z apiservice.apiregistration.k8s.io/v1beta1.discovery.k8s.io Local True 7m35s
2021-07-13T00:14:21.4421294Z apiservice.apiregistration.k8s.io/v1beta1.events.k8s.io Local True 7m35s
2021-07-13T00:14:21.4422792Z apiservice.apiregistration.k8s.io/v1beta1.extensions Local True 7m35s
2021-07-13T00:14:21.4424172Z apiservice.apiregistration.k8s.io/v1beta1.networking.k8s.io Local True 7m35s
2021-07-13T00:14:21.4425552Z apiservice.apiregistration.k8s.io/v1beta1.node.k8s.io Local True 7m35s
2021-07-13T00:14:21.4426823Z apiservice.apiregistration.k8s.io/v1beta1.policy Local True 7m35s
2021-07-13T00:14:21.4428428Z apiservice.apiregistration.k8s.io/v1beta1.rbac.authorization.k8s.io Local True 7m35s
2021-07-13T00:14:21.4430587Z apiservice.apiregistration.k8s.io/v1beta1.scheduling.k8s.io Local True 7m35s
2021-07-13T00:14:21.4432006Z apiservice.apiregistration.k8s.io/v1beta1.storage.k8s.io Local True 7m35s
2021-07-13T00:14:21.4433354Z apiservice.apiregistration.k8s.io/v2beta1.autoscaling Local True 7m35s
2021-07-13T00:14:21.4434677Z apiservice.apiregistration.k8s.io/v2beta2.autoscaling Local True 7m35s
2021-07-13T00:14:24.5105330Z NAME AGE REQUESTOR CONDITION
2021-07-13T00:14:24.5107773Z certificatesigningrequest.certificates.k8s.io/csr-hgjmv 7m16s system:bootstrap:abcdef Approved,Issued
2021-07-13T00:14:24.5110368Z certificatesigningrequest.certificates.k8s.io/csr-tqqpb 7m15s system:bootstrap:abcdef Approved,Issued
2021-07-13T00:14:25.3227900Z NAME ADDRESSTYPE PORTS ENDPOINTS AGE
2021-07-13T00:14:25.3230138Z endpointslice.discovery.k8s.io/nginx-demo-cluster2 IPv4 8080 10.2.0.5,10.2.128.5 3m41s
2021-07-13T00:14:25.7866573Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-13T00:14:25.7870198Z 8m7s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 8m7s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5acb4
2021-07-13T00:14:25.7878689Z 8m7s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 8m7s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5c35d
2021-07-13T00:14:25.7887436Z 8m7s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 8m7s 7 event.events.k8s.io/cluster1-control-plane.169130f70dd5d16d
2021-07-13T00:14:25.7897343Z 7m35s Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 7m35s 1 event.events.k8s.io/cluster1-control-plane.169130feb1267f34
2021-07-13T00:14:25.7905328Z 7m34s Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 7m34s 1 event.events.k8s.io/cluster1-control-plane.169130febad52e76
2021-07-13T00:14:25.7911691Z 7m34s Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 7m34s 1 event.events.k8s.io/cluster1-control-plane.169130febad545e6
2021-07-13T00:14:25.7916177Z 7m34s Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 7m34s 1 event.events.k8s.io/cluster1-control-plane.169130febad5545a
2021-07-13T00:14:25.7920703Z 7m34s Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 7m34s 1 event.events.k8s.io/cluster1-control-plane.169130fed8008483
2021-07-13T00:14:25.7924182Z 7m19s Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 7m19s 1 event.events.k8s.io/cluster1-control-plane.1691310245ec7a16
2021-07-13T00:14:25.7930229Z 7m17s Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 7m17s 1 event.events.k8s.io/cluster1-control-plane.16913102afe326c6
2021-07-13T00:14:25.7935843Z 6m24s Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 6m24s 1 event.events.k8s.io/cluster1-control-plane.1691310f13b0f299
2021-07-13T00:14:25.7944361Z 7m3s Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 7m17s 8 event.events.k8s.io/cluster1-worker.16913102e44e5816
2021-07-13T00:14:25.7949084Z 7m3s Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 7m17s 8 event.events.k8s.io/cluster1-worker.16913102e44e7b3e
2021-07-13T00:14:25.7954615Z 6m59s Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 6m59s 1 event.events.k8s.io/cluster1-worker.16913106e1780153
2021-07-13T00:14:25.7961234Z 6m59s Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 6m59s 1 event.events.k8s.io/cluster1-worker.16913106ee14ec0c
2021-07-13T00:14:25.7967044Z 7m2s Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 7m15s 8 event.events.k8s.io/cluster1-worker2.1691310328eddd1d
2021-07-13T00:14:25.7971354Z 7m2s Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 7m15s 8 event.events.k8s.io/cluster1-worker2.1691310328ee1306
2021-07-13T00:14:25.7974430Z 6m59s Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 6m59s 1 event.events.k8s.io/cluster1-worker2.16913106ee151b50
2021-07-13T00:14:25.7977143Z 6m58s Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 6m58s 1 event.events.k8s.io/cluster1-worker2.1691310750164589
2021-07-13T00:14:29.6449896Z NAME AGE
2021-07-13T00:14:29.6452350Z clusterrolebinding.rbac.authorization.k8s.io/cluster-admin 7m43s
2021-07-13T00:14:29.6454541Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:kubelet-bootstrap 7m39s
2021-07-13T00:14:29.6456854Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-bootstrap 7m39s
2021-07-13T00:14:29.6461236Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-certificate-rotation 7m39s
2021-07-13T00:14:29.6463493Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-proxier 7m39s
2021-07-13T00:14:29.6465516Z clusterrolebinding.rbac.authorization.k8s.io/local-path-provisioner-bind 7m35s
2021-07-13T00:14:29.6467564Z clusterrolebinding.rbac.authorization.k8s.io/submariner-gateway 5m22s
2021-07-13T00:14:29.6469520Z clusterrolebinding.rbac.authorization.k8s.io/submariner-globalnet 5m21s
2021-07-13T00:14:29.6471804Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-agent 5m20s
2021-07-13T00:14:29.6474159Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-coredns 5m20s
2021-07-13T00:14:29.6476392Z clusterrolebinding.rbac.authorization.k8s.io/submariner-networkplugin-syncer 5m20s
2021-07-13T00:14:29.6479311Z clusterrolebinding.rbac.authorization.k8s.io/submariner-operator 5m22s
2021-07-13T00:14:29.6481294Z clusterrolebinding.rbac.authorization.k8s.io/submariner-routeagent 5m21s
2021-07-13T00:14:29.6483207Z clusterrolebinding.rbac.authorization.k8s.io/system:basic-user 7m43s
2021-07-13T00:14:29.6485213Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller 7m42s
2021-07-13T00:14:29.6487716Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller 7m42s
2021-07-13T00:14:29.6490106Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 7m42s
2021-07-13T00:14:29.6492371Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller 7m42s
2021-07-13T00:14:29.6494454Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller 7m42s
2021-07-13T00:14:29.6496562Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller 7m42s
2021-07-13T00:14:29.6498681Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller 7m42s
2021-07-13T00:14:29.6500783Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller 7m42s
2021-07-13T00:14:29.6503948Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller 7m42s
2021-07-13T00:14:29.6506094Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 7m42s
2021-07-13T00:14:29.6508388Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 7m42s
2021-07-13T00:14:29.6510486Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller 7m42s
2021-07-13T00:14:29.6512514Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller 7m42s
2021-07-13T00:14:29.6514559Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller 7m42s
2021-07-13T00:14:29.6516648Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 7m42s
2021-07-13T00:14:29.6548071Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 7m42s
2021-07-13T00:14:29.6550268Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pv-protection-controller 7m42s
2021-07-13T00:14:29.6552475Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 7m42s
2021-07-13T00:14:29.6554649Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replicaset-controller 7m42s
2021-07-13T00:14:29.6556784Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replication-controller 7m42s
2021-07-13T00:14:29.6560081Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:resourcequota-controller 7m42s
2021-07-13T00:14:29.6562415Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:route-controller 7m42s
2021-07-13T00:14:29.6564538Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-account-controller 7m42s
2021-07-13T00:14:29.6566733Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-controller 7m42s
2021-07-13T00:14:29.6568848Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:statefulset-controller 7m42s
2021-07-13T00:14:29.6570916Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:ttl-controller 7m42s
2021-07-13T00:14:29.6572604Z clusterrolebinding.rbac.authorization.k8s.io/system:coredns 7m39s
2021-07-13T00:14:29.6574512Z clusterrolebinding.rbac.authorization.k8s.io/system:discovery 7m43s
2021-07-13T00:14:29.6576651Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-controller-manager 7m43s
2021-07-13T00:14:29.6578592Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-dns 7m43s
2021-07-13T00:14:29.6580460Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-scheduler 7m43s
2021-07-13T00:14:29.6582098Z clusterrolebinding.rbac.authorization.k8s.io/system:node 7m42s
2021-07-13T00:14:29.6584238Z clusterrolebinding.rbac.authorization.k8s.io/system:node-proxier 7m43s
2021-07-13T00:14:29.6586237Z clusterrolebinding.rbac.authorization.k8s.io/system:public-info-viewer 7m43s
2021-07-13T00:14:29.6588179Z clusterrolebinding.rbac.authorization.k8s.io/system:volume-scheduler 7m43s
2021-07-13T00:14:29.6590037Z clusterrolebinding.rbac.authorization.k8s.io/weave-net 6m53s
2021-07-13T00:14:30.0938276Z NAME AGE
2021-07-13T00:14:30.0948717Z clusterrole.rbac.authorization.k8s.io/admin 7m44s
2021-07-13T00:14:30.0992841Z clusterrole.rbac.authorization.k8s.io/cluster-admin 7m44s
2021-07-13T00:14:30.0994258Z clusterrole.rbac.authorization.k8s.io/edit 7m44s
2021-07-13T00:14:30.0996039Z clusterrole.rbac.authorization.k8s.io/local-path-provisioner-role 7m36s
2021-07-13T00:14:30.0998024Z clusterrole.rbac.authorization.k8s.io/submariner-gateway 5m25s
2021-07-13T00:14:30.1001656Z clusterrole.rbac.authorization.k8s.io/submariner-globalnet 5m24s
2021-07-13T00:14:30.1003585Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-agent 5m21s
2021-07-13T00:14:30.1005596Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-coredns 5m21s
2021-07-13T00:14:30.1008009Z clusterrole.rbac.authorization.k8s.io/submariner-networkplugin-syncer 5m23s
2021-07-13T00:14:30.1009887Z clusterrole.rbac.authorization.k8s.io/submariner-operator 5m25s
2021-07-13T00:14:30.1011576Z clusterrole.rbac.authorization.k8s.io/submariner-routeagent 5m24s
2021-07-13T00:14:30.1013283Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-admin 7m44s
2021-07-13T00:14:30.1014968Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-edit 7m44s
2021-07-13T00:14:30.1016648Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-view 7m44s
2021-07-13T00:14:30.1018299Z clusterrole.rbac.authorization.k8s.io/system:auth-delegator 7m44s
2021-07-13T00:14:30.1019887Z clusterrole.rbac.authorization.k8s.io/system:basic-user 7m44s
2021-07-13T00:14:30.1021566Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:nodeclient 7m44s
2021-07-13T00:14:30.1023573Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 7m44s
2021-07-13T00:14:30.1025654Z clusterrole.rbac.authorization.k8s.io/system:controller:attachdetach-controller 7m44s
2021-07-13T00:14:30.1027533Z clusterrole.rbac.authorization.k8s.io/system:controller:certificate-controller 7m44s
2021-07-13T00:14:30.1029558Z clusterrole.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 7m44s
2021-07-13T00:14:30.1031555Z clusterrole.rbac.authorization.k8s.io/system:controller:cronjob-controller 7m44s
2021-07-13T00:14:30.1038372Z clusterrole.rbac.authorization.k8s.io/system:controller:daemon-set-controller 7m44s
2021-07-13T00:14:30.1040455Z clusterrole.rbac.authorization.k8s.io/system:controller:deployment-controller 7m44s
2021-07-13T00:14:30.1042620Z clusterrole.rbac.authorization.k8s.io/system:controller:disruption-controller 7m44s
2021-07-13T00:14:30.1044478Z clusterrole.rbac.authorization.k8s.io/system:controller:endpoint-controller 7m44s
2021-07-13T00:14:30.1046270Z clusterrole.rbac.authorization.k8s.io/system:controller:expand-controller 7m44s
2021-07-13T00:14:30.1048107Z clusterrole.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 7m44s
2021-07-13T00:14:30.1050036Z clusterrole.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 7m44s
2021-07-13T00:14:30.1052000Z clusterrole.rbac.authorization.k8s.io/system:controller:job-controller 7m44s
2021-07-13T00:14:30.1053790Z clusterrole.rbac.authorization.k8s.io/system:controller:namespace-controller 7m44s
2021-07-13T00:14:30.1055564Z clusterrole.rbac.authorization.k8s.io/system:controller:node-controller 7m44s
2021-07-13T00:14:30.1057369Z clusterrole.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 7m44s
2021-07-13T00:14:30.1059248Z clusterrole.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 7m44s
2021-07-13T00:14:30.1061121Z clusterrole.rbac.authorization.k8s.io/system:controller:pv-protection-controller 7m44s
2021-07-13T00:14:30.1063032Z clusterrole.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 7m44s
2021-07-13T00:14:30.1065137Z clusterrole.rbac.authorization.k8s.io/system:controller:replicaset-controller 7m44s
2021-07-13T00:14:30.1067027Z clusterrole.rbac.authorization.k8s.io/system:controller:replication-controller 7m44s
2021-07-13T00:14:30.1068944Z clusterrole.rbac.authorization.k8s.io/system:controller:resourcequota-controller 7m44s
2021-07-13T00:14:30.1070773Z clusterrole.rbac.authorization.k8s.io/system:controller:route-controller 7m44s
2021-07-13T00:14:30.1072603Z clusterrole.rbac.authorization.k8s.io/system:controller:service-account-controller 7m44s
2021-07-13T00:14:30.1074469Z clusterrole.rbac.authorization.k8s.io/system:controller:service-controller 7m44s
2021-07-13T00:14:30.1076273Z clusterrole.rbac.authorization.k8s.io/system:controller:statefulset-controller 7m44s
2021-07-13T00:14:30.1085692Z clusterrole.rbac.authorization.k8s.io/system:controller:ttl-controller 7m44s
2021-07-13T00:14:30.1087099Z clusterrole.rbac.authorization.k8s.io/system:coredns 7m40s
2021-07-13T00:14:30.1089311Z clusterrole.rbac.authorization.k8s.io/system:discovery 7m44s
2021-07-13T00:14:30.1092265Z clusterrole.rbac.authorization.k8s.io/system:heapster 7m44s
2021-07-13T00:14:30.1097295Z clusterrole.rbac.authorization.k8s.io/system:kube-aggregator 7m44s
2021-07-13T00:14:30.1099051Z clusterrole.rbac.authorization.k8s.io/system:kube-controller-manager 7m44s
2021-07-13T00:14:30.1103048Z clusterrole.rbac.authorization.k8s.io/system:kube-dns 7m44s
2021-07-13T00:14:30.1104706Z clusterrole.rbac.authorization.k8s.io/system:kube-scheduler 7m44s
2021-07-13T00:14:30.1106370Z clusterrole.rbac.authorization.k8s.io/system:kubelet-api-admin 7m44s
2021-07-13T00:14:30.1109888Z clusterrole.rbac.authorization.k8s.io/system:node 7m44s
2021-07-13T00:14:30.1111658Z clusterrole.rbac.authorization.k8s.io/system:node-bootstrapper 7m44s
2021-07-13T00:14:30.1113387Z clusterrole.rbac.authorization.k8s.io/system:node-problem-detector 7m44s
2021-07-13T00:14:30.1115545Z clusterrole.rbac.authorization.k8s.io/system:node-proxier 7m44s
2021-07-13T00:14:30.1117553Z clusterrole.rbac.authorization.k8s.io/system:persistent-volume-provisioner 7m44s
2021-07-13T00:14:30.1119859Z clusterrole.rbac.authorization.k8s.io/system:public-info-viewer 7m44s
2021-07-13T00:14:30.1121834Z clusterrole.rbac.authorization.k8s.io/system:volume-scheduler 7m44s
2021-07-13T00:14:30.1123167Z clusterrole.rbac.authorization.k8s.io/view 7m44s
2021-07-13T00:14:30.1124656Z clusterrole.rbac.authorization.k8s.io/weave-net 6m54s
2021-07-13T00:14:31.5004391Z NAME VALUE GLOBAL-DEFAULT AGE
2021-07-13T00:14:31.5022806Z priorityclass.scheduling.k8s.io/system-cluster-critical 2000000000 false 7m45s
2021-07-13T00:14:31.5038475Z priorityclass.scheduling.k8s.io/system-node-critical 2000001000 false 7m45s
2021-07-13T00:14:32.5268345Z NAME CREATED AT
2021-07-13T00:14:32.5270031Z csinode.storage.k8s.io/cluster1-control-plane 2021-07-13T00:06:49Z
2021-07-13T00:14:32.5271525Z csinode.storage.k8s.io/cluster1-worker 2021-07-13T00:07:23Z
2021-07-13T00:14:32.5272584Z csinode.storage.k8s.io/cluster1-worker2 2021-07-13T00:07:25Z
2021-07-13T00:14:32.9465796Z NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
2021-07-13T00:14:32.9468161Z storageclass.storage.k8s.io/standard (default) rancher.io/local-path Delete WaitForFirstConsumer false 7m38s
2021-07-13T00:14:37.4561794Z [lighthouse]$ [cluster2] print_section * Details of pods with statuses other than Running in cluster2 *
2021-07-13T00:14:37.4581873Z [lighthouse]$ [cluster2] print_section * Details of pods with statuses other than Running in cluster2 *
2021-07-13T00:14:37.4588363Z ====================================================================
2021-07-13T00:14:37.4596247Z ##[endgroup]
2021-07-13T00:14:37.4605649Z ##[group]* Details of pods with statuses other than Running in cluster2 *
2021-07-13T00:14:37.4611582Z ======================= * Details of pods with statuses other than Running in cluster2 * =======================
2021-07-13T00:14:37.4638493Z [lighthouse]$ [cluster2] kubectl get pods -A
2021-07-13T00:14:37.4659301Z [lighthouse]$ [cluster2] tail -n +2
2021-07-13T00:14:37.4699931Z [lighthouse]$ [cluster2] grep -v Running
2021-07-13T00:14:37.4707026Z [lighthouse]$ [cluster2] kubectl get pods -A
2021-07-13T00:14:37.4733516Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -A
2021-07-13T00:14:37.4761884Z [lighthouse]$ [cluster2] sed s/ */;/g
2021-07-13T00:14:37.8309379Z [lighthouse]$ [cluster2] print_section * Kube-proxy pod logs for cluster2 *
2021-07-13T00:14:37.8324842Z [lighthouse]$ [cluster2] print_section * Kube-proxy pod logs for cluster2 *
2021-07-13T00:14:37.8328140Z ====================================================================
2021-07-13T00:14:37.8328646Z ##[endgroup]
2021-07-13T00:14:37.8329841Z ##[group]* Kube-proxy pod logs for cluster2 *
2021-07-13T00:14:37.8330694Z ======================= * Kube-proxy pod logs for cluster2 * =======================
2021-07-13T00:14:37.8343712Z [lighthouse]$ [cluster2] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-13T00:14:37.8352458Z [lighthouse]$ [cluster2] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-13T00:14:37.8367906Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:37.8378401Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:37.8383830Z ====================================================================
2021-07-13T00:14:37.8387154Z ##[endgroup]
2021-07-13T00:14:37.8391175Z ##[group]** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-13T00:14:37.8393950Z ======================= ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' ** =======================
2021-07-13T00:14:37.8411717Z [lighthouse]$ [cluster2] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:37.8427416Z [lighthouse]$ [cluster2] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:37.8440625Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:38.1770216Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-9w2qv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:38.1787455Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-9w2qv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:38.1807862Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n kube-system kube-proxy-9w2qv -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:38.4965185Z [lighthouse]$ [cluster2] print_section *** kube-proxy-9w2qv ***
2021-07-13T00:14:38.4979381Z [lighthouse]$ [cluster2] print_section *** kube-proxy-9w2qv ***
2021-07-13T00:14:38.4985093Z ====================================================================
2021-07-13T00:14:38.4986385Z ##[endgroup]
2021-07-13T00:14:38.4991442Z ##[group]*** kube-proxy-9w2qv ***
2021-07-13T00:14:38.4995766Z ======================= *** kube-proxy-9w2qv *** =======================
2021-07-13T00:14:38.5012100Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-9w2qv
2021-07-13T00:14:38.5025088Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-9w2qv
2021-07-13T00:14:38.5041859Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n kube-system logs kube-proxy-9w2qv
2021-07-13T00:14:38.8817682Z I0713 00:07:19.533360 1 node.go:135] Successfully retrieved node IP: 172.18.0.10
2021-07-13T00:14:38.8818479Z I0713 00:07:19.533606 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:38.8819128Z I0713 00:07:19.538421 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:38.8820572Z I0713 00:07:19.539149 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:38.8821809Z I0713 00:07:19.539340 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:38.8822648Z I0713 00:07:19.553069 1 config.go:313] Starting service config controller
2021-07-13T00:14:38.8823426Z I0713 00:07:19.553235 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:38.8824209Z I0713 00:07:19.553404 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:38.8825012Z I0713 00:07:19.553499 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:38.8825844Z I0713 00:07:19.653531 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:38.8826845Z I0713 00:07:19.653791 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:38.8948082Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-fx7jz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:38.8999395Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-fx7jz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:38.9012471Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n kube-system kube-proxy-fx7jz -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:39.2502057Z [lighthouse]$ [cluster2] print_section *** kube-proxy-fx7jz ***
2021-07-13T00:14:39.2518895Z [lighthouse]$ [cluster2] print_section *** kube-proxy-fx7jz ***
2021-07-13T00:14:39.2519677Z ====================================================================
2021-07-13T00:14:39.2528613Z ##[endgroup]
2021-07-13T00:14:39.2529640Z ##[group]*** kube-proxy-fx7jz ***
2021-07-13T00:14:39.2530486Z ======================= *** kube-proxy-fx7jz *** =======================
2021-07-13T00:14:39.2539622Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-fx7jz
2021-07-13T00:14:39.2571988Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-fx7jz
2021-07-13T00:14:39.2624227Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n kube-system logs kube-proxy-fx7jz
2021-07-13T00:14:39.5820848Z I0713 00:07:21.253487 1 node.go:135] Successfully retrieved node IP: 172.18.0.5
2021-07-13T00:14:39.5823174Z I0713 00:07:21.253712 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:39.5823912Z I0713 00:07:21.254332 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:39.5825408Z I0713 00:07:21.257820 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:39.5826985Z I0713 00:07:21.260243 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:39.5828017Z I0713 00:07:21.265365 1 config.go:313] Starting service config controller
2021-07-13T00:14:39.5828800Z I0713 00:07:21.267602 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:39.5829709Z I0713 00:07:21.265512 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:39.5830506Z I0713 00:07:21.267872 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:39.5831345Z I0713 00:07:21.368860 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:39.5832140Z I0713 00:07:21.368860 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:39.5889667Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-l75pb -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:39.5904645Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-proxy-l75pb -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:39.5918188Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n kube-system kube-proxy-l75pb -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:39.8997590Z [lighthouse]$ [cluster2] print_section *** kube-proxy-l75pb ***
2021-07-13T00:14:39.9010544Z [lighthouse]$ [cluster2] print_section *** kube-proxy-l75pb ***
2021-07-13T00:14:39.9016625Z ====================================================================
2021-07-13T00:14:39.9023025Z ##[endgroup]
2021-07-13T00:14:39.9024344Z ##[group]*** kube-proxy-l75pb ***
2021-07-13T00:14:39.9027210Z ======================= *** kube-proxy-l75pb *** =======================
2021-07-13T00:14:39.9040850Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-l75pb
2021-07-13T00:14:39.9052754Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-proxy-l75pb
2021-07-13T00:14:39.9065619Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n kube-system logs kube-proxy-l75pb
2021-07-13T00:14:40.2394594Z I0713 00:06:59.709086 1 node.go:135] Successfully retrieved node IP: 172.18.0.8
2021-07-13T00:14:40.2395490Z I0713 00:06:59.709145 1 server_others.go:145] Using iptables Proxier.
2021-07-13T00:14:40.2396369Z I0713 00:06:59.709427 1 server.go:571] Version: v1.17.17
2021-07-13T00:14:40.2398773Z I0713 00:06:59.709895 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-13T00:14:40.2403396Z I0713 00:06:59.709979 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-13T00:14:40.2404295Z I0713 00:06:59.711544 1 config.go:131] Starting endpoints config controller
2021-07-13T00:14:40.2405126Z I0713 00:06:59.712083 1 shared_informer.go:197] Waiting for caches to sync for endpoints config
2021-07-13T00:14:40.2405905Z I0713 00:06:59.712293 1 config.go:313] Starting service config controller
2021-07-13T00:14:40.2406812Z I0713 00:06:59.712424 1 shared_informer.go:197] Waiting for caches to sync for service config
2021-07-13T00:14:40.2407634Z I0713 00:06:59.815321 1 shared_informer.go:204] Caches are synced for service config
2021-07-13T00:14:40.2408425Z I0713 00:06:59.815448 1 shared_informer.go:204] Caches are synced for endpoints config
2021-07-13T00:14:40.2479601Z [lighthouse]$ [cluster2] print_section * Kube-controller-manager pod logs for cluster2 *
2021-07-13T00:14:40.2494658Z [lighthouse]$ [cluster2] print_section * Kube-controller-manager pod logs for cluster2 *
2021-07-13T00:14:40.2497236Z ====================================================================
2021-07-13T00:14:40.2501011Z ##[endgroup]
2021-07-13T00:14:40.2504298Z ##[group]* Kube-controller-manager pod logs for cluster2 *
2021-07-13T00:14:40.2507315Z ======================= * Kube-controller-manager pod logs for cluster2 * =======================
2021-07-13T00:14:40.2520327Z [lighthouse]$ [cluster2] print_pods_logs kube-system component=kube-controller-manager
2021-07-13T00:14:40.2532255Z [lighthouse]$ [cluster2] print_pods_logs kube-system component=kube-controller-manager
2021-07-13T00:14:40.2545275Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:40.2560140Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:40.2562541Z ====================================================================
2021-07-13T00:14:40.2569341Z ##[endgroup]
2021-07-13T00:14:40.2570978Z ##[group]** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-13T00:14:40.2572501Z ======================= ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' ** =======================
2021-07-13T00:14:40.2593516Z [lighthouse]$ [cluster2] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:40.2610765Z [lighthouse]$ [cluster2] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:40.2627334Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:40.6102068Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-controller-manager-cluster2-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:40.6122226Z [lighthouse]$ [cluster2] kubectl get pods -n kube-system kube-controller-manager-cluster2-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:40.6143435Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n kube-system kube-controller-manager-cluster2-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:40.9111845Z [lighthouse]$ [cluster2] print_section *** kube-controller-manager-cluster2-control-plane ***
2021-07-13T00:14:40.9122167Z [lighthouse]$ [cluster2] print_section *** kube-controller-manager-cluster2-control-plane ***
2021-07-13T00:14:40.9125096Z ====================================================================
2021-07-13T00:14:40.9127837Z ##[endgroup]
2021-07-13T00:14:40.9133137Z ##[group]*** kube-controller-manager-cluster2-control-plane ***
2021-07-13T00:14:40.9135185Z ======================= *** kube-controller-manager-cluster2-control-plane *** =======================
2021-07-13T00:14:40.9147725Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-controller-manager-cluster2-control-plane
2021-07-13T00:14:40.9163409Z [lighthouse]$ [cluster2] kubectl -n kube-system logs kube-controller-manager-cluster2-control-plane
2021-07-13T00:14:40.9182964Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n kube-system logs kube-controller-manager-cluster2-control-plane
2021-07-13T00:14:41.2590587Z Flag --port has been deprecated, see --secure-port instead.
2021-07-13T00:14:41.2595025Z I0713 00:06:28.911559 1 serving.go:312] Generated self-signed cert in-memory
2021-07-13T00:14:41.2597420Z I0713 00:06:30.119974 1 controllermanager.go:161] Version: v1.17.17
2021-07-13T00:14:41.2602516Z I0713 00:06:30.123813 1 dynamic_cafile_content.go:166] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
2021-07-13T00:14:41.2605221Z I0713 00:06:30.124434 1 dynamic_cafile_content.go:166] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
2021-07-13T00:14:41.2607669Z I0713 00:06:30.124542 1 secure_serving.go:178] Serving securely on 127.0.0.1:10257
2021-07-13T00:14:41.2610765Z I0713 00:06:30.124580 1 leaderelection.go:242] attempting to acquire leader lease kube-system/kube-controller-manager...
2021-07-13T00:14:41.2612789Z I0713 00:06:30.124757 1 tlsconfig.go:219] Starting DynamicServingCertificateController
2021-07-13T00:14:41.2617869Z E0713 00:06:40.074718 1 leaderelection.go:335] error retrieving resource lock kube-system/kube-controller-manager: endpoints "kube-controller-manager" is forbidden: User "system:kube-controller-manager" cannot get resource "endpoints" in API group "" in the namespace "kube-system"
2021-07-13T00:14:41.2623725Z I0713 00:06:42.324826 1 leaderelection.go:252] successfully acquired lease kube-system/kube-controller-manager
2021-07-13T00:14:41.2644447Z I0713 00:06:42.325323 1 event.go:281] Event(v1.ObjectReference{Kind:"Endpoints", Namespace:"kube-system", Name:"kube-controller-manager", UID:"a0e8f867-02b4-4de2-8448-50846df77669", APIVersion:"v1", ResourceVersion:"154", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster2-control-plane_3fe5d660-a140-4469-bdd5-24b486efe295 became leader
2021-07-13T00:14:41.2669603Z I0713 00:06:42.325549 1 event.go:281] Event(v1.ObjectReference{Kind:"Lease", Namespace:"kube-system", Name:"kube-controller-manager", UID:"a8bcc62e-2221-4a6d-9bb3-2ae2d5f98dd2", APIVersion:"coordination.k8s.io/v1", ResourceVersion:"155", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster2-control-plane_3fe5d660-a140-4469-bdd5-24b486efe295 became leader
2021-07-13T00:14:41.2673880Z I0713 00:06:42.602978 1 plugins.go:100] No cloud provider specified.
2021-07-13T00:14:41.2675319Z I0713 00:06:42.605445 1 shared_informer.go:197] Waiting for caches to sync for tokens
2021-07-13T00:14:41.2676764Z I0713 00:06:42.705753 1 shared_informer.go:204] Caches are synced for tokens
2021-07-13T00:14:41.2695617Z I0713 00:06:42.737156 1 controllermanager.go:533] Started "bootstrapsigner"
2021-07-13T00:14:41.2719926Z W0713 00:06:42.737349 1 controllermanager.go:525] Skipping "ttl-after-finished"
2021-07-13T00:14:41.2720903Z I0713 00:06:42.737652 1 shared_informer.go:197] Waiting for caches to sync for bootstrap_signer
2021-07-13T00:14:41.2722027Z I0713 00:06:42.772596 1 controllermanager.go:533] Started "cronjob"
2021-07-13T00:14:41.2722821Z I0713 00:06:42.774220 1 cronjob_controller.go:97] Starting CronJob Manager
2021-07-13T00:14:41.2724046Z I0713 00:06:42.838180 1 controllermanager.go:533] Started "serviceaccount"
2021-07-13T00:14:41.2729523Z W0713 00:06:42.838209 1 core.go:246] configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes.
2021-07-13T00:14:41.2730948Z W0713 00:06:42.838215 1 controllermanager.go:525] Skipping "route"
2021-07-13T00:14:41.2732376Z I0713 00:06:42.838495 1 serviceaccounts_controller.go:116] Starting service account controller
2021-07-13T00:14:41.2739907Z I0713 00:06:42.839434 1 shared_informer.go:197] Waiting for caches to sync for service account
2021-07-13T00:14:41.2742651Z I0713 00:06:42.895351 1 controllermanager.go:533] Started "persistentvolume-expander"
2021-07-13T00:14:41.2744997Z W0713 00:06:42.895395 1 controllermanager.go:525] Skipping "root-ca-cert-publisher"
2021-07-13T00:14:41.2751821Z I0713 00:06:42.895558 1 expand_controller.go:303] Starting expand controller
2021-07-13T00:14:41.2755297Z I0713 00:06:42.895576 1 shared_informer.go:197] Waiting for caches to sync for expand
2021-07-13T00:14:41.2799933Z I0713 00:06:42.950682 1 controllermanager.go:533] Started "namespace"
2021-07-13T00:14:41.2800968Z I0713 00:06:42.951254 1 namespace_controller.go:200] Starting namespace controller
2021-07-13T00:14:41.2801800Z I0713 00:06:42.951262 1 shared_informer.go:197] Waiting for caches to sync for namespace
2021-07-13T00:14:41.2802635Z I0713 00:06:42.994174 1 controllermanager.go:533] Started "tokencleaner"
2021-07-13T00:14:41.2804094Z I0713 00:06:42.994323 1 tokencleaner.go:117] Starting token cleaner controller
2021-07-13T00:14:41.2804919Z I0713 00:06:42.994330 1 shared_informer.go:197] Waiting for caches to sync for token_cleaner
2021-07-13T00:14:41.2805743Z I0713 00:06:42.994336 1 shared_informer.go:204] Caches are synced for token_cleaner
2021-07-13T00:14:41.2806655Z I0713 00:06:43.047814 1 node_ipam_controller.go:94] Sending events to api server.
2021-07-13T00:14:41.2807995Z I0713 00:06:53.051154 1 range_allocator.go:82] Sending events to api server.
2021-07-13T00:14:41.2809004Z I0713 00:06:53.051377 1 range_allocator.go:116] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses.
2021-07-13T00:14:41.2810034Z I0713 00:06:53.051629 1 controllermanager.go:533] Started "nodeipam"
2021-07-13T00:14:41.2810814Z I0713 00:06:53.051653 1 node_ipam_controller.go:162] Starting ipam controller
2021-07-13T00:14:41.2811576Z I0713 00:06:53.051886 1 shared_informer.go:197] Waiting for caches to sync for node
2021-07-13T00:14:41.2813266Z I0713 00:06:53.074859 1 controllermanager.go:533] Started "clusterrole-aggregation"
2021-07-13T00:14:41.2814443Z I0713 00:06:53.075095 1 clusterroleaggregation_controller.go:148] Starting ClusterRoleAggregator
2021-07-13T00:14:41.2815595Z I0713 00:06:53.080719 1 shared_informer.go:197] Waiting for caches to sync for ClusterRoleAggregator
2021-07-13T00:14:41.2816620Z I0713 00:06:53.108589 1 controllermanager.go:533] Started "replicationcontroller"
2021-07-13T00:14:41.2817631Z I0713 00:06:53.108838 1 replica_set.go:181] Starting replicationcontroller controller
2021-07-13T00:14:41.2818615Z I0713 00:06:53.108919 1 shared_informer.go:197] Waiting for caches to sync for ReplicationController
2021-07-13T00:14:41.2819932Z I0713 00:06:53.392384 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
2021-07-13T00:14:41.2821527Z I0713 00:06:53.392602 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
2021-07-13T00:14:41.2822826Z I0713 00:06:53.392761 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for limitranges
2021-07-13T00:14:41.2824157Z I0713 00:06:53.392902 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for statefulsets.apps
2021-07-13T00:14:41.2830424Z I0713 00:06:53.392998 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for events.events.k8s.io
2021-07-13T00:14:41.2834373Z I0713 00:06:53.393093 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling
2021-07-13T00:14:41.2836507Z I0713 00:06:53.393203 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpoints
2021-07-13T00:14:41.2862601Z I0713 00:06:53.393312 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for jobs.batch
2021-07-13T00:14:41.2864717Z I0713 00:06:53.393408 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for podtemplates
2021-07-13T00:14:41.2867666Z I0713 00:06:53.393523 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for daemonsets.apps
2021-07-13T00:14:41.2870423Z I0713 00:06:53.393619 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for deployments.apps
2021-07-13T00:14:41.2871702Z I0713 00:06:53.393722 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
2021-07-13T00:14:41.2873094Z W0713 00:06:53.393803 1 shared_informer.go:415] resyncPeriod 62644256354316 is smaller than resyncCheckPeriod 78733095491768 and the informer has already started. Changing it to 78733095491768
2021-07-13T00:14:41.2874438Z I0713 00:06:53.393983 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for replicasets.apps
2021-07-13T00:14:41.2876349Z I0713 00:06:53.394133 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
2021-07-13T00:14:41.2877894Z I0713 00:06:53.394247 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceaccounts
2021-07-13T00:14:41.2879174Z I0713 00:06:53.394370 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
2021-07-13T00:14:41.2880786Z I0713 00:06:53.394484 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
2021-07-13T00:14:41.2882395Z I0713 00:06:53.394594 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy
2021-07-13T00:14:41.2883727Z I0713 00:06:53.394732 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for ingresses.extensions
2021-07-13T00:14:41.2885044Z I0713 00:06:53.394833 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for controllerrevisions.apps
2021-07-13T00:14:41.2886296Z I0713 00:06:53.394944 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for cronjobs.batch
2021-07-13T00:14:41.2887298Z I0713 00:06:53.395044 1 controllermanager.go:533] Started "resourcequota"
2021-07-13T00:14:41.2888329Z I0713 00:06:53.395135 1 resource_quota_controller.go:271] Starting resource quota controller
2021-07-13T00:14:41.2889230Z I0713 00:06:53.396219 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:41.2890012Z I0713 00:06:53.396244 1 resource_quota_monitor.go:303] QuotaMonitor running
2021-07-13T00:14:41.2890803Z I0713 00:06:53.416866 1 controllermanager.go:533] Started "csrsigning"
2021-07-13T00:14:41.2891749Z I0713 00:06:53.417064 1 certificate_controller.go:118] Starting certificate controller "csrsigning"
2021-07-13T00:14:41.2893544Z I0713 00:06:53.417270 1 shared_informer.go:197] Waiting for caches to sync for certificate-csrsigning
2021-07-13T00:14:41.2894872Z I0713 00:06:53.448267 1 controllermanager.go:533] Started "persistentvolume-binder"
2021-07-13T00:14:41.2896146Z I0713 00:06:53.448557 1 pv_controller_base.go:294] Starting persistent volume controller
2021-07-13T00:14:41.2897034Z I0713 00:06:53.448850 1 shared_informer.go:197] Waiting for caches to sync for persistent volume
2021-07-13T00:14:41.2897895Z I0713 00:06:53.470377 1 controllermanager.go:533] Started "endpoint"
2021-07-13T00:14:41.2898765Z I0713 00:06:53.470706 1 endpoints_controller.go:181] Starting endpoint controller
2021-07-13T00:14:41.2899589Z I0713 00:06:53.470807 1 shared_informer.go:197] Waiting for caches to sync for endpoint
2021-07-13T00:14:41.2900399Z I0713 00:06:53.505131 1 controllermanager.go:533] Started "job"
2021-07-13T00:14:41.2901132Z I0713 00:06:53.506225 1 job_controller.go:144] Starting job controller
2021-07-13T00:14:41.2901853Z I0713 00:06:53.506333 1 shared_informer.go:197] Waiting for caches to sync for job
2021-07-13T00:14:41.2902595Z I0713 00:06:53.554616 1 controllermanager.go:533] Started "ttl"
2021-07-13T00:14:41.2903384Z I0713 00:06:53.554808 1 ttl_controller.go:116] Starting TTL controller
2021-07-13T00:14:41.2904124Z I0713 00:06:53.554973 1 shared_informer.go:197] Waiting for caches to sync for TTL
2021-07-13T00:14:41.2904911Z I0713 00:06:53.703942 1 node_lifecycle_controller.go:388] Sending events to api server.
2021-07-13T00:14:41.2936218Z I0713 00:06:53.704564 1 node_lifecycle_controller.go:423] Controller is using taint based evictions.
2021-07-13T00:14:41.2942458Z I0713 00:06:53.704733 1 taint_manager.go:162] Sending events to api server.
2021-07-13T00:14:41.2946521Z I0713 00:06:53.704900 1 node_lifecycle_controller.go:520] Controller will reconcile labels.
2021-07-13T00:14:41.2948684Z I0713 00:06:53.707831 1 controllermanager.go:533] Started "nodelifecycle"
2021-07-13T00:14:41.2951164Z I0713 00:06:53.708108 1 node_lifecycle_controller.go:554] Starting node controller
2021-07-13T00:14:41.2953065Z I0713 00:06:53.708203 1 shared_informer.go:197] Waiting for caches to sync for taint
2021-07-13T00:14:41.2956072Z I0713 00:06:53.955069 1 controllermanager.go:533] Started "podgc"
2021-07-13T00:14:41.2960794Z I0713 00:06:53.955232 1 gc_controller.go:88] Starting GC controller
2021-07-13T00:14:41.2963477Z I0713 00:06:53.955445 1 shared_informer.go:197] Waiting for caches to sync for GC
2021-07-13T00:14:41.2965485Z I0713 00:06:54.205916 1 controllermanager.go:533] Started "daemonset"
2021-07-13T00:14:41.2967692Z I0713 00:06:54.205978 1 daemon_controller.go:284] Starting daemon sets controller
2021-07-13T00:14:41.2969419Z I0713 00:06:54.205985 1 shared_informer.go:197] Waiting for caches to sync for daemon sets
2021-07-13T00:14:41.2970247Z I0713 00:06:54.455499 1 controllermanager.go:533] Started "deployment"
2021-07-13T00:14:41.2999534Z I0713 00:06:54.455631 1 deployment_controller.go:152] Starting deployment controller
2021-07-13T00:14:41.3000555Z I0713 00:06:54.455650 1 shared_informer.go:197] Waiting for caches to sync for deployment
2021-07-13T00:14:41.3001948Z I0713 00:06:54.704632 1 controllermanager.go:533] Started "replicaset"
2021-07-13T00:14:41.3002962Z I0713 00:06:54.704694 1 replica_set.go:181] Starting replicaset controller
2021-07-13T00:14:41.3003759Z I0713 00:06:54.704709 1 shared_informer.go:197] Waiting for caches to sync for ReplicaSet
2021-07-13T00:14:41.3004844Z I0713 00:06:55.104083 1 controllermanager.go:533] Started "disruption"
2021-07-13T00:14:41.3005986Z I0713 00:06:55.104177 1 disruption.go:330] Starting disruption controller
2021-07-13T00:14:41.3006943Z I0713 00:06:55.104185 1 shared_informer.go:197] Waiting for caches to sync for disruption
2021-07-13T00:14:41.3007762Z I0713 00:06:55.256114 1 node_lifecycle_controller.go:77] Sending events to api server
2021-07-13T00:14:41.3010158Z E0713 00:06:55.256773 1 core.go:232] failed to start cloud node lifecycle controller: no cloud provider provided
2021-07-13T00:14:41.3012627Z W0713 00:06:55.256917 1 controllermanager.go:525] Skipping "cloud-node-lifecycle"
2021-07-13T00:14:41.3014150Z I0713 00:06:55.511379 1 controllermanager.go:533] Started "attachdetach"
2021-07-13T00:14:41.3015033Z I0713 00:06:55.511451 1 attach_detach_controller.go:352] Starting attach detach controller
2021-07-13T00:14:41.3015861Z I0713 00:06:55.511893 1 shared_informer.go:197] Waiting for caches to sync for attach detach
2021-07-13T00:14:41.3017040Z I0713 00:06:55.755851 1 controllermanager.go:533] Started "pv-protection"
2021-07-13T00:14:41.3017930Z W0713 00:06:55.756095 1 controllermanager.go:525] Skipping "endpointslice"
2021-07-13T00:14:41.3018849Z I0713 00:06:55.756345 1 pv_protection_controller.go:81] Starting PV protection controller
2021-07-13T00:14:41.3019745Z I0713 00:06:55.756749 1 shared_informer.go:197] Waiting for caches to sync for PV protection
2021-07-13T00:14:41.3020867Z I0713 00:06:56.454384 1 controllermanager.go:533] Started "horizontalpodautoscaling"
2021-07-13T00:14:41.3021789Z I0713 00:06:56.454454 1 horizontal.go:156] Starting HPA controller
2021-07-13T00:14:41.3022508Z I0713 00:06:56.454460 1 shared_informer.go:197] Waiting for caches to sync for HPA
2021-07-13T00:14:41.3023315Z I0713 00:06:56.604083 1 controllermanager.go:533] Started "csrapproving"
2021-07-13T00:14:41.3024269Z I0713 00:06:56.604292 1 certificate_controller.go:118] Starting certificate controller "csrapproving"
2021-07-13T00:14:41.3025624Z I0713 00:06:56.604596 1 shared_informer.go:197] Waiting for caches to sync for certificate-csrapproving
2021-07-13T00:14:41.3026910Z I0713 00:06:56.754311 1 controllermanager.go:533] Started "csrcleaner"
2021-07-13T00:14:41.3028423Z I0713 00:06:56.754508 1 cleaner.go:81] Starting CSR cleaner controller
2021-07-13T00:14:41.3029744Z I0713 00:06:57.004417 1 controllermanager.go:533] Started "pvc-protection"
2021-07-13T00:14:41.3030663Z I0713 00:06:57.004650 1 pvc_protection_controller.go:100] Starting PVC protection controller
2021-07-13T00:14:41.3031561Z I0713 00:06:57.004753 1 shared_informer.go:197] Waiting for caches to sync for PVC protection
2021-07-13T00:14:41.3032438Z I0713 00:06:57.909355 1 controllermanager.go:533] Started "garbagecollector"
2021-07-13T00:14:41.3033377Z I0713 00:06:57.909729 1 garbagecollector.go:129] Starting garbage collector controller
2021-07-13T00:14:41.3034281Z I0713 00:06:57.910613 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:41.3035051Z I0713 00:06:57.910748 1 graph_builder.go:282] GraphBuilder running
2021-07-13T00:14:41.3036051Z E0713 00:06:57.936558 1 core.go:91] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail
2021-07-13T00:14:41.3047338Z W0713 00:06:57.936840 1 controllermanager.go:525] Skipping "service"
2021-07-13T00:14:41.3048626Z I0713 00:06:57.955411 1 controllermanager.go:533] Started "statefulset"
2021-07-13T00:14:41.3049799Z I0713 00:06:57.955863 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:41.3050587Z I0713 00:06:57.955528 1 stateful_set.go:145] Starting stateful set controller
2021-07-13T00:14:41.3051369Z I0713 00:06:57.955997 1 shared_informer.go:197] Waiting for caches to sync for stateful set
2021-07-13T00:14:41.3053354Z W0713 00:06:57.987483 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster2-control-plane" does not exist
2021-07-13T00:14:41.3054798Z I0713 00:06:58.006529 1 shared_informer.go:204] Caches are synced for job
2021-07-13T00:14:41.3055667Z I0713 00:06:58.009276 1 shared_informer.go:204] Caches are synced for ReplicationController
2021-07-13T00:14:41.3056577Z I0713 00:06:58.037922 1 shared_informer.go:204] Caches are synced for bootstrap_signer
2021-07-13T00:14:41.3057559Z I0713 00:06:58.041291 1 shared_informer.go:204] Caches are synced for service account
2021-07-13T00:14:41.3058327Z I0713 00:06:58.061395 1 shared_informer.go:204] Caches are synced for TTL
2021-07-13T00:14:41.3059095Z I0713 00:06:58.066301 1 shared_informer.go:204] Caches are synced for PV protection
2021-07-13T00:14:41.3059849Z I0713 00:06:58.067244 1 shared_informer.go:204] Caches are synced for GC
2021-07-13T00:14:41.3060569Z I0713 00:06:58.067484 1 shared_informer.go:204] Caches are synced for namespace
2021-07-13T00:14:41.3061311Z I0713 00:06:58.067494 1 shared_informer.go:204] Caches are synced for node
2021-07-13T00:14:41.3062030Z I0713 00:06:58.074045 1 range_allocator.go:172] Starting range CIDR allocator
2021-07-13T00:14:41.3062839Z I0713 00:06:58.074069 1 shared_informer.go:197] Waiting for caches to sync for cidrallocator
2021-07-13T00:14:41.3063707Z I0713 00:06:58.074115 1 shared_informer.go:204] Caches are synced for cidrallocator
2021-07-13T00:14:41.3064462Z I0713 00:06:58.067600 1 shared_informer.go:204] Caches are synced for HPA
2021-07-13T00:14:41.3068033Z I0713 00:06:58.073683 1 shared_informer.go:204] Caches are synced for endpoint
2021-07-13T00:14:41.3069112Z I0713 00:06:58.081989 1 shared_informer.go:204] Caches are synced for ClusterRoleAggregator
2021-07-13T00:14:41.3071107Z I0713 00:06:58.086192 1 range_allocator.go:373] Set node cluster2-control-plane PodCIDR to [10.2.0.0/24]
2021-07-13T00:14:41.3072000Z I0713 00:06:58.096292 1 shared_informer.go:204] Caches are synced for expand
2021-07-13T00:14:41.3073216Z I0713 00:06:58.106005 1 shared_informer.go:204] Caches are synced for PVC protection
2021-07-13T00:14:41.3074981Z E0713 00:06:58.115175 1 clusterroleaggregation_controller.go:180] admin failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "admin": the object has been modified; please apply your changes to the latest version and try again
2021-07-13T00:14:41.3081707Z I0713 00:06:58.150071 1 shared_informer.go:204] Caches are synced for persistent volume
2021-07-13T00:14:41.3082588Z I0713 00:06:58.160304 1 shared_informer.go:204] Caches are synced for stateful set
2021-07-13T00:14:41.3083361Z I0713 00:06:58.206106 1 shared_informer.go:204] Caches are synced for daemon sets
2021-07-13T00:14:41.3084087Z I0713 00:06:58.208759 1 shared_informer.go:204] Caches are synced for taint
2021-07-13T00:14:41.3084920Z I0713 00:06:58.208856 1 node_lifecycle_controller.go:1443] Initializing eviction metric for zone:
2021-07-13T00:14:41.3086569Z W0713 00:06:58.208934 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster2-control-plane. Assuming now as a timestamp.
2021-07-13T00:14:41.3088568Z I0713 00:06:58.209006 1 node_lifecycle_controller.go:1209] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
2021-07-13T00:14:41.3090897Z I0713 00:06:58.209254 1 taint_manager.go:186] Starting NoExecuteTaintManager
2021-07-13T00:14:41.3093652Z I0713 00:06:58.210350 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster2-control-plane", UID:"a32d1e80-5286-4e28-96b3-677f8a22e37d", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster2-control-plane event: Registered Node cluster2-control-plane in Controller
2021-07-13T00:14:41.3097074Z I0713 00:06:58.237353 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"e934cf68-e107-4003-8fa8-290026adac8f", APIVersion:"apps/v1", ResourceVersion:"238", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-l75pb
2021-07-13T00:14:41.3098811Z I0713 00:06:58.305009 1 shared_informer.go:204] Caches are synced for disruption
2021-07-13T00:14:41.3099579Z I0713 00:06:58.305030 1 disruption.go:338] Sending events to api server.
2021-07-13T00:14:41.3100607Z I0713 00:06:58.305098 1 shared_informer.go:204] Caches are synced for ReplicaSet
2021-07-13T00:14:41.3103393Z I0713 00:06:58.355837 1 shared_informer.go:204] Caches are synced for deployment
2021-07-13T00:14:41.3105767Z I0713 00:06:58.364671 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"kube-system", Name:"coredns", UID:"c041909c-845e-4bed-8edb-424fc29077e9", APIVersion:"apps/v1", ResourceVersion:"231", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set coredns-6955765f44 to 2
2021-07-13T00:14:41.3110040Z I0713 00:06:58.364983 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"local-path-storage", Name:"local-path-provisioner", UID:"051e4684-cdeb-446d-b518-6fa58eb626b9", APIVersion:"apps/v1", ResourceVersion:"274", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set local-path-provisioner-5bf465b47d to 1
2021-07-13T00:14:41.3114817Z I0713 00:06:58.373470 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-6955765f44", UID:"c43ffe68-ee5a-4777-90c5-c702ec0283b4", APIVersion:"apps/v1", ResourceVersion:"389", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-6955765f44-k58vx
2021-07-13T00:14:41.3120327Z I0713 00:06:58.378891 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"local-path-storage", Name:"local-path-provisioner-5bf465b47d", UID:"df021bb8-5f2f-448e-b528-9b6f5dd30f1f", APIVersion:"apps/v1", ResourceVersion:"390", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: local-path-provisioner-5bf465b47d-g687f
2021-07-13T00:14:41.3125457Z I0713 00:06:58.379184 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"kube-system", Name:"coredns-6955765f44", UID:"c43ffe68-ee5a-4777-90c5-c702ec0283b4", APIVersion:"apps/v1", ResourceVersion:"389", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: coredns-6955765f44-v46gr
2021-07-13T00:14:41.3139449Z I0713 00:06:58.417402 1 shared_informer.go:204] Caches are synced for attach detach
2021-07-13T00:14:41.3140251Z I0713 00:06:58.457643 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:41.3141049Z I0713 00:06:58.498538 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:41.3142883Z I0713 00:06:58.504969 1 shared_informer.go:204] Caches are synced for certificate-csrapproving
2021-07-13T00:14:41.3143861Z I0713 00:06:58.510851 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:41.3144922Z I0713 00:06:58.510868 1 garbagecollector.go:138] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
2021-07-13T00:14:41.3146975Z I0713 00:06:58.517529 1 shared_informer.go:204] Caches are synced for certificate-csrsigning
2021-07-13T00:14:41.3147922Z I0713 00:06:59.405814 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:41.3148760Z I0713 00:06:59.405862 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:41.3150530Z W0713 00:07:15.411885 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster2-worker2" does not exist
2021-07-13T00:14:41.3156423Z I0713 00:07:15.446802 1 range_allocator.go:373] Set node cluster2-worker2 PodCIDR to [10.2.1.0/24]
2021-07-13T00:14:41.3158866Z I0713 00:07:15.456370 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"e934cf68-e107-4003-8fa8-290026adac8f", APIVersion:"apps/v1", ResourceVersion:"428", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-9w2qv
2021-07-13T00:14:41.3161734Z W0713 00:07:16.045660 1 actual_state_of_world.go:506] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster2-worker" does not exist
2021-07-13T00:14:41.3163457Z I0713 00:07:16.061377 1 range_allocator.go:373] Set node cluster2-worker PodCIDR to [10.2.2.0/24]
2021-07-13T00:14:41.3165640Z I0713 00:07:16.062138 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"kube-proxy", UID:"e934cf68-e107-4003-8fa8-290026adac8f", APIVersion:"apps/v1", ResourceVersion:"484", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: kube-proxy-fx7jz
2021-07-13T00:14:41.3167837Z W0713 00:07:18.213560 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster2-worker. Assuming now as a timestamp.
2021-07-13T00:14:41.3169335Z W0713 00:07:18.214175 1 node_lifecycle_controller.go:1058] Missing timestamp for Node cluster2-worker2. Assuming now as a timestamp.
2021-07-13T00:14:41.3171912Z I0713 00:07:18.214345 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster2-worker2", UID:"dba4d665-2a11-4627-a9b1-ff98febe5feb", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster2-worker2 event: Registered Node cluster2-worker2 in Controller
2021-07-13T00:14:41.3175374Z I0713 00:07:18.215956 1 event.go:281] Event(v1.ObjectReference{Kind:"Node", Namespace:"", Name:"cluster2-worker", UID:"ed32e75c-f26d-45d3-9dec-f14f5451c5d5", APIVersion:"", ResourceVersion:"", FieldPath:""}): type: 'Normal' reason: 'RegisteredNode' Node cluster2-worker event: Registered Node cluster2-worker in Controller
2021-07-13T00:14:41.3178745Z I0713 00:07:29.582518 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"7d56fe4e-5cbb-4c1f-8f50-ef876ab1cee0", APIVersion:"apps/v1", ResourceVersion:"572", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-hzdfh
2021-07-13T00:14:41.3194157Z I0713 00:07:29.600724 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"7d56fe4e-5cbb-4c1f-8f50-ef876ab1cee0", APIVersion:"apps/v1", ResourceVersion:"572", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-9rhgb
2021-07-13T00:14:41.3198542Z I0713 00:07:29.612877 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"kube-system", Name:"weave-net", UID:"7d56fe4e-5cbb-4c1f-8f50-ef876ab1cee0", APIVersion:"apps/v1", ResourceVersion:"572", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: weave-net-7h9tc
2021-07-13T00:14:41.3209432Z I0713 00:07:48.221625 1 node_lifecycle_controller.go:1236] Controller detected that some Nodes are Ready. Exiting master disruption mode.
2021-07-13T00:14:41.3212638Z I0713 00:09:21.760223 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-operator", UID:"6ef21a1d-bc0b-47ec-9203-097591460771", APIVersion:"apps/v1", ResourceVersion:"1066", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-operator-56f895dd55 to 1
2021-07-13T00:14:41.3217443Z I0713 00:09:21.776830 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-operator-56f895dd55", UID:"ad55c91d-d913-4b9d-9e40-8a0c2338963e", APIVersion:"apps/v1", ResourceVersion:"1067", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-operator-56f895dd55-2zxfg
2021-07-13T00:14:41.3222348Z I0713 00:09:29.849138 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceexports.multicluster.x-k8s.io
2021-07-13T00:14:41.3224605Z I0713 00:09:29.851204 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for submariners.submariner.io
2021-07-13T00:14:41.3225939Z I0713 00:09:29.851317 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for brokers.submariner.io
2021-07-13T00:14:41.3227548Z I0713 00:09:29.851379 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for servicediscoveries.submariner.io
2021-07-13T00:14:41.3229589Z I0713 00:09:29.851448 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for serviceimports.multicluster.x-k8s.io
2021-07-13T00:14:41.3232117Z I0713 00:09:29.883907 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:41.3232960Z I0713 00:09:31.170407 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:41.3234392Z I0713 00:09:33.171479 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:41.3235215Z I0713 00:09:33.188939 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:41.3239171Z I0713 00:09:51.988637 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-gateway", UID:"23f138d9-8d37-486b-93c1-dc3a5ee9e925", APIVersion:"apps/v1", ResourceVersion:"1190", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-gateway-hbh5j
2021-07-13T00:14:41.3243429Z I0713 00:09:53.440469 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-lighthouse-agent", UID:"0de36585-7c53-4fab-be95-1fc039c720c4", APIVersion:"apps/v1", ResourceVersion:"1208", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-lighthouse-agent-c86db954 to 1
2021-07-13T00:14:41.3249040Z I0713 00:09:53.460530 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"f75e368c-e09b-4277-b603-ea42fccba206", APIVersion:"apps/v1", ResourceVersion:"1205", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-st9gl
2021-07-13T00:14:41.3254250Z I0713 00:09:53.740852 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"f75e368c-e09b-4277-b603-ea42fccba206", APIVersion:"apps/v1", ResourceVersion:"1205", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-2b8nd
2021-07-13T00:14:41.3259251Z I0713 00:09:53.884066 1 event.go:281] Event(v1.ObjectReference{Kind:"DaemonSet", Namespace:"submariner-operator", Name:"submariner-routeagent", UID:"f75e368c-e09b-4277-b603-ea42fccba206", APIVersion:"apps/v1", ResourceVersion:"1205", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-routeagent-fsm6d
2021-07-13T00:14:41.3264721Z I0713 00:09:53.884104 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-agent-c86db954", UID:"078d65c5-6600-49e8-9a78-df67c5227dd1", APIVersion:"apps/v1", ResourceVersion:"1211", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-agent-c86db954-r7mf8
2021-07-13T00:14:41.3269519Z I0713 00:09:56.301589 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns", UID:"9204ebe0-b1ba-4137-924f-a20ba255969d", APIVersion:"apps/v1", ResourceVersion:"1245", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set submariner-lighthouse-coredns-546f4d5ff7 to 2
2021-07-13T00:14:41.3274934Z I0713 00:09:56.649334 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns-546f4d5ff7", UID:"e909e5ae-ba88-4724-868e-b68c81b8c942", APIVersion:"apps/v1", ResourceVersion:"1251", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-coredns-546f4d5ff7-ts6k8
2021-07-13T00:14:41.3280892Z I0713 00:09:56.779316 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"submariner-operator", Name:"submariner-lighthouse-coredns-546f4d5ff7", UID:"e909e5ae-ba88-4724-868e-b68c81b8c942", APIVersion:"apps/v1", ResourceVersion:"1251", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: submariner-lighthouse-coredns-546f4d5ff7-sc24r
2021-07-13T00:14:41.3283872Z I0713 00:10:03.740090 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for clusters.submariner.io
2021-07-13T00:14:41.3285146Z I0713 00:10:03.740548 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for gateways.submariner.io
2021-07-13T00:14:41.3286533Z I0713 00:10:03.740797 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for globalegressips.submariner.io
2021-07-13T00:14:41.3287910Z I0713 00:10:03.744216 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for endpoints.submariner.io
2021-07-13T00:14:41.3289326Z I0713 00:10:03.744490 1 resource_quota_monitor.go:228] QuotaMonitor created object count evaluator for globalingressips.submariner.io
2021-07-13T00:14:41.3290486Z I0713 00:10:03.744567 1 shared_informer.go:197] Waiting for caches to sync for resource quota
2021-07-13T00:14:41.3291328Z I0713 00:10:04.630786 1 shared_informer.go:197] Waiting for caches to sync for garbage collector
2021-07-13T00:14:41.3292155Z I0713 00:10:05.847401 1 shared_informer.go:204] Caches are synced for resource quota
2021-07-13T00:14:41.3292953Z I0713 00:10:05.936737 1 shared_informer.go:204] Caches are synced for garbage collector
2021-07-13T00:14:41.3295343Z I0713 00:10:44.146957 1 event.go:281] Event(v1.ObjectReference{Kind:"Deployment", Namespace:"default", Name:"nginx-demo", UID:"4ec4fd45-afd0-41b4-9de0-1d29245d6267", APIVersion:"apps/v1", ResourceVersion:"1495", FieldPath:""}): type: 'Normal' reason: 'ScalingReplicaSet' Scaled up replica set nginx-demo-57fc48c69c to 2
2021-07-13T00:14:41.3298939Z I0713 00:10:44.155770 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"nginx-demo-57fc48c69c", UID:"e314055e-e3a8-4a01-beef-6ad520f9fa74", APIVersion:"apps/v1", ResourceVersion:"1496", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: nginx-demo-57fc48c69c-rcflv
2021-07-13T00:14:41.3303456Z I0713 00:10:44.244357 1 event.go:281] Event(v1.ObjectReference{Kind:"ReplicaSet", Namespace:"default", Name:"nginx-demo-57fc48c69c", UID:"e314055e-e3a8-4a01-beef-6ad520f9fa74", APIVersion:"apps/v1", ResourceVersion:"1496", FieldPath:""}): type: 'Normal' reason: 'SuccessfulCreate' Created pod: nginx-demo-57fc48c69c-bcpd6
2021-07-13T00:14:41.3305900Z [lighthouse]$ [cluster2] print_section * Submariner-operator pod logs for cluster2 *
2021-07-13T00:14:41.3307166Z [lighthouse]$ [cluster2] print_section * Submariner-operator pod logs for cluster2 *
2021-07-13T00:14:41.3308333Z [lighthouse]$ [cluster2] print_pods_logs submariner-operator
2021-07-13T00:14:41.3309585Z [lighthouse]$ [cluster2] print_pods_logs submariner-operator
2021-07-13T00:14:41.3310853Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:41.3342673Z [lighthouse]$ [cluster2] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:41.3344185Z [lighthouse]$ [cluster2] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:41.3345725Z [lighthouse]$ [cluster2] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:41.3347368Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-13T00:14:41.3348359Z ====================================================================
2021-07-13T00:14:41.3348831Z ##[endgroup]
2021-07-13T00:14:41.3349817Z ##[group]* Submariner-operator pod logs for cluster2 *
2021-07-13T00:14:41.3351132Z ======================= * Submariner-operator pod logs for cluster2 * =======================
2021-07-13T00:14:41.3351772Z ====================================================================
2021-07-13T00:14:41.3352187Z ##[endgroup]
2021-07-13T00:14:41.3353310Z ##[group]** Pods logs for NS submariner-operator using selector '' **
2021-07-13T00:14:41.3354448Z ======================= ** Pods logs for NS submariner-operator using selector '' ** =======================
2021-07-13T00:14:41.7458186Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-gateway-hbh5j -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:41.7473799Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-gateway-hbh5j -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:41.7490566Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n submariner-operator submariner-gateway-hbh5j -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:42.1446839Z [lighthouse]$ [cluster2] print_section *** submariner-gateway-hbh5j ***
2021-07-13T00:14:42.1460338Z [lighthouse]$ [cluster2] print_section *** submariner-gateway-hbh5j ***
2021-07-13T00:14:42.1464633Z ====================================================================
2021-07-13T00:14:42.1468342Z ##[endgroup]
2021-07-13T00:14:42.1472958Z ##[group]*** submariner-gateway-hbh5j ***
2021-07-13T00:14:42.1479841Z ======================= *** submariner-gateway-hbh5j *** =======================
2021-07-13T00:14:42.1495052Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-gateway-hbh5j
2021-07-13T00:14:42.1506707Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-gateway-hbh5j
2021-07-13T00:14:42.1519282Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n submariner-operator logs submariner-gateway-hbh5j
2021-07-13T00:14:42.4993588Z + trap 'exit 1' SIGTERM SIGINT
2021-07-13T00:14:42.5005490Z + export CHARON_PID_FILE=/var/run/charon.pid
2021-07-13T00:14:42.5006125Z + CHARON_PID_FILE=/var/run/charon.pid
2021-07-13T00:14:42.5006945Z + rm -f /var/run/charon.pid
2021-07-13T00:14:42.5007435Z + SUBMARINER_VERBOSITY=2
2021-07-13T00:14:42.5008018Z + '[' false == true ']'
2021-07-13T00:14:42.5008725Z + DEBUG=-v=2
2021-07-13T00:14:42.5009232Z ++ cat /proc/sys/net/ipv4/conf/all/send_redirects
2021-07-13T00:14:42.5009686Z + [[ 1 = 0 ]]
2021-07-13T00:14:42.5010022Z + echo 0
2021-07-13T00:14:42.5010794Z + exec submariner-gateway -v=2 -alsologtostderr
2021-07-13T00:14:42.5011572Z I0713 00:10:20.640978 1 main.go:92] Starting the submariner gateway engine
2021-07-13T00:14:42.5012858Z W0713 00:10:20.662182 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:42.5013838Z I0713 00:10:20.705193 1 main.go:120] Creating the cable engine
2021-07-13T00:14:42.5014522Z I0713 00:10:21.514441 1 local_endpoint.go:209] Interface "lo" has "127.0.0.1" address
2021-07-13T00:14:42.5015256Z I0713 00:10:21.514530 1 local_endpoint.go:209] Interface "weave" has "10.2.0.1" address
2021-07-13T00:14:42.5016127Z I0713 00:10:21.514538 1 local_endpoint.go:214] Found CNI Interface "weave" that has IP "10.2.0.1" from ClusterCIDR "10.2.0.0/16"
2021-07-13T00:14:42.5017140Z I0713 00:10:21.514566 1 natdiscovery.go:116] NAT discovery server starting on port 4490
2021-07-13T00:14:42.5017914Z I0713 00:10:21.969885 1 syncer.go:83] CableEngine syncer started
2021-07-13T00:14:42.5019006Z I0713 00:10:21.970674 1 main.go:322] Gateway leader election config values: main.leaderConfig{LeaseDuration:10, RenewDeadline:5, RetryPeriod:2}
2021-07-13T00:14:42.5020498Z I0713 00:10:21.979632 1 main.go:339] Using namespace "submariner-operator" for the leader election lock
2021-07-13T00:14:42.5023829Z I0713 00:10:21.979659 1 leaderelection.go:243] attempting to acquire leader lease submariner-operator/submariner-gateway-lock...
2021-07-13T00:14:42.5025923Z I0713 00:10:22.141559 1 leaderelection.go:253] successfully acquired lease submariner-operator/submariner-gateway-lock
2021-07-13T00:14:42.5027033Z I0713 00:10:22.141741 1 main.go:188] Creating the datastore syncer
2021-07-13T00:14:42.5027674Z I0713 00:10:22.141781 1 libreswan.go:97] Using NATT UDP port 4500
2021-07-13T00:14:42.5028306Z I0713 00:10:22.141840 1 libreswan.go:524] Starting Pluto
2021-07-13T00:14:42.5030941Z I0713 00:10:22.142126 1 event.go:282] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"submariner-operator", Name:"submariner-gateway-lock", UID:"835dd3cc-948d-45dc-ad75-ed88fb019cfb", APIVersion:"v1", ResourceVersion:"1362", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster2-worker-submariner-gateway became leader
2021-07-13T00:14:42.5033133Z /usr/libexec/ipsec/_stackmanager: line 111: pidof: command not found
2021-07-13T00:14:42.5033793Z Initializing NSS database
2021-07-13T00:14:42.5034128Z
2021-07-13T00:14:42.5034523Z nflog ipsec capture disabled
2021-07-13T00:14:42.5035288Z I0713 00:10:25.143208 1 cableengine.go:95] CableEngine controller started, driver: "libreswan"
2021-07-13T00:14:42.5036130Z I0713 00:10:25.143482 1 tunnel.go:36] Starting the tunnel controller
2021-07-13T00:14:42.5037155Z I0713 00:10:25.143669 1 datastoresyncer.go:65] Starting the datastore syncer
2021-07-13T00:14:42.5038377Z I0713 00:10:25.348582 1 healthchecker.go:107] CableEngine HealthChecker started with PingInterval: 1, MaxPacketLossCount: 5
2021-07-13T00:14:42.5039456Z I0713 00:10:25.757042 1 datastoresyncer.go:87] Starting the broker syncer
2021-07-13T00:14:42.5040374Z I0713 00:10:25.960670 1 datastoresyncer.go:140] Ensuring we are the only endpoint active for this cluster
2021-07-13T00:14:42.5042289Z I0713 00:10:25.960696 1 datastoresyncer.go:219] Creating local submariner Cluster: types.SubmarinerCluster{ID:"cluster2", Spec:v1.ClusterSpec{ClusterID:"cluster2", ColorCodes:[]string{"blue"}, ServiceCIDR:[]string{"100.2.0.0/16"}, ClusterCIDR:[]string{"10.2.0.0/16"}, GlobalCIDR:[]string{}}}
2021-07-13T00:14:42.5051647Z I0713 00:10:26.086744 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5059058Z I0713 00:10:26.086831 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:42.5060306Z I0713 00:10:26.086915 1 pinger.go:80] Starting pinger for IP "10.1.0.1"
2021-07-13T00:14:42.5061996Z I0713 00:10:26.086925 1 healthchecker.go:157] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster1-172-18-0-4" with HealthCheckIP "10.1.0.1"
2021-07-13T00:14:42.5065978Z I0713 00:10:26.103675 1 datastoresyncer.go:232] Creating local submariner Endpoint: types.SubmarinerEndpoint{Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5068532Z I0713 00:10:26.455065 1 pinger.go:80] Starting pinger for IP "10.3.0.1"
2021-07-13T00:14:42.5070234Z I0713 00:10:26.455090 1 healthchecker.go:157] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster3-172-18-0-7" with HealthCheckIP "10.3.0.1"
2021-07-13T00:14:42.5079021Z I0713 00:10:26.455178 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5086492Z I0713 00:10:26.455335 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:42.5089026Z I0713 00:10:26.544738 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x3d259f87f18ebd88, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster3-172-18-0-7", USING_SRC: 172.18.0.5:4490, USING_DST: 172.18.0.7:4490
2021-07-13T00:14:42.5134147Z I0713 00:10:26.544928 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x3d259f87f18ebd89, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster3-172-18-0-7", USING_SRC: 172.18.0.5:4490, USING_DST: 20.94.215.61:4490
2021-07-13T00:14:42.5137797Z I0713 00:10:26.545007 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x3d259f87f18ebd8a, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-4", USING_SRC: 172.18.0.5:4490, USING_DST: 172.18.0.4:4490
2021-07-13T00:14:42.5196099Z I0713 00:10:26.545123 1 request_send.go:117] Sending request - REQUEST_NUMBER: 0x3d259f87f18ebd8b, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-4", USING_SRC: 172.18.0.5:4490, USING_DST: 20.94.215.61:4490
2021-07-13T00:14:42.5198180Z 002 listening for IKE messages
2021-07-13T00:14:42.5198686Z 002 forgetting secrets
2021-07-13T00:14:42.5199247Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-13T00:14:42.5200134Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-13T00:14:42.5202425Z I0713 00:10:26.550999 1 response_handle.go:33] Received response from 172.18.0.7:4490 - REQUEST_NUMBER: 0x3d259f87f18ebd88, RESPONSE: OK, SENDER: "submariner-cable-cluster3-172-18-0-7", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:42.5205211Z I0713 00:10:26.551068 1 remote_endpoint.go:179] selected private IP "172.18.0.7" for endpoint "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:42.5207957Z I0713 00:10:26.551120 1 response_handle.go:33] Received response from 172.18.0.4:4490 - REQUEST_NUMBER: 0x3d259f87f18ebd8a, RESPONSE: OK, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:42.5210431Z I0713 00:10:26.551129 1 remote_endpoint.go:179] selected private IP "172.18.0.4" for endpoint "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:42.5212193Z I0713 00:10:26.551149 1 cableengine.go:189] Installing Endpoint cable "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:42.5218033Z I0713 00:10:26.562850 1 libreswan.go:308] Creating connection(s) for {"metadata":{"name":"cluster3-submariner-cable-cluster3-172-18-0-7","namespace":"submariner-operator","selfLink":"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7","uid":"641c974a-2282-4e0e-8cb8-06960fb87319","resourceVersion":"1393","generation":1,"creationTimestamp":"2021-07-13T00:10:26Z","labels":{"submariner-io/clusterID":"cluster3"}},"spec":{"cluster_id":"cluster3","cable_name":"submariner-cable-cluster3-172-18-0-7","healthCheckIP":"10.3.0.1","hostname":"cluster3-worker","subnets":["100.3.0.0/16","10.3.0.0/16"],"private_ip":"172.18.0.7","public_ip":"20.94.215.61","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-13T00:14:42.5225175Z I0713 00:10:26.563047 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-0-0 --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 100.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5227319Z 002 "submariner-cable-cluster3-172-18-0-7-0-0": added IKEv2 connection
2021-07-13T00:14:42.5235675Z I0713 00:10:26.583414 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5242927Z I0713 00:10:26.583480 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5243940Z I0713 00:10:26.593485 1 datastoresyncer.go:114] Datastore syncer started
2021-07-13T00:14:42.5246100Z I0713 00:10:27.010189 1 request_handle.go:54] Received request from 172.18.0.7:4490 - REQUEST_NUMBER: 0x637e09a184b2833c, SENDER: "submariner-cable-cluster3-172-18-0-7", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:42.5249079Z I0713 00:10:27.010225 1 request_handle.go:118] Sending response to 172.18.0.7:4490 - REQUEST_NUMBER: 0x637e09a184b2833c, RESPONSE: OK, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster3-172-18-0-7"
2021-07-13T00:14:42.5252059Z I0713 00:10:27.101517 1 request_handle.go:54] Received request from 172.18.0.4:4490 - REQUEST_NUMBER: 0x73bdc4e332deb07e, SENDER: "submariner-cable-cluster1-172-18-0-4", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-13T00:14:42.5255277Z I0713 00:10:27.101616 1 request_handle.go:118] Sending response to 172.18.0.4:4490 - REQUEST_NUMBER: 0x73bdc4e332deb07e, RESPONSE: OK, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:42.5258240Z I0713 00:10:27.310586 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-0-1 --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 10.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5260259Z 181 "submariner-cable-cluster3-172-18-0-7-0-0" #1: initiating IKEv2 connection
2021-07-13T00:14:42.5261835Z 002 "submariner-cable-cluster3-172-18-0-7-0-1": added IKEv2 connection
2021-07-13T00:14:42.5264059Z I0713 00:10:27.793187 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-1-0 --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 100.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5266635Z 000 "submariner-cable-cluster3-172-18-0-7-0-1": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:42.5268718Z 002 "submariner-cable-cluster3-172-18-0-7-1-0": added IKEv2 connection
2021-07-13T00:14:42.5270862Z 000 "submariner-cable-cluster3-172-18-0-7-1-0": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:42.5272960Z 002 "submariner-cable-cluster3-172-18-0-7-1-1": added IKEv2 connection
2021-07-13T00:14:42.5275175Z I0713 00:10:27.812186 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster3-172-18-0-7-1-1 --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500 --to --id 172.18.0.7 --host 172.18.0.7 --client 10.3.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5278338Z I0713 00:10:27.852651 1 cableengine.go:196] Successfully installed Endpoint cable "submariner-cable-cluster3-172-18-0-7" with remote IP 172.18.0.7
2021-07-13T00:14:42.5280254Z I0713 00:10:27.852708 1 cableengine.go:189] Installing Endpoint cable "submariner-cable-cluster1-172-18-0-4"
2021-07-13T00:14:42.5348690Z I0713 00:10:27.853767 1 libreswan.go:308] Creating connection(s) for {"metadata":{"name":"cluster1-submariner-cable-cluster1-172-18-0-4","namespace":"submariner-operator","selfLink":"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4","uid":"485eaa67-d66d-4d50-869b-ffdc8f6643a3","resourceVersion":"1388","generation":1,"creationTimestamp":"2021-07-13T00:10:26Z","labels":{"submariner-io/clusterID":"cluster1"}},"spec":{"cluster_id":"cluster1","cable_name":"submariner-cable-cluster1-172-18-0-4","healthCheckIP":"10.1.0.1","hostname":"cluster1-worker","subnets":["100.1.0.0/16","10.1.0.0/16"],"private_ip":"172.18.0.4","public_ip":"20.94.215.61","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-13T00:14:42.5354739Z I0713 00:10:27.853839 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster1-172-18-0-4-0-0 --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500 --to --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5357534Z 000 "submariner-cable-cluster3-172-18-0-7-1-1": queuing pending IPsec SA negotiating with 172.18.0.7 IKE SA #1 "submariner-cable-cluster3-172-18-0-7-0-0"
2021-07-13T00:14:42.5359014Z 002 listening for IKE messages
2021-07-13T00:14:42.5359506Z 002 forgetting secrets
2021-07-13T00:14:42.5360073Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-13T00:14:42.5360808Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-13T00:14:42.5362501Z 002 "submariner-cable-cluster1-172-18-0-4-0-0": added IKEv2 connection
2021-07-13T00:14:42.5364411Z 181 "submariner-cable-cluster1-172-18-0-4-0-0" #6: initiating IKEv2 connection
2021-07-13T00:14:42.5366741Z I0713 00:10:28.426432 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster1-172-18-0-4-0-1 --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500 --to --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5368894Z 002 "submariner-cable-cluster1-172-18-0-4-0-1": added IKEv2 connection
2021-07-13T00:14:42.5371142Z I0713 00:10:29.365480 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster1-172-18-0-4-1-0 --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500 --to --id 172.18.0.4 --host 172.18.0.4 --client 100.1.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5373127Z 002 "submariner-cable-cluster1-172-18-0-4-1-0": added IKEv2 connection
2021-07-13T00:14:42.5375315Z I0713 00:10:29.414930 1 libreswan.go:369] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster1-172-18-0-4-1-1 --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500 --to --id 172.18.0.4 --host 172.18.0.4 --client 10.1.0.0/16 --ikeport 4500]
2021-07-13T00:14:42.5377281Z 002 "submariner-cable-cluster1-172-18-0-4-1-1": added IKEv2 connection
2021-07-13T00:14:42.5379252Z I0713 00:10:29.581561 1 cableengine.go:196] Successfully installed Endpoint cable "submariner-cable-cluster1-172-18-0-4" with remote IP 172.18.0.4
2021-07-13T00:14:42.5385330Z I0713 00:10:29.788001 1 libreswan.go:214] Connection "submariner-cable-cluster3-172-18-0-7-0-0" not found in active connections obtained from whack: map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:42.5395175Z I0713 00:10:29.788042 1 libreswan.go:214] Connection "submariner-cable-cluster3-172-18-0-7-0-1" not found in active connections obtained from whack: map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:42.5404790Z I0713 00:10:29.788059 1 libreswan.go:214] Connection "submariner-cable-cluster3-172-18-0-7-1-0" not found in active connections obtained from whack: map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:42.5414302Z I0713 00:10:29.788099 1 libreswan.go:214] Connection "submariner-cable-cluster1-172-18-0-4-1-1" not found in active connections obtained from whack: map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0], map[submariner-cable-cluster1-172-18-0-4-0-0:0 submariner-cable-cluster1-172-18-0-4-0-1:0 submariner-cable-cluster1-172-18-0-4-1-0:0 submariner-cable-cluster3-172-18-0-7-1-1:0]
2021-07-13T00:14:42.5427804Z I0713 00:10:55.616058 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5450447Z I0713 00:10:55.616249 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5464493Z I0713 00:10:55.616397 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5471224Z I0713 00:10:55.616440 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5473009Z I0713 00:10:55.616482 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5475667Z I0713 00:10:55.616526 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5478657Z I0713 00:10:55.616538 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5481356Z I0713 00:10:55.616573 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5490305Z I0713 00:11:25.616476 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5504384Z I0713 00:11:25.616598 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5518327Z I0713 00:11:25.616697 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5546086Z I0713 00:11:25.616727 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5548054Z I0713 00:11:25.616738 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5559134Z I0713 00:11:25.616756 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5561967Z I0713 00:11:25.616766 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5564669Z I0713 00:11:25.616774 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5573593Z I0713 00:11:55.616769 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5588062Z I0713 00:11:55.616985 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5602625Z I0713 00:11:55.617125 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5609136Z I0713 00:11:55.617218 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5611073Z I0713 00:11:55.617268 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5613733Z I0713 00:11:55.617339 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5616520Z I0713 00:11:55.617370 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5619297Z I0713 00:11:55.617417 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5629508Z I0713 00:12:25.617141 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5655355Z I0713 00:12:25.617360 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5669331Z I0713 00:12:25.617495 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5676039Z I0713 00:12:25.617566 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5678172Z I0713 00:12:25.617603 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5680909Z I0713 00:12:25.617693 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5683546Z I0713 00:12:25.617716 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5686212Z I0713 00:12:25.617729 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5695241Z I0713 00:12:55.617546 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5731096Z I0713 00:12:55.617616 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5733828Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-agent-c86db954-r7mf8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:42.5736798Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-agent-c86db954-r7mf8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:42.5739777Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n submariner-operator submariner-lighthouse-agent-c86db954-r7mf8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:42.5749047Z I0713 00:12:55.617661 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5763856Z I0713 00:12:55.617749 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5771980Z I0713 00:12:55.617809 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5774764Z I0713 00:12:55.617832 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5777487Z I0713 00:12:55.617843 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5780311Z I0713 00:12:55.617852 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5789523Z I0713 00:13:25.618633 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5819443Z I0713 00:13:25.618809 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5831849Z I0713 00:13:25.618810 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5834896Z I0713 00:13:25.618864 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5847347Z I0713 00:13:25.618974 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5888807Z I0713 00:13:25.619015 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5891894Z I0713 00:13:25.619025 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5894572Z I0713 00:13:25.619055 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5903990Z I0713 00:13:55.619361 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5911110Z I0713 00:13:55.619427 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.5932901Z I0713 00:13:55.619473 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5947469Z I0713 00:13:55.619553 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.5966480Z I0713 00:13:55.619600 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.5969179Z I0713 00:13:55.619630 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.5971812Z I0713 00:13:55.619641 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.5974511Z I0713 00:13:55.619649 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.5986385Z I0713 00:14:25.620072 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-4", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster1-submariner-cable-cluster1-172-18-0-4", UID:"485eaa67-d66d-4d50-869b-ffdc8f6643a3", ResourceVersion:"1388", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-4", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.4", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.6004909Z I0713 00:14:25.620195 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster3-submariner-cable-cluster3-172-18-0-7", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster3-submariner-cable-cluster3-172-18-0-7", UID:"641c974a-2282-4e0e-8cb8-06960fb87319", ResourceVersion:"1393", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster3"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster3", CableName:"submariner-cable-cluster3-172-18-0-7", HealthCheckIP:"10.3.0.1", Hostname:"cluster3-worker", Subnets:[]string{"100.3.0.0/16", "10.3.0.0/16"}, PrivateIP:"172.18.0.7", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.6019452Z I0713 00:14:25.620320 1 tunnel.go:73] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"/apis/submariner.io/v1/namespaces/submariner-operator/endpoints/cluster2-submariner-cable-cluster2-172-18-0-5", UID:"b9539069-a7a6-47ee-98ca-e2a967295204", ResourceVersion:"1395", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63761731826, loc:(*time.Location)(0x21ef940)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.0.1", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.215.61", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-13T00:14:42.6026858Z I0713 00:14:25.620356 1 cableengine.go:205] Not installing cable for local cluster
2021-07-13T00:14:42.6029329Z I0713 00:14:25.620372 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster1-172-18-0-4" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster1
2021-07-13T00:14:42.6033620Z I0713 00:14:25.620413 1 cableengine.go:171] Connection info (IP: 172.18.0.4, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster1-172-18-0-4" is unchanged - not re-installing
2021-07-13T00:14:42.6036303Z I0713 00:14:25.620428 1 cableengine.go:157] Found a pre-existing cable "submariner-cable-cluster3-172-18-0-7" with timestamp "2021-07-13 00:10:26 +0000 UTC" that belongs to this cluster cluster3
2021-07-13T00:14:42.6039185Z I0713 00:14:25.620438 1 cableengine.go:171] Connection info (IP: 172.18.0.7, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster3-172-18-0-7" is unchanged - not re-installing
2021-07-13T00:14:42.9012509Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-agent-c86db954-r7mf8 ***
2021-07-13T00:14:42.9029408Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-agent-c86db954-r7mf8 ***
2021-07-13T00:14:42.9035762Z ====================================================================
2021-07-13T00:14:42.9040055Z ##[endgroup]
2021-07-13T00:14:42.9046748Z ##[group]*** submariner-lighthouse-agent-c86db954-r7mf8 ***
2021-07-13T00:14:42.9050107Z ======================= *** submariner-lighthouse-agent-c86db954-r7mf8 *** =======================
2021-07-13T00:14:42.9068007Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-agent-c86db954-r7mf8
2021-07-13T00:14:42.9085049Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-agent-c86db954-r7mf8
2021-07-13T00:14:42.9096767Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n submariner-operator logs submariner-lighthouse-agent-c86db954-r7mf8
2021-07-13T00:14:43.2535363Z I0713 00:10:27.042172 1 main.go:70] Arguments: [/usr/local/bin/lighthouse-agent -alsologtostderr -v=2]
2021-07-13T00:14:43.2542009Z I0713 00:10:27.042268 1 main.go:71] AgentSpec: {cluster2 submariner-operator false}
2021-07-13T00:14:43.2549530Z W0713 00:10:27.042427 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:43.2551303Z I0713 00:10:27.204546 1 main.go:98] Starting submariner-lighthouse-agent {cluster2 submariner-operator false}
2021-07-13T00:14:43.2552325Z I0713 00:10:27.454651 1 agent.go:169] Starting Agent controller
2021-07-13T00:14:43.2552989Z I0713 00:10:27.959579 1 agent.go:213] Agent controller started
2021-07-13T00:14:43.2553981Z I0713 00:10:44.321719 1 agent.go:239] ServiceExport default/nginx-demo created
2021-07-13T00:14:43.2555749Z I0713 00:10:44.321812 1 agent.go:393] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "False", Reason: "AwaitingSync", Message: "Awaiting sync of the ServiceImport to the broker"
2021-07-13T00:14:43.2566033Z I0713 00:10:44.420280 1 agent.go:322] Returning ServiceImport: &v1alpha1.ServiceImport{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-default-cluster2", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"lighthouse.submariner.io/sourceCluster":"cluster2", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default"}, Annotations:map[string]string{"cluster-ip":"100.2.36.127", "origin-name":"nginx-demo", "origin-namespace":"default"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1alpha1.ServiceImportSpec{Ports:[]v1alpha1.ServicePort{v1alpha1.ServicePort{Name:"", Protocol:"TCP", AppProtocol:(*string)(nil), Port:80}}, IPs:[]string{"100.2.36.127"}, Type:"ClusterSetIP", SessionAffinity:"", SessionAffinityConfig:(*v1.SessionAffinityConfig)(0xc00033e738)}, Status:v1alpha1.ServiceImportStatus{Clusters:[]v1alpha1.ClusterStatus{v1alpha1.ClusterStatus{Cluster:"cluster2"}}}}
2021-07-13T00:14:43.2573853Z I0713 00:10:44.491275 1 agent.go:393] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "True", Reason: "", Message: "Service was successfully synced to the broker"
2021-07-13T00:14:43.2592268Z I0713 00:10:44.507225 1 serviceimport.go:146] ServiceImport "submariner-operator/nginx-demo-default-cluster2" created
2021-07-13T00:14:43.2593905Z I0713 00:10:44.507919 1 endpoint.go:46] Starting Endpoints controller for service default/nginx-demo
2021-07-13T00:14:43.2595036Z I0713 00:10:44.563636 1 agent.go:239] ServiceExport default/nginx-demo updated
2021-07-13T00:14:43.2596081Z I0713 00:10:44.572698 1 agent.go:239] ServiceExport default/nginx-demo updated
2021-07-13T00:14:43.2597437Z I0713 00:10:44.616394 1 endpoint.go:126] Endpoints default/nginx-demo created
2021-07-13T00:14:43.2604784Z I0713 00:10:44.616423 1 endpoint.go:179] Returning EndpointSlice: &v1beta1.EndpointSlice{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-cluster2", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"endpointslice.kubernetes.io/managed-by":"lighthouse-agent.submariner.io", "lighthouse.submariner.io/sourceCluster":"cluster2", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default", "multicluster.kubernetes.io/service-name":"nginx-demo-default-cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, AddressType:"IPv4", Endpoints:[]v1beta1.Endpoint(nil), Ports:[]v1beta1.EndpointPort(nil)}
2021-07-13T00:14:43.2674141Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-sc24r -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:43.2690781Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-sc24r -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:43.2706799Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-sc24r -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:43.6264109Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-coredns-546f4d5ff7-sc24r ***
2021-07-13T00:14:43.6282261Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-coredns-546f4d5ff7-sc24r ***
2021-07-13T00:14:43.6288174Z ====================================================================
2021-07-13T00:14:43.6292715Z ##[endgroup]
2021-07-13T00:14:43.6298303Z ##[group]*** submariner-lighthouse-coredns-546f4d5ff7-sc24r ***
2021-07-13T00:14:43.6317437Z ======================= *** submariner-lighthouse-coredns-546f4d5ff7-sc24r *** =======================
2021-07-13T00:14:43.6334141Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-sc24r
2021-07-13T00:14:43.6355147Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-sc24r
2021-07-13T00:14:43.6371667Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-sc24r
2021-07-13T00:14:43.9943393Z W0713 00:10:28.931823 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:43.9944753Z I0713 00:10:28.932106 1 controller.go:65] Starting ServiceImport Controller
2021-07-13T00:14:43.9945618Z I0713 00:10:29.032778 1 controller.go:69] Starting EndpointSlice Controller
2021-07-13T00:14:43.9946469Z I0713 00:10:29.036036 1 controller.go:69] Setting localClusterID from env: "cluster2"
2021-07-13T00:14:43.9947312Z I0713 00:10:29.060387 1 controller.go:97] Starting Gateway status Controller
2021-07-13T00:14:43.9948068Z I0713 00:10:29.161606 1 controller.go:56] Starting Services Controller
2021-07-13T00:14:43.9948925Z I0713 00:10:29.161765 1 controller.go:200] Updating the gateway status map[string]bool{"cluster2":true}
2021-07-13T00:14:43.9949639Z clusterset.local.:53
2021-07-13T00:14:43.9950320Z CoreDNS-1.8.3
2021-07-13T00:14:43.9950737Z linux/amd64, go1.16.5,
2021-07-13T00:14:43.9951557Z I0713 00:10:29.854934 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:43.9952858Z I0713 00:10:34.981474 1 controller.go:200] Updating the gateway status map[string]bool{"cluster2":true}
2021-07-13T00:14:43.9953920Z I0713 00:10:40.012265 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:44.0019549Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-ts6k8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.0032614Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-ts6k8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.0053880Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n submariner-operator submariner-lighthouse-coredns-546f4d5ff7-ts6k8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.3480491Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-coredns-546f4d5ff7-ts6k8 ***
2021-07-13T00:14:44.3492736Z [lighthouse]$ [cluster2] print_section *** submariner-lighthouse-coredns-546f4d5ff7-ts6k8 ***
2021-07-13T00:14:44.3497190Z ====================================================================
2021-07-13T00:14:44.3497727Z ##[endgroup]
2021-07-13T00:14:44.3499336Z ##[group]*** submariner-lighthouse-coredns-546f4d5ff7-ts6k8 ***
2021-07-13T00:14:44.3501102Z ======================= *** submariner-lighthouse-coredns-546f4d5ff7-ts6k8 *** =======================
2021-07-13T00:14:44.3509206Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-ts6k8
2021-07-13T00:14:44.3519119Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-ts6k8
2021-07-13T00:14:44.3536377Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n submariner-operator logs submariner-lighthouse-coredns-546f4d5ff7-ts6k8
2021-07-13T00:14:44.6714951Z W0713 00:10:33.935774 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-13T00:14:44.6716222Z I0713 00:10:33.936001 1 controller.go:65] Starting ServiceImport Controller
2021-07-13T00:14:44.6717940Z I0713 00:10:34.038167 1 controller.go:69] Starting EndpointSlice Controller
2021-07-13T00:14:44.6718879Z I0713 00:10:34.058149 1 controller.go:69] Setting localClusterID from env: "cluster2"
2021-07-13T00:14:44.6719727Z I0713 00:10:34.124097 1 controller.go:97] Starting Gateway status Controller
2021-07-13T00:14:44.6720487Z I0713 00:10:34.232073 1 controller.go:56] Starting Services Controller
2021-07-13T00:14:44.6721162Z clusterset.local.:53
2021-07-13T00:14:44.6721865Z CoreDNS-1.8.3
2021-07-13T00:14:44.6722296Z linux/amd64, go1.16.5,
2021-07-13T00:14:44.6723110Z I0713 00:10:34.235261 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:44.6724175Z I0713 00:10:34.960072 1 controller.go:200] Updating the gateway status map[string]bool{"cluster2":true}
2021-07-13T00:14:44.6725214Z I0713 00:10:40.013998 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true, "cluster3":true}
2021-07-13T00:14:44.6785205Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-operator-56f895dd55-2zxfg -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.6799057Z [lighthouse]$ [cluster2] kubectl get pods -n submariner-operator submariner-operator-56f895dd55-2zxfg -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.6807795Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 get pods -n submariner-operator submariner-operator-56f895dd55-2zxfg -o jsonpath={.status.containerStatuses[*].ready}
2021-07-13T00:14:44.9877762Z [lighthouse]$ [cluster2] print_section *** submariner-operator-56f895dd55-2zxfg ***
2021-07-13T00:14:44.9891368Z [lighthouse]$ [cluster2] print_section *** submariner-operator-56f895dd55-2zxfg ***
2021-07-13T00:14:44.9895417Z ====================================================================
2021-07-13T00:14:44.9899080Z ##[endgroup]
2021-07-13T00:14:44.9903283Z ##[group]*** submariner-operator-56f895dd55-2zxfg ***
2021-07-13T00:14:44.9906891Z ======================= *** submariner-operator-56f895dd55-2zxfg *** =======================
2021-07-13T00:14:44.9919589Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-operator-56f895dd55-2zxfg
2021-07-13T00:14:44.9933571Z [lighthouse]$ [cluster2] kubectl -n submariner-operator logs submariner-operator-56f895dd55-2zxfg
2021-07-13T00:14:44.9949662Z [lighthouse]$ [cluster2] command kubectl --context=cluster2 -n submariner-operator logs submariner-operator-56f895dd55-2zxfg
2021-07-13T00:14:45.3229785Z I0713 00:09:44.842333 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-13T00:14:45.3230512Z I0713 00:09:44.842599 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-13T00:14:45.3237153Z I0713 00:09:44.842692 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-13T00:14:45.3238264Z I0713 00:09:44.842775 1 main.go:80] cmd "msg"="Submariner operator version: devel-a203dc6"
2021-07-13T00:14:45.3245786Z I0713 00:09:44.843009 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-13T00:14:45.3246727Z I0713 00:09:45.566527 1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."
2021-07-13T00:14:45.3256258Z I0713 00:09:45.566588 1 leader.go:123] leader "msg"="Continuing as the leader."
2021-07-13T00:14:45.3257717Z I0713 00:09:45.972552 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-13T00:14:45.3263204Z I0713 00:09:45.973514 1 main.go:129] cmd "msg"="Registering Components."
2021-07-13T00:14:45.3264093Z I0713 00:09:45.974801 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-13T00:14:45.3272343Z I0713 00:09:50.976800 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:45.3276797Z I0713 00:09:50.976842 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-13T00:14:45.3279630Z I0713 00:09:50.976890 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-13T00:14:45.3280880Z I0713 00:09:50.977287 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-13T00:14:45.3288431Z I0713 00:09:50.978444 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-13T00:14:45.3302610Z I0713 00:09:50.979365 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-13T00:14:45.3313749Z I0713 00:09:50.980424 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-13T00:14:45.3318498Z I0713 00:09:50.987035 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-13T00:14:45.3322294Z I0713 00:09:50.990835 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-13T00:14:45.3326020Z I0713 00:09:51.082218 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-13T00:14:45.3330294Z I0713 00:09:51.085807 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-13T00:14:45.3333717Z I0713 00:09:51.089382 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-13T00:14:45.3336486Z I0713 00:09:51.091818 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-13T00:14:45.3338791Z I0713 00:09:51.116486 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-13T00:14:45.3340772Z I0713 00:09:51.116946 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-13T00:14:45.3343727Z I0713 00:09:51.183283 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-13T00:14:45.3347601Z I0713 00:09:51.187945 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-13T00:14:45.3349585Z I0713 00:09:51.190206 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-13T00:14:45.3351876Z I0713 00:09:51.193432 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-13T00:14:45.3392476Z I0713 00:09:51.384308 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-13T00:14:45.3394250Z I0713 00:09:51.384432 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-13T00:14:45.3396194Z I0713 00:09:51.384530 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-13T00:14:45.3398596Z I0713 00:09:51.388057 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-13T00:14:45.3400697Z I0713 00:09:51.388194
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment