Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 19, 2021 22:35
Show Gist options
  • Save dfarrell07/fcde223936e3e7eec4ab886aec75796d to your computer and use it in GitHub Desktop.
Save dfarrell07/fcde223936e3e7eec4ab886aec75796d to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210718-2
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-18T14:04:31.1182329Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-18T14:04:31.1182401Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-18T14:04:39.6565786Z Current runner version: '2.278.0'
2021-07-18T14:04:39.6595905Z ##[group]Operating System
2021-07-18T14:04:39.6597098Z Ubuntu
2021-07-18T14:04:39.6597630Z 20.04.2
2021-07-18T14:04:39.6598129Z LTS
2021-07-18T14:04:39.6598686Z ##[endgroup]
2021-07-18T14:04:39.6599288Z ##[group]Virtual Environment
2021-07-18T14:04:39.6600144Z Environment: ubuntu-20.04
2021-07-18T14:04:39.6600730Z Version: 20210712.0
2021-07-18T14:04:39.6601940Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-18T14:04:39.6603381Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-18T14:04:39.6604370Z ##[endgroup]
2021-07-18T14:04:39.6606512Z ##[group]GITHUB_TOKEN Permissions
2021-07-18T14:04:39.6608067Z Actions: write
2021-07-18T14:04:39.6608659Z Checks: write
2021-07-18T14:04:39.6609186Z Contents: write
2021-07-18T14:04:39.6609782Z Deployments: write
2021-07-18T14:04:39.6610531Z Discussions: write
2021-07-18T14:04:39.6611146Z Issues: write
2021-07-18T14:04:39.6611716Z Metadata: read
2021-07-18T14:04:39.6612231Z Packages: write
2021-07-18T14:04:39.6612831Z PullRequests: write
2021-07-18T14:04:39.6613497Z RepositoryProjects: write
2021-07-18T14:04:39.6614319Z SecurityEvents: write
2021-07-18T14:04:39.6614931Z Statuses: write
2021-07-18T14:04:39.6615649Z ##[endgroup]
2021-07-18T14:04:39.6619195Z Prepare workflow directory
2021-07-18T14:04:39.7313945Z Prepare all required actions
2021-07-18T14:04:39.7325441Z Getting action download info
2021-07-18T14:04:39.9608260Z Download action repository 'actions/checkout@v2'
2021-07-18T14:04:41.8971253Z Download action repository 'submariner-io/shipyard@devel'
2021-07-18T14:04:42.4330099Z ##[group]Run actions/checkout@v2
2021-07-18T14:04:42.4330812Z with:
2021-07-18T14:04:42.4331406Z repository: submariner-io/submariner-operator
2021-07-18T14:04:42.4332504Z token: ***
2021-07-18T14:04:42.4333027Z ssh-strict: true
2021-07-18T14:04:42.4333533Z persist-credentials: true
2021-07-18T14:04:42.4334026Z clean: true
2021-07-18T14:04:42.4334422Z fetch-depth: 1
2021-07-18T14:04:42.4334799Z lfs: false
2021-07-18T14:04:42.4335191Z submodules: false
2021-07-18T14:04:42.4335590Z ##[endgroup]
2021-07-18T14:04:42.6694163Z Syncing repository: submariner-io/submariner-operator
2021-07-18T14:04:42.6695164Z ##[group]Getting Git version info
2021-07-18T14:04:42.6696364Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:42.6765170Z [command]/usr/bin/git version
2021-07-18T14:04:42.6917876Z git version 2.32.0
2021-07-18T14:04:42.6943736Z ##[endgroup]
2021-07-18T14:04:42.6951797Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:42.6955980Z ##[group]Initializing the repository
2021-07-18T14:04:42.6960472Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-18T14:04:42.7040611Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-18T14:04:42.7041848Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-18T14:04:42.7042768Z hint: of your new repositories, which will suppress this warning, call:
2021-07-18T14:04:42.7043432Z hint:
2021-07-18T14:04:42.7044632Z hint: git config --global init.defaultBranch <name>
2021-07-18T14:04:42.7045389Z hint:
2021-07-18T14:04:42.7046347Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-18T14:04:42.7047672Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-18T14:04:42.7048407Z hint:
2021-07-18T14:04:42.7049100Z hint: git branch -m <name>
2021-07-18T14:04:42.7061073Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-18T14:04:42.7073726Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:42.7111517Z ##[endgroup]
2021-07-18T14:04:42.7112369Z ##[group]Disabling automatic garbage collection
2021-07-18T14:04:42.7116483Z [command]/usr/bin/git config --local gc.auto 0
2021-07-18T14:04:42.7150884Z ##[endgroup]
2021-07-18T14:04:42.7156031Z ##[group]Setting up auth
2021-07-18T14:04:42.7164187Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-18T14:04:42.7193806Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-18T14:04:43.2635800Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-18T14:04:43.2637889Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-18T14:04:43.2640785Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-18T14:04:43.2642164Z ##[endgroup]
2021-07-18T14:04:43.2642771Z ##[group]Fetching the repository
2021-07-18T14:04:43.2645005Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-18T14:04:43.2646283Z remote: Enumerating objects: 486, done.
2021-07-18T14:04:43.2646929Z remote: Counting objects: 0% (1/486)
2021-07-18T14:04:43.2647532Z remote: Counting objects: 1% (5/486)
2021-07-18T14:04:43.2648120Z remote: Counting objects: 2% (10/486)
2021-07-18T14:04:43.2649173Z remote: Counting objects: 3% (15/486)
2021-07-18T14:04:43.2650052Z remote: Counting objects: 4% (20/486)
2021-07-18T14:04:43.2650796Z remote: Counting objects: 5% (25/486)
2021-07-18T14:04:43.2651470Z remote: Counting objects: 6% (30/486)
2021-07-18T14:04:43.2652249Z remote: Counting objects: 7% (35/486)
2021-07-18T14:04:43.2652855Z remote: Counting objects: 8% (39/486)
2021-07-18T14:04:43.2653441Z remote: Counting objects: 9% (44/486)
2021-07-18T14:04:43.2654017Z remote: Counting objects: 10% (49/486)
2021-07-18T14:04:43.2654607Z remote: Counting objects: 11% (54/486)
2021-07-18T14:04:43.2655182Z remote: Counting objects: 12% (59/486)
2021-07-18T14:04:43.2655769Z remote: Counting objects: 13% (64/486)
2021-07-18T14:04:43.2656354Z remote: Counting objects: 14% (69/486)
2021-07-18T14:04:43.2656927Z remote: Counting objects: 15% (73/486)
2021-07-18T14:04:43.2657518Z remote: Counting objects: 16% (78/486)
2021-07-18T14:04:43.2658175Z remote: Counting objects: 17% (83/486)
2021-07-18T14:04:43.2659302Z remote: Counting objects: 18% (88/486)
2021-07-18T14:04:43.2659863Z remote: Counting objects: 19% (93/486)
2021-07-18T14:04:43.2660394Z remote: Counting objects: 20% (98/486)
2021-07-18T14:04:43.2661357Z remote: Counting objects: 21% (103/486)
2021-07-18T14:04:43.2662399Z remote: Counting objects: 22% (107/486)
2021-07-18T14:04:43.2662997Z remote: Counting objects: 23% (112/486)
2021-07-18T14:04:43.2663589Z remote: Counting objects: 24% (117/486)
2021-07-18T14:04:43.2664171Z remote: Counting objects: 25% (122/486)
2021-07-18T14:04:43.2664761Z remote: Counting objects: 26% (127/486)
2021-07-18T14:04:43.2665338Z remote: Counting objects: 27% (132/486)
2021-07-18T14:04:43.2665931Z remote: Counting objects: 28% (137/486)
2021-07-18T14:04:43.2666519Z remote: Counting objects: 29% (141/486)
2021-07-18T14:04:43.2667103Z remote: Counting objects: 30% (146/486)
2021-07-18T14:04:43.2667700Z remote: Counting objects: 31% (151/486)
2021-07-18T14:04:43.2668445Z remote: Counting objects: 32% (156/486)
2021-07-18T14:04:43.2669526Z remote: Counting objects: 33% (161/486)
2021-07-18T14:04:43.2670437Z remote: Counting objects: 34% (166/486)
2021-07-18T14:04:43.2671312Z remote: Counting objects: 35% (171/486)
2021-07-18T14:04:43.2672185Z remote: Counting objects: 36% (175/486)
2021-07-18T14:04:43.2672766Z remote: Counting objects: 37% (180/486)
2021-07-18T14:04:43.2673357Z remote: Counting objects: 38% (185/486)
2021-07-18T14:04:43.2673946Z remote: Counting objects: 39% (190/486)
2021-07-18T14:04:43.2674521Z remote: Counting objects: 40% (195/486)
2021-07-18T14:04:43.2675111Z remote: Counting objects: 41% (200/486)
2021-07-18T14:04:43.2675699Z remote: Counting objects: 42% (205/486)
2021-07-18T14:04:43.2676289Z remote: Counting objects: 43% (209/486)
2021-07-18T14:04:43.2676880Z remote: Counting objects: 44% (214/486)
2021-07-18T14:04:43.2677454Z remote: Counting objects: 45% (219/486)
2021-07-18T14:04:43.2678050Z remote: Counting objects: 46% (224/486)
2021-07-18T14:04:43.2679051Z remote: Counting objects: 47% (229/486)
2021-07-18T14:04:43.2679738Z remote: Counting objects: 48% (234/486)
2021-07-18T14:04:43.2680414Z remote: Counting objects: 49% (239/486)
2021-07-18T14:04:43.2682039Z remote: Counting objects: 50% (243/486)
2021-07-18T14:04:43.2682841Z remote: Counting objects: 51% (248/486)
2021-07-18T14:04:43.2683530Z remote: Counting objects: 52% (253/486)
2021-07-18T14:04:43.2684189Z remote: Counting objects: 53% (258/486)
2021-07-18T14:04:43.2685226Z remote: Counting objects: 54% (263/486)
2021-07-18T14:04:43.2685800Z remote: Counting objects: 55% (268/486)
2021-07-18T14:04:43.2686564Z remote: Counting objects: 56% (273/486)
2021-07-18T14:04:43.2687231Z remote: Counting objects: 57% (278/486)
2021-07-18T14:04:43.2687816Z remote: Counting objects: 58% (282/486)
2021-07-18T14:04:43.2688804Z remote: Counting objects: 59% (287/486)
2021-07-18T14:04:43.2689664Z remote: Counting objects: 60% (292/486)
2021-07-18T14:04:43.2690357Z remote: Counting objects: 61% (297/486)
2021-07-18T14:04:43.2691184Z remote: Counting objects: 62% (302/486)
2021-07-18T14:04:43.2692075Z remote: Counting objects: 63% (307/486)
2021-07-18T14:04:43.2692657Z remote: Counting objects: 64% (312/486)
2021-07-18T14:04:43.2693249Z remote: Counting objects: 65% (316/486)
2021-07-18T14:04:43.2693830Z remote: Counting objects: 66% (321/486)
2021-07-18T14:04:43.2694424Z remote: Counting objects: 67% (326/486)
2021-07-18T14:04:43.2695013Z remote: Counting objects: 68% (331/486)
2021-07-18T14:04:43.2695621Z remote: Counting objects: 69% (336/486)
2021-07-18T14:04:43.2696229Z remote: Counting objects: 70% (341/486)
2021-07-18T14:04:43.2696822Z remote: Counting objects: 71% (346/486)
2021-07-18T14:04:43.2697401Z remote: Counting objects: 72% (350/486)
2021-07-18T14:04:43.2697994Z remote: Counting objects: 73% (355/486)
2021-07-18T14:04:43.2699109Z remote: Counting objects: 74% (360/486)
2021-07-18T14:04:43.2699931Z remote: Counting objects: 75% (365/486)
2021-07-18T14:04:43.2700610Z remote: Counting objects: 76% (370/486)
2021-07-18T14:04:43.2701266Z remote: Counting objects: 77% (375/486)
2021-07-18T14:04:43.2701935Z remote: Counting objects: 78% (380/486)
2021-07-18T14:04:43.2702790Z remote: Counting objects: 79% (384/486)
2021-07-18T14:04:43.2703413Z remote: Counting objects: 80% (389/486)
2021-07-18T14:04:43.2704033Z remote: Counting objects: 81% (394/486)
2021-07-18T14:04:43.2704739Z remote: Counting objects: 82% (399/486)
2021-07-18T14:04:43.2705344Z remote: Counting objects: 83% (404/486)
2021-07-18T14:04:43.2705922Z remote: Counting objects: 84% (409/486)
2021-07-18T14:04:43.2706516Z remote: Counting objects: 85% (414/486)
2021-07-18T14:04:43.2707110Z remote: Counting objects: 86% (418/486)
2021-07-18T14:04:43.2707847Z remote: Counting objects: 87% (423/486)
2021-07-18T14:04:43.2708865Z remote: Counting objects: 88% (428/486)
2021-07-18T14:04:43.2709569Z remote: Counting objects: 89% (433/486)
2021-07-18T14:04:43.2712528Z remote: Counting objects: 90% (438/486)
2021-07-18T14:04:43.2713155Z remote: Counting objects: 91% (443/486)
2021-07-18T14:04:43.2713734Z remote: Counting objects: 92% (448/486)
2021-07-18T14:04:43.2714327Z remote: Counting objects: 93% (452/486)
2021-07-18T14:04:43.2714919Z remote: Counting objects: 94% (457/486)
2021-07-18T14:04:43.2715498Z remote: Counting objects: 95% (462/486)
2021-07-18T14:04:43.2716101Z remote: Counting objects: 96% (467/486)
2021-07-18T14:04:43.2716688Z remote: Counting objects: 97% (472/486)
2021-07-18T14:04:43.2717416Z remote: Counting objects: 98% (477/486)
2021-07-18T14:04:43.2718040Z remote: Counting objects: 99% (482/486)
2021-07-18T14:04:43.2719407Z remote: Counting objects: 100% (486/486)
2021-07-18T14:04:43.2720145Z remote: Counting objects: 100% (486/486), done.
2021-07-18T14:04:43.2720856Z remote: Compressing objects: 0% (1/352)
2021-07-18T14:04:43.2721702Z remote: Compressing objects: 1% (4/352)
2021-07-18T14:04:43.2722562Z remote: Compressing objects: 2% (8/352)
2021-07-18T14:04:43.2723302Z remote: Compressing objects: 3% (11/352)
2021-07-18T14:04:43.2723981Z remote: Compressing objects: 4% (15/352)
2021-07-18T14:04:43.2724657Z remote: Compressing objects: 5% (18/352)
2021-07-18T14:04:43.2725320Z remote: Compressing objects: 6% (22/352)
2021-07-18T14:04:43.2726116Z remote: Compressing objects: 7% (25/352)
2021-07-18T14:04:43.2726922Z remote: Compressing objects: 8% (29/352)
2021-07-18T14:04:43.2727564Z remote: Compressing objects: 9% (32/352)
2021-07-18T14:04:43.2728205Z remote: Compressing objects: 10% (36/352)
2021-07-18T14:04:43.2729651Z remote: Compressing objects: 11% (39/352)
2021-07-18T14:04:43.2730392Z remote: Compressing objects: 12% (43/352)
2021-07-18T14:04:43.2731102Z remote: Compressing objects: 13% (46/352)
2021-07-18T14:04:43.2732205Z remote: Compressing objects: 14% (50/352)
2021-07-18T14:04:43.2732879Z remote: Compressing objects: 15% (53/352)
2021-07-18T14:04:43.2733538Z remote: Compressing objects: 16% (57/352)
2021-07-18T14:04:43.2734212Z remote: Compressing objects: 17% (60/352)
2021-07-18T14:04:43.2734866Z remote: Compressing objects: 18% (64/352)
2021-07-18T14:04:43.2735651Z remote: Compressing objects: 19% (67/352)
2021-07-18T14:04:43.2736289Z remote: Compressing objects: 20% (71/352)
2021-07-18T14:04:43.2736908Z remote: Compressing objects: 21% (74/352)
2021-07-18T14:04:43.2737544Z remote: Compressing objects: 22% (78/352)
2021-07-18T14:04:43.2738170Z remote: Compressing objects: 23% (81/352)
2021-07-18T14:04:43.2739277Z remote: Compressing objects: 24% (85/352)
2021-07-18T14:04:43.2739985Z remote: Compressing objects: 25% (88/352)
2021-07-18T14:04:43.2740663Z remote: Compressing objects: 26% (92/352)
2021-07-18T14:04:43.2741355Z remote: Compressing objects: 27% (96/352)
2021-07-18T14:04:43.2742232Z remote: Compressing objects: 28% (99/352)
2021-07-18T14:04:43.2742849Z remote: Compressing objects: 29% (103/352)
2021-07-18T14:04:43.2743483Z remote: Compressing objects: 30% (106/352)
2021-07-18T14:04:43.2744107Z remote: Compressing objects: 31% (110/352)
2021-07-18T14:04:43.2744760Z remote: Compressing objects: 32% (113/352)
2021-07-18T14:04:43.2745398Z remote: Compressing objects: 33% (117/352)
2021-07-18T14:04:43.2746020Z remote: Compressing objects: 34% (120/352)
2021-07-18T14:04:43.2746661Z remote: Compressing objects: 35% (124/352)
2021-07-18T14:04:43.2747293Z remote: Compressing objects: 36% (127/352)
2021-07-18T14:04:43.2748086Z remote: Compressing objects: 37% (131/352)
2021-07-18T14:04:43.2749219Z remote: Compressing objects: 38% (134/352)
2021-07-18T14:04:43.2750041Z remote: Compressing objects: 39% (138/352)
2021-07-18T14:04:43.2751050Z remote: Compressing objects: 40% (141/352)
2021-07-18T14:04:43.2751844Z remote: Compressing objects: 41% (145/352)
2021-07-18T14:04:43.2752464Z remote: Compressing objects: 42% (148/352)
2021-07-18T14:04:43.2753102Z remote: Compressing objects: 43% (152/352)
2021-07-18T14:04:43.2753720Z remote: Compressing objects: 44% (155/352)
2021-07-18T14:04:43.2754372Z remote: Compressing objects: 45% (159/352)
2021-07-18T14:04:43.2755016Z remote: Compressing objects: 46% (162/352)
2021-07-18T14:04:43.2755638Z remote: Compressing objects: 47% (166/352)
2021-07-18T14:04:43.2756272Z remote: Compressing objects: 48% (169/352)
2021-07-18T14:04:43.2756906Z remote: Compressing objects: 49% (173/352)
2021-07-18T14:04:43.2757540Z remote: Compressing objects: 50% (176/352)
2021-07-18T14:04:43.2758174Z remote: Compressing objects: 51% (180/352)
2021-07-18T14:04:43.2759294Z remote: Compressing objects: 52% (184/352)
2021-07-18T14:04:43.2760000Z remote: Compressing objects: 53% (187/352)
2021-07-18T14:04:43.2760698Z remote: Compressing objects: 54% (191/352)
2021-07-18T14:04:43.2761383Z remote: Compressing objects: 55% (194/352)
2021-07-18T14:04:43.2762272Z remote: Compressing objects: 56% (198/352)
2021-07-18T14:04:43.2762890Z remote: Compressing objects: 57% (201/352)
2021-07-18T14:04:43.2763641Z remote: Compressing objects: 58% (205/352)
2021-07-18T14:04:43.2764336Z remote: Compressing objects: 59% (208/352)
2021-07-18T14:04:43.2764961Z remote: Compressing objects: 60% (212/352)
2021-07-18T14:04:43.2765593Z remote: Compressing objects: 61% (215/352)
2021-07-18T14:04:43.2766226Z remote: Compressing objects: 62% (219/352)
2021-07-18T14:04:43.2766863Z remote: Compressing objects: 63% (222/352)
2021-07-18T14:04:43.2767498Z remote: Compressing objects: 64% (226/352)
2021-07-18T14:04:43.2768118Z remote: Compressing objects: 65% (229/352)
2021-07-18T14:04:43.2769439Z remote: Compressing objects: 66% (233/352)
2021-07-18T14:04:43.2770157Z remote: Compressing objects: 67% (236/352)
2021-07-18T14:04:43.2770839Z remote: Compressing objects: 68% (240/352)
2021-07-18T14:04:43.2771639Z remote: Compressing objects: 69% (243/352)
2021-07-18T14:04:43.2772394Z remote: Compressing objects: 70% (247/352)
2021-07-18T14:04:43.2773036Z remote: Compressing objects: 71% (250/352)
2021-07-18T14:04:43.2773665Z remote: Compressing objects: 72% (254/352)
2021-07-18T14:04:43.2774429Z remote: Compressing objects: 73% (257/352)
2021-07-18T14:04:43.2775376Z remote: Compressing objects: 74% (261/352)
2021-07-18T14:04:43.2776141Z remote: Compressing objects: 75% (264/352)
2021-07-18T14:04:43.2776795Z remote: Compressing objects: 76% (268/352)
2021-07-18T14:04:43.2777428Z remote: Compressing objects: 77% (272/352)
2021-07-18T14:04:43.2778047Z remote: Compressing objects: 78% (275/352)
2021-07-18T14:04:43.2779161Z remote: Compressing objects: 79% (279/352)
2021-07-18T14:04:43.2779876Z remote: Compressing objects: 80% (282/352)
2021-07-18T14:04:43.2780700Z remote: Compressing objects: 81% (286/352)
2021-07-18T14:04:43.2781422Z remote: Compressing objects: 82% (289/352)
2021-07-18T14:04:43.2792076Z remote: Compressing objects: 83% (293/352)
2021-07-18T14:04:43.2792854Z remote: Compressing objects: 84% (296/352)
2021-07-18T14:04:43.2793606Z remote: Compressing objects: 85% (300/352)
2021-07-18T14:04:43.2794320Z remote: Compressing objects: 86% (303/352)
2021-07-18T14:04:43.2795266Z remote: Compressing objects: 87% (307/352)
2021-07-18T14:04:43.2796135Z remote: Compressing objects: 88% (310/352)
2021-07-18T14:04:43.2796837Z remote: Compressing objects: 89% (314/352)
2021-07-18T14:04:43.2797518Z remote: Compressing objects: 90% (317/352)
2021-07-18T14:04:43.2798215Z remote: Compressing objects: 91% (321/352)
2021-07-18T14:04:43.2799479Z remote: Compressing objects: 92% (324/352)
2021-07-18T14:04:43.2800216Z remote: Compressing objects: 93% (328/352)
2021-07-18T14:04:43.2800939Z remote: Compressing objects: 94% (331/352)
2021-07-18T14:04:43.2801893Z remote: Compressing objects: 95% (335/352)
2021-07-18T14:04:43.2802771Z remote: Compressing objects: 96% (338/352)
2021-07-18T14:04:43.2803460Z remote: Compressing objects: 97% (342/352)
2021-07-18T14:04:43.2804156Z remote: Compressing objects: 98% (345/352)
2021-07-18T14:04:43.2804891Z remote: Compressing objects: 99% (349/352)
2021-07-18T14:04:43.2805600Z remote: Compressing objects: 100% (352/352)
2021-07-18T14:04:43.2806317Z remote: Compressing objects: 100% (352/352), done.
2021-07-18T14:04:43.2841602Z Receiving objects: 0% (1/486)
2021-07-18T14:04:43.2915108Z Receiving objects: 1% (5/486)
2021-07-18T14:04:43.2915788Z Receiving objects: 2% (10/486)
2021-07-18T14:04:43.2916407Z Receiving objects: 3% (15/486)
2021-07-18T14:04:43.2917006Z Receiving objects: 4% (20/486)
2021-07-18T14:04:43.2917701Z Receiving objects: 5% (25/486)
2021-07-18T14:04:43.2918685Z Receiving objects: 6% (30/486)
2021-07-18T14:04:43.2919830Z Receiving objects: 7% (35/486)
2021-07-18T14:04:43.2920646Z Receiving objects: 8% (39/486)
2021-07-18T14:04:43.2921345Z Receiving objects: 9% (44/486)
2021-07-18T14:04:43.2922075Z Receiving objects: 10% (49/486)
2021-07-18T14:04:43.2922656Z Receiving objects: 11% (54/486)
2021-07-18T14:04:43.2923342Z Receiving objects: 12% (59/486)
2021-07-18T14:04:43.2924550Z Receiving objects: 13% (64/486)
2021-07-18T14:04:43.2931739Z Receiving objects: 14% (69/486)
2021-07-18T14:04:43.2932522Z Receiving objects: 15% (73/486)
2021-07-18T14:04:43.2933126Z Receiving objects: 16% (78/486)
2021-07-18T14:04:43.2933842Z Receiving objects: 17% (83/486)
2021-07-18T14:04:43.2934549Z Receiving objects: 18% (88/486)
2021-07-18T14:04:43.2935168Z Receiving objects: 19% (93/486)
2021-07-18T14:04:43.2935765Z Receiving objects: 20% (98/486)
2021-07-18T14:04:43.2936558Z Receiving objects: 21% (103/486)
2021-07-18T14:04:43.2937261Z Receiving objects: 22% (107/486)
2021-07-18T14:04:43.2938042Z Receiving objects: 23% (112/486)
2021-07-18T14:04:43.2939188Z Receiving objects: 24% (117/486)
2021-07-18T14:04:43.2939837Z Receiving objects: 25% (122/486)
2021-07-18T14:04:43.2940454Z Receiving objects: 26% (127/486)
2021-07-18T14:04:43.2941070Z Receiving objects: 27% (132/486)
2021-07-18T14:04:43.2941905Z Receiving objects: 28% (137/486)
2021-07-18T14:04:43.2942482Z Receiving objects: 29% (141/486)
2021-07-18T14:04:43.2943062Z Receiving objects: 30% (146/486)
2021-07-18T14:04:43.2943643Z Receiving objects: 31% (151/486)
2021-07-18T14:04:43.2944217Z Receiving objects: 32% (156/486)
2021-07-18T14:04:43.2944777Z Receiving objects: 33% (161/486)
2021-07-18T14:04:43.2945351Z Receiving objects: 34% (166/486)
2021-07-18T14:04:43.2945909Z Receiving objects: 35% (171/486)
2021-07-18T14:04:43.2946484Z Receiving objects: 36% (175/486)
2021-07-18T14:04:43.2947061Z Receiving objects: 37% (180/486)
2021-07-18T14:04:43.2947621Z Receiving objects: 38% (185/486)
2021-07-18T14:04:43.2948198Z Receiving objects: 39% (190/486)
2021-07-18T14:04:43.2949246Z Receiving objects: 40% (195/486)
2021-07-18T14:04:43.2950505Z Receiving objects: 41% (200/486)
2021-07-18T14:04:43.2980492Z Receiving objects: 42% (205/486)
2021-07-18T14:04:43.2981220Z Receiving objects: 43% (209/486)
2021-07-18T14:04:43.2982065Z Receiving objects: 44% (214/486)
2021-07-18T14:04:43.2982786Z Receiving objects: 45% (219/486)
2021-07-18T14:04:43.2983619Z Receiving objects: 46% (224/486)
2021-07-18T14:04:43.2984212Z Receiving objects: 47% (229/486)
2021-07-18T14:04:43.2986259Z Receiving objects: 48% (234/486)
2021-07-18T14:04:43.2994170Z Receiving objects: 49% (239/486)
2021-07-18T14:04:43.2994914Z Receiving objects: 50% (243/486)
2021-07-18T14:04:43.2997261Z Receiving objects: 51% (248/486)
2021-07-18T14:04:43.2999197Z Receiving objects: 52% (253/486)
2021-07-18T14:04:43.3000318Z Receiving objects: 53% (258/486)
2021-07-18T14:04:43.3014845Z Receiving objects: 54% (263/486)
2021-07-18T14:04:43.3015632Z Receiving objects: 55% (268/486)
2021-07-18T14:04:43.3016394Z Receiving objects: 56% (273/486)
2021-07-18T14:04:43.3017173Z Receiving objects: 57% (278/486)
2021-07-18T14:04:43.3017905Z Receiving objects: 58% (282/486)
2021-07-18T14:04:43.3019150Z Receiving objects: 59% (287/486)
2021-07-18T14:04:43.3020038Z Receiving objects: 60% (292/486)
2021-07-18T14:04:43.3020877Z Receiving objects: 61% (297/486)
2021-07-18T14:04:43.3021537Z Receiving objects: 62% (302/486)
2021-07-18T14:04:43.3022456Z Receiving objects: 63% (307/486)
2021-07-18T14:04:43.3023288Z Receiving objects: 64% (312/486)
2021-07-18T14:04:43.3023900Z Receiving objects: 65% (316/486)
2021-07-18T14:04:43.3024601Z Receiving objects: 66% (321/486)
2021-07-18T14:04:43.3025108Z Receiving objects: 67% (326/486)
2021-07-18T14:04:43.3025769Z Receiving objects: 68% (331/486)
2021-07-18T14:04:43.3026416Z Receiving objects: 69% (336/486)
2021-07-18T14:04:43.3027019Z Receiving objects: 70% (341/486)
2021-07-18T14:04:43.3027706Z Receiving objects: 71% (346/486)
2021-07-18T14:04:43.3028663Z Receiving objects: 72% (350/486)
2021-07-18T14:04:43.3030001Z Receiving objects: 73% (355/486)
2021-07-18T14:04:43.3030839Z Receiving objects: 74% (360/486)
2021-07-18T14:04:43.3031496Z Receiving objects: 75% (365/486)
2021-07-18T14:04:43.3032370Z Receiving objects: 76% (370/486)
2021-07-18T14:04:43.3032985Z Receiving objects: 77% (375/486)
2021-07-18T14:04:43.3033645Z Receiving objects: 78% (380/486)
2021-07-18T14:04:43.3034319Z Receiving objects: 79% (384/486)
2021-07-18T14:04:43.3034925Z Receiving objects: 80% (389/486)
2021-07-18T14:04:43.3035773Z Receiving objects: 81% (394/486)
2021-07-18T14:04:43.3036399Z Receiving objects: 82% (399/486)
2021-07-18T14:04:43.3037125Z Receiving objects: 83% (404/486)
2021-07-18T14:04:43.3037798Z Receiving objects: 84% (409/486)
2021-07-18T14:04:43.3038940Z Receiving objects: 85% (414/486)
2021-07-18T14:04:43.3039923Z Receiving objects: 86% (418/486)
2021-07-18T14:04:43.3040578Z Receiving objects: 87% (423/486)
2021-07-18T14:04:43.3041282Z Receiving objects: 88% (428/486)
2021-07-18T14:04:43.3042233Z Receiving objects: 89% (433/486)
2021-07-18T14:04:43.3042898Z Receiving objects: 90% (438/486)
2021-07-18T14:04:43.3044297Z remote: Total 486 (delta 155), reused 305 (delta 88), pack-reused 0
2021-07-18T14:04:43.3045125Z Receiving objects: 91% (443/486)
2021-07-18T14:04:43.3045838Z Receiving objects: 92% (448/486)
2021-07-18T14:04:43.3046655Z Receiving objects: 93% (452/486)
2021-07-18T14:04:43.3047340Z Receiving objects: 94% (457/486)
2021-07-18T14:04:43.3048015Z Receiving objects: 95% (462/486)
2021-07-18T14:04:43.3049371Z Receiving objects: 96% (467/486)
2021-07-18T14:04:43.3050051Z Receiving objects: 97% (472/486)
2021-07-18T14:04:43.3050771Z Receiving objects: 98% (477/486)
2021-07-18T14:04:43.3051469Z Receiving objects: 99% (482/486)
2021-07-18T14:04:43.3052297Z Receiving objects: 100% (486/486)
2021-07-18T14:04:43.3053045Z Receiving objects: 100% (486/486), 349.04 KiB | 8.95 MiB/s, done.
2021-07-18T14:04:43.3053782Z Resolving deltas: 0% (0/155)
2021-07-18T14:04:43.3054737Z Resolving deltas: 1% (2/155)
2021-07-18T14:04:43.3055404Z Resolving deltas: 2% (4/155)
2021-07-18T14:04:43.3056079Z Resolving deltas: 3% (5/155)
2021-07-18T14:04:43.3056864Z Resolving deltas: 4% (7/155)
2021-07-18T14:04:43.3057699Z Resolving deltas: 5% (8/155)
2021-07-18T14:04:43.3058735Z Resolving deltas: 6% (10/155)
2021-07-18T14:04:43.3059703Z Resolving deltas: 7% (11/155)
2021-07-18T14:04:43.3060605Z Resolving deltas: 8% (13/155)
2021-07-18T14:04:43.3061416Z Resolving deltas: 9% (14/155)
2021-07-18T14:04:43.3062231Z Resolving deltas: 10% (16/155)
2021-07-18T14:04:43.3062837Z Resolving deltas: 11% (18/155)
2021-07-18T14:04:43.3063439Z Resolving deltas: 12% (19/155)
2021-07-18T14:04:43.3064054Z Resolving deltas: 13% (21/155)
2021-07-18T14:04:43.3064770Z Resolving deltas: 14% (22/155)
2021-07-18T14:04:43.3065378Z Resolving deltas: 15% (24/155)
2021-07-18T14:04:43.3066015Z Resolving deltas: 16% (25/155)
2021-07-18T14:04:43.3066800Z Resolving deltas: 17% (27/155)
2021-07-18T14:04:43.3067602Z Resolving deltas: 18% (28/155)
2021-07-18T14:04:43.3068568Z Resolving deltas: 19% (30/155)
2021-07-18T14:04:43.3069415Z Resolving deltas: 20% (31/155)
2021-07-18T14:04:43.3070544Z Resolving deltas: 21% (33/155)
2021-07-18T14:04:43.3071330Z Resolving deltas: 22% (35/155)
2021-07-18T14:04:43.3072217Z Resolving deltas: 23% (36/155)
2021-07-18T14:04:43.3072869Z Resolving deltas: 24% (38/155)
2021-07-18T14:04:43.3073432Z Resolving deltas: 25% (39/155)
2021-07-18T14:04:43.3074075Z Resolving deltas: 26% (41/155)
2021-07-18T14:04:43.3074648Z Resolving deltas: 27% (42/155)
2021-07-18T14:04:43.3075273Z Resolving deltas: 28% (44/155)
2021-07-18T14:04:43.3075885Z Resolving deltas: 29% (45/155)
2021-07-18T14:04:43.3076448Z Resolving deltas: 30% (47/155)
2021-07-18T14:04:43.3077104Z Resolving deltas: 31% (49/155)
2021-07-18T14:04:43.3077679Z Resolving deltas: 32% (50/155)
2021-07-18T14:04:43.3078758Z Resolving deltas: 33% (52/155)
2021-07-18T14:04:43.3079805Z Resolving deltas: 34% (53/155)
2021-07-18T14:04:43.3080671Z Resolving deltas: 35% (55/155)
2021-07-18T14:04:43.3081463Z Resolving deltas: 36% (56/155)
2021-07-18T14:04:43.3082124Z Resolving deltas: 37% (58/155)
2021-07-18T14:04:43.3082880Z Resolving deltas: 38% (59/155)
2021-07-18T14:04:43.3083513Z Resolving deltas: 39% (61/155)
2021-07-18T14:04:43.3084361Z Resolving deltas: 40% (62/155)
2021-07-18T14:04:43.3085264Z Resolving deltas: 41% (64/155)
2021-07-18T14:04:43.3086749Z Resolving deltas: 42% (66/155)
2021-07-18T14:04:43.3087487Z Resolving deltas: 43% (67/155)
2021-07-18T14:04:43.3088741Z Resolving deltas: 44% (69/155)
2021-07-18T14:04:43.3089694Z Resolving deltas: 45% (70/155)
2021-07-18T14:04:43.3090620Z Resolving deltas: 46% (72/155)
2021-07-18T14:04:43.3091469Z Resolving deltas: 47% (73/155)
2021-07-18T14:04:43.3092038Z Resolving deltas: 48% (75/155)
2021-07-18T14:04:43.3092537Z Resolving deltas: 49% (76/155)
2021-07-18T14:04:43.3093082Z Resolving deltas: 50% (78/155)
2021-07-18T14:04:43.3093740Z Resolving deltas: 51% (80/155)
2021-07-18T14:04:43.3094507Z Resolving deltas: 52% (81/155)
2021-07-18T14:04:43.3094991Z Resolving deltas: 53% (83/155)
2021-07-18T14:04:43.3095426Z Resolving deltas: 54% (84/155)
2021-07-18T14:04:43.3096038Z Resolving deltas: 55% (86/155)
2021-07-18T14:04:43.3096520Z Resolving deltas: 56% (87/155)
2021-07-18T14:04:43.3097045Z Resolving deltas: 57% (89/155)
2021-07-18T14:04:43.3097566Z Resolving deltas: 58% (90/155)
2021-07-18T14:04:43.3098075Z Resolving deltas: 59% (92/155)
2021-07-18T14:04:43.3098898Z Resolving deltas: 60% (93/155)
2021-07-18T14:04:43.3099970Z Resolving deltas: 61% (95/155)
2021-07-18T14:04:43.3100692Z Resolving deltas: 62% (97/155)
2021-07-18T14:04:43.3101338Z Resolving deltas: 63% (98/155)
2021-07-18T14:04:43.3102234Z Resolving deltas: 64% (100/155)
2021-07-18T14:04:43.3102838Z Resolving deltas: 65% (101/155)
2021-07-18T14:04:43.3103538Z Resolving deltas: 66% (103/155)
2021-07-18T14:04:43.3104202Z Resolving deltas: 67% (104/155)
2021-07-18T14:04:43.3104813Z Resolving deltas: 68% (106/155)
2021-07-18T14:04:43.3105483Z Resolving deltas: 69% (107/155)
2021-07-18T14:04:43.3106088Z Resolving deltas: 70% (109/155)
2021-07-18T14:04:43.3106789Z Resolving deltas: 71% (111/155)
2021-07-18T14:04:43.3107449Z Resolving deltas: 72% (112/155)
2021-07-18T14:04:43.3108051Z Resolving deltas: 73% (114/155)
2021-07-18T14:04:43.3109094Z Resolving deltas: 74% (115/155)
2021-07-18T14:04:43.3110102Z Resolving deltas: 75% (117/155)
2021-07-18T14:04:43.3110876Z Resolving deltas: 76% (118/155)
2021-07-18T14:04:43.3111740Z Resolving deltas: 77% (120/155)
2021-07-18T14:04:43.3112368Z Resolving deltas: 78% (121/155)
2021-07-18T14:04:43.3113044Z Resolving deltas: 79% (123/155)
2021-07-18T14:04:43.3113677Z Resolving deltas: 80% (124/155)
2021-07-18T14:04:43.3114472Z Resolving deltas: 81% (126/155)
2021-07-18T14:04:43.3115080Z Resolving deltas: 82% (128/155)
2021-07-18T14:04:43.3115739Z Resolving deltas: 83% (129/155)
2021-07-18T14:04:43.3116396Z Resolving deltas: 84% (131/155)
2021-07-18T14:04:43.3117005Z Resolving deltas: 85% (132/155)
2021-07-18T14:04:43.3117688Z Resolving deltas: 86% (134/155)
2021-07-18T14:04:43.3118624Z Resolving deltas: 87% (135/155)
2021-07-18T14:04:43.3119397Z Resolving deltas: 88% (137/155)
2021-07-18T14:04:43.3120120Z Resolving deltas: 89% (138/155)
2021-07-18T14:04:43.3120762Z Resolving deltas: 90% (140/155)
2021-07-18T14:04:43.3121513Z Resolving deltas: 91% (142/155)
2021-07-18T14:04:43.3122400Z Resolving deltas: 92% (143/155)
2021-07-18T14:04:43.3123086Z Resolving deltas: 93% (145/155)
2021-07-18T14:04:43.3123986Z Resolving deltas: 94% (146/155)
2021-07-18T14:04:43.3124629Z Resolving deltas: 95% (148/155)
2021-07-18T14:04:43.3125367Z Resolving deltas: 96% (149/155)
2021-07-18T14:04:43.3126001Z Resolving deltas: 97% (151/155)
2021-07-18T14:04:43.3126850Z Resolving deltas: 98% (152/155)
2021-07-18T14:04:43.3127536Z Resolving deltas: 99% (154/155)
2021-07-18T14:04:43.3128154Z Resolving deltas: 100% (155/155)
2021-07-18T14:04:43.3129272Z Resolving deltas: 100% (155/155), done.
2021-07-18T14:04:43.3130710Z From https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:43.3132477Z * [new ref] 0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-18T14:04:43.3133392Z ##[endgroup]
2021-07-18T14:04:43.3134073Z ##[group]Determining the checkout info
2021-07-18T14:04:43.3134854Z ##[endgroup]
2021-07-18T14:04:43.3135551Z ##[group]Checking out the ref
2021-07-18T14:04:43.3136702Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-18T14:04:43.3137863Z Switched to a new branch 'devel'
2021-07-18T14:04:43.3139313Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-18T14:04:43.3140300Z ##[endgroup]
2021-07-18T14:04:43.3141285Z [command]/usr/bin/git log -1 --format='%H'
2021-07-18T14:04:43.3142416Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-18T14:04:43.3232720Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-18T14:04:43.3233426Z ##[endgroup]
2021-07-18T14:04:43.8960808Z ##[group]Reclaiming free space
2021-07-18T14:04:54.3707043Z Filesystem Size Used Avail Use% Mounted on
2021-07-18T14:04:54.3739955Z /dev/root 84G 42G 43G 50% /
2021-07-18T14:04:54.3740709Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-18T14:04:54.3741357Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-18T14:04:54.3742112Z tmpfs 696M 1.1M 695M 1% /run
2021-07-18T14:04:54.3742682Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-18T14:04:54.3743519Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-18T14:04:54.3744141Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-18T14:04:54.3744743Z /dev/loop2 68M 68M 0 100% /snap/lxd/20326
2021-07-18T14:04:54.3745351Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-18T14:04:54.3746113Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-18T14:04:54.3746850Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-18T14:04:54.3747476Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-18T14:04:54.3748228Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-18T14:04:54.3749176Z ##[endgroup]
2021-07-18T14:04:54.3895196Z ##[group]Disable swap
2021-07-18T14:04:54.4335497Z ##[endgroup]
2021-07-18T14:04:54.4457732Z ##[group]Report available RAM
2021-07-18T14:04:54.4556132Z total used free shared buff/cache available
2021-07-18T14:04:54.4557667Z Mem: 6.8Gi 488Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-18T14:04:54.4558244Z Swap: 0B 0B 0B
2021-07-18T14:04:54.4558844Z ##[endgroup]
2021-07-18T14:04:54.4718166Z Downloading Makefile.dapper
2021-07-18T14:04:54.5730163Z Downloading dapper
2021-07-18T14:04:54.8073701Z .dapper.tmp version v0.5.6
2021-07-18T14:04:54.8108788Z Downloading Dockerfile.dapper
2021-07-18T14:04:54.9092124Z docker network create -d bridge kind
2021-07-18T14:04:55.2663487Z 86c8f5140c3c5add43a9a1fd60a3e59f553afd64c7dab2145ab5bbf955e558e6
2021-07-18T14:04:55.2687259Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-18T14:04:55.5068530Z Sending build context to Docker daemon 7.517MB
2021-07-18T14:04:55.5068954Z
2021-07-18T14:04:55.5161365Z Step 1/8 : ARG BASE_BRANCH
2021-07-18T14:04:55.5163872Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-18T14:04:56.9148876Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-18T14:04:56.9164933Z b1495d80d526: Pulling fs layer
2021-07-18T14:04:56.9167170Z fb3037ce215d: Pulling fs layer
2021-07-18T14:04:56.9168829Z 95344349df1d: Pulling fs layer
2021-07-18T14:04:56.9170608Z a3e11b0fdbf6: Pulling fs layer
2021-07-18T14:04:56.9171738Z b2d0ef6cbe4f: Pulling fs layer
2021-07-18T14:04:56.9172946Z fa188fe30729: Pulling fs layer
2021-07-18T14:04:56.9174084Z 05ca4b0545ef: Pulling fs layer
2021-07-18T14:04:56.9175026Z b17ce80b21da: Pulling fs layer
2021-07-18T14:04:56.9176728Z b2d0ef6cbe4f: Waiting
2021-07-18T14:04:56.9177813Z fa188fe30729: Waiting
2021-07-18T14:04:56.9178533Z a3e11b0fdbf6: Waiting
2021-07-18T14:04:56.9179229Z b17ce80b21da: Waiting
2021-07-18T14:04:58.4167195Z b1495d80d526: Verifying Checksum
2021-07-18T14:04:58.4168252Z b1495d80d526: Download complete
2021-07-18T14:04:58.6898043Z 95344349df1d: Verifying Checksum
2021-07-18T14:04:58.6909598Z 95344349df1d: Download complete
2021-07-18T14:04:58.7633177Z a3e11b0fdbf6: Verifying Checksum
2021-07-18T14:04:58.7662795Z a3e11b0fdbf6: Download complete
2021-07-18T14:04:59.0330158Z b2d0ef6cbe4f: Verifying Checksum
2021-07-18T14:04:59.0334767Z b2d0ef6cbe4f: Download complete
2021-07-18T14:04:59.1301344Z fa188fe30729: Verifying Checksum
2021-07-18T14:04:59.1302169Z fa188fe30729: Download complete
2021-07-18T14:04:59.9001591Z 05ca4b0545ef: Verifying Checksum
2021-07-18T14:04:59.9031885Z 05ca4b0545ef: Download complete
2021-07-18T14:04:59.9033002Z b17ce80b21da: Verifying Checksum
2021-07-18T14:04:59.9034457Z b17ce80b21da: Download complete
2021-07-18T14:05:01.5299317Z b1495d80d526: Pull complete
2021-07-18T14:05:04.5092440Z fb3037ce215d: Verifying Checksum
2021-07-18T14:05:04.5093742Z fb3037ce215d: Download complete
2021-07-18T14:05:15.4804365Z fb3037ce215d: Pull complete
2021-07-18T14:05:17.0428904Z 95344349df1d: Pull complete
2021-07-18T14:05:17.1176530Z a3e11b0fdbf6: Pull complete
2021-07-18T14:05:17.1905012Z b2d0ef6cbe4f: Pull complete
2021-07-18T14:05:17.3716496Z fa188fe30729: Pull complete
2021-07-18T14:05:17.4411449Z 05ca4b0545ef: Pull complete
2021-07-18T14:05:17.5185556Z b17ce80b21da: Pull complete
2021-07-18T14:05:17.5242270Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-18T14:05:17.5266147Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-18T14:05:17.5283110Z ---> 92b726655a41
2021-07-18T14:05:17.5283623Z Step 3/8 : ARG PROJECT
2021-07-18T14:05:17.5477127Z ---> Running in 3ebeac2954ae
2021-07-18T14:05:18.5801266Z Removing intermediate container 3ebeac2954ae
2021-07-18T14:05:18.5802640Z ---> 734d34c66c7c
2021-07-18T14:05:18.5804229Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-18T14:05:18.5997213Z ---> Running in 3719f7554fb0
2021-07-18T14:05:19.6288013Z Removing intermediate container 3719f7554fb0
2021-07-18T14:05:19.6324564Z ---> 23626febc940
2021-07-18T14:05:19.6325606Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-18T14:05:19.6592497Z ---> Running in f4fdbf02d02c
2021-07-18T14:05:20.6254468Z Removing intermediate container f4fdbf02d02c
2021-07-18T14:05:20.6259056Z ---> 8378ff61e6e6
2021-07-18T14:05:20.6263168Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-18T14:05:20.6408761Z ---> Running in b80e4c539975
2021-07-18T14:05:21.6153426Z Removing intermediate container b80e4c539975
2021-07-18T14:05:21.6154696Z ---> 67bb19b4bf7e
2021-07-18T14:05:21.6155481Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-18T14:05:21.6364116Z ---> Running in e2c616107843
2021-07-18T14:05:22.6380552Z Removing intermediate container e2c616107843
2021-07-18T14:05:22.6384241Z ---> 42700df0336d
2021-07-18T14:05:22.6384930Z Step 8/8 : CMD ["sh"]
2021-07-18T14:05:22.6595887Z ---> Running in fce5a99a7913
2021-07-18T14:05:23.6785866Z Removing intermediate container fce5a99a7913
2021-07-18T14:05:23.6789160Z ---> 8a3db436f845
2021-07-18T14:05:23.6931860Z Successfully built 8a3db436f845
2021-07-18T14:05:23.7019832Z Successfully tagged submariner-operator:devel
2021-07-18T14:05:24.2053458Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-18T14:05:24.2065062Z [submariner-operator]$ mkdir -p bin dist output
2021-07-18T14:05:24.2103825Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-18T14:05:24.2104456Z GNU Make 4.3
2021-07-18T14:05:24.2111051Z Built for x86_64-redhat-linux-gnu
2021-07-18T14:05:24.2152431Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-18T14:05:24.2153277Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-18T14:05:24.2154140Z This is free software: you are free to change and redistribute it.
2021-07-18T14:05:24.2154878Z There is NO WARRANTY, to the extent permitted by law.
2021-07-18T14:05:24.2155476Z Reading makefiles...
2021-07-18T14:05:24.3220294Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-18T14:05:24.3221610Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-18T14:05:24.5270798Z Updating makefiles....
2021-07-18T14:05:24.5279782Z Updating goal targets....
2021-07-18T14:05:24.5280954Z File 'upgrade-e2e' does not exist.
2021-07-18T14:05:24.5284258Z File 'deploy-latest' does not exist.
2021-07-18T14:05:24.5284955Z Must remake target 'deploy-latest'.
2021-07-18T14:05:24.5286257Z curl -L get.submariner.io | VERSION=latest bash
2021-07-18T14:05:24.5397379Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-18T14:05:24.5408974Z Dload Upload Total Spent Left Speed
2021-07-18T14:05:24.5409397Z
2021-07-18T14:05:24.5773581Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-18T14:05:24.5782266Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-18T14:05:24.7179436Z
2021-07-18T14:05:24.7180682Z 100 4155 0 4155 0 0 23212 0 --:--:-- --:--:-- --:--:-- 23212
2021-07-18T14:05:24.8825929Z Installing subctl version latest
2021-07-18T14:05:24.8828746Z OS detected: linux
2021-07-18T14:05:24.8830521Z Architecture detected: amd64
2021-07-18T14:05:24.8833246Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-18T14:05:24.8835024Z
2021-07-18T14:05:24.8836351Z Downloading...
2021-07-18T14:05:26.2151720Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-18T14:05:26.2517007Z This provides subctl version: v0.9.1
2021-07-18T14:05:26.2537108Z
2021-07-18T14:05:26.2537936Z please update your path (and consider adding it to ~/.profile):
2021-07-18T14:05:26.2538584Z export PATH=$PATH:/root/.local/bin
2021-07-18T14:05:26.2539019Z
2021-07-18T14:05:26.2629160Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-18T14:05:26.2659021Z GNU Make 4.3
2021-07-18T14:05:26.2659862Z Built for x86_64-redhat-linux-gnu
2021-07-18T14:05:26.2660688Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-18T14:05:26.2661619Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-18T14:05:26.2662534Z This is free software: you are free to change and redistribute it.
2021-07-18T14:05:26.2663176Z There is NO WARRANTY, to the extent permitted by law.
2021-07-18T14:05:26.2663694Z Reading makefiles...
2021-07-18T14:05:26.2664568Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-18T14:05:26.3742551Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-18T14:05:26.5772430Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-18T14:05:26.5773285Z Updating makefiles....
2021-07-18T14:05:26.5781163Z Updating goal targets....
2021-07-18T14:05:26.5782058Z File 'clusters' does not exist.
2021-07-18T14:05:26.5782726Z Must remake target 'clusters'.
2021-07-18T14:05:26.5784142Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:26.5819460Z Downloading shflags 1.0.3
2021-07-18T14:05:26.5877643Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-18T14:05:26.5878336Z Dload Upload Total Spent Left Speed
2021-07-18T14:05:26.5878673Z
2021-07-18T14:05:26.6237737Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-18T14:05:26.6238643Z 100 31091 100 31091 0 0 843k 0 --:--:-- --:--:-- --:--:-- 867k
2021-07-18T14:05:26.6909593Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-18T14:05:26.6938330Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:05:26.6950920Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:26.6963690Z [submariner-operator]$ script_name=utils
2021-07-18T14:05:26.6976777Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:26.6996364Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:05:26.7009570Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:26.7024541Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:26.7038710Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:26.7061382Z [submariner-operator]$ broker=cluster1
2021-07-18T14:05:26.7074733Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:05:26.7085981Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:05:26.7096652Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:05:26.7106561Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:05:26.7119844Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:05:26.7132918Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:05:26.7145943Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:05:26.7158310Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:05:26.7170806Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:05:26.7183018Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:05:26.7191405Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:05:26.7203423Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:26.7213822Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:26.7228353Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:26.7240519Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:26.7262137Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:05:26.7271848Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:05:26.7302141Z [submariner-operator]$ cat <<EOM
2021-07-18T14:05:26.7303590Z Cluster settings::
2021-07-18T14:05:26.7304209Z broker - ${broker@Q}
2021-07-18T14:05:26.7304735Z clusters - ${clusters[*]@Q}
2021-07-18T14:05:26.7305348Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-18T14:05:26.7306188Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-18T14:05:26.7307291Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-18T14:05:26.7307935Z EOM
2021-07-18T14:05:26.7335756Z [submariner-operator]$ typeset -p cluster_cni
2021-07-18T14:05:26.7351419Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:26.7380062Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-18T14:05:26.7394622Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:26.7432051Z [submariner-operator]$ typeset -p cluster_subm
2021-07-18T14:05:26.7444188Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:26.7463086Z Cluster settings::
2021-07-18T14:05:26.7463750Z broker - 'cluster1'
2021-07-18T14:05:26.7464330Z clusters - 'cluster1' 'cluster2'
2021-07-18T14:05:26.7464966Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-18T14:05:26.7466232Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-18T14:05:26.7467698Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-18T14:05:26.7479467Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:26.7498275Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:26.7521661Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:26.7534581Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:26.7546231Z [submariner-operator]$ registry_running
2021-07-18T14:05:26.7557820Z [submariner-operator]$ registry_running
2021-07-18T14:05:26.7569304Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-18T14:05:26.7583617Z [submariner-operator]$ grep kind-registry
2021-07-18T14:05:27.0107981Z [submariner-operator]$ return 0
2021-07-18T14:05:27.0113773Z Deploying local registry kind-registry to serve images centrally.
2021-07-18T14:05:27.0126789Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-18T14:05:27.0138663Z [submariner-operator]$ selinuxenabled
2021-07-18T14:05:27.0163625Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-18T14:05:27.2793314Z Unable to find image 'registry:2' locally
2021-07-18T14:05:28.5422827Z 2: Pulling from library/registry
2021-07-18T14:05:28.9079726Z ddad3d7c1e96: Already exists
2021-07-18T14:05:28.9112851Z 6eda6749503f: Pulling fs layer
2021-07-18T14:05:28.9113736Z 363ab70c2143: Pulling fs layer
2021-07-18T14:05:28.9114261Z 5b94580856e6: Pulling fs layer
2021-07-18T14:05:28.9114772Z 12008541203a: Pulling fs layer
2021-07-18T14:05:28.9115133Z 12008541203a: Waiting
2021-07-18T14:05:29.2839696Z 5b94580856e6: Verifying Checksum
2021-07-18T14:05:29.2840354Z 5b94580856e6: Download complete
2021-07-18T14:05:29.2888900Z 6eda6749503f: Download complete
2021-07-18T14:05:29.3640267Z 363ab70c2143: Verifying Checksum
2021-07-18T14:05:29.3647516Z 363ab70c2143: Download complete
2021-07-18T14:05:29.7253160Z 12008541203a: Verifying Checksum
2021-07-18T14:05:29.7253686Z 12008541203a: Download complete
2021-07-18T14:05:29.7358734Z 6eda6749503f: Pull complete
2021-07-18T14:05:30.0714346Z 363ab70c2143: Pull complete
2021-07-18T14:05:30.1529655Z 5b94580856e6: Pull complete
2021-07-18T14:05:30.2227518Z 12008541203a: Pull complete
2021-07-18T14:05:30.2284305Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-18T14:05:30.2303702Z Status: Downloaded newer image for registry:2
2021-07-18T14:05:30.2509190Z 5cc48f9b372ebf167aea2165456377b4b773f5268822d20cc587805de4334d52
2021-07-18T14:05:30.6034516Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-18T14:05:30.9989129Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:30.9999693Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:31.0008409Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:05:31.0018469Z [submariner-operator]$ i=1
2021-07-18T14:05:31.0027477Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:31.0038307Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:31.0052581Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:05:31.0068294Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:05:31.0069183Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:05:31.0080998Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:31.0084954Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:31.0098173Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:05:31.0109159Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:05:31.0121936Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:05:31.0130802Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0138422Z [submariner-operator]$ [cluster2] wait 288
2021-07-18T14:05:31.0142683Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0153147Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0166680Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0176202Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:05:31.0191116Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:05:31.0210768Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:05:31.0213960Z [submariner-operator]$ [cluster1] pids[cluster1]=297
2021-07-18T14:05:31.0227811Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0236106Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:05:31.0246869Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-18T14:05:31.0253684Z [submariner-operator]$ [cluster2] pids[cluster2]=300
2021-07-18T14:05:31.0266689Z [submariner-operator]$ [cluster2] wait 300
2021-07-18T14:05:31.0272821Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:05:31.0279650Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:07:31.9273828Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:07:31.9275368Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:07:31.9276760Z [submariner-operator]$ [cluster2] wait 320
2021-07-18T14:07:31.9277710Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:31.9278821Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:31.9280368Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:31.9282505Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:31.9283936Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-18T14:07:31.9285525Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-18T14:07:31.9286338Z [cluster2] No kind clusters found.
2021-07-18T14:07:31.9286904Z [cluster2] Creating KIND cluster...
2021-07-18T14:07:31.9288012Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:31.9289117Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:31.9290107Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-18T14:07:31.9291126Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:31.9291896Z [cluster2] - role: control-plane
2021-07-18T14:07:31.9292682Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:31.9293424Z [cluster2] - role: control-plane
2021-07-18T14:07:31.9294069Z [cluster2] - role: worker
2021-07-18T14:07:31.9295843Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:31.9296735Z [cluster2] - role: control-plane
2021-07-18T14:07:31.9297393Z [cluster2] - role: worker
2021-07-18T14:07:31.9298123Z [cluster2] - role: worker
2021-07-18T14:07:31.9298681Z [cluster2] 
2021-07-18T14:07:31.9299183Z [cluster2] 
2021-07-18T14:07:31.9299941Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-18T14:07:31.9301312Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:31.9303914Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-18T14:07:31.9305380Z [submariner-operator]$ [cluster2] kind version
2021-07-18T14:07:31.9306044Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:31.9307181Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:31.9308231Z [cluster2] ---
2021-07-18T14:07:31.9308865Z [cluster2] kind: Cluster
2021-07-18T14:07:31.9309639Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:31.9313762Z [cluster2] networking:
2021-07-18T14:07:31.9314321Z [cluster2] disableDefaultCNI: true
2021-07-18T14:07:31.9315398Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-18T14:07:31.9315928Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-18T14:07:31.9317414Z [cluster2] containerdConfigPatches:
2021-07-18T14:07:31.9318278Z [cluster2] - |-
2021-07-18T14:07:31.9319076Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:31.9320385Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:31.9321111Z [cluster2] kubeadmConfigPatches:
2021-07-18T14:07:31.9322458Z [cluster2] - |
2021-07-18T14:07:31.9323013Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:31.9323718Z [cluster2] kind: ClusterConfiguration
2021-07-18T14:07:31.9324284Z [cluster2] metadata:
2021-07-18T14:07:31.9325021Z [cluster2] name: config
2021-07-18T14:07:31.9325621Z [cluster2] networking:
2021-07-18T14:07:31.9326126Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-18T14:07:31.9326658Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-18T14:07:31.9327263Z [cluster2] dnsDomain: cluster2.local
2021-07-18T14:07:31.9327792Z [cluster2] nodes:
2021-07-18T14:07:31.9328485Z [cluster2] - role: control-plane
2021-07-18T14:07:31.9329144Z [cluster2] - role: worker
2021-07-18T14:07:31.9329733Z [cluster2] - role: worker
2021-07-18T14:07:31.9331344Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:31.9332501Z [cluster2] Creating cluster "cluster2" ...
2021-07-18T14:07:31.9345779Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-18T14:07:31.9347602Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-18T14:07:31.9348809Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-18T14:07:31.9350164Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-18T14:07:31.9351286Z [cluster2] • Writing configuration 📜 ...
2021-07-18T14:07:31.9352088Z [cluster2] ✓ Writing configuration 📜
2021-07-18T14:07:31.9353102Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-18T14:07:31.9353899Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-18T14:07:31.9357962Z [cluster2] • Installing StorageClass 💾 ...
2021-07-18T14:07:31.9366064Z [cluster2] ✓ Installing StorageClass 💾
2021-07-18T14:07:31.9376533Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-18T14:07:31.9619092Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-18T14:07:31.9619915Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-18T14:07:31.9620580Z [cluster2] You can now use your cluster with:
2021-07-18T14:07:31.9621169Z [cluster2]
2021-07-18T14:07:31.9621953Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-18T14:07:31.9622543Z [cluster2]
2021-07-18T14:07:31.9623610Z [cluster2] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-18T14:07:31.9624831Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:31.9625791Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:31.9627315Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-18T14:07:31.9628691Z [submariner-operator]$ [cluster2] head -n 1
2021-07-18T14:07:35.5613057Z [3[submariner-operator]$ [cluster1] with_retries
2021-07-18T14:07:35.5614083Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:07:35.5615253Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:35.5616160Z [submariner-operator]$ [cluster1] wait 318
2021-07-18T14:07:35.5617066Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:35.5618905Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:35.5620758Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:35.5622022Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-18T14:07:35.5622891Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-18T14:07:35.5623478Z [cluster1] No kind clusters found.
2021-07-18T14:07:35.5623990Z [cluster1] Creating KIND cluster...
2021-07-18T14:07:35.5625046Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:35.5626040Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:35.5626990Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-18T14:07:35.5627987Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:35.5628790Z [cluster1] - role: control-plane
2021-07-18T14:07:35.5629508Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:35.5630913Z [cluster1] - role: control-plane
2021-07-18T14:07:35.5631538Z [cluster1] - role: worker
2021-07-18T14:07:35.5632249Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:35.5632964Z [cluster1] - role: control-plane
2021-07-18T14:07:35.5633684Z [cluster1] - role: worker
2021-07-18T14:07:35.5634216Z [cluster1] - role: worker
2021-07-18T14:07:35.5634993Z [cluster1] 
2021-07-18T14:07:35.5635750Z [cluster1] 
2021-07-18T14:07:35.5636737Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-18T14:07:35.5638020Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:35.5639682Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-18T14:07:35.5640610Z [submariner-operator]$ [cluster1] kind version
2021-07-18T14:07:35.5641192Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:35.5642279Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:35.5643127Z [cluster1] ---
2021-07-18T14:07:35.5643511Z [cluster1] kind: Cluster
2021-07-18T14:07:35.5644151Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:35.5644963Z [cluster1] networking:
2021-07-18T14:07:35.5645719Z [cluster1] disableDefaultCNI: true
2021-07-18T14:07:35.5647263Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-18T14:07:35.5647842Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-18T14:07:35.5648870Z [cluster1] containerdConfigPatches:
2021-07-18T14:07:35.5649753Z [cluster1] - |-
2021-07-18T14:07:35.5650448Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:35.5651498Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:35.5652158Z [cluster1] kubeadmConfigPatches:
2021-07-18T14:07:35.5652752Z [cluster1] - |
2021-07-18T14:07:35.5653239Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:35.5653862Z [cluster1] kind: ClusterConfiguration
2021-07-18T14:07:35.5654537Z [cluster1] metadata:
2021-07-18T14:07:35.5656183Z [cluster1] name: config
2021-07-18T14:07:35.5656700Z [cluster1] networking:
2021-07-18T14:07:35.5657204Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-18T14:07:35.5657742Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-18T14:07:35.5658539Z [cluster1] dnsDomain: cluster1.local
2021-07-18T14:07:35.5659013Z [cluster1] nodes:
2021-07-18T14:07:35.5660431Z [cluster1] - role: control-plane
2021-07-18T14:07:35.5661149Z [cluster1] - role: worker
2021-07-18T14:07:35.5661711Z [cluster1] - role: worker
2021-07-18T14:07:35.5663115Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:35.5664472Z [cluster1] Creating cluster "cluster1" ...
2021-07-18T14:07:35.5665624Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-18T14:07:35.5666642Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-18T14:07:35.5667541Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-18T14:07:35.5668881Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-18T14:07:35.5669577Z [cluster1] • Writing configuration 📜 ...
2021-07-18T14:07:35.5671168Z [cluster1] ✓ Writing configuration 📜
2021-07-18T14:07:35.5671872Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-18T14:07:35.5672629Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-18T14:07:35.5673311Z [cluster1] • Installing StorageClass 💾 ...
2021-07-18T14:07:35.5674005Z [cluster1] ✓ Installing StorageClass 💾
2021-07-18T14:07:35.5674917Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-18T14:07:35.5675620Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-18T14:07:35.5676397Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-18T14:07:35.5677158Z [cluster1] You can now use your cluster with:
2021-07-18T14:07:35.5677688Z [cluster1]
2021-07-18T14:07:35.5678673Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-18T14:07:35.5679226Z [cluster1]
2021-07-18T14:07:35.5680221Z [cluster1] Not sure what to do next? 😅 Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-18T14:07:35.5681356Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:35.5682256Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:35.5683679Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-18T14:07:35.5685603Z [submariner-operator]$ [cluster1] head -n 1
2021-07-18T14:08:02.2926205Z [sub6m[submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.7:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2929212Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2933732Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2935895Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2938067Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2940417Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:02.2941819Z [submariner-operator]$ [cluster2] wait 1545
2021-07-18T14:08:02.2942836Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:08:02.2943962Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:08:02.2944846Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:08:02.2945639Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:08:02.2946498Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-18T14:08:02.2947357Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:08:02.2978095Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:08:02.2978730Z [cluster2] Applying weave network...
2021-07-18T14:08:02.2980395Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:08:02.2983096Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:08:02.2985139Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-18T14:08:02.2986376Z [cluster2] serviceaccount/weave-net created
2021-07-18T14:08:02.2987415Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:02.2988857Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:02.2990823Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:02.2992543Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:02.2993837Z [cluster2] daemonset.apps/weave-net created
2021-07-18T14:08:02.2994641Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-18T14:08:02.2995870Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:02.2997741Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:02.2999397Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:02.3001716Z [cluster2] pod/weave-net-bmrbj condition met
2021-07-18T14:08:02.3002988Z [cluster2] pod/weave-net-jdcgl condition met
2021-07-18T14:08:02.3004637Z [cluster2] pod/weave-net-qc4w8 condition met
2021-07-18T14:08:02.3006627Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-18T14:08:02.3008176Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:02.3009845Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:02.3011553Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:02.3037646Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:08:02.3038993Z [cluster2] deployment "coredns" successfully rolled out
2021-07-18T14:08:02.3040746Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:08:02.3043718Z [submariner-operator]$ [cluster2] wait 297
2021-07-18T14:08:12.0321593Z mariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0325285Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0327843Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0330279Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0332610Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0334828Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:12.0336521Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:08:12.0337595Z [submariner-operator]$ [cluster1] wait 1651
2021-07-18T14:08:12.0338697Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:08:12.0339934Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:08:12.0341038Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:08:12.0342167Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-18T14:08:12.0343239Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:08:12.0344220Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:08:12.0344978Z [cluster1] Applying weave network...
2021-07-18T14:08:12.0346533Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:08:12.0348419Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:08:12.0350835Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-18T14:08:12.0352323Z [cluster1] serviceaccount/weave-net created
2021-07-18T14:08:12.0353842Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:12.0355646Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:12.0357499Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:12.0447363Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:12.0448907Z [cluster1] daemonset.apps/weave-net created
2021-07-18T14:08:12.0449897Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-18T14:08:12.0458884Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:12.0460851Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:12.0462357Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:12.0472788Z [cluster1] pod/weave-net-dknmd condition met
2021-07-18T14:08:12.0473778Z [cluster1] pod/weave-net-j8vp9 condition met
2021-07-18T14:08:12.0474679Z [cluster1] pod/weave-net-tfzk7 condition met
2021-07-18T14:08:12.0475445Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-18T14:08:12.0476966Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:12.0478399Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:12.0480145Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:12.0481457Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:08:12.0482541Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:08:12.0484537Z [cluster1] deployment "coredns" successfully rolled out
2021-07-18T14:08:12.0485743Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:08:12.0486657Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:08:12.0487169Z
2021-07-18T14:08:12.0488106Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:08:12.0488725Z
2021-07-18T14:08:12.0489658Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:08:12.0490093Z
2021-07-18T14:08:12.0490719Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:08:12.0491499Z Successfully remade target file 'clusters'.
2021-07-18T14:08:12.0492450Z File 'bin/subctl' does not exist.
2021-07-18T14:08:12.0493302Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-18T14:08:12.0496535Z File 'generate-embeddedyamls' does not exist.
2021-07-18T14:08:12.0504974Z File 'generate' does not exist.
2021-07-18T14:08:12.0506521Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-18T14:08:12.0507780Z File 'vendor/modules.txt' does not exist.
2021-07-18T14:08:12.0508567Z Must remake target 'vendor/modules.txt'.
2021-07-18T14:08:12.0509182Z go mod download
2021-07-18T14:08:12.0510604Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:08:12.0511642Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:08:12.0512552Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-18T14:08:12.0513431Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:08:12.0513916Z
2021-07-18T14:08:12.0514773Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:08:12.0515357Z
2021-07-18T14:08:12.0516300Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:08:12.0516771Z
2021-07-18T14:08:12.0517434Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:08:12.0518079Z EOM
2021-07-18T14:09:12.4745167Z go mod vendor
2021-07-18T14:09:14.8422886Z go mod tidy
2021-07-18T14:09:15.5512334Z Successfully remade target file 'vendor/modules.txt'.
2021-07-18T14:09:15.5513586Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:09:15.5515143Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-18T14:09:15.5553244Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-18T14:09:36.9032230Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:09:36.9033618Z Must remake target 'generate'.
2021-07-18T14:09:36.9072169Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-18T14:09:49.5935945Z Successfully remade target file 'generate'.
2021-07-18T14:09:49.5937094Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-18T14:09:49.5941671Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-18T14:09:49.5946730Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:09:49.5948594Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-18T14:09:51.9873561Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:09:51.9877957Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-18T14:09:51.9879463Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:09:51.9881682Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-18T14:09:53.4742105Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:09:53.4847362Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:09:53.4848349Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-18T14:09:54.2106618Z Generating yamls.go
2021-07-18T14:09:54.2107509Z deploy/crds/submariner.io_brokers.yaml
2021-07-18T14:09:54.2113302Z deploy/crds/submariner.io_submariners.yaml
2021-07-18T14:09:54.2145839Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-18T14:09:54.2151350Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-18T14:09:54.2162442Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-18T14:09:54.2163474Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-18T14:09:54.2169309Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-18T14:09:54.2176506Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-18T14:09:54.2187165Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-18T14:09:54.2197682Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-18T14:09:54.2206039Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-18T14:09:54.2213512Z config/broker/broker-admin/service_account.yaml
2021-07-18T14:09:54.2217378Z config/broker/broker-admin/role.yaml
2021-07-18T14:09:54.2225374Z config/broker/broker-admin/role_binding.yaml
2021-07-18T14:09:54.2234678Z config/broker/broker-client/service_account.yaml
2021-07-18T14:09:54.2239903Z config/broker/broker-client/role.yaml
2021-07-18T14:09:54.2246302Z config/broker/broker-client/role_binding.yaml
2021-07-18T14:09:54.2250335Z config/rbac/submariner-operator/service_account.yaml
2021-07-18T14:09:54.2255113Z config/rbac/submariner-operator/role.yaml
2021-07-18T14:09:54.2260338Z config/rbac/submariner-operator/role_binding.yaml
2021-07-18T14:09:54.2267359Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-18T14:09:54.2273434Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-18T14:09:54.2276575Z config/rbac/submariner-gateway/service_account.yaml
2021-07-18T14:09:54.2282398Z config/rbac/submariner-gateway/role.yaml
2021-07-18T14:09:54.2285983Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-18T14:09:54.2290392Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-18T14:09:54.2296601Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-18T14:09:54.2302598Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-18T14:09:54.2306333Z config/rbac/submariner-route-agent/role.yaml
2021-07-18T14:09:54.2312095Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-18T14:09:54.2316524Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-18T14:09:54.2321197Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-18T14:09:54.2325562Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-18T14:09:54.2331176Z config/rbac/submariner-globalnet/role.yaml
2021-07-18T14:09:54.2335701Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-18T14:09:54.2340406Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-18T14:09:54.2344531Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-18T14:09:54.2348175Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-18T14:09:54.2353602Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-18T14:09:54.2358104Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-18T14:09:54.2362648Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-18T14:09:54.2367172Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-18T14:09:54.2375457Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-18T14:09:54.2376640Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-18T14:09:54.2379904Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-18T14:09:54.2384538Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-18T14:09:54.2390555Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-18T14:09:54.2396130Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-18T14:09:54.2451790Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:09:54.2453006Z Must remake target 'generate-embeddedyamls'.
2021-07-18T14:09:54.2454110Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-18T14:09:54.2674168Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-18T14:09:54.2678882Z mkdir -p bin
2021-07-18T14:09:54.2707474Z target=bin/subctl-latest-linux-amd64; \
2021-07-18T14:09:54.2708181Z target=${target%.exe}; \
2021-07-18T14:09:54.2709122Z components=($(echo ${target//-/ })); \
2021-07-18T14:09:54.2710237Z GOOS=${components[-2]}; \
2021-07-18T14:09:54.2710929Z GOARCH=${components[-1]}; \
2021-07-18T14:09:54.2711392Z export GOARCH GOOS; \
2021-07-18T14:09:54.2711916Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:09:54.2713009Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-18T14:09:54.2714900Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-18T14:09:54.2716592Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:09:54.3551723Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:09:54.3570530Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-18T14:09:54.3600588Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-18T14:09:54.3632970Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:11:57.5837960Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-18T14:11:57.5838986Z Must remake target 'bin/subctl'.
2021-07-18T14:11:57.5839790Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-18T14:11:57.5866622Z Successfully remade target file 'bin/subctl'.
2021-07-18T14:11:57.5867626Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-18T14:11:57.5868582Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-18T14:11:57.5869330Z Must remake target 'deploy'.
2021-07-18T14:11:57.5881653Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:11:57.6934043Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-18T14:11:57.6961789Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:11:57.6990651Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:11:57.7004642Z [submariner-operator]$ script_name=utils
2021-07-18T14:11:57.7017834Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:11:57.7039217Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:11:57.7056651Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:11:57.7071509Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:11:57.7084466Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:11:57.7104164Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:11:57.7123778Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:11:57.7134877Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:11:57.7149126Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:11:57.7169713Z [submariner-operator]$ broker=cluster1
2021-07-18T14:11:57.7180612Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:11:57.7195096Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:11:57.7209655Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:11:57.7223492Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:11:57.7238536Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:11:57.7252939Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:11:57.7266513Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:11:57.7280567Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:11:57.7293963Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:11:57.7309200Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:11:57.7323844Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:11:57.7338976Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:11:57.7352991Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:11:57.7364864Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:11:57.7377777Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:11:57.7400127Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:11:57.7415388Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:11:57.7445347Z [submariner-operator]$ declare_cidrs
2021-07-18T14:11:57.7457063Z [submariner-operator]$ declare_cidrs
2021-07-18T14:11:57.7469207Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:11:57.7482721Z [submariner-operator]$ i=1
2021-07-18T14:11:57.7496769Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:11:57.7513475Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:11:57.7532264Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:11:57.7549397Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:11:57.7563218Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:11:57.7576917Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:11:57.7590731Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:11:57.7605604Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:11:57.7620272Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:11:57.7636117Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:11:57.7648836Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:11:57.7662805Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:11:57.7677625Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:11:57.7696104Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-18T14:11:57.7711946Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:11:57.7731156Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:11:57.7777837Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-18T14:11:58.2045723Z Installing subctl version latest
2021-07-18T14:11:58.2046286Z OS detected: linux
2021-07-18T14:11:58.2046738Z Architecture detected: amd64
2021-07-18T14:11:58.2048344Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-18T14:11:58.2049078Z
2021-07-18T14:11:58.2049620Z Downloading...
2021-07-18T14:11:59.5093429Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-18T14:11:59.5458794Z This provides subctl version: v0.9.1
2021-07-18T14:11:59.5515430Z
2021-07-18T14:11:59.5517458Z please update your path (and consider adding it to ~/.profile):
2021-07-18T14:11:59.5518179Z export PATH=$PATH:/go/bin
2021-07-18T14:11:59.5518535Z
2021-07-18T14:11:59.5723598Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:11:59.5736330Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:11:59.5744017Z Will deploy submariner using operator
2021-07-18T14:11:59.5757742Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:11:59.5772403Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:11:59.5785147Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-18T14:11:59.5798609Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-18T14:11:59.5825473Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:11:59.5836976Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:11:59.5849429Z 
2021-07-18T14:11:59.5862516Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-18T14:11:59.7743309Z subctl version: v0.9.1
2021-07-18T14:11:59.7772155Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:11:59.7784594Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:11:59.7797684Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-18T14:11:59.7816916Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:11:59.7846365Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:11:59.7859444Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:11:59.7872327Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:11:59.7886464Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:11:59.7921447Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-18T14:11:59.7936305Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-18T14:11:59.7956933Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:11:59.7973679Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:11:59.7993430Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:11:59.7997466Z [submariner-operator]$ [cluster1] pids[cluster1]=6319
2021-07-18T14:11:59.8011912Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:11:59.8015685Z [submariner-operator]$ [cluster2] pids[cluster2]=6322
2021-07-18T14:11:59.8052982Z [submariner-operator]$ [cluster2] wait 6322
2021-07-18T14:11:59.8056904Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:11:59.8068122Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:11:59.8078390Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:11:59.8098181Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:12:00.2062371Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:12:00.2063586Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:12:00.2064562Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:12:00.2065977Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2067555Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2075966Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2077347Z [cluster1] node/cluster1-worker labeled
2021-07-18T14:12:00.2488168Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:12:00.2489420Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:12:00.2490542Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:12:00.2491888Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2493650Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2495396Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:12:00.2496772Z [cluster2] node/cluster2-worker labeled
2021-07-18T14:12:00.2515370Z [submariner-operator]$ [cluster2] wait 6319
2021-07-18T14:12:00.2533459Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:12:00.2550875Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:12:00.2567044Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:12:00.2580336Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:12:00.2586274Z Installing broker...
2021-07-18T14:12:00.2598459Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:12:00.2620016Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-18T14:12:00.2634264Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:12:00.3280303Z • Setting up broker RBAC ...
2021-07-18T14:12:00.4411353Z ✓ Setting up broker RBAC
2021-07-18T14:12:00.4412245Z • Deploying the Submariner operator ...
2021-07-18T14:12:10.9513710Z ✓ Deploying the Submariner operator
2021-07-18T14:12:10.9514571Z ✓ Created operator CRDs
2021-07-18T14:12:10.9515424Z ✓ Created operator namespace: submariner-operator
2021-07-18T14:12:10.9516447Z ✓ Created operator service account and role
2021-07-18T14:12:10.9517309Z ✓ Created lighthouse service account and role
2021-07-18T14:12:10.9518156Z ✓ Created Lighthouse service accounts and roles
2021-07-18T14:12:10.9519123Z ✓ Deployed the operator successfully
2021-07-18T14:12:10.9519778Z • Deploying the broker ...
2021-07-18T14:12:11.0076118Z ✓ Deploying the broker
2021-07-18T14:12:11.0076888Z ✓ The broker has been deployed
2021-07-18T14:12:11.0077705Z • Creating broker-info.subm file ...
2021-07-18T14:12:11.0141725Z ✓ Creating broker-info.subm file
2021-07-18T14:12:11.0142867Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-18T14:12:11.0188195Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:12:11.0202875Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:12:11.0225807Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:12:11.0239929Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:12:11.0252740Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:12:11.0296724Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-18T14:12:11.0309124Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-18T14:12:11.0322609Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:12:11.0341212Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:12:11.0365451Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:12:11.0369737Z [submariner-operator]$ [cluster1] pids[cluster1]=6401
2021-07-18T14:12:11.0391153Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:12:11.0400519Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:12:11.0413581Z [submariner-operator]$ [cluster2] pids[cluster2]=6404
2021-07-18T14:12:11.0417484Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:12:11.0445232Z [submariner-operator]$ [cluster2] wait 6404
2021-07-18T14:12:11.0453785Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:12:11.0473737Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:12:22.1250198Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:12:22.1251541Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-18T14:12:22.1254104Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-18T14:12:22.1257009Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:12:22.1259945Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:12:22.1261295Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-18T14:12:22.1264023Z [cluster2] - cluster2-worker
2021-07-18T14:12:22.1264868Z [cluster2] • Discovering network details ...
2021-07-18T14:12:22.1265502Z [cluster2] Discovered network details:
2021-07-18T14:12:22.1266292Z [cluster2] Network plugin: weave-net
2021-07-18T14:12:22.1266854Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-18T14:12:22.1267472Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-18T14:12:22.1268227Z [cluster2] ✓ Discovering network details
2021-07-18T14:12:22.1269046Z [cluster2] • Discovering multi cluster details ...
2021-07-18T14:12:22.1270149Z [cluster2] • Validating Globalnet configurations ...
2021-07-18T14:12:22.1271360Z [cluster2] ✓ Validating Globalnet configurations
2021-07-18T14:12:22.1272215Z [cluster2] ✓ Discovering multi cluster details
2021-07-18T14:12:22.1273046Z [cluster2] • Deploying the Submariner operator ...
2021-07-18T14:12:22.1273951Z [cluster2] ✓ Deploying the Submariner operator
2021-07-18T14:12:22.1274708Z [cluster2] ✓ Created operator CRDs
2021-07-18T14:12:22.1275616Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-18T14:12:22.1276576Z [cluster2] ✓ Created operator service account and role
2021-07-18T14:12:22.1277476Z [cluster2] ✓ Created lighthouse service account and role
2021-07-18T14:12:22.1278404Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:12:22.1279308Z [cluster2] ✓ Deployed the operator successfully
2021-07-18T14:12:22.1280098Z [cluster2] • Creating SA for cluster ...
2021-07-18T14:12:22.1280796Z [cluster2] ✓ Creating SA for cluster
2021-07-18T14:12:22.1281514Z [cluster2] • Deploying Submariner ...
2021-07-18T14:12:22.1282227Z [cluster2] ✓ Deploying Submariner
2021-07-18T14:12:22.1282961Z [cluster2] ✓ Submariner is up and running
2021-07-18T14:12:22.1283855Z [submariner-operator]$ [cluster2] wait 6401
2021-07-18T14:12:22.2932743Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:12:22.2934835Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:12:22.2935817Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-18T14:12:22.2938906Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:12:22.2942078Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:12:22.2943138Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-18T14:12:22.2943913Z [cluster1] - cluster1-worker
2021-07-18T14:12:22.2944900Z [cluster1] • Discovering network details ...
2021-07-18T14:12:22.2945538Z [cluster1] Discovered network details:
2021-07-18T14:12:22.2946292Z [cluster1] Network plugin: weave-net
2021-07-18T14:12:22.2946868Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-18T14:12:22.2947549Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-18T14:12:22.2948437Z [cluster1] ✓ Discovering network details
2021-07-18T14:12:22.2949255Z [cluster1] • Discovering multi cluster details ...
2021-07-18T14:12:22.2950396Z [cluster1] • Validating Globalnet configurations ...
2021-07-18T14:12:22.2951324Z [cluster1] ✓ Validating Globalnet configurations
2021-07-18T14:12:22.2952262Z [cluster1] ✓ Discovering multi cluster details
2021-07-18T14:12:22.2953072Z [cluster1] • Deploying the Submariner operator ...
2021-07-18T14:12:22.2953877Z [cluster1] ✓ Deploying the Submariner operator
2021-07-18T14:12:22.2954739Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:12:22.2955934Z [cluster1] • Creating SA for cluster ...
2021-07-18T14:12:22.2956629Z [cluster1] ✓ Creating SA for cluster
2021-07-18T14:12:22.2957325Z [cluster1] • Deploying Submariner ...
2021-07-18T14:12:22.2958136Z [cluster1] ✓ Deploying Submariner
2021-07-18T14:12:22.2958871Z [cluster1] ✓ Submariner is up and running
2021-07-18T14:12:22.2993611Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:12:22.2994964Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:12:22.3005700Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-18T14:12:22.3039527Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:12:22.3089182Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:12:22.3113169Z [submariner-operator]$ [cluster2] wait 6442
2021-07-18T14:12:22.3160065Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:22.3203083Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:22.3213362Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:22.3227572Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:22.3246191Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:22.5350786Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:22.5363286Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:22.7832011Z • Showing Connections ...
2021-07-18T14:12:22.7985629Z ✗ Showing Connections
2021-07-18T14:12:22.7987186Z ✗ There are no gateways detected
2021-07-18T14:12:23.0065841Z • Showing Connections ...
2021-07-18T14:12:23.2816235Z ✗ Showing Connections
2021-07-18T14:12:23.2817048Z ✗ There are no gateways detected
2021-07-18T14:12:23.2865804Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:23.2880594Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:12:29.2919881Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:12:29.2968738Z [submariner-operator]$ [cluster2] wait 6470
2021-07-18T14:12:29.2981513Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:29.3010587Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:29.3021806Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:29.3035851Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:29.3100622Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:29.4724163Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:29.4740387Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:29.8909278Z • Showing Connections ...
2021-07-18T14:12:29.8979945Z ✗ Showing Connections
2021-07-18T14:12:29.8980674Z ✗ There are no gateways detected
2021-07-18T14:12:29.9049256Z • Showing Connections ...
2021-07-18T14:12:29.9111965Z ✗ Showing Connections
2021-07-18T14:12:29.9112579Z ✗ There are no gateways detected
2021-07-18T14:12:29.9139360Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:29.9150744Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:12:35.9175470Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:12:35.9213553Z [submariner-operator]$ [cluster2] wait 6498
2021-07-18T14:12:35.9224174Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:35.9239643Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:35.9261971Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:35.9298106Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:35.9325689Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:36.3824100Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:36.3844490Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:36.6155633Z • Showing Connections ...
2021-07-18T14:12:36.6502153Z ✗ Showing Connections
2021-07-18T14:12:36.6502930Z ✗ There are no gateways detected
2021-07-18T14:12:36.6622551Z • Showing Connections ...
2021-07-18T14:12:36.6856293Z ✗ Showing Connections
2021-07-18T14:12:36.6860670Z ✗ There are no gateways detected
2021-07-18T14:12:36.6888101Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:36.6965191Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:12:42.6992745Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:12:42.7034689Z [submariner-operator]$ [cluster2] wait 6524
2021-07-18T14:12:42.7049891Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:42.7137008Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:42.7186220Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:42.7207194Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:42.7264060Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:43.9890955Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:43.9911965Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:44.3741651Z • Showing Connections ...
2021-07-18T14:12:44.3997703Z ✗ Showing Connections
2021-07-18T14:12:44.4004388Z ✗ There are no gateways detected
2021-07-18T14:12:44.7099104Z • Showing Connections ...
2021-07-18T14:12:44.7249612Z ✗ Showing Connections
2021-07-18T14:12:44.7255595Z ✗ There are no gateways detected
2021-07-18T14:12:44.7285145Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:44.7295028Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:12:50.7321440Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:12:50.7367395Z [submariner-operator]$ [cluster2] wait 6550
2021-07-18T14:12:50.7372270Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:50.7399333Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:50.7421257Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:50.7430502Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:50.7533367Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:51.8572573Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:51.8598117Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:52.2281583Z • Showing Connections ...
2021-07-18T14:12:52.3053822Z ✗ Showing Connections
2021-07-18T14:12:52.3054526Z ✗ No connections found
2021-07-18T14:12:52.4731298Z • Showing Connections ...
2021-07-18T14:12:52.5388565Z ✗ Showing Connections
2021-07-18T14:12:52.5389345Z ✗ There are no gateways detected
2021-07-18T14:12:52.5407680Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:52.5435298Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:12:58.5465713Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:12:58.5518248Z [submariner-operator]$ [cluster2] wait 6577
2021-07-18T14:12:58.5548727Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:58.5564180Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:12:58.5587410Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:12:58.5618037Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:58.5677709Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:12:58.7651593Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:12:58.7673548Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:12:58.8439564Z • Showing Connections ...
2021-07-18T14:12:58.8496365Z ✗ Showing Connections
2021-07-18T14:12:58.8501189Z ✗ No connections found
2021-07-18T14:12:58.8955046Z • Showing Connections ...
2021-07-18T14:12:58.9090703Z ✗ Showing Connections
2021-07-18T14:12:58.9098500Z ✗ There are no gateways detected
2021-07-18T14:12:58.9131928Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:12:58.9144483Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:04.9171819Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:04.9216026Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:04.9220378Z [submariner-operator]$ [cluster2] wait 6606
2021-07-18T14:13:04.9250334Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:04.9263628Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:04.9298415Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:04.9336865Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:05.0188346Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:05.0213192Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:05.1364178Z • Showing Connections ...
2021-07-18T14:13:05.1486289Z ✗ Showing Connections
2021-07-18T14:13:05.1487302Z ✗ There are no gateways detected
2021-07-18T14:13:05.1593107Z • Showing Connections ...
2021-07-18T14:13:05.1624837Z ✗ Showing Connections
2021-07-18T14:13:05.1625541Z ✗ No connections found
2021-07-18T14:13:05.1674262Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:05.1687753Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:11.1719257Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:11.1762897Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:11.1768752Z [submariner-operator]$ [cluster2] wait 6633
2021-07-18T14:13:11.1780422Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:11.1782690Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:11.1798318Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:11.1817966Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:11.2603835Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:11.2618001Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:11.3095058Z • Showing Connections ...
2021-07-18T14:13:11.3128609Z ✗ Showing Connections
2021-07-18T14:13:11.3129401Z ✗ No connections found
2021-07-18T14:13:11.3303026Z • Showing Connections ...
2021-07-18T14:13:11.3327356Z ✗ Showing Connections
2021-07-18T14:13:11.3328078Z ✗ No connections found
2021-07-18T14:13:11.3358720Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:11.3371491Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:17.3402480Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:17.3444145Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:17.3451833Z [submariner-operator]$ [cluster2] wait 6659
2021-07-18T14:13:17.3460555Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:17.3471090Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:17.3481870Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:17.3496966Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:17.4187116Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:17.4200400Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:17.4625097Z • Showing Connections ...
2021-07-18T14:13:17.4658041Z ✗ Showing Connections
2021-07-18T14:13:17.4658722Z ✗ No connections found
2021-07-18T14:13:17.4772716Z • Showing Connections ...
2021-07-18T14:13:17.4797756Z ✗ Showing Connections
2021-07-18T14:13:17.4798451Z ✗ No connections found
2021-07-18T14:13:17.4823736Z iter: 9. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:17.4835644Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:23.4861698Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:23.4898683Z [submariner-operator]$ [cluster2] wait 6685
2021-07-18T14:13:23.4902171Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:23.4922533Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:23.4935170Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:23.4954621Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:23.4981488Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:23.6189025Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:23.6283661Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:23.6960080Z • Showing Connections ...
2021-07-18T14:13:23.6993927Z ✓ Showing Connections
2021-07-18T14:13:23.7151320Z • Showing Connections ...
2021-07-18T14:13:23.7187965Z ✓ Showing Connections
2021-07-18T14:13:23.7213019Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 320.576µs
2021-07-18T14:13:23.7214257Z cluster1-worker cluster1 172.18.0.9 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 213.306µs
2021-07-18T14:13:23.7240127Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:23.7260928Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:23.7274209Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:13:23.7300547Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:13:23.7318643Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-18T14:13:23.7335229Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-18T14:13:23.7352805Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-18T14:13:23.7376107Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:13:23.7391913Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:13:23.7488644Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-18T14:13:24.1192200Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-18T14:13:24.1271621Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-18T14:13:25.9120510Z latest: Pulling from submariner/nettest
2021-07-18T14:13:25.9153023Z df20fa9351a1: Pulling fs layer
2021-07-18T14:13:25.9154449Z 741138c6c583: Pulling fs layer
2021-07-18T14:13:25.9154908Z d34ea735672c: Pulling fs layer
2021-07-18T14:13:25.9155495Z c91acd455ec9: Pulling fs layer
2021-07-18T14:13:25.9158154Z c91acd455ec9: Waiting
2021-07-18T14:13:26.3102637Z 741138c6c583: Verifying Checksum
2021-07-18T14:13:26.3103852Z 741138c6c583: Download complete
2021-07-18T14:13:26.3437026Z df20fa9351a1: Verifying Checksum
2021-07-18T14:13:26.3437875Z df20fa9351a1: Download complete
2021-07-18T14:13:26.3908402Z d34ea735672c: Verifying Checksum
2021-07-18T14:13:26.3909025Z d34ea735672c: Download complete
2021-07-18T14:13:26.6979123Z c91acd455ec9: Verifying Checksum
2021-07-18T14:13:26.6980613Z c91acd455ec9: Download complete
2021-07-18T14:13:26.7700780Z df20fa9351a1: Pull complete
2021-07-18T14:13:26.8807102Z 741138c6c583: Pull complete
2021-07-18T14:13:27.3415604Z d34ea735672c: Pull complete
2021-07-18T14:13:27.4368543Z c91acd455ec9: Pull complete
2021-07-18T14:13:27.4411338Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-18T14:13:27.4436498Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-18T14:13:27.4451149Z quay.io/submariner/nettest:latest
2021-07-18T14:13:27.4506248Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-18T14:13:27.7410256Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-18T14:13:28.0585964Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-18T14:13:28.3575113Z The push refers to repository [localhost:5000/nettest]
2021-07-18T14:13:28.4041010Z 7497bfb0ae54: Preparing
2021-07-18T14:13:28.4045103Z 17de069c349e: Preparing
2021-07-18T14:13:28.4045682Z b85398c91342: Preparing
2021-07-18T14:13:28.4048142Z 50644c29ef5a: Preparing
2021-07-18T14:13:29.1235306Z 7497bfb0ae54: Pushed
2021-07-18T14:13:29.1590977Z b85398c91342: Pushed
2021-07-18T14:13:29.1710793Z 50644c29ef5a: Pushed
2021-07-18T14:13:30.1170165Z 17de069c349e: Pushed
2021-07-18T14:13:30.1445491Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-18T14:13:30.1531776Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:30.1547145Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:30.1564541Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:13:30.1589655Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-18T14:13:30.1618215Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:30.1642083Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:30.1665139Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:30.6744521Z deployment.apps/netshoot created
2021-07-18T14:13:30.6805435Z Waiting for netshoot pods to be ready.
2021-07-18T14:13:30.6823979Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:30.6838952Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:30.6854734Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-18T14:13:31.0410695Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-18T14:13:32.2998225Z deployment "netshoot" successfully rolled out
2021-07-18T14:13:32.3053310Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.3066118Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.3080758Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.3095406Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-18T14:13:32.3111866Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:13:32.3133446Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-18T14:13:32.3155090Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.3173856Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.3188031Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:32.9514095Z deployment.apps/nginx-demo created
2021-07-18T14:13:33.0086395Z service/nginx-demo created
2021-07-18T14:13:33.1242074Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-18T14:13:33.1290522Z Waiting for nginx-demo pods to be ready.
2021-07-18T14:13:33.1302481Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:33.1314066Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:33.1327754Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:13:33.7014761Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:13:40.7093090Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:13:41.0295735Z deployment "nginx-demo" successfully rolled out
2021-07-18T14:13:41.0383179Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-18T14:13:41.0418776Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:13:41.0435794Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-18T14:13:41.0455209Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:13:41.0502712Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-18T14:13:41.3916063Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-18T14:13:41.3931235Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:13:41.3943175Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:13:41.3959149Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-18T14:13:41.3970471Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-18T14:13:41.3983423Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-18T14:13:41.4003698Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:13:41.4027579Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-18T14:13:41.4038783Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:13:41.4055670Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:13:41.6916557Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-vcjzc 100.1.24.246
2021-07-18T14:13:41.6930176Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-vcjzc 100.1.24.246
2021-07-18T14:13:41.6946637Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:13:41.6975064Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-vcjzc 100.1.24.246
2021-07-18T14:13:41.6976123Z [submariner-operator]$ [cluster2] wait 6840
2021-07-18T14:13:41.6990851Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:13:41.6995994Z Attempting connectivity between clusters - netshoot-57677568b8-vcjzc --> 100.1.24.246
2021-07-18T14:13:41.7004903Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:13:41.7015922Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:13:41.7033307Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:13:41.7071867Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-vcjzc -- curl --output /dev/null -m 30 --silent --head --fail 100.1.24.246
2021-07-18T14:13:41.7088450Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-vcjzc -- curl --output /dev/null -m 30 --silent --head --fail 100.1.24.246
2021-07-18T14:13:41.7103179Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-vcjzc -- curl --output /dev/null -m 30 --silent --head --fail 100.1.24.246
2021-07-18T14:13:42.1468594Z Connection test was successful!
2021-07-18T14:13:42.1484436Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:42.1514807Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:42.1530139Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:42.1546282Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:42.1560872Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:42.1580016Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:13:42.4336758Z deployment.apps "netshoot" deleted
2021-07-18T14:13:42.4442342Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.4453414Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.4466917Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.4479131Z [submariner-operator]$ [cluster1] remove_resource
2021-07-18T14:13:42.4491291Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.4502433Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.4524680Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:13:42.7307342Z deployment.apps "nginx-demo" deleted
2021-07-18T14:13:42.7839035Z service "nginx-demo" deleted
2021-07-18T14:13:42.8804589Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-18T14:13:42.9224742Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:13:42.9238026Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:13:42.9251742Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-18T14:13:42.9269582Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:13:42.9375192Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:42.9383677Z Successfully remade target file 'deploy'.
2021-07-18T14:13:42.9425999Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-18T14:13:42.9488592Z Successfully remade target file 'deploy-latest'.
2021-07-18T14:13:42.9489507Z File 'clusters' does not exist.
2021-07-18T14:13:42.9490391Z Must remake target 'clusters'.
2021-07-18T14:13:42.9491730Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:13:43.1528725Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-18T14:13:43.1569947Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:13:43.1575343Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:43.1591006Z [submariner-operator]$ script_name=utils
2021-07-18T14:13:43.1621011Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:13:43.1672624Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:13:43.1766800Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:43.1780309Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:13:43.1796791Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:13:43.1827807Z [submariner-operator]$ broker=cluster1
2021-07-18T14:13:43.1846836Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:13:43.1860719Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:13:43.1913940Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:13:43.1917190Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:13:43.1936828Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:13:43.1984579Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:13:43.2024560Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:13:43.2039720Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:13:43.2051440Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:13:43.2065447Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:13:43.2089172Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:13:43.2115870Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:13:43.2135224Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:43.2220597Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:13:43.2240847Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:13:43.2285346Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:13:43.2319219Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:13:43.2444127Z [submariner-operator]$ cat <<EOM
2021-07-18T14:13:43.2446715Z Cluster settings::
2021-07-18T14:13:43.2447807Z broker - ${broker@Q}
2021-07-18T14:13:43.2448507Z clusters - ${clusters[*]@Q}
2021-07-18T14:13:43.2449967Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-18T14:13:43.2450817Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-18T14:13:43.2451804Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-18T14:13:43.2452447Z EOM
2021-07-18T14:13:43.2468347Z [submariner-operator]$ typeset -p cluster_cni
2021-07-18T14:13:43.2488899Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:13:43.2623773Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-18T14:13:43.2645582Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:13:43.2766678Z [submariner-operator]$ typeset -p cluster_subm
2021-07-18T14:13:43.2784362Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:13:43.2867148Z Cluster settings::
2021-07-18T14:13:43.2867942Z broker - 'cluster1'
2021-07-18T14:13:43.2868558Z clusters - 'cluster1' 'cluster2'
2021-07-18T14:13:43.2869372Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-18T14:13:43.2872756Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-18T14:13:43.2874094Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-18T14:13:43.2902155Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:13:43.2935943Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:13:43.2972714Z [submariner-operator]$ run_local_registry
2021-07-18T14:13:43.2985991Z [submariner-operator]$ run_local_registry
2021-07-18T14:13:43.3000708Z [submariner-operator]$ registry_running
2021-07-18T14:13:43.3015420Z [submariner-operator]$ registry_running
2021-07-18T14:13:43.3027261Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-18T14:13:43.3077897Z [submariner-operator]$ grep kind-registry
2021-07-18T14:13:43.6027353Z 5cc48f9b372e registry:2 "/entrypoint.sh /etc…" 8 minutes ago Up 8 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-18T14:13:43.6037981Z [submariner-operator]$ return 0
2021-07-18T14:13:43.6041739Z Local registry kind-registry already running.
2021-07-18T14:13:43.6061310Z [submariner-operator]$ declare_cidrs
2021-07-18T14:13:43.6077628Z [submariner-operator]$ declare_cidrs
2021-07-18T14:13:43.6088369Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:13:43.6101475Z [submariner-operator]$ i=1
2021-07-18T14:13:43.6116551Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:13:43.6129714Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:13:43.6148309Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:13:43.6160940Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:13:43.6172834Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:13:43.6188392Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:13:43.6201435Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:13:43.6218458Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:13:43.6233696Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:13:43.6252218Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:13:43.6268201Z [submariner-operator]$ [cluster2] wait 7052
2021-07-18T14:13:43.6271617Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6283231Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6294874Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6308423Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6324219Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:13:43.6343532Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:13:43.6365626Z [submariner-operator]$ [cluster1] pids[cluster1]=7061
2021-07-18T14:13:43.6372279Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:13:43.6424580Z [submariner-operator]$ [cluster2] pids[cluster2]=7065
2021-07-18T14:13:43.6475050Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6500727Z [submariner-operator]$ [cluster2] wait 7065
2021-07-18T14:13:43.6512469Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:13:43.6540105Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-18T14:13:43.6705797Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:13:43.6745246Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:13:50.8708295Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:13:50.8710048Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:13:50.8711495Z [submariner-operator]$ [cluster2] wait 7083
2021-07-18T14:13:50.8712851Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:13:50.8713910Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:13:50.8715499Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8717589Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8719384Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-18T14:13:50.8720580Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-18T14:13:50.8721850Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-18T14:13:50.8722963Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-18T14:13:50.8724040Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-18T14:13:50.8725056Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:13:50.8726079Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:13:50.8728527Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-18T14:13:50.8730595Z [submariner-operator]$ [cluster2] head -n 1
2021-07-18T14:13:50.8732509Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.7:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8734882Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8737233Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8740244Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8742994Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8747302Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:13:50.8756563Z [submariner-operator]$ [cluster2] return
2021-07-18T14:13:50.8757519Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:50.8765875Z [submariner-operator]$ [cluster2] wait 7061
2021-07-18T14:13:51.2914323Z [submariner-operator]$ [cluster1] with_retries
2021-07-18T14:13:51.2915532Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:13:51.2916479Z [submariner-operator]$ [cluster1] wait 7080
2021-07-18T14:13:51.2917433Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:13:51.2918613Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:13:51.2920263Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2922307Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2923735Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-18T14:13:51.2924723Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-18T14:13:51.2925552Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-18T14:13:51.2926741Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-18T14:13:51.2927996Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-18T14:13:51.2929020Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:13:51.2929991Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:13:51.2934447Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-18T14:13:51.2936024Z [submariner-operator]$ [cluster1] head -n 1
2021-07-18T14:13:51.2937700Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2940069Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2942333Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2946468Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2949163Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2951868Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:13:51.2953731Z [submariner-operator]$ [cluster1] return
2021-07-18T14:13:51.2954624Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:13:51.2955989Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:13:51.2962167Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:13:51.2963251Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-18T14:13:51.2964092Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:13:51.2964625Z
2021-07-18T14:13:51.2965552Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:13:51.2966180Z
2021-07-18T14:13:51.2967084Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:13:51.2967806Z
2021-07-18T14:13:51.2972635Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:13:51.2973522Z EOM
2021-07-18T14:13:51.2974528Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:13:51.2978730Z
2021-07-18T14:13:51.2980036Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:13:51.2982348Z
2021-07-18T14:13:51.2983218Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:13:51.2983677Z
2021-07-18T14:13:51.2984359Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:13:51.2985257Z Successfully remade target file 'clusters'.
2021-07-18T14:13:51.2986202Z File 'preload-images' does not exist.
2021-07-18T14:13:51.2986959Z File 'images' does not exist.
2021-07-18T14:13:51.2987952Z File 'package/.image.submariner-operator' does not exist.
2021-07-18T14:13:51.3049023Z find: 'bin/submariner-operator': No such file or directory
2021-07-18T14:13:51.6227490Z File 'bin/submariner-operator' does not exist.
2021-07-18T14:13:51.6240239Z File 'generate-embeddedyamls' does not exist.
2021-07-18T14:13:51.6241132Z File 'generate' does not exist.
2021-07-18T14:13:51.6246066Z Must remake target 'generate'.
2021-07-18T14:13:51.6274142Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-18T14:13:55.7626290Z Successfully remade target file 'generate'.
2021-07-18T14:13:55.7735019Z Must remake target 'generate-embeddedyamls'.
2021-07-18T14:13:55.7736105Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-18T14:13:55.7737074Z Must remake target 'bin/submariner-operator'.
2021-07-18T14:13:55.7737779Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:13:55.7739280Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-18T14:13:55.7740557Z bin/submariner-operator main.go
2021-07-18T14:13:55.8220131Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:13:55.8235746Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-18T14:13:55.8246639Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-18T14:13:55.8261685Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-18T14:14:14.0693320Z [submariner-operator]$ upx bin/submariner-operator
2021-07-18T14:14:21.1931568Z Ultimate Packer for eXecutables
2021-07-18T14:14:21.1933689Z Copyright (C) 1996 - 2020
2021-07-18T14:14:21.1934502Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-18T14:14:21.1935046Z
2021-07-18T14:14:21.1935664Z File size Ratio Format Name
2021-07-18T14:14:21.1937103Z -------------------- ------ ----------- -----------
2021-07-18T14:14:21.1938168Z 34459648 -> 9933112 28.83% linux/amd64 submariner-operator
2021-07-18T14:14:21.1938746Z
2021-07-18T14:14:21.1939225Z Packed 1 file.
2021-07-18T14:14:21.1946566Z Successfully remade target file 'bin/submariner-operator'.
2021-07-18T14:14:21.1949126Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:14:21.1951888Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:14:21.1953683Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-18T14:14:21.1954990Z File 'FORCE_IMAGE' does not exist.
2021-07-18T14:14:21.1957108Z Must remake target 'FORCE_IMAGE'.
2021-07-18T14:14:21.1958574Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-18T14:14:21.1959579Z Must remake target 'package/.image.submariner-operator'.
2021-07-18T14:14:21.1961512Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-18T14:14:21.2463956Z flags:WARN flag short name (h) already defined
2021-07-18T14:14:22.0406952Z [submariner-operator]$ set -e
2021-07-18T14:14:22.0408658Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:22.0409797Z [submariner-operator]$ cache_flag=
2021-07-18T14:14:22.0411127Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:22.0412515Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:22.0414066Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:23.1712948Z devel: Pulling from submariner/submariner-operator
2021-07-18T14:14:23.1713917Z 9aabc6bb514c: Pulling fs layer
2021-07-18T14:14:23.6213841Z 9aabc6bb514c: Download complete
2021-07-18T14:14:23.8627695Z 9aabc6bb514c: Pull complete
2021-07-18T14:14:23.8670532Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-18T14:14:23.8689860Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:23.8711988Z quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:23.8752646Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-18T14:14:23.8769681Z [submariner-operator]$ cut -f2 -d 
2021-07-18T14:14:23.8774437Z [submariner-operator]$ grep -v scratch
2021-07-18T14:14:23.8804040Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-18T14:14:23.8821148Z 
2021-07-18T14:14:24.7846501Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-18T14:14:25.6445067Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-18T14:14:25.6531716Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-18T14:14:26.4542750Z buildx_builder
2021-07-18T14:14:26.4636597Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-18T14:14:27.2708229Z #1 [internal] booting buildkit
2021-07-18T14:14:27.2709425Z #1 sha256:8f1b9a5796557b3623b148c1142a7c6fc9455e2b8a4bbfbb99b0ce87466edff5
2021-07-18T14:14:27.4209462Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-18T14:14:33.1347051Z #1 pulling image moby/buildkit:buildx-stable-1 5.8s done
2021-07-18T14:14:33.1347929Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-18T14:14:33.7300800Z #1 creating container buildx_buildkit_buildx_builder0 0.6s done
2021-07-18T14:14:33.7301531Z #1 DONE 6.3s
2021-07-18T14:14:33.9978770Z
2021-07-18T14:14:33.9982399Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-18T14:14:33.9988297Z #2 sha256:65f1225136909e47191558cab61795825d3b9043a9132cee95cb3df8369cc70f
2021-07-18T14:14:33.9992796Z #2 transferring dockerfile: 230B done
2021-07-18T14:14:33.9993466Z #2 DONE 0.0s
2021-07-18T14:14:33.9993821Z
2021-07-18T14:14:33.9994223Z #3 [internal] load .dockerignore
2021-07-18T14:14:33.9995095Z #3 sha256:b48fa2cba7d8a1159b7269d50497a30632505ed0142b05950f548ac510b9f328
2021-07-18T14:14:33.9996096Z #3 transferring context: 2B done
2021-07-18T14:14:33.9996633Z #3 DONE 0.0s
2021-07-18T14:14:33.9997049Z
2021-07-18T14:14:33.9997463Z #4 [internal] load build context
2021-07-18T14:14:33.9998393Z #4 sha256:ae76d57a9ad4e204833474add99728606be9e7bd7d07bb3d3f061c7b5c04a258
2021-07-18T14:14:33.9999248Z #4 DONE 0.0s
2021-07-18T14:14:33.9999466Z
2021-07-18T14:14:34.0000902Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:34.0002235Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-18T14:14:35.1916846Z #6 DONE 1.2s
2021-07-18T14:14:35.1917151Z
2021-07-18T14:14:35.1937504Z #4 [internal] load build context
2021-07-18T14:14:35.1938467Z #4 sha256:ae76d57a9ad4e204833474add99728606be9e7bd7d07bb3d3f061c7b5c04a258
2021-07-18T14:14:35.6048325Z #4 transferring context: 9.94MB 0.4s done
2021-07-18T14:14:35.6048926Z #4 DONE 0.4s
2021-07-18T14:14:35.6049161Z
2021-07-18T14:14:35.6050554Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:14:35.6051714Z #5 sha256:574e8e9a11f5e41396b75f466d1040efc90a18f1aa0b8e8e919a0a83326ac8be
2021-07-18T14:14:35.6052473Z #5 CACHED
2021-07-18T14:14:35.6052687Z
2021-07-18T14:14:35.6053174Z #7 exporting to oci image format
2021-07-18T14:14:35.6054186Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:14:35.6055083Z #7 exporting layers done
2021-07-18T14:14:35.6056399Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-18T14:14:35.6058414Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-18T14:14:35.7552484Z #7 ...
2021-07-18T14:14:35.7552811Z
2021-07-18T14:14:35.7554054Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:14:35.7555217Z #5 sha256:574e8e9a11f5e41396b75f466d1040efc90a18f1aa0b8e8e919a0a83326ac8be
2021-07-18T14:14:35.7556690Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 0B / 9.62MB 0.2s
2021-07-18T14:14:35.7561234Z #5 CACHED
2021-07-18T14:14:35.9054147Z
2021-07-18T14:14:35.9056146Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:14:35.9057302Z #5 sha256:574e8e9a11f5e41396b75f466d1040efc90a18f1aa0b8e8e919a0a83326ac8be
2021-07-18T14:14:35.9058545Z #5 CACHED
2021-07-18T14:14:35.9058745Z
2021-07-18T14:14:35.9059113Z #7 exporting to oci image format
2021-07-18T14:14:35.9060271Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:14:36.0554993Z #7 ...
2021-07-18T14:14:36.0555341Z
2021-07-18T14:14:36.0556673Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:14:36.0557873Z #5 sha256:574e8e9a11f5e41396b75f466d1040efc90a18f1aa0b8e8e919a0a83326ac8be
2021-07-18T14:14:36.0559380Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 5.24MB / 9.62MB 0.5s
2021-07-18T14:14:36.0560352Z #5 CACHED
2021-07-18T14:14:36.2110202Z
2021-07-18T14:14:36.2111924Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:14:36.2113109Z #5 sha256:574e8e9a11f5e41396b75f466d1040efc90a18f1aa0b8e8e919a0a83326ac8be
2021-07-18T14:14:36.2114753Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.6s done
2021-07-18T14:14:36.2115742Z #5 CACHED
2021-07-18T14:14:36.2115987Z
2021-07-18T14:14:36.2116389Z #7 exporting to oci image format
2021-07-18T14:14:36.2117392Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:14:36.2118310Z #7 sending tarball
2021-07-18T14:14:36.4347865Z #7 sending tarball 0.4s done
2021-07-18T14:14:36.4348342Z #7 DONE 0.9s
2021-07-18T14:14:36.4348583Z
2021-07-18T14:14:36.4349206Z #9 exporting cache
2021-07-18T14:14:36.4350205Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-18T14:14:36.4351199Z #9 preparing build cache for export done
2021-07-18T14:14:36.4351665Z #9 DONE 0.0s
2021-07-18T14:14:36.4351904Z
2021-07-18T14:14:36.4352280Z #8 importing to docker
2021-07-18T14:14:36.4353378Z #8 sha256:d5b6b9961247ca1952d0970abf82ee012ccb13338f6de125757d2d8cc7360dd3
2021-07-18T14:14:36.4354486Z #8 DONE 0.0s
2021-07-18T14:14:36.4505072Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-18T14:14:36.7185604Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-18T14:14:36.7186693Z File 'build' does not exist.
2021-07-18T14:14:36.7187541Z File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-18T14:14:36.7408192Z Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:14:36.7411127Z mkdir -p bin
2021-07-18T14:14:36.7446461Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-18T14:14:36.7447104Z target=${target%.exe}; \
2021-07-18T14:14:36.7447863Z components=($(echo ${target//-/ })); \
2021-07-18T14:14:36.7448442Z GOOS=${components[-2]}; \
2021-07-18T14:14:36.7448979Z GOARCH=${components[-1]}; \
2021-07-18T14:14:36.7449379Z export GOARCH GOOS; \
2021-07-18T14:14:36.7449857Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:14:36.7451117Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-18T14:14:36.7453183Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-18T14:14:36.7455032Z --noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:14:36.7993196Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:14:36.8011131Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-18T14:14:36.8023080Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-18T14:14:36.8036376Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:14:40.5228522Z Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:14:40.5230753Z Prerequisite 'bin/subctl-devel-0105e4d-linux-amd64' is newer than target 'bin/subctl'.
2021-07-18T14:14:40.5231907Z Must remake target 'bin/subctl'.
2021-07-18T14:14:40.5232821Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-18T14:14:40.5271776Z Successfully remade target file 'bin/subctl'.
2021-07-18T14:14:40.5272786Z Must remake target 'build'.
2021-07-18T14:14:40.5273510Z Successfully remade target file 'build'.
2021-07-18T14:14:40.5274417Z Must remake target 'images'.
2021-07-18T14:14:40.5278994Z Successfully remade target file 'images'.
2021-07-18T14:14:40.5279948Z Must remake target 'preload-images'.
2021-07-18T14:14:40.5280581Z set -e;\
2021-07-18T14:14:40.5281049Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-18T14:14:40.5281664Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-18T14:14:40.5283088Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-18T14:14:40.5284275Z import_image quay.io/submariner/${image};\
2021-07-18T14:14:40.5284895Z done
2021-07-18T14:14:40.5324874Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:14:40.5346486Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:14:40.5362577Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-18T14:14:40.8207319Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-18T14:14:41.1308610Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-18T14:14:41.1357253Z f9269f9cee12: Preparing
2021-07-18T14:14:41.7130889Z f9269f9cee12: Pushed
2021-07-18T14:14:41.7313614Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-18T14:14:41.7359492Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:14:41.7370931Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:14:41.7385752Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:14:41.9949319Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-18T14:14:42.0006657Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-18T14:14:43.5766805Z devel: Pulling from submariner/submariner-gateway
2021-07-18T14:14:43.5767459Z 8c741e919b67: Pulling fs layer
2021-07-18T14:14:43.5767921Z 13495efbbac4: Pulling fs layer
2021-07-18T14:14:43.5768373Z 6df6df193f2d: Pulling fs layer
2021-07-18T14:14:43.5769153Z 3afbe9ee7387: Pulling fs layer
2021-07-18T14:14:43.5769630Z 3afbe9ee7387: Waiting
2021-07-18T14:14:43.9556276Z 13495efbbac4: Verifying Checksum
2021-07-18T14:14:43.9558822Z 13495efbbac4: Download complete
2021-07-18T14:14:44.1620982Z 6df6df193f2d: Verifying Checksum
2021-07-18T14:14:44.1621853Z 6df6df193f2d: Download complete
2021-07-18T14:14:44.4165782Z 3afbe9ee7387: Verifying Checksum
2021-07-18T14:14:44.4166656Z 3afbe9ee7387: Download complete
2021-07-18T14:14:45.0454234Z 8c741e919b67: Verifying Checksum
2021-07-18T14:14:45.0455276Z 8c741e919b67: Download complete
2021-07-18T14:14:48.1018567Z 8c741e919b67: Pull complete
2021-07-18T14:14:49.3179169Z 13495efbbac4: Pull complete
2021-07-18T14:14:50.7339655Z 6df6df193f2d: Pull complete
2021-07-18T14:14:50.9696923Z 3afbe9ee7387: Pull complete
2021-07-18T14:14:50.9753944Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-18T14:14:50.9837104Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-18T14:14:50.9877191Z quay.io/submariner/submariner-gateway:devel
2021-07-18T14:14:50.9881978Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-18T14:14:51.2769044Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:14:51.5807913Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-18T14:14:51.8401864Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-18T14:14:51.8455868Z 71972a942ed4: Preparing
2021-07-18T14:14:51.8456373Z 3c7f2d60eacb: Preparing
2021-07-18T14:14:51.8456962Z 00c5f6897675: Preparing
2021-07-18T14:14:51.8457422Z b3b62c837788: Preparing
2021-07-18T14:14:52.8115060Z 00c5f6897675: Pushed
2021-07-18T14:14:53.8503159Z 71972a942ed4: Pushed
2021-07-18T14:14:56.9966842Z 3c7f2d60eacb: Pushed
2021-07-18T14:15:05.2000461Z b3b62c837788: Pushed
2021-07-18T14:15:05.2187547Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-18T14:15:05.2241576Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:15:05.2255294Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:15:05.2272899Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:15:05.5042572Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:15:05.5104072Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:15:07.1135944Z devel: Pulling from submariner/submariner-route-agent
2021-07-18T14:15:07.1136776Z 8c741e919b67: Already exists
2021-07-18T14:15:07.1152413Z 13495efbbac4: Already exists
2021-07-18T14:15:07.1172949Z 70cc6422093d: Pulling fs layer
2021-07-18T14:15:07.1173605Z 7ba74d821748: Pulling fs layer
2021-07-18T14:15:07.1182863Z 62b0802bcf90: Pulling fs layer
2021-07-18T14:15:07.1183402Z 3e9c83283ee4: Pulling fs layer
2021-07-18T14:15:07.1183874Z 3e9c83283ee4: Waiting
2021-07-18T14:15:07.4711652Z 62b0802bcf90: Download complete
2021-07-18T14:15:07.5813741Z 7ba74d821748: Verifying Checksum
2021-07-18T14:15:07.5814379Z 7ba74d821748: Download complete
2021-07-18T14:15:07.7791704Z 70cc6422093d: Verifying Checksum
2021-07-18T14:15:07.7792596Z 70cc6422093d: Download complete
2021-07-18T14:15:07.8264524Z 3e9c83283ee4: Verifying Checksum
2021-07-18T14:15:07.8265099Z 3e9c83283ee4: Download complete
2021-07-18T14:15:09.4024412Z 70cc6422093d: Pull complete
2021-07-18T14:15:09.6179710Z 7ba74d821748: Pull complete
2021-07-18T14:15:09.7147550Z 62b0802bcf90: Pull complete
2021-07-18T14:15:09.8099194Z 3e9c83283ee4: Pull complete
2021-07-18T14:15:09.8146471Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-18T14:15:09.8169812Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:15:09.8217451Z quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:15:09.8233543Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:15:10.1253661Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:15:10.3960287Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-18T14:15:10.6722711Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-18T14:15:10.6776686Z 1d810a4c0610: Preparing
2021-07-18T14:15:10.6777605Z 7a86b74623fc: Preparing
2021-07-18T14:15:10.6778312Z 26de773c4486: Preparing
2021-07-18T14:15:10.6779018Z 6931e591f8e2: Preparing
2021-07-18T14:15:10.6779806Z 00c5f6897675: Preparing
2021-07-18T14:15:10.6780562Z b3b62c837788: Preparing
2021-07-18T14:15:10.6781223Z b3b62c837788: Waiting
2021-07-18T14:15:10.7083402Z 00c5f6897675: Mounted from submariner-gateway
2021-07-18T14:15:10.8439449Z b3b62c837788: Mounted from submariner-gateway
2021-07-18T14:15:11.3540194Z 7a86b74623fc: Pushed
2021-07-18T14:15:11.5148662Z 1d810a4c0610: Pushed
2021-07-18T14:15:11.5283186Z 26de773c4486: Pushed
2021-07-18T14:15:15.7043356Z 6931e591f8e2: Pushed
2021-07-18T14:15:15.7610802Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-18T14:15:15.7662791Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:15:15.7677998Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:15:15.7702896Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:15:16.5679601Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:15:16.5682042Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:15:17.6717587Z devel: Pulling from submariner/lighthouse-agent
2021-07-18T14:15:17.6719601Z ecd69139dc76: Pulling fs layer
2021-07-18T14:15:17.6720428Z 8261c1767de3: Pulling fs layer
2021-07-18T14:15:18.0675095Z ecd69139dc76: Verifying Checksum
2021-07-18T14:15:18.0675866Z ecd69139dc76: Download complete
2021-07-18T14:15:18.1441743Z 8261c1767de3: Verifying Checksum
2021-07-18T14:15:18.1442378Z 8261c1767de3: Download complete
2021-07-18T14:15:18.1747264Z ecd69139dc76: Pull complete
2021-07-18T14:15:18.3925764Z 8261c1767de3: Pull complete
2021-07-18T14:15:18.4021724Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-18T14:15:18.4042678Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:15:18.4072147Z quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:15:18.4081681Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:15:18.6760749Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:15:18.9504237Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-18T14:15:19.2211791Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-18T14:15:19.2265705Z 83c79e393e11: Preparing
2021-07-18T14:15:19.2266187Z 0026d2f62bbf: Preparing
2021-07-18T14:15:19.2598838Z 0026d2f62bbf: Pushed
2021-07-18T14:15:19.7498838Z 83c79e393e11: Pushed
2021-07-18T14:15:19.7697910Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-18T14:15:19.7744967Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:15:19.7757836Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:15:19.7766540Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:15:20.0579865Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:15:20.0613368Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:15:21.6882452Z devel: Pulling from submariner/lighthouse-coredns
2021-07-18T14:15:21.6888347Z 088e56360f76: Pulling fs layer
2021-07-18T14:15:21.6892683Z 18aed70882d2: Pulling fs layer
2021-07-18T14:15:22.0599602Z 088e56360f76: Verifying Checksum
2021-07-18T14:15:22.0606267Z 088e56360f76: Download complete
2021-07-18T14:15:22.1672391Z 18aed70882d2: Verifying Checksum
2021-07-18T14:15:22.1675867Z 18aed70882d2: Download complete
2021-07-18T14:15:22.2205465Z 088e56360f76: Pull complete
2021-07-18T14:15:22.5922583Z 18aed70882d2: Pull complete
2021-07-18T14:15:22.5977417Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-18T14:15:22.5998306Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:15:22.6071261Z quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:15:22.6267068Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:15:22.8859204Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:15:23.1590800Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-18T14:15:23.4154037Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-18T14:15:23.4190689Z 7fca351e51be: Preparing
2021-07-18T14:15:23.4377893Z 4fa0ece06e25: Preparing
2021-07-18T14:15:23.4949935Z 4fa0ece06e25: Pushed
2021-07-18T14:15:24.1481202Z 7fca351e51be: Pushed
2021-07-18T14:15:24.1795472Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-18T14:15:24.1829336Z Successfully remade target file 'preload-images'.
2021-07-18T14:15:24.1834904Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-18T14:15:24.1836128Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-18T14:15:24.1837186Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-18T14:15:24.1837956Z Must remake target 'deploy'.
2021-07-18T14:15:24.1846657Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:15:24.2990179Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-18T14:15:24.3015183Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:15:24.3028823Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:15:24.3042189Z [submariner-operator]$ script_name=utils
2021-07-18T14:15:24.3054401Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:15:24.3075531Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:15:24.3087398Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:15:24.3100550Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:15:24.3115338Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:15:24.3136888Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:15:24.3152224Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:15:24.3167150Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:15:24.3181399Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:15:24.3206786Z [submariner-operator]$ broker=cluster1
2021-07-18T14:15:24.3222820Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:15:24.3247879Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:15:24.3258673Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:15:24.3273618Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:15:24.3287650Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:15:24.3300798Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:15:24.3314857Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:15:24.3327446Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:15:24.3340622Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:15:24.3352627Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:15:24.3364577Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:15:24.3378530Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:15:24.3395072Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:15:24.3408348Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:15:24.3421903Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:15:24.3454784Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:15:24.3466305Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:15:24.3496742Z [submariner-operator]$ declare_cidrs
2021-07-18T14:15:24.3509207Z [submariner-operator]$ declare_cidrs
2021-07-18T14:15:24.3521943Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:15:24.3535948Z [submariner-operator]$ i=1
2021-07-18T14:15:24.3550931Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:15:24.3564887Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:15:24.3582573Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-18T14:15:24.3597026Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-18T14:15:24.3611926Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:15:24.3626276Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:15:24.3640529Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:15:24.3656852Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-18T14:15:24.3680882Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-18T14:15:24.3698400Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:15:24.3724493Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:15:24.3738511Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:15:24.3753578Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:15:24.3772676Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-18T14:15:24.3786798Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:15:24.3805481Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:15:24.3836992Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-18T14:15:24.5110893Z Installing subctl version devel
2021-07-18T14:15:24.5111441Z OS detected: linux
2021-07-18T14:15:24.5112272Z Architecture detected: amd64
2021-07-18T14:15:24.5119712Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-18T14:15:24.5120821Z
2021-07-18T14:15:24.5126262Z Downloading...
2021-07-18T14:15:25.8862684Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-18T14:15:25.9316052Z This provides subctl version: devel
2021-07-18T14:15:25.9337798Z
2021-07-18T14:15:25.9338429Z please update your path (and consider adding it to ~/.profile):
2021-07-18T14:15:25.9339027Z export PATH=$PATH:/go/bin
2021-07-18T14:15:25.9339418Z
2021-07-18T14:15:25.9455576Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:15:25.9470230Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:15:25.9478033Z Will deploy submariner using operator
2021-07-18T14:15:25.9492563Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:15:25.9513200Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:15:25.9528983Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-18T14:15:25.9545448Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-18T14:15:25.9577157Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:15:25.9617308Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:15:25.9634113Z 
2021-07-18T14:15:25.9647008Z [submariner-operator]$ [cluster2] subctl version
2021-07-18T14:15:25.9933240Z subctl version: devel-0105e4d
2021-07-18T14:15:25.9963146Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:15:25.9975543Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:15:25.9997019Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-18T14:15:26.0016979Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:15:26.0120827Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:15:26.0133233Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:15:26.0147014Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:15:26.0160059Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:15:26.0193483Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-18T14:15:26.0209761Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-18T14:15:26.0224842Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:15:26.0242763Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:15:26.0261770Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:15:26.0262737Z [submariner-operator]$ [cluster1] pids[cluster1]=8702
2021-07-18T14:15:26.0279086Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:15:26.0288094Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:15:26.0303941Z [submariner-operator]$ [cluster2] pids[cluster2]=8705
2021-07-18T14:15:26.0321405Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:15:26.0330530Z [submariner-operator]$ [cluster2] wait 8705
2021-07-18T14:15:26.0341062Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:15:26.0360223Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:15:26.5219570Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:15:26.5220897Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:15:26.5221925Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:15:26.5223307Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.5224890Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.5226561Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.5228083Z [cluster1] node/cluster1-worker not labeled
2021-07-18T14:15:26.6197687Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:15:26.6199141Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:15:26.6200261Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:15:26.6201715Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.6203306Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.6205124Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:15:26.6206361Z [cluster2] node/cluster2-worker not labeled
2021-07-18T14:15:26.6216459Z [submariner-operator]$ [cluster2] wait 8702
2021-07-18T14:15:26.6233980Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:15:26.6250630Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:15:26.6270699Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:15:26.6294626Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:15:26.6301799Z Installing broker...
2021-07-18T14:15:26.6313866Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:15:26.6328659Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:15:26.6346834Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-18T14:15:26.6363156Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-18T14:15:26.6875865Z • Setting up broker RBAC ...
2021-07-18T14:15:26.7405321Z ✓ Setting up broker RBAC
2021-07-18T14:15:26.7406172Z • Deploying the Submariner operator ...
2021-07-18T14:15:33.1334901Z ✓ Deploying the Submariner operator
2021-07-18T14:15:33.1336397Z ✓ Created operator service account and role
2021-07-18T14:15:33.1337652Z ✓ Created Lighthouse service accounts and roles
2021-07-18T14:15:33.1338756Z • Deploying the broker ...
2021-07-18T14:15:34.2286414Z ✓ Deploying the broker
2021-07-18T14:15:34.2287797Z ✓ The broker has been deployed
2021-07-18T14:15:34.2288527Z • Creating broker-info.subm file ...
2021-07-18T14:15:34.4307466Z ✓ Creating broker-info.subm file
2021-07-18T14:15:34.4308614Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-18T14_15_34Z
2021-07-18T14:15:34.4321063Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-18T14:15:34.4372491Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:15:34.4382973Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:15:34.4396079Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:15:34.4411913Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:15:34.4424135Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:15:34.4469312Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-18T14:15:34.4561117Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-18T14:15:34.4580009Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:15:34.4639194Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:15:34.4685259Z [submariner-operator]$ [cluster1] pids[cluster1]=8766
2021-07-18T14:15:34.4747998Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:15:34.4779827Z [submariner-operator]$ [cluster2] pids[cluster2]=8769
2021-07-18T14:15:34.4805885Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:15:34.4821186Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:15:34.4883996Z [submariner-operator]$ [cluster2] wait 8769
2021-07-18T14:15:34.4896778Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:15:34.4914439Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:15:34.4951357Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:15:50.7244916Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:15:50.7246225Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:15:50.7247401Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:15:50.7248644Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-18T14:15:50.7251187Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:15:50.7253814Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:15:50.7254915Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-18T14:15:50.7256069Z [cluster1] - cluster1-worker
2021-07-18T14:15:50.7256900Z [cluster1] • Discovering network details ...
2021-07-18T14:15:50.7257675Z [cluster1] Network plugin: weave-net
2021-07-18T14:15:50.7258253Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-18T14:15:50.7259130Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-18T14:15:50.7259780Z [cluster1] ✓ Discovering network details
2021-07-18T14:15:50.7260484Z [cluster1] • Discovering multi cluster details ...
2021-07-18T14:15:50.7261250Z [cluster1] • Validating Globalnet configurations ...
2021-07-18T14:15:50.7262033Z [cluster1] ✓ Validating Globalnet configurations
2021-07-18T14:15:50.7262766Z [cluster1] ✓ Discovering multi cluster details
2021-07-18T14:15:50.7263708Z [cluster1] • Deploying the Submariner operator ...
2021-07-18T14:15:50.7264511Z [cluster1] ✓ Deploying the Submariner operator
2021-07-18T14:15:50.7265459Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:15:50.7266213Z [cluster1] • Creating SA for cluster ...
2021-07-18T14:15:50.7266874Z [cluster1] ✓ Creating SA for cluster
2021-07-18T14:15:50.7267644Z [cluster1] • Deploying Submariner ...
2021-07-18T14:15:50.7268285Z [cluster1] ✓ Deploying Submariner
2021-07-18T14:15:50.7268946Z [cluster1] ✓ Submariner is up and running
2021-07-18T14:15:54.3813356Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:15:54.3814475Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-18T14:15:54.3815688Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:15:54.3816852Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-18T14:15:54.3820038Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:15:54.3823072Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.8:6443
2021-07-18T14:15:54.3824445Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-18T14:15:54.3825269Z [cluster2] - cluster2-worker
2021-07-18T14:15:54.3826044Z [cluster2] • Discovering network details ...
2021-07-18T14:15:54.3826831Z [cluster2] Network plugin: weave-net
2021-07-18T14:15:54.3827412Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-18T14:15:54.3827935Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-18T14:15:54.3828692Z [cluster2] ✓ Discovering network details
2021-07-18T14:15:54.3829499Z [cluster2] • Discovering multi cluster details ...
2021-07-18T14:15:54.3830849Z [cluster2] • Validating Globalnet configurations ...
2021-07-18T14:15:54.3831887Z [cluster2] ✓ Validating Globalnet configurations
2021-07-18T14:15:54.3832785Z [cluster2] ✓ Discovering multi cluster details
2021-07-18T14:15:54.3833616Z [cluster2] • Deploying the Submariner operator ...
2021-07-18T14:15:54.3834935Z [cluster2] ✓ Deploying the Submariner operator
2021-07-18T14:15:54.3835842Z [cluster2] ✓ Created operator service account and role
2021-07-18T14:15:54.3836758Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-18T14:15:54.3837579Z [cluster2] • Creating SA for cluster ...
2021-07-18T14:15:54.3838278Z [cluster2] ✓ Creating SA for cluster
2021-07-18T14:15:54.3839000Z [cluster2] • Deploying Submariner ...
2021-07-18T14:15:54.3839928Z [cluster2] ✓ Deploying Submariner
2021-07-18T14:15:54.3840805Z [cluster2] ✓ Submariner is up and running
2021-07-18T14:15:54.3860589Z [submariner-operator]$ [cluster2] wait 8766
2021-07-18T14:15:54.3894896Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:15:54.3907148Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:15:54.3921352Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-18T14:15:54.3988414Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:15:54.4012580Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:15:54.4141890Z [submariner-operator]$ [cluster2] wait 8810
2021-07-18T14:15:54.4177435Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:15:54.4211535Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:15:54.4222600Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:15:54.4237220Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:15:54.4346240Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:15:54.7670387Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:15:54.7697995Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:15:55.5381908Z • Showing Connections ...
2021-07-18T14:15:55.8078062Z ✗ Showing Connections
2021-07-18T14:15:55.8078882Z ✗ There are no gateways detected
2021-07-18T14:15:55.8210056Z • Showing Connections ...
2021-07-18T14:15:55.8229344Z ✗ Showing Connections
2021-07-18T14:15:55.8230427Z ✗ There are no gateways detected
2021-07-18T14:15:55.8264229Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:15:55.8283355Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:16:01.9731617Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:16:01.9819622Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:01.9820651Z [submariner-operator]$ [cluster2] wait 8837
2021-07-18T14:16:01.9846551Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:01.9866527Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:16:01.9892098Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:01.9916272Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:16:02.4006537Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:02.4019344Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:16:02.6026500Z • Showing Connections ...
2021-07-18T14:16:02.6195031Z ✗ Showing Connections
2021-07-18T14:16:02.6213471Z ✗ There are no gateways detected
2021-07-18T14:16:02.6348356Z • Showing Connections ...
2021-07-18T14:16:02.6387976Z ✗ Showing Connections
2021-07-18T14:16:02.6388762Z ✗ No connections found
2021-07-18T14:16:02.6409640Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:16:02.6423499Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:16:08.6450276Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:16:08.6495816Z [submariner-operator]$ [cluster2] wait 8864
2021-07-18T14:16:08.6511206Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:08.6525825Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:08.6541481Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:16:08.6555543Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:08.6658532Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:16:08.8957696Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:08.8976534Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:16:09.0188790Z • Showing Connections ...
2021-07-18T14:16:09.0228237Z ✓ Showing Connections
2021-07-18T14:16:09.1624285Z • Showing Connections ...
2021-07-18T14:16:09.1735887Z ✗ Showing Connections
2021-07-18T14:16:09.1736629Z ✗ There are no gateways detected
2021-07-18T14:16:09.1758299Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:16:09.1785461Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:16:15.1816227Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:16:15.1861947Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:15.1874382Z [submariner-operator]$ [cluster2] wait 8890
2021-07-18T14:16:15.1875288Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:15.1913000Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:16:15.1923966Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:15.1988808Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:16:15.3468350Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:15.3487438Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:16:15.4262195Z • Showing Connections ...
2021-07-18T14:16:15.4308590Z ✓ Showing Connections
2021-07-18T14:16:15.4459554Z • Showing Connections ...
2021-07-18T14:16:15.4480977Z ✗ Showing Connections
2021-07-18T14:16:15.4481633Z ✗ There are no gateways detected
2021-07-18T14:16:15.4516761Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:16:15.4527912Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:16:21.4567561Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:16:21.4611953Z [submariner-operator]$ [cluster2] wait 8917
2021-07-18T14:16:21.4613363Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:21.4627362Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:21.4636702Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:16:21.4649373Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:21.4662105Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:16:21.5355954Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:21.5450412Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:16:21.5867023Z • Showing Connections ...
2021-07-18T14:16:21.5901216Z ✓ Showing Connections
2021-07-18T14:16:21.6017142Z • Showing Connections ...
2021-07-18T14:16:21.6041887Z ✗ Showing Connections
2021-07-18T14:16:21.6042532Z ✗ No connections found
2021-07-18T14:16:21.6070469Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:16:21.6083644Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:16:27.6120206Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:16:27.6191725Z [submariner-operator]$ [cluster2] wait 8943
2021-07-18T14:16:27.6216011Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:27.6230548Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:16:27.6239676Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:16:27.6256563Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:27.6280679Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:16:27.7359739Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:16:27.7381703Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:16:27.8665997Z • Showing Connections ...
2021-07-18T14:16:27.8727080Z ✓ Showing Connections
2021-07-18T14:16:27.8904740Z • Showing Connections ...
2021-07-18T14:16:27.8930767Z ✓ Showing Connections
2021-07-18T14:16:27.8954596Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 210.151µs
2021-07-18T14:16:27.8977927Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:16:27.8998551Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:16:27.9015859Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:16:27.9030323Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:16:27.9047022Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-18T14:16:27.9061145Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-18T14:16:27.9123629Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-18T14:16:27.9170493Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:16:27.9186765Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:16:27.9203984Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:16:28.3650938Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-18T14:16:28.3712954Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-18T14:16:29.9762507Z devel: Pulling from submariner/nettest
2021-07-18T14:16:29.9767849Z 5843afab3874: Already exists
2021-07-18T14:16:29.9793807Z 9565bb92f43f: Pulling fs layer
2021-07-18T14:16:29.9794574Z a31c0d5b4ad6: Pulling fs layer
2021-07-18T14:16:29.9796369Z dc3d13650205: Pulling fs layer
2021-07-18T14:16:30.3299348Z 9565bb92f43f: Verifying Checksum
2021-07-18T14:16:30.3299970Z 9565bb92f43f: Download complete
2021-07-18T14:16:30.3436991Z dc3d13650205: Verifying Checksum
2021-07-18T14:16:30.3437533Z dc3d13650205: Download complete
2021-07-18T14:16:30.4771356Z a31c0d5b4ad6: Verifying Checksum
2021-07-18T14:16:30.4772086Z a31c0d5b4ad6: Download complete
2021-07-18T14:16:30.5032964Z 9565bb92f43f: Pull complete
2021-07-18T14:16:30.8394636Z a31c0d5b4ad6: Pull complete
2021-07-18T14:16:30.9300616Z dc3d13650205: Pull complete
2021-07-18T14:16:30.9343691Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-18T14:16:30.9369589Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-18T14:16:30.9414701Z quay.io/submariner/nettest:devel
2021-07-18T14:16:30.9428505Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-18T14:16:31.2327990Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:16:31.5130278Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-18T14:16:31.7915249Z The push refers to repository [localhost:5000/nettest]
2021-07-18T14:16:31.7954782Z 4f2cdf68c81d: Preparing
2021-07-18T14:16:31.7956163Z 1f803d62c8b3: Preparing
2021-07-18T14:16:31.7957031Z 80c9eaab4c9e: Preparing
2021-07-18T14:16:31.8020341Z 72e830a4dff5: Preparing
2021-07-18T14:16:32.3343552Z 80c9eaab4c9e: Pushed
2021-07-18T14:16:32.5016456Z 4f2cdf68c81d: Pushed
2021-07-18T14:16:32.5626097Z 72e830a4dff5: Pushed
2021-07-18T14:16:33.1797085Z 1f803d62c8b3: Pushed
2021-07-18T14:16:33.2006596Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-18T14:16:33.2084324Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:16:33.2097442Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:16:33.2124963Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:16:33.2143692Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-18T14:16:33.2164509Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:16:33.2178627Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:16:33.2195076Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:16:33.7690149Z deployment.apps/netshoot created
2021-07-18T14:16:33.7786639Z Waiting for netshoot pods to be ready.
2021-07-18T14:16:33.7803342Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:16:33.7853608Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:16:33.7888266Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-18T14:16:34.1384065Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-18T14:16:34.6239590Z deployment "netshoot" successfully rolled out
2021-07-18T14:16:34.6302250Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:34.6325241Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:34.6336740Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:34.6348914Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-18T14:16:34.6363812Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:16:34.6381244Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-18T14:16:34.6404711Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:34.6416455Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:34.6429190Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:16:35.1442479Z deployment.apps/nginx-demo created
2021-07-18T14:16:35.1734071Z service/nginx-demo created
2021-07-18T14:16:35.2276783Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-18T14:16:35.2358249Z Waiting for nginx-demo pods to be ready.
2021-07-18T14:16:35.2371774Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:16:35.2384482Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:16:35.2397997Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:16:36.0499185Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:16:37.0576216Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:16:37.4605350Z deployment "nginx-demo" successfully rolled out
2021-07-18T14:16:37.4665024Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-18T14:16:37.4693080Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:16:37.4716616Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-18T14:16:37.4726631Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:16:37.4742838Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-18T14:16:37.8521370Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-18T14:16:37.8540369Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:16:37.8606357Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:16:37.8623263Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-18T14:16:37.8636820Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-18T14:16:37.8654412Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-18T14:16:37.8674601Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:16:37.8692701Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:16:37.8693806Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-18T14:16:37.8725962Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-18T14:16:38.1685623Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:16:38.1694066Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:16:38.1712251Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:16:38.1739495Z [submariner-operator]$ [cluster2] wait 9093
2021-07-18T14:16:38.1741158Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:16:38.1754611Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:16:38.1760939Z Attempting connectivity between clusters - netshoot-57677568b8-ss97l --> 100.1.131.218
2021-07-18T14:16:38.1772357Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:16:38.1783565Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:16:38.1799612Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:16:38.1838836Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:16:38.1853312Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:16:38.1867823Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:16:41.6428004Z command terminated with exit code 7
2021-07-18T14:16:41.6473359Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-18T14:16:41.6491719Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:16:41.6513186Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-18T14:16:41.6525239Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-18T14:16:41.6528780Z curl returned too soon. Sleeping for 27 secs
2021-07-18T14:16:41.6540308Z [submariner-operator]$ [cluster2] sleep 27
2021-07-18T14:17:08.6572608Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:17:08.6616256Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:17:08.6618080Z [submariner-operator]$ [cluster2] wait 9119
2021-07-18T14:17:08.6630998Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:17:08.6638294Z Attempting connectivity between clusters - netshoot-57677568b8-ss97l --> 100.1.131.218
2021-07-18T14:17:08.6649411Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:17:08.6661586Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:17:08.6696613Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:17:08.6718696Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:08.6733191Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:08.6747879Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:12.1070870Z command terminated with exit code 7
2021-07-18T14:17:12.1122303Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-18T14:17:12.1140827Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:17:12.1165121Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-18T14:17:12.1175596Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-18T14:17:12.1180964Z curl returned too soon. Sleeping for 26 secs
2021-07-18T14:17:12.1194820Z [submariner-operator]$ [cluster2] sleep 26
2021-07-18T14:17:38.1251983Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:17:38.1295653Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:17:38.1301661Z [submariner-operator]$ [cluster2] wait 9145
2021-07-18T14:17:38.1305761Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:17:38.1313015Z Attempting connectivity between clusters - netshoot-57677568b8-ss97l --> 100.1.131.218
2021-07-18T14:17:38.1322766Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:17:38.1332074Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:17:38.1349304Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:17:39.1121241Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:39.1130582Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:39.1133072Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:17:41.6747643Z command terminated with exit code 7
2021-07-18T14:17:41.6796719Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-18T14:17:41.6815420Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:17:41.6836793Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-18T14:17:41.6850187Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-18T14:17:41.6856882Z curl returned too soon. Sleeping for 27 secs
2021-07-18T14:17:41.6872663Z [submariner-operator]$ [cluster2] sleep 27
2021-07-18T14:18:08.6910303Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:18:08.6959527Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:18:08.6960889Z [submariner-operator]$ [cluster2] wait 9173
2021-07-18T14:18:08.6975865Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:18:08.6982698Z Attempting connectivity between clusters - netshoot-57677568b8-ss97l --> 100.1.131.218
2021-07-18T14:18:08.6996332Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:18:08.7010699Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:18:08.7027086Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:18:08.7048367Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:08.7061986Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:08.7079358Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:12.1714850Z command terminated with exit code 7
2021-07-18T14:18:12.1765694Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-18T14:18:12.1781001Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:18:12.1807768Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-18T14:18:12.1825455Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-18T14:18:12.1826473Z curl returned too soon. Sleeping for 26 secs
2021-07-18T14:18:12.1837770Z [submariner-operator]$ [cluster2] sleep 26
2021-07-18T14:18:38.1862798Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:18:38.1918269Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ss97l 100.1.131.218
2021-07-18T14:18:38.1925549Z [submariner-operator]$ [cluster2] wait 9199
2021-07-18T14:18:38.1935324Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:18:38.1941966Z Attempting connectivity between clusters - netshoot-57677568b8-ss97l --> 100.1.131.218
2021-07-18T14:18:38.1956047Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:18:38.1967787Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:18:38.1991893Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:18:38.2018593Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:38.2043356Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:38.2055743Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ss97l -- curl --output /dev/null -m 30 --silent --head --fail 100.1.131.218
2021-07-18T14:18:41.6428896Z command terminated with exit code 7
2021-07-18T14:18:41.6486033Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-18T14:18:41.6505390Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:18:41.6524417Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-18T14:18:41.6539669Z [submariner-operator]$ [cluster2] remaining_time=$(( wait_time - execution_time))
2021-07-18T14:18:41.6543795Z curl returned too soon. Sleeping for 27 secs
2021-07-18T14:18:41.6556888Z [submariner-operator]$ [cluster2] sleep 27
2021-07-18T14:19:08.6584158Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:19:08.6604931Z Max attempts reached, failed to run 'test_connection netshoot-57677568b8-ss97l 100.1.131.218'!
2021-07-18T14:19:08.6614947Z [submariner-operator]$ [cluster2] exit 1
2021-07-18T14:19:08.6621701Z make: *** [/opt/shipyard/Makefile.inc:101: deploy] Error 1
2021-07-18T14:19:08.6687606Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-18T14:19:24.9866407Z time="2021-07-18T14:19:24Z" level=fatal msg="exit status 2"
2021-07-18T14:19:24.9874177Z make: *** [Makefile.dapper:28: upgrade-e2e] Error 1
2021-07-18T14:19:24.9908360Z ##[error]Process completed with exit code 2.
2021-07-18T14:19:25.0102947Z ##[group]Run submariner-io/shipyard/gh-actions/post-mortem@devel
2021-07-18T14:19:25.0104066Z ##[endgroup]
2021-07-18T14:19:25.1023005Z ##[group]Report available disk space
2021-07-18T14:19:25.1052227Z Filesystem Size Used Avail Use% Mounted on
2021-07-18T14:19:25.1057245Z /dev/root 84G 53G 31G 64% /
2021-07-18T14:19:25.1058478Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-18T14:19:25.1059485Z tmpfs 3.4G 166M 3.3G 5% /dev/shm
2021-07-18T14:19:25.1060206Z tmpfs 696M 1.7M 694M 1% /run
2021-07-18T14:19:25.1060718Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-18T14:19:25.1061188Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-18T14:19:25.1061704Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-18T14:19:25.1062200Z /dev/loop2 68M 68M 0 100% /snap/lxd/20326
2021-07-18T14:19:25.1062701Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-18T14:19:25.1063321Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-18T14:19:25.1063840Z /dev/sdb15 105M 7.9M 97M 8% /boot/efi
2021-07-18T14:19:25.1064483Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-18T14:19:25.1064986Z /dev/sda1 14G 4.1G 9.0G 32% /mnt
2021-07-18T14:19:25.1066075Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/791ae7e48982390fcb1c9facb4790d905eb432865ab7d1a64bd35d85cb42e1b7/merged
2021-07-18T14:19:25.1068673Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/fd31514fb3402286cc4e0700256deb87323493c45b57c9b084f8093631bc2283/merged
2021-07-18T14:19:25.1070729Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/c585c3c188c40ab4b5280a57eb07c5c4872c9f5e4ae19675dffecfb73ab46e68/merged
2021-07-18T14:19:25.1072574Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/69ad60dcbddf8d63700f2df797e098c2d5e4e19f40c1af1bb358494474fd34ce/merged
2021-07-18T14:19:25.1074404Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/8215b0f1bb4650b23b2fdb9af27a13053b6b7b4fc1a14c0a72f74946042f2b87/merged
2021-07-18T14:19:25.1076108Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/24f0a53b6fa0cf38986993d498e7c7f2c57cab7494bf2c6b5c16c28205c46095/merged
2021-07-18T14:19:25.1077671Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/01485a66348a9545e9b7838c65e71378be46aab20d3ae37f2954d999cc217f04/merged
2021-07-18T14:19:25.1079236Z overlay 84G 53G 31G 64% /var/lib/docker/overlay2/fa96092bc2fa87207d8d3f327e77730ce3062eff8d25079499df0942f2ada38f/merged
2021-07-18T14:19:25.1080332Z ##[endgroup]
2021-07-18T14:19:25.1080825Z ##[group]Report available RAM
2021-07-18T14:19:25.1096023Z total used free shared buff/cache available
2021-07-18T14:19:25.1098274Z Mem: 6.8Gi 3.8Gi 421Mi 226Mi 2.6Gi 2.8Gi
2021-07-18T14:19:25.1098749Z Swap: 0B 0B 0B
2021-07-18T14:19:25.1099200Z ##[endgroup]
2021-07-18T14:19:25.1222060Z ##[group]Running post mortem
2021-07-18T14:19:25.1271159Z docker network create -d bridge kind
2021-07-18T14:19:25.1777803Z Error response from daemon: network with name kind already exists
2021-07-18T14:19:25.1842220Z ./.dapper -m bind make --debug=b post-mortem
2021-07-18T14:19:25.1845381Z make: [Makefile.dapper:27: post-mortem] Error 1 (ignored)
2021-07-18T14:19:28.3707815Z Sending build context to Docker daemon 204.1MB
2021-07-18T14:19:28.3708320Z
2021-07-18T14:19:28.3820195Z Step 1/8 : ARG BASE_BRANCH
2021-07-18T14:19:28.3821662Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-18T14:19:28.3830192Z ---> 92b726655a41
2021-07-18T14:19:28.3831900Z Step 3/8 : ARG PROJECT
2021-07-18T14:19:28.3844937Z ---> Using cache
2021-07-18T14:19:28.3846633Z ---> 734d34c66c7c
2021-07-18T14:19:28.3849113Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-18T14:19:28.3859581Z ---> Using cache
2021-07-18T14:19:28.3860796Z ---> 23626febc940
2021-07-18T14:19:28.3861844Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-18T14:19:28.3872589Z ---> Using cache
2021-07-18T14:19:28.3873208Z ---> 8378ff61e6e6
2021-07-18T14:19:28.3874293Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-18T14:19:28.3884978Z ---> Using cache
2021-07-18T14:19:28.3888218Z ---> 67bb19b4bf7e
2021-07-18T14:19:28.3888867Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-18T14:19:28.3913975Z ---> Using cache
2021-07-18T14:19:28.3914586Z ---> 42700df0336d
2021-07-18T14:19:28.3914989Z Step 8/8 : CMD ["sh"]
2021-07-18T14:19:28.3926748Z ---> Using cache
2021-07-18T14:19:28.3927364Z ---> 8a3db436f845
2021-07-18T14:19:28.5675556Z Successfully built 8a3db436f845
2021-07-18T14:19:28.6371446Z Successfully tagged submariner-operator:devel
2021-07-18T14:19:29.3631520Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-18T14:19:29.3644370Z [submariner-operator]$ mkdir -p bin dist output
2021-07-18T14:19:29.3665872Z [submariner-operator]$ make --debug=b post-mortem
2021-07-18T14:19:29.3724582Z GNU Make 4.3
2021-07-18T14:19:29.3725714Z Built for x86_64-redhat-linux-gnu
2021-07-18T14:19:29.3726553Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-18T14:19:29.3727789Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-18T14:19:29.3728544Z This is free software: you are free to change and redistribute it.
2021-07-18T14:19:29.3730941Z There is NO WARRANTY, to the extent permitted by law.
2021-07-18T14:19:29.3734844Z Reading makefiles...
2021-07-18T14:19:29.5241310Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-18T14:19:29.5255583Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-18T14:19:29.7547739Z Updating makefiles....
2021-07-18T14:19:29.7559359Z Updating goal targets....
2021-07-18T14:19:29.7561029Z File 'post-mortem' does not exist.
2021-07-18T14:19:29.7562367Z Must remake target 'post-mortem'.
2021-07-18T14:19:29.7565818Z /opt/shipyard/scripts/post_mortem.sh
2021-07-18T14:19:29.7608476Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:19:29.7621593Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:19:29.7632455Z [submariner-operator]$ script_name=utils
2021-07-18T14:19:29.7641147Z [submariner-operator]$ exec_name=post_mortem.sh
2021-07-18T14:19:29.7661708Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:19:29.7671440Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:19:29.7679785Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:19:29.7694797Z [submariner-operator]$ export KUBECONFIG
2021-07-18T14:19:29.7706095Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:19:29.7719924Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:19:29.7746214Z [submariner-operator]$ kind get clusters
2021-07-18T14:19:30.4176724Z [submariner-operator]$ [cluster1] post_analyze
2021-07-18T14:19:30.4190292Z [submariner-operator]$ [cluster1] post_analyze
2021-07-18T14:19:30.4203462Z [submariner-operator]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-18T14:19:30.4217520Z [submariner-operator]$ [cluster1] print_section * Kubernetes client and server versions in cluster1 *
2021-07-18T14:19:30.4223293Z ====================================================================
2021-07-18T14:19:30.4228462Z ##[endgroup]
2021-07-18T14:19:30.4234143Z ##[group]* Kubernetes client and server versions in cluster1 *
2021-07-18T14:19:30.4238724Z ======================= * Kubernetes client and server versions in cluster1 * =======================
2021-07-18T14:19:30.4251849Z [submariner-operator]$ [cluster1] kubectl version
2021-07-18T14:19:30.4264010Z [submariner-operator]$ [cluster1] kubectl version
2021-07-18T14:19:30.4277543Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 version
2021-07-18T14:19:30.6998273Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-18T14:19:30.7052650Z Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.7", GitCommit:"132a687512d7fb058d0f5890f07d4121b3f0a2e2", GitTreeState:"clean", BuildDate:"2021-05-27T23:27:49Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}
2021-07-18T14:19:30.7217769Z [submariner-operator]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-18T14:19:30.7238739Z [submariner-operator]$ [cluster1] print_section * Overview of all resources in cluster1 *
2021-07-18T14:19:30.7244436Z ====================================================================
2021-07-18T14:19:30.7246631Z ##[endgroup]
2021-07-18T14:19:30.7253658Z ##[group]* Overview of all resources in cluster1 *
2021-07-18T14:19:30.7258315Z ======================= * Overview of all resources in cluster1 * =======================
2021-07-18T14:19:30.7278663Z [submariner-operator]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-18T14:19:30.7290564Z [submariner-operator]$ [cluster1] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-18T14:19:30.7302475Z [submariner-operator]$ [cluster1] kubectl api-resources --verbs=list -o name
2021-07-18T14:19:30.7315824Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources --verbs=list -o name
2021-07-18T14:19:31.4014078Z Warning: v1 ComponentStatus is deprecated in v1.19+
2021-07-18T14:19:31.4015299Z NAME STATUS MESSAGE ERROR
2021-07-18T14:19:31.4017095Z componentstatus/controller-manager Unhealthy Get "http://127.0.0.1:10252/healthz": dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-18T14:19:31.4020640Z componentstatus/scheduler Unhealthy Get "http://127.0.0.1:10251/healthz": dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-18T14:19:31.4026605Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-18T14:19:31.6977346Z NAME DATA AGE
2021-07-18T14:19:31.6978428Z configmap/kube-root-ca.crt 1 12m
2021-07-18T14:19:31.9799147Z NAME ENDPOINTS AGE
2021-07-18T14:19:31.9799793Z endpoints/kubernetes 172.18.0.8:6443 12m
2021-07-18T14:19:31.9801319Z endpoints/nginx-demo 10.1.0.4:8080,10.1.128.5:8080 2m56s
2021-07-18T14:19:32.2926504Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-18T14:19:32.2930480Z 12m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 12m 1 event/cluster1-control-plane.1692e7c065dfd8c5
2021-07-18T14:19:32.2938650Z 12m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 12m 1 event/cluster1-control-plane.1692e7c06da205dc
2021-07-18T14:19:32.2965557Z 12m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 12m 1 event/cluster1-control-plane.1692e7c06da221fc
2021-07-18T14:19:32.2972644Z 12m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 12m 1 event/cluster1-control-plane.1692e7c06da24268
2021-07-18T14:19:32.2976452Z 12m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 12m 1 event/cluster1-control-plane.1692e7c0865b7176
2021-07-18T14:19:32.2980602Z 12m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 12m 1 event/cluster1-control-plane.1692e7c214269285
2021-07-18T14:19:32.2983981Z 12m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 12m 1 event/cluster1-control-plane.1692e7c3005cb3d3
2021-07-18T14:19:32.2987258Z 11m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 11m 1 event/cluster1-control-plane.1692e7cc18429c1e
2021-07-18T14:19:32.2991073Z 12m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 12m 1 event/cluster1-worker.1692e7c49fb80718
2021-07-18T14:19:32.2994925Z 12m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 12m 1 event/cluster1-worker.1692e7c4a905d67e
2021-07-18T14:19:32.2998697Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 12m 1 event/cluster1-worker.1692e7c4a905f1d6
2021-07-18T14:19:32.3002288Z 12m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 12m 1 event/cluster1-worker.1692e7c4a90613d2
2021-07-18T14:19:32.3006053Z 12m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 12m 1 event/cluster1-worker.1692e7c4b5c941f4
2021-07-18T14:19:32.3011165Z 12m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 12m 1 event/cluster1-worker.1692e7c592485907
2021-07-18T14:19:32.3015430Z 12m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 12m 1 event/cluster1-worker.1692e7c5d7400e44
2021-07-18T14:19:32.3018897Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event/cluster1-worker.1692e7c978f537ed
2021-07-18T14:19:32.3021451Z 12m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 12m 1 event/cluster1-worker2.1692e7c4b3164996
2021-07-18T14:19:32.3025296Z 12m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 12m 1 event/cluster1-worker2.1692e7c4bc97e348
2021-07-18T14:19:32.3030570Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 12m 1 event/cluster1-worker2.1692e7c4bc97fcac
2021-07-18T14:19:32.3034392Z 12m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 12m 1 event/cluster1-worker2.1692e7c4bc980cb0
2021-07-18T14:19:32.3037747Z 12m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 12m 1 event/cluster1-worker2.1692e7c4d4072d9f
2021-07-18T14:19:32.3041009Z 12m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 12m 1 event/cluster1-worker2.1692e7c5924885f3
2021-07-18T14:19:32.3043946Z 12m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 12m 1 event/cluster1-worker2.1692e7c5dc6861dc
2021-07-18T14:19:32.3046702Z 11m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 11m 1 event/cluster1-worker2.1692e7cbd04b243a
2021-07-18T14:19:32.3050359Z 5m59s Normal Scheduled pod/nginx-demo-b8f8b4fc6-684hs default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-684hs to cluster1-worker2 5m59s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e819d50230df
2021-07-18T14:19:32.3055713Z 5m59s Normal Pulling pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 5m59s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e819fe7ce321
2021-07-18T14:19:32.3060106Z 5m53s Normal Pulled pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 5.506083169s 5m53s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e81b46ad6ef2
2021-07-18T14:19:32.3064898Z 5m52s Normal Created pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 5m52s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e81b748c5c96
2021-07-18T14:19:32.3069037Z 5m52s Normal Started pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 5m52s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e81b814cfcbf
2021-07-18T14:19:32.3073624Z 5m50s Normal Killing pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 5m50s 1 event/nginx-demo-b8f8b4fc6-684hs.1692e81c19c525e8
2021-07-18T14:19:32.3076940Z 2m57s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6g9jn default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6g9jn to cluster1-worker2 2m57s 1 event/nginx-demo-b8f8b4fc6-6g9jn.1692e84442fe6cfd
2021-07-18T14:19:32.3087001Z 2m56s Normal Pulling pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 2m56s 1 event/nginx-demo-b8f8b4fc6-6g9jn.1692e8446e47409d
2021-07-18T14:19:32.3090651Z 2m56s Normal Pulled pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 388.609299ms 2m56s 1 event/nginx-demo-b8f8b4fc6-6g9jn.1692e84485712d28
2021-07-18T14:19:32.3094301Z 2m56s Normal Created pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 2m56s 1 event/nginx-demo-b8f8b4fc6-6g9jn.1692e84486db157b
2021-07-18T14:19:32.3105714Z 2m56s Normal Started pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 2m56s 1 event/nginx-demo-b8f8b4fc6-6g9jn.1692e8448dbc2796
2021-07-18T14:19:32.3109096Z 2m57s Normal Scheduled pod/nginx-demo-b8f8b4fc6-h54lx default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-h54lx to cluster1-worker 2m57s 1 event/nginx-demo-b8f8b4fc6-h54lx.1692e8443ee28ede
2021-07-18T14:19:32.3113398Z 2m57s Normal Pulling pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 2m57s 1 event/nginx-demo-b8f8b4fc6-h54lx.1692e8446b6cacb3
2021-07-18T14:19:32.3117004Z 2m56s Normal Pulled pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 367.022644ms 2m56s 1 event/nginx-demo-b8f8b4fc6-h54lx.1692e844814d3598
2021-07-18T14:19:32.3124679Z 2m56s Normal Created pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 2m56s 1 event/nginx-demo-b8f8b4fc6-h54lx.1692e84482e5a9a1
2021-07-18T14:19:32.3128014Z 2m56s Normal Started pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 2m56s 1 event/nginx-demo-b8f8b4fc6-h54lx.1692e84489e6bf1b
2021-07-18T14:19:32.3131987Z 5m59s Normal Scheduled pod/nginx-demo-b8f8b4fc6-h9cxc default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-h9cxc to cluster1-worker 5m59s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e819d505fdf2
2021-07-18T14:19:32.3135502Z 5m59s Normal Pulling pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 5m59s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e819fe6e6ea2
2021-07-18T14:19:32.3138636Z 5m53s Normal Pulled pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 5.256578091s 5m53s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e81b37bfac3b
2021-07-18T14:19:32.3142021Z 5m52s Normal Created pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 5m52s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e81b7522162c
2021-07-18T14:19:32.3145282Z 5m52s Normal Started pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 5m52s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e81b7e8ae305
2021-07-18T14:19:32.3148516Z 5m50s Normal Killing pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 5m50s 1 event/nginx-demo-b8f8b4fc6-h9cxc.1692e81c231f8cbf
2021-07-18T14:19:32.3152459Z 5m59s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-h9cxc 5m59s 1 event/nginx-demo-b8f8b4fc6.1692e819d15187a4
2021-07-18T14:19:32.3190133Z 5m59s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-684hs 5m59s 1 event/nginx-demo-b8f8b4fc6.1692e819d35af74e
2021-07-18T14:19:32.3193414Z 2m57s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-h54lx 2m57s 1 event/nginx-demo-b8f8b4fc6.1692e8443cf658e1
2021-07-18T14:19:32.3196506Z 2m57s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6g9jn 2m57s 1 event/nginx-demo-b8f8b4fc6.1692e844418170a5
2021-07-18T14:19:32.3200612Z 5m59s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 3239b295-ad45-4d14-aa08-a2dc085b43ac] does not exist in namespace "default" 5m59s 1 event/nginx-demo-cluster1.1692e819e4df6f87
2021-07-18T14:19:32.3204554Z 6m Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 6m 1 event/nginx-demo.1692e819ceac1949
2021-07-18T14:19:32.3207303Z 2m57s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 2m57s 1 event/nginx-demo.1692e8443a2c3596
2021-07-18T14:19:32.3210335Z 2m57s Warning FailedToCreateEndpoint endpoints/nginx-demo endpoint-controller Failed to create endpoint for service default/nginx-demo: endpoints "nginx-demo" already exists 2m57s 1 event/nginx-demo.1692e84441d31147
2021-07-18T14:19:32.3214721Z 3m39s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 3m39s 1 event/submariner-lighthouse-coredns.1692e83a9ee75d70
2021-07-18T14:19:32.8755607Z NAME STATUS AGE
2021-07-18T14:19:32.8756184Z namespace/default Active 12m
2021-07-18T14:19:32.8757414Z namespace/kube-node-lease Active 12m
2021-07-18T14:19:32.8768792Z namespace/kube-public Active 12m
2021-07-18T14:19:32.8769714Z namespace/kube-system Active 12m
2021-07-18T14:19:32.8770512Z namespace/local-path-storage Active 12m
2021-07-18T14:19:32.8771638Z namespace/submariner-k8s-broker Active 7m32s
2021-07-18T14:19:32.8772535Z namespace/submariner-operator Active 7m32s
2021-07-18T14:19:33.1760450Z NAME STATUS ROLES AGE VERSION INTERNAL-IP EXTERNAL-IP OS-IMAGE KERNEL-VERSION CONTAINER-RUNTIME
2021-07-18T14:19:33.1762560Z node/cluster1-control-plane Ready control-plane,master 12m v1.20.7 172.18.0.8 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-18T14:19:33.1764242Z node/cluster1-worker Ready <none> 12m v1.20.7 172.18.0.9 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-18T14:19:33.1765513Z node/cluster1-worker2 Ready <none> 12m v1.20.7 172.18.0.6 <none> Ubuntu 21.04 5.8.0-1036-azure containerd://1.5.2
2021-07-18T14:19:34.0333605Z NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
2021-07-18T14:19:34.0335705Z pod/nginx-demo-b8f8b4fc6-6g9jn 1/1 Running 0 2m59s 10.1.128.5 cluster1-worker2 <none> <none>
2021-07-18T14:19:34.0336938Z pod/nginx-demo-b8f8b4fc6-h54lx 1/1 Running 0 2m59s 10.1.0.4 cluster1-worker <none> <none>
2021-07-18T14:19:35.2719699Z NAME TYPE DATA AGE
2021-07-18T14:19:35.2722592Z secret/default-token-v85bd kubernetes.io/service-account-token 3 12m
2021-07-18T14:19:35.5568528Z NAME SECRETS AGE
2021-07-18T14:19:35.5569118Z serviceaccount/default 1 12m
2021-07-18T14:19:35.8477209Z NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
2021-07-18T14:19:35.8477959Z service/kubernetes ClusterIP 100.1.0.1 <none> 443/TCP 12m <none>
2021-07-18T14:19:35.8478986Z service/nginx-demo ClusterIP 100.1.131.218 <none> 80/TCP 3m app=nginx-demo
2021-07-18T14:19:37.0447610Z NAME CREATED AT
2021-07-18T14:19:37.0449949Z customresourcedefinition.apiextensions.k8s.io/brokers.submariner.io 2021-07-18T14:12:00Z
2021-07-18T14:19:37.0452111Z customresourcedefinition.apiextensions.k8s.io/clusterglobalegressips.submariner.io 2021-07-18T14:15:43Z
2021-07-18T14:19:37.0454267Z customresourcedefinition.apiextensions.k8s.io/clusters.submariner.io 2021-07-18T14:12:12Z
2021-07-18T14:19:37.0456408Z customresourcedefinition.apiextensions.k8s.io/endpoints.submariner.io 2021-07-18T14:12:12Z
2021-07-18T14:19:37.0461935Z customresourcedefinition.apiextensions.k8s.io/gateways.submariner.io 2021-07-18T14:12:12Z
2021-07-18T14:19:37.0464103Z customresourcedefinition.apiextensions.k8s.io/globalegressips.submariner.io 2021-07-18T14:15:43Z
2021-07-18T14:19:37.0466595Z customresourcedefinition.apiextensions.k8s.io/globalingressips.submariner.io 2021-07-18T14:15:44Z
2021-07-18T14:19:37.0469476Z customresourcedefinition.apiextensions.k8s.io/servicediscoveries.submariner.io 2021-07-18T14:12:00Z
2021-07-18T14:19:37.0472014Z customresourcedefinition.apiextensions.k8s.io/serviceexports.multicluster.x-k8s.io 2021-07-18T14:12:10Z
2021-07-18T14:19:37.0474191Z customresourcedefinition.apiextensions.k8s.io/serviceimports.multicluster.x-k8s.io 2021-07-18T14:12:10Z
2021-07-18T14:19:37.0476576Z customresourcedefinition.apiextensions.k8s.io/submariners.submariner.io 2021-07-18T14:12:00Z
2021-07-18T14:19:37.4799726Z NAME SERVICE AVAILABLE AGE
2021-07-18T14:19:37.4800695Z apiservice.apiregistration.k8s.io/v1. Local True 12m
2021-07-18T14:19:37.4802713Z apiservice.apiregistration.k8s.io/v1.admissionregistration.k8s.io Local True 12m
2021-07-18T14:19:37.4804465Z apiservice.apiregistration.k8s.io/v1.apiextensions.k8s.io Local True 12m
2021-07-18T14:19:37.4805986Z apiservice.apiregistration.k8s.io/v1.apps Local True 12m
2021-07-18T14:19:37.4807357Z apiservice.apiregistration.k8s.io/v1.authentication.k8s.io Local True 12m
2021-07-18T14:19:37.4808760Z apiservice.apiregistration.k8s.io/v1.authorization.k8s.io Local True 12m
2021-07-18T14:19:37.4810130Z apiservice.apiregistration.k8s.io/v1.autoscaling Local True 12m
2021-07-18T14:19:37.4811327Z apiservice.apiregistration.k8s.io/v1.batch Local True 12m
2021-07-18T14:19:37.4812672Z apiservice.apiregistration.k8s.io/v1.certificates.k8s.io Local True 12m
2021-07-18T14:19:37.4814036Z apiservice.apiregistration.k8s.io/v1.coordination.k8s.io Local True 12m
2021-07-18T14:19:37.4815352Z apiservice.apiregistration.k8s.io/v1.events.k8s.io Local True 12m
2021-07-18T14:19:37.4816634Z apiservice.apiregistration.k8s.io/v1.networking.k8s.io Local True 12m
2021-07-18T14:19:37.4817901Z apiservice.apiregistration.k8s.io/v1.node.k8s.io Local True 12m
2021-07-18T14:19:37.4819242Z apiservice.apiregistration.k8s.io/v1.rbac.authorization.k8s.io Local True 12m
2021-07-18T14:19:37.4820643Z apiservice.apiregistration.k8s.io/v1.scheduling.k8s.io Local True 12m
2021-07-18T14:19:37.4821933Z apiservice.apiregistration.k8s.io/v1.storage.k8s.io Local True 12m
2021-07-18T14:19:37.4823192Z apiservice.apiregistration.k8s.io/v1.submariner.io Local True 7m25s
2021-07-18T14:19:37.4825250Z apiservice.apiregistration.k8s.io/v1alpha1.multicluster.x-k8s.io Local True 7m27s
2021-07-18T14:19:37.4826725Z apiservice.apiregistration.k8s.io/v1alpha1.submariner.io Local True 7m37s
2021-07-18T14:19:37.4828286Z apiservice.apiregistration.k8s.io/v1beta1.admissionregistration.k8s.io Local True 12m
2021-07-18T14:19:37.4830264Z apiservice.apiregistration.k8s.io/v1beta1.apiextensions.k8s.io Local True 12m
2021-07-18T14:19:37.4831783Z apiservice.apiregistration.k8s.io/v1beta1.authentication.k8s.io Local True 12m
2021-07-18T14:19:37.4833288Z apiservice.apiregistration.k8s.io/v1beta1.authorization.k8s.io Local True 12m
2021-07-18T14:19:37.4834623Z apiservice.apiregistration.k8s.io/v1beta1.batch Local True 12m
2021-07-18T14:19:37.4835965Z apiservice.apiregistration.k8s.io/v1beta1.certificates.k8s.io Local True 12m
2021-07-18T14:19:37.4837419Z apiservice.apiregistration.k8s.io/v1beta1.coordination.k8s.io Local True 12m
2021-07-18T14:19:37.4838851Z apiservice.apiregistration.k8s.io/v1beta1.discovery.k8s.io Local True 12m
2021-07-18T14:19:37.4840415Z apiservice.apiregistration.k8s.io/v1beta1.events.k8s.io Local True 12m
2021-07-18T14:19:37.4841717Z apiservice.apiregistration.k8s.io/v1beta1.extensions Local True 12m
2021-07-18T14:19:37.4843369Z apiservice.apiregistration.k8s.io/v1beta1.flowcontrol.apiserver.k8s.io Local True 12m
2021-07-18T14:19:37.4844929Z apiservice.apiregistration.k8s.io/v1beta1.networking.k8s.io Local True 12m
2021-07-18T14:19:37.4846317Z apiservice.apiregistration.k8s.io/v1beta1.node.k8s.io Local True 12m
2021-07-18T14:19:37.4847581Z apiservice.apiregistration.k8s.io/v1beta1.policy Local True 12m
2021-07-18T14:19:37.4848993Z apiservice.apiregistration.k8s.io/v1beta1.rbac.authorization.k8s.io Local True 12m
2021-07-18T14:19:37.4850705Z apiservice.apiregistration.k8s.io/v1beta1.scheduling.k8s.io Local True 12m
2021-07-18T14:19:37.4852090Z apiservice.apiregistration.k8s.io/v1beta1.storage.k8s.io Local True 12m
2021-07-18T14:19:37.4853413Z apiservice.apiregistration.k8s.io/v2beta1.autoscaling Local True 12m
2021-07-18T14:19:37.4854708Z apiservice.apiregistration.k8s.io/v2beta2.autoscaling Local True 12m
2021-07-18T14:19:38.3940292Z NAME READY UP-TO-DATE AVAILABLE AGE CONTAINERS IMAGES SELECTOR
2021-07-18T14:19:38.3941750Z deployment.apps/nginx-demo 2/2 2 2 3m3s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo
2021-07-18T14:19:38.6995920Z NAME DESIRED CURRENT READY AGE CONTAINERS IMAGES SELECTOR
2021-07-18T14:19:38.6998225Z replicaset.apps/nginx-demo-b8f8b4fc6 2 2 2 3m3s nginx-demo quay.io/bitnami/nginx:latest app=nginx-demo,pod-template-hash=b8f8b4fc6
2021-07-18T14:19:40.3856358Z NAME AGE SIGNERNAME REQUESTOR CONDITION
2021-07-18T14:19:40.3858688Z certificatesigningrequest.certificates.k8s.io/csr-6q24g 12m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-18T14:19:40.3861228Z certificatesigningrequest.certificates.k8s.io/csr-qx79m 12m kubernetes.io/kube-apiserver-client-kubelet system:bootstrap:abcdef Approved,Issued
2021-07-18T14:19:41.2095893Z NAME ADDRESSTYPE PORTS ENDPOINTS AGE
2021-07-18T14:19:41.2097485Z endpointslice.discovery.k8s.io/kubernetes IPv4 6443 172.18.0.8 12m
2021-07-18T14:19:41.2099711Z endpointslice.discovery.k8s.io/nginx-demo-cluster1 IPv4 8080 10.1.0.4,10.1.128.5 3m6s
2021-07-18T14:19:41.2101638Z endpointslice.discovery.k8s.io/nginx-demo-ng9ch IPv4 8080 10.1.128.5,10.1.0.4 3m6s
2021-07-18T14:19:41.6312579Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-18T14:19:41.6315621Z 12m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c065dfd8c5
2021-07-18T14:19:41.6319317Z 12m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c06da205dc
2021-07-18T14:19:41.6323650Z 12m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c06da221fc
2021-07-18T14:19:41.6327738Z 12m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c06da24268
2021-07-18T14:19:41.6331589Z 12m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c0865b7176
2021-07-18T14:19:41.6335446Z 12m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c214269285
2021-07-18T14:19:41.6339021Z 12m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 12m 1 event.events.k8s.io/cluster1-control-plane.1692e7c3005cb3d3
2021-07-18T14:19:41.6342258Z 11m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-control-plane.1692e7cc18429c1e
2021-07-18T14:19:41.6345420Z 12m Normal Starting node/cluster1-worker kubelet, cluster1-worker Starting kubelet. 12m 1 event.events.k8s.io/cluster1-worker.1692e7c49fb80718
2021-07-18T14:19:41.6348481Z 12m Normal NodeHasSufficientMemory node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-worker.1692e7c4a905d67e
2021-07-18T14:19:41.6352410Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-worker.1692e7c4a905f1d6
2021-07-18T14:19:41.6357682Z 12m Normal NodeHasSufficientPID node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-worker.1692e7c4a90613d2
2021-07-18T14:19:41.6361130Z 12m Normal NodeAllocatableEnforced node/cluster1-worker kubelet, cluster1-worker Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-worker.1692e7c4b5c941f4
2021-07-18T14:19:41.6364280Z 12m Normal RegisteredNode node/cluster1-worker node-controller Node cluster1-worker event: Registered Node cluster1-worker in Controller 12m 1 event.events.k8s.io/cluster1-worker.1692e7c592485907
2021-07-18T14:19:41.6367179Z 12m Normal Starting node/cluster1-worker kube-proxy, cluster1-worker Starting kube-proxy. 12m 1 event.events.k8s.io/cluster1-worker.1692e7c5d7400e44
2021-07-18T14:19:41.6369936Z 11m Normal NodeReady node/cluster1-worker kubelet, cluster1-worker Node cluster1-worker status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker.1692e7c978f537ed
2021-07-18T14:19:41.6372669Z 12m Normal Starting node/cluster1-worker2 kubelet, cluster1-worker2 Starting kubelet. 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c4b3164996
2021-07-18T14:19:41.6375967Z 12m Normal NodeHasSufficientMemory node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientMemory 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c4bc97e348
2021-07-18T14:19:41.6379875Z 12m Normal NodeHasNoDiskPressure node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasNoDiskPressure 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c4bc97fcac
2021-07-18T14:19:41.6383567Z 12m Normal NodeHasSufficientPID node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeHasSufficientPID 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c4bc980cb0
2021-07-18T14:19:41.6386883Z 12m Normal NodeAllocatableEnforced node/cluster1-worker2 kubelet, cluster1-worker2 Updated Node Allocatable limit across pods 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c4d4072d9f
2021-07-18T14:19:41.6429661Z 12m Normal RegisteredNode node/cluster1-worker2 node-controller Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c5924885f3
2021-07-18T14:19:41.6432923Z 12m Normal Starting node/cluster1-worker2 kube-proxy, cluster1-worker2 Starting kube-proxy. 12m 1 event.events.k8s.io/cluster1-worker2.1692e7c5dc6861dc
2021-07-18T14:19:41.6436167Z 11m Normal NodeReady node/cluster1-worker2 kubelet, cluster1-worker2 Node cluster1-worker2 status is now: NodeReady 11m 1 event.events.k8s.io/cluster1-worker2.1692e7cbd04b243a
2021-07-18T14:19:41.6439557Z 6m8s Normal Scheduled pod/nginx-demo-b8f8b4fc6-684hs default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-684hs to cluster1-worker2 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e819d50230df
2021-07-18T14:19:41.6443129Z 6m8s Normal Pulling pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e819fe7ce321
2021-07-18T14:19:41.6446931Z 6m2s Normal Pulled pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 5.506083169s 6m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e81b46ad6ef2
2021-07-18T14:19:41.6450530Z 6m1s Normal Created pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 6m1s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e81b748c5c96
2021-07-18T14:19:41.6454288Z 6m1s Normal Started pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 6m1s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e81b814cfcbf
2021-07-18T14:19:41.6458472Z 5m59s Normal Killing pod/nginx-demo-b8f8b4fc6-684hs spec.containers{nginx-demo} kubelet, cluster1-worker2 Stopping container nginx-demo 5m59s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-684hs.1692e81c19c525e8
2021-07-18T14:19:41.6462206Z 3m6s Normal Scheduled pod/nginx-demo-b8f8b4fc6-6g9jn default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-6g9jn to cluster1-worker2 3m6s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6g9jn.1692e84442fe6cfd
2021-07-18T14:19:41.6465875Z 3m5s Normal Pulling pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Pulling image "quay.io/bitnami/nginx:latest" 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6g9jn.1692e8446e47409d
2021-07-18T14:19:41.6469408Z 3m5s Normal Pulled pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Successfully pulled image "quay.io/bitnami/nginx:latest" in 388.609299ms 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6g9jn.1692e84485712d28
2021-07-18T14:19:41.6473287Z 3m5s Normal Created pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Created container nginx-demo 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6g9jn.1692e84486db157b
2021-07-18T14:19:41.6476840Z 3m5s Normal Started pod/nginx-demo-b8f8b4fc6-6g9jn spec.containers{nginx-demo} kubelet, cluster1-worker2 Started container nginx-demo 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-6g9jn.1692e8448dbc2796
2021-07-18T14:19:41.6480298Z 3m6s Normal Scheduled pod/nginx-demo-b8f8b4fc6-h54lx default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-h54lx to cluster1-worker 3m6s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h54lx.1692e8443ee28ede
2021-07-18T14:19:41.6483891Z 3m6s Normal Pulling pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 3m6s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h54lx.1692e8446b6cacb3
2021-07-18T14:19:41.6487659Z 3m5s Normal Pulled pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 367.022644ms 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h54lx.1692e844814d3598
2021-07-18T14:19:41.6491122Z 3m5s Normal Created pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h54lx.1692e84482e5a9a1
2021-07-18T14:19:41.6494612Z 3m5s Normal Started pod/nginx-demo-b8f8b4fc6-h54lx spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 3m5s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h54lx.1692e84489e6bf1b
2021-07-18T14:19:41.6498410Z 6m8s Normal Scheduled pod/nginx-demo-b8f8b4fc6-h9cxc default-scheduler Successfully assigned default/nginx-demo-b8f8b4fc6-h9cxc to cluster1-worker 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e819d505fdf2
2021-07-18T14:19:41.6502102Z 6m8s Normal Pulling pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Pulling image "quay.io/bitnami/nginx:latest" 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e819fe6e6ea2
2021-07-18T14:19:41.6505758Z 6m2s Normal Pulled pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Successfully pulled image "quay.io/bitnami/nginx:latest" in 5.256578091s 6m2s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e81b37bfac3b
2021-07-18T14:19:41.6509293Z 6m1s Normal Created pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Created container nginx-demo 6m1s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e81b7522162c
2021-07-18T14:19:41.6514545Z 6m1s Normal Started pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Started container nginx-demo 6m1s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e81b7e8ae305
2021-07-18T14:19:41.6518095Z 5m59s Normal Killing pod/nginx-demo-b8f8b4fc6-h9cxc spec.containers{nginx-demo} kubelet, cluster1-worker Stopping container nginx-demo 5m59s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6-h9cxc.1692e81c231f8cbf
2021-07-18T14:19:41.6522051Z 6m8s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-h9cxc 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1692e819d15187a4
2021-07-18T14:19:41.6525679Z 6m8s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-684hs 6m8s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1692e819d35af74e
2021-07-18T14:19:41.6529137Z 3m6s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-h54lx 3m6s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1692e8443cf658e1
2021-07-18T14:19:41.6532357Z 3m6s Normal SuccessfulCreate replicaset/nginx-demo-b8f8b4fc6 replicaset-controller Created pod: nginx-demo-b8f8b4fc6-6g9jn 3m6s 1 event.events.k8s.io/nginx-demo-b8f8b4fc6.1692e844418170a5
2021-07-18T14:19:41.6536746Z 6m8s Warning OwnerRefInvalidNamespace endpointslice/nginx-demo-cluster1 garbage-collector-controller ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 3239b295-ad45-4d14-aa08-a2dc085b43ac] does not exist in namespace "default" 6m8s 1 event.events.k8s.io/nginx-demo-cluster1.1692e819e4df6f87
2021-07-18T14:19:41.6540938Z 6m9s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 6m9s 1 event.events.k8s.io/nginx-demo.1692e819ceac1949
2021-07-18T14:19:41.6544147Z 3m6s Normal ScalingReplicaSet deployment/nginx-demo deployment-controller Scaled up replica set nginx-demo-b8f8b4fc6 to 2 3m6s 1 event.events.k8s.io/nginx-demo.1692e8443a2c3596
2021-07-18T14:19:41.6547244Z 3m6s Warning FailedToCreateEndpoint endpoints/nginx-demo endpoint-controller Failed to create endpoint for service default/nginx-demo: endpoints "nginx-demo" already exists 3m6s 1 event.events.k8s.io/nginx-demo.1692e84441d31147
2021-07-18T14:19:41.6553236Z 3m48s Warning FailedToCreateEndpoint endpoints/submariner-lighthouse-coredns endpoint-controller Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints "submariner-lighthouse-coredns" already exists 3m48s 1 event.events.k8s.io/submariner-lighthouse-coredns.1692e83a9ee75d70
2021-07-18T14:19:41.9181037Z Warning: extensions/v1beta1 Ingress is deprecated in v1.14+, unavailable in v1.22+; use networking.k8s.io/v1 Ingress
2021-07-18T14:19:42.3393751Z NAME PRIORITYLEVEL MATCHINGPRECEDENCE DISTINGUISHERMETHOD AGE MISSINGPL
2021-07-18T14:19:42.3412209Z flowschema.flowcontrol.apiserver.k8s.io/exempt exempt 1 <none> 12m False
2021-07-18T14:19:42.3416367Z flowschema.flowcontrol.apiserver.k8s.io/probes exempt 2 <none> 12m False
2021-07-18T14:19:42.3423438Z flowschema.flowcontrol.apiserver.k8s.io/system-leader-election leader-election 100 ByUser 12m False
2021-07-18T14:19:42.3448847Z flowschema.flowcontrol.apiserver.k8s.io/workload-leader-election leader-election 200 ByUser 12m False
2021-07-18T14:19:42.3454774Z flowschema.flowcontrol.apiserver.k8s.io/system-nodes system 500 ByUser 12m False
2021-07-18T14:19:42.3463684Z flowschema.flowcontrol.apiserver.k8s.io/kube-controller-manager workload-high 800 ByNamespace 12m False
2021-07-18T14:19:42.3465972Z flowschema.flowcontrol.apiserver.k8s.io/kube-scheduler workload-high 800 ByNamespace 12m False
2021-07-18T14:19:42.3468221Z flowschema.flowcontrol.apiserver.k8s.io/kube-system-service-accounts workload-high 900 ByNamespace 12m False
2021-07-18T14:19:42.3470572Z flowschema.flowcontrol.apiserver.k8s.io/service-accounts workload-low 9000 ByUser 12m False
2021-07-18T14:19:42.3472663Z flowschema.flowcontrol.apiserver.k8s.io/global-default global-default 9900 ByUser 12m False
2021-07-18T14:19:42.3474686Z flowschema.flowcontrol.apiserver.k8s.io/catch-all catch-all 10000 ByUser 12m False
2021-07-18T14:19:42.7714190Z NAME TYPE ASSUREDCONCURRENCYSHARES QUEUES HANDSIZE QUEUELENGTHLIMIT AGE
2021-07-18T14:19:42.7720321Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/catch-all Limited 5 <none> <none> <none> 12m
2021-07-18T14:19:42.7726527Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/exempt Exempt <none> <none> <none> <none> 12m
2021-07-18T14:19:42.7736632Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/global-default Limited 20 128 6 50 12m
2021-07-18T14:19:42.7750437Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/leader-election Limited 10 16 4 50 12m
2021-07-18T14:19:42.7768908Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/system Limited 30 64 6 50 12m
2021-07-18T14:19:42.7771541Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-high Limited 40 128 6 50 12m
2021-07-18T14:19:42.7774355Z prioritylevelconfiguration.flowcontrol.apiserver.k8s.io/workload-low Limited 100 128 6 50 12m
2021-07-18T14:19:43.1835191Z NAME AGE
2021-07-18T14:19:43.1837661Z serviceexport.multicluster.x-k8s.io/nginx-demo 3m8s
2021-07-18T14:19:46.3371314Z NAME ROLE AGE USERS GROUPS SERVICEACCOUNTS
2021-07-18T14:19:46.3374102Z clusterrolebinding.rbac.authorization.k8s.io/cluster-admin ClusterRole/cluster-admin 12m system:masters
2021-07-18T14:19:46.3376799Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:get-nodes ClusterRole/kubeadm:get-nodes 12m system:bootstrappers:kubeadm:default-node-token
2021-07-18T14:19:46.3381878Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:kubelet-bootstrap ClusterRole/system:node-bootstrapper 12m system:bootstrappers:kubeadm:default-node-token
2021-07-18T14:19:46.3385672Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-bootstrap ClusterRole/system:certificates.k8s.io:certificatesigningrequests:nodeclient 12m system:bootstrappers:kubeadm:default-node-token
2021-07-18T14:19:46.3389256Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-autoapprove-certificate-rotation ClusterRole/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 12m system:nodes
2021-07-18T14:19:46.3392606Z clusterrolebinding.rbac.authorization.k8s.io/kubeadm:node-proxier ClusterRole/system:node-proxier 12m kube-system/kube-proxy
2021-07-18T14:19:46.3396096Z clusterrolebinding.rbac.authorization.k8s.io/local-path-provisioner-bind ClusterRole/local-path-provisioner-role 12m local-path-storage/local-path-provisioner-service-account
2021-07-18T14:19:46.3401023Z clusterrolebinding.rbac.authorization.k8s.io/submariner-gateway ClusterRole/submariner-gateway 7m42s submariner-operator/submariner-gateway
2021-07-18T14:19:46.3404494Z clusterrolebinding.rbac.authorization.k8s.io/submariner-globalnet ClusterRole/submariner-globalnet 7m41s submariner-operator/submariner-globalnet
2021-07-18T14:19:46.3409340Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-agent ClusterRole/submariner-lighthouse-agent 7m41s submariner-operator/submariner-lighthouse-agent
2021-07-18T14:19:46.3414138Z clusterrolebinding.rbac.authorization.k8s.io/submariner-lighthouse-coredns ClusterRole/submariner-lighthouse-coredns 7m41s submariner-operator/submariner-lighthouse-coredns
2021-07-18T14:19:46.3420889Z clusterrolebinding.rbac.authorization.k8s.io/submariner-networkplugin-syncer ClusterRole/submariner-networkplugin-syncer 7m41s submariner-operator/submariner-networkplugin-syncer
2021-07-18T14:19:46.3425224Z clusterrolebinding.rbac.authorization.k8s.io/submariner-operator ClusterRole/submariner-operator 7m42s submariner-operator/submariner-operator
2021-07-18T14:19:46.3428220Z clusterrolebinding.rbac.authorization.k8s.io/submariner-routeagent ClusterRole/submariner-routeagent 7m41s submariner-operator/submariner-routeagent
2021-07-18T14:19:46.3431670Z clusterrolebinding.rbac.authorization.k8s.io/system:basic-user ClusterRole/system:basic-user 12m system:authenticated
2021-07-18T14:19:46.3434810Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:attachdetach-controller ClusterRole/system:controller:attachdetach-controller 12m kube-system/attachdetach-controller
2021-07-18T14:19:46.3438304Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:certificate-controller ClusterRole/system:controller:certificate-controller 12m kube-system/certificate-controller
2021-07-18T14:19:46.3442801Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller ClusterRole/system:controller:clusterrole-aggregation-controller 12m kube-system/clusterrole-aggregation-controller
2021-07-18T14:19:46.3446900Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:cronjob-controller ClusterRole/system:controller:cronjob-controller 12m kube-system/cronjob-controller
2021-07-18T14:19:46.3450126Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:daemon-set-controller ClusterRole/system:controller:daemon-set-controller 12m kube-system/daemon-set-controller
2021-07-18T14:19:46.3453704Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:deployment-controller ClusterRole/system:controller:deployment-controller 12m kube-system/deployment-controller
2021-07-18T14:19:46.3457158Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:disruption-controller ClusterRole/system:controller:disruption-controller 12m kube-system/disruption-controller
2021-07-18T14:19:46.3460246Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpoint-controller ClusterRole/system:controller:endpoint-controller 12m kube-system/endpoint-controller
2021-07-18T14:19:46.3464010Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslice-controller ClusterRole/system:controller:endpointslice-controller 12m kube-system/endpointslice-controller
2021-07-18T14:19:46.3469234Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:endpointslicemirroring-controller ClusterRole/system:controller:endpointslicemirroring-controller 12m kube-system/endpointslicemirroring-controller
2021-07-18T14:19:46.3473155Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:expand-controller ClusterRole/system:controller:expand-controller 12m kube-system/expand-controller
2021-07-18T14:19:46.3477216Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:generic-garbage-collector ClusterRole/system:controller:generic-garbage-collector 12m kube-system/generic-garbage-collector
2021-07-18T14:19:46.3482419Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler ClusterRole/system:controller:horizontal-pod-autoscaler 12m kube-system/horizontal-pod-autoscaler
2021-07-18T14:19:46.3485883Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:job-controller ClusterRole/system:controller:job-controller 12m kube-system/job-controller
2021-07-18T14:19:46.3488905Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:namespace-controller ClusterRole/system:controller:namespace-controller 12m kube-system/namespace-controller
2021-07-18T14:19:46.3492345Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:node-controller ClusterRole/system:controller:node-controller 12m kube-system/node-controller
2021-07-18T14:19:46.3495823Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:persistent-volume-binder ClusterRole/system:controller:persistent-volume-binder 12m kube-system/persistent-volume-binder
2021-07-18T14:19:46.3498871Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pod-garbage-collector ClusterRole/system:controller:pod-garbage-collector 12m kube-system/pod-garbage-collector
2021-07-18T14:19:46.3502441Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pv-protection-controller ClusterRole/system:controller:pv-protection-controller 12m kube-system/pv-protection-controller
2021-07-18T14:19:46.3506135Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:pvc-protection-controller ClusterRole/system:controller:pvc-protection-controller 12m kube-system/pvc-protection-controller
2021-07-18T14:19:46.3509199Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replicaset-controller ClusterRole/system:controller:replicaset-controller 12m kube-system/replicaset-controller
2021-07-18T14:19:46.3513070Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:replication-controller ClusterRole/system:controller:replication-controller 12m kube-system/replication-controller
2021-07-18T14:19:46.3517119Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:resourcequota-controller ClusterRole/system:controller:resourcequota-controller 12m kube-system/resourcequota-controller
2021-07-18T14:19:46.3520520Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:root-ca-cert-publisher ClusterRole/system:controller:root-ca-cert-publisher 12m kube-system/root-ca-cert-publisher
2021-07-18T14:19:46.3524033Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:route-controller ClusterRole/system:controller:route-controller 12m kube-system/route-controller
2021-07-18T14:19:46.3527647Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-account-controller ClusterRole/system:controller:service-account-controller 12m kube-system/service-account-controller
2021-07-18T14:19:46.3531202Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:service-controller ClusterRole/system:controller:service-controller 12m kube-system/service-controller
2021-07-18T14:19:46.3534646Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:statefulset-controller ClusterRole/system:controller:statefulset-controller 12m kube-system/statefulset-controller
2021-07-18T14:19:46.3538030Z clusterrolebinding.rbac.authorization.k8s.io/system:controller:ttl-controller ClusterRole/system:controller:ttl-controller 12m kube-system/ttl-controller
2021-07-18T14:19:46.3540387Z clusterrolebinding.rbac.authorization.k8s.io/system:coredns ClusterRole/system:coredns 12m kube-system/coredns
2021-07-18T14:19:46.3542724Z clusterrolebinding.rbac.authorization.k8s.io/system:discovery ClusterRole/system:discovery 12m system:authenticated
2021-07-18T14:19:46.3547160Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-controller-manager ClusterRole/system:kube-controller-manager 12m system:kube-controller-manager
2021-07-18T14:19:46.3549933Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-dns ClusterRole/system:kube-dns 12m kube-system/kube-dns
2021-07-18T14:19:46.3552623Z clusterrolebinding.rbac.authorization.k8s.io/system:kube-scheduler ClusterRole/system:kube-scheduler 12m system:kube-scheduler
2021-07-18T14:19:46.3562697Z clusterrolebinding.rbac.authorization.k8s.io/system:monitoring ClusterRole/system:monitoring 12m system:monitoring
2021-07-18T14:19:46.3565124Z clusterrolebinding.rbac.authorization.k8s.io/system:node ClusterRole/system:node 12m
2021-07-18T14:19:46.3568166Z clusterrolebinding.rbac.authorization.k8s.io/system:node-proxier ClusterRole/system:node-proxier 12m system:kube-proxy
2021-07-18T14:19:46.3571034Z clusterrolebinding.rbac.authorization.k8s.io/system:public-info-viewer ClusterRole/system:public-info-viewer 12m system:authenticated, system:unauthenticated
2021-07-18T14:19:46.3575343Z clusterrolebinding.rbac.authorization.k8s.io/system:service-account-issuer-discovery ClusterRole/system:service-account-issuer-discovery 12m system:serviceaccounts
2021-07-18T14:19:46.3578153Z clusterrolebinding.rbac.authorization.k8s.io/system:volume-scheduler ClusterRole/system:volume-scheduler 12m system:kube-scheduler
2021-07-18T14:19:46.3581401Z clusterrolebinding.rbac.authorization.k8s.io/weave-net ClusterRole/weave-net 12m kube-system/weave-net
2021-07-18T14:19:46.7498565Z NAME CREATED AT
2021-07-18T14:19:46.7502644Z clusterrole.rbac.authorization.k8s.io/admin 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7506260Z clusterrole.rbac.authorization.k8s.io/cluster-admin 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7509944Z clusterrole.rbac.authorization.k8s.io/edit 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7512865Z clusterrole.rbac.authorization.k8s.io/kubeadm:get-nodes 2021-07-18T14:07:03Z
2021-07-18T14:19:46.7517025Z clusterrole.rbac.authorization.k8s.io/local-path-provisioner-role 2021-07-18T14:07:06Z
2021-07-18T14:19:46.7522429Z clusterrole.rbac.authorization.k8s.io/submariner-gateway 2021-07-18T14:12:02Z
2021-07-18T14:19:46.7537875Z clusterrole.rbac.authorization.k8s.io/submariner-globalnet 2021-07-18T14:12:03Z
2021-07-18T14:19:46.7543742Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-agent 2021-07-18T14:12:05Z
2021-07-18T14:19:46.7577401Z clusterrole.rbac.authorization.k8s.io/submariner-lighthouse-coredns 2021-07-18T14:12:05Z
2021-07-18T14:19:46.7579293Z clusterrole.rbac.authorization.k8s.io/submariner-networkplugin-syncer 2021-07-18T14:12:03Z
2021-07-18T14:19:46.7581338Z clusterrole.rbac.authorization.k8s.io/submariner-operator 2021-07-18T14:12:02Z
2021-07-18T14:19:46.7582840Z clusterrole.rbac.authorization.k8s.io/submariner-routeagent 2021-07-18T14:12:03Z
2021-07-18T14:19:46.7584753Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-admin 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7586452Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-edit 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7588263Z clusterrole.rbac.authorization.k8s.io/system:aggregate-to-view 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7590635Z clusterrole.rbac.authorization.k8s.io/system:auth-delegator 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7592281Z clusterrole.rbac.authorization.k8s.io/system:basic-user 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7594349Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:nodeclient 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7596599Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:certificatesigningrequests:selfnodeclient 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7599281Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kube-apiserver-client-approver 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7601759Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kube-apiserver-client-kubelet-approver 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7603866Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:kubelet-serving-approver 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7606042Z clusterrole.rbac.authorization.k8s.io/system:certificates.k8s.io:legacy-unknown-approver 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7608357Z clusterrole.rbac.authorization.k8s.io/system:controller:attachdetach-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7610329Z clusterrole.rbac.authorization.k8s.io/system:controller:certificate-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7612170Z clusterrole.rbac.authorization.k8s.io/system:controller:clusterrole-aggregation-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7614051Z clusterrole.rbac.authorization.k8s.io/system:controller:cronjob-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7615999Z clusterrole.rbac.authorization.k8s.io/system:controller:daemon-set-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7617997Z clusterrole.rbac.authorization.k8s.io/system:controller:deployment-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7619635Z clusterrole.rbac.authorization.k8s.io/system:controller:disruption-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7621398Z clusterrole.rbac.authorization.k8s.io/system:controller:endpoint-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7623146Z clusterrole.rbac.authorization.k8s.io/system:controller:endpointslice-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7625560Z clusterrole.rbac.authorization.k8s.io/system:controller:endpointslicemirroring-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7627659Z clusterrole.rbac.authorization.k8s.io/system:controller:expand-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7632563Z clusterrole.rbac.authorization.k8s.io/system:controller:generic-garbage-collector 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7635472Z clusterrole.rbac.authorization.k8s.io/system:controller:horizontal-pod-autoscaler 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7637595Z clusterrole.rbac.authorization.k8s.io/system:controller:job-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7639643Z clusterrole.rbac.authorization.k8s.io/system:controller:namespace-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7643978Z clusterrole.rbac.authorization.k8s.io/system:controller:node-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7646103Z clusterrole.rbac.authorization.k8s.io/system:controller:persistent-volume-binder 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7648113Z clusterrole.rbac.authorization.k8s.io/system:controller:pod-garbage-collector 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7650702Z clusterrole.rbac.authorization.k8s.io/system:controller:pv-protection-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7652717Z clusterrole.rbac.authorization.k8s.io/system:controller:pvc-protection-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7654725Z clusterrole.rbac.authorization.k8s.io/system:controller:replicaset-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7656596Z clusterrole.rbac.authorization.k8s.io/system:controller:replication-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7658590Z clusterrole.rbac.authorization.k8s.io/system:controller:resourcequota-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7661027Z clusterrole.rbac.authorization.k8s.io/system:controller:root-ca-cert-publisher 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7662731Z clusterrole.rbac.authorization.k8s.io/system:controller:route-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7664873Z clusterrole.rbac.authorization.k8s.io/system:controller:service-account-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7666756Z clusterrole.rbac.authorization.k8s.io/system:controller:service-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7668809Z clusterrole.rbac.authorization.k8s.io/system:controller:statefulset-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7670812Z clusterrole.rbac.authorization.k8s.io/system:controller:ttl-controller 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7672377Z clusterrole.rbac.authorization.k8s.io/system:coredns 2021-07-18T14:07:03Z
2021-07-18T14:19:46.7674046Z clusterrole.rbac.authorization.k8s.io/system:discovery 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7675809Z clusterrole.rbac.authorization.k8s.io/system:heapster 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7677681Z clusterrole.rbac.authorization.k8s.io/system:kube-aggregator 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7679314Z clusterrole.rbac.authorization.k8s.io/system:kube-controller-manager 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7680765Z clusterrole.rbac.authorization.k8s.io/system:kube-dns 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7682165Z clusterrole.rbac.authorization.k8s.io/system:kube-scheduler 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7683734Z clusterrole.rbac.authorization.k8s.io/system:kubelet-api-admin 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7685468Z clusterrole.rbac.authorization.k8s.io/system:monitoring 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7687203Z clusterrole.rbac.authorization.k8s.io/system:node 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7689007Z clusterrole.rbac.authorization.k8s.io/system:node-bootstrapper 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7690649Z clusterrole.rbac.authorization.k8s.io/system:node-problem-detector 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7692116Z clusterrole.rbac.authorization.k8s.io/system:node-proxier 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7693813Z clusterrole.rbac.authorization.k8s.io/system:persistent-volume-provisioner 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7695766Z clusterrole.rbac.authorization.k8s.io/system:public-info-viewer 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7697903Z clusterrole.rbac.authorization.k8s.io/system:service-account-issuer-discovery 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7699715Z clusterrole.rbac.authorization.k8s.io/system:volume-scheduler 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7701586Z clusterrole.rbac.authorization.k8s.io/view 2021-07-18T14:07:00Z
2021-07-18T14:19:46.7703170Z clusterrole.rbac.authorization.k8s.io/weave-net 2021-07-18T14:07:36Z
2021-07-18T14:19:48.0238412Z NAME VALUE GLOBAL-DEFAULT AGE
2021-07-18T14:19:48.0239810Z priorityclass.scheduling.k8s.io/system-cluster-critical 2000000000 false 12m
2021-07-18T14:19:48.0241317Z priorityclass.scheduling.k8s.io/system-node-critical 2000001000 false 12m
2021-07-18T14:19:48.8711894Z NAME DRIVERS AGE
2021-07-18T14:19:48.8713198Z csinode.storage.k8s.io/cluster1-control-plane 0 12m
2021-07-18T14:19:48.8714191Z csinode.storage.k8s.io/cluster1-worker 0 12m
2021-07-18T14:19:48.8715082Z csinode.storage.k8s.io/cluster1-worker2 0 12m
2021-07-18T14:19:49.2675247Z NAME PROVISIONER RECLAIMPOLICY VOLUMEBINDINGMODE ALLOWVOLUMEEXPANSION AGE
2021-07-18T14:19:49.2677587Z storageclass.storage.k8s.io/standard (default) rancher.io/local-path Delete WaitForFirstConsumer false 12m
2021-07-18T14:19:53.3697381Z [submariner-operator]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-18T14:19:53.3716986Z [submariner-operator]$ [cluster1] print_section * Details of pods with statuses other than Running in cluster1 *
2021-07-18T14:19:53.3717833Z ====================================================================
2021-07-18T14:19:53.3718589Z ##[endgroup]
2021-07-18T14:19:53.3719600Z ##[group]* Details of pods with statuses other than Running in cluster1 *
2021-07-18T14:19:53.3720373Z ======================= * Details of pods with statuses other than Running in cluster1 * =======================
2021-07-18T14:19:53.3737036Z [submariner-operator]$ [cluster1] kubectl get pods -A
2021-07-18T14:19:53.3759347Z [submariner-operator]$ [cluster1] tail -n +2
2021-07-18T14:19:53.3783671Z [submariner-operator]$ [cluster1] grep -v Running
2021-07-18T14:19:53.3789537Z [submariner-operator]$ [cluster1] kubectl get pods -A
2021-07-18T14:19:53.3802804Z [submariner-operator]$ [cluster1] sed s/ */;/g
2021-07-18T14:19:53.3818583Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -A
2021-07-18T14:19:53.6970060Z [submariner-operator]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-18T14:19:53.6982809Z [submariner-operator]$ [cluster1] print_section * Kube-proxy pod logs for cluster1 *
2021-07-18T14:19:53.6985751Z ====================================================================
2021-07-18T14:19:53.6991370Z ##[endgroup]
2021-07-18T14:19:53.7008847Z ##[group]* Kube-proxy pod logs for cluster1 *
2021-07-18T14:19:53.7012757Z [submariner-operator]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-18T14:19:53.7013950Z ======================= * Kube-proxy pod logs for cluster1 * =======================
2021-07-18T14:19:53.7021794Z [submariner-operator]$ [cluster1] print_pods_logs kube-system k8s-app=kube-proxy
2021-07-18T14:19:53.7035109Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-18T14:19:53.7047672Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-18T14:19:53.7054191Z ====================================================================
2021-07-18T14:19:53.7059034Z ##[endgroup]
2021-07-18T14:19:53.7064447Z ##[group]** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' **
2021-07-18T14:19:53.7070744Z ======================= ** Pods logs for NS kube-system using selector 'k8s-app=kube-proxy' ** =======================
2021-07-18T14:19:53.7088817Z [submariner-operator]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:53.7102873Z [submariner-operator]$ [cluster1] kubectl get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:53.7111659Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector=k8s-app=kube-proxy -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:54.0078790Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-ntb9g -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:54.0101427Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-ntb9g -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:54.0122066Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-ntb9g -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:54.3173518Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-ntb9g ***
2021-07-18T14:19:54.3182584Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-ntb9g ***
2021-07-18T14:19:54.3203483Z ====================================================================
2021-07-18T14:19:54.3206866Z ##[endgroup]
2021-07-18T14:19:54.3210277Z ##[group]*** kube-proxy-ntb9g ***
2021-07-18T14:19:54.3213153Z ======================= *** kube-proxy-ntb9g *** =======================
2021-07-18T14:19:54.3240887Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-ntb9g
2021-07-18T14:19:54.3266295Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-ntb9g
2021-07-18T14:19:54.3287571Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-ntb9g
2021-07-18T14:19:54.7126657Z I0718 14:07:20.129390 1 node.go:172] Successfully retrieved node IP: 172.18.0.8
2021-07-18T14:19:54.7128326Z I0718 14:07:20.129443 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.8), assume IPv4 operation
2021-07-18T14:19:54.7129318Z I0718 14:07:20.142470 1 server_others.go:185] Using iptables Proxier.
2021-07-18T14:19:54.7130114Z I0718 14:07:20.142553 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-18T14:19:54.7131601Z W0718 14:07:20.143582 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-18T14:19:54.7132600Z I0718 14:07:20.143887 1 server.go:650] Version: v1.20.7
2021-07-18T14:19:54.7134235Z I0718 14:07:20.144375 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-18T14:19:54.7135473Z I0718 14:07:20.144511 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-18T14:19:54.7136335Z I0718 14:07:20.144929 1 config.go:315] Starting service config controller
2021-07-18T14:19:54.7137117Z I0718 14:07:20.144946 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-18T14:19:54.7137941Z I0718 14:07:20.144962 1 config.go:224] Starting endpoint slice config controller
2021-07-18T14:19:54.7138890Z I0718 14:07:20.145026 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-18T14:19:54.7139844Z I0718 14:07:20.245076 1 shared_informer.go:247] Caches are synced for service config
2021-07-18T14:19:54.7140741Z I0718 14:07:20.245130 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-18T14:19:54.7142509Z W0718 14:13:33.434944 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7144400Z W0718 14:13:33.435197 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7146224Z W0718 14:13:40.727973 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7148148Z W0718 14:13:40.763182 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7150353Z W0718 14:13:41.039538 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7152199Z W0718 14:13:41.080910 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7154099Z W0718 14:13:42.798113 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7155911Z W0718 14:13:42.903766 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7157791Z W0718 14:16:35.654402 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7159541Z W0718 14:16:35.726074 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7161288Z W0718 14:16:37.083619 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7163032Z W0718 14:16:37.101832 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7164987Z W0718 14:16:37.480812 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7166901Z W0718 14:16:37.502101 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:54.7190555Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-smx7h -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:54.7201794Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-smx7h -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:54.7214501Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-smx7h -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:55.0078702Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-smx7h ***
2021-07-18T14:19:55.0091610Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-smx7h ***
2021-07-18T14:19:55.0095961Z ====================================================================
2021-07-18T14:19:55.0100389Z ##[endgroup]
2021-07-18T14:19:55.0104806Z ##[group]*** kube-proxy-smx7h ***
2021-07-18T14:19:55.0107382Z ======================= *** kube-proxy-smx7h *** =======================
2021-07-18T14:19:55.0119829Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-smx7h
2021-07-18T14:19:55.0131504Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-smx7h
2021-07-18T14:19:55.0146424Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-smx7h
2021-07-18T14:19:55.3565925Z I0718 14:07:32.290199 1 node.go:172] Successfully retrieved node IP: 172.18.0.9
2021-07-18T14:19:55.3567627Z I0718 14:07:32.290409 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.9), assume IPv4 operation
2021-07-18T14:19:55.3568496Z I0718 14:07:32.330559 1 server_others.go:185] Using iptables Proxier.
2021-07-18T14:19:55.3569300Z I0718 14:07:32.330586 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-18T14:19:55.3570818Z W0718 14:07:32.335232 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-18T14:19:55.3571853Z I0718 14:07:32.335552 1 server.go:650] Version: v1.20.7
2021-07-18T14:19:55.3573635Z I0718 14:07:32.339768 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-18T14:19:55.3575347Z I0718 14:07:32.339832 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-18T14:19:55.3576232Z I0718 14:07:32.340993 1 config.go:315] Starting service config controller
2021-07-18T14:19:55.3577012Z I0718 14:07:32.341828 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-18T14:19:55.3577831Z I0718 14:07:32.341923 1 config.go:224] Starting endpoint slice config controller
2021-07-18T14:19:55.3578780Z I0718 14:07:32.341934 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-18T14:19:55.3579622Z I0718 14:07:32.442060 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-18T14:19:55.3580411Z I0718 14:07:32.442122 1 shared_informer.go:247] Caches are synced for service config
2021-07-18T14:19:55.3581895Z W0718 14:13:33.364643 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3583871Z W0718 14:13:33.416267 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3585876Z W0718 14:13:40.722753 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3587966Z W0718 14:13:40.762079 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3590201Z W0718 14:13:41.039511 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3592099Z W0718 14:13:41.074998 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3594638Z W0718 14:13:42.794434 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3596477Z W0718 14:13:42.861966 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3598292Z W0718 14:16:35.625436 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3600367Z W0718 14:16:35.724200 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3602398Z W0718 14:16:37.082116 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3604422Z W0718 14:16:37.100956 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3606324Z W0718 14:16:37.477575 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3608370Z W0718 14:16:37.502299 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.3677580Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-tmw9z -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:55.3688832Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-proxy-tmw9z -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:55.3703313Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-proxy-tmw9z -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:55.6661546Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-tmw9z ***
2021-07-18T14:19:55.6672964Z [submariner-operator]$ [cluster1] print_section *** kube-proxy-tmw9z ***
2021-07-18T14:19:55.6675976Z ====================================================================
2021-07-18T14:19:55.6678406Z ##[endgroup]
2021-07-18T14:19:55.6685150Z ##[group]*** kube-proxy-tmw9z ***
2021-07-18T14:19:55.6686140Z ======================= *** kube-proxy-tmw9z *** =======================
2021-07-18T14:19:55.6695586Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-tmw9z
2021-07-18T14:19:55.6710545Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-proxy-tmw9z
2021-07-18T14:19:55.6727912Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-proxy-tmw9z
2021-07-18T14:19:55.9921427Z I0718 14:07:32.397887 1 node.go:172] Successfully retrieved node IP: 172.18.0.6
2021-07-18T14:19:55.9923042Z I0718 14:07:32.398197 1 server_others.go:142] kube-proxy node IP is an IPv4 address (172.18.0.6), assume IPv4 operation
2021-07-18T14:19:55.9923885Z I0718 14:07:32.421164 1 server_others.go:185] Using iptables Proxier.
2021-07-18T14:19:55.9924701Z I0718 14:07:32.421373 1 server_others.go:192] creating dualStackProxier for iptables.
2021-07-18T14:19:55.9926212Z W0718 14:07:32.422828 1 server_others.go:498] detect-local-mode set to ClusterCIDR, but no IPv6 cluster CIDR defined, , defaulting to no-op detect-local for IPv6
2021-07-18T14:19:55.9927231Z I0718 14:07:32.423263 1 server.go:650] Version: v1.20.7
2021-07-18T14:19:55.9928275Z I0718 14:07:32.424126 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_established' to 86400
2021-07-18T14:19:55.9929503Z I0718 14:07:32.426329 1 conntrack.go:100] Set sysctl 'net/netfilter/nf_conntrack_tcp_timeout_close_wait' to 3600
2021-07-18T14:19:55.9930587Z I0718 14:07:32.426866 1 config.go:315] Starting service config controller
2021-07-18T14:19:55.9931361Z I0718 14:07:32.427164 1 shared_informer.go:240] Waiting for caches to sync for service config
2021-07-18T14:19:55.9932484Z I0718 14:07:32.427328 1 config.go:224] Starting endpoint slice config controller
2021-07-18T14:19:55.9933342Z I0718 14:07:32.427471 1 shared_informer.go:240] Waiting for caches to sync for endpoint slice config
2021-07-18T14:19:55.9934180Z I0718 14:07:32.527410 1 shared_informer.go:247] Caches are synced for service config
2021-07-18T14:19:55.9935013Z I0718 14:07:32.527627 1 shared_informer.go:247] Caches are synced for endpoint slice config
2021-07-18T14:19:55.9936580Z W0718 14:13:33.355213 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9938567Z W0718 14:13:33.412255 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9940446Z W0718 14:13:40.722058 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9942280Z W0718 14:13:40.761770 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9944113Z W0718 14:13:41.042769 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9945923Z W0718 14:13:41.073466 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9947755Z W0718 14:13:42.793318 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9950161Z W0718 14:13:42.878472 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9952983Z W0718 14:16:35.630716 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9954956Z W0718 14:16:35.725573 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9957069Z W0718 14:16:37.081755 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9958902Z W0718 14:16:37.099305 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9960733Z W0718 14:16:37.501230 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:55.9962540Z W0718 14:16:37.501257 1 endpoints.go:214] Error getting endpoint slice cache keys: No kubernetes.io/service-name label set on endpoint slice: nginx-demo-cluster1
2021-07-18T14:19:56.0016629Z [submariner-operator]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-18T14:19:56.0029009Z [submariner-operator]$ [cluster1] print_section * Kube-controller-manager pod logs for cluster1 *
2021-07-18T14:19:56.0036045Z ====================================================================
2021-07-18T14:19:56.0040412Z ##[endgroup]
2021-07-18T14:19:56.0046072Z ##[group]* Kube-controller-manager pod logs for cluster1 *
2021-07-18T14:19:56.0051228Z ======================= * Kube-controller-manager pod logs for cluster1 * =======================
2021-07-18T14:19:56.0065244Z [submariner-operator]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-18T14:19:56.0078400Z [submariner-operator]$ [cluster1] print_pods_logs kube-system component=kube-controller-manager
2021-07-18T14:19:56.0095590Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-18T14:19:56.0108588Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-18T14:19:56.0117612Z ====================================================================
2021-07-18T14:19:56.0118313Z ##[endgroup]
2021-07-18T14:19:56.0119787Z ##[group]** Pods logs for NS kube-system using selector 'component=kube-controller-manager' **
2021-07-18T14:19:56.0121408Z ======================= ** Pods logs for NS kube-system using selector 'component=kube-controller-manager' ** =======================
2021-07-18T14:19:56.0143047Z [submariner-operator]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:56.0178091Z [submariner-operator]$ [cluster1] kubectl get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:56.0188290Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector=component=kube-controller-manager -n kube-system -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:56.3333168Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:56.3346860Z [submariner-operator]$ [cluster1] kubectl get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:56.3363029Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n kube-system kube-controller-manager-cluster1-control-plane -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:56.6181933Z [submariner-operator]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-18T14:19:56.6195423Z [submariner-operator]$ [cluster1] print_section *** kube-controller-manager-cluster1-control-plane ***
2021-07-18T14:19:56.6199268Z ====================================================================
2021-07-18T14:19:56.6203252Z ##[endgroup]
2021-07-18T14:19:56.6207863Z ##[group]*** kube-controller-manager-cluster1-control-plane ***
2021-07-18T14:19:56.6250936Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-18T14:19:56.6253059Z ======================= *** kube-controller-manager-cluster1-control-plane *** =======================
2021-07-18T14:19:56.6267653Z [submariner-operator]$ [cluster1] kubectl -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-18T14:19:56.6281178Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system logs kube-controller-manager-cluster1-control-plane
2021-07-18T14:19:56.9214545Z Flag --port has been deprecated, see --secure-port instead.
2021-07-18T14:19:56.9215612Z I0718 14:06:45.923202 1 serving.go:331] Generated self-signed cert in-memory
2021-07-18T14:19:56.9216354Z I0718 14:06:47.618506 1 controllermanager.go:176] Version: v1.20.7
2021-07-18T14:19:56.9218762Z I0718 14:06:47.620609 1 dynamic_cafile_content.go:167] Starting request-header::/etc/kubernetes/pki/front-proxy-ca.crt
2021-07-18T14:19:56.9220901Z I0718 14:06:47.620887 1 dynamic_cafile_content.go:167] Starting client-ca-bundle::/etc/kubernetes/pki/ca.crt
2021-07-18T14:19:56.9222022Z I0718 14:06:47.984422 1 secure_serving.go:197] Serving securely on 127.0.0.1:10257
2021-07-18T14:19:56.9223623Z I0718 14:06:47.984478 1 tlsconfig.go:240] Starting DynamicServingCertificateController
2021-07-18T14:19:56.9225643Z I0718 14:06:47.984642 1 leaderelection.go:243] attempting to acquire leader lease kube-system/kube-controller-manager...
2021-07-18T14:19:56.9228339Z E0718 14:06:57.985083 1 leaderelection.go:325] error retrieving resource lock kube-system/kube-controller-manager: Get "https://172.18.0.8:6443/apis/coordination.k8s.io/v1/namespaces/kube-system/leases/kube-controller-manager?timeout=10s": context deadline exceeded
2021-07-18T14:19:56.9231450Z I0718 14:07:01.100980 1 leaderelection.go:253] successfully acquired lease kube-system/kube-controller-manager
2021-07-18T14:19:56.9234451Z I0718 14:07:01.101371 1 event.go:291] "Event occurred" object="kube-system/kube-controller-manager" kind="Lease" apiVersion="coordination.k8s.io/v1" type="Normal" reason="LeaderElection" message="cluster1-control-plane_5bc87ae1-255d-40db-a208-27ff4e55403b became leader"
2021-07-18T14:19:56.9236197Z I0718 14:07:02.564831 1 shared_informer.go:240] Waiting for caches to sync for tokens
2021-07-18T14:19:56.9237325Z I0718 14:07:02.665168 1 shared_informer.go:247] Caches are synced for tokens
2021-07-18T14:19:56.9238388Z I0718 14:07:03.026329 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for events.events.k8s.io
2021-07-18T14:19:56.9239626Z I0718 14:07:03.027066 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceaccounts
2021-07-18T14:19:56.9241206Z I0718 14:07:03.027239 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for leases.coordination.k8s.io
2021-07-18T14:19:56.9242424Z I0718 14:07:03.027411 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for limitranges
2021-07-18T14:19:56.9243936Z I0718 14:07:03.027487 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for statefulsets.apps
2021-07-18T14:19:56.9245439Z I0718 14:07:03.028038 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for poddisruptionbudgets.policy
2021-07-18T14:19:56.9246930Z I0718 14:07:03.028078 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for jobs.batch
2021-07-18T14:19:56.9247967Z I0718 14:07:03.028102 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for cronjobs.batch
2021-07-18T14:19:56.9249338Z I0718 14:07:03.028121 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpointslices.discovery.k8s.io
2021-07-18T14:19:56.9250828Z I0718 14:07:03.028176 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpoints
2021-07-18T14:19:56.9252135Z I0718 14:07:03.028262 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for replicasets.apps
2021-07-18T14:19:56.9253667Z I0718 14:07:03.028292 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for deployments.apps
2021-07-18T14:19:56.9255090Z I0718 14:07:03.028366 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for roles.rbac.authorization.k8s.io
2021-07-18T14:19:56.9262691Z I0718 14:07:03.028426 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.networking.k8s.io
2021-07-18T14:19:56.9264029Z I0718 14:07:03.028457 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for daemonsets.apps
2021-07-18T14:19:56.9265291Z I0718 14:07:03.028474 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for controllerrevisions.apps
2021-07-18T14:19:56.9268717Z I0718 14:07:03.028520 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for rolebindings.rbac.authorization.k8s.io
2021-07-18T14:19:56.9290161Z I0718 14:07:03.028565 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for podtemplates
2021-07-18T14:19:56.9292114Z I0718 14:07:03.028636 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for horizontalpodautoscalers.autoscaling
2021-07-18T14:19:56.9299981Z I0718 14:07:03.028702 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for networkpolicies.networking.k8s.io
2021-07-18T14:19:56.9302486Z I0718 14:07:03.028773 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for ingresses.extensions
2021-07-18T14:19:56.9303549Z I0718 14:07:03.028797 1 controllermanager.go:554] Started "resourcequota"
2021-07-18T14:19:56.9305210Z W0718 14:07:03.028813 1 core.go:246] configure-cloud-routes is set, but no cloud provider specified. Will not configure cloud provider routes.
2021-07-18T14:19:56.9306218Z W0718 14:07:03.028818 1 controllermanager.go:546] Skipping "route"
2021-07-18T14:19:56.9307337Z I0718 14:07:03.028880 1 resource_quota_controller.go:273] Starting resource quota controller
2021-07-18T14:19:56.9308190Z I0718 14:07:03.028894 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-18T14:19:56.9308930Z I0718 14:07:03.028916 1 resource_quota_monitor.go:304] QuotaMonitor running
2021-07-18T14:19:56.9310433Z I0718 14:07:03.054425 1 controllermanager.go:554] Started "clusterrole-aggregation"
2021-07-18T14:19:56.9311906Z I0718 14:07:03.054474 1 clusterroleaggregation_controller.go:149] Starting ClusterRoleAggregator
2021-07-18T14:19:56.9313045Z I0718 14:07:03.054814 1 shared_informer.go:240] Waiting for caches to sync for ClusterRoleAggregator
2021-07-18T14:19:56.9314382Z I0718 14:07:03.066148 1 controllermanager.go:554] Started "pvc-protection"
2021-07-18T14:19:56.9315466Z W0718 14:07:03.066170 1 controllermanager.go:546] Skipping "ephemeral-volume"
2021-07-18T14:19:56.9316414Z I0718 14:07:03.066360 1 pvc_protection_controller.go:110] Starting PVC protection controller
2021-07-18T14:19:56.9317475Z I0718 14:07:03.066374 1 shared_informer.go:240] Waiting for caches to sync for PVC protection
2021-07-18T14:19:56.9318285Z I0718 14:07:03.083256 1 controllermanager.go:554] Started "job"
2021-07-18T14:19:56.9319014Z I0718 14:07:03.083426 1 job_controller.go:148] Starting job controller
2021-07-18T14:19:56.9319747Z I0718 14:07:03.083441 1 shared_informer.go:240] Waiting for caches to sync for job
2021-07-18T14:19:56.9320804Z I0718 14:07:03.094350 1 controllermanager.go:554] Started "disruption"
2021-07-18T14:19:56.9321600Z I0718 14:07:03.094519 1 disruption.go:331] Starting disruption controller
2021-07-18T14:19:56.9322402Z I0718 14:07:03.094533 1 shared_informer.go:240] Waiting for caches to sync for disruption
2021-07-18T14:19:56.9323234Z I0718 14:07:03.105622 1 controllermanager.go:554] Started "tokencleaner"
2021-07-18T14:19:56.9324299Z I0718 14:07:03.105785 1 tokencleaner.go:118] Starting token cleaner controller
2021-07-18T14:19:56.9325066Z I0718 14:07:03.105800 1 shared_informer.go:240] Waiting for caches to sync for token_cleaner
2021-07-18T14:19:56.9325826Z I0718 14:07:03.105807 1 shared_informer.go:247] Caches are synced for token_cleaner
2021-07-18T14:19:56.9326568Z I0718 14:07:03.121710 1 node_ipam_controller.go:91] Sending events to api server.
2021-07-18T14:19:56.9327606Z I0718 14:07:04.174642 1 request.go:655] Throttling request took 1.048089994s, request: GET:https://172.18.0.8:6443/apis/authentication.k8s.io/v1?timeout=32s
2021-07-18T14:19:56.9328617Z I0718 14:07:13.143541 1 range_allocator.go:82] Sending events to api server.
2021-07-18T14:19:56.9329548Z I0718 14:07:13.143899 1 range_allocator.go:116] No Secondary Service CIDR provided. Skipping filtering out secondary service addresses.
2021-07-18T14:19:56.9330625Z I0718 14:07:13.143934 1 controllermanager.go:554] Started "nodeipam"
2021-07-18T14:19:56.9331541Z I0718 14:07:13.144075 1 node_ipam_controller.go:159] Starting ipam controller
2021-07-18T14:19:56.9332449Z I0718 14:07:13.144180 1 shared_informer.go:240] Waiting for caches to sync for node
2021-07-18T14:19:56.9333279Z I0718 14:07:13.149082 1 controllermanager.go:554] Started "endpointslice"
2021-07-18T14:19:56.9334368Z I0718 14:07:13.149480 1 endpointslice_controller.go:237] Starting endpoint slice controller
2021-07-18T14:19:56.9335246Z I0718 14:07:13.149494 1 shared_informer.go:240] Waiting for caches to sync for endpoint_slice
2021-07-18T14:19:56.9336042Z I0718 14:07:13.159526 1 controllermanager.go:554] Started "replicaset"
2021-07-18T14:19:56.9336817Z I0718 14:07:13.159649 1 replica_set.go:182] Starting replicaset controller
2021-07-18T14:19:56.9337688Z I0718 14:07:13.159667 1 shared_informer.go:240] Waiting for caches to sync for ReplicaSet
2021-07-18T14:19:56.9338457Z I0718 14:07:13.167664 1 controllermanager.go:554] Started "csrcleaner"
2021-07-18T14:19:56.9339260Z I0718 14:07:13.167799 1 cleaner.go:82] Starting CSR cleaner controller
2021-07-18T14:19:56.9340340Z I0718 14:07:13.178489 1 controllermanager.go:554] Started "root-ca-cert-publisher"
2021-07-18T14:19:56.9341627Z I0718 14:07:13.178732 1 publisher.go:98] Starting root CA certificate configmap publisher
2021-07-18T14:19:56.9342492Z I0718 14:07:13.178878 1 shared_informer.go:240] Waiting for caches to sync for crt configmap
2021-07-18T14:19:56.9343304Z I0718 14:07:13.185261 1 controllermanager.go:554] Started "endpoint"
2021-07-18T14:19:56.9344142Z I0718 14:07:13.185548 1 endpoints_controller.go:184] Starting endpoint controller
2021-07-18T14:19:56.9345055Z I0718 14:07:13.185673 1 shared_informer.go:240] Waiting for caches to sync for endpoint
2021-07-18T14:19:56.9345810Z I0718 14:07:13.198008 1 controllermanager.go:554] Started "daemonset"
2021-07-18T14:19:56.9346557Z I0718 14:07:13.198850 1 daemon_controller.go:285] Starting daemon sets controller
2021-07-18T14:19:56.9347327Z I0718 14:07:13.198868 1 shared_informer.go:240] Waiting for caches to sync for daemon sets
2021-07-18T14:19:56.9348101Z I0718 14:07:13.211033 1 controllermanager.go:554] Started "statefulset"
2021-07-18T14:19:56.9348833Z I0718 14:07:13.211621 1 stateful_set.go:146] Starting stateful set controller
2021-07-18T14:19:56.9349564Z I0718 14:07:13.215111 1 shared_informer.go:240] Waiting for caches to sync for stateful set
2021-07-18T14:19:56.9385869Z I0718 14:07:13.215676 1 node_lifecycle_controller.go:77] Sending events to api server
2021-07-18T14:19:56.9386762Z E0718 14:07:13.215709 1 core.go:232] failed to start cloud node lifecycle controller: no cloud provider provided
2021-07-18T14:19:56.9388024Z W0718 14:07:13.215719 1 controllermanager.go:546] Skipping "cloud-node-lifecycle"
2021-07-18T14:19:56.9388913Z I0718 14:07:13.231582 1 controllermanager.go:554] Started "deployment"
2021-07-18T14:19:56.9389884Z I0718 14:07:13.231903 1 deployment_controller.go:153] Starting deployment controller
2021-07-18T14:19:56.9390826Z I0718 14:07:13.232047 1 shared_informer.go:240] Waiting for caches to sync for deployment
2021-07-18T14:19:56.9391795Z I0718 14:07:13.235347 1 controllermanager.go:554] Started "csrapproving"
2021-07-18T14:19:56.9392756Z I0718 14:07:13.235501 1 certificate_controller.go:118] Starting certificate controller "csrapproving"
2021-07-18T14:19:56.9394350Z I0718 14:07:13.235564 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrapproving
2021-07-18T14:19:56.9395305Z I0718 14:07:13.246453 1 controllermanager.go:554] Started "bootstrapsigner"
2021-07-18T14:19:56.9396122Z I0718 14:07:13.246569 1 shared_informer.go:240] Waiting for caches to sync for bootstrap_signer
2021-07-18T14:19:56.9397134Z I0718 14:07:13.327485 1 controllermanager.go:554] Started "pv-protection"
2021-07-18T14:19:56.9397978Z I0718 14:07:13.327602 1 pv_protection_controller.go:83] Starting PV protection controller
2021-07-18T14:19:56.9399117Z I0718 14:07:13.327646 1 shared_informer.go:240] Waiting for caches to sync for PV protection
2021-07-18T14:19:56.9400028Z I0718 14:07:13.475463 1 controllermanager.go:554] Started "replicationcontroller"
2021-07-18T14:19:56.9401738Z I0718 14:07:13.475618 1 replica_set.go:182] Starting replicationcontroller controller
2021-07-18T14:19:56.9403645Z I0718 14:07:13.475633 1 shared_informer.go:240] Waiting for caches to sync for ReplicationController
2021-07-18T14:19:56.9404666Z I0718 14:07:13.625242 1 controllermanager.go:554] Started "podgc"
2021-07-18T14:19:56.9405472Z I0718 14:07:13.625544 1 gc_controller.go:89] Starting GC controller
2021-07-18T14:19:56.9406142Z I0718 14:07:13.625722 1 shared_informer.go:240] Waiting for caches to sync for GC
2021-07-18T14:19:56.9406933Z I0718 14:07:13.825644 1 controllermanager.go:554] Started "garbagecollector"
2021-07-18T14:19:56.9407928Z I0718 14:07:13.825950 1 garbagecollector.go:142] Starting garbage collector controller
2021-07-18T14:19:56.9408804Z I0718 14:07:13.825966 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-18T14:19:56.9409543Z I0718 14:07:13.826009 1 graph_builder.go:289] GraphBuilder running
2021-07-18T14:19:56.9410589Z E0718 14:07:14.075754 1 core.go:92] Failed to start service controller: WARNING: no cloud provider provided, services of type LoadBalancer will fail
2021-07-18T14:19:56.9411753Z W0718 14:07:14.075780 1 controllermanager.go:546] Skipping "service"
2021-07-18T14:19:56.9412542Z I0718 14:07:14.225041 1 controllermanager.go:554] Started "cronjob"
2021-07-18T14:19:56.9413318Z I0718 14:07:14.225236 1 cronjob_controller.go:96] Starting CronJob Manager
2021-07-18T14:19:56.9414936Z I0718 14:07:14.274629 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-serving"
2021-07-18T14:19:56.9416517Z I0718 14:07:14.274788 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-serving
2021-07-18T14:19:56.9418935Z I0718 14:07:14.274880 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-18T14:19:56.9420371Z I0718 14:07:14.275287 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kubelet-client"
2021-07-18T14:19:56.9422922Z I0718 14:07:14.275411 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kubelet-client
2021-07-18T14:19:56.9425117Z I0718 14:07:14.275492 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-18T14:19:56.9427016Z I0718 14:07:14.275789 1 certificate_controller.go:118] Starting certificate controller "csrsigning-kube-apiserver-client"
2021-07-18T14:19:56.9428992Z I0718 14:07:14.275868 1 certificate_controller.go:118] Starting certificate controller "csrsigning-legacy-unknown"
2021-07-18T14:19:56.9431237Z I0718 14:07:14.275897 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-legacy-unknown
2021-07-18T14:19:56.9433705Z I0718 14:07:14.275916 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-18T14:19:56.9435809Z I0718 14:07:14.275885 1 shared_informer.go:240] Waiting for caches to sync for certificate-csrsigning-kube-apiserver-client
2021-07-18T14:19:56.9437735Z I0718 14:07:14.276038 1 dynamic_serving_content.go:130] Starting csr-controller::/etc/kubernetes/pki/ca.crt::/etc/kubernetes/pki/ca.key
2021-07-18T14:19:56.9438845Z I0718 14:07:14.275828 1 controllermanager.go:554] Started "csrsigning"
2021-07-18T14:19:56.9439627Z I0718 14:07:14.374652 1 node_lifecycle_controller.go:380] Sending events to api server.
2021-07-18T14:19:56.9440372Z I0718 14:07:14.374791 1 taint_manager.go:163] Sending events to api server.
2021-07-18T14:19:56.9441488Z I0718 14:07:14.374864 1 node_lifecycle_controller.go:508] Controller will reconcile labels.
2021-07-18T14:19:56.9442537Z I0718 14:07:14.374907 1 controllermanager.go:554] Started "nodelifecycle"
2021-07-18T14:19:56.9443398Z I0718 14:07:14.375000 1 node_lifecycle_controller.go:542] Starting node controller
2021-07-18T14:19:56.9444606Z I0718 14:07:14.375011 1 shared_informer.go:240] Waiting for caches to sync for taint
2021-07-18T14:19:56.9446261Z I0718 14:07:14.579493 1 controllermanager.go:554] Started "persistentvolume-binder"
2021-07-18T14:19:56.9447249Z I0718 14:07:14.579572 1 pv_controller_base.go:307] Starting persistent volume controller
2021-07-18T14:19:56.9448132Z I0718 14:07:14.579603 1 shared_informer.go:240] Waiting for caches to sync for persistent volume
2021-07-18T14:19:56.9449118Z I0718 14:07:14.725639 1 controllermanager.go:554] Started "endpointslicemirroring"
2021-07-18T14:19:56.9450551Z I0718 14:07:14.725755 1 endpointslicemirroring_controller.go:211] Starting EndpointSliceMirroring controller
2021-07-18T14:19:56.9451849Z I0718 14:07:14.725814 1 shared_informer.go:240] Waiting for caches to sync for endpoint_slice_mirroring
2021-07-18T14:19:56.9452843Z I0718 14:07:14.988250 1 controllermanager.go:554] Started "namespace"
2021-07-18T14:19:56.9453683Z I0718 14:07:14.988448 1 namespace_controller.go:200] Starting namespace controller
2021-07-18T14:19:56.9454640Z I0718 14:07:14.988466 1 shared_informer.go:240] Waiting for caches to sync for namespace
2021-07-18T14:19:56.9455624Z I0718 14:07:15.125640 1 controllermanager.go:554] Started "serviceaccount"
2021-07-18T14:19:56.9456494Z I0718 14:07:15.125708 1 serviceaccounts_controller.go:117] Starting service account controller
2021-07-18T14:19:56.9457400Z I0718 14:07:15.126106 1 shared_informer.go:240] Waiting for caches to sync for service account
2021-07-18T14:19:56.9458312Z I0718 14:07:15.424338 1 controllermanager.go:554] Started "horizontalpodautoscaling"
2021-07-18T14:19:56.9459178Z I0718 14:07:15.424512 1 horizontal.go:169] Starting HPA controller
2021-07-18T14:19:56.9459864Z I0718 14:07:15.424733 1 shared_informer.go:240] Waiting for caches to sync for HPA
2021-07-18T14:19:56.9460732Z I0718 14:07:15.576044 1 controllermanager.go:554] Started "attachdetach"
2021-07-18T14:19:56.9462900Z I0718 14:07:15.576140 1 attach_detach_controller.go:328] Starting attach detach controller
2021-07-18T14:19:56.9463744Z I0718 14:07:15.576167 1 shared_informer.go:240] Waiting for caches to sync for attach detach
2021-07-18T14:19:56.9465512Z I0718 14:07:15.725751 1 controllermanager.go:554] Started "persistentvolume-expander"
2021-07-18T14:19:56.9466866Z W0718 14:07:15.725779 1 controllermanager.go:546] Skipping "ttl-after-finished"
2021-07-18T14:19:56.9467782Z I0718 14:07:15.725846 1 expand_controller.go:310] Starting expand controller
2021-07-18T14:19:56.9468668Z I0718 14:07:15.725862 1 shared_informer.go:240] Waiting for caches to sync for expand
2021-07-18T14:19:56.9469376Z I0718 14:07:15.885845 1 controllermanager.go:554] Started "ttl"
2021-07-18T14:19:56.9470239Z I0718 14:07:15.889377 1 ttl_controller.go:121] Starting TTL controller
2021-07-18T14:19:56.9471259Z I0718 14:07:15.889394 1 shared_informer.go:240] Waiting for caches to sync for TTL
2021-07-18T14:19:56.9472061Z I0718 14:07:15.952956 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-18T14:19:56.9472973Z I0718 14:07:15.956196 1 shared_informer.go:247] Caches are synced for ClusterRoleAggregator
2021-07-18T14:19:56.9474721Z I0718 14:07:15.975832 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-client
2021-07-18T14:19:56.9476346Z I0718 14:07:15.976797 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kubelet-serving
2021-07-18T14:19:56.9478099Z I0718 14:07:15.978304 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-kube-apiserver-client
2021-07-18T14:19:56.9480031Z I0718 14:07:15.980208 1 shared_informer.go:247] Caches are synced for crt configmap
2021-07-18T14:19:56.9481713Z I0718 14:07:15.981706 1 shared_informer.go:247] Caches are synced for certificate-csrsigning-legacy-unknown
2021-07-18T14:19:56.9483880Z W0718 14:07:15.987462 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-control-plane" does not exist
2021-07-18T14:19:56.9485383Z I0718 14:07:15.994639 1 shared_informer.go:247] Caches are synced for TTL
2021-07-18T14:19:56.9486296Z I0718 14:07:15.994702 1 shared_informer.go:247] Caches are synced for namespace
2021-07-18T14:19:56.9487042Z I0718 14:07:16.026665 1 shared_informer.go:247] Caches are synced for expand
2021-07-18T14:19:56.9487787Z I0718 14:07:16.028168 1 shared_informer.go:247] Caches are synced for PV protection
2021-07-18T14:19:56.9488704Z I0718 14:07:16.028534 1 shared_informer.go:247] Caches are synced for service account
2021-07-18T14:19:56.9490632Z I0718 14:07:16.035696 1 shared_informer.go:247] Caches are synced for certificate-csrapproving
2021-07-18T14:19:56.9492519Z E0718 14:07:16.038004 1 clusterroleaggregation_controller.go:181] edit failed with : Operation cannot be fulfilled on clusterroles.rbac.authorization.k8s.io "edit": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:56.9502123Z I0718 14:07:16.044332 1 shared_informer.go:247] Caches are synced for node
2021-07-18T14:19:56.9503159Z I0718 14:07:16.044357 1 range_allocator.go:172] Starting range CIDR allocator
2021-07-18T14:19:56.9503979Z I0718 14:07:16.044401 1 shared_informer.go:240] Waiting for caches to sync for cidrallocator
2021-07-18T14:19:56.9504904Z I0718 14:07:16.044413 1 shared_informer.go:247] Caches are synced for cidrallocator
2021-07-18T14:19:56.9505676Z I0718 14:07:16.048100 1 shared_informer.go:247] Caches are synced for bootstrap_signer
2021-07-18T14:19:56.9506951Z I0718 14:07:16.051819 1 range_allocator.go:373] Set node cluster1-control-plane PodCIDR to [10.1.0.0/24]
2021-07-18T14:19:56.9507786Z I0718 14:07:16.125902 1 shared_informer.go:247] Caches are synced for endpoint_slice_mirroring
2021-07-18T14:19:56.9508532Z I0718 14:07:16.149579 1 shared_informer.go:247] Caches are synced for endpoint_slice
2021-07-18T14:19:56.9509236Z I0718 14:07:16.153091 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-18T14:19:56.9510098Z I0718 14:07:16.159787 1 shared_informer.go:247] Caches are synced for ReplicaSet
2021-07-18T14:19:56.9511156Z I0718 14:07:16.167615 1 shared_informer.go:247] Caches are synced for PVC protection
2021-07-18T14:19:56.9512066Z I0718 14:07:16.180705 1 shared_informer.go:247] Caches are synced for ReplicationController
2021-07-18T14:19:56.9512974Z I0718 14:07:16.180952 1 shared_informer.go:247] Caches are synced for attach detach
2021-07-18T14:19:56.9514465Z I0718 14:07:16.181183 1 shared_informer.go:247] Caches are synced for persistent volume
2021-07-18T14:19:56.9515171Z I0718 14:07:16.181661 1 shared_informer.go:247] Caches are synced for taint
2021-07-18T14:19:56.9515912Z I0718 14:07:16.181926 1 node_lifecycle_controller.go:1429] Initializing eviction metric for zone:
2021-07-18T14:19:56.9517502Z W0718 14:07:16.182083 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-control-plane. Assuming now as a timestamp.
2021-07-18T14:19:56.9519190Z I0718 14:07:16.182264 1 node_lifecycle_controller.go:1195] Controller detected that all Nodes are not-Ready. Entering master disruption mode.
2021-07-18T14:19:56.9520400Z I0718 14:07:16.182637 1 taint_manager.go:187] Starting NoExecuteTaintManager
2021-07-18T14:19:56.9523068Z I0718 14:07:16.183286 1 event.go:291] "Event occurred" object="cluster1-control-plane" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller"
2021-07-18T14:19:56.9525460Z I0718 14:07:16.183909 1 shared_informer.go:247] Caches are synced for job
2021-07-18T14:19:56.9526102Z I0718 14:07:16.187200 1 shared_informer.go:247] Caches are synced for endpoint
2021-07-18T14:19:56.9527026Z I0718 14:07:16.194622 1 shared_informer.go:247] Caches are synced for disruption
2021-07-18T14:19:56.9527888Z I0718 14:07:16.194707 1 disruption.go:339] Sending events to api server.
2021-07-18T14:19:56.9528561Z I0718 14:07:16.198928 1 shared_informer.go:247] Caches are synced for daemon sets
2021-07-18T14:19:56.9529244Z I0718 14:07:16.215230 1 shared_informer.go:247] Caches are synced for stateful set
2021-07-18T14:19:56.9529888Z I0718 14:07:16.224954 1 shared_informer.go:247] Caches are synced for HPA
2021-07-18T14:19:56.9530730Z I0718 14:07:16.225918 1 shared_informer.go:247] Caches are synced for GC
2021-07-18T14:19:56.9531654Z I0718 14:07:16.229999 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-18T14:19:56.9532464Z I0718 14:07:16.232246 1 shared_informer.go:247] Caches are synced for deployment
2021-07-18T14:19:56.9533307Z I0718 14:07:16.410322 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-18T14:19:56.9534266Z I0718 14:07:16.610881 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-18T14:19:56.9535068Z I0718 14:07:16.626365 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-18T14:19:56.9536118Z I0718 14:07:16.626479 1 garbagecollector.go:151] Garbage collector: all resource monitors have synced. Proceeding to collect garbage
2021-07-18T14:19:56.9538556Z I0718 14:07:17.025975 1 event.go:291] "Event occurred" object="local-path-storage/local-path-provisioner" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set local-path-provisioner-547f784dff to 1"
2021-07-18T14:19:56.9541344Z I0718 14:07:17.282715 1 event.go:291] "Event occurred" object="kube-system/coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set coredns-74ff55c5b to 2"
2021-07-18T14:19:56.9543535Z I0718 14:07:17.420246 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-ntb9g"
2021-07-18T14:19:56.9546912Z I0718 14:07:17.498903 1 event.go:291] "Event occurred" object="local-path-storage/local-path-provisioner-547f784dff" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: local-path-provisioner-547f784dff-65c6q"
2021-07-18T14:19:56.9549520Z I0718 14:07:17.516797 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-2vs7z"
2021-07-18T14:19:56.9552506Z I0718 14:07:17.685653 1 event.go:291] "Event occurred" object="kube-system/coredns-74ff55c5b" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: coredns-74ff55c5b-42rl5"
2021-07-18T14:19:56.9558271Z W0718 14:07:27.279157 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker" does not exist
2021-07-18T14:19:56.9560127Z I0718 14:07:27.454691 1 range_allocator.go:373] Set node cluster1-worker PodCIDR to [10.1.1.0/24]
2021-07-18T14:19:56.9563201Z I0718 14:07:27.600793 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-smx7h"
2021-07-18T14:19:56.9566047Z W0718 14:07:27.647656 1 actual_state_of_world.go:534] Failed to update statusUpdateNeeded field in actual state of world: Failed to set statusUpdateNeeded to needed true, because nodeName="cluster1-worker2" does not exist
2021-07-18T14:19:56.9568090Z I0718 14:07:27.807371 1 range_allocator.go:373] Set node cluster1-worker2 PodCIDR to [10.1.2.0/24]
2021-07-18T14:19:56.9569568Z I0718 14:07:28.071274 1 event.go:291] "Event occurred" object="kube-system/kube-proxy" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: kube-proxy-tmw9z"
2021-07-18T14:19:56.9572148Z W0718 14:07:31.183084 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-worker. Assuming now as a timestamp.
2021-07-18T14:19:56.9573601Z W0718 14:07:31.183665 1 node_lifecycle_controller.go:1044] Missing timestamp for Node cluster1-worker2. Assuming now as a timestamp.
2021-07-18T14:19:56.9575640Z I0718 14:07:31.183296 1 event.go:291] "Event occurred" object="cluster1-worker" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-worker event: Registered Node cluster1-worker in Controller"
2021-07-18T14:19:56.9577817Z I0718 14:07:31.183980 1 event.go:291] "Event occurred" object="cluster1-worker2" kind="Node" apiVersion="v1" type="Normal" reason="RegisteredNode" message="Node cluster1-worker2 event: Registered Node cluster1-worker2 in Controller"
2021-07-18T14:19:56.9579809Z I0718 14:07:36.870191 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-j8vp9"
2021-07-18T14:19:56.9582220Z I0718 14:07:36.970361 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-tfzk7"
2021-07-18T14:19:56.9585094Z I0718 14:07:36.996612 1 event.go:291] "Event occurred" object="kube-system/weave-net" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: weave-net-dknmd"
2021-07-18T14:19:56.9720149Z E0718 14:07:37.271421 1 daemon_controller.go:320] kube-system/weave-net failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"weave-net", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"43a074d7-2408-41a2-b162-f050303b0c9f", ResourceVersion:"554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214056, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"weave-net"}, Annotations:map[string]string{"cloud.weave.works/launcher-info":"{\n \"original-request\": {\n \"url\": \"/k8s/v1.16/net.yaml?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16\",\n \"date\": \"Sun Jul 18 2021 14:07:36 GMT+0000 (UTC)\"\n },\n \"email-address\": \"[email protected]\"\n}", "deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{\"cloud.weave.works/launcher-info\":\"{\\n \\\"original-request\\\": {\\n \\\"url\\\": \\\"/k8s/v1.16/net.yaml?k8s-version=v1.20.7\\u0026env.IPALLOC_RANGE=10.1.0.0/16\\\",\\n \\\"date\\\": \\\"Sun Jul 18 2021 14:07:36 GMT+0000 (UTC)\\\"\\n },\\n \\\"email-address\\\": \\\"[email protected]\\\"\\n}\"},\"labels\":{\"name\":\"weave-net\"},\"name\":\"weave-net\",\"namespace\":\"kube-system\"},\"spec\":{\"minReadySeconds\":5,\"selector\":{\"matchLabels\":{\"name\":\"weave-net\"}},\"template\":{\"metadata\":{\"labels\":{\"name\":\"weave-net\"}},\"spec\":{\"containers\":[{\"command\":[\"/home/weave/launch.sh\"],\"env\":[{\"name\":\"HOSTNAME\",\"valueFrom\":{\"fieldRef\":{\"apiVersion\":\"v1\",\"fieldPath\":\"spec.nodeName\"}}},{\"name\":\"IPALLOC_RANGE\",\"value\":\"10.1.0.0/16\"},{\"name\":\"INIT_CONTAINER\",\"value\":\"true\"}],\"image\":\"docker.io/weaveworks/weave-kube:2.8.1\",\"name\":\"weave\",\"readinessProbe\":{\"httpGet\":{\"host\":\"127.0.0.1\",\"path\":\"/status\",\"port\":6784}},\"resources\":{\"requests\":{\"cpu\":\"50m\",\"memory\":\"100Mi\"}},\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/weavedb\",\"name\":\"weavedb\"},{\"mountPath\":\"/host/var/lib/dbus\",\"name\":\"dbus\"},{\"mountPath\":\"/host/etc/machine-id\",\"name\":\"machine-id\",\"readOnly\":true},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]},{\"env\":[{\"name\":\"HOSTNAME\",\"valueFrom\":{\"fieldRef\":{\"apiVersion\":\"v1\",\"fieldPath\":\"spec.nodeName\"}}}],\"image\":\"docker.io/weaveworks/weave-npc:2.8.1\",\"name\":\"weave-npc\",\"resources\":{\"requests\":{\"cpu\":\"50m\",\"memory\":\"100Mi\"}},\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]}],\"dnsPolicy\":\"ClusterFirstWithHostNet\",\"hostNetwork\":true,\"initContainers\":[{\"command\":[\"/home/weave/init.sh\"],\"image\":\"docker.io/weaveworks/weave-kube:2.8.1\",\"name\":\"weave-init\",\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/host/opt\",\"name\":\"cni-bin\"},{\"mountPath\":\"/host/home\",\"name\":\"cni-bin2\"},{\"mountPath\":\"/host/etc\",\"name\":\"cni-conf\"},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]}],\"priorityClassName\":\"system-node-critical\",\"restartPolicy\":\"Always\",\"securityContext\":{\"seLinuxOptions\":{}},\"serviceAccountName\":\"weave-net\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\":\"Exists\"},{\"effect\":\"NoExecute\",\"operator\":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/var/lib/weave\"},\"name\":\"weavedb\"},{\"hostPath\":{\"path\":\"/opt\"},\"name\":\"cni-bin\"},{\"hostPath\":{\"path\":\"/home\"},\"name\":\"cni-bin2\"},{\"hostPath\":{\"path\":\"/etc\"},\"name\":\"cni-conf\"},{\"hostPath\":{\"path\":\"/var/lib/dbus\"},\"name\":\"dbus\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"},{\"hostPath\":{\"path\":\"/etc/machine-id\",\"type\":\"FileOrCreate\"},\"name\":\"machine-id\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"}]}},\"updateStrategy\":{\"type\":\"RollingUpdate\"}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc001447680), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0014476a0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0014476c0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"weave-net"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"weavedb", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0014476e0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-bin", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001447700), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-bin2", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001447720), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-conf", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001447740), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"dbus", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001447760), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001447780), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"machine-id", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0014477a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0014477c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container{v1.Container{Name:"weave-init", Image:"docker.io/weaveworks/weave-kube:2.8.1", Command:[]string{"/home/weave/init.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-bin", ReadOnly:false, MountPath:"/host/opt", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"cni-bin2", ReadOnly:false, MountPath:"/host/home", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"cni-conf", ReadOnly:false, MountPath:"/host/etc", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:false, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001e561e0), Stdin:false, StdinOnce:false, TTY:false}}, Containers:[]v1.Container{v1.Container{Name:"weave", Image:"docker.io/weaveworks/weave-kube:2.8.1", Command:[]string{"/home/weave/launch.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOSTNAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0014477e0)}, v1.EnvVar{Name:"IPALLOC_RANGE", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"INIT_CONTAINER", Value:"true", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:50, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"weavedb", ReadOnly:false, MountPath:"/weavedb", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"dbus", ReadOnly:false, MountPath:"/host/var/lib/dbus", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"machine-id", ReadOnly:true, MountPath:"/host/etc/machine-id", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(0xc001cbac60), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001e560c0), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"weave-npc", Image:"docker.io/weaveworks/weave-npc:2.8.1", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOSTNAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001447820)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:50, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001e56180), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001ad6898), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirstWithHostNet", NodeSelector:map[string]string(nil), ServiceAccountName:"weave-net", DeprecatedServiceAccount:"weave-net", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00042c700), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc000287670)}, MinReadySeconds:5, RevisionHistoryLimit:(*int32)(0xc001ad6980)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "weave-net": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:56.9839796Z [submariner-operator]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-18T14:19:56.9841383Z [submariner-operator]$ [cluster1] print_section * Submariner-operator pod logs for cluster1 *
2021-07-18T14:19:56.9842689Z [submariner-operator]$ [cluster1] print_pods_logs submariner-operator
2021-07-18T14:19:56.9843982Z [submariner-operator]$ [cluster1] print_pods_logs submariner-operator
2021-07-18T14:19:56.9847242Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-18T14:19:56.9849640Z [submariner-operator]$ [cluster1] print_section ** Pods logs for NS submariner-operator using selector '' **
2021-07-18T14:19:56.9851861Z [submariner-operator]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:56.9853541Z [submariner-operator]$ [cluster1] kubectl get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:56.9855516Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --selector= -n submariner-operator -o jsonpath={.items[*].metadata.name}
2021-07-18T14:19:57.0000720Z E0718 14:07:37.535467 1 daemon_controller.go:320] kube-system/weave-net failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"weave-net", GenerateName:"", Namespace:"kube-system", SelfLink:"", UID:"43a074d7-2408-41a2-b162-f050303b0c9f", ResourceVersion:"564", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214056, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"weave-net"}, Annotations:map[string]string{"cloud.weave.works/launcher-info":"{\n \"original-request\": {\n \"url\": \"/k8s/v1.16/net.yaml?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16\",\n \"date\": \"Sun Jul 18 2021 14:07:36 GMT+0000 (UTC)\"\n },\n \"email-address\": \"[email protected]\"\n}", "deprecated.daemonset.template.generation":"1", "kubectl.kubernetes.io/last-applied-configuration":"{\"apiVersion\":\"apps/v1\",\"kind\":\"DaemonSet\",\"metadata\":{\"annotations\":{\"cloud.weave.works/launcher-info\":\"{\\n \\\"original-request\\\": {\\n \\\"url\\\": \\\"/k8s/v1.16/net.yaml?k8s-version=v1.20.7\\u0026env.IPALLOC_RANGE=10.1.0.0/16\\\",\\n \\\"date\\\": \\\"Sun Jul 18 2021 14:07:36 GMT+0000 (UTC)\\\"\\n },\\n \\\"email-address\\\": \\\"[email protected]\\\"\\n}\"},\"labels\":{\"name\":\"weave-net\"},\"name\":\"weave-net\",\"namespace\":\"kube-system\"},\"spec\":{\"minReadySeconds\":5,\"selector\":{\"matchLabels\":{\"name\":\"weave-net\"}},\"template\":{\"metadata\":{\"labels\":{\"name\":\"weave-net\"}},\"spec\":{\"containers\":[{\"command\":[\"/home/weave/launch.sh\"],\"env\":[{\"name\":\"HOSTNAME\",\"valueFrom\":{\"fieldRef\":{\"apiVersion\":\"v1\",\"fieldPath\":\"spec.nodeName\"}}},{\"name\":\"IPALLOC_RANGE\",\"value\":\"10.1.0.0/16\"},{\"name\":\"INIT_CONTAINER\",\"value\":\"true\"}],\"image\":\"docker.io/weaveworks/weave-kube:2.8.1\",\"name\":\"weave\",\"readinessProbe\":{\"httpGet\":{\"host\":\"127.0.0.1\",\"path\":\"/status\",\"port\":6784}},\"resources\":{\"requests\":{\"cpu\":\"50m\",\"memory\":\"100Mi\"}},\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/weavedb\",\"name\":\"weavedb\"},{\"mountPath\":\"/host/var/lib/dbus\",\"name\":\"dbus\"},{\"mountPath\":\"/host/etc/machine-id\",\"name\":\"machine-id\",\"readOnly\":true},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]},{\"env\":[{\"name\":\"HOSTNAME\",\"valueFrom\":{\"fieldRef\":{\"apiVersion\":\"v1\",\"fieldPath\":\"spec.nodeName\"}}}],\"image\":\"docker.io/weaveworks/weave-npc:2.8.1\",\"name\":\"weave-npc\",\"resources\":{\"requests\":{\"cpu\":\"50m\",\"memory\":\"100Mi\"}},\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]}],\"dnsPolicy\":\"ClusterFirstWithHostNet\",\"hostNetwork\":true,\"initContainers\":[{\"command\":[\"/home/weave/init.sh\"],\"image\":\"docker.io/weaveworks/weave-kube:2.8.1\",\"name\":\"weave-init\",\"securityContext\":{\"privileged\":true},\"volumeMounts\":[{\"mountPath\":\"/host/opt\",\"name\":\"cni-bin\"},{\"mountPath\":\"/host/home\",\"name\":\"cni-bin2\"},{\"mountPath\":\"/host/etc\",\"name\":\"cni-conf\"},{\"mountPath\":\"/lib/modules\",\"name\":\"lib-modules\"},{\"mountPath\":\"/run/xtables.lock\",\"name\":\"xtables-lock\"}]}],\"priorityClassName\":\"system-node-critical\",\"restartPolicy\":\"Always\",\"securityContext\":{\"seLinuxOptions\":{}},\"serviceAccountName\":\"weave-net\",\"tolerations\":[{\"effect\":\"NoSchedule\",\"operator\":\"Exists\"},{\"effect\":\"NoExecute\",\"operator\":\"Exists\"}],\"volumes\":[{\"hostPath\":{\"path\":\"/var/lib/weave\"},\"name\":\"weavedb\"},{\"hostPath\":{\"path\":\"/opt\"},\"name\":\"cni-bin\"},{\"hostPath\":{\"path\":\"/home\"},\"name\":\"cni-bin2\"},{\"hostPath\":{\"path\":\"/etc\"},\"name\":\"cni-conf\"},{\"hostPath\":{\"path\":\"/var/lib/dbus\"},\"name\":\"dbus\"},{\"hostPath\":{\"path\":\"/lib/modules\"},\"name\":\"lib-modules\"},{\"hostPath\":{\"path\":\"/etc/machine-id\",\"type\":\"FileOrCreate\"},\"name\":\"machine-id\"},{\"hostPath\":{\"path\":\"/run/xtables.lock\",\"type\":\"FileOrCreate\"},\"name\":\"xtables-lock\"}]}},\"updateStrategy\":{\"type\":\"RollingUpdate\"}}}\n"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"kubectl-client-side-apply", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0016a1aa0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0016a1b40)}, v1.ManagedFieldsEntry{Manager:"kube-controller-manager", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0016a1c80), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0016a1dc0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0016a1de0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"name":"weave-net"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"weavedb", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1e00), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-bin", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1ea0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-bin2", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1ec0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"cni-conf", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1ee0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"dbus", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1f00), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"lib-modules", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1f20), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"machine-id", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1f40), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016a1f80), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container{v1.Container{Name:"weave-init", Image:"docker.io/weaveworks/weave-kube:2.8.1", Command:[]string{"/home/weave/init.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar(nil), Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"cni-bin", ReadOnly:false, MountPath:"/host/opt", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"cni-bin2", ReadOnly:false, MountPath:"/host/home", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"cni-conf", ReadOnly:false, MountPath:"/host/etc", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"lib-modules", ReadOnly:false, MountPath:"/lib/modules", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc002013800), Stdin:false, StdinOnce:false, TTY:false}}, Containers:[]v1.Container{v1.Container{Name:"weave", Image:"docker.io/weaveworks/weave-kube:2.8.1", Command:[]string{"/home/weave/launch.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOSTNAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001624000)}, v1.EnvVar{Name:"IPALLOC_RANGE", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"INIT_CONTAINER", Value:"true", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:50, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"weavedb", ReadOnly:false, MountPath:"/weavedb", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"dbus", ReadOnly:false, MountPath:"/host/var/lib/dbus", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"machine-id", ReadOnly:true, MountPath:"/host/etc/machine-id", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(0xc001e4d5f0), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc002013740), Stdin:false, StdinOnce:false, TTY:false}, v1.Container{Name:"weave-npc", Image:"docker.io/weaveworks/weave-npc:2.8.1", Command:[]string(nil), Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"HOSTNAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001624040)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList{"cpu":resource.Quantity{i:resource.int64Amount{value:50, scale:-3}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"50m", Format:"DecimalSI"}, "memory":resource.Quantity{i:resource.int64Amount{value:104857600, scale:0}, d:resource.infDecAmount{Dec:(*inf.Dec)(nil)}, s:"100Mi", Format:"BinarySI"}}}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc0020137a0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001e59b58), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirstWithHostNet", NodeSelector:map[string]string(nil), ServiceAccountName:"weave-net", DeprecatedServiceAccount:"weave-net", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc0000f53b0), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoSchedule", TolerationSeconds:(*int64)(nil)}, v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"NoExecute", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"system-node-critical", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc000287918)}, MinReadySeconds:5, RevisionHistoryLimit:(*int32)(0xc001e59c70)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:2, NumberMisscheduled:0, DesiredNumberScheduled:3, NumberReady:0, ObservedGeneration:1, UpdatedNumberScheduled:2, NumberAvailable:0, NumberUnavailable:3, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "weave-net": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:57.0177224Z I0718 14:07:51.185147 1 node_lifecycle_controller.go:1222] Controller detected that some Nodes are Ready. Exiting master disruption mode.
2021-07-18T14:19:57.0180032Z I0718 14:12:05.929092 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-operator-586cb56578 to 1"
2021-07-18T14:19:57.0183091Z I0718 14:12:05.941283 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-586cb56578" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-operator-586cb56578-pztq6"
2021-07-18T14:19:57.0184941Z I0718 14:12:20.827112 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for clusters.submariner.io
2021-07-18T14:19:57.0186285Z I0718 14:12:20.827164 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for servicediscoveries.submariner.io
2021-07-18T14:19:57.0188495Z I0718 14:12:20.827187 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceimports.multicluster.x-k8s.io
2021-07-18T14:19:57.0190550Z I0718 14:12:20.827232 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for endpoints.submariner.io
2021-07-18T14:19:57.0192667Z I0718 14:12:20.827286 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for serviceexports.multicluster.x-k8s.io
2021-07-18T14:19:57.0193977Z I0718 14:12:20.827322 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for gateways.submariner.io
2021-07-18T14:19:57.0195120Z I0718 14:12:20.828447 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for submariners.submariner.io
2021-07-18T14:19:57.0196262Z I0718 14:12:20.828703 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for brokers.submariner.io
2021-07-18T14:19:57.0197328Z I0718 14:12:20.829901 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-18T14:19:57.0198255Z I0718 14:12:21.230415 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-18T14:19:57.0199096Z I0718 14:12:21.886113 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-18T14:19:57.0199938Z I0718 14:12:21.886443 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-18T14:19:57.0202214Z I0718 14:12:22.425305 1 event.go:291] "Event occurred" object="submariner-operator/submariner-gateway" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-gateway-h9krb"
2021-07-18T14:19:57.0902761Z E0718 14:12:22.557733 1 daemon_controller.go:320] submariner-operator/submariner-gateway failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-gateway", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"38a8d4fe-b0f6-4afe-94db-44a40b11a496", ResourceVersion:"1406", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214342, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway", "component":"gateway"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"a69e3e48-f5d3-44d3-a00f-4e1254083380", Controller:(*bool)(0xc000878f27), BlockOwnerDeletion:(*bool)(0xc000878f28)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-operator", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0011a6e40), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0011a6ee0)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0011a72a0), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-gateway"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume(nil), InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-gateway", Image:"quay.io/submariner/submariner-gateway:0.9.1", Command:[]string{"submariner.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_COLORCODES", Value:"blue", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NATENABLED", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_BROKER", Value:"k8s", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CABLEDRIVER", Value:"libreswan", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVER", Value:"172.18.0.8:6443", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_APISERVERTOKEN", Value:"***", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_REMOTENAMESPACE", Value:"submariner-k8s-broker", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"BROKER_K8S_CA", Value:"LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU9Wb1hEVE14TURjeE5qRTBNRFl5T1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDl6CkM0OUp3VjhuWkduSTVESWVERE90b0FwNjRKY0dFZDFwYThGa2dCTUhiMlZxTWRrRmx1Uzk1cWdOVTJKcDQyamgKSVlPNk9QNTJEVGxEVW93dHhzMnlqNldxUjdPT2l5anUzVnhlYXVwNng2NklqQ0Q5MEdPVHlGNitwZkw4WTdtQgpvMVQ4eTR4RlZlT2d5UjMxREZYaDZOT1RNc2pHWEZOUXBsR2tsbnNDU0hTenlvUzYwakdUbG1aKytRa2prU3R0CmpVUUhjZlRRM3RrV21ubGtSUEIxVUN4NThQajZoUUJ5OE1VTFRaUUgrUEZNMUZvUnRxaktFa2ZWT3k4T3pLMjcKSWdMd0NTNzJpYmIvWjBNV2t1R0dBU2hBS3BMZ1ZEMVI0ZkozanZ0ZWo1cUpYRlo0WDh4RUlhN09oZjVHbmZaYQpGTEgzRHYwaXFGcmF2K0g1VmNNQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIN1RmVy8wOStoeWhvNDVIRWZSdy9MUFFkYi9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDR291UDhINEo5Z1ZhM0tXekVkOCtJMThmK3lUNjUzZ09acGNWZFQxKytmUjJMSDBTZQpsNERNdjVsWGV1R2FTdVRybWpUNjZkK3B1czdhbUV5TXZuT1dyalpmWjRLQklqRkJLbk56OVBHNTBzNFhvb2wzCk1TMFlQRDdaaGptY1dxaEp1NmZWYXZqMVZuU292dlJnSVp2UTFtMHg2NlhtMEhSL04yRWtFd3I0RndudjF5NWoKVnA2RktZay9WdThmY3RNSjFWMEpjbTVEa2pTTWRGNFJJcllmTHhGaE9SbkROOFFIbHRDQjlGT1ozVWpOZGhIQgpVQzlaUzVpRzRGZWQzUlpWTTBHWFdoMGJDcXc4RnduY29SbVpWTVBJNFk4WDFKRXRXREF0TEFnYmlZc2hzUmxNCjZjZ2x4UlpsNTlDTWh2enB4V1NtdWx5Q0VCVUljc09IcUJFaQotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PSK", Value:"9ZlTiFwcI2LMHfnfeH0kza3+cNPS0jgde/KJcg7/htmVLlIcgimOmYZWafDT5Uny", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKENABLED", Value:"true", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKINTERVAL", Value:"1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT", Value:"5", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0011a7660)}, v1.EnvVar{Name:"CE_IPSEC_IKEPORT", Value:"500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_NATTPORT", Value:"4500", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_PREFERREDSERVER", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"CE_IPSEC_FORCEENCAPS", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount(nil), VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc00158ec60), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc000879130), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string{"submariner.io/gateway":"true"}, ServiceAccountName:"submariner-gateway", DeprecatedServiceAccount:"submariner-gateway", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00060de30), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(0xc0011a7c40), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc001e52da8)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc000879178)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-gateway": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:57.1450579Z I0718 14:12:23.240797 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-427gq"
2021-07-18T14:19:57.1453128Z I0718 14:12:23.271974 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-5w7hh"
2021-07-18T14:19:57.1456498Z I0718 14:12:23.308832 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-5bl84"
2021-07-18T14:19:57.1459770Z I0718 14:12:23.370901 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-agent-5fc8c8684f to 1"
2021-07-18T14:19:57.1463025Z I0718 14:12:23.540149 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent-5fc8c8684f" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-agent-5fc8c8684f-8ts5q"
2021-07-18T14:19:57.1518260Z E0718 14:12:23.779013 1 daemon_controller.go:320] submariner-operator/submariner-routeagent failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-routeagent", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"f879ea14-0630-495d-b6ff-2ed59a47037b", ResourceVersion:"1423", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214343, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"a69e3e48-f5d3-44d3-a00f-4e1254083380", Controller:(*bool)(0xc001ad67fa), BlockOwnerDeletion:(*bool)(0xc001ad67fb)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-operator", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0013913c0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc001391460)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc001391500), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"host-run", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0013915a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"host-sys", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc001391780), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-routeagent", Image:"quay.io/submariner/submariner-route-agent:0.9.1", Command:[]string{"submariner-route-agent.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NETWORKPLUGIN", Value:"weave-net", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc001391820)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"host-sys", ReadOnly:true, MountPath:"/sys", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"host-run", ReadOnly:false, MountPath:"/run", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"IfNotPresent", SecurityContext:(*v1.SecurityContext)(0xc001fec7e0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001ad6930), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"submariner-routeagent", DeprecatedServiceAccount:"submariner-routeagent", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc000565420), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc001e52f00)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc001ad6964)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-routeagent": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:57.1571016Z I0718 14:12:24.306106 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-coredns-86867f4988 to 2"
2021-07-18T14:19:57.1574956Z I0718 14:12:24.326886 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-86867f4988" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-86867f4988-pmlgq"
2021-07-18T14:19:57.1579218Z I0718 14:12:24.352810 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-86867f4988" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-86867f4988-xs8zl"
2021-07-18T14:19:57.1582034Z I0718 14:13:32.973943 1 event.go:291] "Event occurred" object="default/nginx-demo" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set nginx-demo-b8f8b4fc6 to 2"
2021-07-18T14:19:57.1584401Z I0718 14:13:33.018318 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-h9cxc"
2021-07-18T14:19:57.1586869Z I0718 14:13:33.054316 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-684hs"
2021-07-18T14:19:57.1591979Z I0718 14:13:33.346413 1 event.go:291] "Event occurred" object="default/nginx-demo-cluster1" kind="EndpointSlice" apiVersion="discovery.k8s.io/v1beta1" type="Warning" reason="OwnerRefInvalidNamespace" message="ownerRef [multicluster.x-k8s.io.v1alpha1/ServiceImport, namespace: default, name: nginx-demo-default-cluster1, uid: 3239b295-ad45-4d14-aa08-a2dc085b43ac] does not exist in namespace \"default\""
2021-07-18T14:19:57.1595912Z I0718 14:15:33.138364 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-operator-5bfdb87494 to 1"
2021-07-18T14:19:57.1599271Z I0718 14:15:33.152789 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-5bfdb87494" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-operator-5bfdb87494-nnbw8"
2021-07-18T14:19:57.1602243Z I0718 14:15:34.235014 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled down replica set submariner-operator-586cb56578 to 0"
2021-07-18T14:19:57.1605376Z I0718 14:15:34.313441 1 event.go:291] "Event occurred" object="submariner-operator/submariner-operator-586cb56578" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulDelete" message="Deleted pod: submariner-operator-586cb56578-pztq6"
2021-07-18T14:19:57.1614869Z E0718 14:15:44.095493 1 garbagecollector.go:350] error syncing item &garbagecollector.node{identity:garbagecollector.objectReference{OwnerReference:v1.OwnerReference{APIVersion:"v1", Kind:"Pod", Name:"submariner-routeagent-427gq", UID:"9215bf27-51c6-461e-ada3-730522493f18", Controller:(*bool)(nil), BlockOwnerDeletion:(*bool)(nil)}, Namespace:"submariner-operator"}, dependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:1, readerWait:0}, dependents:map[*garbagecollector.node]struct {}{}, deletingDependents:false, deletingDependentsLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, beingDeleted:true, beingDeletedLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, virtual:false, virtualLock:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:0, readerWait:0}, owners:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"apps/v1", Kind:"DaemonSet", Name:"submariner-routeagent", UID:"f879ea14-0630-495d-b6ff-2ed59a47037b", Controller:(*bool)(0xc001ad6ad0), BlockOwnerDeletion:(*bool)(0xc001ad6ad1)}}}: pods "submariner-routeagent-427gq" not found
2021-07-18T14:19:57.1624573Z I0718 14:15:45.880577 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint submariner-operator/submariner-lighthouse-coredns: Operation cannot be fulfilled on endpoints \"submariner-lighthouse-coredns\": the object has been modified; please apply your changes to the latest version and try again"
2021-07-18T14:19:57.1631533Z I0718 14:15:45.880925 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-metrics" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToUpdateEndpoint" message="Failed to update endpoint submariner-operator/submariner-lighthouse-coredns-metrics: Operation cannot be fulfilled on endpoints \"submariner-lighthouse-coredns-metrics\": the object has been modified; please apply your changes to the latest version and try again"
2021-07-18T14:19:57.1636036Z I0718 14:15:50.791226 1 event.go:291] "Event occurred" object="submariner-operator/submariner-gateway" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-gateway-kwxr8"
2021-07-18T14:19:57.1638751Z I0718 14:15:51.486514 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-246bf"
2021-07-18T14:19:57.1641208Z I0718 14:15:51.524115 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-8wwlc"
2021-07-18T14:19:57.1644261Z I0718 14:15:51.525615 1 event.go:291] "Event occurred" object="submariner-operator/submariner-routeagent" kind="DaemonSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-routeagent-2ls6w"
2021-07-18T14:19:57.1647665Z I0718 14:15:51.631258 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-agent-5d8c4f58c to 1"
2021-07-18T14:19:57.1651055Z I0718 14:15:51.676408 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-agent-5d8c4f58c" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-agent-5d8c4f58c-6rrx9"
2021-07-18T14:19:57.1716451Z E0718 14:15:51.715555 1 daemon_controller.go:320] submariner-operator/submariner-routeagent failed with : error storing status for daemon set &v1.DaemonSet{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"submariner-routeagent", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"ddf36748-4e6d-4350-b213-ed31ef162a5d", ResourceVersion:"2410", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214551, loc:(*time.Location)(0x6f94440)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string{"deprecated.daemonset.template.generation":"1"}, OwnerReferences:[]v1.OwnerReference{v1.OwnerReference{APIVersion:"submariner.io/v1alpha1", Kind:"Submariner", Name:"submariner", UID:"59ce9110-d5cf-4911-845e-446484c48418", Controller:(*bool)(0xc001651a8a), BlockOwnerDeletion:(*bool)(0xc001651a8b)}}, Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-operator", Operation:"Update", APIVersion:"apps/v1", Time:(*v1.Time)(0xc0016c2920), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0016c2940)}}}, Spec:v1.DaemonSetSpec{Selector:(*v1.LabelSelector)(0xc0016c2960), Template:v1.PodTemplateSpec{ObjectMeta:v1.ObjectMeta{Name:"", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"app":"submariner-routeagent", "component":"routeagent"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1.PodSpec{Volumes:[]v1.Volume{v1.Volume{Name:"host-run-xtables-lock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016c2980), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"host-run-openvswitch-db-sock", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016c29a0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}, v1.Volume{Name:"host-sys", VolumeSource:v1.VolumeSource{HostPath:(*v1.HostPathVolumeSource)(0xc0016c29c0), EmptyDir:(*v1.EmptyDirVolumeSource)(nil), GCEPersistentDisk:(*v1.GCEPersistentDiskVolumeSource)(nil), AWSElasticBlockStore:(*v1.AWSElasticBlockStoreVolumeSource)(nil), GitRepo:(*v1.GitRepoVolumeSource)(nil), Secret:(*v1.SecretVolumeSource)(nil), NFS:(*v1.NFSVolumeSource)(nil), ISCSI:(*v1.ISCSIVolumeSource)(nil), Glusterfs:(*v1.GlusterfsVolumeSource)(nil), PersistentVolumeClaim:(*v1.PersistentVolumeClaimVolumeSource)(nil), RBD:(*v1.RBDVolumeSource)(nil), FlexVolume:(*v1.FlexVolumeSource)(nil), Cinder:(*v1.CinderVolumeSource)(nil), CephFS:(*v1.CephFSVolumeSource)(nil), Flocker:(*v1.FlockerVolumeSource)(nil), DownwardAPI:(*v1.DownwardAPIVolumeSource)(nil), FC:(*v1.FCVolumeSource)(nil), AzureFile:(*v1.AzureFileVolumeSource)(nil), ConfigMap:(*v1.ConfigMapVolumeSource)(nil), VsphereVolume:(*v1.VsphereVirtualDiskVolumeSource)(nil), Quobyte:(*v1.QuobyteVolumeSource)(nil), AzureDisk:(*v1.AzureDiskVolumeSource)(nil), PhotonPersistentDisk:(*v1.PhotonPersistentDiskVolumeSource)(nil), Projected:(*v1.ProjectedVolumeSource)(nil), PortworxVolume:(*v1.PortworxVolumeSource)(nil), ScaleIO:(*v1.ScaleIOVolumeSource)(nil), StorageOS:(*v1.StorageOSVolumeSource)(nil), CSI:(*v1.CSIVolumeSource)(nil), Ephemeral:(*v1.EphemeralVolumeSource)(nil)}}}, InitContainers:[]v1.Container(nil), Containers:[]v1.Container{v1.Container{Name:"submariner-routeagent", Image:"localhost:5000/submariner-route-agent:local", Command:[]string{"submariner-route-agent.sh"}, Args:[]string(nil), WorkingDir:"", Ports:[]v1.ContainerPort(nil), EnvFrom:[]v1.EnvFromSource(nil), Env:[]v1.EnvVar{v1.EnvVar{Name:"SUBMARINER_NAMESPACE", Value:"submariner-operator", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERID", Value:"cluster1", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_DEBUG", Value:"false", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_CLUSTERCIDR", Value:"10.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_SERVICECIDR", Value:"100.1.0.0/16", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_GLOBALCIDR", Value:"", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"SUBMARINER_NETWORKPLUGIN", Value:"weave-net", ValueFrom:(*v1.EnvVarSource)(nil)}, v1.EnvVar{Name:"NODE_NAME", Value:"", ValueFrom:(*v1.EnvVarSource)(0xc0016c29e0)}}, Resources:v1.ResourceRequirements{Limits:v1.ResourceList(nil), Requests:v1.ResourceList(nil)}, VolumeMounts:[]v1.VolumeMount{v1.VolumeMount{Name:"host-sys", ReadOnly:true, MountPath:"/sys", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"host-run-xtables-lock", ReadOnly:false, MountPath:"/run/xtables.lock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}, v1.VolumeMount{Name:"host-run-openvswitch-db-sock", ReadOnly:false, MountPath:"/run/openvswitch/db.sock", SubPath:"", MountPropagation:(*v1.MountPropagationMode)(nil), SubPathExpr:""}}, VolumeDevices:[]v1.VolumeDevice(nil), LivenessProbe:(*v1.Probe)(nil), ReadinessProbe:(*v1.Probe)(nil), StartupProbe:(*v1.Probe)(nil), Lifecycle:(*v1.Lifecycle)(nil), TerminationMessagePath:"/dev/termination-log", TerminationMessagePolicy:"File", ImagePullPolicy:"Always", SecurityContext:(*v1.SecurityContext)(0xc001e93aa0), Stdin:false, StdinOnce:false, TTY:false}}, EphemeralContainers:[]v1.EphemeralContainer(nil), RestartPolicy:"Always", TerminationGracePeriodSeconds:(*int64)(0xc001651bc0), ActiveDeadlineSeconds:(*int64)(nil), DNSPolicy:"ClusterFirst", NodeSelector:map[string]string(nil), ServiceAccountName:"submariner-routeagent", DeprecatedServiceAccount:"submariner-routeagent", AutomountServiceAccountToken:(*bool)(nil), NodeName:"", HostNetwork:true, HostPID:false, HostIPC:false, ShareProcessNamespace:(*bool)(nil), SecurityContext:(*v1.PodSecurityContext)(0xc00041dc00), ImagePullSecrets:[]v1.LocalObjectReference(nil), Hostname:"", Subdomain:"", Affinity:(*v1.Affinity)(nil), SchedulerName:"default-scheduler", Tolerations:[]v1.Toleration{v1.Toleration{Key:"", Operator:"Exists", Value:"", Effect:"", TolerationSeconds:(*int64)(nil)}}, HostAliases:[]v1.HostAlias(nil), PriorityClassName:"", Priority:(*int32)(nil), DNSConfig:(*v1.PodDNSConfig)(nil), ReadinessGates:[]v1.PodReadinessGate(nil), RuntimeClassName:(*string)(nil), EnableServiceLinks:(*bool)(nil), PreemptionPolicy:(*v1.PreemptionPolicy)(nil), Overhead:v1.ResourceList(nil), TopologySpreadConstraints:[]v1.TopologySpreadConstraint(nil), SetHostnameAsFQDN:(*bool)(nil)}}, UpdateStrategy:v1.DaemonSetUpdateStrategy{Type:"RollingUpdate", RollingUpdate:(*v1.RollingUpdateDaemonSet)(0xc001e52e80)}, MinReadySeconds:0, RevisionHistoryLimit:(*int32)(0xc001651bf4)}, Status:v1.DaemonSetStatus{CurrentNumberScheduled:0, NumberMisscheduled:0, DesiredNumberScheduled:0, NumberReady:0, ObservedGeneration:0, UpdatedNumberScheduled:0, NumberAvailable:0, NumberUnavailable:0, CollisionCount:(*int32)(nil), Conditions:[]v1.DaemonSetCondition(nil)}}: Operation cannot be fulfilled on daemonsets.apps "submariner-routeagent": the object has been modified; please apply your changes to the latest version and try again
2021-07-18T14:19:57.1768504Z I0718 14:15:53.367930 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set submariner-lighthouse-coredns-68766559c4 to 2"
2021-07-18T14:19:57.1772325Z I0718 14:15:53.461033 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-68766559c4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-68766559c4-cj4g2"
2021-07-18T14:19:57.1776679Z I0718 14:15:53.528423 1 event.go:291] "Event occurred" object="submariner-operator/submariner-lighthouse-coredns-68766559c4" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: submariner-lighthouse-coredns-68766559c4-b4r66"
2021-07-18T14:19:57.1780334Z I0718 14:15:53.909206 1 event.go:291] "Event occurred" object="submariner-lighthouse-coredns" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service submariner-operator/submariner-lighthouse-coredns: endpoints \"submariner-lighthouse-coredns\" already exists"
2021-07-18T14:19:57.1783052Z I0718 14:15:56.029190 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for globalegressips.submariner.io
2021-07-18T14:19:57.1784560Z I0718 14:15:56.031244 1 resource_quota_monitor.go:229] QuotaMonitor created object count evaluator for globalingressips.submariner.io
2021-07-18T14:19:57.1785825Z I0718 14:15:56.031393 1 shared_informer.go:240] Waiting for caches to sync for resource quota
2021-07-18T14:19:57.1786532Z I0718 14:15:56.431606 1 shared_informer.go:247] Caches are synced for resource quota
2021-07-18T14:19:57.1787269Z I0718 14:15:56.885286 1 shared_informer.go:240] Waiting for caches to sync for garbage collector
2021-07-18T14:19:57.1788009Z I0718 14:15:57.289069 1 shared_informer.go:247] Caches are synced for garbage collector
2021-07-18T14:19:57.1789556Z I0718 14:16:35.165834 1 event.go:291] "Event occurred" object="default/nginx-demo" kind="Deployment" apiVersion="apps/v1" type="Normal" reason="ScalingReplicaSet" message="Scaled up replica set nginx-demo-b8f8b4fc6 to 2"
2021-07-18T14:19:57.1793035Z I0718 14:16:35.213571 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-h54lx"
2021-07-18T14:19:57.1795696Z I0718 14:16:35.288994 1 event.go:291] "Event occurred" object="default/nginx-demo-b8f8b4fc6" kind="ReplicaSet" apiVersion="apps/v1" type="Normal" reason="SuccessfulCreate" message="Created pod: nginx-demo-b8f8b4fc6-6g9jn"
2021-07-18T14:19:57.1797961Z I0718 14:16:35.294796 1 event.go:291] "Event occurred" object="nginx-demo" kind="Endpoints" apiVersion="v1" type="Warning" reason="FailedToCreateEndpoint" message="Failed to create endpoint for service default/nginx-demo: endpoints \"nginx-demo\" already exists"
2021-07-18T14:19:57.1799464Z ====================================================================
2021-07-18T14:19:57.1800247Z ##[endgroup]
2021-07-18T14:19:57.1801523Z ##[group]* Submariner-operator pod logs for cluster1 *
2021-07-18T14:19:57.1802797Z ======================= * Submariner-operator pod logs for cluster1 * =======================
2021-07-18T14:19:57.1803420Z ====================================================================
2021-07-18T14:19:57.1803888Z ##[endgroup]
2021-07-18T14:19:57.1804990Z ##[group]** Pods logs for NS submariner-operator using selector '' **
2021-07-18T14:19:57.1806300Z ======================= ** Pods logs for NS submariner-operator using selector '' ** =======================
2021-07-18T14:19:57.3141864Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-kwxr8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:57.3164018Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-gateway-kwxr8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:57.3210695Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-gateway-kwxr8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:57.6263193Z [submariner-operator]$ [cluster1] print_section *** submariner-gateway-kwxr8 ***
2021-07-18T14:19:57.6272498Z [submariner-operator]$ [cluster1] print_section *** submariner-gateway-kwxr8 ***
2021-07-18T14:19:57.6277402Z ====================================================================
2021-07-18T14:19:57.6279822Z ##[endgroup]
2021-07-18T14:19:57.6282984Z ##[group]*** submariner-gateway-kwxr8 ***
2021-07-18T14:19:57.6285145Z ======================= *** submariner-gateway-kwxr8 *** =======================
2021-07-18T14:19:57.6299127Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-kwxr8
2021-07-18T14:19:57.6310495Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-gateway-kwxr8
2021-07-18T14:19:57.6324035Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-gateway-kwxr8
2021-07-18T14:19:57.9462965Z + trap 'exit 1' SIGTERM SIGINT
2021-07-18T14:19:57.9464323Z + export CHARON_PID_FILE=/var/run/charon.pid
2021-07-18T14:19:57.9465416Z + CHARON_PID_FILE=/var/run/charon.pid
2021-07-18T14:19:57.9466937Z + rm -f /var/run/charon.pid
2021-07-18T14:19:57.9467829Z + SUBMARINER_VERBOSITY=2
2021-07-18T14:19:57.9470239Z + '[' false == true ']'
2021-07-18T14:19:57.9471751Z + DEBUG=-v=2
2021-07-18T14:19:57.9472237Z ++ cat /proc/sys/net/ipv4/conf/all/send_redirects
2021-07-18T14:19:57.9472880Z + [[ 0 = 0 ]]
2021-07-18T14:19:57.9474840Z + exec submariner-gateway -v=2 -alsologtostderr
2021-07-18T14:19:57.9475943Z I0718 14:15:57.139093 1 main.go:93] Starting the submariner gateway engine
2021-07-18T14:19:57.9478689Z W0718 14:15:57.139532 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:19:57.9482757Z I0718 14:15:57.141399 1 main.go:121] Creating the cable engine
2021-07-18T14:19:57.9486160Z I0718 14:15:57.979844 1 local_endpoint.go:210] Interface "lo" has "127.0.0.1" address
2021-07-18T14:19:57.9488266Z I0718 14:15:57.979935 1 local_endpoint.go:210] Interface "weave" has "10.1.0.1" address
2021-07-18T14:19:57.9490974Z I0718 14:15:57.979953 1 local_endpoint.go:215] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:19:57.9507590Z I0718 14:15:57.979985 1 natdiscovery.go:116] NAT discovery server starting on port 4490
2021-07-18T14:19:57.9508484Z I0718 14:15:58.187434 1 syncer.go:84] CableEngine syncer started
2021-07-18T14:19:57.9510063Z I0718 14:15:58.188280 1 main.go:323] Gateway leader election config values: main.leaderConfig{LeaseDuration:10, RenewDeadline:5, RetryPeriod:2}
2021-07-18T14:19:57.9512337Z I0718 14:15:58.188432 1 main.go:340] Using namespace "submariner-operator" for the leader election lock
2021-07-18T14:19:57.9514789Z I0718 14:15:58.188446 1 leaderelection.go:243] attempting to acquire leader lease submariner-operator/submariner-gateway-lock...
2021-07-18T14:19:57.9517414Z I0718 14:15:58.466316 1 leaderelection.go:253] successfully acquired lease submariner-operator/submariner-gateway-lock
2021-07-18T14:19:57.9518965Z I0718 14:15:58.466464 1 main.go:189] Creating the datastore syncer
2021-07-18T14:19:57.9535469Z I0718 14:15:58.466525 1 libreswan.go:98] Using NATT UDP port 4500
2021-07-18T14:19:57.9550760Z I0718 14:15:58.466579 1 libreswan.go:525] Starting Pluto
2021-07-18T14:19:57.9553537Z I0718 14:15:58.467086 1 event.go:282] Event(v1.ObjectReference{Kind:"ConfigMap", Namespace:"submariner-operator", Name:"submariner-gateway-lock", UID:"46a9db72-7e81-4590-bbaa-eabb20904f1e", APIVersion:"v1", ResourceVersion:"2517", FieldPath:""}): type: 'Normal' reason: 'LeaderElection' cluster1-worker-submariner-gateway became leader
2021-07-18T14:19:57.9556072Z /usr/libexec/ipsec/_stackmanager: line 111: pidof: command not found
2021-07-18T14:19:57.9556725Z Initializing NSS database
2021-07-18T14:19:57.9557059Z
2021-07-18T14:19:57.9557538Z /usr/sbin/ipsec: line 175: iptables: command not found
2021-07-18T14:19:57.9558326Z nflog ipsec capture disabled
2021-07-18T14:19:57.9559038Z I0718 14:16:00.482513 1 cableengine.go:96] CableEngine controller started, driver: "libreswan"
2021-07-18T14:19:57.9559827Z I0718 14:16:00.482807 1 tunnel.go:37] Starting the tunnel controller
2021-07-18T14:19:57.9560541Z I0718 14:16:00.483311 1 datastoresyncer.go:66] Starting the datastore syncer
2021-07-18T14:19:57.9561583Z I0718 14:16:00.631546 1 healthchecker.go:108] CableEngine HealthChecker started with PingInterval: 1, MaxPacketLossCount: 5
2021-07-18T14:19:57.9562509Z I0718 14:16:00.632783 1 pinger.go:81] Starting pinger for IP "10.2.128.0"
2021-07-18T14:19:57.9564139Z I0718 14:16:00.632806 1 healthchecker.go:158] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster2-172-18-0-5" with HealthCheckIP "10.2.128.0"
2021-07-18T14:19:57.9573105Z I0718 14:16:00.681625 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"96a42f73-c619-4128-a03e-b1ba548580d7", ResourceVersion:"1637", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214378, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00015d278), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00015d290)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-18T14:19:57.9580613Z I0718 14:16:00.681691 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:57.9581298Z 002 listening for IKE messages
2021-07-18T14:19:57.9581905Z 002 forgetting secrets
2021-07-18T14:19:57.9582740Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-18T14:19:57.9583424Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-18T14:19:57.9593665Z I0718 14:16:00.681924 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"dd8d1c98-f022-48a3-9a58-553c2b6198b3", ResourceVersion:"1687", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214396, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc00015d668), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc00015d680)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-18T14:19:57.9602039Z I0718 14:16:00.681984 1 remote_endpoint.go:129] using NAT legacy settings for endpoint "submariner-cable-cluster2-172-18-0-5", using private IP "172.18.0.5"
2021-07-18T14:19:57.9604025Z I0718 14:16:00.682004 1 cableengine.go:190] Installing Endpoint cable "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9605536Z 002 "submariner-cable-cluster2-172-18-0-5-0-0": added IKEv2 connection
2021-07-18T14:19:57.9624241Z I0718 14:16:00.683836 1 libreswan.go:309] Creating connection(s) for {"metadata":{"name":"cluster2-submariner-cable-cluster2-172-18-0-5","namespace":"submariner-operator","uid":"dd8d1c98-f022-48a3-9a58-553c2b6198b3","resourceVersion":"1687","generation":1,"creationTimestamp":"2021-07-18T14:13:16Z","labels":{"submariner-io/clusterID":"cluster2"},"managedFields":[{"manager":"submariner-gateway","operation":"Update","apiVersion":"submariner.io/v1","time":"2021-07-18T14:13:16Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:submariner-io/clusterID":{}}},"f:spec":{".":{},"f:backend":{},"f:backend_config":{".":{},"f:preferred-server":{}},"f:cable_name":{},"f:cluster_id":{},"f:healthCheckIP":{},"f:hostname":{},"f:nat_enabled":{},"f:private_ip":{},"f:public_ip":{},"f:subnets":{}}}}]},"spec":{"cluster_id":"cluster2","cable_name":"submariner-cable-cluster2-172-18-0-5","healthCheckIP":"10.2.128.0","hostname":"cluster2-worker","subnets":["100.2.0.0/16","10.2.0.0/16"],"private_ip":"172.18.0.5","public_ip":"20.94.255.131","nat_enabled":false,"backend":"libreswan","backend_config":{"preferred-server":"false"}}} in bi-directional mode
2021-07-18T14:19:57.9631785Z I0718 14:16:00.685913 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-0 --id 172.18.0.9 --host 172.18.0.9 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9635472Z I0718 14:16:00.699679 1 datastoresyncer.go:88] Starting the broker syncer
2021-07-18T14:19:57.9637812Z 181 "submariner-cable-cluster2-172-18-0-5-0-0" #1: initiating IKEv2 connection
2021-07-18T14:19:57.9640453Z I0718 14:16:00.849047 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-1 --id 172.18.0.9 --host 172.18.0.9 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9642310Z 002 "submariner-cable-cluster2-172-18-0-5-0-1": added IKEv2 connection
2021-07-18T14:19:57.9643581Z I0718 14:16:00.901471 1 datastoresyncer.go:141] Ensuring we are the only endpoint active for this cluster
2021-07-18T14:19:57.9645508Z I0718 14:16:00.918113 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-0 --id 172.18.0.9 --host 172.18.0.9 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9648598Z 000 "submariner-cable-cluster2-172-18-0-5-0-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #1 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9650796Z 002 "submariner-cable-cluster2-172-18-0-5-1-0": added IKEv2 connection
2021-07-18T14:19:57.9653207Z I0718 14:16:00.921919 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-1 --id 172.18.0.9 --host 172.18.0.9 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9656937Z 000 "submariner-cable-cluster2-172-18-0-5-1-0": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #1 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9660864Z 002 "submariner-cable-cluster2-172-18-0-5-1-1": added IKEv2 connection
2021-07-18T14:19:57.9662984Z I0718 14:16:00.925108 1 cableengine.go:197] Successfully installed Endpoint cable "submariner-cable-cluster2-172-18-0-5" with remote IP 172.18.0.5
2021-07-18T14:19:57.9665229Z 000 "submariner-cable-cluster2-172-18-0-5-1-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #1 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9667965Z I0718 14:16:00.959410 1 datastoresyncer.go:169] Successfully deleted existing submariner Endpoint "cluster1-submariner-cable-cluster1-172-18-0-9"
2021-07-18T14:19:57.9670907Z I0718 14:16:00.959429 1 datastoresyncer.go:220] Creating local submariner Cluster: types.SubmarinerCluster{ID:"cluster1", Spec:v1.ClusterSpec{ClusterID:"cluster1", ColorCodes:[]string{"blue"}, ServiceCIDR:[]string{"100.1.0.0/16"}, ClusterCIDR:[]string{"10.1.0.0/16"}, GlobalCIDR:[]string{}}}
2021-07-18T14:19:57.9680717Z I0718 14:16:00.964815 1 tunnel.go:88] Tunnel controller processing removed submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"96a42f73-c619-4128-a03e-b1ba548580d7", ResourceVersion:"2550", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214378, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000452ff0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000453008)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-18T14:19:57.9687606Z I0718 14:16:00.964902 1 cableengine.go:226] Cables are not added/removed for the local cluster, skipping removal
2021-07-18T14:19:57.9689400Z I0718 14:16:00.964908 1 tunnel.go:95] Tunnel controller successfully removed Endpoint cable submariner-cable-cluster1-172-18-0-9 from the engine
2021-07-18T14:19:57.9693680Z I0718 14:16:00.977625 1 datastoresyncer.go:233] Creating local submariner Endpoint: types.SubmarinerEndpoint{Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9696292Z I0718 14:16:01.034956 1 datastoresyncer.go:115] Datastore syncer started
2021-07-18T14:19:57.9704784Z I0718 14:16:01.045393 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000118438), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000118450)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9712142Z I0718 14:16:01.045451 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:57.9713802Z I0718 14:16:03.458867 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9715834Z I0718 14:16:03.458898 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9718419Z I0718 14:16:03.458905 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9720713Z I0718 14:16:03.458912 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9723037Z I0718 14:16:03.459141 1 libreswan.go:229] Connection "submariner-cable-cluster2-172-18-0-5" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9724991Z I0718 14:16:08.498486 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9727274Z I0718 14:16:08.498512 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9730308Z I0718 14:16:08.498519 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9732621Z I0718 14:16:08.498528 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9734816Z I0718 14:16:08.498557 1 libreswan.go:229] Connection "submariner-cable-cluster2-172-18-0-5" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9737477Z I0718 14:16:13.518048 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9740985Z I0718 14:16:13.518079 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9743647Z I0718 14:16:13.518087 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9745647Z I0718 14:16:13.518094 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9747913Z I0718 14:16:13.518132 1 libreswan.go:229] Connection "submariner-cable-cluster2-172-18-0-5" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9750261Z I0718 14:16:18.528367 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9752401Z I0718 14:16:18.528391 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-0-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9754782Z I0718 14:16:18.528400 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-0" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9757041Z I0718 14:16:18.528407 1 libreswan.go:215] Connection "submariner-cable-cluster2-172-18-0-5-1-1" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9760070Z I0718 14:16:18.528440 1 libreswan.go:229] Connection "submariner-cable-cluster2-172-18-0-5" not found in active connections obtained from whack: map[], map[]
2021-07-18T14:19:57.9769563Z I0718 14:16:18.632508 1 tunnel.go:88] Tunnel controller processing removed submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"dd8d1c98-f022-48a3-9a58-553c2b6198b3", ResourceVersion:"2619", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214396, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003f2348), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003f2360)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}}
2021-07-18T14:19:57.9776515Z I0718 14:16:18.632569 1 cableengine.go:230] Removing Endpoint cable "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9778627Z I0718 14:16:18.632579 1 libreswan.go:477] Deleting connection to {{cluster2 submariner-cable-cluster2-172-18-0-5 10.2.128.0 cluster2-worker [100.2.0.0/16 10.2.0.0/16] 172.18.0.5 20.94.255.131 false libreswan map[preferred-server:false]}}
2021-07-18T14:19:57.9781896Z I0718 14:16:18.632593 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-5-0-0]
2021-07-18T14:19:57.9783624Z 002 "submariner-cable-cluster2-172-18-0-5-0-0": terminating SAs using this connection
2021-07-18T14:19:57.9785497Z 002 "submariner-cable-cluster2-172-18-0-5-0-0" #1: deleting state (STATE_PARENT_I1) aged 17.790928s and NOT sending notification
2021-07-18T14:19:57.9787356Z I0718 14:16:18.636318 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-5-0-1]
2021-07-18T14:19:57.9789263Z 002 "submariner-cable-cluster2-172-18-0-5-0-1": terminating SAs using this connection
2021-07-18T14:19:57.9791259Z I0718 14:16:18.638834 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-5-1-0]
2021-07-18T14:19:57.9793081Z 002 "submariner-cable-cluster2-172-18-0-5-1-0": terminating SAs using this connection
2021-07-18T14:19:57.9794864Z 002 "submariner-cable-cluster2-172-18-0-5-1-0" #3: deleting state (STATE_V2_ESTABLISHED_CHILD_SA) aged 0.074408s and sending notification
2021-07-18T14:19:57.9796717Z 005 "submariner-cable-cluster2-172-18-0-5-1-0" #3: ESP traffic information: in=0B out=0B
2021-07-18T14:19:57.9797871Z I0718 14:16:18.680641 1 pinger.go:81] Starting pinger for IP "10.2.128.0"
2021-07-18T14:19:57.9800543Z I0718 14:16:18.680737 1 healthchecker.go:158] CableEngine HealthChecker started pinger for CableName: "submariner-cable-cluster2-172-18-0-5" with HealthCheckIP "10.2.128.0"
2021-07-18T14:19:57.9803572Z I0718 14:16:18.722149 1 libreswan.go:489] Whacking with [--delete --name submariner-cable-cluster2-172-18-0-5-1-1]
2021-07-18T14:19:57.9805566Z 002 "submariner-cable-cluster2-172-18-0-5-1-1": terminating SAs using this connection
2021-07-18T14:19:57.9807456Z 002 "submariner-cable-cluster2-172-18-0-5-1-1" #4: deleting state (STATE_V2_ESTABLISHED_CHILD_SA) aged 0.014337s and sending notification
2021-07-18T14:19:57.9809188Z 005 "submariner-cable-cluster2-172-18-0-5-1-1" #4: ESP traffic information: in=0B out=0B
2021-07-18T14:19:57.9811637Z 002 "submariner-cable-cluster2-172-18-0-5-1-1" #2: deleting state (STATE_V2_ESTABLISHED_IKE_SA) aged 0.193044s and sending notification
2021-07-18T14:19:57.9814058Z I0718 14:16:18.777827 1 cableengine.go:250] Successfully removed Endpoint cable "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9816147Z I0718 14:16:18.777944 1 tunnel.go:95] Tunnel controller successfully removed Endpoint cable submariner-cable-cluster2-172-18-0-5 from the engine
2021-07-18T14:19:57.9825511Z I0718 14:16:18.778145 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000331008), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000331020)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9833310Z I0718 14:16:18.778209 1 natdiscovery.go:158] Starting NAT discovery for endpoint "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9836000Z I0718 14:16:18.988110 1 request_handle.go:54] Received request from 172.18.0.5:4490 - REQUEST_NUMBER: 0x227f6bd6654c9811, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-9"
2021-07-18T14:19:57.9838948Z I0718 14:16:18.988186 1 request_handle.go:118] Sending response to 172.18.0.5:4490 - REQUEST_NUMBER: 0x227f6bd6654c9811, RESPONSE: OK, SENDER: "submariner-cable-cluster1-172-18-0-9", RECEIVER: "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9842235Z I0718 14:16:19.002652 1 request_send.go:118] Sending request - REQUEST_NUMBER: 0x31097e3bebc51ea4, SENDER: "submariner-cable-cluster1-172-18-0-9", RECEIVER: "submariner-cable-cluster2-172-18-0-5", USING_SRC: 172.18.0.9:4490, USING_DST: 172.18.0.5:4490
2021-07-18T14:19:57.9845044Z I0718 14:16:19.002806 1 request_send.go:118] Sending request - REQUEST_NUMBER: 0x31097e3bebc51ea5, SENDER: "submariner-cable-cluster1-172-18-0-9", RECEIVER: "submariner-cable-cluster2-172-18-0-5", USING_SRC: 172.18.0.9:4490, USING_DST: 20.94.255.131:4490
2021-07-18T14:19:57.9847997Z I0718 14:16:19.003182 1 response_handle.go:33] Received response from 172.18.0.5:4490 - REQUEST_NUMBER: 0x31097e3bebc51ea4, RESPONSE: OK, SENDER: "submariner-cable-cluster2-172-18-0-5", RECEIVER: "submariner-cable-cluster1-172-18-0-9"
2021-07-18T14:19:57.9850457Z I0718 14:16:19.003326 1 remote_endpoint.go:180] selected private IP "172.18.0.5" for endpoint "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9852138Z I0718 14:16:19.003356 1 cableengine.go:190] Installing Endpoint cable "submariner-cable-cluster2-172-18-0-5"
2021-07-18T14:19:57.9853052Z 002 listening for IKE messages
2021-07-18T14:19:57.9853509Z 002 forgetting secrets
2021-07-18T14:19:57.9854025Z 002 loading secrets from "/etc/ipsec.secrets"
2021-07-18T14:19:57.9854720Z 002 loading secrets from "/etc/ipsec.d/submariner.secrets"
2021-07-18T14:19:57.9861114Z I0718 14:16:19.006772 1 libreswan.go:309] Creating connection(s) for {"metadata":{"name":"cluster2-submariner-cable-cluster2-172-18-0-5","namespace":"submariner-operator","uid":"b92ed577-1b21-4552-ba99-e64304966dfd","resourceVersion":"2621","generation":1,"creationTimestamp":"2021-07-18T14:16:18Z","labels":{"submariner-io/clusterID":"cluster2"},"managedFields":[{"manager":"submariner-gateway","operation":"Update","apiVersion":"submariner.io/v1","time":"2021-07-18T14:16:18Z","fieldsType":"FieldsV1","fieldsV1":{"f:metadata":{"f:labels":{".":{},"f:submariner-io/clusterID":{}}},"f:spec":{".":{},"f:backend":{},"f:backend_config":{".":{},"f:natt-discovery-port":{},"f:preferred-server":{}},"f:cable_name":{},"f:cluster_id":{},"f:healthCheckIP":{},"f:hostname":{},"f:nat_enabled":{},"f:private_ip":{},"f:public_ip":{},"f:subnets":{}}}}]},"spec":{"cluster_id":"cluster2","cable_name":"submariner-cable-cluster2-172-18-0-5","healthCheckIP":"10.2.128.0","hostname":"cluster2-worker","subnets":["100.2.0.0/16","10.2.0.0/16"],"private_ip":"172.18.0.5","public_ip":"20.94.255.131","nat_enabled":false,"backend":"libreswan","backend_config":{"natt-discovery-port":"4490","preferred-server":"false"}}} in bi-directional mode
2021-07-18T14:19:57.9869086Z I0718 14:16:19.006912 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-0 --id 172.18.0.9 --host 172.18.0.9 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9871460Z 002 "submariner-cable-cluster2-172-18-0-5-0-0": added IKEv2 connection
2021-07-18T14:19:57.9873482Z 181 "submariner-cable-cluster2-172-18-0-5-0-0" #5: initiating IKEv2 connection
2021-07-18T14:19:57.9875567Z I0718 14:16:19.060384 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-0-1 --id 172.18.0.9 --host 172.18.0.9 --client 100.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9877690Z 002 "submariner-cable-cluster2-172-18-0-5-0-1": added IKEv2 connection
2021-07-18T14:19:57.9879930Z 000 "submariner-cable-cluster2-172-18-0-5-0-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #5 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9884040Z I0718 14:16:19.131460 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-0 --id 172.18.0.9 --host 172.18.0.9 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 100.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9886604Z 002 "submariner-cable-cluster2-172-18-0-5-1-0": added IKEv2 connection
2021-07-18T14:19:57.9888722Z 000 "submariner-cable-cluster2-172-18-0-5-1-0": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #5 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9891580Z I0718 14:16:19.135687 1 libreswan.go:370] Executing whack with args: [--psk --encrypt --name submariner-cable-cluster2-172-18-0-5-1-1 --id 172.18.0.9 --host 172.18.0.9 --client 10.1.0.0/16 --ikeport 4500 --to --id 172.18.0.5 --host 172.18.0.5 --client 10.2.0.0/16 --ikeport 4500]
2021-07-18T14:19:57.9893395Z 002 "submariner-cable-cluster2-172-18-0-5-1-1": added IKEv2 connection
2021-07-18T14:19:57.9895368Z 000 "submariner-cable-cluster2-172-18-0-5-1-1": queuing pending IPsec SA negotiating with 172.18.0.5 IKE SA #5 "submariner-cable-cluster2-172-18-0-5-0-0"
2021-07-18T14:19:57.9898002Z I0718 14:16:19.138502 1 cableengine.go:197] Successfully installed Endpoint cable "submariner-cable-cluster2-172-18-0-5" with remote IP 172.18.0.5
2021-07-18T14:19:57.9908334Z I0718 14:16:30.636796 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0002d53c8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002d53e0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9915490Z I0718 14:16:30.636945 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:57.9923685Z I0718 14:16:30.637116 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0002d57b8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002d5818)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9931374Z I0718 14:16:30.637247 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:57.9934271Z I0718 14:16:30.637337 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:57.9944410Z I0718 14:17:00.637686 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0002f5140), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002f51a0)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9959786Z I0718 14:17:00.638003 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000118120), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000118138)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9967004Z I0718 14:17:00.638060 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:57.9969283Z I0718 14:17:00.638094 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:57.9972729Z I0718 14:17:00.638134 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:57.9984538Z I0718 14:17:30.638598 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0002d4120), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002d4138)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:57.9991521Z I0718 14:17:30.638667 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:58.0014319Z I0718 14:17:30.638890 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0002d44f8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0002d4510)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0021885Z I0718 14:17:30.639063 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:58.0024525Z I0718 14:17:30.639111 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:58.0033739Z I0718 14:18:00.639323 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0001fec90), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0001feca8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0041410Z I0718 14:18:00.639409 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:58.0049972Z I0718 14:18:00.640392 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0001ff068), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0001ff080)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0057652Z I0718 14:18:00.640574 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:58.0060381Z I0718 14:18:00.640628 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:58.0070233Z I0718 14:18:30.639714 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000330ed0), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000330ee8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0077872Z I0718 14:18:30.640077 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:58.0088075Z I0718 14:18:30.642051 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000331290), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003312a8)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0095673Z I0718 14:18:30.642198 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:58.0098549Z I0718 14:18:30.642224 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:58.0107567Z I0718 14:19:00.640125 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000182720), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000182738)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0114111Z I0718 14:19:00.640194 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:58.0122154Z I0718 14:19:00.640433 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000182b10), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000182b28)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0129858Z I0718 14:19:00.640578 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:58.0132371Z I0718 14:19:00.640745 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:58.0141135Z I0718 14:19:30.640749 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster1-submariner-cable-cluster1-172-18-0-9", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"6e09f138-7d42-4014-b7fd-498efcde10e0", ResourceVersion:"2554", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214561, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string(nil), Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc000119e60), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc000119e78)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0147712Z I0718 14:19:30.640813 1 cableengine.go:206] Not installing cable for local cluster
2021-07-18T14:19:58.0156363Z I0718 14:19:30.640894 1 tunnel.go:74] Tunnel controller processing added or updated submariner Endpoint object: &v1.Endpoint{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"cluster2-submariner-cable-cluster2-172-18-0-5", GenerateName:"", Namespace:"submariner-operator", SelfLink:"", UID:"b92ed577-1b21-4552-ba99-e64304966dfd", ResourceVersion:"2621", Generation:1, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:63762214578, loc:(*time.Location)(0x21ef8a0)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"submariner-io/clusterID":"cluster2"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry{v1.ManagedFieldsEntry{Manager:"submariner-gateway", Operation:"Update", APIVersion:"submariner.io/v1", Time:(*v1.Time)(0xc0003f21f8), FieldsType:"FieldsV1", FieldsV1:(*v1.FieldsV1)(0xc0003f2210)}}}, Spec:v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}}
2021-07-18T14:19:58.0165124Z I0718 14:19:30.640969 1 cableengine.go:158] Found a pre-existing cable "submariner-cable-cluster2-172-18-0-5" with timestamp "2021-07-18 14:16:18 +0000 UTC" that belongs to this cluster cluster2
2021-07-18T14:19:58.0167953Z I0718 14:19:30.641027 1 cableengine.go:172] Connection info (IP: 172.18.0.5, NAT: false, BackendConfig: map[natt-discovery-port:4490 preferred-server:false]) for cable "submariner-cable-cluster2-172-18-0-5" is unchanged - not re-installing
2021-07-18T14:19:58.0170965Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-5d8c4f58c-6rrx9 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.0173972Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-agent-5d8c4f58c-6rrx9 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.0178180Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-agent-5d8c4f58c-6rrx9 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.2501007Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-agent-5d8c4f58c-6rrx9 ***
2021-07-18T14:19:58.2513722Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-agent-5d8c4f58c-6rrx9 ***
2021-07-18T14:19:58.2517193Z ====================================================================
2021-07-18T14:19:58.2517755Z ##[endgroup]
2021-07-18T14:19:58.2523375Z ##[group]*** submariner-lighthouse-agent-5d8c4f58c-6rrx9 ***
2021-07-18T14:19:58.2524844Z ======================= *** submariner-lighthouse-agent-5d8c4f58c-6rrx9 *** =======================
2021-07-18T14:19:58.2536637Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-5d8c4f58c-6rrx9
2021-07-18T14:19:58.2547525Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-agent-5d8c4f58c-6rrx9
2021-07-18T14:19:58.2560319Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-agent-5d8c4f58c-6rrx9
2021-07-18T14:19:58.5809794Z I0718 14:15:59.511973 1 main.go:70] Arguments: [/usr/local/bin/lighthouse-agent -alsologtostderr -v=2]
2021-07-18T14:19:58.5812912Z I0718 14:15:59.512109 1 main.go:71] AgentSpec: {cluster1 submariner-operator false}
2021-07-18T14:19:58.5814240Z W0718 14:15:59.512326 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:19:58.5816901Z I0718 14:15:59.574424 1 main.go:98] Starting submariner-lighthouse-agent {cluster1 submariner-operator false}
2021-07-18T14:19:58.5819243Z I0718 14:15:59.803691 1 agent.go:163] Starting Agent controller
2021-07-18T14:19:58.5819897Z I0718 14:16:00.309049 1 agent.go:207] Agent controller started
2021-07-18T14:19:58.5824088Z I0718 14:16:35.231914 1 agent.go:233] ServiceExport default/nginx-demo created
2021-07-18T14:19:58.5827638Z I0718 14:16:35.232453 1 agent.go:387] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "False", Reason: "AwaitingSync", Message: "Awaiting sync of the ServiceImport to the broker"
2021-07-18T14:19:58.5843042Z I0718 14:16:35.365885 1 agent.go:316] Returning ServiceImport: &v1alpha1.ServiceImport{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-default-cluster1", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"lighthouse.submariner.io/sourceCluster":"cluster1", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default"}, Annotations:map[string]string{"cluster-ip":"100.1.131.218", "origin-name":"nginx-demo", "origin-namespace":"default"}, OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, Spec:v1alpha1.ServiceImportSpec{Ports:[]v1alpha1.ServicePort{v1alpha1.ServicePort{Name:"", Protocol:"TCP", AppProtocol:(*string)(nil), Port:80}}, IPs:[]string{"100.1.131.218"}, Type:"ClusterSetIP", SessionAffinity:"", SessionAffinityConfig:(*v1.SessionAffinityConfig)(0xc00000e510)}, Status:v1alpha1.ServiceImportStatus{Clusters:[]v1alpha1.ClusterStatus{v1alpha1.ClusterStatus{Cluster:"cluster1"}}}}
2021-07-18T14:19:58.5852117Z I0718 14:16:35.455182 1 agent.go:387] updateExportedServiceStatus for (default/nginx-demo) - Type: "Valid", Status: "True", Reason: "", Message: "Service was successfully synced to the broker"
2021-07-18T14:19:58.5854342Z I0718 14:16:35.476577 1 serviceimport.go:160] ServiceImport "submariner-operator/nginx-demo-default-cluster1" created
2021-07-18T14:19:58.5856061Z I0718 14:16:35.480967 1 endpoint.go:46] Starting Endpoints controller for service default/nginx-demo
2021-07-18T14:19:58.5857816Z I0718 14:16:35.541461 1 agent.go:233] ServiceExport default/nginx-demo updated
2021-07-18T14:19:58.5859195Z I0718 14:16:35.548776 1 agent.go:233] ServiceExport default/nginx-demo updated
2021-07-18T14:19:58.5860245Z I0718 14:16:35.600771 1 endpoint.go:126] Endpoints default/nginx-demo created
2021-07-18T14:19:58.5910766Z I0718 14:16:35.603266 1 endpoint.go:179] Returning EndpointSlice: &v1beta1.EndpointSlice{TypeMeta:v1.TypeMeta{Kind:"", APIVersion:""}, ObjectMeta:v1.ObjectMeta{Name:"nginx-demo-cluster1", GenerateName:"", Namespace:"", SelfLink:"", UID:"", ResourceVersion:"", Generation:0, CreationTimestamp:v1.Time{Time:time.Time{wall:0x0, ext:0, loc:(*time.Location)(nil)}}, DeletionTimestamp:(*v1.Time)(nil), DeletionGracePeriodSeconds:(*int64)(nil), Labels:map[string]string{"endpointslice.kubernetes.io/managed-by":"lighthouse-agent.submariner.io", "lighthouse.submariner.io/sourceCluster":"cluster1", "lighthouse.submariner.io/sourceName":"nginx-demo", "lighthouse.submariner.io/sourceNamespace":"default", "multicluster.kubernetes.io/service-name":"nginx-demo-default-cluster1"}, Annotations:map[string]string(nil), OwnerReferences:[]v1.OwnerReference(nil), Finalizers:[]string(nil), ClusterName:"", ManagedFields:[]v1.ManagedFieldsEntry(nil)}, AddressType:"IPv4", Endpoints:[]v1beta1.Endpoint(nil), Ports:[]v1beta1.EndpointPort(nil)}
2021-07-18T14:19:58.5918093Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-b4r66 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.5922454Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-b4r66 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.5936783Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-b4r66 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:58.9031211Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-b4r66 ***
2021-07-18T14:19:58.9053410Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-b4r66 ***
2021-07-18T14:19:58.9059015Z ====================================================================
2021-07-18T14:19:58.9065073Z ##[endgroup]
2021-07-18T14:19:58.9071788Z ##[group]*** submariner-lighthouse-coredns-68766559c4-b4r66 ***
2021-07-18T14:19:58.9081987Z ======================= *** submariner-lighthouse-coredns-68766559c4-b4r66 *** =======================
2021-07-18T14:19:58.9096384Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-b4r66
2021-07-18T14:19:58.9116157Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-b4r66
2021-07-18T14:19:58.9133409Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-b4r66
2021-07-18T14:19:59.2200738Z W0718 14:16:00.787821 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:19:59.2201967Z I0718 14:16:00.788522 1 controller.go:65] Starting ServiceImport Controller
2021-07-18T14:19:59.2202749Z I0718 14:16:00.889736 1 controller.go:69] Starting EndpointSlice Controller
2021-07-18T14:19:59.2203694Z I0718 14:16:00.890822 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-18T14:19:59.2204501Z I0718 14:16:00.937476 1 controller.go:97] Starting Gateway status Controller
2021-07-18T14:19:59.2205257Z I0718 14:16:01.038771 1 controller.go:56] Starting Services Controller
2021-07-18T14:19:59.2206218Z I0718 14:16:01.039808 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-18T14:19:59.2207853Z clusterset.local.:53
2021-07-18T14:19:59.2208644Z CoreDNS-1.8.3
2021-07-18T14:19:59.2209064Z linux/amd64, go1.16.5,
2021-07-18T14:19:59.2209829Z I0718 14:16:23.559269 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true}
2021-07-18T14:19:59.2253906Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-cj4g2 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:59.2266827Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-cj4g2 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:59.2280367Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-lighthouse-coredns-68766559c4-cj4g2 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:59.5089594Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-cj4g2 ***
2021-07-18T14:19:59.5099912Z [submariner-operator]$ [cluster1] print_section *** submariner-lighthouse-coredns-68766559c4-cj4g2 ***
2021-07-18T14:19:59.5102269Z ====================================================================
2021-07-18T14:19:59.5105640Z ##[endgroup]
2021-07-18T14:19:59.5108731Z ##[group]*** submariner-lighthouse-coredns-68766559c4-cj4g2 ***
2021-07-18T14:19:59.5114280Z ======================= *** submariner-lighthouse-coredns-68766559c4-cj4g2 *** =======================
2021-07-18T14:19:59.5123865Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-cj4g2
2021-07-18T14:19:59.5139355Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-cj4g2
2021-07-18T14:19:59.5155832Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-lighthouse-coredns-68766559c4-cj4g2
2021-07-18T14:19:59.8746422Z W0718 14:16:00.706242 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:19:59.8747648Z I0718 14:16:00.706599 1 controller.go:65] Starting ServiceImport Controller
2021-07-18T14:19:59.8748530Z I0718 14:16:00.807403 1 controller.go:69] Starting EndpointSlice Controller
2021-07-18T14:19:59.8749405Z I0718 14:16:00.808868 1 controller.go:69] Setting localClusterID from env: "cluster1"
2021-07-18T14:19:59.8750596Z I0718 14:16:00.822642 1 controller.go:97] Starting Gateway status Controller
2021-07-18T14:19:59.8751676Z I0718 14:16:00.923512 1 controller.go:56] Starting Services Controller
2021-07-18T14:19:59.8752319Z clusterset.local.:53
2021-07-18T14:19:59.8753009Z CoreDNS-1.8.3
2021-07-18T14:19:59.8753441Z linux/amd64, go1.16.5,
2021-07-18T14:19:59.8754157Z I0718 14:16:00.925290 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true}
2021-07-18T14:19:59.8755468Z I0718 14:16:23.563233 1 controller.go:200] Updating the gateway status map[string]bool{"cluster1":true, "cluster2":true}
2021-07-18T14:19:59.8808971Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-5bfdb87494-nnbw8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:59.8821811Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-operator-5bfdb87494-nnbw8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:19:59.8836919Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-operator-5bfdb87494-nnbw8 -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:00.1852349Z [submariner-operator]$ [cluster1] print_section *** submariner-operator-5bfdb87494-nnbw8 ***
2021-07-18T14:20:00.1862868Z [submariner-operator]$ [cluster1] print_section *** submariner-operator-5bfdb87494-nnbw8 ***
2021-07-18T14:20:00.1870918Z ====================================================================
2021-07-18T14:20:00.1871490Z ##[endgroup]
2021-07-18T14:20:00.1872765Z ##[group]*** submariner-operator-5bfdb87494-nnbw8 ***
2021-07-18T14:20:00.1874302Z ======================= *** submariner-operator-5bfdb87494-nnbw8 *** =======================
2021-07-18T14:20:00.1882202Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-5bfdb87494-nnbw8
2021-07-18T14:20:00.1893461Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-operator-5bfdb87494-nnbw8
2021-07-18T14:20:00.1904796Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-operator-5bfdb87494-nnbw8
2021-07-18T14:20:00.5012936Z I0718 14:15:34.214132 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-18T14:20:00.5013636Z I0718 14:15:34.214727 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-18T14:20:00.5014945Z I0718 14:15:34.214782 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-18T14:20:00.5015967Z I0718 14:15:34.214803 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-18T14:20:00.5017746Z I0718 14:15:34.215134 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-18T14:20:00.5019268Z I0718 14:15:34.829211 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-pztq6"
2021-07-18T14:20:00.5020370Z I0718 14:15:34.854195 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-18T14:20:00.5021106Z I0718 14:15:36.013464 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-18T14:20:00.5022045Z I0718 14:15:38.399054 1 leader.go:171] leader "msg"="Leader pod has been deleted, waiting for garbage collection to remove the lock."
2021-07-18T14:20:00.5022960Z I0718 14:15:43.049077 1 leader.go:149] leader "msg"="Became the leader."
2021-07-18T14:20:00.5024179Z I0718 14:15:43.671024 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-18T14:20:00.5025102Z I0718 14:15:43.671924 1 main.go:129] cmd "msg"="Registering Components."
2021-07-18T14:20:00.5025828Z I0718 14:15:43.672454 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-18T14:20:00.5026816Z I0718 14:15:47.802526 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5029082Z I0718 14:15:47.802563 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5030423Z I0718 14:15:47.802751 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-18T14:20:00.5032001Z I0718 14:15:47.803152 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-18T14:20:00.5072194Z I0718 14:15:47.803778 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:20:00.5089026Z I0718 14:15:47.804110 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:20:00.5100104Z I0718 14:15:47.804393 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:20:00.5104951Z I0718 14:15:47.804659 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:20:00.5108493Z I0718 14:15:47.804913 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-18T14:20:00.5111069Z I0718 14:15:47.905009 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:20:00.5113408Z I0718 14:15:47.910113 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-18T14:20:00.5115550Z I0718 14:15:47.905351 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5117545Z I0718 14:15:47.910274 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-18T14:20:00.5120401Z I0718 14:15:47.927747 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:20:00.5124649Z I0718 14:15:47.927874 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-18T14:20:00.5128527Z I0718 14:15:47.927946 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:20:00.5131141Z I0718 14:15:48.028512 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-18T14:20:00.5133094Z I0718 14:15:48.028644 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:20:00.5135090Z I0718 14:15:48.028848 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-18T14:20:00.5137189Z I0718 14:15:48.028967 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-18T14:20:00.5139363Z I0718 14:15:48.029130 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5143262Z I0718 14:15:48.029325 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-18T14:20:00.5146827Z E0718 14:15:48.100257 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5149180Z I0718 14:15:48.130213 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-18T14:20:00.5155624Z I0718 14:15:48.130414 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-18T14:20:00.5157654Z I0718 14:15:48.130621 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5160337Z E0718 14:15:48.284187 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5162911Z I0718 14:15:48.298743 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5164987Z I0718 14:15:48.459270 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5167061Z I0718 14:15:48.459645 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5171152Z E0718 14:15:48.506615 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5174534Z E0718 14:15:48.575001 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5177740Z E0718 14:15:48.682391 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5181092Z E0718 14:15:48.859655 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5184966Z E0718 14:15:49.079838 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5188279Z E0718 14:15:49.460427 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5192341Z E0718 14:15:50.165851 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5195059Z I0718 14:15:50.718141 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5196886Z I0718 14:15:50.718753 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5198344Z I0718 14:15:50.763389 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-18T14:20:00.5200902Z I0718 14:15:50.763418 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-18T14:20:00.5202281Z I0718 14:15:50.763428 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5226830Z I0718 14:15:50.763437 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5228343Z I0718 14:15:50.764068 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-18T14:20:00.5230300Z I0718 14:15:50.764097 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-18T14:20:00.5231666Z I0718 14:15:50.764109 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5233112Z I0718 14:15:50.764119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5235903Z I0718 14:15:50.771084 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5251246Z E0718 14:15:50.779430 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-18T14:20:00.5254733Z I0718 14:15:50.779473 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5256122Z I0718 14:15:50.779503 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5257229Z I0718 14:15:50.779517 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5259301Z I0718 14:15:50.794536 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5265414Z I0718 14:15:50.854903 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5293828Z I0718 14:15:50.907765 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5298216Z I0718 14:15:51.461091 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5305233Z I0718 14:15:51.476130 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5308417Z E0718 14:15:51.476235 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-18T14:20:00.5311593Z I0718 14:15:51.476272 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5313150Z I0718 14:15:51.476304 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5314593Z I0718 14:15:51.476316 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5325112Z I0718 14:15:51.516876 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5329154Z I0718 14:15:51.528911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5335571Z I0718 14:15:51.540953 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5338542Z I0718 14:15:51.557902 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5345741Z I0718 14:15:51.569677 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-18T14:20:00.5349684Z I0718 14:15:51.581972 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5355789Z I0718 14:15:51.619762 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5359738Z I0718 14:15:51.620203 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5364172Z E0718 14:15:51.620285 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:20:00.5367759Z I0718 14:15:51.620538 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5374291Z E0718 14:15:51.648985 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:20:00.5378041Z I0718 14:15:51.654490 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5390527Z I0718 14:15:51.677490 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5393854Z I0718 14:15:51.845425 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5421187Z I0718 14:15:51.850591 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5424412Z I0718 14:15:51.851153 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5428995Z I0718 14:15:51.851169 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5432177Z E0718 14:15:51.864674 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5435820Z I0718 14:15:51.873022 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5439470Z I0718 14:15:51.875867 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5442819Z I0718 14:15:51.930701 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5466951Z I0718 14:15:51.938239 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5475994Z I0718 14:15:52.275126 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5478886Z I0718 14:15:52.370328 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5483546Z E0718 14:15:52.416338 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5496194Z I0718 14:15:52.417348 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5499415Z I0718 14:15:52.417511 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5501016Z I0718 14:15:52.417526 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5503546Z I0718 14:15:52.465349 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5506540Z I0718 14:15:52.483769 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5509407Z I0718 14:15:52.508063 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5512867Z I0718 14:15:52.565154 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5516274Z I0718 14:15:52.566850 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5539208Z I0718 14:15:52.595892 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-18T14:20:00.5545956Z E0718 14:15:52.595939 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-18T14:20:00.5551321Z E0718 14:15:52.595980 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:20:00.5565280Z I0718 14:15:52.596005 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5568981Z E0718 14:15:52.624248 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-18T14:20:00.5582410Z E0718 14:15:52.624293 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:20:00.5586651Z I0718 14:15:52.624641 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5589520Z I0718 14:15:52.626154 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5594867Z I0718 14:15:52.640845 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5598102Z I0718 14:15:52.682337 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5602942Z I0718 14:15:52.693839 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5604594Z I0718 14:15:52.693885 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5606047Z I0718 14:15:52.693912 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5611682Z I0718 14:15:52.714452 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5633448Z I0718 14:15:52.714788 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5641843Z I0718 14:15:52.721571 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5645010Z I0718 14:15:52.792253 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5652443Z I0718 14:15:53.114269 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5655618Z I0718 14:15:53.128088 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5660072Z E0718 14:15:53.143256 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5663206Z I0718 14:15:53.143300 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5664753Z I0718 14:15:53.143354 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5666163Z I0718 14:15:53.143373 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5686313Z I0718 14:15:53.179198 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5691855Z I0718 14:15:53.186118 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5695173Z I0718 14:15:53.327100 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5706797Z I0718 14:15:53.334569 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5714598Z I0718 14:15:53.357905 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5718021Z I0718 14:15:53.369702 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5721374Z I0718 14:15:53.402141 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5730413Z I0718 14:15:53.433128 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5741877Z E0718 14:15:53.433223 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-18T14:20:00.5745947Z E0718 14:15:53.433286 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-18T14:20:00.5750011Z I0718 14:15:53.433340 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5762239Z I0718 14:15:53.563022 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5765896Z I0718 14:15:53.707491 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5780022Z E0718 14:15:53.829862 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists"
2021-07-18T14:20:00.5787651Z E0718 14:15:53.829926 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: services \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-18T14:20:00.5791868Z I0718 14:15:53.830135 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5795105Z I0718 14:15:53.850057 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5798089Z I0718 14:15:53.918817 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5801353Z I0718 14:15:53.931038 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5804863Z I0718 14:15:54.009686 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5808029Z I0718 14:15:54.049248 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5811433Z I0718 14:15:54.551627 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5815371Z I0718 14:15:54.578342 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5819047Z I0718 14:15:54.704241 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5823513Z I0718 14:15:54.813292 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5828972Z I0718 14:15:54.813690 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5833417Z I0718 14:15:54.994832 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5839780Z I0718 14:15:55.616349 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5844717Z I0718 14:15:55.807094 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5857303Z I0718 14:15:55.807262 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.5863529Z E0718 14:15:55.811268 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.5866576Z I0718 14:15:55.818256 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5870347Z I0718 14:15:55.985216 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5873819Z I0718 14:15:56.028650 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5877570Z I0718 14:15:56.082881 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5882770Z I0718 14:15:56.083545 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5887093Z I0718 14:15:56.083590 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.5891328Z I0718 14:15:56.695796 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5895111Z I0718 14:15:56.721026 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5898737Z I0718 14:15:56.760454 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5911695Z I0718 14:15:57.396599 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5915320Z I0718 14:15:57.445476 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5920409Z I0718 14:15:57.445535 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.5924036Z I0718 14:15:57.451380 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5925936Z I0718 14:15:57.451421 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5927225Z I0718 14:15:57.451430 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5929680Z I0718 14:15:57.519645 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5932828Z I0718 14:15:57.551612 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5935966Z I0718 14:15:58.188923 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5940150Z I0718 14:15:58.358619 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5942851Z I0718 14:15:58.462157 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5944416Z I0718 14:15:58.462197 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5945679Z I0718 14:15:58.462207 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5947514Z I0718 14:15:58.471956 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5949051Z I0718 14:15:58.471986 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.5951490Z I0718 14:15:58.471995 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.5954294Z I0718 14:15:58.661377 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5957654Z I0718 14:15:58.661867 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5960790Z I0718 14:15:58.690884 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5963979Z I0718 14:15:58.691172 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5967153Z I0718 14:15:59.183953 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.5982049Z I0718 14:15:59.261316 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.5986205Z I0718 14:15:59.295660 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.5989408Z I0718 14:15:59.300668 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5992897Z I0718 14:15:59.308441 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.5996208Z I0718 14:15:59.336600 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.5999228Z I0718 14:15:59.337227 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6002117Z I0718 14:15:59.426367 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6003656Z I0718 14:15:59.427465 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6004962Z I0718 14:15:59.427555 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6007805Z E0718 14:15:59.433890 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6011243Z I0718 14:15:59.433924 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6012782Z I0718 14:15:59.433966 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6014280Z I0718 14:15:59.433976 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6016432Z I0718 14:15:59.459765 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6019303Z I0718 14:15:59.461245 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6022681Z I0718 14:15:59.468890 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6025777Z I0718 14:15:59.525590 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6028725Z I0718 14:15:59.902136 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6032589Z I0718 14:15:59.931255 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.6036531Z I0718 14:15:59.941897 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6039625Z I0718 14:16:00.076387 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6042885Z I0718 14:16:00.106925 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6046120Z I0718 14:16:00.134397 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6049277Z I0718 14:16:00.182543 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6054535Z I0718 14:16:00.550072 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6057777Z I0718 14:16:00.566241 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6062969Z I0718 14:16:00.566285 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.6067212Z I0718 14:16:00.939687 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6069252Z I0718 14:16:00.939734 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6070771Z I0718 14:16:00.939744 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6073171Z I0718 14:16:00.977305 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6076233Z I0718 14:16:01.045850 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6079244Z I0718 14:16:01.082430 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6082488Z I0718 14:16:01.210062 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.6086056Z I0718 14:16:01.231281 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6089489Z E0718 14:16:01.412965 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.6092544Z I0718 14:16:01.647757 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6095673Z I0718 14:16:01.655401 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6098098Z I0718 14:16:01.699303 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6099667Z I0718 14:16:01.699355 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6101429Z I0718 14:16:01.699367 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6103323Z I0718 14:16:01.700601 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6104943Z I0718 14:16:01.700641 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6106163Z I0718 14:16:01.700651 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6108233Z I0718 14:16:01.792394 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6111360Z I0718 14:16:01.799301 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6116640Z I0718 14:16:01.814603 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6119364Z I0718 14:16:01.821073 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6122811Z I0718 14:16:01.852367 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6126309Z I0718 14:16:01.871387 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.6129918Z I0718 14:16:01.907618 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6134126Z I0718 14:16:02.424194 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6136701Z I0718 14:16:02.427370 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6139322Z I0718 14:16:02.439854 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6142612Z I0718 14:16:02.440753 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6146218Z E0718 14:16:02.490765 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6148691Z I0718 14:16:02.491436 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6150673Z I0718 14:16:02.491584 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6152847Z I0718 14:16:02.491693 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6155878Z I0718 14:16:02.491309 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6170918Z I0718 14:16:02.496299 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6172206Z I0718 14:16:02.503493 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6174657Z I0718 14:16:02.505810 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6177509Z I0718 14:16:02.533178 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6180386Z I0718 14:16:02.548193 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6183791Z I0718 14:16:02.548423 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6186806Z I0718 14:16:02.555199 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6190973Z I0718 14:16:02.568731 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.6194957Z I0718 14:16:02.573223 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6198847Z I0718 14:16:02.606703 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6202515Z I0718 14:16:02.651231 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.6206842Z I0718 14:16:02.658310 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6210743Z I0718 14:16:03.151435 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6213922Z I0718 14:16:03.161692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6216542Z I0718 14:16:03.176980 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6219208Z I0718 14:16:03.186617 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6222394Z I0718 14:16:03.273516 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6225703Z I0718 14:16:03.280584 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:20:00.6228867Z I0718 14:16:03.285648 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6232108Z I0718 14:16:03.477947 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6233784Z I0718 14:16:03.478140 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6235153Z I0718 14:16:03.478306 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6237181Z I0718 14:16:03.491863 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6239832Z I0718 14:16:03.500067 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6243222Z I0718 14:16:03.888047 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6246225Z I0718 14:16:03.890168 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6250366Z I0718 14:16:03.890246 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.4.152\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-18T14:20:00.6255966Z I0718 14:16:04.102432 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6258868Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-246bf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:00.6261339Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-246bf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:00.6264870Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-246bf -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:00.6267383Z I0718 14:16:04.110719 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6269589Z I0718 14:16:04.127439 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6272006Z I0718 14:16:04.127475 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6273688Z I0718 14:16:04.127704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6275089Z I0718 14:16:04.127795 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6276188Z I0718 14:16:04.127743 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6277286Z I0718 14:16:04.127876 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6279315Z I0718 14:16:04.137346 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6282323Z I0718 14:16:04.138048 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6285499Z I0718 14:16:04.145833 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6288688Z I0718 14:16:04.146096 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6292043Z I0718 14:16:04.748239 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6295191Z I0718 14:16:04.749462 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6297835Z I0718 14:16:04.759356 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6300963Z I0718 14:16:04.765372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6305021Z E0718 14:16:11.731457 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.6307289Z I0718 14:16:23.560473 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6308633Z I0718 14:16:23.560718 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6309853Z I0718 14:16:23.560741 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6312340Z I0718 14:16:23.594715 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6315337Z I0718 14:16:23.604913 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6318033Z I0718 14:16:24.207285 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6320930Z I0718 14:16:24.214766 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6323360Z I0718 14:16:24.238490 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6324976Z I0718 14:16:24.238544 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6326236Z I0718 14:16:24.238556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6327961Z I0718 14:16:24.243575 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6329762Z I0718 14:16:24.243634 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6331729Z I0718 14:16:24.243654 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6334342Z I0718 14:16:24.270382 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6337933Z I0718 14:16:24.271311 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6341921Z I0718 14:16:24.296833 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6345517Z I0718 14:16:24.298218 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6348257Z I0718 14:16:24.898921 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6351841Z I0718 14:16:24.899956 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6359722Z I0718 14:16:24.907558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6363531Z I0718 14:16:24.908904 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6366213Z I0718 14:16:28.591783 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6367651Z I0718 14:16:28.591836 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6368920Z I0718 14:16:28.591864 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6373366Z I0718 14:16:28.604492 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6376733Z I0718 14:16:28.608958 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6379370Z I0718 14:16:29.211208 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6382551Z I0718 14:16:29.216851 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6385271Z I0718 14:16:29.227113 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6386619Z I0718 14:16:29.227156 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6387726Z I0718 14:16:29.227167 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6389347Z I0718 14:16:29.228335 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6391279Z I0718 14:16:29.228362 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6392553Z I0718 14:16:29.228371 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6395125Z I0718 14:16:29.236083 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6397707Z I0718 14:16:29.236418 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6401194Z I0718 14:16:29.240483 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6404484Z I0718 14:16:29.241737 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6407333Z I0718 14:16:29.843084 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6415970Z I0718 14:16:29.845330 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6418809Z I0718 14:16:29.859109 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6422237Z I0718 14:16:29.859568 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6425427Z E0718 14:16:32.331388 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.6427675Z I0718 14:16:33.618658 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6429119Z I0718 14:16:33.618717 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6430522Z I0718 14:16:33.618731 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6433029Z I0718 14:16:33.632952 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6436170Z I0718 14:16:33.643096 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6438987Z I0718 14:16:34.245428 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6443038Z I0718 14:16:34.251993 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6446280Z I0718 14:16:34.264391 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6447865Z I0718 14:16:34.264431 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6449187Z I0718 14:16:34.264452 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6451674Z I0718 14:16:34.272324 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6453221Z I0718 14:16:34.272366 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6454523Z I0718 14:16:34.272376 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6460286Z I0718 14:16:34.279945 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6463456Z I0718 14:16:34.296241 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6470674Z I0718 14:16:34.304808 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6474881Z I0718 14:16:34.328521 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6478485Z I0718 14:16:34.906832 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6481821Z I0718 14:16:34.914192 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6484986Z I0718 14:16:34.932904 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6488590Z I0718 14:16:34.939783 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6491393Z I0718 14:16:38.650278 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6492953Z I0718 14:16:38.650356 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6494385Z I0718 14:16:38.650368 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6497007Z I0718 14:16:38.658626 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6501101Z I0718 14:16:38.661870 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6504328Z I0718 14:16:39.264012 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6507096Z I0718 14:16:39.269951 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6510143Z I0718 14:16:39.279203 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6512202Z I0718 14:16:39.279289 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6513490Z I0718 14:16:39.279309 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6516081Z I0718 14:16:39.285394 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6517610Z I0718 14:16:39.285430 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6519064Z I0718 14:16:39.285513 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6522129Z I0718 14:16:39.289674 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6525477Z I0718 14:16:39.293578 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6528383Z I0718 14:16:39.296875 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6532145Z I0718 14:16:39.298251 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6536750Z I0718 14:16:39.900011 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6539742Z I0718 14:16:39.902870 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6543306Z I0718 14:16:39.908763 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6546419Z I0718 14:16:39.909832 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6548911Z I0718 14:16:43.668025 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6550975Z I0718 14:16:43.668103 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6552255Z I0718 14:16:43.668114 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6554650Z I0718 14:16:43.676728 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6558523Z I0718 14:16:43.680079 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6562545Z I0718 14:16:44.283289 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6565719Z I0718 14:16:44.294070 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6568078Z I0718 14:16:44.304497 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6569501Z I0718 14:16:44.304542 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6571280Z I0718 14:16:44.304553 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6573910Z I0718 14:16:44.315289 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6576218Z I0718 14:16:44.315758 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6577792Z I0718 14:16:44.315917 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6579013Z I0718 14:16:44.315939 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6581821Z I0718 14:16:44.324542 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6584933Z I0718 14:16:44.326110 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6587753Z I0718 14:16:44.335881 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6591338Z I0718 14:16:44.927440 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6595410Z I0718 14:16:44.933500 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6599380Z I0718 14:16:44.937583 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6603957Z I0718 14:16:44.945446 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6607363Z I0718 14:16:48.683551 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6609226Z I0718 14:16:48.683603 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6610981Z I0718 14:16:48.683614 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6613653Z I0718 14:16:48.693486 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6616774Z I0718 14:16:48.697028 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6620745Z I0718 14:16:49.298814 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6624236Z I0718 14:16:49.305219 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6626600Z I0718 14:16:49.314512 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6628032Z I0718 14:16:49.314558 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6629217Z I0718 14:16:49.314569 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6631624Z I0718 14:16:49.315072 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6633149Z I0718 14:16:49.315173 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6634577Z I0718 14:16:49.315282 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6636921Z I0718 14:16:49.328243 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6640042Z I0718 14:16:49.328243 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6643811Z I0718 14:16:49.332833 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6646685Z I0718 14:16:49.333903 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6649500Z I0718 14:16:49.934542 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6652968Z I0718 14:16:49.936038 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6655916Z I0718 14:16:49.943709 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6662397Z I0718 14:16:49.944472 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6667592Z I0718 14:16:53.702899 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6669321Z I0718 14:16:53.702955 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6671140Z I0718 14:16:53.702965 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6673525Z I0718 14:16:53.713035 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6678919Z I0718 14:16:53.717446 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6682503Z I0718 14:16:54.319118 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6685558Z I0718 14:16:54.326162 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6688017Z I0718 14:16:54.341042 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6689462Z I0718 14:16:54.341085 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6691195Z I0718 14:16:54.341095 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6708182Z I0718 14:16:54.347361 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6712103Z I0718 14:16:54.347523 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6713578Z I0718 14:16:54.347620 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6716553Z I0718 14:16:54.353987 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6719783Z I0718 14:16:54.356640 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6724719Z I0718 14:16:54.360013 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6730310Z I0718 14:16:54.370746 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6733442Z I0718 14:16:54.961447 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6736389Z I0718 14:16:54.967738 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6739293Z I0718 14:16:54.973603 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6742552Z I0718 14:16:54.979863 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6745136Z I0718 14:16:58.722962 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6746707Z I0718 14:16:58.723047 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6747832Z I0718 14:16:58.723059 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6750026Z I0718 14:16:58.732558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6753459Z I0718 14:16:58.738439 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6756789Z I0718 14:16:59.340830 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6759395Z I0718 14:16:59.346543 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6762557Z I0718 14:16:59.356001 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6764411Z I0718 14:16:59.356075 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6766128Z I0718 14:16:59.356093 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6767844Z I0718 14:16:59.359920 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6769185Z I0718 14:16:59.359975 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6770411Z I0718 14:16:59.359986 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6773066Z I0718 14:16:59.365548 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6775917Z I0718 14:16:59.368393 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6779503Z I0718 14:16:59.371214 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6782889Z I0718 14:16:59.373213 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6785876Z I0718 14:16:59.972923 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6788450Z I0718 14:16:59.975490 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6791992Z I0718 14:16:59.979361 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6795119Z I0718 14:16:59.983677 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6797585Z I0718 14:17:03.741421 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6799103Z I0718 14:17:03.741490 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6800332Z I0718 14:17:03.741501 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6802757Z I0718 14:17:03.752362 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6806054Z I0718 14:17:03.761066 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6808961Z I0718 14:17:04.363489 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6812083Z I0718 14:17:04.371263 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6814810Z I0718 14:17:04.380519 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6816172Z I0718 14:17:04.380562 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6817285Z I0718 14:17:04.380646 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6818958Z I0718 14:17:04.385170 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6820434Z I0718 14:17:04.385272 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6821820Z I0718 14:17:04.385296 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6824193Z I0718 14:17:04.390412 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6826842Z I0718 14:17:04.395614 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6829480Z I0718 14:17:04.397363 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6833322Z I0718 14:17:04.409287 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6837290Z I0718 14:17:04.997746 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6841744Z I0718 14:17:05.004157 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6845516Z I0718 14:17:05.012755 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6848337Z I0718 14:17:05.017823 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6851981Z I0718 14:17:08.761568 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6853523Z I0718 14:17:08.761619 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6854902Z I0718 14:17:08.761630 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6857540Z I0718 14:17:08.774196 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6861964Z I0718 14:17:08.778039 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6866410Z I0718 14:17:09.380434 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6912056Z I0718 14:17:09.387506 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6914839Z I0718 14:17:09.425217 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6916522Z I0718 14:17:09.425484 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6917717Z I0718 14:17:09.425603 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6919587Z I0718 14:17:09.425257 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6921228Z I0718 14:17:09.425839 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6922508Z I0718 14:17:09.425855 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6924886Z I0718 14:17:09.452623 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6927766Z I0718 14:17:09.453617 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6930874Z I0718 14:17:09.458330 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6934372Z I0718 14:17:09.461681 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.6937620Z I0718 14:17:10.060029 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6940709Z I0718 14:17:10.063869 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.6943902Z I0718 14:17:10.068560 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6946993Z I0718 14:17:10.075898 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6950244Z E0718 14:17:13.365734 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.6991922Z I0718 14:17:13.788648 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.6993382Z I0718 14:17:13.788728 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.6994583Z I0718 14:17:13.788739 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.6996775Z I0718 14:17:13.797660 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.6999814Z I0718 14:17:13.800994 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7002763Z I0718 14:17:14.402689 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7005702Z I0718 14:17:14.409368 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7008150Z I0718 14:17:14.419159 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7009713Z I0718 14:17:14.419206 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7010889Z I0718 14:17:14.419217 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7012860Z I0718 14:17:14.423611 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7014296Z I0718 14:17:14.423696 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7015463Z I0718 14:17:14.423790 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7017642Z I0718 14:17:14.437842 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7020658Z I0718 14:17:14.441758 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7023734Z I0718 14:17:14.459149 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7026617Z I0718 14:17:14.459708 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7029440Z I0718 14:17:15.061757 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7032832Z I0718 14:17:15.062037 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7035915Z I0718 14:17:15.069362 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7038755Z I0718 14:17:15.070880 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7041243Z I0718 14:17:18.799980 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7042733Z I0718 14:17:18.800039 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7044061Z I0718 14:17:18.800049 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7046500Z I0718 14:17:18.808522 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7049830Z I0718 14:17:18.811850 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7053074Z I0718 14:17:19.414380 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7056161Z I0718 14:17:19.419774 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7058508Z I0718 14:17:19.430645 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7059938Z I0718 14:17:19.430705 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7061355Z I0718 14:17:19.430853 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7082387Z I0718 14:17:19.430821 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7084062Z I0718 14:17:19.431179 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7085638Z I0718 14:17:19.431201 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7088115Z I0718 14:17:19.439183 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7091130Z I0718 14:17:19.439765 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7094282Z I0718 14:17:19.442959 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7097432Z I0718 14:17:19.443096 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7100457Z I0718 14:17:20.045116 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7103591Z I0718 14:17:20.045476 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7106646Z I0718 14:17:20.054611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7109525Z I0718 14:17:20.055244 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7112289Z I0718 14:17:23.828781 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7114061Z I0718 14:17:23.828839 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7115359Z I0718 14:17:23.828849 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7117675Z I0718 14:17:23.838392 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7120847Z I0718 14:17:23.848260 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7124160Z I0718 14:17:24.450374 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7127249Z I0718 14:17:24.456716 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7129824Z I0718 14:17:24.465988 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7134234Z I0718 14:17:24.466064 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7135486Z I0718 14:17:24.466187 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7137323Z I0718 14:17:24.468061 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7138746Z I0718 14:17:24.468210 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7139925Z I0718 14:17:24.468312 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7142505Z I0718 14:17:24.479987 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7145407Z I0718 14:17:24.482457 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7148238Z I0718 14:17:24.483785 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7151878Z I0718 14:17:24.486774 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7155136Z I0718 14:17:25.085684 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7158115Z I0718 14:17:25.091316 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7160899Z I0718 14:17:25.092287 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7165518Z I0718 14:17:25.096280 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7168424Z I0718 14:17:28.847603 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7169862Z I0718 14:17:28.847674 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7171040Z I0718 14:17:28.847686 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7173598Z I0718 14:17:28.857576 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7176690Z I0718 14:17:28.861333 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7179509Z I0718 14:17:29.462955 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7182661Z I0718 14:17:29.468679 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7185192Z I0718 14:17:29.479053 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7186801Z I0718 14:17:29.479245 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7188040Z I0718 14:17:29.479392 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7189968Z I0718 14:17:29.481261 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7191526Z I0718 14:17:29.481303 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7193005Z I0718 14:17:29.481317 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7195505Z I0718 14:17:29.489259 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7198570Z I0718 14:17:29.489967 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7201580Z I0718 14:17:29.494873 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7206293Z I0718 14:17:29.495309 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7209573Z I0718 14:17:30.097148 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7213990Z I0718 14:17:30.099149 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7220003Z I0718 14:17:30.106238 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7223384Z I0718 14:17:30.109746 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7226807Z I0718 14:17:33.863087 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7228364Z I0718 14:17:33.863154 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7229676Z I0718 14:17:33.863165 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7232826Z I0718 14:17:33.879388 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7235905Z I0718 14:17:33.882754 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7238989Z I0718 14:17:34.484080 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7246804Z I0718 14:17:34.490538 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7249396Z I0718 14:17:34.500432 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7251017Z I0718 14:17:34.500680 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7252446Z I0718 14:17:34.500731 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7254313Z I0718 14:17:34.502653 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7255927Z I0718 14:17:34.502745 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7257095Z I0718 14:17:34.502840 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7259354Z I0718 14:17:34.513544 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7262430Z I0718 14:17:34.513570 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7267142Z I0718 14:17:34.519228 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7270669Z I0718 14:17:34.520188 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7274122Z I0718 14:17:35.121274 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7277189Z I0718 14:17:35.123442 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7279979Z I0718 14:17:35.129869 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7283134Z I0718 14:17:35.129869 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7285661Z I0718 14:17:38.891552 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7287317Z I0718 14:17:38.891642 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7288543Z I0718 14:17:38.891660 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7290809Z I0718 14:17:38.901027 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7294241Z I0718 14:17:38.904268 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7297248Z I0718 14:17:39.508406 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7300016Z I0718 14:17:39.516462 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7302810Z I0718 14:17:39.527965 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7304425Z I0718 14:17:39.528012 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7305886Z I0718 14:17:39.528619 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7307628Z I0718 14:17:39.528502 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7309055Z I0718 14:17:39.530231 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7312284Z I0718 14:17:39.530320 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7314789Z I0718 14:17:39.537009 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7317775Z I0718 14:17:39.541744 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7320584Z I0718 14:17:39.542875 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7323948Z I0718 14:17:39.561211 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7327329Z I0718 14:17:40.145356 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7330709Z I0718 14:17:40.163079 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7333713Z I0718 14:17:40.169558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7338734Z I0718 14:17:40.170854 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7342622Z I0718 14:17:43.911139 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7344679Z I0718 14:17:43.911222 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7346649Z I0718 14:17:43.911233 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7349007Z I0718 14:17:43.925702 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7353811Z I0718 14:17:43.929153 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7357377Z I0718 14:17:44.532261 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7360207Z I0718 14:17:44.539534 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7363003Z I0718 14:17:44.548916 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7366333Z I0718 14:17:44.548959 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7368078Z I0718 14:17:44.549062 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7370070Z I0718 14:17:44.548924 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7378430Z I0718 14:17:44.549409 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7379624Z I0718 14:17:44.549551 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7381923Z I0718 14:17:44.555952 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7385144Z I0718 14:17:44.562113 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7388051Z I0718 14:17:44.566680 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7390894Z I0718 14:17:44.572443 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7394394Z I0718 14:17:45.168743 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7409065Z I0718 14:17:45.174951 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7412509Z I0718 14:17:45.174960 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7415847Z I0718 14:17:45.181130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7418053Z I0718 14:17:48.934149 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7419388Z I0718 14:17:48.934212 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7420501Z I0718 14:17:48.934223 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7427265Z I0718 14:17:48.952389 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7430342Z I0718 14:17:48.955487 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7433718Z I0718 14:17:49.557599 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7436813Z I0718 14:17:49.562556 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7440209Z I0718 14:17:49.570186 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7442340Z I0718 14:17:49.570224 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7443658Z I0718 14:17:49.570233 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7445710Z I0718 14:17:49.571712 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7447328Z I0718 14:17:49.571753 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7448596Z I0718 14:17:49.571765 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7450858Z I0718 14:17:49.580402 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7454463Z I0718 14:17:49.580864 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7457792Z I0718 14:17:49.585226 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7461433Z I0718 14:17:49.587141 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7467040Z I0718 14:17:50.188794 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7471373Z I0718 14:17:50.197140 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7474418Z I0718 14:17:50.201616 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7477524Z I0718 14:17:50.207505 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7479880Z I0718 14:17:53.968155 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7481319Z I0718 14:17:53.968236 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7482861Z I0718 14:17:53.968283 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7485176Z I0718 14:17:53.977798 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7488241Z I0718 14:17:53.982509 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7491040Z I0718 14:17:54.584172 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7494222Z I0718 14:17:54.590589 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7497104Z I0718 14:17:54.599388 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7498723Z I0718 14:17:54.599759 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7499917Z I0718 14:17:54.599919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7501659Z I0718 14:17:54.602272 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7503552Z I0718 14:17:54.602720 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7504845Z I0718 14:17:54.603157 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7507320Z I0718 14:17:54.612345 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7513443Z I0718 14:17:54.613359 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7516854Z I0718 14:17:54.616483 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7519752Z I0718 14:17:54.617777 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7523523Z I0718 14:17:55.218060 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7526814Z I0718 14:17:55.220412 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7529994Z I0718 14:17:55.224345 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7533671Z I0718 14:17:55.226368 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7536792Z I0718 14:17:58.980121 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7538275Z I0718 14:17:58.980190 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7539590Z I0718 14:17:58.980202 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7542050Z I0718 14:17:58.996655 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7545608Z I0718 14:17:59.000704 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7548237Z I0718 14:17:59.604338 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7551266Z I0718 14:17:59.610293 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7554071Z I0718 14:17:59.619107 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7555716Z I0718 14:17:59.619158 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7557044Z I0718 14:17:59.619170 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7558973Z I0718 14:17:59.621616 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7560649Z I0718 14:17:59.621659 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7561874Z I0718 14:17:59.621670 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7564656Z I0718 14:17:59.628536 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7567630Z I0718 14:17:59.630532 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7571222Z I0718 14:17:59.635225 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7574339Z I0718 14:17:59.635245 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7577243Z I0718 14:18:00.237446 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7580976Z I0718 14:18:00.241895 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7584423Z I0718 14:18:00.245730 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7587429Z I0718 14:18:00.251243 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7589627Z I0718 14:18:04.002516 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7591480Z I0718 14:18:04.002573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7593099Z I0718 14:18:04.002583 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7595799Z I0718 14:18:04.010763 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7598731Z I0718 14:18:04.018910 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7602063Z I0718 14:18:04.621269 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7605755Z I0718 14:18:04.627639 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7608179Z I0718 14:18:04.636281 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7609525Z I0718 14:18:04.636323 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7611156Z I0718 14:18:04.636341 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7613375Z I0718 14:18:04.637431 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7614928Z I0718 14:18:04.637468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7616478Z I0718 14:18:04.637478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7618513Z I0718 14:18:04.648158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7621101Z I0718 14:18:04.648633 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7624389Z I0718 14:18:04.651523 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7627410Z I0718 14:18:04.652750 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7630508Z I0718 14:18:05.252862 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7633822Z I0718 14:18:05.256129 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7636989Z I0718 14:18:05.263098 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7639945Z I0718 14:18:05.264026 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7643295Z I0718 14:18:09.025565 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7644804Z I0718 14:18:09.025624 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7646068Z I0718 14:18:09.025634 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7648087Z I0718 14:18:09.040174 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7650741Z I0718 14:18:09.052357 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7653789Z I0718 14:18:09.653961 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7656746Z I0718 14:18:09.659682 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7658959Z I0718 14:18:09.668278 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7660307Z I0718 14:18:09.668353 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7661407Z I0718 14:18:09.668389 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7663714Z I0718 14:18:09.670717 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7665246Z I0718 14:18:09.670925 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7666602Z I0718 14:18:09.671180 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7668619Z I0718 14:18:09.679060 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7681395Z I0718 14:18:09.681012 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7684516Z I0718 14:18:09.684048 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7687832Z I0718 14:18:09.685765 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7691071Z I0718 14:18:10.286085 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7693923Z I0718 14:18:10.287441 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7697223Z I0718 14:18:10.295414 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7700499Z I0718 14:18:10.295564 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7707555Z I0718 14:18:14.041218 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7709113Z I0718 14:18:14.041300 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7712323Z I0718 14:18:14.041319 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7714637Z I0718 14:18:14.048447 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7717809Z I0718 14:18:14.059575 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7722140Z I0718 14:18:14.661427 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7725451Z I0718 14:18:14.668124 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7728138Z I0718 14:18:14.678200 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7729790Z I0718 14:18:14.678245 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7731114Z I0718 14:18:14.678257 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7732862Z I0718 14:18:14.679620 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7734295Z I0718 14:18:14.679679 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7735463Z I0718 14:18:14.679704 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7738039Z I0718 14:18:14.689828 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7741204Z I0718 14:18:14.691624 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7744275Z I0718 14:18:14.695451 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7747519Z I0718 14:18:14.695729 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7750854Z I0718 14:18:15.297666 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7753600Z I0718 14:18:15.297994 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7756323Z I0718 14:18:15.305558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7759592Z I0718 14:18:15.306095 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7762253Z I0718 14:18:19.062697 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7763807Z I0718 14:18:19.062777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7765071Z I0718 14:18:19.062815 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7767553Z I0718 14:18:19.071577 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7770932Z I0718 14:18:19.075177 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7774935Z I0718 14:18:19.677393 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7777941Z I0718 14:18:19.683149 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7780420Z I0718 14:18:19.694171 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7781776Z I0718 14:18:19.694360 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7782891Z I0718 14:18:19.694382 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7784481Z I0718 14:18:19.694182 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7785819Z I0718 14:18:19.694638 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7787234Z I0718 14:18:19.694752 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7789454Z I0718 14:18:19.702697 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7792563Z I0718 14:18:19.703293 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7795219Z I0718 14:18:19.707152 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7798305Z I0718 14:18:19.707758 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7801377Z I0718 14:18:20.308857 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7804808Z I0718 14:18:20.309496 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7808085Z I0718 14:18:20.318645 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7812139Z I0718 14:18:20.320820 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7819388Z I0718 14:18:24.081949 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7820986Z I0718 14:18:24.082017 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7822092Z I0718 14:18:24.082027 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7824173Z I0718 14:18:24.092882 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7827128Z I0718 14:18:24.103090 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7830469Z I0718 14:18:24.704706 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7833338Z I0718 14:18:24.711304 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7835919Z I0718 14:18:24.721843 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7838172Z I0718 14:18:24.721887 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7839965Z I0718 14:18:24.721899 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7842415Z I0718 14:18:24.723106 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7844048Z I0718 14:18:24.723178 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7845447Z I0718 14:18:24.723190 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7848349Z I0718 14:18:24.729960 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7852486Z I0718 14:18:24.732019 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7855841Z I0718 14:18:24.734426 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7859211Z I0718 14:18:24.735793 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7862340Z I0718 14:18:25.335977 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7864973Z I0718 14:18:25.337971 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7867970Z I0718 14:18:25.344201 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7872824Z I0718 14:18:25.345256 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7878275Z I0718 14:18:29.101018 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7879829Z I0718 14:18:29.101072 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7881341Z I0718 14:18:29.101083 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7883365Z I0718 14:18:29.117623 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7887215Z I0718 14:18:29.125060 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7890520Z I0718 14:18:29.727067 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7893158Z I0718 14:18:29.739276 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7895381Z I0718 14:18:29.748097 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7897347Z I0718 14:18:29.748229 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7898623Z I0718 14:18:29.748250 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7900645Z I0718 14:18:29.749979 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7902282Z I0718 14:18:29.750015 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7903533Z I0718 14:18:29.750025 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7906311Z I0718 14:18:29.758017 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7909443Z I0718 14:18:29.759220 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7912383Z I0718 14:18:29.763071 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7915081Z I0718 14:18:29.763657 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7918277Z I0718 14:18:30.365498 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7921318Z I0718 14:18:30.365535 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7923931Z I0718 14:18:30.372242 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7926599Z I0718 14:18:30.373289 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7928809Z I0718 14:18:34.135642 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7930480Z I0718 14:18:34.135697 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7931698Z I0718 14:18:34.135708 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7933937Z I0718 14:18:34.148777 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7937027Z I0718 14:18:34.179353 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7940141Z I0718 14:18:34.781609 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7943280Z I0718 14:18:34.790310 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7946274Z I0718 14:18:34.811640 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7947739Z I0718 14:18:34.811702 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7949211Z I0718 14:18:34.811713 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7951254Z I0718 14:18:34.811916 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7953436Z I0718 14:18:34.812145 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7954808Z I0718 14:18:34.812246 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7958199Z I0718 14:18:34.819696 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7961250Z I0718 14:18:34.822823 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7964760Z I0718 14:18:34.833416 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7967754Z I0718 14:18:34.839041 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.7971033Z E0718 14:18:35.348824 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-18T14:20:00.7974821Z I0718 14:18:35.424234 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7977765Z I0718 14:18:35.429497 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7981239Z I0718 14:18:35.440942 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.7984293Z I0718 14:18:35.445378 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7986931Z I0718 14:18:39.169345 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.7988934Z I0718 14:18:39.169549 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.7990456Z I0718 14:18:39.169715 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.7993252Z I0718 14:18:39.184161 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.7996103Z I0718 14:18:39.188473 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8000107Z I0718 14:18:39.791116 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8004561Z I0718 14:18:39.798205 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8007602Z I0718 14:18:39.808863 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8009973Z I0718 14:18:39.808912 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8011569Z I0718 14:18:39.808924 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8014123Z I0718 14:18:39.810217 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8015495Z I0718 14:18:39.810257 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8016592Z I0718 14:18:39.810268 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8019037Z I0718 14:18:39.820369 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8022338Z I0718 14:18:39.820817 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8030601Z I0718 14:18:39.825959 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8034083Z I0718 14:18:39.827481 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8037021Z I0718 14:18:40.429227 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8064667Z I0718 14:18:40.430055 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8067498Z I0718 14:18:40.443496 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8071005Z I0718 14:18:40.444422 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8074801Z I0718 14:18:44.199846 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8076384Z I0718 14:18:44.199900 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8077931Z I0718 14:18:44.199911 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8080566Z I0718 14:18:44.214297 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8083768Z I0718 14:18:44.217878 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8087068Z I0718 14:18:44.820372 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8090295Z I0718 14:18:44.826144 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8092864Z I0718 14:18:44.835721 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8094587Z I0718 14:18:44.835829 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8095998Z I0718 14:18:44.835852 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8097815Z I0718 14:18:44.837054 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8099536Z I0718 14:18:44.837096 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8100788Z I0718 14:18:44.837106 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8103301Z I0718 14:18:44.847470 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8106179Z I0718 14:18:44.848020 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8109495Z I0718 14:18:44.851196 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8117148Z I0718 14:18:44.851710 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8120287Z I0718 14:18:45.453396 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8123294Z I0718 14:18:45.453420 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8126064Z I0718 14:18:45.459723 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8129167Z I0718 14:18:45.460575 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8131709Z I0718 14:18:49.220441 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8137504Z I0718 14:18:49.220497 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8139241Z I0718 14:18:49.220507 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8141835Z I0718 14:18:49.239849 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8144492Z I0718 14:18:49.244351 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8147304Z I0718 14:18:49.845722 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8150964Z I0718 14:18:49.850836 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8153675Z I0718 14:18:49.866321 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8155502Z I0718 14:18:49.866538 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8156957Z I0718 14:18:49.866632 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8158184Z I0718 14:18:49.866652 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8159729Z I0718 14:18:49.868015 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8160997Z I0718 14:18:49.868040 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8163386Z I0718 14:18:49.880056 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8166333Z I0718 14:18:49.880675 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8169434Z I0718 14:18:49.893645 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8172603Z I0718 14:18:49.917170 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8176321Z I0718 14:18:50.495707 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8179688Z I0718 14:18:50.502309 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8182943Z I0718 14:18:50.518596 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8185558Z I0718 14:18:50.524058 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8187774Z I0718 14:18:54.250631 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8189674Z I0718 14:18:54.250703 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8191201Z I0718 14:18:54.250714 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8194744Z I0718 14:18:54.262086 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8197554Z I0718 14:18:54.271281 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8200804Z I0718 14:18:54.872919 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8203788Z I0718 14:18:54.881604 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8206819Z I0718 14:18:54.895168 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8208427Z I0718 14:18:54.895386 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8209717Z I0718 14:18:54.895533 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8211660Z I0718 14:18:54.896335 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8213115Z I0718 14:18:54.896407 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8214221Z I0718 14:18:54.896422 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8216359Z I0718 14:18:54.906054 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8219496Z I0718 14:18:54.909838 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8222641Z I0718 14:18:54.926746 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8225286Z I0718 14:18:54.930358 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8227922Z I0718 14:18:55.512156 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8231481Z I0718 14:18:55.518658 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8234607Z I0718 14:18:55.532368 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8237612Z I0718 14:18:55.537446 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8240388Z I0718 14:18:59.270489 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8242047Z I0718 14:18:59.270838 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8243262Z I0718 14:18:59.270936 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8245483Z I0718 14:18:59.281999 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8248772Z I0718 14:18:59.291694 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8251776Z I0718 14:18:59.893115 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8254716Z I0718 14:18:59.899058 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8257063Z I0718 14:18:59.909636 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8258817Z I0718 14:18:59.909770 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8260091Z I0718 14:18:59.909841 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8262041Z I0718 14:18:59.910915 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8263507Z I0718 14:18:59.911027 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8264729Z I0718 14:18:59.911081 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8266953Z I0718 14:18:59.918501 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8270800Z I0718 14:18:59.920129 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8274018Z I0718 14:18:59.923724 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8278682Z I0718 14:18:59.924415 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8281972Z I0718 14:19:00.525181 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8284905Z I0718 14:19:00.527488 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8287801Z I0718 14:19:00.534596 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8291027Z I0718 14:19:00.536451 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8293829Z I0718 14:19:04.295145 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8295318Z I0718 14:19:04.295247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8296537Z I0718 14:19:04.295258 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8298914Z I0718 14:19:04.308089 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8301962Z I0718 14:19:04.311645 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8305023Z I0718 14:19:04.913431 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8307899Z I0718 14:19:04.920251 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8310837Z I0718 14:19:04.931745 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8312619Z I0718 14:19:04.931782 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8313790Z I0718 14:19:04.931791 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8315597Z I0718 14:19:04.932333 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8316922Z I0718 14:19:04.932365 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8318033Z I0718 14:19:04.932375 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8320655Z I0718 14:19:04.940432 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8323695Z I0718 14:19:04.941817 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8326553Z I0718 14:19:04.947345 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8329704Z I0718 14:19:04.947693 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8333288Z I0718 14:19:05.556122 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8337113Z I0718 14:19:05.557321 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8340472Z I0718 14:19:05.563491 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8343947Z I0718 14:19:05.570889 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8346299Z I0718 14:19:09.316556 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8347884Z I0718 14:19:09.316617 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8349445Z I0718 14:19:09.316628 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8353148Z I0718 14:19:09.331724 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8356452Z I0718 14:19:09.336207 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8359543Z I0718 14:19:09.938171 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8363503Z I0718 14:19:09.944083 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8366470Z I0718 14:19:09.956354 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8367990Z I0718 14:19:09.956503 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8369362Z I0718 14:19:09.956624 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8371225Z I0718 14:19:09.960225 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8372722Z I0718 14:19:09.960283 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8375485Z I0718 14:19:09.960293 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8379210Z I0718 14:19:09.985197 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8382494Z I0718 14:19:09.995263 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8385318Z I0718 14:19:10.000913 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8388371Z I0718 14:19:10.004226 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8391795Z I0718 14:19:10.603372 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8395667Z I0718 14:19:10.607095 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8398753Z I0718 14:19:10.612406 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8402816Z I0718 14:19:10.618551 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8405543Z I0718 14:19:14.336146 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8407196Z I0718 14:19:14.336223 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8408472Z I0718 14:19:14.336240 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8411859Z I0718 14:19:14.350369 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8414872Z I0718 14:19:14.355609 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8417696Z I0718 14:19:14.958595 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8420968Z I0718 14:19:14.965287 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8423696Z I0718 14:19:14.978552 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8425134Z I0718 14:19:14.978739 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8426320Z I0718 14:19:14.978807 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8428326Z I0718 14:19:14.985697 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8430730Z I0718 14:19:14.985749 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8432193Z I0718 14:19:14.985760 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8434703Z I0718 14:19:14.994096 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8437889Z I0718 14:19:14.996963 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8440708Z I0718 14:19:15.001151 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8444032Z I0718 14:19:15.015186 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8447342Z I0718 14:19:15.605028 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8450642Z I0718 14:19:15.610640 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8453743Z I0718 14:19:15.619903 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8456842Z I0718 14:19:15.625511 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8459204Z I0718 14:19:19.356999 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8460625Z I0718 14:19:19.357053 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8461809Z I0718 14:19:19.357065 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8464225Z I0718 14:19:19.368335 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8467363Z I0718 14:19:19.372910 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8470694Z I0718 14:19:19.975341 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8473688Z I0718 14:19:19.982124 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8476042Z I0718 14:19:19.993153 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8478602Z I0718 14:19:19.993219 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8479922Z I0718 14:19:19.993231 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8481855Z I0718 14:19:20.004734 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8484402Z I0718 14:19:20.004810 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8486704Z I0718 14:19:20.004885 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8489656Z I0718 14:19:20.008914 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8494542Z I0718 14:19:20.015529 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8497870Z I0718 14:19:20.017487 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8501224Z I0718 14:19:20.020670 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8504181Z I0718 14:19:20.619489 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8506937Z I0718 14:19:20.622290 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8510099Z I0718 14:19:20.630568 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8513204Z I0718 14:19:20.631296 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8515559Z I0718 14:19:24.377251 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8516987Z I0718 14:19:24.377311 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8518185Z I0718 14:19:24.377321 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8520739Z I0718 14:19:24.389558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8523723Z I0718 14:19:24.399562 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8526748Z I0718 14:19:25.001786 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8529817Z I0718 14:19:25.009395 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8532766Z I0718 14:19:25.020602 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8534295Z I0718 14:19:25.020662 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8535561Z I0718 14:19:25.020673 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8537374Z I0718 14:19:25.024974 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8539006Z I0718 14:19:25.025003 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8540301Z I0718 14:19:25.025013 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8542937Z I0718 14:19:25.035093 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8545719Z I0718 14:19:25.040108 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8548694Z I0718 14:19:25.041264 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8552015Z I0718 14:19:25.050940 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8555009Z I0718 14:19:25.643851 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8557964Z I0718 14:19:25.649191 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8561199Z I0718 14:19:25.664429 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8564412Z I0718 14:19:25.675838 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8567017Z I0718 14:19:29.406088 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8568552Z I0718 14:19:29.406137 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8569812Z I0718 14:19:29.406148 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8572457Z I0718 14:19:29.414240 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8575402Z I0718 14:19:29.421040 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8578928Z I0718 14:19:30.023524 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8582242Z I0718 14:19:30.030454 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8585042Z I0718 14:19:30.045176 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8586462Z I0718 14:19:30.045368 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8587645Z I0718 14:19:30.045544 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8589559Z I0718 14:19:30.055682 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8591773Z I0718 14:19:30.055913 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8593006Z I0718 14:19:30.056089 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8595797Z I0718 14:19:30.084123 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8599655Z I0718 14:19:30.085230 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8603823Z I0718 14:19:30.094304 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8607179Z I0718 14:19:30.098952 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8610205Z I0718 14:19:30.695954 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8614471Z I0718 14:19:30.700964 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8617891Z I0718 14:19:30.704118 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8621124Z I0718 14:19:30.710248 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8623633Z I0718 14:19:34.456577 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8625188Z I0718 14:19:34.456651 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8626386Z I0718 14:19:34.456663 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8628863Z I0718 14:19:34.471455 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8632271Z I0718 14:19:34.475690 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8635088Z I0718 14:19:35.077928 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8638058Z I0718 14:19:35.086711 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8640697Z I0718 14:19:35.099592 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8642420Z I0718 14:19:35.099827 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8643588Z I0718 14:19:35.099848 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8645298Z I0718 14:19:35.110767 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8647038Z I0718 14:19:35.110923 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8648306Z I0718 14:19:35.110944 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8650737Z I0718 14:19:35.117115 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8653557Z I0718 14:19:35.124538 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8656535Z I0718 14:19:35.126337 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8659352Z I0718 14:19:35.159672 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8662162Z I0718 14:19:35.726348 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8665845Z I0718 14:19:35.733217 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8668811Z I0718 14:19:35.762037 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8672582Z I0718 14:19:35.768234 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8675230Z I0718 14:19:39.470103 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8676685Z I0718 14:19:39.470172 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8677880Z I0718 14:19:39.470184 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8689247Z I0718 14:19:39.494039 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8692487Z I0718 14:19:39.498647 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8695426Z I0718 14:19:40.100808 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8698801Z I0718 14:19:40.107367 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8701361Z I0718 14:19:40.121506 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8702795Z I0718 14:19:40.121613 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8703975Z I0718 14:19:40.121677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8706507Z I0718 14:19:40.128129 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8707946Z I0718 14:19:40.128239 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8709113Z I0718 14:19:40.128388 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8712717Z I0718 14:19:40.144933 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8716185Z I0718 14:19:40.155778 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8719506Z I0718 14:19:40.158294 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8722633Z I0718 14:19:40.186746 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8725672Z I0718 14:19:40.757680 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8728677Z I0718 14:19:40.771337 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8731740Z I0718 14:19:40.788575 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8734533Z I0718 14:19:40.794630 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8737056Z I0718 14:19:44.503819 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8738552Z I0718 14:19:44.503897 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8739779Z I0718 14:19:44.503907 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8742349Z I0718 14:19:44.519401 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8746316Z I0718 14:19:44.532876 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8749333Z I0718 14:19:45.135486 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8752738Z I0718 14:19:45.141888 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8755625Z I0718 14:19:45.153435 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8757062Z I0718 14:19:45.153479 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8758372Z I0718 14:19:45.153567 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8760140Z I0718 14:19:45.174066 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8761573Z I0718 14:19:45.174111 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8762743Z I0718 14:19:45.174121 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8764899Z I0718 14:19:45.182586 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8768788Z I0718 14:19:45.189428 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8773252Z I0718 14:19:45.192411 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8778171Z I0718 14:19:45.203633 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8783228Z I0718 14:19:45.796225 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8787263Z I0718 14:19:45.805756 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8790510Z I0718 14:19:45.809043 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8793755Z I0718 14:19:45.818305 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8796132Z I0718 14:19:49.524974 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8797731Z I0718 14:19:49.525034 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8799230Z I0718 14:19:49.525065 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8801578Z I0718 14:19:49.535529 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8804734Z I0718 14:19:49.542348 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8809289Z I0718 14:19:50.144248 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8816742Z I0718 14:19:50.151088 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8819549Z I0718 14:19:50.167052 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8821113Z I0718 14:19:50.167182 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8822473Z I0718 14:19:50.167229 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8824175Z I0718 14:19:50.176646 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8825614Z I0718 14:19:50.176843 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8826799Z I0718 14:19:50.176987 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8829243Z I0718 14:19:50.188078 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8832489Z I0718 14:19:50.190793 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8835755Z I0718 14:19:50.195548 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8842651Z I0718 14:19:50.215385 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8845717Z I0718 14:19:50.797990 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8848993Z I0718 14:19:50.806911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8853979Z I0718 14:19:50.817936 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8857588Z I0718 14:19:50.823120 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8861253Z I0718 14:19:54.554478 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8863510Z I0718 14:19:54.554535 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8864706Z I0718 14:19:54.554546 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8866948Z I0718 14:19:54.572810 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8870718Z I0718 14:19:54.590427 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8873929Z I0718 14:19:55.210111 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8876756Z I0718 14:19:55.227477 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8879419Z I0718 14:19:55.252117 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8881415Z I0718 14:19:55.252344 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8883888Z I0718 14:19:55.252459 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8886236Z I0718 14:19:55.253975 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8887803Z I0718 14:19:55.254154 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8889325Z I0718 14:19:55.254249 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8891715Z I0718 14:19:55.266794 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8896098Z I0718 14:19:55.272314 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8899205Z I0718 14:19:55.278969 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8902737Z I0718 14:19:55.279325 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8906474Z I0718 14:19:55.882537 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8910659Z I0718 14:19:55.883660 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8914906Z I0718 14:19:55.895886 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8919269Z I0718 14:19:55.898742 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8922650Z I0718 14:19:59.581433 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8924814Z I0718 14:19:59.581490 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8926089Z I0718 14:19:59.581500 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8928482Z I0718 14:19:59.603289 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8931975Z I0718 14:19:59.610773 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8935105Z I0718 14:20:00.213532 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:20:00.8938109Z I0718 14:20:00.223235 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8940645Z I0718 14:20:00.238611 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8942345Z I0718 14:20:00.238754 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8943616Z I0718 14:20:00.238777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8945485Z I0718 14:20:00.261012 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-18T14:20:00.8947012Z I0718 14:20:00.261061 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-18T14:20:00.8948286Z I0718 14:20:00.261189 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-18T14:20:00.8950858Z I0718 14:20:00.266278 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8954276Z I0718 14:20:00.280495 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:20:00.8958274Z I0718 14:20:00.283290 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:00.8961993Z I0718 14:20:00.309302 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:20:01.0073032Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-246bf ***
2021-07-18T14:20:01.0083415Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-246bf ***
2021-07-18T14:20:01.0089906Z ====================================================================
2021-07-18T14:20:01.0090630Z ##[endgroup]
2021-07-18T14:20:01.0096918Z ##[group]*** submariner-routeagent-246bf ***
2021-07-18T14:20:01.0102157Z ======================= *** submariner-routeagent-246bf *** =======================
2021-07-18T14:20:01.0115018Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-246bf
2021-07-18T14:20:01.0128362Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-246bf
2021-07-18T14:20:01.0144584Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-246bf
2021-07-18T14:20:01.3304170Z + trap 'exit 1' SIGTERM SIGINT
2021-07-18T14:20:01.3308177Z + SUBMARINER_VERBOSITY=2
2021-07-18T14:20:01.3308859Z + '[' false == true ']'
2021-07-18T14:20:01.3312257Z + DEBUG=-v=2
2021-07-18T14:20:01.3313065Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-18T14:20:01.3314256Z I0718 14:16:00.855344 1 main.go:56] Starting submariner-route-agent using the event framework
2021-07-18T14:20:01.3315720Z W0718 14:16:00.860194 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:01.3316648Z I0718 14:16:00.861713 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:01.3317293Z I0718 14:16:00.861925 1 cni_iface.go:75] Interface "weave" has "10.1.224.0" address
2021-07-18T14:20:01.3318045Z I0718 14:16:00.862006 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:01.3319668Z I0718 14:16:01.391907 1 cni_iface.go:117] Successfully annotated node "cluster1-control-plane" with cniIfaceIP "10.1.224.0"
2021-07-18T14:20:01.3320849Z I0718 14:16:01.392101 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-18T14:20:01.3321636Z I0718 14:16:01.392874 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:01.3322325Z I0718 14:16:01.393928 1 cni_iface.go:75] Interface "weave" has "10.1.224.0" address
2021-07-18T14:20:01.3323124Z I0718 14:16:01.394058 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.224.0" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:01.3324329Z I0718 14:16:01.541085 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-18T14:20:01.3325697Z I0718 14:16:01.557445 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-18T14:20:01.3327221Z I0718 14:16:01.563426 1 iptables.go:112] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-18T14:20:01.3330227Z I0718 14:16:01.563447 1 iptables.go:133] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-18T14:20:01.3331492Z I0718 14:16:01.563453 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-18T14:20:01.3332676Z I0718 14:16:01.581224 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-18T14:20:01.3333968Z I0718 14:16:01.584663 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-18T14:20:01.3335557Z I0718 14:16:01.589844 1 iptables.go:112] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-18T14:20:01.3336799Z I0718 14:16:01.589863 1 iptables.go:133] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-18T14:20:01.3338203Z I0718 14:16:01.589905 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.224.0
2021-07-18T14:20:01.3339778Z I0718 14:16:01.600429 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.3341452Z I0718 14:16:01.600466 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-18T14:20:01.3342561Z I0718 14:16:01.600473 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-18T14:20:01.3343547Z I0718 14:16:01.600477 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.3344491Z I0718 14:16:01.600483 1 mtuhandler.go:52] Updating configurations for Path MTU
2021-07-18T14:20:01.3345380Z I0718 14:16:01.600654 1 registry.go:68] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.3347017Z W0718 14:16:01.600854 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:01.3347978Z I0718 14:16:01.750711 1 controller.go:142] Starting the Event controller...
2021-07-18T14:20:01.3351460Z I0718 14:16:01.852342 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.3357554Z I0718 14:16:01.912499 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3360050Z I0718 14:16:01.952242 1 controller.go:149] Event controller started
2021-07-18T14:20:01.3366292Z I0718 14:16:01.953606 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:01.3371303Z I0718 14:16:01.953679 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:01.3373507Z I0718 14:16:01.958604 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3377253Z I0718 14:16:01.977308 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3378735Z I0718 14:16:02.007846 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3419674Z I0718 14:16:02.015729 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:01.3422425Z I0718 14:16:02.015958 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.8, isGatewayNode false
2021-07-18T14:20:01.3424616Z I0718 14:16:02.016528 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:01.3427152Z I0718 14:16:02.016711 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:01.3430168Z I0718 14:16:02.016688 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.9
2021-07-18T14:20:01.3431173Z I0718 14:16:02.017106 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-18T14:20:01.3432030Z I0718 14:16:02.017287 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.9
2021-07-18T14:20:01.3432855Z I0718 14:16:02.017906 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.3433832Z I0718 14:16:02.018011 1 routes_iface.go:198] Found route {Ifindex: 9 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254} with gw 240.18.0.9 already installed
2021-07-18T14:20:01.3434817Z I0718 14:16:02.018106 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.3435793Z I0718 14:16:02.018201 1 routes_iface.go:198] Found route {Ifindex: 9 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254} with gw 240.18.0.9 already installed
2021-07-18T14:20:01.3436748Z I0718 14:16:02.018283 1 routes_iface.go:192] Processing route {Ifindex: 9 Dst: 240.0.0.0/8 Src: 240.18.0.8 Gw: <nil> Flags: [] Table: 254}
2021-07-18T14:20:01.3437497Z I0718 14:16:02.018362 1 routes_iface.go:195] Found nil gw or dst
2021-07-18T14:20:01.3438165Z I0718 14:16:02.018571 1 routes_iface.go:234] Found equivalent route, not adding
2021-07-18T14:20:01.3438918Z I0718 14:16:02.018654 1 routes_iface.go:234] Found equivalent route, not adding
2021-07-18T14:20:01.3453664Z I0718 14:16:02.018742 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-18T14:20:01.3456247Z I0718 14:16:02.025941 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:01.3458843Z I0718 14:16:02.026064 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:01.3460626Z I0718 14:16:02.026295 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode false
2021-07-18T14:20:01.3463897Z I0718 14:16:18.637298 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.3473409Z W0718 14:16:18.637632 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:01.3474737Z W0718 14:16:18.637731 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:01.3489278Z I0718 14:16:18.695915 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:01.3492375Z I0718 14:16:18.702186 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3493704Z I0718 14:16:18.704968 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3495092Z I0718 14:16:18.709218 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3496524Z I0718 14:16:18.711323 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.3508733Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-2ls6w -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:01.3546994Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-2ls6w -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:01.3561975Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-2ls6w -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:01.6432634Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-2ls6w ***
2021-07-18T14:20:01.6446935Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-2ls6w ***
2021-07-18T14:20:01.6452388Z ====================================================================
2021-07-18T14:20:01.6455810Z ##[endgroup]
2021-07-18T14:20:01.6459850Z ##[group]*** submariner-routeagent-2ls6w ***
2021-07-18T14:20:01.6465062Z ======================= *** submariner-routeagent-2ls6w *** =======================
2021-07-18T14:20:01.6477599Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-2ls6w
2021-07-18T14:20:01.6490025Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-2ls6w
2021-07-18T14:20:01.6505518Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-2ls6w
2021-07-18T14:20:01.9606513Z + trap 'exit 1' SIGTERM SIGINT
2021-07-18T14:20:01.9607235Z + SUBMARINER_VERBOSITY=2
2021-07-18T14:20:01.9607964Z + '[' false == true ']'
2021-07-18T14:20:01.9608485Z + DEBUG=-v=2
2021-07-18T14:20:01.9609269Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-18T14:20:01.9610464Z I0718 14:15:58.167762 1 main.go:56] Starting submariner-route-agent using the event framework
2021-07-18T14:20:01.9611900Z W0718 14:15:58.168135 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:01.9612884Z I0718 14:15:58.173864 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:01.9613801Z I0718 14:15:58.174603 1 cni_iface.go:75] Interface "weave" has "10.1.128.0" address
2021-07-18T14:20:01.9614655Z I0718 14:15:58.174629 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:01.9615994Z I0718 14:15:58.582464 1 cni_iface.go:117] Successfully annotated node "cluster1-worker2" with cniIfaceIP "10.1.128.0"
2021-07-18T14:20:01.9617019Z I0718 14:15:58.582494 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-18T14:20:01.9617813Z I0718 14:15:58.591295 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:01.9618499Z I0718 14:15:58.591373 1 cni_iface.go:75] Interface "weave" has "10.1.128.0" address
2021-07-18T14:20:01.9619306Z I0718 14:15:58.591381 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.128.0" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:01.9620525Z I0718 14:15:58.830907 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-18T14:20:01.9621895Z I0718 14:15:58.874800 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-18T14:20:01.9623310Z I0718 14:15:58.915097 1 iptables.go:112] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-18T14:20:01.9624697Z I0718 14:15:58.915117 1 iptables.go:133] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-18T14:20:01.9625941Z I0718 14:15:58.915123 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-18T14:20:01.9627120Z I0718 14:15:59.030407 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-18T14:20:01.9628413Z I0718 14:15:59.169719 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-18T14:20:01.9629863Z I0718 14:15:59.213757 1 iptables.go:112] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-18T14:20:01.9631209Z I0718 14:15:59.213792 1 iptables.go:133] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-18T14:20:01.9632673Z I0718 14:15:59.213815 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.128.0
2021-07-18T14:20:01.9634224Z I0718 14:16:00.235043 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.9635735Z I0718 14:16:00.235069 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-18T14:20:01.9636800Z I0718 14:16:00.235075 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-18T14:20:01.9637796Z I0718 14:16:00.235080 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.9638751Z I0718 14:16:00.235088 1 mtuhandler.go:52] Updating configurations for Path MTU
2021-07-18T14:20:01.9640972Z I0718 14:16:00.235575 1 registry.go:68] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-18T14:20:01.9642505Z W0718 14:16:00.235901 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:01.9643534Z I0718 14:16:00.268815 1 controller.go:142] Starting the Event controller...
2021-07-18T14:20:01.9648522Z I0718 14:16:00.376212 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.9651705Z I0718 14:16:00.376254 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.9
2021-07-18T14:20:01.9654225Z I0718 14:16:00.382603 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-18T14:20:01.9676102Z I0718 14:16:00.382876 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.9
2021-07-18T14:20:01.9677018Z I0718 14:16:00.383649 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.9677936Z I0718 14:16:00.383745 1 routes_iface.go:200] Removing route {Ifindex: 18 Dst: 10.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.9678827Z I0718 14:16:00.384172 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.9679738Z I0718 14:16:00.384243 1 routes_iface.go:200] Removing route {Ifindex: 18 Dst: 100.2.0.0/16 Src: <nil> Gw: 240.18.0.9 Flags: [] Table: 254}
2021-07-18T14:20:01.9680648Z I0718 14:16:00.384443 1 routes_iface.go:192] Processing route {Ifindex: 18 Dst: 240.0.0.0/8 Src: 240.18.0.6 Gw: <nil> Flags: [] Table: 254}
2021-07-18T14:20:01.9681565Z I0718 14:16:00.384598 1 routes_iface.go:195] Found nil gw or dst
2021-07-18T14:20:01.9684492Z I0718 14:16:00.397474 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.9687722Z I0718 14:16:00.404392 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9689016Z I0718 14:16:00.406232 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9690293Z I0718 14:16:00.411468 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9691535Z I0718 14:16:00.413908 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9692394Z I0718 14:16:00.475855 1 controller.go:149] Event controller started
2021-07-18T14:20:01.9694347Z I0718 14:16:00.485131 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:01.9697698Z I0718 14:16:00.485172 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:01.9699743Z I0718 14:16:00.485186 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.8, isGatewayNode false
2021-07-18T14:20:01.9701876Z I0718 14:16:00.485503 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:01.9704365Z I0718 14:16:00.485515 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:01.9706030Z I0718 14:16:00.485522 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode false
2021-07-18T14:20:01.9708207Z I0718 14:16:00.486818 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:01.9711311Z I0718 14:16:00.486832 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:01.9713000Z I0718 14:16:00.486840 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode false
2021-07-18T14:20:01.9722563Z I0718 14:16:00.963124 1 handler.go:67] The Endpoint for the local cluster has been removed: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.9727046Z I0718 14:16:01.037664 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:01.9729798Z I0718 14:16:01.037727 1 endpoint_handler.go:57] Creating the vxlan interface vx-submariner with gateway node IP 172.18.0.9
2021-07-18T14:20:01.9730702Z I0718 14:16:01.038387 1 routes_iface.go:176] Reconciling routes to gw: 240.18.0.9
2021-07-18T14:20:01.9731526Z I0718 14:16:01.039173 1 routes_iface.go:192] Processing route {Ifindex: 27 Dst: 240.0.0.0/8 Src: 240.18.0.6 Gw: <nil> Flags: [] Table: 254}
2021-07-18T14:20:01.9732294Z I0718 14:16:01.039195 1 routes_iface.go:195] Found nil gw or dst
2021-07-18T14:20:01.9735041Z I0718 14:16:18.629732 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:01.9737447Z W0718 14:16:18.629936 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:01.9739658Z W0718 14:16:18.629956 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:01.9744016Z I0718 14:16:18.676582 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:01.9762948Z I0718 14:16:18.681003 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9764715Z I0718 14:16:18.683055 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9766094Z I0718 14:16:18.686887 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9767346Z I0718 14:16:18.689393 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:01.9784836Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-8wwlc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:01.9809789Z [submariner-operator]$ [cluster1] kubectl get pods -n submariner-operator submariner-routeagent-8wwlc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:01.9837487Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods -n submariner-operator submariner-routeagent-8wwlc -o jsonpath={.status.containerStatuses[*].ready}
2021-07-18T14:20:02.2911973Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-8wwlc ***
2021-07-18T14:20:02.2926454Z [submariner-operator]$ [cluster1] print_section *** submariner-routeagent-8wwlc ***
2021-07-18T14:20:02.2929771Z ====================================================================
2021-07-18T14:20:02.2933748Z ##[endgroup]
2021-07-18T14:20:02.2938617Z ##[group]*** submariner-routeagent-8wwlc ***
2021-07-18T14:20:02.2942884Z ======================= *** submariner-routeagent-8wwlc *** =======================
2021-07-18T14:20:02.2958551Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-8wwlc
2021-07-18T14:20:02.2974702Z [submariner-operator]$ [cluster1] kubectl -n submariner-operator logs submariner-routeagent-8wwlc
2021-07-18T14:20:02.2993365Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-operator logs submariner-routeagent-8wwlc
2021-07-18T14:20:02.5970825Z + trap 'exit 1' SIGTERM SIGINT
2021-07-18T14:20:02.5971473Z + SUBMARINER_VERBOSITY=2
2021-07-18T14:20:02.5972101Z + '[' false == true ']'
2021-07-18T14:20:02.5972619Z + DEBUG=-v=2
2021-07-18T14:20:02.5973631Z + exec submariner-route-agent -v=2 -alsologtostderr
2021-07-18T14:20:02.5975064Z I0718 14:16:02.307118 1 main.go:56] Starting submariner-route-agent using the event framework
2021-07-18T14:20:02.5976579Z W0718 14:16:02.307739 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:02.5977573Z I0718 14:16:02.309934 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:02.5978268Z I0718 14:16:02.310175 1 cni_iface.go:75] Interface "weave" has "10.1.0.1" address
2021-07-18T14:20:02.5979069Z I0718 14:16:02.310277 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:02.5980322Z I0718 14:16:02.346834 1 cni_iface.go:117] Successfully annotated node "cluster1-worker" with cniIfaceIP "10.1.0.1"
2021-07-18T14:20:02.5981326Z I0718 14:16:02.346920 1 registry.go:68] Event handler "logger" added to registry "routeagent_driver".
2021-07-18T14:20:02.5982122Z I0718 14:16:02.347678 1 cni_iface.go:75] Interface "lo" has "127.0.0.1" address
2021-07-18T14:20:02.5982812Z I0718 14:16:02.348157 1 cni_iface.go:75] Interface "weave" has "10.1.0.1" address
2021-07-18T14:20:02.5983821Z I0718 14:16:02.348208 1 cni_iface.go:80] Found CNI Interface "weave" that has IP "10.1.0.1" from ClusterCIDR "10.1.0.0/16"
2021-07-18T14:20:02.5985067Z I0718 14:16:02.459413 1 iptables.go:31] Install/ensure SUBMARINER-POSTROUTING chain exists
2021-07-18T14:20:02.5986794Z I0718 14:16:02.482212 1 iptables.go:37] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
2021-07-18T14:20:02.5988785Z I0718 14:16:02.496725 1 iptables.go:112] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
2021-07-18T14:20:02.5990938Z I0718 14:16:02.496741 1 iptables.go:133] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
2021-07-18T14:20:02.5992264Z I0718 14:16:02.496747 1 iptables_iface.go:44] Install/ensure SUBMARINER-INPUT chain exists
2021-07-18T14:20:02.5999524Z I0718 14:16:02.591967 1 iptables_iface.go:55] Allow VxLAN incoming traffic in SUBMARINER-INPUT Chain
2021-07-18T14:20:02.6001157Z I0718 14:16:02.610438 1 iptables_iface.go:63] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
2021-07-18T14:20:02.6002543Z I0718 14:16:02.641845 1 iptables.go:112] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 1.
2021-07-18T14:20:02.6003839Z I0718 14:16:02.642119 1 iptables.go:133] In filter table, iptables rule "-o vx-submariner -j ACCEPT", already exists.
2021-07-18T14:20:02.6005300Z I0718 14:16:02.642514 1 iptables_iface.go:75] Installing rule for host network to remote cluster communication: -s 240.0.0.0/8 -o vx-submariner -j SNAT --to 10.1.0.1
2021-07-18T14:20:02.6006835Z I0718 14:16:02.691948 1 registry.go:68] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
2021-07-18T14:20:02.6008354Z I0718 14:16:02.691979 1 registry.go:70] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
2021-07-18T14:20:02.6009425Z I0718 14:16:02.691985 1 registry.go:68] Event handler "xfrm" added to registry "routeagent_driver".
2021-07-18T14:20:02.6010427Z I0718 14:16:02.691989 1 registry.go:68] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
2021-07-18T14:20:02.6011375Z I0718 14:16:02.691996 1 mtuhandler.go:52] Updating configurations for Path MTU
2021-07-18T14:20:02.6012327Z I0718 14:16:02.692088 1 registry.go:68] Event handler "MTU handler" added to registry "routeagent_driver".
2021-07-18T14:20:02.6013758Z W0718 14:16:02.692215 1 client_config.go:608] Neither --kubeconfig nor --master was specified. Using the inClusterConfig. This might not work.
2021-07-18T14:20:02.6014787Z I0718 14:16:02.742462 1 controller.go:142] Starting the Event controller...
2021-07-18T14:20:02.6017762Z I0718 14:16:02.842949 1 handler.go:57] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster1", CableName:"submariner-cable-cluster1-172-18-0-9", HealthCheckIP:"10.1.0.1", Hostname:"cluster1-worker", Subnets:[]string{"100.1.0.0/16", "10.1.0.0/16"}, PrivateIP:"172.18.0.9", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:02.6020099Z I0718 14:16:02.843017 1 handler.go:52] The current node has become a Gateway
2021-07-18T14:20:02.6020862Z I0718 14:16:02.843025 1 gw_transition.go:48] The current node has become a Gateway
2021-07-18T14:20:02.6021715Z I0718 14:16:02.843797 1 routes_iface.go:161] Processing route {Ifindex: 15 Dst: 240.0.0.0/8 Src: 240.18.0.9 Gw: <nil> Flags: [] Table: 254}
2021-07-18T14:20:02.6022653Z I0718 14:16:02.843831 1 routes_iface.go:164] Found nil gw or dst
2021-07-18T14:20:02.6023768Z I0718 14:16:02.843835 1 gw_transition.go:56] Creating the vxlan interface: vx-submariner on the gateway node
2021-07-18T14:20:02.6024731Z I0718 14:16:02.843964 1 vxlan.go:91] VxLAN interface already exists with same configuration.
2021-07-18T14:20:02.6026313Z I0718 14:16:02.844044 1 vxlan.go:274] Successfully configured reverse path filter to loose mode on "vx-submariner"
2021-07-18T14:20:02.6029314Z I0718 14:16:02.844216 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:02.6034706Z I0718 14:16:02.844241 1 routes_iface.go:252] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-18T14:20:02.6036454Z I0718 14:16:02.846371 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6037885Z I0718 14:16:02.871291 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6039207Z I0718 14:16:02.879256 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6040524Z I0718 14:16:02.882417 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6041390Z I0718 14:16:02.943101 1 controller.go:149] Event controller started
2021-07-18T14:20:02.6043334Z I0718 14:16:02.944163 1 handler.go:90] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:02.6046122Z I0718 14:16:02.944262 1 node_handler.go:31] A Node with name "cluster1-control-plane" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.8"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-control-plane"}} has been added to the cluster
2021-07-18T14:20:02.6047949Z I0718 14:16:02.944332 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.8, isGatewayNode true
2021-07-18T14:20:02.6048946Z I0718 14:16:02.944478 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.8 00:00:00:00:00:00
2021-07-18T14:20:02.6050774Z I0718 14:16:02.944933 1 handler.go:90] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:02.6053242Z I0718 14:16:02.944999 1 node_handler.go:31] A Node with name "cluster1-worker" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.9"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker"}} has been added to the cluster
2021-07-18T14:20:02.6054907Z I0718 14:16:02.945040 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.9, isGatewayNode true
2021-07-18T14:20:02.6055920Z I0718 14:16:02.945278 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.9 00:00:00:00:00:00
2021-07-18T14:20:02.6057760Z I0718 14:16:02.945675 1 handler.go:90] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:02.6060258Z I0718 14:16:02.945755 1 node_handler.go:31] A Node with name "cluster1-worker2" and addresses []v1.NodeAddress{v1.NodeAddress{Type:"InternalIP", Address:"172.18.0.6"}, v1.NodeAddress{Type:"Hostname", Address:"cluster1-worker2"}} has been added to the cluster
2021-07-18T14:20:02.6061949Z I0718 14:16:02.945817 1 node_handler.go:75] populateRemoteVtepIps is called with vtepIP 172.18.0.6, isGatewayNode true
2021-07-18T14:20:02.6063089Z I0718 14:16:02.945902 1 vxlan.go:189] Successfully added the bridge fdb entry 172.18.0.6 00:00:00:00:00:00
2021-07-18T14:20:02.6101215Z I0718 14:16:18.632874 1 handler.go:84] A new Endpoint for remote cluster "cluster2" has been removed: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"preferred-server":"false"}}
2021-07-18T14:20:02.6103960Z I0718 14:16:18.632919 1 routes_iface.go:252] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-18T14:20:02.6105497Z W0718 14:16:18.633089 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:02.6106416Z W0718 14:16:18.633094 1 iptables_iface.go:94] Handle the delete use-case
2021-07-18T14:20:02.6109543Z I0718 14:16:18.681802 1 handler.go:72] A new Endpoint for remote cluster "cluster2" has been created: v1.EndpointSpec{ClusterID:"cluster2", CableName:"submariner-cable-cluster2-172-18-0-5", HealthCheckIP:"10.2.128.0", Hostname:"cluster2-worker", Subnets:[]string{"100.2.0.0/16", "10.2.0.0/16"}, PrivateIP:"172.18.0.5", PublicIP:"20.94.255.131", NATEnabled:false, Backend:"libreswan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false"}}
2021-07-18T14:20:02.6112647Z I0718 14:16:18.681975 1 routes_iface.go:252] On GWNode, in updateRoutingRulesForInterClusterSupport ignoring
2021-07-18T14:20:02.6114329Z I0718 14:16:18.693645 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 100.2.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6115586Z I0718 14:16:18.697502 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 100.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6116875Z I0718 14:16:18.704692 1 iptables_iface.go:107] Installing iptables rule for outgoing traffic: -s 10.1.0.0/16 -d 10.2.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6118136Z I0718 14:16:18.708269 1 iptables_iface.go:115] Installing iptables rule for incoming traffic: -s 10.2.0.0/16 -d 10.1.0.0/16 -j ACCEPT
2021-07-18T14:20:02.6126139Z [submariner-operator]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-18T14:20:02.6134035Z [submariner-operator]$ [cluster1] print_section * Output of 'subctl show all' in cluster1 *
2021-07-18T14:20:02.6138669Z ====================================================================
2021-07-18T14:20:02.6142533Z ##[endgroup]
2021-07-18T14:20:02.6146712Z ##[group]* Output of 'subctl show all' in cluster1 *
2021-07-18T14:20:02.6151495Z ======================= * Output of 'subctl show all' in cluster1 * =======================
2021-07-18T14:20:02.6162858Z [submariner-operator]$ [cluster1] subctl show all
2021-07-18T14:20:02.6578608Z Cluster "cluster1"
2021-07-18T14:20:02.6628139Z • Showing Connections ...
2021-07-18T14:20:02.6660178Z ✓ Showing Connections
2021-07-18T14:20:02.6660877Z GATEWAY CLUSTER REMOTE IP NAT CABLE DRIVER SUBNETS STATUS RTT avg.
2021-07-18T14:20:02.6661729Z • Showing Endpoints ...
2021-07-18T14:20:02.6662650Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 222.27µs
2021-07-18T14:20:02.6663136Z
2021-07-18T14:20:02.6684710Z ✓ Showing Endpoints
2021-07-18T14:20:02.6685355Z CLUSTER ID ENDPOINT IP PUBLIC IP CABLE DRIVER TYPE
2021-07-18T14:20:02.6686212Z • Showing Gateways ...
2021-07-18T14:20:02.6686760Z cluster1 172.18.0.9 20.94.255.131 libreswan local
2021-07-18T14:20:02.6687379Z cluster2 172.18.0.5 20.94.255.131 libreswan remote
2021-07-18T14:20:02.6687760Z
2021-07-18T14:20:02.6718795Z ✓ Showing Gateways
2021-07-18T14:20:02.6720668Z NODE HA STATUS SUMMARY
2021-07-18T14:20:02.6723144Z cluster1-worker active All connections (1) are established
2021-07-18T14:20:02.6723656Z
2021-07-18T14:20:02.6727572Z • Showing Network details ...
2021-07-18T14:20:02.6728199Z Discovered network details via Submariner:
2021-07-18T14:20:02.6729290Z ✓ Showing Network details
2021-07-18T14:20:02.6729946Z • Showing versions ...
2021-07-18T14:20:02.6730589Z Network plugin: weave-net
2021-07-18T14:20:02.6731089Z Service CIDRs: [100.1.0.0/16]
2021-07-18T14:20:02.6731527Z Cluster CIDRs: [10.1.0.0/16]
2021-07-18T14:20:02.6731816Z
2021-07-18T14:20:02.6843771Z ✓ Showing versions
2021-07-18T14:20:02.6844397Z COMPONENT REPOSITORY VERSION
2021-07-18T14:20:02.6847674Z submariner localhost:5000 local
2021-07-18T14:20:02.6849468Z submariner-operator localhost:5000 local
2021-07-18T14:20:02.6851024Z service-discovery localhost:5000 local
2021-07-18T14:20:02.6851777Z
2021-07-18T14:20:02.6852396Z Cluster "cluster2"
2021-07-18T14:20:02.7004546Z • Showing Connections ...
2021-07-18T14:20:02.7031660Z ✓ Showing Connections
2021-07-18T14:20:02.7032359Z GATEWAY CLUSTER REMOTE IP NAT CABLE DRIVER SUBNETS STATUS RTT avg.
2021-07-18T14:20:02.7033469Z • Showing Endpoints ...
2021-07-18T14:20:02.7034796Z cluster1-worker cluster1 172.18.0.9 no libreswan 100.1.0.0/16, 10.1.0.0/16 error 0s
2021-07-18T14:20:02.7035512Z
2021-07-18T14:20:02.7064192Z ✓ Showing Endpoints
2021-07-18T14:20:02.7064984Z CLUSTER ID ENDPOINT IP PUBLIC IP CABLE DRIVER TYPE
2021-07-18T14:20:02.7066014Z • Showing Gateways ...
2021-07-18T14:20:02.7067146Z cluster2 172.18.0.5 20.94.255.131 libreswan local
2021-07-18T14:20:02.7068054Z cluster1 172.18.0.9 20.94.255.131 libreswan remote
2021-07-18T14:20:02.7068581Z
2021-07-18T14:20:02.7089150Z ✓ Showing Gateways
2021-07-18T14:20:02.7089684Z NODE HA STATUS SUMMARY
2021-07-18T14:20:02.7090618Z • Showing Network details ...
2021-07-18T14:20:02.7091965Z cluster2-worker active 0 connections out of 1 are established
2021-07-18T14:20:02.7092656Z
2021-07-18T14:20:02.7093317Z Discovered network details via Submariner:
2021-07-18T14:20:02.7094261Z Network plugin: weave-net
2021-07-18T14:20:02.7094938Z Service CIDRs: [100.2.0.0/16]
2021-07-18T14:20:02.7101497Z Cluster CIDRs: [10.2.0.0/16]
2021-07-18T14:20:02.7108839Z ✓ Showing Network details
2021-07-18T14:20:02.7109178Z
2021-07-18T14:20:02.7110379Z • Showing versions ...
2021-07-18T14:20:02.7160646Z ✓ Showing versions
2021-07-18T14:20:02.7161238Z COMPONENT REPOSITORY VERSION
2021-07-18T14:20:02.7161905Z submariner localhost:5000 local
2021-07-18T14:20:02.7162861Z submariner-operator localhost:5000 local
2021-07-18T14:20:02.7163863Z service-discovery localhost:5000 local
2021-07-18T14:20:02.7164313Z
2021-07-18T14:20:02.7201121Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:20:02.7212715Z [submariner-operator]$ [cluster2] post_analyze
2021-07-18T14:20:02.7224481Z [submariner-operator]$ [cluster2] post_analyze
2021-07-18T14:20:02.7254345Z [submariner-operator]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-18T14:20:02.7269643Z [submariner-operator]$ [cluster2] print_section * Kubernetes client and server versions in cluster2 *
2021-07-18T14:20:02.7295191Z ====================================================================
2021-07-18T14:20:02.7308732Z ##[endgroup]
2021-07-18T14:20:02.7316739Z ##[group]* Kubernetes client and server versions in cluster2 *
2021-07-18T14:20:02.7354479Z ======================= * Kubernetes client and server versions in cluster2 * =======================
2021-07-18T14:20:02.7366265Z [submariner-operator]$ [cluster2] kubectl version
2021-07-18T14:20:02.7385021Z [submariner-operator]$ [cluster2] kubectl version
2021-07-18T14:20:02.7401070Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 version
2021-07-18T14:20:03.0251933Z Client Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.5", GitCommit:"6b1d87acf3c8253c123756b9e61dac642678305f", GitTreeState:"archive", BuildDate:"2021-03-30T00:00:00Z", GoVersion:"go1.16", Compiler:"gc", Platform:"linux/amd64"}
2021-07-18T14:20:03.0254455Z Server Version: version.Info{Major:"1", Minor:"20", GitVersion:"v1.20.7", GitCommit:"132a687512d7fb058d0f5890f07d4121b3f0a2e2", GitTreeState:"clean", BuildDate:"2021-05-27T23:27:49Z", GoVersion:"go1.15.12", Compiler:"gc", Platform:"linux/amd64"}
2021-07-18T14:20:03.0299900Z [submariner-operator]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-18T14:20:03.0311009Z [submariner-operator]$ [cluster2] print_section * Overview of all resources in cluster2 *
2021-07-18T14:20:03.0324124Z ====================================================================
2021-07-18T14:20:03.0324729Z ##[endgroup]
2021-07-18T14:20:03.0325315Z ##[group]* Overview of all resources in cluster2 *
2021-07-18T14:20:03.0326124Z ======================= * Overview of all resources in cluster2 * =======================
2021-07-18T14:20:03.0334459Z [submariner-operator]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-18T14:20:03.0350605Z [submariner-operator]$ [cluster2] xargs -n 1 kubectl get --show-kind -o wide --ignore-not-found
2021-07-18T14:20:03.0360340Z [submariner-operator]$ [cluster2] kubectl api-resources --verbs=list -o name
2021-07-18T14:20:03.0401860Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources --verbs=list -o name
2021-07-18T14:20:03.7150145Z Warning: v1 ComponentStatus is deprecated in v1.19+
2021-07-18T14:20:03.7159039Z NAME STATUS MESSAGE ERROR
2021-07-18T14:20:03.7160104Z componentstatus/scheduler Unhealthy Get "http://127.0.0.1:10251/healthz": dial tcp 127.0.0.1:10251: connect: connection refused
2021-07-18T14:20:03.7162154Z componentstatus/controller-manager Unhealthy Get "http://127.0.0.1:10252/healthz": dial tcp 127.0.0.1:10252: connect: connection refused
2021-07-18T14:20:03.7163603Z componentstatus/etcd-0 Healthy {"health":"true"}
2021-07-18T14:20:03.9979165Z NAME DATA AGE
2021-07-18T14:20:03.9980295Z configmap/kube-root-ca.crt 1 12m
2021-07-18T14:20:04.3065722Z NAME ENDPOINTS AGE
2021-07-18T14:20:04.3067425Z endpoints/kubernetes 172.18.0.8:6443 13m
2021-07-18T14:20:04.3069444Z endpoints/nginx-demo 10.1.0.4:8080,10.1.128.5:8080 3m29s
2021-07-18T14:20:04.6284510Z LAST SEEN TYPE REASON OBJECT SUBOBJECT SOURCE MESSAGE FIRST SEEN COUNT NAME
2021-07-18T14:20:04.6297702Z 12m Normal Starting node/cluster1-control-plane kubelet, cluster1-control-plane Starting kubelet. 12m 1 event/cluster1-control-plane.1692e7c065dfd8c5
2021-07-18T14:20:04.6301438Z 12m Normal NodeHasSufficientMemory node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientMemory 12m 1 event/cluster1-control-plane.1692e7c06da205dc
2021-07-18T14:20:04.6339558Z 12m Normal NodeHasNoDiskPressure node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasNoDiskPressure 12m 1 event/cluster1-control-plane.1692e7c06da221fc
2021-07-18T14:20:04.6343587Z 12m Normal NodeHasSufficientPID node/cluster1-control-plane kubelet, cluster1-control-plane Node cluster1-control-plane status is now: NodeHasSufficientPID 12m 1 event/cluster1-control-plane.1692e7c06da24268
2021-07-18T14:20:04.6347189Z 12m Normal NodeAllocatableEnforced node/cluster1-control-plane kubelet, cluster1-control-plane Updated Node Allocatable limit across pods 12m 1 event/cluster1-control-plane.1692e7c0865b7176
2021-07-18T14:20:04.6350795Z 12m Normal RegisteredNode node/cluster1-control-plane node-controller Node cluster1-control-plane event: Registered Node cluster1-control-plane in Controller 12m 1 event/cluster1-control-plane.1692e7c214269285
2021-07-18T14:20:04.6354141Z 12m Normal Starting node/cluster1-control-plane kube-proxy, cluster1-control-plane Starting kube-proxy. 12m 1 event/cluster1-control-plane.1692e7c3005cb3d3
2021-07-18T14:20:04.6357476Z 12m Normal NodeReady node/cluster1-control-plane kubelet, cluster1-control-plan
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment