subm_random_fail_20210718-1

logs.txt

2021-07-18T14:04:31.4080117Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-18T14:04:31.4080173Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-18T14:04:38.8533062Z Current runner version: '2.278.0'
2021-07-18T14:04:38.8559285Z ##[group]Operating System
2021-07-18T14:04:38.8560574Z Ubuntu
2021-07-18T14:04:38.8561025Z 20.04.2
2021-07-18T14:04:38.8561479Z LTS
2021-07-18T14:04:38.8562230Z ##[endgroup]
2021-07-18T14:04:38.8562763Z ##[group]Virtual Environment
2021-07-18T14:04:38.8563697Z Environment: ubuntu-20.04
2021-07-18T14:04:38.8564796Z Version: 20210712.0
2021-07-18T14:04:38.8565829Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-18T14:04:38.8566982Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-18T14:04:38.8568173Z ##[endgroup]
2021-07-18T14:04:38.8570451Z ##[group]GITHUB_TOKEN Permissions
2021-07-18T14:04:38.8571972Z Actions: write
2021-07-18T14:04:38.8572519Z Checks: write
2021-07-18T14:04:38.8572971Z Contents: write
2021-07-18T14:04:38.8573493Z Deployments: write
2021-07-18T14:04:38.8574648Z Discussions: write
2021-07-18T14:04:38.8575199Z Issues: write
2021-07-18T14:04:38.8575860Z Metadata: read
2021-07-18T14:04:38.8576845Z Packages: write
2021-07-18T14:04:38.8577426Z PullRequests: write
2021-07-18T14:04:38.8578220Z RepositoryProjects: write
2021-07-18T14:04:38.8578894Z SecurityEvents: write
2021-07-18T14:04:38.8579416Z Statuses: write
2021-07-18T14:04:38.8580419Z ##[endgroup]
2021-07-18T14:04:38.8584280Z Prepare workflow directory
2021-07-18T14:04:38.9215958Z Prepare all required actions
2021-07-18T14:04:38.9226467Z Getting action download info
2021-07-18T14:04:39.0980483Z Download action repository 'actions/checkout@v2'
2021-07-18T14:04:40.9493221Z Download action repository 'submariner-io/shipyard@devel'
2021-07-18T14:04:41.7659972Z ##[group]Run actions/checkout@v2
2021-07-18T14:04:41.7661360Z with:
2021-07-18T14:04:41.7662040Z   repository: submariner-io/submariner-operator
2021-07-18T14:04:41.7663126Z   token: ***
2021-07-18T14:04:41.7663735Z   ssh-strict: true
2021-07-18T14:04:41.7664744Z   persist-credentials: true
2021-07-18T14:04:41.7665231Z   clean: true
2021-07-18T14:04:41.7665831Z   fetch-depth: 1
2021-07-18T14:04:41.7666569Z   lfs: false
2021-07-18T14:04:41.7667039Z   submodules: false
2021-07-18T14:04:41.7667462Z ##[endgroup]
2021-07-18T14:04:41.9961187Z Syncing repository: submariner-io/submariner-operator
2021-07-18T14:04:41.9978808Z ##[group]Getting Git version info
2021-07-18T14:04:41.9981781Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:42.6921938Z [command]/usr/bin/git version
2021-07-18T14:04:42.7030329Z git version 2.32.0
2021-07-18T14:04:42.7033177Z ##[endgroup]
2021-07-18T14:04:42.7034936Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-18T14:04:42.7037215Z ##[group]Initializing the repository
2021-07-18T14:04:42.7038410Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-18T14:04:42.7039692Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-18T14:04:42.7040601Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-18T14:04:42.7041678Z hint: of your new repositories, which will suppress this warning, call:
2021-07-18T14:04:42.7042576Z hint: 
2021-07-18T14:04:42.7043387Z hint: 	git config --global init.defaultBranch <name>
2021-07-18T14:04:42.7044078Z hint: 
2021-07-18T14:04:42.7044980Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-18T14:04:42.7046245Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-18T14:04:42.7047170Z hint: 
2021-07-18T14:04:42.7049051Z hint: 	git branch -m <name>
2021-07-18T14:04:42.7050603Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-18T14:04:42.7052607Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:42.7053534Z ##[endgroup]
2021-07-18T14:04:42.7054419Z ##[group]Disabling automatic garbage collection
2021-07-18T14:04:42.7055708Z [command]/usr/bin/git config --local gc.auto 0
2021-07-18T14:04:42.7056371Z ##[endgroup]
2021-07-18T14:04:42.7058559Z ##[group]Setting up auth
2021-07-18T14:04:42.7060052Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-18T14:04:42.7061919Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-18T14:04:42.7063907Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-18T14:04:42.7066147Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-18T14:04:42.7068140Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-18T14:04:42.7069469Z ##[endgroup]
2021-07-18T14:04:42.7070159Z ##[group]Fetching the repository
2021-07-18T14:04:42.7071717Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-18T14:04:42.7073189Z remote: Enumerating objects: 486, done.        
2021-07-18T14:04:42.7073905Z remote: Counting objects:   0% (1/486)        
2021-07-18T14:04:42.7074903Z remote: Counting objects:   1% (5/486)        
2021-07-18T14:04:42.7075602Z remote: Counting objects:   2% (10/486)        
2021-07-18T14:04:42.7076294Z remote: Counting objects:   3% (15/486)        
2021-07-18T14:04:42.7077078Z remote: Counting objects:   4% (20/486)        
2021-07-18T14:04:42.7078021Z remote: Counting objects:   5% (25/486)        
2021-07-18T14:04:42.7078657Z remote: Counting objects:   6% (30/486)        
2021-07-18T14:04:42.7079509Z remote: Counting objects:   7% (35/486)        
2021-07-18T14:04:42.7080228Z remote: Counting objects:   8% (39/486)        
2021-07-18T14:04:42.7080885Z remote: Counting objects:   9% (44/486)        
2021-07-18T14:04:42.7081601Z remote: Counting objects:  10% (49/486)        
2021-07-18T14:04:42.7082504Z remote: Counting objects:  11% (54/486)        
2021-07-18T14:04:42.7083141Z remote: Counting objects:  12% (59/486)        
2021-07-18T14:04:42.7083840Z remote: Counting objects:  13% (64/486)        
2021-07-18T14:04:42.7084471Z remote: Counting objects:  14% (69/486)        
2021-07-18T14:04:42.7085341Z remote: Counting objects:  15% (73/486)        
2021-07-18T14:04:42.7086031Z remote: Counting objects:  16% (78/486)        
2021-07-18T14:04:42.7086689Z remote: Counting objects:  17% (83/486)        
2021-07-18T14:04:42.7087416Z remote: Counting objects:  18% (88/486)        
2021-07-18T14:04:42.7088282Z remote: Counting objects:  19% (93/486)        
2021-07-18T14:04:42.7089335Z remote: Counting objects:  20% (98/486)        
2021-07-18T14:04:42.7090066Z remote: Counting objects:  21% (103/486)        
2021-07-18T14:04:42.7090735Z remote: Counting objects:  22% (107/486)        
2021-07-18T14:04:42.7091462Z remote: Counting objects:  23% (112/486)        
2021-07-18T14:04:42.7092133Z remote: Counting objects:  24% (117/486)        
2021-07-18T14:04:42.7093013Z remote: Counting objects:  25% (122/486)        
2021-07-18T14:04:42.7093691Z remote: Counting objects:  26% (127/486)        
2021-07-18T14:04:42.7094326Z remote: Counting objects:  27% (132/486)        
2021-07-18T14:04:42.7094885Z remote: Counting objects:  28% (137/486)        
2021-07-18T14:04:42.7095547Z remote: Counting objects:  29% (141/486)        
2021-07-18T14:04:42.7096237Z remote: Counting objects:  30% (146/486)        
2021-07-18T14:04:42.7096909Z remote: Counting objects:  31% (151/486)        
2021-07-18T14:04:42.7097540Z remote: Counting objects:  32% (156/486)        
2021-07-18T14:04:42.7098114Z remote: Counting objects:  33% (161/486)        
2021-07-18T14:04:42.7098748Z remote: Counting objects:  34% (166/486)        
2021-07-18T14:04:42.7099817Z remote: Counting objects:  35% (171/486)        
2021-07-18T14:04:42.7100950Z remote: Counting objects:  36% (175/486)        
2021-07-18T14:04:42.7101613Z remote: Counting objects:  37% (180/486)        
2021-07-18T14:04:42.7102381Z remote: Counting objects:  38% (185/486)        
2021-07-18T14:04:42.7103023Z remote: Counting objects:  39% (190/486)        
2021-07-18T14:04:42.7103749Z remote: Counting objects:  40% (195/486)        
2021-07-18T14:04:42.7104761Z remote: Counting objects:  41% (200/486)        
2021-07-18T14:04:42.7105359Z remote: Counting objects:  42% (205/486)        
2021-07-18T14:04:42.7106078Z remote: Counting objects:  43% (209/486)        
2021-07-18T14:04:42.7106730Z remote: Counting objects:  44% (214/486)        
2021-07-18T14:04:42.7107326Z remote: Counting objects:  45% (219/486)        
2021-07-18T14:04:42.7107955Z remote: Counting objects:  46% (224/486)        
2021-07-18T14:04:42.7108739Z remote: Counting objects:  47% (229/486)        
2021-07-18T14:04:42.7109635Z remote: Counting objects:  48% (234/486)        
2021-07-18T14:04:42.7110304Z remote: Counting objects:  49% (239/486)        
2021-07-18T14:04:42.7110927Z remote: Counting objects:  50% (243/486)        
2021-07-18T14:04:42.7111916Z remote: Counting objects:  51% (248/486)        
2021-07-18T14:04:42.7112700Z remote: Counting objects:  52% (253/486)        
2021-07-18T14:04:42.7113387Z remote: Counting objects:  53% (258/486)        
2021-07-18T14:04:42.7114020Z remote: Counting objects:  54% (263/486)        
2021-07-18T14:04:42.7114622Z remote: Counting objects:  55% (268/486)        
2021-07-18T14:04:42.7115610Z remote: Counting objects:  56% (273/486)        
2021-07-18T14:04:42.7116295Z remote: Counting objects:  57% (278/486)        
2021-07-18T14:04:42.7117070Z remote: Counting objects:  58% (282/486)        
2021-07-18T14:04:42.7349107Z remote: Counting objects:  59% (287/486)        
2021-07-18T14:04:42.7353310Z remote: Counting objects:  60% (292/486)        
2021-07-18T14:04:42.7353833Z remote: Counting objects:  61% (297/486)        
2021-07-18T14:04:42.7354485Z remote: Counting objects:  62% (302/486)        
2021-07-18T14:04:42.7354964Z remote: Counting objects:  63% (307/486)        
2021-07-18T14:04:42.7355437Z remote: Counting objects:  64% (312/486)        
2021-07-18T14:04:42.7355998Z remote: Counting objects:  65% (316/486)        
2021-07-18T14:04:42.7356467Z remote: Counting objects:  66% (321/486)        
2021-07-18T14:04:42.7356922Z remote: Counting objects:  67% (326/486)        
2021-07-18T14:04:42.7357383Z remote: Counting objects:  68% (331/486)        
2021-07-18T14:04:42.7357841Z remote: Counting objects:  69% (336/486)        
2021-07-18T14:04:42.7358509Z remote: Counting objects:  70% (341/486)        
2021-07-18T14:04:42.7359174Z remote: Counting objects:  71% (346/486)        
2021-07-18T14:04:42.7359666Z remote: Counting objects:  72% (350/486)        
2021-07-18T14:04:42.7360159Z remote: Counting objects:  73% (355/486)        
2021-07-18T14:04:42.7360824Z remote: Counting objects:  74% (360/486)        
2021-07-18T14:04:42.7361464Z remote: Counting objects:  75% (365/486)        
2021-07-18T14:04:42.7361926Z remote: Counting objects:  76% (370/486)        
2021-07-18T14:04:42.7362552Z remote: Counting objects:  77% (375/486)        
2021-07-18T14:04:42.7363001Z remote: Counting objects:  78% (380/486)        
2021-07-18T14:04:42.7363448Z remote: Counting objects:  79% (384/486)        
2021-07-18T14:04:42.7363889Z remote: Counting objects:  80% (389/486)        
2021-07-18T14:04:42.7364339Z remote: Counting objects:  81% (394/486)        
2021-07-18T14:04:42.7364782Z remote: Counting objects:  82% (399/486)        
2021-07-18T14:04:42.7365245Z remote: Counting objects:  83% (404/486)        
2021-07-18T14:04:42.7365699Z remote: Counting objects:  84% (409/486)        
2021-07-18T14:04:42.7366327Z remote: Counting objects:  85% (414/486)        
2021-07-18T14:04:42.7366788Z remote: Counting objects:  86% (418/486)        
2021-07-18T14:04:42.7367441Z remote: Counting objects:  87% (423/486)        
2021-07-18T14:04:42.7368310Z remote: Counting objects:  88% (428/486)        
2021-07-18T14:04:42.7368757Z remote: Counting objects:  89% (433/486)        
2021-07-18T14:04:42.7369206Z remote: Counting objects:  90% (438/486)        
2021-07-18T14:04:42.7369843Z remote: Counting objects:  91% (443/486)        
2021-07-18T14:04:42.7370306Z remote: Counting objects:  92% (448/486)        
2021-07-18T14:04:42.7370776Z remote: Counting objects:  93% (452/486)        
2021-07-18T14:04:42.7371238Z remote: Counting objects:  94% (457/486)        
2021-07-18T14:04:42.7372048Z remote: Counting objects:  95% (462/486)        
2021-07-18T14:04:42.7372519Z remote: Counting objects:  96% (467/486)        
2021-07-18T14:04:42.7373142Z remote: Counting objects:  97% (472/486)        
2021-07-18T14:04:42.7373585Z remote: Counting objects:  98% (477/486)        
2021-07-18T14:04:42.7374030Z remote: Counting objects:  99% (482/486)        
2021-07-18T14:04:42.7374470Z remote: Counting objects: 100% (486/486)        
2021-07-18T14:04:42.7374951Z remote: Counting objects: 100% (486/486), done.        
2021-07-18T14:04:42.7375449Z remote: Compressing objects:   0% (1/351)        
2021-07-18T14:04:42.7376085Z remote: Compressing objects:   1% (4/351)        
2021-07-18T14:04:42.7376564Z remote: Compressing objects:   2% (8/351)        
2021-07-18T14:04:42.7377041Z remote: Compressing objects:   3% (11/351)        
2021-07-18T14:04:42.7377525Z remote: Compressing objects:   4% (15/351)        
2021-07-18T14:04:42.7378001Z remote: Compressing objects:   5% (18/351)        
2021-07-18T14:04:42.7378490Z remote: Compressing objects:   6% (22/351)        
2021-07-18T14:04:42.7379068Z remote: Compressing objects:   7% (25/351)        
2021-07-18T14:04:42.7379575Z remote: Compressing objects:   8% (29/351)        
2021-07-18T14:04:42.7380068Z remote: Compressing objects:   9% (32/351)        
2021-07-18T14:04:42.7380542Z remote: Compressing objects:  10% (36/351)        
2021-07-18T14:04:42.7381031Z remote: Compressing objects:  11% (39/351)        
2021-07-18T14:04:42.7381508Z remote: Compressing objects:  12% (43/351)        
2021-07-18T14:04:42.7381979Z remote: Compressing objects:  13% (46/351)        
2021-07-18T14:04:42.7382445Z remote: Compressing objects:  14% (50/351)        
2021-07-18T14:04:42.7382921Z remote: Compressing objects:  15% (53/351)        
2021-07-18T14:04:42.7383387Z remote: Compressing objects:  16% (57/351)        
2021-07-18T14:04:42.7383866Z remote: Compressing objects:  17% (60/351)        
2021-07-18T14:04:42.7384340Z remote: Compressing objects:  18% (64/351)        
2021-07-18T14:04:42.7384811Z remote: Compressing objects:  19% (67/351)        
2021-07-18T14:04:42.7385283Z remote: Compressing objects:  20% (71/351)        
2021-07-18T14:04:42.7385747Z remote: Compressing objects:  21% (74/351)        
2021-07-18T14:04:42.7386229Z remote: Compressing objects:  22% (78/351)        
2021-07-18T14:04:42.7386698Z remote: Compressing objects:  23% (81/351)        
2021-07-18T14:04:42.7387175Z remote: Compressing objects:  24% (85/351)        
2021-07-18T14:04:42.7387644Z remote: Compressing objects:  25% (88/351)        
2021-07-18T14:04:42.7388115Z remote: Compressing objects:  26% (92/351)        
2021-07-18T14:04:42.7388595Z remote: Compressing objects:  27% (95/351)        
2021-07-18T14:04:42.7389065Z remote: Compressing objects:  28% (99/351)        
2021-07-18T14:04:42.7389539Z remote: Compressing objects:  29% (102/351)        
2021-07-18T14:04:42.7390204Z remote: Compressing objects:  30% (106/351)        
2021-07-18T14:04:42.7390700Z remote: Compressing objects:  31% (109/351)        
2021-07-18T14:04:42.7391195Z remote: Compressing objects:  32% (113/351)        
2021-07-18T14:04:42.7391692Z remote: Compressing objects:  33% (116/351)        
2021-07-18T14:04:42.7392178Z remote: Compressing objects:  34% (120/351)        
2021-07-18T14:04:42.7392838Z remote: Compressing objects:  35% (123/351)        
2021-07-18T14:04:42.7393319Z remote: Compressing objects:  36% (127/351)        
2021-07-18T14:04:42.7393926Z remote: Compressing objects:  37% (130/351)        
2021-07-18T14:04:42.7394783Z remote: Compressing objects:  38% (134/351)        
2021-07-18T14:04:42.7395473Z remote: Compressing objects:  39% (137/351)        
2021-07-18T14:04:42.7396108Z remote: Compressing objects:  40% (141/351)        
2021-07-18T14:04:42.7396667Z remote: Compressing objects:  41% (144/351)        
2021-07-18T14:04:42.7397221Z remote: Compressing objects:  42% (148/351)        
2021-07-18T14:04:42.7397900Z remote: Compressing objects:  43% (151/351)        
2021-07-18T14:04:42.7398396Z remote: Compressing objects:  44% (155/351)        
2021-07-18T14:04:42.7399045Z remote: Compressing objects:  45% (158/351)        
2021-07-18T14:04:42.7399524Z remote: Compressing objects:  46% (162/351)        
2021-07-18T14:04:42.7400019Z remote: Compressing objects:  47% (165/351)        
2021-07-18T14:04:42.7400499Z remote: Compressing objects:  48% (169/351)        
2021-07-18T14:04:42.7401177Z remote: Compressing objects:  49% (172/351)        
2021-07-18T14:04:42.7401649Z remote: Compressing objects:  50% (176/351)        
2021-07-18T14:04:42.7402133Z remote: Compressing objects:  51% (180/351)        
2021-07-18T14:04:42.7402605Z remote: Compressing objects:  52% (183/351)        
2021-07-18T14:04:42.7403062Z remote: Compressing objects:  53% (187/351)        
2021-07-18T14:04:42.7403530Z remote: Compressing objects:  54% (190/351)        
2021-07-18T14:04:42.7403990Z remote: Compressing objects:  55% (194/351)        
2021-07-18T14:04:42.7404444Z remote: Compressing objects:  56% (197/351)        
2021-07-18T14:04:42.7405078Z remote: Compressing objects:  57% (201/351)        
2021-07-18T14:04:42.7405638Z remote: Compressing objects:  58% (204/351)        
2021-07-18T14:04:42.7406127Z remote: Compressing objects:  59% (208/351)        
2021-07-18T14:04:42.7406601Z remote: Compressing objects:  60% (211/351)        
2021-07-18T14:04:42.7407074Z remote: Compressing objects:  61% (215/351)        
2021-07-18T14:04:42.7407557Z remote: Compressing objects:  62% (218/351)        
2021-07-18T14:04:42.7408568Z remote: Compressing objects:  63% (222/351)        
2021-07-18T14:04:42.7409039Z remote: Compressing objects:  64% (225/351)        
2021-07-18T14:04:42.7409699Z remote: Compressing objects:  65% (229/351)        
2021-07-18T14:04:42.7410183Z remote: Compressing objects:  66% (232/351)        
2021-07-18T14:04:42.7410674Z remote: Compressing objects:  67% (236/351)        
2021-07-18T14:04:42.7411533Z remote: Compressing objects:  68% (239/351)        
2021-07-18T14:04:42.7412051Z remote: Compressing objects:  69% (243/351)        
2021-07-18T14:04:42.7412567Z remote: Compressing objects:  70% (246/351)        
2021-07-18T14:04:42.7413231Z remote: Compressing objects:  71% (250/351)        
2021-07-18T14:04:42.7413735Z remote: Compressing objects:  72% (253/351)        
2021-07-18T14:04:42.7414225Z remote: Compressing objects:  73% (257/351)        
2021-07-18T14:04:42.7415040Z remote: Compressing objects:  74% (260/351)        
2021-07-18T14:04:42.7415504Z remote: Compressing objects:  75% (264/351)        
2021-07-18T14:04:42.7415966Z remote: Compressing objects:  76% (267/351)        
2021-07-18T14:04:42.7416426Z remote: Compressing objects:  77% (271/351)        
2021-07-18T14:04:42.7416904Z remote: Compressing objects:  78% (274/351)        
2021-07-18T14:04:42.7417388Z remote: Compressing objects:  79% (278/351)        
2021-07-18T14:04:42.7417854Z remote: Compressing objects:  80% (281/351)        
2021-07-18T14:04:42.7418335Z remote: Compressing objects:  81% (285/351)        
2021-07-18T14:04:42.7418804Z remote: Compressing objects:  82% (288/351)        
2021-07-18T14:04:42.7419292Z remote: Compressing objects:  83% (292/351)        
2021-07-18T14:04:42.7419759Z remote: Compressing objects:  84% (295/351)        
2021-07-18T14:04:42.7420230Z remote: Compressing objects:  85% (299/351)        
2021-07-18T14:04:42.7420688Z remote: Compressing objects:  86% (302/351)        
2021-07-18T14:04:42.7421469Z remote: Compressing objects:  87% (306/351)        
2021-07-18T14:04:42.7421966Z remote: Compressing objects:  88% (309/351)        
2021-07-18T14:04:42.7422447Z remote: Compressing objects:  89% (313/351)        
2021-07-18T14:04:42.7422938Z remote: Compressing objects:  90% (316/351)        
2021-07-18T14:04:42.7423442Z remote: Compressing objects:  91% (320/351)        
2021-07-18T14:04:42.7423928Z remote: Compressing objects:  92% (323/351)        
2021-07-18T14:04:42.7424746Z remote: Compressing objects:  93% (327/351)        
2021-07-18T14:04:42.7425207Z remote: Compressing objects:  94% (330/351)        
2021-07-18T14:04:42.7425675Z remote: Compressing objects:  95% (334/351)        
2021-07-18T14:04:42.7426834Z remote: Compressing objects:  96% (337/351)        
2021-07-18T14:04:42.7427355Z remote: Compressing objects:  97% (341/351)        
2021-07-18T14:04:42.7427847Z remote: Compressing objects:  98% (344/351)        
2021-07-18T14:04:42.7428328Z remote: Compressing objects:  99% (348/351)        
2021-07-18T14:04:42.7428831Z remote: Compressing objects: 100% (351/351)        
2021-07-18T14:04:42.7429330Z remote: Compressing objects: 100% (351/351), done.        
2021-07-18T14:04:42.7429790Z Receiving objects:   0% (1/486)
2021-07-18T14:04:42.7430181Z Receiving objects:   1% (5/486)
2021-07-18T14:04:42.7430577Z Receiving objects:   2% (10/486)
2021-07-18T14:04:42.7431155Z Receiving objects:   3% (15/486)
2021-07-18T14:04:42.7431572Z Receiving objects:   4% (20/486)
2021-07-18T14:04:42.7431999Z Receiving objects:   5% (25/486)
2021-07-18T14:04:42.7432417Z Receiving objects:   6% (30/486)
2021-07-18T14:04:42.7432849Z Receiving objects:   7% (35/486)
2021-07-18T14:04:42.7433434Z Receiving objects:   8% (39/486)
2021-07-18T14:04:42.7433894Z Receiving objects:   9% (44/486)
2021-07-18T14:04:42.7434463Z Receiving objects:  10% (49/486)
2021-07-18T14:04:42.7434869Z Receiving objects:  11% (54/486)
2021-07-18T14:04:42.7435267Z Receiving objects:  12% (59/486)
2021-07-18T14:04:42.7435859Z Receiving objects:  13% (64/486)
2021-07-18T14:04:42.7437123Z Receiving objects:  14% (69/486)
2021-07-18T14:04:42.7437656Z Receiving objects:  15% (73/486)
2021-07-18T14:04:42.7438164Z Receiving objects:  16% (78/486)
2021-07-18T14:04:42.7438655Z Receiving objects:  17% (83/486)
2021-07-18T14:04:42.7439161Z Receiving objects:  18% (88/486)
2021-07-18T14:04:42.7439999Z Receiving objects:  19% (93/486)
2021-07-18T14:04:42.7440632Z Receiving objects:  20% (98/486)
2021-07-18T14:04:42.7441096Z Receiving objects:  21% (103/486)
2021-07-18T14:04:42.7443361Z Receiving objects:  22% (107/486)
2021-07-18T14:04:42.7444115Z Receiving objects:  23% (112/486)
2021-07-18T14:04:42.7444750Z Receiving objects:  24% (117/486)
2021-07-18T14:04:42.7451861Z Receiving objects:  25% (122/486)
2021-07-18T14:04:42.7452373Z Receiving objects:  26% (127/486)
2021-07-18T14:04:42.7452840Z Receiving objects:  27% (132/486)
2021-07-18T14:04:42.7453550Z Receiving objects:  28% (137/486)
2021-07-18T14:04:42.7454046Z Receiving objects:  29% (141/486)
2021-07-18T14:04:42.7454870Z Receiving objects:  30% (146/486)
2021-07-18T14:04:42.7455493Z Receiving objects:  31% (151/486)
2021-07-18T14:04:42.7455926Z Receiving objects:  32% (156/486)
2021-07-18T14:04:42.7456370Z Receiving objects:  33% (161/486)
2021-07-18T14:04:42.7456799Z Receiving objects:  34% (166/486)
2021-07-18T14:04:42.7457248Z Receiving objects:  35% (171/486)
2021-07-18T14:04:42.7457678Z Receiving objects:  36% (175/486)
2021-07-18T14:04:42.7458119Z Receiving objects:  37% (180/486)
2021-07-18T14:04:42.7458590Z Receiving objects:  38% (185/486)
2021-07-18T14:04:42.7459034Z Receiving objects:  39% (190/486)
2021-07-18T14:04:42.7459481Z Receiving objects:  40% (195/486)
2021-07-18T14:04:42.7460082Z Receiving objects:  41% (200/486)
2021-07-18T14:04:42.7460518Z Receiving objects:  42% (205/486)
2021-07-18T14:04:42.7460931Z Receiving objects:  43% (209/486)
2021-07-18T14:04:42.7461551Z Receiving objects:  44% (214/486)
2021-07-18T14:04:42.7461981Z Receiving objects:  45% (219/486)
2021-07-18T14:04:42.7462615Z Receiving objects:  46% (224/486)
2021-07-18T14:04:42.7463044Z Receiving objects:  47% (229/486)
2021-07-18T14:04:42.7463642Z Receiving objects:  48% (234/486)
2021-07-18T14:04:42.7464054Z Receiving objects:  49% (239/486)
2021-07-18T14:04:42.7464644Z Receiving objects:  50% (243/486)
2021-07-18T14:04:42.7465064Z Receiving objects:  51% (248/486)
2021-07-18T14:04:42.7465657Z Receiving objects:  52% (253/486)
2021-07-18T14:04:42.7466286Z Receiving objects:  53% (258/486)
2021-07-18T14:04:42.7467169Z Receiving objects:  54% (263/486)
2021-07-18T14:04:42.7467690Z Receiving objects:  55% (268/486)
2021-07-18T14:04:42.7468184Z Receiving objects:  56% (273/486)
2021-07-18T14:04:42.7468700Z Receiving objects:  57% (278/486)
2021-07-18T14:04:42.7469347Z Receiving objects:  58% (282/486)
2021-07-18T14:04:42.7469821Z Receiving objects:  59% (287/486)
2021-07-18T14:04:42.7470634Z Receiving objects:  60% (292/486)
2021-07-18T14:04:42.7471263Z Receiving objects:  61% (297/486)
2021-07-18T14:04:42.7471877Z Receiving objects:  62% (302/486)
2021-07-18T14:04:42.7472344Z Receiving objects:  63% (307/486)
2021-07-18T14:04:42.7472799Z Receiving objects:  64% (312/486)
2021-07-18T14:04:42.7473403Z Receiving objects:  65% (316/486)
2021-07-18T14:04:42.7473848Z Receiving objects:  66% (321/486)
2021-07-18T14:04:42.7474446Z Receiving objects:  67% (326/486)
2021-07-18T14:04:42.7475026Z Receiving objects:  68% (331/486)
2021-07-18T14:04:42.7475432Z Receiving objects:  69% (336/486)
2021-07-18T14:04:42.7475850Z Receiving objects:  70% (341/486)
2021-07-18T14:04:42.7476251Z Receiving objects:  71% (346/486)
2021-07-18T14:04:42.7476674Z Receiving objects:  72% (350/486)
2021-07-18T14:04:42.7477159Z Receiving objects:  73% (355/486)
2021-07-18T14:04:42.7477595Z Receiving objects:  74% (360/486)
2021-07-18T14:04:42.7478010Z Receiving objects:  75% (365/486)
2021-07-18T14:04:42.7478414Z Receiving objects:  76% (370/486)
2021-07-18T14:04:42.7478834Z Receiving objects:  77% (375/486)
2021-07-18T14:04:42.7479236Z Receiving objects:  78% (380/486)
2021-07-18T14:04:42.7479664Z Receiving objects:  79% (384/486)
2021-07-18T14:04:42.7480071Z Receiving objects:  80% (389/486)
2021-07-18T14:04:42.7480487Z Receiving objects:  81% (394/486)
2021-07-18T14:04:42.7480896Z Receiving objects:  82% (399/486)
2021-07-18T14:04:42.7481503Z Receiving objects:  83% (404/486)
2021-07-18T14:04:42.7481920Z Receiving objects:  84% (409/486)
2021-07-18T14:04:42.7482349Z Receiving objects:  85% (414/486)
2021-07-18T14:04:42.7482780Z Receiving objects:  86% (418/486)
2021-07-18T14:04:42.7483200Z Receiving objects:  87% (423/486)
2021-07-18T14:04:42.7483628Z Receiving objects:  88% (428/486)
2021-07-18T14:04:42.7484048Z Receiving objects:  89% (433/486)
2021-07-18T14:04:42.7484633Z Receiving objects:  90% (438/486)
2021-07-18T14:04:42.7485195Z Receiving objects:  91% (443/486)
2021-07-18T14:04:42.7485602Z Receiving objects:  92% (448/486)
2021-07-18T14:04:42.7485993Z Receiving objects:  93% (452/486)
2021-07-18T14:04:42.7486399Z Receiving objects:  94% (457/486)
2021-07-18T14:04:42.7486799Z Receiving objects:  95% (462/486)
2021-07-18T14:04:42.7487209Z Receiving objects:  96% (467/486)
2021-07-18T14:04:42.7488616Z remote: Total 486 (delta 156), reused 303 (delta 89), pack-reused 0        
2021-07-18T14:04:42.7489167Z Receiving objects:  97% (472/486)
2021-07-18T14:04:42.7489592Z Receiving objects:  98% (477/486)
2021-07-18T14:04:42.7489998Z Receiving objects:  99% (482/486)
2021-07-18T14:04:42.7490414Z Receiving objects: 100% (486/486)
2021-07-18T14:04:42.7490878Z Receiving objects: 100% (486/486), 348.32 KiB | 3.00 MiB/s, done.
2021-07-18T14:04:42.7491497Z Resolving deltas:   0% (0/156)
2021-07-18T14:04:42.7491882Z Resolving deltas:   1% (2/156)
2021-07-18T14:04:42.7492285Z Resolving deltas:   2% (4/156)
2021-07-18T14:04:42.7492669Z Resolving deltas:   3% (5/156)
2021-07-18T14:04:42.7493062Z Resolving deltas:   4% (7/156)
2021-07-18T14:04:42.7493457Z Resolving deltas:   5% (8/156)
2021-07-18T14:04:42.7493837Z Resolving deltas:   6% (10/156)
2021-07-18T14:04:42.7494236Z Resolving deltas:   7% (11/156)
2021-07-18T14:04:42.7494753Z Resolving deltas:   8% (13/156)
2021-07-18T14:04:42.7495146Z Resolving deltas:   9% (15/156)
2021-07-18T14:04:42.7495532Z Resolving deltas:  10% (16/156)
2021-07-18T14:04:42.7495926Z Resolving deltas:  11% (18/156)
2021-07-18T14:04:42.7496309Z Resolving deltas:  12% (19/156)
2021-07-18T14:04:42.7496704Z Resolving deltas:  13% (21/156)
2021-07-18T14:04:42.7497085Z Resolving deltas:  14% (22/156)
2021-07-18T14:04:42.7497666Z Resolving deltas:  15% (24/156)
2021-07-18T14:04:42.7498073Z Resolving deltas:  16% (25/156)
2021-07-18T14:04:42.7498470Z Resolving deltas:  17% (27/156)
2021-07-18T14:04:42.7498874Z Resolving deltas:  18% (29/156)
2021-07-18T14:04:42.7499453Z Resolving deltas:  19% (30/156)
2021-07-18T14:04:42.7499871Z Resolving deltas:  20% (32/156)
2021-07-18T14:04:42.7500281Z Resolving deltas:  21% (33/156)
2021-07-18T14:04:42.7500698Z Resolving deltas:  22% (35/156)
2021-07-18T14:04:42.7501443Z Resolving deltas:  23% (36/156)
2021-07-18T14:04:42.7501870Z Resolving deltas:  24% (38/156)
2021-07-18T14:04:42.7502273Z Resolving deltas:  25% (39/156)
2021-07-18T14:04:42.7502852Z Resolving deltas:  26% (41/156)
2021-07-18T14:04:42.7503243Z Resolving deltas:  27% (43/156)
2021-07-18T14:04:42.7503650Z Resolving deltas:  28% (44/156)
2021-07-18T14:04:42.7504055Z Resolving deltas:  29% (46/156)
2021-07-18T14:04:42.7504608Z Resolving deltas:  30% (47/156)
2021-07-18T14:04:42.7505004Z Resolving deltas:  31% (49/156)
2021-07-18T14:04:42.7505383Z Resolving deltas:  32% (50/156)
2021-07-18T14:04:42.7505778Z Resolving deltas:  33% (52/156)
2021-07-18T14:04:42.7506343Z Resolving deltas:  34% (54/156)
2021-07-18T14:04:42.7506826Z Resolving deltas:  35% (55/156)
2021-07-18T14:04:42.7507240Z Resolving deltas:  36% (57/156)
2021-07-18T14:04:42.7507643Z Resolving deltas:  37% (58/156)
2021-07-18T14:04:42.7508033Z Resolving deltas:  38% (60/156)
2021-07-18T14:04:42.7508436Z Resolving deltas:  39% (61/156)
2021-07-18T14:04:42.7508827Z Resolving deltas:  40% (63/156)
2021-07-18T14:04:42.7509243Z Resolving deltas:  41% (64/156)
2021-07-18T14:04:42.7509996Z Resolving deltas:  42% (66/156)
2021-07-18T14:04:42.7510384Z Resolving deltas:  43% (68/156)
2021-07-18T14:04:42.7510787Z Resolving deltas:  44% (69/156)
2021-07-18T14:04:42.7511177Z Resolving deltas:  45% (71/156)
2021-07-18T14:04:42.7511583Z Resolving deltas:  46% (72/156)
2021-07-18T14:04:42.7511975Z Resolving deltas:  47% (74/156)
2021-07-18T14:04:42.7512381Z Resolving deltas:  48% (75/156)
2021-07-18T14:04:42.7512929Z Resolving deltas:  49% (77/156)
2021-07-18T14:04:42.7513324Z Resolving deltas:  50% (78/156)
2021-07-18T14:04:42.7513701Z Resolving deltas:  51% (80/156)
2021-07-18T14:04:42.7514106Z Resolving deltas:  52% (82/156)
2021-07-18T14:04:42.7514504Z Resolving deltas:  53% (83/156)
2021-07-18T14:04:42.7515064Z Resolving deltas:  54% (85/156)
2021-07-18T14:04:42.7515652Z Resolving deltas:  55% (86/156)
2021-07-18T14:04:42.7516054Z Resolving deltas:  56% (88/156)
2021-07-18T14:04:42.7516665Z Resolving deltas:  57% (89/156)
2021-07-18T14:04:42.7517089Z Resolving deltas:  58% (91/156)
2021-07-18T14:04:42.7517521Z Resolving deltas:  59% (93/156)
2021-07-18T14:04:42.7517939Z Resolving deltas:  60% (94/156)
2021-07-18T14:04:42.7518369Z Resolving deltas:  61% (96/156)
2021-07-18T14:04:42.7518791Z Resolving deltas:  62% (97/156)
2021-07-18T14:04:42.7519381Z Resolving deltas:  63% (99/156)
2021-07-18T14:04:42.7519781Z Resolving deltas:  64% (100/156)
2021-07-18T14:04:42.7520357Z Resolving deltas:  65% (102/156)
2021-07-18T14:04:42.7520754Z Resolving deltas:  66% (103/156)
2021-07-18T14:04:42.7521140Z Resolving deltas:  67% (105/156)
2021-07-18T14:04:42.7521536Z Resolving deltas:  68% (107/156)
2021-07-18T14:04:42.7521928Z Resolving deltas:  69% (108/156)
2021-07-18T14:04:42.7522329Z Resolving deltas:  70% (110/156)
2021-07-18T14:04:42.7522711Z Resolving deltas:  71% (111/156)
2021-07-18T14:04:42.7523107Z Resolving deltas:  72% (113/156)
2021-07-18T14:04:42.7523490Z Resolving deltas:  73% (114/156)
2021-07-18T14:04:42.7523888Z Resolving deltas:  74% (116/156)
2021-07-18T14:04:42.7524534Z Resolving deltas:  75% (117/156)
2021-07-18T14:04:42.7524941Z Resolving deltas:  76% (119/156)
2021-07-18T14:04:42.7525338Z Resolving deltas:  77% (121/156)
2021-07-18T14:04:42.7525753Z Resolving deltas:  78% (122/156)
2021-07-18T14:04:42.7526163Z Resolving deltas:  79% (124/156)
2021-07-18T14:04:42.7526556Z Resolving deltas:  80% (125/156)
2021-07-18T14:04:42.7526966Z Resolving deltas:  81% (127/156)
2021-07-18T14:04:42.7527357Z Resolving deltas:  82% (128/156)
2021-07-18T14:04:42.7528111Z Resolving deltas:  83% (130/156)
2021-07-18T14:04:42.7528522Z Resolving deltas:  84% (132/156)
2021-07-18T14:04:42.7529116Z Resolving deltas:  85% (133/156)
2021-07-18T14:04:42.7529518Z Resolving deltas:  86% (135/156)
2021-07-18T14:04:42.7529925Z Resolving deltas:  87% (136/156)
2021-07-18T14:04:42.7530612Z Resolving deltas:  88% (138/156)
2021-07-18T14:04:42.7531216Z Resolving deltas:  89% (139/156)
2021-07-18T14:04:42.7531622Z Resolving deltas:  90% (141/156)
2021-07-18T14:04:42.7532028Z Resolving deltas:  91% (142/156)
2021-07-18T14:04:42.7532425Z Resolving deltas:  92% (144/156)
2021-07-18T14:04:42.7532812Z Resolving deltas:  93% (146/156)
2021-07-18T14:04:42.7533211Z Resolving deltas:  94% (147/156)
2021-07-18T14:04:42.7533599Z Resolving deltas:  95% (149/156)
2021-07-18T14:04:42.7533998Z Resolving deltas:  96% (150/156)
2021-07-18T14:04:42.7534384Z Resolving deltas:  97% (152/156)
2021-07-18T14:04:42.7534783Z Resolving deltas:  98% (153/156)
2021-07-18T14:04:42.7535343Z Resolving deltas:  99% (155/156)
2021-07-18T14:04:42.7535731Z Resolving deltas: 100% (156/156)
2021-07-18T14:04:42.7536126Z Resolving deltas: 100% (156/156), done.
2021-07-18T14:04:42.7538849Z From https://github.com/submariner-io/submariner-operator
2021-07-18T14:04:42.7540163Z  * [new ref]         0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-18T14:04:42.7540899Z ##[endgroup]
2021-07-18T14:04:42.7541466Z ##[group]Determining the checkout info
2021-07-18T14:04:42.7541997Z ##[endgroup]
2021-07-18T14:04:42.7542501Z ##[group]Checking out the ref
2021-07-18T14:04:42.7543672Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-18T14:04:42.7544728Z Switched to a new branch 'devel'
2021-07-18T14:04:42.7551548Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-18T14:04:42.7552264Z ##[endgroup]
2021-07-18T14:04:42.7553043Z [command]/usr/bin/git log -1 --format='%H'
2021-07-18T14:04:42.7553706Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-18T14:04:42.7805653Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-18T14:04:42.7806207Z with:
2021-07-18T14:04:42.7806531Z   k8s_version: 1.20
2021-07-18T14:04:42.7806875Z   using:  globalnet 
2021-07-18T14:04:42.7807464Z   working-directory: .
2021-07-18T14:04:42.7808057Z   target: e2e
2021-07-18T14:04:42.7808548Z   focus: \[.*\]
2021-07-18T14:04:42.7808948Z   skip: \[external-dataplane\]
2021-07-18T14:04:42.7809384Z   testdir: test/e2e
2021-07-18T14:04:42.7809743Z ##[endgroup]
2021-07-18T14:04:42.7992670Z ##[group]Reclaiming free space
2021-07-18T14:04:43.9997682Z Filesystem      Size  Used Avail Use% Mounted on
2021-07-18T14:04:43.9998234Z /dev/root        84G   42G   43G  50% /
2021-07-18T14:04:43.9998821Z devtmpfs        3.4G     0  3.4G   0% /dev
2021-07-18T14:04:43.9999227Z tmpfs           3.4G   12K  3.4G   1% /dev/shm
2021-07-18T14:04:43.9999629Z tmpfs           696M  1.1M  695M   1% /run
2021-07-18T14:04:44.0000377Z tmpfs           5.0M     0  5.0M   0% /run/lock
2021-07-18T14:04:44.0001149Z tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
2021-07-18T14:04:44.0001823Z /dev/loop0       56M   56M     0 100% /snap/core18/2074
2021-07-18T14:04:44.0002298Z /dev/sdb15      105M  7.9M   97M   8% /boot/efi
2021-07-18T14:04:44.0002784Z /dev/loop1       56M   56M     0 100% /snap/core18/2066
2021-07-18T14:04:44.0003417Z /dev/loop3       33M   33M     0 100% /snap/snapd/12398
2021-07-18T14:04:44.0004025Z /dev/loop2       68M   68M     0 100% /snap/lxd/20326
2021-07-18T14:04:44.0004648Z /dev/loop4       33M   33M     0 100% /snap/snapd/12159
2021-07-18T14:04:44.0005046Z /dev/sda1        14G  4.1G  9.0G  32% /mnt
2021-07-18T14:04:44.0005886Z ##[endgroup]
2021-07-18T14:04:44.0161739Z ##[group]Disable swap
2021-07-18T14:04:44.0510892Z ##[endgroup]
2021-07-18T14:04:44.0650369Z ##[group]Report available RAM
2021-07-18T14:04:44.0675535Z               total        used        free      shared  buff/cache   available
2021-07-18T14:04:44.0676293Z Mem:          6.8Gi       483Mi       5.2Gi       7.0Mi       1.1Gi       6.0Gi
2021-07-18T14:04:44.0676698Z Swap:            0B          0B          0B
2021-07-18T14:04:44.0677324Z ##[endgroup]
2021-07-18T14:04:44.1109019Z Downloading Makefile.dapper
2021-07-18T14:04:44.1589474Z Downloading dapper
2021-07-18T14:04:44.7457347Z .dapper.tmp version v0.5.6
2021-07-18T14:04:44.7501213Z Downloading Dockerfile.dapper
2021-07-18T14:04:44.8329885Z docker network create -d bridge kind
2021-07-18T14:04:45.2142109Z f731462dfad12cb791af092aa9b7fb9b51491feccfcae378b627b4296020da1b
2021-07-18T14:04:45.2164821Z ./.dapper -m bind  make --debug=b e2e
2021-07-18T14:04:45.4591791Z Sending build context to Docker daemon  7.516MB
2021-07-18T14:04:45.4592815Z 
2021-07-18T14:04:45.4675704Z Step 1/8 : ARG BASE_BRANCH
2021-07-18T14:04:45.4677593Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-18T14:04:46.2989656Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-18T14:04:46.3006144Z b1495d80d526: Pulling fs layer
2021-07-18T14:04:46.3047264Z fb3037ce215d: Pulling fs layer
2021-07-18T14:04:46.3048776Z 95344349df1d: Pulling fs layer
2021-07-18T14:04:46.3050023Z a3e11b0fdbf6: Pulling fs layer
2021-07-18T14:04:46.3050854Z b2d0ef6cbe4f: Pulling fs layer
2021-07-18T14:04:46.3051451Z fa188fe30729: Pulling fs layer
2021-07-18T14:04:46.3052104Z 05ca4b0545ef: Pulling fs layer
2021-07-18T14:04:46.3053814Z b17ce80b21da: Pulling fs layer
2021-07-18T14:04:46.3054581Z fa188fe30729: Waiting
2021-07-18T14:04:46.3055244Z 05ca4b0545ef: Waiting
2021-07-18T14:04:46.3056884Z b17ce80b21da: Waiting
2021-07-18T14:04:46.3057683Z a3e11b0fdbf6: Waiting
2021-07-18T14:04:46.3058190Z b2d0ef6cbe4f: Waiting
2021-07-18T14:04:47.1865802Z 95344349df1d: Verifying Checksum
2021-07-18T14:04:47.1866460Z 95344349df1d: Download complete
2021-07-18T14:04:47.9519065Z a3e11b0fdbf6: Verifying Checksum
2021-07-18T14:04:47.9519664Z a3e11b0fdbf6: Download complete
2021-07-18T14:04:47.9520179Z b1495d80d526: Verifying Checksum
2021-07-18T14:04:47.9521039Z b1495d80d526: Download complete
2021-07-18T14:04:47.9521797Z b2d0ef6cbe4f: Verifying Checksum
2021-07-18T14:04:47.9522761Z b2d0ef6cbe4f: Download complete
2021-07-18T14:04:47.9523245Z fa188fe30729: Verifying Checksum
2021-07-18T14:04:47.9523695Z fa188fe30729: Download complete
2021-07-18T14:04:47.9524156Z 05ca4b0545ef: Verifying Checksum
2021-07-18T14:04:47.9524598Z 05ca4b0545ef: Download complete
2021-07-18T14:04:48.0928623Z b17ce80b21da: Verifying Checksum
2021-07-18T14:04:48.0929332Z b17ce80b21da: Download complete
2021-07-18T14:04:50.7546542Z b1495d80d526: Pull complete
2021-07-18T14:04:52.9950565Z fb3037ce215d: Download complete
2021-07-18T14:05:03.7654225Z fb3037ce215d: Pull complete
2021-07-18T14:05:05.3450985Z 95344349df1d: Pull complete
2021-07-18T14:05:05.4348875Z a3e11b0fdbf6: Pull complete
2021-07-18T14:05:05.5479245Z b2d0ef6cbe4f: Pull complete
2021-07-18T14:05:05.7811853Z fa188fe30729: Pull complete
2021-07-18T14:05:05.8862507Z 05ca4b0545ef: Pull complete
2021-07-18T14:05:06.0384662Z b17ce80b21da: Pull complete
2021-07-18T14:05:06.0469245Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-18T14:05:06.0499540Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-18T14:05:06.0527312Z  ---> 92b726655a41
2021-07-18T14:05:06.0528674Z Step 3/8 : ARG PROJECT
2021-07-18T14:05:06.0956816Z  ---> Running in 363fac42766a
2021-07-18T14:05:07.1008128Z Removing intermediate container 363fac42766a
2021-07-18T14:05:07.1009769Z  ---> 28667fce45e3
2021-07-18T14:05:07.1011702Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR"     DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-18T14:05:07.1325511Z  ---> Running in 0c732c54d322
2021-07-18T14:05:08.0631932Z Removing intermediate container 0c732c54d322
2021-07-18T14:05:08.0633473Z  ---> 6113d67b5478
2021-07-18T14:05:08.0634382Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-18T14:05:08.1138994Z  ---> Running in 46898c41132e
2021-07-18T14:05:09.0548671Z Removing intermediate container 46898c41132e
2021-07-18T14:05:09.0549666Z  ---> c7c0d68530b5
2021-07-18T14:05:09.0550054Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-18T14:05:09.0850042Z  ---> Running in 1292ed3da9aa
2021-07-18T14:05:10.0648131Z Removing intermediate container 1292ed3da9aa
2021-07-18T14:05:10.0649100Z  ---> 5042370f3907
2021-07-18T14:05:10.0649543Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-18T14:05:10.0934361Z  ---> Running in 569359bb7693
2021-07-18T14:05:11.0903607Z Removing intermediate container 569359bb7693
2021-07-18T14:05:11.0904709Z  ---> 50b12bf8904d
2021-07-18T14:05:11.0905078Z Step 8/8 : CMD ["sh"]
2021-07-18T14:05:11.1449965Z  ---> Running in f673c57a6380
2021-07-18T14:05:12.2125949Z Removing intermediate container f673c57a6380
2021-07-18T14:05:12.2127014Z  ---> 2475b7b3e661
2021-07-18T14:05:12.2243119Z Successfully built 2475b7b3e661
2021-07-18T14:05:12.2331389Z Successfully tagged submariner-operator:devel
2021-07-18T14:05:12.8126868Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-18T14:05:12.8128054Z [submariner-operator]$ mkdir -p bin dist output
2021-07-18T14:05:12.8159219Z [submariner-operator]$ make --debug=b e2e
2021-07-18T14:05:12.8167042Z GNU Make 4.3
2021-07-18T14:05:12.8181798Z Built for x86_64-redhat-linux-gnu
2021-07-18T14:05:12.8182735Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-18T14:05:12.8183602Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-18T14:05:12.8184310Z This is free software: you are free to change and redistribute it.
2021-07-18T14:05:12.8184913Z There is NO WARRANTY, to the extent permitted by law.
2021-07-18T14:05:12.8185591Z Reading makefiles...
2021-07-18T14:05:12.9335013Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-18T14:05:12.9336025Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-18T14:05:13.1363059Z Updating makefiles....
2021-07-18T14:05:13.1375208Z Updating goal targets....
2021-07-18T14:05:13.1377140Z  File 'e2e' does not exist.
2021-07-18T14:05:13.1377827Z      File 'clusters' does not exist.
2021-07-18T14:05:13.1378516Z     Must remake target 'clusters'.
2021-07-18T14:05:13.1380037Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.20" --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:13.1404505Z Downloading shflags 1.0.3
2021-07-18T14:05:13.1459180Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-07-18T14:05:13.1459828Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-07-18T14:05:13.1460162Z 
2021-07-18T14:05:13.1856612Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-07-18T14:05:13.1857283Z 100 31091  100 31091    0     0   778k      0 --:--:-- --:--:-- --:--:--  778k
2021-07-18T14:05:13.2571430Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=true, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-18T14:05:13.2595600Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:05:13.2608887Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:13.2619328Z [submariner-operator]$ script_name=utils
2021-07-18T14:05:13.2630603Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:13.2648372Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:05:13.2659732Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:13.2671372Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:13.2683941Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:13.2711402Z [submariner-operator]$ broker=cluster1
2021-07-18T14:05:13.2723494Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:05:13.2733742Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:05:13.2745261Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:05:13.2757678Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:05:13.2769771Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:05:13.2779864Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:05:13.2790680Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:05:13.2802023Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:05:13.2812653Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:05:13.2835237Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:05:13.2844743Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:05:13.2858372Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:05:13.2870643Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:05:13.2884471Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:05:13.2899441Z [submariner-operator]$ exec_name=clusters.sh
2021-07-18T14:05:13.2918830Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:05:13.2931023Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:05:13.2957155Z [submariner-operator]$ cat <<EOM
2021-07-18T14:05:13.2958423Z Cluster settings::
2021-07-18T14:05:13.2959078Z   broker - ${broker@Q}
2021-07-18T14:05:13.2959568Z   clusters - ${clusters[*]@Q}
2021-07-18T14:05:13.2960151Z   cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-18T14:05:13.2961015Z   nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-18T14:05:13.2961820Z   install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-18T14:05:13.2962367Z EOM
2021-07-18T14:05:13.2975449Z [submariner-operator]$ typeset -p cluster_cni
2021-07-18T14:05:13.2987968Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:13.3017945Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-18T14:05:13.3031220Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:13.3060059Z [submariner-operator]$ typeset -p cluster_subm
2021-07-18T14:05:13.3072473Z [submariner-operator]$ cut -f 2- -d=
2021-07-18T14:05:13.3096112Z Cluster settings::
2021-07-18T14:05:13.3098778Z   broker - 'cluster1'
2021-07-18T14:05:13.3099571Z   clusters - 'cluster1' 'cluster2'
2021-07-18T14:05:13.3100234Z   cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-18T14:05:13.3101385Z   nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-18T14:05:13.3102527Z   install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-18T14:05:13.3124489Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:13.3155351Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-18T14:05:13.3182908Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:13.3196975Z [submariner-operator]$ run_local_registry
2021-07-18T14:05:13.3209069Z [submariner-operator]$ registry_running
2021-07-18T14:05:13.3222461Z [submariner-operator]$ registry_running
2021-07-18T14:05:13.3233893Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-18T14:05:13.3248754Z [submariner-operator]$ grep kind-registry
2021-07-18T14:05:13.5895774Z [submariner-operator]$ return 0
2021-07-18T14:05:13.5920626Z Deploying local registry kind-registry to serve images centrally.
2021-07-18T14:05:13.5940525Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-18T14:05:13.5954948Z [submariner-operator]$ selinuxenabled
2021-07-18T14:05:13.5974650Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-18T14:05:13.8384867Z Unable to find image 'registry:2' locally
2021-07-18T14:05:14.5951478Z 2: Pulling from library/registry
2021-07-18T14:05:14.7939149Z ddad3d7c1e96: Already exists
2021-07-18T14:05:14.7976888Z 6eda6749503f: Pulling fs layer
2021-07-18T14:05:14.7977556Z 363ab70c2143: Pulling fs layer
2021-07-18T14:05:14.7977982Z 5b94580856e6: Pulling fs layer
2021-07-18T14:05:14.7978370Z 12008541203a: Pulling fs layer
2021-07-18T14:05:14.7978734Z 12008541203a: Waiting
2021-07-18T14:05:15.0121202Z 5b94580856e6: Verifying Checksum
2021-07-18T14:05:15.0123565Z 5b94580856e6: Download complete
2021-07-18T14:05:15.0633826Z 6eda6749503f: Download complete
2021-07-18T14:05:15.1217311Z 363ab70c2143: Download complete
2021-07-18T14:05:15.2366129Z 12008541203a: Verifying Checksum
2021-07-18T14:05:15.2367600Z 12008541203a: Download complete
2021-07-18T14:05:15.2538240Z 6eda6749503f: Pull complete
2021-07-18T14:05:15.6148830Z 363ab70c2143: Pull complete
2021-07-18T14:05:15.6939937Z 5b94580856e6: Pull complete
2021-07-18T14:05:15.7749434Z 12008541203a: Pull complete
2021-07-18T14:05:15.7837802Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-18T14:05:15.7869241Z Status: Downloaded newer image for registry:2
2021-07-18T14:05:15.8283716Z 8c60534bff2275aab597ccf727f667ec87a56277207210487f329f1fa4ca5028
2021-07-18T14:05:16.1847173Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-18T14:05:16.5968610Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:16.5978952Z [submariner-operator]$ declare_cidrs
2021-07-18T14:05:16.6007201Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:05:16.6020546Z [submariner-operator]$ i=1
2021-07-18T14:05:16.6023830Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:16.6044994Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:05:16.6057960Z [submariner-operator]$ [cluster1] val=0
2021-07-18T14:05:16.6071493Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-18T14:05:16.6085523Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-18T14:05:16.6098870Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-18T14:05:16.6108596Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:05:16.6125829Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:16.6140143Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:05:16.6157421Z [submariner-operator]$ [cluster2] val=0
2021-07-18T14:05:16.6174131Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-18T14:05:16.6191755Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-18T14:05:16.6207091Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-18T14:05:16.6220672Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:05:16.6240087Z [submariner-operator]$ [cluster2] wait 238
2021-07-18T14:05:16.6249883Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6266485Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6282457Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6301166Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6325393Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:05:16.6344896Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:05:16.6367138Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:05:16.6371832Z [submariner-operator]$ [cluster1] pids[cluster1]=247
2021-07-18T14:05:16.6392305Z [submariner-operator]$ [cluster2] pids[cluster2]=251
2021-07-18T14:05:16.6400642Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:05:16.6405255Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6415356Z [submariner-operator]$ [cluster2] wait 251
2021-07-18T14:05:16.6426674Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:05:16.6439301Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-18T14:05:16.6475864Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:07:23.6692427Z [submariner-operator]$ [cluster1] with_retries
2021-07-18T14:07:23.6693314Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:07:23.6694080Z [submariner-operator]$ [cluster1] wait 270
2021-07-18T14:07:23.6695243Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:23.6696344Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-18T14:07:23.6697811Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:23.6700900Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:07:23.6703116Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-18T14:07:23.6704011Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-18T14:07:23.6704554Z [cluster1] No kind clusters found.
2021-07-18T14:07:23.6705012Z [cluster1] Creating KIND cluster...
2021-07-18T14:07:23.6705747Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:23.6706568Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-18T14:07:23.6707373Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-18T14:07:23.6708115Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:23.6708771Z [cluster1] - role: control-plane
2021-07-18T14:07:23.6709412Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:23.6710055Z [cluster1] - role: control-plane
2021-07-18T14:07:23.6710592Z [cluster1] - role: worker
2021-07-18T14:07:23.6711208Z [submariner-operator]$ [cluster1] nodes=
2021-07-18T14:07:23.6711831Z [cluster1] - role: control-plane
2021-07-18T14:07:23.6712548Z [cluster1] - role: worker
2021-07-18T14:07:23.6713225Z [cluster1] - role: worker
2021-07-18T14:07:23.6713736Z [cluster1] 
2021-07-18T14:07:23.6714372Z [cluster1] 
2021-07-18T14:07:23.6715231Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-18T14:07:23.6716524Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:23.6717933Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-18T14:07:23.6719220Z [submariner-operator]$ [cluster1] kind version
2021-07-18T14:07:23.6719782Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:23.6720738Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:23.6721906Z [cluster1] ---
2021-07-18T14:07:23.6722272Z [cluster1] kind: Cluster
2021-07-18T14:07:23.6722910Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:23.6723416Z [cluster1] networking:
2021-07-18T14:07:23.6723912Z [cluster1]   disableDefaultCNI: true
2021-07-18T14:07:23.6724704Z [cluster1]   podSubnet: 10.0.0.0/16
2021-07-18T14:07:23.6725326Z [cluster1]   serviceSubnet: 100.0.0.0/16
2021-07-18T14:07:23.6725870Z [cluster1] containerdConfigPatches:
2021-07-18T14:07:23.6726854Z [cluster1]   - |-
2021-07-18T14:07:23.6739217Z [cluster1]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:23.6740472Z [cluster1]       endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:23.6741305Z [cluster1] kubeadmConfigPatches:
2021-07-18T14:07:23.6741878Z [cluster1]   - |
2021-07-18T14:07:23.6742349Z [cluster1]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:23.6743111Z [cluster1]     kind: ClusterConfiguration
2021-07-18T14:07:23.6743608Z [cluster1]     metadata:
2021-07-18T14:07:23.6744000Z [cluster1]       name: config
2021-07-18T14:07:23.6744417Z [cluster1]     networking:
2021-07-18T14:07:23.6745025Z [cluster1]       podSubnet: 10.0.0.0/16
2021-07-18T14:07:23.6745516Z [cluster1]       serviceSubnet: 100.0.0.0/16
2021-07-18T14:07:23.6746370Z [cluster1]       dnsDomain: cluster1.local
2021-07-18T14:07:23.6746812Z [cluster1] nodes: 
2021-07-18T14:07:23.6747364Z [cluster1] - role: control-plane
2021-07-18T14:07:23.6747922Z [cluster1] - role: worker
2021-07-18T14:07:23.6748584Z [cluster1] - role: worker
2021-07-18T14:07:23.6749695Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-18T14:07:23.6750645Z [cluster1] Creating cluster "cluster1" ...
2021-07-18T14:07:23.6752344Z [cluster1]  • Ensuring node image (kindest/node:v1.20.7) 🖼  ...
2021-07-18T14:07:23.6753419Z [cluster1]  ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-18T14:07:23.6754076Z [cluster1]  • Preparing nodes 📦 📦 📦   ...
2021-07-18T14:07:23.6754681Z [cluster1]  ✓ Preparing nodes 📦 📦 📦 
2021-07-18T14:07:23.6755472Z [cluster1]  • Writing configuration 📜  ...
2021-07-18T14:07:23.6756189Z [cluster1]  ✓ Writing configuration 📜
2021-07-18T14:07:23.6757088Z [cluster1]  • Starting control-plane 🕹️  ...
2021-07-18T14:07:23.6757754Z [cluster1]  ✓ Starting control-plane 🕹️
2021-07-18T14:07:23.6758436Z [cluster1]  • Installing StorageClass 💾  ...
2021-07-18T14:07:23.6759215Z [cluster1]  ✓ Installing StorageClass 💾
2021-07-18T14:07:23.6760269Z [cluster1]  • Joining worker nodes 🚜  ...
2021-07-18T14:07:23.6761173Z [cluster1]  ✓ Joining worker nodes 🚜
2021-07-18T14:07:23.6761921Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-18T14:07:23.6763180Z [cluster1] You can now use your cluster with:
2021-07-18T14:07:23.6764152Z [cluster1] 
2021-07-18T14:07:23.6765304Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-18T14:07:23.6765907Z [cluster1] 
2021-07-18T14:07:23.6766930Z [cluster1] Not sure what to do next? 😅  Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-18T14:07:23.6770481Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:23.6771639Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-18T14:07:23.6773541Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-18T14:07:23.6775038Z [submariner-operator]$ [cluster1] head -n 1
2021-07-18T14:07:25.8891152Z [sub[submariner-operator]$ [cluster2] with_retries
2021-07-18T14:07:25.8892512Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:07:25.8893512Z [submariner-operator]$ [cluster2] wait 268
2021-07-18T14:07:25.8894317Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:25.8895201Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-18T14:07:25.8896808Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:25.8898545Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:07:25.8899744Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-18T14:07:25.8900557Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-18T14:07:25.8901130Z [cluster2] No kind clusters found.
2021-07-18T14:07:25.8901585Z [cluster2] Creating KIND cluster...
2021-07-18T14:07:25.8902345Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:25.8903596Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-18T14:07:25.8905016Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-18T14:07:25.8906295Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:25.8907278Z [cluster2] - role: control-plane
2021-07-18T14:07:25.8908106Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:25.8908899Z [cluster2] - role: control-plane
2021-07-18T14:07:25.8909848Z [cluster2] - role: worker
2021-07-18T14:07:25.8910531Z [submariner-operator]$ [cluster2] nodes=
2021-07-18T14:07:25.8911915Z [cluster2] - role: control-plane
2021-07-18T14:07:25.8912552Z [cluster2] - role: worker
2021-07-18T14:07:25.8913139Z [cluster2] - role: worker
2021-07-18T14:07:25.8913686Z [cluster2] 
2021-07-18T14:07:25.8914180Z [cluster2] 
2021-07-18T14:07:25.8915365Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-18T14:07:25.8916457Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-18T14:07:25.8917745Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-18T14:07:25.8918902Z [submariner-operator]$ [cluster2] kind version
2021-07-18T14:07:25.8919451Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-18T14:07:25.8920755Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:25.8921627Z [cluster2] ---
2021-07-18T14:07:25.8921996Z [cluster2] kind: Cluster
2021-07-18T14:07:25.8922602Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-18T14:07:25.8923097Z [cluster2] networking:
2021-07-18T14:07:25.8923716Z [cluster2]   disableDefaultCNI: true
2021-07-18T14:07:25.8924501Z [cluster2]   podSubnet: 10.0.0.0/16
2021-07-18T14:07:25.8924936Z [cluster2]   serviceSubnet: 100.0.0.0/16
2021-07-18T14:07:25.8925491Z [cluster2] containerdConfigPatches:
2021-07-18T14:07:25.8926097Z [cluster2]   - |-
2021-07-18T14:07:25.8926769Z [cluster2]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-18T14:07:25.8928469Z [cluster2]       endpoint = ["http://kind-registry:5000"]
2021-07-18T14:07:25.8929129Z [cluster2] kubeadmConfigPatches:
2021-07-18T14:07:25.8929734Z [cluster2]   - |
2021-07-18T14:07:25.8930197Z [cluster2]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-18T14:07:25.8930774Z [cluster2]     kind: ClusterConfiguration
2021-07-18T14:07:25.8931240Z [cluster2]     metadata:
2021-07-18T14:07:25.8931629Z [cluster2]       name: config
2021-07-18T14:07:25.8932007Z [cluster2]     networking:
2021-07-18T14:07:25.8932420Z [cluster2]       podSubnet: 10.0.0.0/16
2021-07-18T14:07:25.8932849Z [cluster2]       serviceSubnet: 100.0.0.0/16
2021-07-18T14:07:25.8933337Z [cluster2]       dnsDomain: cluster2.local
2021-07-18T14:07:25.8933749Z [cluster2] nodes: 
2021-07-18T14:07:25.8934302Z [cluster2] - role: control-plane
2021-07-18T14:07:25.8934995Z [cluster2] - role: worker
2021-07-18T14:07:25.8935494Z [cluster2] - role: worker
2021-07-18T14:07:25.8936615Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-18T14:07:25.8937730Z [cluster2] Creating cluster "cluster2" ...
2021-07-18T14:07:25.8938534Z [cluster2]  • Ensuring node image (kindest/node:v1.20.7) 🖼  ...
2021-07-18T14:07:25.8939331Z [cluster2]  ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-18T14:07:25.8940085Z [cluster2]  • Preparing nodes 📦 📦 📦   ...
2021-07-18T14:07:25.8949531Z [cluster2]  ✓ Preparing nodes 📦 📦 📦 
2021-07-18T14:07:25.8950395Z [cluster2]  • Writing configuration 📜  ...
2021-07-18T14:07:25.8951036Z [cluster2]  ✓ Writing configuration 📜
2021-07-18T14:07:25.8952426Z [cluster2]  • Starting control-plane 🕹️  ...
2021-07-18T14:07:25.8953202Z [cluster2]  ✓ Starting control-plane 🕹️
2021-07-18T14:07:25.8953898Z [cluster2]  • Installing StorageClass 💾  ...
2021-07-18T14:07:25.8955137Z [cluster2]  ✓ Installing StorageClass 💾
2021-07-18T14:07:25.8955746Z [cluster2]  • Joining worker nodes 🚜  ...
2021-07-18T14:07:25.8956321Z [cluster2]  ✓ Joining worker nodes 🚜
2021-07-18T14:07:25.8956949Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-18T14:07:25.8957483Z [cluster2] You can now use your cluster with:
2021-07-18T14:07:25.8957867Z [cluster2] 
2021-07-18T14:07:25.8958492Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-18T14:07:25.8959029Z [cluster2] 
2021-07-18T14:07:25.8959905Z [cluster2] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-18T14:07:25.8960968Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:25.8961818Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-18T14:07:25.8963125Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-18T14:07:25.8964284Z [submariner-operator]$ [cluster2] head -n 1
2021-07-18T14:08:03.9412289Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9414635Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9416509Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9418310Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9420218Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9421990Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-18T14:08:03.9423210Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:08:03.9424002Z [submariner-operator]$ [cluster2] wait 1593
2021-07-18T14:08:03.9424820Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-18T14:08:03.9425634Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:08:03.9426360Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-18T14:08:03.9427144Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-18T14:08:03.9427933Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:08:03.9428762Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-18T14:08:03.9429670Z [cluster2] Applying weave network...
2021-07-18T14:08:03.9431025Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:03.9432871Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:03.9434458Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:03.9435592Z [cluster2] serviceaccount/weave-net created
2021-07-18T14:08:03.9436541Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:03.9437865Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:03.9439056Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:03.9440156Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:03.9441097Z [cluster2] daemonset.apps/weave-net created
2021-07-18T14:08:03.9441786Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-18T14:08:03.9442790Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:03.9444025Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:03.9445370Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:03.9446379Z [cluster2] pod/weave-net-5vg6p condition met
2021-07-18T14:08:03.9447073Z [cluster2] pod/weave-net-kbkhw condition met
2021-07-18T14:08:03.9448384Z [cluster2] pod/weave-net-pl9ng condition met
2021-07-18T14:08:03.9449347Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-18T14:08:03.9450521Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:03.9452159Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:03.9454035Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:03.9455357Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:08:03.9456412Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:08:03.9457313Z [cluster2] deployment "coredns" successfully rolled out
2021-07-18T14:08:03.9458278Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:08:03.9480545Z [submariner-operator]$ [cluster2] wait 247
2021-07-18T14:08:05.4381251Z mariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4383702Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4385881Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4388037Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4390329Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4392919Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-18T14:08:05.4394714Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:08:05.4396526Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-18T14:08:05.4397611Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:08:05.4399547Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-18T14:08:05.4401665Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-18T14:08:05.4402674Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:08:05.4403611Z [submariner-operator]$ [cluster1] wait 1508
2021-07-18T14:08:05.4404945Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-18T14:08:05.4405737Z [cluster1] Applying weave network...
2021-07-18T14:08:05.4406902Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:05.4409007Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:05.4410827Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-18T14:08:05.4412083Z [cluster1] serviceaccount/weave-net created
2021-07-18T14:08:05.4413112Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:05.4414685Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:05.4416556Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:05.4417928Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-18T14:08:05.4419124Z [cluster1] daemonset.apps/weave-net created
2021-07-18T14:08:05.4419874Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-18T14:08:05.4420931Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:05.4422252Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:05.4423830Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-18T14:08:05.4424989Z [cluster1] pod/weave-net-lthwn condition met
2021-07-18T14:08:05.4425727Z [cluster1] pod/weave-net-w2wdz condition met
2021-07-18T14:08:05.4428190Z [cluster1] pod/weave-net-z8qlh condition met
2021-07-18T14:08:05.4429116Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-18T14:08:05.4430594Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:05.4431815Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:05.4433113Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-18T14:08:05.4434175Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:08:05.4435095Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:08:05.4435861Z [cluster1] deployment "coredns" successfully rolled out
2021-07-18T14:08:05.4436837Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:08:05.4462028Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:08:05.4490681Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-18T14:08:05.4509066Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-18T14:08:05.4510137Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:08:05.4510575Z 
2021-07-18T14:08:05.4511403Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:08:05.4511905Z 
2021-07-18T14:08:05.4512516Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:08:05.4513064Z 
2021-07-18T14:08:05.4513595Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:08:05.4514313Z EOM
2021-07-18T14:08:05.4537087Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-18T14:08:05.4537607Z 
2021-07-18T14:08:05.4538529Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-18T14:08:05.4539045Z 
2021-07-18T14:08:05.4539655Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-18T14:08:05.4540047Z 
2021-07-18T14:08:05.4540592Z To clean everthing up, just run: make clean-clusters
2021-07-18T14:08:05.4551258Z     Successfully remade target file 'clusters'.
2021-07-18T14:08:05.4555543Z      File 'preload-images' does not exist.
2021-07-18T14:08:05.4561406Z        File 'images' does not exist.
2021-07-18T14:08:05.4568498Z          File 'package/.image.submariner-operator' does not exist.
2021-07-18T14:08:05.4741163Z find: 'bin/submariner-operator': No such file or directory
2021-07-18T14:08:05.8345593Z              File 'bin/submariner-operator' does not exist.
2021-07-18T14:08:05.8346936Z                File 'vendor/modules.txt' does not exist.
2021-07-18T14:08:05.8350240Z               Must remake target 'vendor/modules.txt'.
2021-07-18T14:08:05.8353448Z go mod download
2021-07-18T14:09:26.3429440Z go mod vendor
2021-07-18T14:09:29.2836419Z go mod tidy
2021-07-18T14:09:29.9201607Z               Successfully remade target file 'vendor/modules.txt'.
2021-07-18T14:09:29.9203696Z                File 'generate-embeddedyamls' does not exist.
2021-07-18T14:09:29.9204431Z                  File 'generate' does not exist.
2021-07-18T14:09:29.9205536Z                    File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-18T14:09:29.9206758Z                   Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:09:29.9208152Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-18T14:09:29.9243888Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-18T14:09:50.6844694Z                   Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-18T14:09:50.6846273Z                 Must remake target 'generate'.
2021-07-18T14:09:50.6893821Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-18T14:10:02.1689342Z                 Successfully remade target file 'generate'.
2021-07-18T14:10:02.1690829Z                  File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-18T14:10:02.1696477Z                    File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-18T14:10:02.1701362Z                   Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:10:02.1703456Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-18T14:10:04.4993353Z                   Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-18T14:10:04.5001244Z                    File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-18T14:10:04.5002644Z                   Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:10:04.5004499Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-18T14:10:05.9698399Z                   Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-18T14:10:05.9914444Z                 Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:10:05.9918887Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-18T14:10:06.6859218Z Generating yamls.go
2021-07-18T14:10:06.6864144Z deploy/crds/submariner.io_brokers.yaml
2021-07-18T14:10:06.6871644Z deploy/crds/submariner.io_submariners.yaml
2021-07-18T14:10:06.6901396Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-18T14:10:06.6905544Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-18T14:10:06.6909066Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-18T14:10:06.6912673Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-18T14:10:06.6917964Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-18T14:10:06.6924815Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-18T14:10:06.6933386Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-18T14:10:06.6937720Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-18T14:10:06.6942836Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-18T14:10:06.6953151Z config/broker/broker-admin/service_account.yaml
2021-07-18T14:10:06.6958704Z config/broker/broker-admin/role.yaml
2021-07-18T14:10:06.6966216Z config/broker/broker-admin/role_binding.yaml
2021-07-18T14:10:06.6973107Z config/broker/broker-client/service_account.yaml
2021-07-18T14:10:06.6977949Z config/broker/broker-client/role.yaml
2021-07-18T14:10:06.6984606Z config/broker/broker-client/role_binding.yaml
2021-07-18T14:10:06.6987671Z config/rbac/submariner-operator/service_account.yaml
2021-07-18T14:10:06.6994406Z config/rbac/submariner-operator/role.yaml
2021-07-18T14:10:06.6997928Z config/rbac/submariner-operator/role_binding.yaml
2021-07-18T14:10:06.7004156Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-18T14:10:06.7010605Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-18T14:10:06.7016299Z config/rbac/submariner-gateway/service_account.yaml
2021-07-18T14:10:06.7017722Z config/rbac/submariner-gateway/role.yaml
2021-07-18T14:10:06.7025675Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-18T14:10:06.7030423Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-18T14:10:06.7035020Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-18T14:10:06.7038704Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-18T14:10:06.7045584Z config/rbac/submariner-route-agent/role.yaml
2021-07-18T14:10:06.7050343Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-18T14:10:06.7055185Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-18T14:10:06.7059543Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-18T14:10:06.7064947Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-18T14:10:06.7072822Z config/rbac/submariner-globalnet/role.yaml
2021-07-18T14:10:06.7079939Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-18T14:10:06.7088431Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-18T14:10:06.7091348Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-18T14:10:06.7093409Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-18T14:10:06.7094278Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-18T14:10:06.7098346Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-18T14:10:06.7100981Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-18T14:10:06.7105213Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-18T14:10:06.7109703Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-18T14:10:06.7115333Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-18T14:10:06.7122265Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-18T14:10:06.7123230Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-18T14:10:06.7124444Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-18T14:10:06.7130749Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-18T14:10:06.7178708Z                 Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-18T14:10:06.7179986Z               Must remake target 'generate-embeddedyamls'.
2021-07-18T14:10:06.7181073Z               Successfully remade target file 'generate-embeddedyamls'.
2021-07-18T14:10:06.7182132Z             Must remake target 'bin/submariner-operator'.
2021-07-18T14:10:06.7182867Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:10:06.7183991Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-18T14:10:06.7185154Z bin/submariner-operator main.go 
2021-07-18T14:10:06.7837403Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:10:06.7850166Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-18T14:10:06.7862425Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-18T14:10:06.7873202Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-18T14:11:41.5987883Z [submariner-operator]$ upx bin/submariner-operator
2021-07-18T14:11:48.7530188Z                        Ultimate Packer for eXecutables
2021-07-18T14:11:48.7531558Z                           Copyright (C) 1996 - 2020
2021-07-18T14:11:48.7532092Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2021-07-18T14:11:48.7532463Z 
2021-07-18T14:11:48.7533012Z         File size         Ratio      Format      Name
2021-07-18T14:11:48.7533669Z    --------------------   ------   -----------   -----------
2021-07-18T14:11:48.7535127Z   34459648 ->   9933112   28.83%   linux/amd64   submariner-operator
2021-07-18T14:11:48.7535503Z 
2021-07-18T14:11:48.7535826Z Packed 1 file.
2021-07-18T14:11:48.7546589Z             Successfully remade target file 'bin/submariner-operator'.
2021-07-18T14:11:48.7548021Z            Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:48.7549294Z           Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:48.7550399Z           Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-18T14:11:48.7551402Z            File 'FORCE_IMAGE' does not exist.
2021-07-18T14:11:48.7551958Z           Must remake target 'FORCE_IMAGE'.
2021-07-18T14:11:48.7552582Z           Successfully remade target file 'FORCE_IMAGE'.
2021-07-18T14:11:48.7553374Z         Must remake target 'package/.image.submariner-operator'.
2021-07-18T14:11:48.7554753Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator 
2021-07-18T14:11:48.7964727Z flags:WARN flag short name (h) already defined
2021-07-18T14:11:48.8506653Z [submariner-operator]$ set -e
2021-07-18T14:11:48.8516271Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:48.8526142Z [submariner-operator]$ cache_flag=
2021-07-18T14:11:48.8537578Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:48.8551814Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:49.1181947Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:50.1704823Z devel: Pulling from submariner/submariner-operator
2021-07-18T14:11:50.1716544Z 9aabc6bb514c: Pulling fs layer
2021-07-18T14:11:50.5243740Z 9aabc6bb514c: Verifying Checksum
2021-07-18T14:11:50.5245064Z 9aabc6bb514c: Download complete
2021-07-18T14:11:50.9067831Z 9aabc6bb514c: Pull complete
2021-07-18T14:11:50.9219436Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-18T14:11:50.9268261Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:50.9309155Z quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:50.9324740Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-18T14:11:50.9335375Z [submariner-operator]$ cut -f2 -d 
2021-07-18T14:11:50.9344929Z [submariner-operator]$ grep -v scratch
2021-07-18T14:11:50.9357503Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-18T14:11:50.9365296Z 
2021-07-18T14:11:51.6451869Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-18T14:11:52.3654446Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-18T14:11:52.3693066Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-18T14:11:53.1001453Z buildx_builder
2021-07-18T14:11:53.1051436Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-18T14:11:53.8178424Z #1 [internal] booting buildkit
2021-07-18T14:11:53.8179598Z #1 sha256:e228dbbbb882bc779f605c1d9c1cf4537035cdb59e05ffcbbed7b6c0a860e923
2021-07-18T14:11:53.9681383Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-18T14:11:58.7750746Z #1 pulling image moby/buildkit:buildx-stable-1 4.8s done
2021-07-18T14:11:58.7751522Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-18T14:11:59.3740158Z #1 creating container buildx_buildkit_buildx_builder0 0.6s done
2021-07-18T14:11:59.3740778Z #1 DONE 5.5s
2021-07-18T14:11:59.6472946Z 
2021-07-18T14:11:59.6474629Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-18T14:11:59.6480634Z #2 sha256:c0fbf65682054f5e25d1e3630dc55a71eadd6b15ccf3ca1c9068e5f55a33e364
2021-07-18T14:11:59.6481783Z #2 transferring dockerfile: 230B done
2021-07-18T14:11:59.6485292Z #2 DONE 0.1s
2021-07-18T14:11:59.6491371Z 
2021-07-18T14:11:59.6493215Z #3 [internal] load .dockerignore
2021-07-18T14:11:59.6493997Z #3 sha256:6a919349066d5e5a4c71e506671237fec1821c815b87f42d6a0edbebeb82e236
2021-07-18T14:11:59.6498760Z #3 transferring context: 2B done
2021-07-18T14:11:59.6499361Z #3 DONE 0.1s
2021-07-18T14:11:59.8011508Z 
2021-07-18T14:11:59.8012194Z #4 [internal] load build context
2021-07-18T14:11:59.8013040Z #4 sha256:2cd3fce16013a8743e72fe482b5962f0282384735b8b1195876a56570becd384
2021-07-18T14:11:59.8013826Z #4 DONE 0.0s
2021-07-18T14:11:59.8014045Z 
2021-07-18T14:11:59.8019608Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-18T14:11:59.8020708Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-18T14:12:00.3844843Z #6 DONE 0.7s
2021-07-18T14:12:00.3845103Z 
2021-07-18T14:12:00.3845617Z #4 [internal] load build context
2021-07-18T14:12:00.3846484Z #4 sha256:2cd3fce16013a8743e72fe482b5962f0282384735b8b1195876a56570becd384
2021-07-18T14:12:00.7289402Z #4 transferring context: 9.94MB 0.3s done
2021-07-18T14:12:00.7291175Z #4 DONE 0.3s
2021-07-18T14:12:00.7291437Z 
2021-07-18T14:12:00.7294899Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:12:00.7295872Z #5 sha256:23fc8ff57ce70329102afd4a411d779d44296992695ed353bbc4c962aced393a
2021-07-18T14:12:00.7296602Z #5 CACHED
2021-07-18T14:12:00.8793470Z 
2021-07-18T14:12:00.8794370Z #7 exporting to oci image format
2021-07-18T14:12:00.8795497Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:12:00.8796282Z #7 exporting layers done
2021-07-18T14:12:00.8797203Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f 0.0s done
2021-07-18T14:12:00.8798725Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 0.0s done
2021-07-18T14:12:01.0294690Z #7 ...
2021-07-18T14:12:01.0295036Z 
2021-07-18T14:12:01.0296631Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:12:01.0297600Z #5 sha256:23fc8ff57ce70329102afd4a411d779d44296992695ed353bbc4c962aced393a
2021-07-18T14:12:01.0299805Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 0B / 9.62MB 0.2s
2021-07-18T14:12:01.0302096Z #5 CACHED
2021-07-18T14:12:01.1344390Z 
2021-07-18T14:12:01.1346361Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-18T14:12:01.1349545Z #5 sha256:23fc8ff57ce70329102afd4a411d779d44296992695ed353bbc4c962aced393a
2021-07-18T14:12:01.1351574Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.3s done
2021-07-18T14:12:01.1352983Z #5 CACHED
2021-07-18T14:12:01.1353629Z 
2021-07-18T14:12:01.1354816Z #7 exporting to oci image format
2021-07-18T14:12:01.1355826Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-18T14:12:01.2855332Z #7 sending tarball
2021-07-18T14:12:01.4080172Z #7 sending tarball 0.3s done
2021-07-18T14:12:01.4080718Z #7 DONE 0.7s
2021-07-18T14:12:01.4081046Z 
2021-07-18T14:12:01.4081416Z #9 exporting cache
2021-07-18T14:12:01.4082346Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-18T14:12:01.4083437Z #9 preparing build cache for export done
2021-07-18T14:12:01.4083921Z #9 DONE 0.0s
2021-07-18T14:12:01.4084124Z 
2021-07-18T14:12:01.4084430Z #8 importing to docker
2021-07-18T14:12:01.4085579Z #8 sha256:8896be02240d1effa5ef7f00b5623d9f87abd1d000d3b8bc790e4107e98ab9cf
2021-07-18T14:12:01.4086490Z #8 DONE 0.0s
2021-07-18T14:12:01.4156691Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-18T14:12:01.6843216Z         Successfully remade target file 'package/.image.submariner-operator'.
2021-07-18T14:12:01.6844066Z          File 'build' does not exist.
2021-07-18T14:12:01.6844631Z            File 'bin/subctl' does not exist.
2021-07-18T14:12:01.6850520Z              File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-18T14:12:01.7443094Z             Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:12:01.7443869Z mkdir -p bin
2021-07-18T14:12:01.7471961Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-18T14:12:01.7472736Z target=${target%.exe}; \
2021-07-18T14:12:01.7473282Z components=($(echo ${target//-/ })); \
2021-07-18T14:12:01.7473813Z GOOS=${components[-2]}; \
2021-07-18T14:12:01.7474303Z GOARCH=${components[-1]}; \
2021-07-18T14:12:01.7474727Z export GOARCH GOOS; \
2021-07-18T14:12:01.7475161Z /opt/shipyard/scripts/compile.sh \
2021-07-18T14:12:01.7476102Z 	--ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-18T14:12:01.7477670Z 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-18T14:12:01.7479095Z 	--noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go 
2021-07-18T14:12:01.8064222Z [submariner-operator]$ mkdir -p bin
2021-07-18T14:12:01.8079804Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-18T14:12:01.8094643Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-18T14:12:01.8109200Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-18T14:12:37.4255862Z             Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-18T14:12:37.4256772Z           Must remake target 'bin/subctl'.
2021-07-18T14:12:37.4257863Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-18T14:12:37.4290829Z           Successfully remade target file 'bin/subctl'.
2021-07-18T14:12:37.4291574Z         Must remake target 'build'.
2021-07-18T14:12:37.4292207Z         Successfully remade target file 'build'.
2021-07-18T14:12:37.4293114Z       Must remake target 'images'.
2021-07-18T14:12:37.4294432Z       Successfully remade target file 'images'.
2021-07-18T14:12:37.4295281Z     Must remake target 'preload-images'.
2021-07-18T14:12:37.4295868Z set -e;\
2021-07-18T14:12:37.4296274Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-18T14:12:37.4296797Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-18T14:12:37.4298158Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns submariner-globalnet; do\
2021-07-18T14:12:37.4299276Z 	import_image quay.io/submariner/${image};\
2021-07-18T14:12:37.4299696Z done
2021-07-18T14:12:37.4348134Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:12:37.4361357Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-18T14:12:37.4372601Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-18T14:12:37.6892184Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-18T14:12:37.9317803Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-18T14:12:37.9666644Z f9269f9cee12: Preparing
2021-07-18T14:12:38.5567291Z f9269f9cee12: Pushed
2021-07-18T14:12:38.5799592Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-18T14:12:38.5838824Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:12:38.5842550Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-18T14:12:38.5856915Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:12:38.8336495Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-18T14:12:38.8356273Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:39.8057354Z devel: Pulling from submariner/submariner-gateway
2021-07-18T14:12:39.8061928Z 8c741e919b67: Pulling fs layer
2021-07-18T14:12:39.8066363Z 13495efbbac4: Pulling fs layer
2021-07-18T14:12:39.8066772Z 6df6df193f2d: Pulling fs layer
2021-07-18T14:12:39.8067194Z 3afbe9ee7387: Pulling fs layer
2021-07-18T14:12:39.8067580Z 3afbe9ee7387: Waiting
2021-07-18T14:12:40.0057661Z 13495efbbac4: Verifying Checksum
2021-07-18T14:12:40.0058187Z 13495efbbac4: Download complete
2021-07-18T14:12:40.2527269Z 6df6df193f2d: Verifying Checksum
2021-07-18T14:12:40.2528281Z 6df6df193f2d: Download complete
2021-07-18T14:12:40.4214374Z 3afbe9ee7387: Verifying Checksum
2021-07-18T14:12:40.4215055Z 3afbe9ee7387: Download complete
2021-07-18T14:12:40.5790214Z 8c741e919b67: Verifying Checksum
2021-07-18T14:12:40.5790920Z 8c741e919b67: Download complete
2021-07-18T14:12:43.2924240Z 8c741e919b67: Pull complete
2021-07-18T14:12:44.5022271Z 13495efbbac4: Pull complete
2021-07-18T14:12:45.7249219Z 6df6df193f2d: Pull complete
2021-07-18T14:12:45.9575404Z 3afbe9ee7387: Pull complete
2021-07-18T14:12:45.9657917Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-18T14:12:45.9750215Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:45.9787726Z quay.io/submariner/submariner-gateway:devel
2021-07-18T14:12:45.9852146Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-18T14:12:46.2280368Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-18T14:12:46.4849867Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-18T14:12:46.7470091Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-18T14:12:46.7516905Z 71972a942ed4: Preparing
2021-07-18T14:12:46.7517526Z 3c7f2d60eacb: Preparing
2021-07-18T14:12:46.7517920Z 00c5f6897675: Preparing
2021-07-18T14:12:46.7518313Z b3b62c837788: Preparing
2021-07-18T14:12:47.5947641Z 00c5f6897675: Pushed
2021-07-18T14:12:48.5807881Z 71972a942ed4: Pushed
2021-07-18T14:12:50.9494453Z 3c7f2d60eacb: Pushed
2021-07-18T14:12:58.1302110Z b3b62c837788: Pushed
2021-07-18T14:12:58.1606310Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-18T14:12:58.1720661Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:12:58.1734889Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-18T14:12:58.1737211Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:12:58.4141866Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:12:58.4161933Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:12:59.4019746Z devel: Pulling from submariner/submariner-route-agent
2021-07-18T14:12:59.4020737Z 8c741e919b67: Already exists
2021-07-18T14:12:59.4081405Z 13495efbbac4: Already exists
2021-07-18T14:12:59.4126136Z 70cc6422093d: Pulling fs layer
2021-07-18T14:12:59.4128882Z 7ba74d821748: Pulling fs layer
2021-07-18T14:12:59.4129723Z 62b0802bcf90: Pulling fs layer
2021-07-18T14:12:59.4130204Z 3e9c83283ee4: Pulling fs layer
2021-07-18T14:12:59.4130652Z 3e9c83283ee4: Waiting
2021-07-18T14:12:59.6361533Z 62b0802bcf90: Verifying Checksum
2021-07-18T14:12:59.6362431Z 62b0802bcf90: Download complete
2021-07-18T14:12:59.7477714Z 7ba74d821748: Verifying Checksum
2021-07-18T14:12:59.7479560Z 7ba74d821748: Download complete
2021-07-18T14:12:59.8399259Z 70cc6422093d: Verifying Checksum
2021-07-18T14:12:59.8399724Z 70cc6422093d: Download complete
2021-07-18T14:12:59.8733597Z 3e9c83283ee4: Verifying Checksum
2021-07-18T14:12:59.8735262Z 3e9c83283ee4: Download complete
2021-07-18T14:13:01.4476056Z 70cc6422093d: Pull complete
2021-07-18T14:13:01.6861386Z 7ba74d821748: Pull complete
2021-07-18T14:13:01.7820155Z 62b0802bcf90: Pull complete
2021-07-18T14:13:01.8919625Z 3e9c83283ee4: Pull complete
2021-07-18T14:13:01.9069621Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-18T14:13:01.9085978Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:13:01.9210179Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-18T14:13:01.9211614Z quay.io/submariner/submariner-route-agent:devel
2021-07-18T14:13:02.1789742Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-18T14:13:02.4341006Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-18T14:13:02.6673016Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-18T14:13:02.6803413Z 1d810a4c0610: Preparing
2021-07-18T14:13:02.6814846Z 7a86b74623fc: Preparing
2021-07-18T14:13:02.6818222Z 26de773c4486: Preparing
2021-07-18T14:13:02.6820902Z 6931e591f8e2: Preparing
2021-07-18T14:13:02.6823721Z 00c5f6897675: Preparing
2021-07-18T14:13:02.6826767Z b3b62c837788: Preparing
2021-07-18T14:13:02.6830154Z b3b62c837788: Waiting
2021-07-18T14:13:03.3080175Z 00c5f6897675: Mounted from submariner-gateway
2021-07-18T14:13:03.3216348Z 7a86b74623fc: Pushed
2021-07-18T14:13:03.3415313Z 26de773c4486: Pushed
2021-07-18T14:13:03.3415690Z 1d810a4c0610: Pushed
2021-07-18T14:13:03.3501141Z b3b62c837788: Mounted from submariner-gateway
2021-07-18T14:13:07.0363255Z 6931e591f8e2: Pushed
2021-07-18T14:13:07.0671214Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-18T14:13:07.0730606Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:13:07.0743867Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-18T14:13:07.0760426Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:13:07.3265569Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:13:07.3288494Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:13:08.2915698Z devel: Pulling from submariner/lighthouse-agent
2021-07-18T14:13:08.2917296Z ecd69139dc76: Pulling fs layer
2021-07-18T14:13:08.2918243Z 8261c1767de3: Pulling fs layer
2021-07-18T14:13:08.4993856Z ecd69139dc76: Verifying Checksum
2021-07-18T14:13:08.4995086Z ecd69139dc76: Download complete
2021-07-18T14:13:08.5922335Z ecd69139dc76: Pull complete
2021-07-18T14:13:08.6093502Z 8261c1767de3: Verifying Checksum
2021-07-18T14:13:08.6096081Z 8261c1767de3: Download complete
2021-07-18T14:13:08.8442067Z 8261c1767de3: Pull complete
2021-07-18T14:13:08.8580309Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-18T14:13:08.8604874Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:13:08.8609612Z quay.io/submariner/lighthouse-agent:devel
2021-07-18T14:13:08.8635477Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-18T14:13:09.1269289Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-18T14:13:09.3685322Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-18T14:13:09.6273687Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-18T14:13:09.6310053Z 83c79e393e11: Preparing
2021-07-18T14:13:09.6310449Z 0026d2f62bbf: Preparing
2021-07-18T14:13:09.6711594Z 0026d2f62bbf: Pushed
2021-07-18T14:13:10.1270096Z 83c79e393e11: Pushed
2021-07-18T14:13:10.1537200Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-18T14:13:10.1578660Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:13:10.1596451Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-18T14:13:10.1605370Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:13:10.4130419Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:13:10.4155187Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:13:11.3957800Z devel: Pulling from submariner/lighthouse-coredns
2021-07-18T14:13:11.3958971Z 088e56360f76: Pulling fs layer
2021-07-18T14:13:11.3959529Z 18aed70882d2: Pulling fs layer
2021-07-18T14:13:11.6283803Z 088e56360f76: Verifying Checksum
2021-07-18T14:13:11.6284311Z 088e56360f76: Download complete
2021-07-18T14:13:11.7277969Z 088e56360f76: Pull complete
2021-07-18T14:13:11.8438777Z 18aed70882d2: Verifying Checksum
2021-07-18T14:13:11.8439732Z 18aed70882d2: Download complete
2021-07-18T14:13:12.1876930Z 18aed70882d2: Pull complete
2021-07-18T14:13:12.1995227Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-18T14:13:12.2024478Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:13:12.2035069Z quay.io/submariner/lighthouse-coredns:devel
2021-07-18T14:13:12.2061778Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-18T14:13:12.4506574Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-18T14:13:12.6895178Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-18T14:13:12.9410532Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-18T14:13:12.9467824Z 7fca351e51be: Preparing
2021-07-18T14:13:12.9468332Z 4fa0ece06e25: Preparing
2021-07-18T14:13:12.9916911Z 4fa0ece06e25: Pushed
2021-07-18T14:13:13.6405541Z 7fca351e51be: Pushed
2021-07-18T14:13:13.6588864Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-18T14:13:13.6625448Z [submariner-operator]$ import_image quay.io/submariner/submariner-globalnet
2021-07-18T14:13:13.6634449Z [submariner-operator]$ import_image quay.io/submariner/submariner-globalnet
2021-07-18T14:13:13.6648721Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local
2021-07-18T14:13:13.9036749Z Error response from daemon: No such image: quay.io/submariner/submariner-globalnet:dev
2021-07-18T14:13:13.9061760Z [submariner-operator]$ docker pull quay.io/submariner/submariner-globalnet:devel
2021-07-18T14:13:14.9025460Z devel: Pulling from submariner/submariner-globalnet
2021-07-18T14:13:14.9026657Z 8c741e919b67: Already exists
2021-07-18T14:13:14.9034142Z 13495efbbac4: Already exists
2021-07-18T14:13:14.9058419Z bb77c1f3f2df: Pulling fs layer
2021-07-18T14:13:14.9059139Z 8d0ffdb5918e: Pulling fs layer
2021-07-18T14:13:14.9059752Z bcf8fc53d486: Pulling fs layer
2021-07-18T14:13:14.9060248Z 218c178ba1a9: Pulling fs layer
2021-07-18T14:13:14.9064840Z 218c178ba1a9: Waiting
2021-07-18T14:13:15.1197817Z bcf8fc53d486: Verifying Checksum
2021-07-18T14:13:15.1198692Z bcf8fc53d486: Download complete
2021-07-18T14:13:15.2488824Z 8d0ffdb5918e: Verifying Checksum
2021-07-18T14:13:15.2489399Z 8d0ffdb5918e: Download complete
2021-07-18T14:13:15.2673994Z bb77c1f3f2df: Verifying Checksum
2021-07-18T14:13:15.2674475Z bb77c1f3f2df: Download complete
2021-07-18T14:13:15.3462360Z 218c178ba1a9: Verifying Checksum
2021-07-18T14:13:15.3462838Z 218c178ba1a9: Download complete
2021-07-18T14:13:16.2010231Z bb77c1f3f2df: Pull complete
2021-07-18T14:13:16.4949336Z 8d0ffdb5918e: Pull complete
2021-07-18T14:13:16.5930909Z bcf8fc53d486: Pull complete
2021-07-18T14:13:16.6986479Z 218c178ba1a9: Pull complete
2021-07-18T14:13:16.7167396Z Digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69
2021-07-18T14:13:16.7189212Z Status: Downloaded newer image for quay.io/submariner/submariner-globalnet:devel
2021-07-18T14:13:16.7200040Z quay.io/submariner/submariner-globalnet:devel
2021-07-18T14:13:16.7228313Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:devel quay.io/submariner/submariner-globalnet:dev
2021-07-18T14:13:16.9782491Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local
2021-07-18T14:13:17.2378437Z [submariner-operator]$ docker push localhost:5000/submariner-globalnet:local
2021-07-18T14:13:17.4905491Z The push refers to repository [localhost:5000/submariner-globalnet]
2021-07-18T14:13:17.4985659Z a395ed568a2f: Preparing
2021-07-18T14:13:17.4986244Z 39ac285976a0: Preparing
2021-07-18T14:13:17.4986876Z de48a84fa0cb: Preparing
2021-07-18T14:13:17.4987260Z 70c3bf07b5e8: Preparing
2021-07-18T14:13:17.4987608Z 00c5f6897675: Preparing
2021-07-18T14:13:17.4987965Z b3b62c837788: Preparing
2021-07-18T14:13:17.4988296Z b3b62c837788: Waiting
2021-07-18T14:13:17.5501426Z 00c5f6897675: Mounted from submariner-route-agent
2021-07-18T14:13:17.9854034Z 39ac285976a0: Pushed
2021-07-18T14:13:17.9854513Z a395ed568a2f: Pushed
2021-07-18T14:13:18.1973148Z b3b62c837788: Mounted from submariner-route-agent
2021-07-18T14:13:18.2194371Z de48a84fa0cb: Pushed
2021-07-18T14:13:18.9987907Z 70c3bf07b5e8: Pushed
2021-07-18T14:13:19.0327530Z local: digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69 size: 1574
2021-07-18T14:13:19.0425692Z     Successfully remade target file 'preload-images'.
2021-07-18T14:13:19.0429990Z    Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-18T14:13:19.0430852Z    Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-18T14:13:19.0431832Z    Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-18T14:13:19.0432629Z   Must remake target 'deploy'.
2021-07-18T14:13:19.0434022Z /opt/shipyard/scripts/deploy.sh --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:13:19.1481799Z Running with: globalnet='true', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-18T14:13:19.1521292Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:13:19.1537007Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:19.1551634Z [submariner-operator]$ script_name=utils
2021-07-18T14:13:19.1562658Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:13:19.1586898Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:13:19.1600362Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:19.1613361Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:13:19.1624682Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:13:19.1643817Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:13:19.1665346Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:19.1678871Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:13:19.1688755Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:13:19.1713315Z [submariner-operator]$ broker=cluster1
2021-07-18T14:13:19.1729695Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:13:19.1743949Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:13:19.1759683Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:13:19.1774247Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:13:19.1786901Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:13:19.1800514Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:13:19.1815098Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:13:19.1864965Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:13:19.1876131Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:13:19.1899472Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:13:19.1909595Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:13:19.1920272Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:13:19.1933577Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:19.1947659Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:13:19.1962221Z [submariner-operator]$ exec_name=deploy.sh
2021-07-18T14:13:19.1986948Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:13:19.1999278Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:13:19.2030153Z [submariner-operator]$ declare_cidrs
2021-07-18T14:13:19.2041701Z [submariner-operator]$ declare_cidrs
2021-07-18T14:13:19.2053338Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:13:19.2067584Z [submariner-operator]$ i=1
2021-07-18T14:13:19.2085311Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:13:19.2100176Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:13:19.2116932Z [submariner-operator]$ [cluster1] val=0
2021-07-18T14:13:19.2134515Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-18T14:13:19.2147267Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-18T14:13:19.2161897Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-18T14:13:19.2176966Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:13:19.2190082Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:13:19.2201965Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:13:19.2216164Z [submariner-operator]$ [cluster2] val=0
2021-07-18T14:13:19.2228176Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-18T14:13:19.2240301Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-18T14:13:19.2254552Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-18T14:13:19.2269335Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:13:19.2282048Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:13:19.2295050Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-18T14:13:19.2306523Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:13:19.2322920Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-18T14:13:19.2337357Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:13:19.2379774Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:13:19.2414016Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-18T14:13:19.4159043Z Installing subctl version devel
2021-07-18T14:13:19.4163580Z   OS detected:           linux
2021-07-18T14:13:19.4165327Z   Architecture detected: amd64
2021-07-18T14:13:19.4171058Z   Download URL:          https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-18T14:13:19.4178270Z 
2021-07-18T14:13:19.4178700Z Downloading...
2021-07-18T14:13:20.6851818Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-18T14:13:20.7073339Z This provides subctl version: devel
2021-07-18T14:13:20.7095398Z 
2021-07-18T14:13:20.7095966Z please update your path (and consider adding it to ~/.profile):
2021-07-18T14:13:20.7096476Z     export PATH=$PATH:/go/bin
2021-07-18T14:13:20.7096786Z     
2021-07-18T14:13:20.7193878Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:13:20.7205704Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-18T14:13:20.7213877Z Will deploy submariner using operator
2021-07-18T14:13:20.7223379Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:13:20.7241154Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:13:20.7256860Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-18T14:13:20.7271150Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-18T14:13:20.7296316Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:13:20.7320170Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-18T14:13:20.7334987Z 
2021-07-18T14:13:20.7348612Z [submariner-operator]$ [cluster2] subctl version
2021-07-18T14:13:20.7560482Z subctl version: devel-0105e4d
2021-07-18T14:13:20.7586088Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:13:20.7604155Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-18T14:13:20.7631914Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-18T14:13:20.7649198Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:13:20.7682018Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:13:20.7696057Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:13:20.7712281Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-18T14:13:20.7723679Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:13:20.7759209Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-18T14:13:20.7770447Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-18T14:13:20.7784354Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:13:20.7804172Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:13:20.7826269Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:13:20.7827385Z [submariner-operator]$ [cluster1] pids[cluster1]=7225
2021-07-18T14:13:20.7839818Z [submariner-operator]$ [cluster2] pids[cluster2]=7228
2021-07-18T14:13:20.7850119Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:13:20.7855660Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:13:20.7856477Z [submariner-operator]$ [cluster2] wait 7228
2021-07-18T14:13:20.7868065Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:13:20.7882303Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:13:20.7888848Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:13:21.1454414Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-18T14:13:21.1455359Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:13:21.1456192Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-18T14:13:21.1457849Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.1461285Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.1463421Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.1464474Z [cluster2] node/cluster2-worker labeled
2021-07-18T14:13:21.1471547Z [submariner-operator]$ [cluster2] wait 7225
2021-07-18T14:13:21.2049884Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-18T14:13:21.2050968Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:13:21.2051936Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-18T14:13:21.2053317Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.2055064Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.2056616Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-18T14:13:21.2057749Z [cluster1] node/cluster1-worker labeled
2021-07-18T14:13:21.2074555Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:13:21.2088442Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-18T14:13:21.2103855Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:13:21.2115897Z [submariner-operator]$ [cluster1] setup_broker
2021-07-18T14:13:21.2133552Z [submariner-operator]$ [cluster1] gn=--globalnet
2021-07-18T14:13:21.2138988Z Installing broker...
2021-07-18T14:13:21.2149807Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:13:21.2162976Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:13:21.2180284Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-18T14:13:21.2190310Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --globalnet
2021-07-18T14:13:21.2451611Z  • Setting up broker RBAC  ...
2021-07-18T14:13:21.3712626Z  ✓ Setting up broker RBAC
2021-07-18T14:13:21.3713267Z  • Deploying the Submariner operator  ...
2021-07-18T14:13:32.6701056Z  ✓ Deploying the Submariner operator
2021-07-18T14:13:32.6701843Z  ✓ Created operator CRDs
2021-07-18T14:13:32.6702563Z  ✓ Created operator namespace: submariner-operator
2021-07-18T14:13:32.6703310Z  ✓ Created operator service account and role
2021-07-18T14:13:32.6704003Z  ✓ Created lighthouse service account and role
2021-07-18T14:13:32.6704953Z  ✓ Created Lighthouse service accounts and roles
2021-07-18T14:13:32.6705613Z  ✓ Deployed the operator successfully
2021-07-18T14:13:32.6706181Z  • Deploying the broker  ...
2021-07-18T14:13:32.7256570Z  ✓ Deploying the broker
2021-07-18T14:13:32.7257219Z  ✓ The broker has been deployed
2021-07-18T14:13:32.7257840Z  • Creating broker-info.subm file  ...
2021-07-18T14:13:32.7364332Z  ✓ Creating broker-info.subm file
2021-07-18T14:13:32.7365442Z  ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-18T14:13:32.7416238Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:13:32.7430488Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-18T14:13:32.7448839Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:13:32.7461021Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-18T14:13:32.7470918Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:13:32.7505807Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-18T14:13:32.7518983Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-18T14:13:32.7531979Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:13:32.7549509Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:13:32.7565711Z [submariner-operator]$ [cluster1] pids[cluster1]=7290
2021-07-18T14:13:32.7576462Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:13:32.7588247Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:13:32.7600732Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:13:32.7608331Z [submariner-operator]$ [cluster2] pids[cluster2]=7294
2021-07-18T14:13:32.7630067Z [submariner-operator]$ [cluster2] wait 7294
2021-07-18T14:13:32.7650287Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:13:32.7666767Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:13:32.7685715Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:13:39.7483327Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-18T14:13:39.7485531Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-18T14:13:39.7486925Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:13:39.7488196Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-18T14:13:39.7490447Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.1.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:13:39.7492796Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-18T14:13:39.7493666Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-18T14:13:39.7494265Z [cluster1]   - cluster1-worker
2021-07-18T14:13:39.7494893Z [cluster1]  • Discovering network details  ...
2021-07-18T14:13:39.7495722Z [cluster1]         Network plugin:  weave-net
2021-07-18T14:13:39.7496194Z [cluster1]         Service CIDRs:   [100.0.0.0/16]
2021-07-18T14:13:39.7496602Z [cluster1]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-18T14:13:39.7497398Z [cluster1]  ✓ Discovering network details
2021-07-18T14:13:39.7499032Z [cluster1]  • Discovering multi cluster details  ...
2021-07-18T14:13:39.7500079Z [cluster1]  • Validating Globalnet configurations  ...
2021-07-18T14:13:39.7500994Z [cluster1]  ✓ Validating Globalnet configurations
2021-07-18T14:13:39.7502077Z [cluster1]  • Assigning Globalnet IPs  ...
2021-07-18T14:13:39.7502971Z [cluster1]  ✓ Assigning Globalnet IPs
2021-07-18T14:13:39.7503804Z [cluster1]  ✓ GlobalCIDR is: 242.254.1.0/24
2021-07-18T14:13:39.7504707Z [cluster1]  • Validating Globalnet configurations  ...
2021-07-18T14:13:39.7505640Z [cluster1]  ✓ Validating Globalnet configurations
2021-07-18T14:13:39.7506318Z [cluster1]  • Assigning Globalnet IPs  ...
2021-07-18T14:13:39.7507328Z [cluster1]  ✓ Assigning Globalnet IPs
2021-07-18T14:13:39.7507967Z [cluster1]  ✓ GlobalCIDR is: 242.254.1.0/24
2021-07-18T14:13:39.7508726Z [cluster1]  ✓ Discovering multi cluster details
2021-07-18T14:13:39.7509400Z [cluster1]  • Deploying the Submariner operator  ...
2021-07-18T14:13:39.7510073Z [cluster1]  ✓ Deploying the Submariner operator
2021-07-18T14:13:39.7510764Z [cluster1]  ✓ Created Lighthouse service accounts and roles
2021-07-18T14:13:39.7511410Z [cluster1]  • Creating SA for cluster  ...
2021-07-18T14:13:39.7512002Z [cluster1]  ✓ Creating SA for cluster
2021-07-18T14:13:39.7512761Z [cluster1]  • Deploying Submariner  ...
2021-07-18T14:13:39.7513341Z [cluster1]  ✓ Deploying Submariner
2021-07-18T14:13:39.7513941Z [cluster1]  ✓ Submariner is up and running
2021-07-18T14:13:47.2404406Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-18T14:13:47.2405406Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-18T14:13:47.2406442Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-18T14:13:47.2407489Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-18T14:13:47.2409891Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.2.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-18T14:13:47.2412762Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-18T14:13:47.2413656Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-18T14:13:47.2414437Z [cluster2]   - cluster2-worker
2021-07-18T14:13:47.2415067Z [cluster2]  • Discovering network details  ...
2021-07-18T14:13:47.2415879Z [cluster2]         Network plugin:  weave-net
2021-07-18T14:13:47.2416403Z [cluster2]         Service CIDRs:   [100.0.0.0/16]
2021-07-18T14:13:47.2416845Z [cluster2]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-18T14:13:47.2417449Z [cluster2]  ✓ Discovering network details
2021-07-18T14:13:47.2418114Z [cluster2]  • Discovering multi cluster details  ...
2021-07-18T14:13:47.2418982Z [cluster2]  • Validating Globalnet configurations  ...
2021-07-18T14:13:47.2419681Z [cluster2]  ✓ Validating Globalnet configurations
2021-07-18T14:13:47.2420581Z [cluster2]  • Assigning Globalnet IPs  ...
2021-07-18T14:13:47.2421381Z [cluster2]  ✓ Assigning Globalnet IPs
2021-07-18T14:13:47.2421947Z [cluster2]  ✓ GlobalCIDR is: 242.254.2.0/24
2021-07-18T14:13:47.2423476Z [cluster2]  ✓ Discovering multi cluster details
2021-07-18T14:13:47.2424358Z [cluster2]  • Deploying the Submariner operator  ...
2021-07-18T14:13:47.2425204Z [cluster2]  ✓ Deploying the Submariner operator
2021-07-18T14:13:47.2426462Z [cluster2]  ✓ Created operator CRDs
2021-07-18T14:13:47.2427371Z [cluster2]  ✓ Created operator namespace: submariner-operator
2021-07-18T14:13:47.2428202Z [cluster2]  ✓ Created operator service account and role
2021-07-18T14:13:47.2428896Z [cluster2]  ✓ Created lighthouse service account and role
2021-07-18T14:13:47.2429746Z [cluster2]  ✓ Created Lighthouse service accounts and roles
2021-07-18T14:13:47.2430620Z [cluster2]  ✓ Deployed the operator successfully
2021-07-18T14:13:47.2431263Z [cluster2]  • Creating SA for cluster  ...
2021-07-18T14:13:47.2431845Z [cluster2]  ✓ Creating SA for cluster
2021-07-18T14:13:47.2432617Z [cluster2]  • Deploying Submariner  ...
2021-07-18T14:13:47.2433228Z [cluster2]  ✓ Deploying Submariner
2021-07-18T14:13:47.2433986Z [cluster2]  ✓ Submariner is up and running
2021-07-18T14:13:47.2434701Z [submariner-operator]$ [cluster2] wait 7290
2021-07-18T14:13:47.2448681Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:13:47.2460127Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-18T14:13:47.2537659Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-18T14:13:47.2557703Z [submariner-operator]$ [cluster2] with_retries
2021-07-18T14:13:47.2575777Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:13:47.2659262Z [submariner-operator]$ [cluster2] wait 7334
2021-07-18T14:13:47.2721547Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:47.2779767Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:47.2791697Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:47.2804465Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:47.2821538Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:48.3597020Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:48.3614608Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:48.5302377Z  • Showing Connections  ...
2021-07-18T14:13:48.5504979Z  ✗ Showing Connections
2021-07-18T14:13:48.5505588Z  ✗ There are no gateways detected
2021-07-18T14:13:48.5667550Z  • Showing Connections  ...
2021-07-18T14:13:48.5723137Z  ✗ Showing Connections
2021-07-18T14:13:48.5724042Z  ✗ There are no gateways detected
2021-07-18T14:13:48.5748375Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:48.5763216Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:13:54.5798777Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:13:54.5833961Z [submariner-operator]$ [cluster2] wait 7362
2021-07-18T14:13:54.5852814Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:54.5862369Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:13:54.5872372Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:13:54.5912057Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:54.5930450Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:13:54.6971738Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:13:54.6986616Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:13:54.7918853Z  • Showing Connections  ...
2021-07-18T14:13:54.7959838Z  ✗ Showing Connections
2021-07-18T14:13:54.7962399Z  ✗ There are no gateways detected
2021-07-18T14:13:54.8040430Z  • Showing Connections  ...
2021-07-18T14:13:54.8058808Z  ✗ Showing Connections
2021-07-18T14:13:54.8059389Z  ✗ There are no gateways detected
2021-07-18T14:13:54.8089597Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:13:54.8103861Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:00.8130910Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:00.8180658Z [submariner-operator]$ [cluster2] wait 7389
2021-07-18T14:14:00.8194332Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:00.8218349Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:00.8231870Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:00.8317824Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:00.8331444Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:01.1298056Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:01.1316083Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:01.3569544Z  • Showing Connections  ...
2021-07-18T14:14:01.3660128Z  ✗ Showing Connections
2021-07-18T14:14:01.3660773Z  ✗ There are no gateways detected
2021-07-18T14:14:01.4084545Z  • Showing Connections  ...
2021-07-18T14:14:01.4300834Z  ✗ Showing Connections
2021-07-18T14:14:01.4301680Z  ✗ There are no gateways detected
2021-07-18T14:14:01.4324469Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:14:01.4343919Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:07.4391853Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:07.4442573Z [submariner-operator]$ [cluster2] wait 7415
2021-07-18T14:14:07.4466813Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:07.4516246Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:07.4545501Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:07.4586133Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:07.4671684Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:07.9953657Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:07.9963094Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:08.4110952Z  • Showing Connections  ...
2021-07-18T14:14:08.4667524Z  ✗ Showing Connections
2021-07-18T14:14:08.4670970Z  ✗ There are no gateways detected
2021-07-18T14:14:08.4840770Z  • Showing Connections  ...
2021-07-18T14:14:08.4954862Z  ✗ Showing Connections
2021-07-18T14:14:08.4956149Z  ✗ No connections found
2021-07-18T14:14:08.4988916Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:14:08.5020363Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:14.5052304Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:14.5105911Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:14.5106800Z [submariner-operator]$ [cluster2] wait 7442
2021-07-18T14:14:14.5153567Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:14.5163564Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:14.5180261Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:14.5217161Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:14.6797082Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:14.6814142Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:14.7933198Z  • Showing Connections  ...
2021-07-18T14:14:14.8018824Z  ✗ Showing Connections
2021-07-18T14:14:14.8019386Z  ✗ No connections found
2021-07-18T14:14:14.8260383Z  • Showing Connections  ...
2021-07-18T14:14:14.8291311Z  ✗ Showing Connections
2021-07-18T14:14:14.8291920Z  ✗ There are no gateways detected
2021-07-18T14:14:14.8314427Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:14:14.8372477Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:20.8405775Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:20.8458935Z [submariner-operator]$ [cluster2] wait 7468
2021-07-18T14:14:20.8495697Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:20.8528293Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:20.8540969Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:20.8586670Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:20.8618096Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:21.1041745Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:21.1062450Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:21.4067077Z  • Showing Connections  ...
2021-07-18T14:14:21.4149478Z  ✗ Showing Connections
2021-07-18T14:14:21.4150118Z  ✗ No connections found
2021-07-18T14:14:21.4462585Z  • Showing Connections  ...
2021-07-18T14:14:21.4486632Z  ✗ Showing Connections
2021-07-18T14:14:21.4487288Z  ✗ There are no gateways detected
2021-07-18T14:14:21.4621340Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:14:21.4637455Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:27.4698190Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:27.4745022Z [submariner-operator]$ [cluster2] wait 7495
2021-07-18T14:14:27.4761910Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:27.4805636Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:27.4830120Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:27.4912185Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:27.4940734Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:27.8814527Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:27.8828968Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:27.9854019Z  • Showing Connections  ...
2021-07-18T14:14:27.9911998Z  ✗ Showing Connections
2021-07-18T14:14:27.9960553Z  ✗ No connections found
2021-07-18T14:14:28.0357365Z  • Showing Connections  ...
2021-07-18T14:14:28.0672804Z  ✗ Showing Connections
2021-07-18T14:14:28.0673499Z  ✗ No connections found
2021-07-18T14:14:28.0701469Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-18T14:14:28.0716766Z [submariner-operator]$ [cluster2] sleep 6
2021-07-18T14:14:34.0764739Z [submariner-operator]$ [cluster2] return 1
2021-07-18T14:14:34.0825376Z [submariner-operator]$ [cluster2] wait 7522
2021-07-18T14:14:34.0827499Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:34.0840241Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-18T14:14:34.0852872Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-18T14:14:34.0865568Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:34.0882754Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-18T14:14:34.1679863Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-18T14:14:34.1697307Z [submariner-operator]$ [cluster2] grep connected
2021-07-18T14:14:34.2265686Z  • Showing Connections  ...
2021-07-18T14:14:34.2442264Z  ✓ Showing Connections
2021-07-18T14:14:34.2625752Z  • Showing Connections  ...
2021-07-18T14:14:34.2686186Z  ✓ Showing Connections
2021-07-18T14:14:34.2718208Z cluster2-worker  cluster2  172.18.0.6  no   libreswan     242.254.2.0/24  connected  363.102µs   
2021-07-18T14:14:34.2719502Z cluster1-worker  cluster1  172.18.0.5  no   libreswan     242.254.1.0/24  connected  0s        
2021-07-18T14:14:34.2754264Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:34.2778371Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:34.2800602Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:14:34.2834457Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-18T14:14:34.2855824Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-18T14:14:34.2867882Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-18T14:14:34.2888795Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-18T14:14:34.2902271Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:14:34.2921045Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-18T14:14:34.2942517Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:14:34.5950446Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-18T14:14:34.6026243Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-18T14:14:35.6398567Z devel: Pulling from submariner/nettest
2021-07-18T14:14:35.6406940Z 5843afab3874: Already exists
2021-07-18T14:14:35.6426600Z 9565bb92f43f: Pulling fs layer
2021-07-18T14:14:35.6427155Z a31c0d5b4ad6: Pulling fs layer
2021-07-18T14:14:35.6427669Z dc3d13650205: Pulling fs layer
2021-07-18T14:14:35.8721683Z 9565bb92f43f: Verifying Checksum
2021-07-18T14:14:35.8723713Z 9565bb92f43f: Download complete
2021-07-18T14:14:35.8997256Z dc3d13650205: Download complete
2021-07-18T14:14:35.9872218Z a31c0d5b4ad6: Verifying Checksum
2021-07-18T14:14:35.9872822Z a31c0d5b4ad6: Download complete
2021-07-18T14:14:36.1065561Z 9565bb92f43f: Pull complete
2021-07-18T14:14:36.5825016Z a31c0d5b4ad6: Pull complete
2021-07-18T14:14:36.7205565Z dc3d13650205: Pull complete
2021-07-18T14:14:36.7341492Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-18T14:14:36.7398474Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-18T14:14:36.7407469Z quay.io/submariner/nettest:devel
2021-07-18T14:14:36.7466699Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-18T14:14:37.0419547Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-18T14:14:37.3252595Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-18T14:14:37.5995667Z The push refers to repository [localhost:5000/nettest]
2021-07-18T14:14:37.6075075Z 4f2cdf68c81d: Preparing
2021-07-18T14:14:37.6076072Z 1f803d62c8b3: Preparing
2021-07-18T14:14:37.6077159Z 80c9eaab4c9e: Preparing
2021-07-18T14:14:37.6077617Z 72e830a4dff5: Preparing
2021-07-18T14:14:38.3952593Z 80c9eaab4c9e: Pushed
2021-07-18T14:14:38.3985954Z 4f2cdf68c81d: Pushed
2021-07-18T14:14:38.4184755Z 72e830a4dff5: Pushed
2021-07-18T14:14:39.0372045Z 1f803d62c8b3: Pushed
2021-07-18T14:14:39.0731184Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-18T14:14:39.0873925Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:39.0884531Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:39.0902665Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:14:39.0925978Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-18T14:14:39.0954509Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:39.0973728Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:39.0996721Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:39.6920411Z deployment.apps/netshoot created
2021-07-18T14:14:39.7029907Z Waiting for netshoot pods to be ready.
2021-07-18T14:14:39.7052623Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:14:39.7067304Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-18T14:14:39.7083712Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-18T14:14:40.0166539Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-18T14:14:41.4568762Z deployment "netshoot" successfully rolled out
2021-07-18T14:14:41.4647058Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:41.4659022Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:41.4672452Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:41.4685841Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-18T14:14:41.4703384Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-18T14:14:41.4723426Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-18T14:14:41.4749153Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:41.4859589Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:41.4880278Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:42.4779937Z deployment.apps/nginx-demo created
2021-07-18T14:14:42.4937486Z service/nginx-demo created
2021-07-18T14:14:42.5503332Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-18T14:14:42.5582645Z Waiting for nginx-demo pods to be ready.
2021-07-18T14:14:42.5597537Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:14:42.5608661Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:14:42.5623410Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-18T14:14:43.1284727Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-18T14:14:48.5753938Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-18T14:14:48.6077262Z deployment "nginx-demo" successfully rolled out
2021-07-18T14:14:48.6128352Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-18T14:14:48.6162472Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:14:48.6185146Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-18T14:14:48.6204358Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-18T14:14:48.6218768Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-18T14:14:49.0732577Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-18T14:14:49.0750421Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:14:49.0761644Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-18T14:14:49.0773500Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-18T14:14:49.0784290Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-18T14:14:49.0800078Z [submariner-operator]$ [cluster1] svc_ip=$(with_retries 30 get_globalip "${svc_name}")
2021-07-18T14:14:49.0817335Z [submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo
2021-07-18T14:14:49.0830126Z [submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo
2021-07-18T14:14:49.0840450Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:14:49.0872970Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-18T14:14:49.0878369Z [submariner-operator]$ [cluster1] wait 7664
2021-07-18T14:14:49.0881660Z [submariner-operator]$ [cluster1] get_globalip
2021-07-18T14:14:49.0896710Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-18T14:14:49.0913781Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:49.0926030Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:49.0954943Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:49.3677757Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-18T14:14:49.3698808Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:49.3711605Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:49.3722448Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:49.6738163Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-18T14:14:49.6785579Z [submariner-operator]$ [cluster1] sleep 1
2021-07-18T14:14:50.6815732Z [submariner-operator]$ [cluster1] return 1
2021-07-18T14:14:50.6849581Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-18T14:14:50.6855136Z [submariner-operator]$ [cluster1] wait 7693
2021-07-18T14:14:50.6868133Z [submariner-operator]$ [cluster1] get_globalip
2021-07-18T14:14:50.6883158Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-18T14:14:50.6897773Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:50.6909888Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:50.6921351Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:50.9626868Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-18T14:14:50.9657977Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:50.9668581Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:50.9678369Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:51.2564430Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-18T14:14:51.2624684Z [submariner-operator]$ [cluster1] sleep 1
2021-07-18T14:14:52.2650728Z [submariner-operator]$ [cluster1] return 1
2021-07-18T14:14:52.2685734Z [submariner-operator]$ [cluster1] wait 7723
2021-07-18T14:14:52.2696711Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-18T14:14:52.2707633Z [submariner-operator]$ [cluster1] get_globalip
2021-07-18T14:14:52.2718599Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-18T14:14:52.2740195Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:52.2755330Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:52.2772261Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:52.5758623Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-18T14:14:52.5776830Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:52.5791458Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:52.5808829Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:52.8466041Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-18T14:14:52.8511733Z [submariner-operator]$ [cluster1] sleep 1
2021-07-18T14:14:53.8541381Z [submariner-operator]$ [cluster1] return 1
2021-07-18T14:14:53.8583341Z [submariner-operator]$ [cluster1] wait 7752
2021-07-18T14:14:53.8593331Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-18T14:14:53.8606622Z [submariner-operator]$ [cluster1] get_globalip
2021-07-18T14:14:53.8619088Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-18T14:14:53.8635579Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:53.8649782Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:53.8664265Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-18T14:14:54.1240693Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-18T14:14:54.1252594Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:54.1263604Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:54.1290304Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-18T14:14:54.3858278Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:14:54.3959362Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-ltfbp 242.254.1.252
2021-07-18T14:14:54.3973813Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-ltfbp 242.254.1.252
2021-07-18T14:14:54.4024202Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:14:54.4055229Z [submariner-operator]$ [cluster2] wait 7782
2021-07-18T14:14:54.4071551Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-ltfbp 242.254.1.252
2021-07-18T14:14:54.4085096Z [submariner-operator]$ [cluster2] test_connection
2021-07-18T14:14:54.4092607Z Attempting connectivity between clusters - netshoot-57677568b8-ltfbp --> 242.254.1.252
2021-07-18T14:14:54.4105440Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-18T14:14:54.4118618Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-18T14:14:54.4141105Z [submariner-operator]$ [cluster2] date +%s
2021-07-18T14:14:54.4174196Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ltfbp -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-18T14:14:54.4186833Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-ltfbp -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-18T14:14:54.4199868Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-ltfbp -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-18T14:14:54.7997108Z Connection test was successful!
2021-07-18T14:14:54.8016846Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:54.8031028Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:54.8054223Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:54.8073523Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:54.8087457Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:54.8106035Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-18T14:14:55.0873737Z deployment.apps "netshoot" deleted
2021-07-18T14:14:55.0990311Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.1011163Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.1027651Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.1038464Z [submariner-operator]$ [cluster1] remove_resource
2021-07-18T14:14:55.1050896Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.1066939Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.1088690Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-18T14:14:55.3574335Z deployment.apps "nginx-demo" deleted
2021-07-18T14:14:55.4064477Z service "nginx-demo" deleted
2021-07-18T14:14:55.4496428Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-18T14:14:55.4995315Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:14:55.5013088Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-18T14:14:55.5034553Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-18T14:14:55.5049167Z [submariner-operator]$ [cluster2] grep -q function
2021-07-18T14:14:55.5120512Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:14:55.5151374Z   Successfully remade target file 'deploy'.
2021-07-18T14:14:55.5154175Z Must remake target 'e2e'.
2021-07-18T14:14:55.5157524Z scripts/kind-e2e/e2e.sh
2021-07-18T14:14:55.5348105Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-18T14:14:55.5395633Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:55.5415707Z [submariner-operator]$ script_name=utils
2021-07-18T14:14:55.5424527Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:55.5444813Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-18T14:14:55.5459306Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:55.5468617Z [submariner-operator]$ script_name=deploy_funcs
2021-07-18T14:14:55.5479314Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:55.5496589Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-18T14:14:55.5519449Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:55.5532090Z [submariner-operator]$ script_name=deploy_operator
2021-07-18T14:14:55.5544417Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:55.5579160Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-18T14:14:55.5597958Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:55.5618134Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:14:55.5628219Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:55.5648358Z [submariner-operator]$ broker=cluster1
2021-07-18T14:14:55.5658650Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-18T14:14:55.5671674Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-18T14:14:55.5684196Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-18T14:14:55.5701963Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-18T14:14:55.5714611Z [submariner-operator]$ declare -gA cluster_subm
2021-07-18T14:14:55.5729915Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-18T14:14:55.5745920Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-18T14:14:55.5757381Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-18T14:14:55.5778655Z [submariner-operator]$ declare -gA cluster_cni
2021-07-18T14:14:55.5791549Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-18T14:14:55.5805105Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-18T14:14:55.5815034Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-18T14:14:55.5837880Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-18T14:14:55.5852940Z [submariner-operator]$ script_name=cluster_settings
2021-07-18T14:14:55.5864646Z [submariner-operator]$ exec_name=e2e.sh
2021-07-18T14:14:55.5942423Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-18T14:14:55.5954575Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-18T14:14:55.5991771Z [submariner-operator]$ globalnet=true
2021-07-18T14:14:55.6003264Z [submariner-operator]$ timeout=2m
2021-07-18T14:14:55.6013849Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:14:55.6024514Z [submariner-operator]$ declare_kubeconfig
2021-07-18T14:14:55.6034133Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-18T14:14:55.6053154Z [submariner-operator]$ export KUBECONFIG
2021-07-18T14:14:55.6067573Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-18T14:14:55.6091880Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-18T14:14:55.6132782Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-18T14:14:55.6155840Z [submariner-operator]$ create_subm_vars
2021-07-18T14:14:55.6177062Z [submariner-operator]$ create_subm_vars
2021-07-18T14:14:55.6194252Z [submariner-operator]$ deployment_name=submariner
2021-07-18T14:14:55.6212303Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-18T14:14:55.6226779Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-18T14:14:55.6239212Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-18T14:14:55.6263377Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-18T14:14:55.6275427Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-18T14:14:55.6290623Z [submariner-operator]$ declare_cidrs
2021-07-18T14:14:55.6298826Z [submariner-operator]$ declare_cidrs
2021-07-18T14:14:55.6308051Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-18T14:14:55.6315856Z [submariner-operator]$ i=1
2021-07-18T14:14:55.6326455Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:14:55.6337058Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-18T14:14:55.6349264Z [submariner-operator]$ [cluster1] val=0
2021-07-18T14:14:55.6364598Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-18T14:14:55.6381533Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-18T14:14:55.6400529Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-18T14:14:55.6410780Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-18T14:14:55.6424316Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:14:55.6435385Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-18T14:14:55.6448367Z [submariner-operator]$ [cluster2] val=0
2021-07-18T14:14:55.6461063Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-18T14:14:55.6473611Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-18T14:14:55.6484309Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-18T14:14:55.6499438Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-18T14:14:55.6507315Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-18T14:14:55.6517594Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-18T14:14:55.6557574Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-18T14:14:55.6567214Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-18T14:14:55.6580022Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-18T14:14:55.6598179Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-18T14:14:55.6610945Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-18T14:14:55.6623313Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-18T14:14:55.6639308Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-18T14:14:55.6654269Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-18T14:14:55.6667576Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-18T14:14:55.6684211Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-18T14:14:55.6700034Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-18T14:14:55.6713288Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-18T14:14:55.6730586Z [submariner-operator]$ [cluster1] broker_vars
2021-07-18T14:14:55.6742264Z [submariner-operator]$ [cluster1] broker_vars
2021-07-18T14:14:55.6755409Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-18T14:14:55.6775048Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:55.6786174Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:55.6803727Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-18T14:14:56.0079291Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-18T14:14:56.0111190Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:56.0126382Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:56.0140085Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-18T14:14:56.5146011Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-18T14:14:56.5215202Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:56.5228934Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-18T14:14:56.5243339Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:56.5273725Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-18T14:14:56.8760379Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-18T14:14:56.8776961Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-18T14:14:56.8790042Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-18T14:14:56.8803652Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-18T14:14:56.9274050Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:57.0234411Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:14:57.0727880Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-18T14:14:57.0728975Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-18T14:14:57.0730023Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-18T14:14:57.0730933Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-18T14:14:57.0731872Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-18T14:14:57.0733022Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-18T14:14:57.2942750Z [submariner-operator]$ [cluster1] return
2021-07-18T14:14:57.2953599Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-18T14:14:57.2966279Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-18T14:14:57.2981724Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-18T14:14:57.6533474Z NAME                                       TYPE                                  DATA   AGE
2021-07-18T14:14:57.6536388Z cluster-cluster1-token-x5mnm               kubernetes.io/service-account-token   3      78s
2021-07-18T14:14:57.6537997Z cluster-cluster2-token-csclh               kubernetes.io/service-account-token   3      72s
2021-07-18T14:14:57.6539783Z default-token-mf2dl                        kubernetes.io/service-account-token   3      96s
2021-07-18T14:14:57.6541658Z submariner-k8s-broker-admin-token-jw8p6    kubernetes.io/service-account-token   3      96s
2021-07-18T14:14:57.6543912Z submariner-k8s-broker-client-token-84vw5   kubernetes.io/service-account-token   3      96s
2021-07-18T14:14:57.6629977Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:57.6658783Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:57.6681973Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-18T14:14:57.9550435Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:57.9565027Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-84vw5 -n submariner-k8s-broker -o json
2021-07-18T14:14:57.9585359Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:57.9605813Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-84vw5 -n submariner-k8s-broker -o json
2021-07-18T14:14:57.9617778Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-84vw5 -n submariner-k8s-broker -o json
2021-07-18T14:14:58.2685466Z {
2021-07-18T14:14:58.2685850Z     "apiVersion": "v1",
2021-07-18T14:14:58.2686178Z     "data": {
2021-07-18T14:14:58.3250000Z         "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:14:58.3887535Z         "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-18T14:14:58.4433789Z         "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNkltdGtUbmhRVWw5MU56Vldiamd4VWpWelUzWnBTV2RCUWxWdVUyTlZUR3hYTlMxb1ZITjVTV1J3Ym5jaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkwNE5IWjNOU0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pWkRNM09HSmtNRGd0TjJNd09TMDBaRGt5TFdFM1lURXRPRFJoWmpKaFltVmtaamN5SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLmdsQmhOWjhNNWtnQl9Za095MmcwR0wzTGhmM2V6TFBiSU5LNmdQQW9sTHlzSVJkWF9ZNVYtLUlpUDVqeDNCc1gybzlLOWsyZEVVcXZTNWhZd2ZlS3JfRFh5cVdTY2F2ejVMZ0tkVFhBVU5PLW1paGFzM3RramlxUnp3RFVHMzJkQlhhY2VPOC1NRjd4MVNaMld2Zkwyc1ZDQnZrSk16X1czbXI2NTdBUHJaQV85S0xiQ3dkSWgwMHRwdm9CYnJyZEZ6VlRWVC1KWXZYb2FvelZXT1VKTXdudWx6SjRLNWM1MXJwS2ZGaUMxWTJUd0d3Snc3a2NqazZhXzFVRGk5XzRRMy1la3dKY25nTG1kVUVnUTkyRzZBX3dGWnF4eHBPeHJpY2xsQU9GSGRSVTY5dndmR2tpVUhHV2dNVzdNcFhkcTNmU3lGZUFNOFlTYnJxTjQtdm1nUQ=="
2021-07-18T14:14:58.5055174Z     },
2021-07-18T14:14:58.5055711Z     "kind": "Secret",
2021-07-18T14:14:58.5056039Z     "metadata": {
2021-07-18T14:14:58.5056386Z         "annotations": {
2021-07-18T14:14:58.5057677Z             "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-18T14:14:58.5059220Z             "kubernetes.io/service-account.uid": "d378bd08-7c09-4d92-a7a1-84af2abedf72"
2021-07-18T14:14:58.5059818Z         },
2021-07-18T14:14:58.5060345Z         "creationTimestamp": "2021-07-18T14:13:21Z",
2021-07-18T14:14:58.5060797Z         "managedFields": [
2021-07-18T14:14:58.5061110Z             {
2021-07-18T14:14:58.5061439Z                 "apiVersion": "v1",
2021-07-18T14:14:58.5062268Z                 "fieldsType": "FieldsV1",
2021-07-18T14:14:58.5062693Z                 "fieldsV1": {
2021-07-18T14:14:58.5063011Z                     "f:data": {
2021-07-18T14:14:58.5063322Z                         ".": {},
2021-07-18T14:14:58.5063630Z                         "f:ca.crt": {},
2021-07-18T14:14:58.5063995Z                         "f:namespace": {},
2021-07-18T14:14:58.5064340Z                         "f:token": {}
2021-07-18T14:14:58.5064652Z                     },
2021-07-18T14:14:58.5064986Z                     "f:metadata": {
2021-07-18T14:14:58.5065346Z                         "f:annotations": {
2021-07-18T14:14:58.5065843Z                             ".": {},
2021-07-18T14:14:58.5066511Z                             "f:kubernetes.io/service-account.name": {},
2021-07-18T14:14:58.5067302Z                             "f:kubernetes.io/service-account.uid": {}
2021-07-18T14:14:58.5067743Z                         }
2021-07-18T14:14:58.5068026Z                     },
2021-07-18T14:14:58.5068493Z                     "f:type": {}
2021-07-18T14:14:58.5069114Z                 },
2021-07-18T14:14:58.5069750Z                 "manager": "kube-controller-manager",
2021-07-18T14:14:58.5070277Z                 "operation": "Update",
2021-07-18T14:14:58.5070789Z                 "time": "2021-07-18T14:13:21Z"
2021-07-18T14:14:58.5071111Z             }
2021-07-18T14:14:58.5071387Z         ],
2021-07-18T14:14:58.5072536Z         "name": "submariner-k8s-broker-client-token-84vw5",
2021-07-18T14:14:58.5073678Z         "namespace": "submariner-k8s-broker",
2021-07-18T14:14:58.5074191Z         "resourceVersion": "1390",
2021-07-18T14:14:58.5075039Z         "uid": "13369a81-af7e-4b8a-9e8d-9d4ae974a536"
2021-07-18T14:14:58.5075623Z     },
2021-07-18T14:14:58.5076231Z     "type": "kubernetes.io/service-account-token"
2021-07-18T14:14:58.5076958Z }
2021-07-18T14:14:58.5077778Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-18T14:14:58.5078839Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-18T14:14:58.5080267Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:58.5081859Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-18T14:14:58.5083464Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-18T14:14:58.5085157Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:58.5087311Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-84vw5
2021-07-18T14:14:58.5089167Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-84vw5
2021-07-18T14:14:58.5091024Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:58.5338449Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-18T14:14:58.5358407Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-18T14:14:58.5375540Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:58.5775887Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-84vw5.cluster1.json
2021-07-18T14:14:58.6183465Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-18T14:14:58.6202316Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-18T14:14:58.6221347Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-18T14:14:58.6235997Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-18T14:14:58.6278384Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-18T14:14:58.6300165Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-18T14:14:58.6313169Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-18T14:14:58.6334556Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-18T14:14:58.6361405Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-18T14:14:58.6364031Z [submariner-operator]$ [cluster1] pids[cluster1]=8035
2021-07-18T14:14:58.6378634Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-18T14:14:58.6398629Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-18T14:14:58.6401216Z [submariner-operator]$ [cluster2] pids[cluster2]=8038
2021-07-18T14:14:58.6419644Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-18T14:14:58.6431298Z [submariner-operator]$ [cluster2] wait 8038
2021-07-18T14:14:58.6439365Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-18T14:14:58.6452491Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-18T14:14:59.4723766Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-18T14:14:59.4724915Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-18T14:14:59.4725760Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-18T14:14:59.4727095Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:59.4728515Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:59.4729784Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:59.4730894Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:59.4732146Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-18T14:14:59.4732947Z [cluster1] NAME                      CREATED AT
2021-07-18T14:14:59.4733652Z [cluster1] endpoints.submariner.io   2021-07-18T14:13:31Z
2021-07-18T14:14:59.4734802Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:59.4736083Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.4737376Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:14:59.4738656Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.4739903Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.4740648Z [cluster1] {
2021-07-18T14:14:59.4741141Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:59.4741826Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-18T14:14:59.4742356Z [cluster1]     "metadata": {
2021-07-18T14:14:59.4742766Z [cluster1]         "annotations": {
2021-07-18T14:14:59.4743567Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:59.4744159Z [cluster1]         },
2021-07-18T14:14:59.4744776Z [cluster1]         "creationTimestamp": "2021-07-18T14:13:31Z",
2021-07-18T14:14:59.4745265Z [cluster1]         "generation": 1,
2021-07-18T14:14:59.4745717Z [cluster1]         "managedFields": [
2021-07-18T14:14:59.4746105Z [cluster1]             {
2021-07-18T14:14:59.4746620Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:59.4747205Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:14:59.4747662Z [cluster1]                 "fieldsV1": {
2021-07-18T14:14:59.4748064Z [cluster1]                     "f:metadata": {
2021-07-18T14:14:59.4748647Z [cluster1]                         "f:annotations": {
2021-07-18T14:14:59.4749184Z [cluster1]                             ".": {},
2021-07-18T14:14:59.4750018Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:59.4750622Z [cluster1]                         }
2021-07-18T14:14:59.4750959Z [cluster1]                     },
2021-07-18T14:14:59.4751334Z [cluster1]                     "f:spec": {
2021-07-18T14:14:59.4751741Z [cluster1]                         "f:conversion": {
2021-07-18T14:14:59.4752317Z [cluster1]                             ".": {},
2021-07-18T14:14:59.4752705Z [cluster1]                             "f:strategy": {}
2021-07-18T14:14:59.4753098Z [cluster1]                         },
2021-07-18T14:14:59.4753466Z [cluster1]                         "f:group": {},
2021-07-18T14:14:59.4753867Z [cluster1]                         "f:names": {
2021-07-18T14:14:59.4754264Z [cluster1]                             "f:kind": {},
2021-07-18T14:14:59.4754668Z [cluster1]                             "f:listKind": {},
2021-07-18T14:14:59.4755099Z [cluster1]                             "f:plural": {},
2021-07-18T14:14:59.4755510Z [cluster1]                             "f:singular": {}
2021-07-18T14:14:59.4755900Z [cluster1]                         },
2021-07-18T14:14:59.4756270Z [cluster1]                         "f:scope": {},
2021-07-18T14:14:59.4756685Z [cluster1]                         "f:versions": {}
2021-07-18T14:14:59.4757056Z [cluster1]                     },
2021-07-18T14:14:59.4757562Z [cluster1]                     "f:status": {
2021-07-18T14:14:59.4758001Z [cluster1]                         "f:acceptedNames": {
2021-07-18T14:14:59.4758453Z [cluster1]                             "f:kind": {},
2021-07-18T14:14:59.4758863Z [cluster1]                             "f:plural": {}
2021-07-18T14:14:59.4759232Z [cluster1]                         },
2021-07-18T14:14:59.4759634Z [cluster1]                         "f:conditions": {},
2021-07-18T14:14:59.4760102Z [cluster1]                         "f:storedVersions": {}
2021-07-18T14:14:59.4760527Z [cluster1]                     }
2021-07-18T14:14:59.4760856Z [cluster1]                 },
2021-07-18T14:14:59.4761546Z [cluster1]                 "manager": "submariner-operator",
2021-07-18T14:14:59.4762088Z [cluster1]                 "operation": "Update",
2021-07-18T14:14:59.4762686Z [cluster1]                 "time": "2021-07-18T14:13:38Z"
2021-07-18T14:14:59.4763051Z [cluster1]             }
2021-07-18T14:14:59.4763388Z [cluster1]         ],
2021-07-18T14:14:59.4763895Z [cluster1]         "name": "endpoints.submariner.io",
2021-07-18T14:14:59.4764461Z [cluster1]         "resourceVersion": "1574",
2021-07-18T14:14:59.4765171Z [cluster1]         "uid": "87960840-fb30-42ff-9264-f0b8e25d3da4"
2021-07-18T14:14:59.4765610Z [cluster1]     },
2021-07-18T14:14:59.4765955Z [cluster1]     "spec": {
2021-07-18T14:14:59.4766333Z [cluster1]         "conversion": {
2021-07-18T14:14:59.4766761Z [cluster1]             "strategy": "None"
2021-07-18T14:14:59.4767132Z [cluster1]         },
2021-07-18T14:14:59.4767552Z [cluster1]         "group": "submariner.io",
2021-07-18T14:14:59.4768374Z [cluster1]         "names": {
2021-07-18T14:14:59.4768780Z [cluster1]             "kind": "Endpoint",
2021-07-18T14:14:59.4769262Z [cluster1]             "listKind": "EndpointList",
2021-07-18T14:14:59.4769745Z [cluster1]             "plural": "endpoints",
2021-07-18T14:14:59.4770217Z [cluster1]             "singular": "endpoint"
2021-07-18T14:14:59.4822435Z [cluster1]         },
2021-07-18T14:14:59.4823192Z [cluster1]         "scope": "Namespaced",
2021-07-18T14:14:59.4836402Z [cluster1]         "versions": [
2021-07-18T14:14:59.4836833Z [cluster1]             {
2021-07-18T14:14:59.4837393Z [cluster1]                 "name": "v1",
2021-07-18T14:14:59.4837790Z [cluster1]                 "schema": {
2021-07-18T14:14:59.4838277Z [cluster1]                     "openAPIV3Schema": {
2021-07-18T14:14:59.4838978Z [cluster1]                         "properties": {
2021-07-18T14:14:59.4840037Z [cluster1]                             "apiVersion": {
2021-07-18T14:14:59.4842550Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:59.4844978Z [cluster1]                                 "type": "string"
2021-07-18T14:14:59.4845423Z [cluster1]                             },
2021-07-18T14:14:59.4845812Z [cluster1]                             "kind": {
2021-07-18T14:14:59.4848070Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:59.4849721Z [cluster1]                                 "type": "string"
2021-07-18T14:14:59.4850279Z [cluster1]                             },
2021-07-18T14:14:59.4850678Z [cluster1]                             "metadata": {
2021-07-18T14:14:59.4851102Z [cluster1]                                 "type": "object"
2021-07-18T14:14:59.4851505Z [cluster1]                             },
2021-07-18T14:14:59.4851884Z [cluster1]                             "spec": {
2021-07-18T14:14:59.4852440Z [cluster1]                                 "properties": {
2021-07-18T14:14:59.4852890Z [cluster1]                                     "backend": {
2021-07-18T14:14:59.4853318Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4853735Z [cluster1]                                     },
2021-07-18T14:14:59.4854143Z [cluster1]                                     "backend_config": {
2021-07-18T14:14:59.4854701Z [cluster1]                                         "additionalProperties": {
2021-07-18T14:14:59.4855250Z [cluster1]                                             "type": "string"
2021-07-18T14:14:59.4855654Z [cluster1]                                         },
2021-07-18T14:14:59.4856077Z [cluster1]                                         "type": "object"
2021-07-18T14:14:59.4856471Z [cluster1]                                     },
2021-07-18T14:14:59.4856883Z [cluster1]                                     "cable_name": {
2021-07-18T14:14:59.4857320Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4857733Z [cluster1]                                     },
2021-07-18T14:14:59.4858124Z [cluster1]                                     "cluster_id": {
2021-07-18T14:14:59.4858692Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4859106Z [cluster1]                                     },
2021-07-18T14:14:59.4859544Z [cluster1]                                     "healthCheckIP": {
2021-07-18T14:14:59.4860214Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4860624Z [cluster1]                                     },
2021-07-18T14:14:59.4861044Z [cluster1]                                     "hostname": {
2021-07-18T14:14:59.4861487Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4861909Z [cluster1]                                     },
2021-07-18T14:14:59.4862317Z [cluster1]                                     "nat_enabled": {
2021-07-18T14:14:59.4862790Z [cluster1]                                         "type": "boolean"
2021-07-18T14:14:59.4863218Z [cluster1]                                     },
2021-07-18T14:14:59.4863783Z [cluster1]                                     "private_ip": {
2021-07-18T14:14:59.4864233Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4864628Z [cluster1]                                     },
2021-07-18T14:14:59.4865120Z [cluster1]                                     "public_ip": {
2021-07-18T14:14:59.4865569Z [cluster1]                                         "type": "string"
2021-07-18T14:14:59.4865981Z [cluster1]                                     },
2021-07-18T14:14:59.4866369Z [cluster1]                                     "subnets": {
2021-07-18T14:14:59.4866895Z [cluster1]                                         "items": {
2021-07-18T14:14:59.4867345Z [cluster1]                                             "type": "string"
2021-07-18T14:14:59.4867754Z [cluster1]                                         },
2021-07-18T14:14:59.4868168Z [cluster1]                                         "type": "array"
2021-07-18T14:14:59.4868753Z [cluster1]                                     }
2021-07-18T14:14:59.4869138Z [cluster1]                                 },
2021-07-18T14:14:59.4869538Z [cluster1]                                 "required": [
2021-07-18T14:14:59.4869984Z [cluster1]                                     "backend",
2021-07-18T14:14:59.4870420Z [cluster1]                                     "cable_name",
2021-07-18T14:14:59.4870867Z [cluster1]                                     "cluster_id",
2021-07-18T14:14:59.7208181Z [cluster1]                           [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-18T14:14:59.7209431Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-18T14:14:59.7210487Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-18T14:14:59.7212411Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:59.7214145Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-18T14:14:59.7215645Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:59.7217049Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-18T14:14:59.7218706Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-18T14:14:59.7219729Z [cluster2] NAME                      CREATED AT
2021-07-18T14:14:59.7220489Z [cluster2] endpoints.submariner.io   2021-07-18T14:13:43Z
2021-07-18T14:14:59.7221701Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:59.7223466Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.7224675Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.7226478Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-18T14:14:59.7228234Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:14:59.7229175Z [cluster2] {
2021-07-18T14:14:59.7229768Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:59.7230566Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-18T14:14:59.7231795Z [cluster2]     "metadata": {
2021-07-18T14:14:59.7232190Z [cluster2]         "annotations": {
2021-07-18T14:14:59.7233005Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:14:59.7233585Z [cluster2]         },
2021-07-18T14:14:59.7234199Z [cluster2]         "creationTimestamp": "2021-07-18T14:13:43Z",
2021-07-18T14:14:59.7234691Z [cluster2]         "generation": 1,
2021-07-18T14:14:59.7235147Z [cluster2]         "managedFields": [
2021-07-18T14:14:59.7235532Z [cluster2]             {
2021-07-18T14:14:59.7236051Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:14:59.7236649Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:14:59.7237098Z [cluster2]                 "fieldsV1": {
2021-07-18T14:14:59.7237520Z [cluster2]                     "f:metadata": {
2021-07-18T14:14:59.7237944Z [cluster2]                         "f:annotations": {
2021-07-18T14:14:59.7238485Z [cluster2]                             ".": {},
2021-07-18T14:14:59.7239303Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:14:59.7239981Z [cluster2]                         }
2021-07-18T14:14:59.7240322Z [cluster2]                     },
2021-07-18T14:14:59.7240695Z [cluster2]                     "f:spec": {
2021-07-18T14:14:59.7241106Z [cluster2]                         "f:conversion": {
2021-07-18T14:14:59.7241516Z [cluster2]                             ".": {},
2021-07-18T14:14:59.7241927Z [cluster2]                             "f:strategy": {}
2021-07-18T14:14:59.7242303Z [cluster2]                         },
2021-07-18T14:14:59.7242868Z [cluster2]                         "f:group": {},
2021-07-18T14:14:59.7244627Z [cluster2]                         "f:names": {
2021-07-18T14:14:59.7245128Z [cluster2]                             "f:kind": {},
2021-07-18T14:14:59.7245623Z [cluster2]                             "f:listKind": {},
2021-07-18T14:14:59.7246153Z [cluster2]                             "f:plural": {},
2021-07-18T14:14:59.7246656Z [cluster2]                             "f:singular": {}
2021-07-18T14:14:59.7247289Z [cluster2]                         },
2021-07-18T14:14:59.7248241Z [cluster2]                         "f:scope": {},
2021-07-18T14:14:59.7249018Z [cluster2]                         "f:versions": {}
2021-07-18T14:14:59.7249595Z [cluster2]                     },
2021-07-18T14:14:59.7249965Z [cluster2]                     "f:status": {
2021-07-18T14:14:59.7250585Z [cluster2]                         "f:acceptedNames": {
2021-07-18T14:14:59.7251228Z [cluster2]                             "f:kind": {},
2021-07-18T14:14:59.7251660Z [cluster2]                             "f:plural": {}
2021-07-18T14:14:59.7252053Z [cluster2]                         },
2021-07-18T14:14:59.7252483Z [cluster2]                         "f:conditions": {},
2021-07-18T14:14:59.7252980Z [cluster2]                         "f:storedVersions": {}
2021-07-18T14:14:59.7253439Z [cluster2]                     }
2021-07-18T14:14:59.7253805Z [cluster2]                 },
2021-07-18T14:14:59.7254761Z [cluster2]                 "manager": "submariner-operator",
2021-07-18T14:14:59.7255500Z [cluster2]                 "operation": "Update",
2021-07-18T14:14:59.7256307Z [cluster2]                 "time": "2021-07-18T14:14:01Z"
2021-07-18T14:14:59.7256793Z [cluster2]             }
2021-07-18T14:14:59.7257116Z [cluster2]         ],
2021-07-18T14:14:59.7257627Z [cluster2]         "name": "endpoints.submariner.io",
2021-07-18T14:14:59.7258201Z [cluster2]         "resourceVersion": "1586",
2021-07-18T14:14:59.7259202Z [cluster2]         "uid": "cc851c8c-552a-4bdb-aa61-962cdbf4bf4d"
2021-07-18T14:14:59.7259730Z [cluster2]     },
2021-07-18T14:14:59.7260088Z [cluster2]     "spec": {
2021-07-18T14:14:59.7260497Z [cluster2]         "conversion": {
2021-07-18T14:14:59.7260919Z [cluster2]             "strategy": "None"
2021-07-18T14:14:59.7261314Z [cluster2]         },
2021-07-18T14:14:59.7261894Z [cluster2]         "group": "submariner.io",
2021-07-18T14:14:59.7262324Z [cluster2]         "names": {
2021-07-18T14:14:59.7262873Z [cluster2]             "kind": "Endpoint",
2021-07-18T14:14:59.7263334Z [cluster2]             "listKind": "EndpointList",
2021-07-18T14:14:59.7263797Z [cluster2]             "plural": "endpoints",
2021-07-18T14:14:59.7264258Z [cluster2]             "singular": "endpoint"
2021-07-18T14:14:59.7264632Z [cluster2]         },
2021-07-18T14:14:59.7265027Z [cluster2]         "scope": "Namespaced",
2021-07-18T14:14:59.7265431Z [cluster2]         "versions": [
2021-07-18T14:14:59.7265788Z [cluster2]             {
2021-07-18T14:14:59.7266284Z [cluster2]                 "name": "v1",
2021-07-18T14:14:59.7266838Z [cluster2]                 "schema": {
2021-07-18T14:14:59.7267629Z [cluster2]                     "openAPIV3Schema": {
2021-07-18T14:14:59.7268732Z [cluster2]                         "properties": {
2021-07-18T14:14:59.7269371Z [cluster2]                             "apiVersion": {
2021-07-18T14:14:59.7272179Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:14:59.7274149Z [cluster2]                                 "type": "string"
2021-07-18T14:14:59.7274977Z [cluster2]                             },
2021-07-18T14:14:59.7275411Z [cluster2]                             "kind": {
2021-07-18T14:14:59.7278185Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:14:59.7280373Z [cluster2]                                 "type": "string"
2021-07-18T14:14:59.7280774Z [cluster2]                             },
2021-07-18T14:14:59.7281183Z [cluster2]                             "metadata": {
2021-07-18T14:14:59.7281619Z [cluster2]                                 "type": "object"
2021-07-18T14:14:59.7282046Z [cluster2]                             },
2021-07-18T14:14:59.7282698Z [cluster2]                             "spec": {
2021-07-18T14:14:59.7283416Z [cluster2]                                 "properties": {
2021-07-18T14:14:59.7283878Z [cluster2]                                     "backend": {
2021-07-18T14:14:59.7284319Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7284747Z [cluster2]                                     },
2021-07-18T14:14:59.7285170Z [cluster2]                                     "backend_config": {
2021-07-18T14:14:59.7286263Z [cluster2]                                         "additionalProperties": {
2021-07-18T14:14:59.7287009Z [cluster2]                                             "type": "string"
2021-07-18T14:14:59.7287425Z [cluster2]                                         },
2021-07-18T14:14:59.7307572Z [cluster2]                                         "type": "object"
2021-07-18T14:14:59.7308111Z [cluster2]                                     },
2021-07-18T14:14:59.7308707Z [cluster2]                                     "cable_name": {
2021-07-18T14:14:59.7309141Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7309568Z [cluster2]                                     },
2021-07-18T14:14:59.7309965Z [cluster2]                                     "cluster_id": {
2021-07-18T14:14:59.7310561Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7310966Z [cluster2]                                     },
2021-07-18T14:14:59.7311380Z [cluster2]                                     "healthCheckIP": {
2021-07-18T14:14:59.7311858Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7312241Z [cluster2]                                     },
2021-07-18T14:14:59.7312744Z [cluster2]                                     "hostname": {
2021-07-18T14:14:59.7313165Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7313566Z [cluster2]                                     },
2021-07-18T14:14:59.7313950Z [cluster2]                                     "nat_enabled": {
2021-07-18T14:14:59.7314489Z [cluster2]                                         "type": "boolean"
2021-07-18T14:14:59.7314904Z [cluster2]                                     },
2021-07-18T14:14:59.7315294Z [cluster2]                                     "private_ip": {
2021-07-18T14:14:59.7315736Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7316127Z [cluster2]                                     },
2021-07-18T14:14:59.7316664Z [cluster2]                                     "public_ip": {
2021-07-18T14:14:59.7317284Z [cluster2]                                         "type": "string"
2021-07-18T14:14:59.7317704Z [cluster2]                                     },
2021-07-18T14:14:59.7318346Z [cluster2]                                     "subnets": {
2021-07-18T14:14:59.7318993Z [cluster2]                                         "items": {
2021-07-18T14:14:59.7319638Z [cluster2]                                             "type": "string"
2021-07-18T14:14:59.7320286Z [cluster2]                                         },
2021-07-18T14:14:59.7320796Z [cluster2]                                         "type": "array"
2021-07-18T14:14:59.7321279Z [cluster2]                                     }
2021-07-18T14:14:59.7321882Z [cluster2]                                 },
2021-07-18T14:14:59.7322341Z [cluster2]                                 "required": [
2021-07-18T14:14:59.7322848Z [cluster2]                                     "backend",
2021-07-18T14:14:59.7323498Z [cluster2]                                     "cable_name",
2021-07-18T14:14:59.7324310Z [cluster2]                                     "cluster_id",
2021-07-18T14:15:00.2347088Z [cluster2]                                     "hostname",
2021-07-18T14:15:00.2347751Z [cluster1]                                     "nat_enabled",
2021-07-18T14:15:00.2348260Z [cluster1]                                     "private_ip",
2021-07-18T14:15:00.2348731Z [cluster1]                                     "public_ip",
2021-07-18T14:15:00.2349630Z [cluster1]                                     "subnets"
2021-07-18T14:15:00.2350037Z [cluster1]                                 ],
2021-07-18T14:15:00.2350477Z [cluster1]                                 "type": "object"
2021-07-18T14:15:00.2350906Z [cluster1]                             }
2021-07-18T14:15:00.2351271Z [cluster1]                         },
2021-07-18T14:15:00.2351691Z [cluster1]                         "required": [
2021-07-18T14:15:00.2352122Z [cluster1]                             "spec"
2021-07-18T14:15:00.2352519Z [cluster1]                         ],
2021-07-18T14:15:00.2352926Z [cluster1]                         "type": "object"
2021-07-18T14:15:00.2353341Z [cluster1]                     }
2021-07-18T14:15:00.2353695Z [cluster1]                 },
2021-07-18T14:15:00.2354104Z [cluster1]                 "served": true,
2021-07-18T14:15:00.2354539Z [cluster1]                 "storage": true
2021-07-18T14:15:00.2355090Z [cluster1]             }
2021-07-18T14:15:00.2355453Z [cluster1]         ]
2021-07-18T14:15:00.2355786Z [cluster1]     },
2021-07-18T14:15:00.2356160Z [cluster1]     "status": {
2021-07-18T14:15:00.2356593Z [cluster1]         "acceptedNames": {
2021-07-18T14:15:00.2357079Z [cluster1]             "kind": "Endpoint",
2021-07-18T14:15:00.2357571Z [cluster1]             "listKind": "EndpointList",
2021-07-18T14:15:00.2358098Z [cluster1]             "plural": "endpoints",
2021-07-18T14:15:00.2358587Z [cluster1]             "singular": "endpoint"
2021-07-18T14:15:00.2359018Z [cluster1]         },
2021-07-18T14:15:00.2359403Z [cluster1]         "conditions": [
2021-07-18T14:15:00.2359803Z [cluster1]             {
2021-07-18T14:15:00.2360897Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:31Z",
2021-07-18T14:15:00.2361511Z [cluster1]                 "message": "no conflicts found",
2021-07-18T14:15:00.2362048Z [cluster1]                 "reason": "NoConflicts",
2021-07-18T14:15:00.2362516Z [cluster1]                 "status": "True",
2021-07-18T14:15:00.2363023Z [cluster1]                 "type": "NamesAccepted"
2021-07-18T14:15:00.2363461Z [cluster1]             },
2021-07-18T14:15:00.2363826Z [cluster1]             {
2021-07-18T14:15:00.2364509Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:31Z",
2021-07-18T14:15:00.2365177Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-18T14:15:00.2365849Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:00.2366552Z [cluster1]                 "status": "True",
2021-07-18T14:15:00.2367054Z [cluster1]                 "type": "Established"
2021-07-18T14:15:00.2369876Z [cluster1]             }
2021-07-18T14:15:00.2370253Z [cluster1]         ],
2021-07-18T14:15:00.2370658Z [cluster1]         "storedVersions": [
2021-07-18T14:15:00.2371084Z [cluster1]             "v1"
2021-07-18T14:15:00.2371421Z [cluster1]         ]
2021-07-18T14:15:00.2371761Z [cluster1]     }
2021-07-18T14:15:00.2372076Z [cluster1] }
2021-07-18T14:15:00.2373080Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:15:00.2374363Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:15:00.2375838Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:15:00.2377167Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:00.2378208Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:00.2379538Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:15:00.2380838Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:00.2381910Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:00.2383380Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:15:00.2384877Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-18T14:15:00.2385954Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-18T14:15:00.2387313Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:15:00.2388780Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:15:00.2390186Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:15:00.2391723Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-18T14:15:00.2393027Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-18T14:15:00.2393845Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-18T14:15:00.2394844Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:15:00.2396100Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:15:00.2397207Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-18T14:15:00.2399151Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-18T14:15:00.2400802Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-18T14:15:00.2401757Z [cluster1] NAME                     CREATED AT
2021-07-18T14:15:00.3961962Z [cluster1] clusters.submariner.io   20          "hostname",
2021-07-18T14:15:00.3962820Z [cluster2]                                     "nat_enabled",
2021-07-18T14:15:00.3963284Z [cluster2]                                     "private_ip",
2021-07-18T14:15:00.3963714Z [cluster2]                                     "public_ip",
2021-07-18T14:15:00.3964173Z [cluster2]                                     "subnets"
2021-07-18T14:15:00.3964571Z [cluster2]                                 ],
2021-07-18T14:15:00.3964963Z [cluster2]                                 "type": "object"
2021-07-18T14:15:00.3965361Z [cluster2]                             }
2021-07-18T14:15:00.3965705Z [cluster2]                         },
2021-07-18T14:15:00.3966098Z [cluster2]                         "required": [
2021-07-18T14:15:00.3966672Z [cluster2]                             "spec"
2021-07-18T14:15:00.3967065Z [cluster2]                         ],
2021-07-18T14:15:00.3967581Z [cluster2]                         "type": "object"
2021-07-18T14:15:00.3968098Z [cluster2]                     }
2021-07-18T14:15:00.3968432Z [cluster2]                 },
2021-07-18T14:15:00.3968814Z [cluster2]                 "served": true,
2021-07-18T14:15:00.3969421Z [cluster2]                 "storage": true
2021-07-18T14:15:00.3969795Z [cluster2]             }
2021-07-18T14:15:00.3970145Z [cluster2]         ]
2021-07-18T14:15:00.3970466Z [cluster2]     },
2021-07-18T14:15:00.3970825Z [cluster2]     "status": {
2021-07-18T14:15:00.3971242Z [cluster2]         "acceptedNames": {
2021-07-18T14:15:00.3971714Z [cluster2]             "kind": "Endpoint",
2021-07-18T14:15:00.3972188Z [cluster2]             "listKind": "EndpointList",
2021-07-18T14:15:00.3972699Z [cluster2]             "plural": "endpoints",
2021-07-18T14:15:00.3973355Z [cluster2]             "singular": "endpoint"
2021-07-18T14:15:00.3973787Z [cluster2]         },
2021-07-18T14:15:00.3974171Z [cluster2]         "conditions": [
2021-07-18T14:15:00.3974568Z [cluster2]             {
2021-07-18T14:15:00.3975674Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:43Z",
2021-07-18T14:15:00.3976267Z [cluster2]                 "message": "no conflicts found",
2021-07-18T14:15:00.3976958Z [cluster2]                 "reason": "NoConflicts",
2021-07-18T14:15:00.3977407Z [cluster2]                 "status": "True",
2021-07-18T14:15:00.3978243Z [cluster2]                 "type": "NamesAccepted"
2021-07-18T14:15:00.3978679Z [cluster2]             },
2021-07-18T14:15:00.3979037Z [cluster2]             {
2021-07-18T14:15:00.3979906Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:44Z",
2021-07-18T14:15:00.3980555Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-18T14:15:00.3981207Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:00.3982105Z [cluster2]                 "status": "True",
2021-07-18T14:15:00.3982569Z [cluster2]                 "type": "Established"
2021-07-18T14:15:00.3982969Z [cluster2]             }
2021-07-18T14:15:00.3983438Z [cluster2]         ],
2021-07-18T14:15:00.3983846Z [cluster2]         "storedVersions": [
2021-07-18T14:15:00.3984273Z [cluster2]             "v1"
2021-07-18T14:15:00.3984781Z [cluster2]         ]
2021-07-18T14:15:00.3985130Z [cluster2]     }
2021-07-18T14:15:00.3985454Z [cluster2] }
2021-07-18T14:15:00.3987064Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:15:00.3988804Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-18T14:15:00.3990957Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:15:00.3993111Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:00.3994209Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:00.3996293Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:15:00.3997483Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:00.3998463Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:00.3999679Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:15:00.4000879Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-18T14:15:00.4001855Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-18T14:15:00.4003089Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:15:00.4004522Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:15:00.4005919Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-18T14:15:00.4007395Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-18T14:15:00.4009074Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-18T14:15:00.4009894Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-18T14:15:00.4010894Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:15:00.4012156Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-18T14:15:00.4013398Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-18T14:15:00.4014418Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-18T14:15:00.4016730Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-18T14:15:00.4017686Z [cluster2] NAME                     CREATED AT
2021-07-18T14:15:00.5921526Z [cluster2] clusters.submariner.io   2021-07-18T14:13:31Z
2021-07-18T14:15:00.5923835Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:00.5925948Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:15:00.5928249Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:00.5930258Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:15:00.5932446Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-18T14:15:00.5933886Z [cluster1] {
2021-07-18T14:15:00.5934733Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:00.5936060Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-18T14:15:00.5937120Z [cluster1]     "metadata": {
2021-07-18T14:15:00.5938078Z [cluster1]         "annotations": {
2021-07-18T14:15:00.5941628Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:15:00.5942800Z [cluster1]         },
2021-07-18T14:15:00.5945338Z [cluster1]         "creationTimestamp": "2021-07-18T14:13:31Z",
2021-07-18T14:15:00.5946417Z [cluster1]         "generation": 1,
2021-07-18T14:15:00.5947068Z [cluster1]         "managedFields": [
2021-07-18T14:15:00.5947615Z [cluster1]             {
2021-07-18T14:15:00.5948264Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:00.5949009Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:00.5949786Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:00.5950358Z [cluster1]                     "f:metadata": {
2021-07-18T14:15:00.5950958Z [cluster1]                         "f:annotations": {
2021-07-18T14:15:00.5951521Z [cluster1]                             ".": {},
2021-07-18T14:15:00.5952646Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:15:00.5953588Z [cluster1]                         }
2021-07-18T14:15:00.5954077Z [cluster1]                     },
2021-07-18T14:15:00.5954586Z [cluster1]                     "f:spec": {
2021-07-18T14:15:00.5955136Z [cluster1]                         "f:conversion": {
2021-07-18T14:15:00.5956845Z [cluster1]                             ".": {},
2021-07-18T14:15:00.5957501Z [cluster1]                             "f:strategy": {}
2021-07-18T14:15:00.5959040Z [cluster1]                         },
2021-07-18T14:15:00.5960813Z [cluster1]                         "f:group": {},
2021-07-18T14:15:00.5962920Z [cluster1]                         "f:names": {
2021-07-18T14:15:00.5964980Z [cluster1]                             "f:kind": {},
2021-07-18T14:15:00.5966967Z [cluster1]                             "f:listKind": {},
2021-07-18T14:15:00.5969648Z [cluster1]                             "f:plural": {},
2021-07-18T14:15:00.5970552Z [cluster1]                             "f:singular": {}
2021-07-18T14:15:00.5971122Z [cluster1]                         },
2021-07-18T14:15:00.5971968Z [cluster1]                         "f:scope": {},
2021-07-18T14:15:00.5973966Z [cluster1]                         "f:versions": {}
2021-07-18T14:15:00.5976124Z [cluster1]                     },
2021-07-18T14:15:00.5977541Z [cluster1]                     "f:status": {
2021-07-18T14:15:00.5987676Z [cluster1]                         "f:acceptedNames": {
2021-07-18T14:15:00.5988367Z [cluster1]                             "f:kind": {},
2021-07-18T14:15:00.5989245Z [cluster1]                             "f:plural": {}
2021-07-18T14:15:00.5989948Z [cluster1]                         },
2021-07-18T14:15:00.5990481Z [cluster1]                         "f:conditions": {},
2021-07-18T14:15:00.5991112Z [cluster1]                         "f:storedVersions": {}
2021-07-18T14:15:00.5991696Z [cluster1]                     }
2021-07-18T14:15:00.5992358Z [cluster1]                 },
2021-07-18T14:15:00.5993324Z [cluster1]                 "manager": "submariner-operator",
2021-07-18T14:15:00.5994084Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:00.5994904Z [cluster1]                 "time": "2021-07-18T14:13:38Z"
2021-07-18T14:15:00.5995636Z [cluster1]             }
2021-07-18T14:15:00.5996095Z [cluster1]         ],
2021-07-18T14:15:00.5996949Z [cluster1]         "name": "clusters.submariner.io",
2021-07-18T14:15:00.5997865Z [cluster1]         "resourceVersion": "1573",
2021-07-18T14:15:00.5998899Z [cluster1]         "uid": "3dc0beb8-db01-4698-acbb-97b2c02ac044"
2021-07-18T14:15:00.5999643Z [cluster1]     },
2021-07-18T14:15:00.6000133Z [cluster1]     "spec": {
2021-07-18T14:15:00.6000844Z [cluster1]         "conversion": {
2021-07-18T14:15:00.6001411Z [cluster1]             "strategy": "None"
2021-07-18T14:15:00.6002525Z [cluster1]         },
2021-07-18T14:15:00.6004479Z [cluster1]         "group": "submariner.io",
2021-07-18T14:15:00.6006100Z [cluster1]         "names": {
2021-07-18T14:15:00.6006498Z [cluster1]             "kind": "Cluster",
2021-07-18T14:15:00.6006981Z [cluster1]             "listKind": "ClusterList",
2021-07-18T14:15:00.6007579Z [cluster1]             "plural": "clusters",
2021-07-18T14:15:00.6010256Z [cluster1]             "singular": "cluster"
2021-07-18T14:15:00.6010660Z [cluster1]         },
2021-07-18T14:15:00.6011214Z [cluster1]         "scope": "Namespaced",
2021-07-18T14:15:00.6011654Z [cluster1]         "versions": [
2021-07-18T14:15:00.6012037Z [cluster1]             {
2021-07-18T14:15:00.6012653Z [cluster1]                 "name": "v1",
2021-07-18T14:15:00.6013078Z [cluster1]                 "schema": {
2021-07-18T14:15:00.6013553Z [cluster1]                     "openAPIV3Schema": {
2021-07-18T14:15:00.6014154Z [cluster1]                         "properties": {
2021-07-18T14:15:00.6014649Z [cluster1]                             "apiVersion": {
2021-07-18T14:15:00.6017006Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:15:00.6018720Z [cluster1]                                 "type": "string"
2021-07-18T14:15:00.6019154Z [cluster1]                             },
2021-07-18T14:15:00.6019534Z [cluster1]                             "kind": {
2021-07-18T14:15:00.6021434Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:15:00.6023087Z [cluster1]                                 "type": "string"
2021-07-18T14:15:00.6023518Z [cluster1]                             },
2021-07-18T14:15:00.6023935Z [cluster1]                             "metadata": {
2021-07-18T14:15:00.6024375Z [cluster1]                                 "type": "object"
2021-07-18T14:15:00.6024793Z [cluster1]                             },
2021-07-18T14:15:00.6025168Z [cluster1]                             "spec": {
2021-07-18T14:15:00.6025622Z [cluster1]                                 "properties": {
2021-07-18T14:15:00.6026083Z [cluster1]                                     "cluster_cidr": {
2021-07-18T14:15:00.6026537Z [cluster1]                                         "items": {
2021-07-18T14:15:00.6026996Z [cluster1]                                             "type": "string"
2021-07-18T14:15:00.6027416Z [cluster1]                                         },
2021-07-18T14:15:00.6027844Z [cluster1]                                         "type": "array"
2021-07-18T14:15:00.6028251Z [cluster1]                                     },
2021-07-18T14:15:00.6028675Z [cluster1]                                     "cluster_id": {
2021-07-18T14:15:00.6029121Z [cluster1]                                         "type": "string"
2021-07-18T14:15:00.6029554Z [cluster1]                                     },
2021-07-18T14:15:00.6029982Z [cluster1]                                     "color_codes": {
2021-07-18T14:15:00.6030407Z [cluster1]                                         "items": {
2021-07-18T14:15:00.6030959Z [cluster1]                                             "type": "string"
2021-07-18T14:15:00.6031376Z [cluster1]                                         },
2021-07-18T14:15:00.6031804Z [cluster1]                                         "type": "array"
2021-07-18T14:15:00.6032209Z [cluster1]                                     },
2021-07-18T14:15:00.6032629Z [cluster1]                                     "global_cidr": {
2021-07-18T14:15:00.6033058Z [cluster1]                                         "items": {
2021-07-18T14:15:00.6033512Z [cluster1]                                             "type": "string"
2021-07-18T14:15:00.6034279Z [cluster1]                                         },
2021-07-18T14:15:00.6034706Z [cluster1]                                         "type": "array"
2021-07-18T14:15:00.6035330Z [cluster1]                                     },
2021-07-18T14:15:00.6035767Z [cluster1]                                     "service_cidr": {
2021-07-18T14:15:00.6036247Z [cluster1]                                         "items": {
2021-07-18T14:15:00.6036722Z [cluster1]                                             "type": "string"
2021-07-18T14:15:00.6037377Z [cluster1]                                         },
2021-07-18T14:15:00.6037819Z [cluster1]                                         "type": "array"
2021-07-18T14:15:00.6038250Z [cluster1]                                     }
2021-07-18T14:15:00.6038794Z [cluster1]                                 },
2021-07-18T14:15:00.6039386Z [cluster1]                                 "required": [
2021-07-18T14:15:00.6040673Z [cluster1]                                     "cluster_cidr",
2021-07-18T14:15:00.6041227Z [cluster1]                                     "cluster_id",
2021-07-18T14:15:00.6041746Z [cluster1]                                     "color_codes",
2021-07-18T14:15:00.6042279Z [cluster1]                                     "global_cidr",
2021-07-18T14:15:00.6042806Z [cluster1]                                     "service_cidr"
2021-07-18T14:15:00.6043319Z [cluster1]                                 ],
2021-07-18T14:15:00.6043999Z [cluster1]                                 "type": "object"
2021-07-18T14:15:00.6044671Z [cluster1]                             }
2021-07-18T14:15:00.6045077Z [cluster1]                         },
2021-07-18T14:15:00.6045505Z [cluster1]                         "required": [
2021-07-18T14:15:00.6045967Z [cluster1]                             "spec"
2021-07-18T14:15:00.6046671Z [cluster1]                         ],
2021-07-18T14:15:00.6047299Z [cluster1]                         "type": "object"
2021-07-18T14:15:00.6072772Z [cluster1]                     }
2021-07-18T14:15:00.6073262Z [cluster1]                 },
2021-07-18T14:15:00.6073721Z [cluster1]                 "served": true,
2021-07-18T14:15:00.6074394Z [cluster1]                 "storage": true
2021-07-18T14:15:00.6075131Z [cluster1]             }
2021-07-18T14:15:00.6075628Z [cluster1]         ]
2021-07-18T14:15:00.6075980Z [cluster1]     },
2021-07-18T14:15:00.6076323Z [cluster1]     "status": {
2021-07-18T14:15:00.6076904Z [cluster1]         "acceptedNames": {
2021-07-18T14:15:00.6077350Z [cluster1]             "kind": "Cluster",
2021-07-18T14:15:00.6077828Z [cluster1]             "listKind": "ClusterList",
2021-07-18T14:15:00.6078312Z [cluster1]             "plural": "clusters",
2021-07-18T14:15:00.6078782Z [cluster1]             "singular": "cluster"
2021-07-18T14:15:00.6079170Z [cluster1]         },
2021-07-18T14:15:00.6079559Z [cluster1]         "conditions": [
2021-07-18T14:15:00.6079933Z [cluster1]             {
2021-07-18T14:15:00.6080750Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:31Z",
2021-07-18T14:15:00.6081339Z [cluster1]                 "message": "no conflicts found",
2021-07-18T14:15:00.6081844Z [cluster1]                 "reason": "NoConflicts",
2021-07-18T14:15:00.6082411Z [cluster1]                 "status": "True",
2021-07-18T14:15:00.6082883Z [cluster1]                 "type": "NamesAccepted"
2021-07-18T14:15:00.7986809Z [cluste21-07-18T14:13:43Z
2021-07-18T14:15:00.7988033Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:00.7990002Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:15:00.7991584Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:00.7993232Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-18T14:15:00.7994681Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-18T14:15:00.7995543Z [cluster2] {
2021-07-18T14:15:00.7996135Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:00.7997079Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-18T14:15:00.7998066Z [cluster2]     "metadata": {
2021-07-18T14:15:00.7998686Z [cluster2]         "annotations": {
2021-07-18T14:15:00.7999651Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:15:00.8000308Z [cluster2]         },
2021-07-18T14:15:00.8001200Z [cluster2]         "creationTimestamp": "2021-07-18T14:13:43Z",
2021-07-18T14:15:00.8001946Z [cluster2]         "generation": 1,
2021-07-18T14:15:00.8002455Z [cluster2]         "managedFields": [
2021-07-18T14:15:00.8002893Z [cluster2]             {
2021-07-18T14:15:00.8003482Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:00.8004167Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:00.8004676Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:00.8005152Z [cluster2]                     "f:metadata": {
2021-07-18T14:15:00.8005638Z [cluster2]                         "f:annotations": {
2021-07-18T14:15:00.8006105Z [cluster2]                             ".": {},
2021-07-18T14:15:00.8006994Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:15:00.8008081Z [cluster2]                         }
2021-07-18T14:15:00.8008489Z [cluster2]                     },
2021-07-18T14:15:00.8008914Z [cluster2]                     "f:spec": {
2021-07-18T14:15:00.8009551Z [cluster2]                         "f:conversion": {
2021-07-18T14:15:00.8009987Z [cluster2]                             ".": {},
2021-07-18T14:15:00.8010431Z [cluster2]                             "f:strategy": {}
2021-07-18T14:15:00.8011039Z [cluster2]                         },
2021-07-18T14:15:00.8011489Z [cluster2]                         "f:group": {},
2021-07-18T14:15:00.8012072Z [cluster2]                         "f:names": {
2021-07-18T14:15:00.8012496Z [cluster2]                             "f:kind": {},
2021-07-18T14:15:00.8012927Z [cluster2]                             "f:listKind": {},
2021-07-18T14:15:00.8013389Z [cluster2]                             "f:plural": {},
2021-07-18T14:15:00.8013824Z [cluster2]                             "f:singular": {}
2021-07-18T14:15:00.8014243Z [cluster2]                         },
2021-07-18T14:15:00.8014646Z [cluster2]                         "f:scope": {},
2021-07-18T14:15:00.8015072Z [cluster2]                         "f:versions": {}
2021-07-18T14:15:00.8015485Z [cluster2]                     },
2021-07-18T14:15:00.8015868Z [cluster2]                     "f:status": {
2021-07-18T14:15:00.8016536Z [cluster2]                         "f:acceptedNames": {
2021-07-18T14:15:00.8017016Z [cluster2]                             "f:kind": {},
2021-07-18T14:15:00.8017466Z [cluster2]                             "f:plural": {}
2021-07-18T14:15:00.8017875Z [cluster2]                         },
2021-07-18T14:15:00.8018317Z [cluster2]                         "f:conditions": {},
2021-07-18T14:15:00.8018842Z [cluster2]                         "f:storedVersions": {}
2021-07-18T14:15:00.8019295Z [cluster2]                     }
2021-07-18T14:15:00.8019830Z [cluster2]                 },
2021-07-18T14:15:00.8020584Z [cluster2]                 "manager": "submariner-operator",
2021-07-18T14:15:00.8021311Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:00.8021967Z [cluster2]                 "time": "2021-07-18T14:14:01Z"
2021-07-18T14:15:00.8022560Z [cluster2]             }
2021-07-18T14:15:00.8022913Z [cluster2]         ],
2021-07-18T14:15:00.8023446Z [cluster2]         "name": "clusters.submariner.io",
2021-07-18T14:15:00.8024055Z [cluster2]         "resourceVersion": "1585",
2021-07-18T14:15:00.8024870Z [cluster2]         "uid": "395866b0-b7d0-426d-bcfd-5951cfafbad1"
2021-07-18T14:15:00.8025401Z [cluster2]     },
2021-07-18T14:15:00.8025914Z [cluster2]     "spec": {
2021-07-18T14:15:00.8026329Z [cluster2]         "conversion": {
2021-07-18T14:15:00.8026769Z [cluster2]             "strategy": "None"
2021-07-18T14:15:00.8027174Z [cluster2]         },
2021-07-18T14:15:00.8027598Z [cluster2]         "group": "submariner.io",
2021-07-18T14:15:00.8028053Z [cluster2]         "names": {
2021-07-18T14:15:00.8028490Z [cluster2]             "kind": "Cluster",
2021-07-18T14:15:00.8028993Z [cluster2]             "listKind": "ClusterList",
2021-07-18T14:15:00.8029485Z [cluster2]             "plural": "clusters",
2021-07-18T14:15:00.8029966Z [cluster2]             "singular": "cluster"
2021-07-18T14:15:00.8030364Z [cluster2]         },
2021-07-18T14:15:00.8030794Z [cluster2]         "scope": "Namespaced",
2021-07-18T14:15:00.8031253Z [cluster2]         "versions": [
2021-07-18T14:15:00.8031739Z [cluster2]             {
2021-07-18T14:15:00.8032128Z [cluster2]                 "name": "v1",
2021-07-18T14:15:00.8032524Z [cluster2]                 "schema": {
2021-07-18T14:15:00.8033162Z [cluster2]                     "openAPIV3Schema": {
2021-07-18T14:15:00.8033674Z [cluster2]                         "properties": {
2021-07-18T14:15:00.8034157Z [cluster2]                             "apiVersion": {
2021-07-18T14:15:00.8036168Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:15:00.8037927Z [cluster2]                                 "type": "string"
2021-07-18T14:15:00.8038375Z [cluster2]                             },
2021-07-18T14:15:00.8038776Z [cluster2]                             "kind": {
2021-07-18T14:15:00.8040873Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:15:00.8042831Z [cluster2]                                 "type": "string"
2021-07-18T14:15:00.8043261Z [cluster2]                             },
2021-07-18T14:15:00.8043705Z [cluster2]                             "metadata": {
2021-07-18T14:15:00.8044172Z [cluster2]                                 "type": "object"
2021-07-18T14:15:00.8044612Z [cluster2]                             },
2021-07-18T14:15:00.8045027Z [cluster2]                             "spec": {
2021-07-18T14:15:00.8045641Z [cluster2]                                 "properties": {
2021-07-18T14:15:00.8046132Z [cluster2]                                     "cluster_cidr": {
2021-07-18T14:15:00.8046584Z [cluster2]                                         "items": {
2021-07-18T14:15:00.8047051Z [cluster2]                                             "type": "string"
2021-07-18T14:15:00.8047482Z [cluster2]                                         },
2021-07-18T14:15:00.8049665Z [cluster2]                                         "type": "array"
2021-07-18T14:15:00.8050127Z [cluster2]                                     },
2021-07-18T14:15:00.8050561Z [cluster2]                                     "cluster_id": {
2021-07-18T14:15:00.8051279Z [cluster2]                                         "type": "string"
2021-07-18T14:15:00.8051901Z [cluster2]                                     },
2021-07-18T14:15:00.8052601Z [cluster2]                                     "color_codes": {
2021-07-18T14:15:00.8053092Z [cluster2]                                         "items": {
2021-07-18T14:15:00.8053600Z [cluster2]                                             "type": "string"
2021-07-18T14:15:00.8054080Z [cluster2]                                         },
2021-07-18T14:15:00.8054571Z [cluster2]                                         "type": "array"
2021-07-18T14:15:00.8055049Z [cluster2]                                     },
2021-07-18T14:15:00.8055823Z [cluster2]                                     "global_cidr": {
2021-07-18T14:15:00.8056449Z [cluster2]                                         "items": {
2021-07-18T14:15:00.8056902Z [cluster2]                                             "type": "string"
2021-07-18T14:15:00.8057586Z [cluster2]                                         },
2021-07-18T14:15:00.8058206Z [cluster2]                                         "type": "array"
2021-07-18T14:15:00.8058857Z [cluster2]                                     },
2021-07-18T14:15:00.8059335Z [cluster2]                                     "service_cidr": {
2021-07-18T14:15:00.8059848Z [cluster2]                                         "items": {
2021-07-18T14:15:00.8060718Z [cluster2]                                             "type": "string"
2021-07-18T14:15:00.8061199Z [cluster2]                                         },
2021-07-18T14:15:00.8061835Z [cluster2]                                         "type": "array"
2021-07-18T14:15:00.8062444Z [cluster2]                                     }
2021-07-18T14:15:00.8062851Z [cluster2]                                 },
2021-07-18T14:15:00.8063431Z [cluster2]                                 "required": [
2021-07-18T14:15:00.8063900Z [cluster2]                                     "cluster_cidr",
2021-07-18T14:15:00.8064374Z [cluster2]                                     "cluster_id",
2021-07-18T14:15:00.8064827Z [cluster2]                                     "color_codes",
2021-07-18T14:15:00.8065291Z [cluster2]                                     "global_cidr",
2021-07-18T14:15:00.8065742Z [cluster2]                                     "service_cidr"
2021-07-18T14:15:00.8066172Z [cluster2]                                 ],
2021-07-18T14:15:00.8066689Z [cluster2]                                 "type": "object"
2021-07-18T14:15:00.8067140Z [cluster2]                             }
2021-07-18T14:15:00.8067869Z [cluster2]                         },
2021-07-18T14:15:00.8068316Z [cluster2]                         "required": [
2021-07-18T14:15:00.8069263Z [cluster2]                             "spec"
2021-07-18T14:15:00.8069714Z [cluster2]                         ],
2021-07-18T14:15:00.8070196Z [cluster2]                         "type": "object"
2021-07-18T14:15:00.8070654Z [cluster2]                     }
2021-07-18T14:15:00.8083390Z [cluster2]                 },
2021-07-18T14:15:00.8084060Z [cluster2]                 "served": true,
2021-07-18T14:15:00.8084740Z [cluster2]                 "storage": true
2021-07-18T14:15:00.8085500Z [cluster2]             }
2021-07-18T14:15:00.8085885Z [cluster2]         ]
2021-07-18T14:15:00.8086248Z [cluster2]     },
2021-07-18T14:15:00.8086646Z [cluster2]     "status": {
2021-07-18T14:15:00.8087264Z [cluster2]         "acceptedNames": {
2021-07-18T14:15:00.8088055Z [cluster2]             "kind": "Cluster",
2021-07-18T14:15:00.8088542Z [cluster2]             "listKind": "ClusterList",
2021-07-18T14:15:00.8089306Z [cluster2]             "plural": "clusters",
2021-07-18T14:15:00.8089808Z [cluster2]             "singular": "cluster"
2021-07-18T14:15:00.8090407Z [cluster2]         },
2021-07-18T14:15:00.8090831Z [cluster2]         "conditions": [
2021-07-18T14:15:00.8091372Z [cluster2]             {
2021-07-18T14:15:00.8092562Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:43Z",
2021-07-18T14:15:00.8093438Z [cluster2]                 "message": "no conflicts found",
2021-07-18T14:15:00.8094286Z [cluster2]                 "reason": "NoConflicts",
2021-07-18T14:15:00.8094785Z [cluster2]                 "status": "True",
2021-07-18T14:15:00.8095468Z [cluster2]                 "type": "NamesAccepted"
2021-07-18T14:15:01.7957227Z [cluster1]             },
2021-07-18T14:15:01.7957578Z [cluster1]             {
2021-07-18T14:15:01.7958669Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:31Z",
2021-07-18T14:15:01.7959274Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-18T14:15:01.7959904Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:01.7960427Z [cluster1]                 "status": "True",
2021-07-18T14:15:01.7960847Z [cluster1]                 "type": "Established"
2021-07-18T14:15:01.7961243Z [cluster1]             }
2021-07-18T14:15:01.7961556Z [cluster1]         ],
2021-07-18T14:15:01.7962072Z [cluster1]         "storedVersions": [
2021-07-18T14:15:01.7962458Z [cluster1]             "v1"
2021-07-18T14:15:01.7962786Z [cluster1]         ]
2021-07-18T14:15:01.7963090Z [cluster1]     }
2021-07-18T14:15:01.7963406Z [cluster1] }
2021-07-18T14:15:01.7964276Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:15:01.7965487Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:15:01.7966836Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:01.7968562Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:01.7969776Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:01.7971011Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:01.7972246Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:01.7973752Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:01.7976165Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:01.7978036Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-18T14:15:01.7979675Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-18T14:15:01.7981208Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:01.7982537Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:15:01.7983737Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:15:01.7985204Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-18T14:15:01.7987202Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-18T14:15:01.7988322Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-18T14:15:01.7989394Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:15:01.7990655Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:15:01.7991820Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:15:01.7993568Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:15:01.7995609Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-18T14:15:01.7996922Z [cluster1] NAME                        CREATED AT
2021-07-18T14:15:01.7997817Z [cluster1] submariners.submariner.io   2021-07-18T14:13:21Z
2021-07-18T14:15:01.7999505Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:01.8001745Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:15:01.8003211Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:01.8004496Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:15:01.8005756Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-18T14:15:01.8006482Z [cluster1] {
2021-07-18T14:15:01.8006969Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:01.8023857Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-18T14:15:01.8024564Z [cluster1]     "metadata": {
2021-07-18T14:15:01.8024956Z [cluster1]         "annotations": {
2021-07-18T14:15:01.8025900Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:15:01.8026482Z [cluster1]         },
2021-07-18T14:15:01.8027076Z [cluster1]         "creationTimestamp": "2021-07-18T14:13:21Z",
2021-07-18T14:15:01.8027569Z [cluster1]         "generation": 1,
2021-07-18T14:15:01.8027988Z [cluster1]         "managedFields": [
2021-07-18T14:15:01.8028379Z [cluster1]             {
2021-07-18T14:15:01.8028873Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:01.8029456Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:01.8029888Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:01.8030295Z [cluster1]                     "f:metadata": {
2021-07-18T14:15:01.8030867Z [cluster1]                         "f:annotations": {
2021-07-18T14:15:01.8031280Z [cluster1]                             ".": {},
2021-07-18T14:15:01.8032147Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:15:01.8032821Z [cluster1]                         }
2021-07-18T14:15:01.8033173Z [cluster1]                     },
2021-07-18T14:15:01.8033519Z [cluster1]                     "f:spec": {
2021-07-18T14:15:01.8033929Z [cluster1]                         "f:conversion": {
2021-07-18T14:15:01.8034314Z [cluster1]                             ".": {},
2021-07-18T14:15:01.8034705Z [cluster1]                             "f:strategy": {}
2021-07-18T14:15:01.8035071Z [cluster1]                         },
2021-07-18T14:15:01.8035600Z [cluster1]                         "f:group": {},
2021-07-18T14:15:01.8036002Z [cluster1]                         "f:names": {
2021-07-18T14:15:01.8036395Z [cluster1]                             "f:kind": {},
2021-07-18T14:15:01.8036802Z [cluster1]                             "f:listKind": {},
2021-07-18T14:15:01.8037202Z [cluster1]                             "f:plural": {},
2021-07-18T14:15:01.8037614Z [cluster1]                             "f:singular": {}
2021-07-18T14:15:01.8037984Z [cluster1]                         },
2021-07-18T14:15:01.8038356Z [cluster1]                         "f:scope": {},
2021-07-18T14:15:01.8038743Z [cluster1]                         "f:versions": {}
2021-07-18T14:15:01.8039215Z [cluster1]                     },
2021-07-18T14:15:01.8039563Z [cluster1]                     "f:status": {
2021-07-18T14:15:01.8040178Z [cluster1]                         "f:acceptedNames": {
2021-07-18T14:15:01.8040988Z [cluster1]                             "f:kind": {},
2021-07-18T14:15:01.8041412Z [cluster1]                             "f:plural": {}
2021-07-18T14:15:01.8041817Z [cluster1]                         },
2021-07-18T14:15:01.8042227Z [cluster1]                         "f:conditions": {},
2021-07-18T14:15:01.8042775Z [cluster1]                         "f:storedVersions": {}
2021-07-18T14:15:01.8043213Z [cluster1]                     }
2021-07-18T14:15:01.8043731Z [cluster1]                 },
2021-07-18T14:15:01.8044434Z [cluster1]                 "manager": "subctl",
2021-07-18T14:15:01.8045000Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:01.8045826Z [cluster1]                 "time": "2021-07-18T14:13:33Z"
2021-07-18T14:15:01.8046210Z [cluster1]             }
2021-07-18T14:15:01.8046544Z [cluster1]         ],
2021-07-18T14:15:01.8047046Z [cluster1]         "name": "submariners.submariner.io",
2021-07-18T14:15:01.8047828Z [cluster1]         "resourceVersion": "1528",
2021-07-18T14:15:01.8048581Z [cluster1]         "uid": "16543440-7d30-4764-bf92-3088d20fc0a2"
2021-07-18T14:15:01.8049163Z [cluster1]     },
2021-07-18T14:15:01.8049483Z [cluster1]     "spec": {
2021-07-18T14:15:01.8049863Z [cluster1]         "conversion": {
2021-07-18T14:15:01.8050260Z [cluster1]             "strategy": "None"
2021-07-18T14:15:01.8050629Z [cluster1]         },
2021-07-18T14:15:01.8051015Z [cluster1]         "group": "submariner.io",
2021-07-18T14:15:01.8051785Z [cluster1]         "names": {
2021-07-18T14:15:01.8052172Z [cluster1]             "kind": "Submariner",
2021-07-18T14:15:01.8052664Z [cluster1]             "listKind": "SubmarinerList",
2021-07-18T14:15:01.8053164Z [cluster1]             "plural": "submariners",
2021-07-18T14:15:01.8053622Z [cluster1]             "singular": "submariner"
2021-07-18T14:15:01.8054016Z [cluster1]         },
2021-07-18T14:15:01.8054389Z [cluster1]         "scope": "Namespaced",
2021-07-18T14:15:01.8054807Z [cluster1]         "versions": [
2021-07-18T14:15:01.8055149Z [cluster1]             {
2021-07-18T14:15:01.8055529Z [cluster1]                 "name": "v1alpha1",
2021-07-18T14:15:01.8055914Z [cluster1]                 "schema": {
2021-07-18T14:15:01.8056462Z [cluster1]                     "openAPIV3Schema": {
2021-07-18T14:15:01.8057077Z [cluster1]                         "description": "Submariner is the Schema for the submariners API",
2021-07-18T14:15:01.8057670Z [cluster1]                         "properties": {
2021-07-18T14:15:01.8058114Z [cluster1]                             "apiVersion": {
2021-07-18T14:15:01.8067638Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:15:01.8069629Z [cluster1]                                 "type": "string"
2021-07-18T14:15:01.8070164Z [cluster1]                             },
2021-07-18T14:15:01.8071036Z [cluster1]                             "kind": {
2021-07-18T14:15:01.8073091Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:15:01.8076038Z [cluster1]                                 "type": "string"
2021-07-18T14:15:01.8077319Z [cluster1]                             },
2021-07-18T14:15:01.8077933Z [cluster1]                             "metadata": {
2021-07-18T14:15:01.8079138Z [cluster1]                                 "type": "object"
2021-07-18T14:15:01.8080410Z [cluster1]                             },
2021-07-18T14:15:01.8081072Z [cluster1]                             "spec": {
2021-07-18T14:15:01.8081769Z [cluster1]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-18T14:15:01.8082653Z [cluster1]                                 "properties": {
2021-07-18T14:15:01.8083099Z [cluster1]                                     "broker": {
2021-07-18T14:15:01.8083710Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8084109Z [cluster1]                                     },
2021-07-18T14:15:01.8084781Z [cluster1]                                     "brokerK8sApiServer": {
2021-07-18T14:15:01.8085482Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8085909Z [cluster1]                                     },
2021-07-18T14:15:01.8086458Z [cluster1]                                     "brokerK8sApiServerToken": {
2021-07-18T14:15:01.8088612Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8089721Z [cluster1]                                     },
2021-07-18T14:15:01.8090457Z [cluster1]                                     "brokerK8sCA": {
2021-07-18T14:15:01.8091213Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8092109Z [cluster1]                                     },
2021-07-18T14:15:01.8092836Z [cluster1]                                     "brokerK8sRemoteNamespace": {
2021-07-18T14:15:01.8093579Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8094000Z [cluster1]                                     },
2021-07-18T14:15:01.8094437Z [cluster1]                                     "cableDriver": {
2021-07-18T14:15:01.8094886Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8095458Z [cluster1]                                     },
2021-07-18T14:15:01.8095874Z [cluster1]                                     "ceIPSecDebug": {
2021-07-18T14:15:01.8096380Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8096777Z [cluster1]                                     },
2021-07-18T14:15:01.8097748Z [cluster1]                                     "ceIPSecForceUDPEncaps": {
2021-07-18T14:15:01.8098307Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8098719Z [cluster1]                                     },
2021-07-18T14:15:01.8099186Z [cluster1]                                     "ceIPSecIKEPort": {
2021-07-18T14:15:01.8130496Z [cluster1]                                         "type": "integer"
2021-07-18T14:15:01.8130995Z [cluster1]                                     },
2021-07-18T14:15:01.8131434Z [cluster1]                                     "ceIPSecNATTPort": {
2021-07-18T14:15:01.8131932Z [cluster1]                                         "type": "integer"
2021-07-18T14:15:01.8132326Z [cluster1]                                     },
2021-07-18T14:15:01.8132739Z [cluster1]                                     "ceIPSecPSK": {
2021-07-18T14:15:01.8133318Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8133749Z [cluster1]                                     },
2021-07-18T14:15:01.8134271Z [cluster1]                                     "ceIPSecPreferredServer": {
2021-07-18T14:15:01.8134819Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8135224Z [cluster1]                                     },
2021-07-18T14:15:01.8135742Z [cluster1]                                     "clusterCIDR": {
2021-07-18T14:15:01.8136199Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8136586Z [cluster1]                                     },
2021-07-18T14:15:01.8136989Z [cluster1]                                     "clusterID": {
2021-07-18T14:15:01.8137429Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8137814Z [cluster1]                                     },
2021-07-18T14:15:01.8138224Z [cluster1]                                     "colorCodes": {
2021-07-18T14:15:01.8138661Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8139095Z [cluster1]                                     },
2021-07-18T14:15:01.8139576Z [cluster1]                                     "connectionHealthCheck": {
2021-07-18T14:15:01.8140126Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8140558Z [cluster1]                                             "enabled": {
2021-07-18T14:15:01.8141006Z [cluster1]                                                 "type": "boolean"
2021-07-18T14:15:01.8141584Z [cluster1]                                             },
2021-07-18T14:15:01.8142020Z [cluster1]                                             "intervalSeconds": {
2021-07-18T14:15:01.8142661Z [cluster1]                                                 "description": "The interval at which health check pings are sent.",
2021-07-18T14:15:01.8143246Z [cluster1]                                                 "format": "int64",
2021-07-18T14:15:01.8143709Z [cluster1]                                                 "type": "integer"
2021-07-18T14:15:01.8144113Z [cluster1]                                             },
2021-07-18T14:15:01.8144588Z [cluster1]                                             "maxPacketLossCount": {
2021-07-18T14:15:01.8145372Z [cluster1]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-18T14:15:01.8146080Z [cluster1]                                                 "format": "int64",
2021-07-18T14:15:01.8146541Z [cluster1]                                                 "type": "integer"
2021-07-18T14:15:01.8147134Z [cluster1]                                             }
2021-07-18T14:15:01.8147515Z [cluster1]                                         },
2021-07-18T14:15:01.8147931Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8148331Z [cluster1]                                     },
2021-07-18T14:15:01.8150747Z [cluster1]                                     "coreDNSCustomConfig": {
2021-07-18T14:15:01.8151531Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8152280Z [cluster1]                                             "configMapName": {
2021-07-18T14:15:01.8152802Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8153267Z [cluster1]                                             },
2021-07-18T14:15:01.8153745Z [cluster1]                                             "namespace": {
2021-07-18T14:15:01.8154237Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8155008Z [cluster1]                                             }
2021-07-18T14:15:01.8155388Z [cluster1]                                         },
2021-07-18T14:15:01.8155819Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8156821Z [cluster1]                                     },
2021-07-18T14:15:01.8157296Z [cluster1]                                     "customDomains": {
2021-07-18T14:15:01.8158281Z [cluster1]                                         "items": {
2021-07-18T14:15:01.8159247Z [cluster1]                                             "type": "string"
2021-07-18T14:15:01.8160240Z [cluster1]                                         },
2021-07-18T14:15:01.8160668Z [cluster1]                                         "type": "array",
2021-07-18T14:15:01.8161615Z [cluster1]                                         "x-kubernetes-list-type": "set"
2021-07-18T14:15:01.8162164Z [cluster1]                                     },
2021-07-18T14:15:01.8162580Z [cluster1]                                     "debug": {
2021-07-18T14:15:01.8163183Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8163660Z [cluster1]                                     },
2021-07-18T14:15:01.8164414Z [cluster1]                                     "globalCIDR": {
2021-07-18T14:15:01.8165400Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8165971Z [cluster1]                                     },
2021-07-18T14:15:01.8166599Z [cluster1]                                     "imageOverrides": {
2021-07-18T14:15:01.8167428Z [cluster1]                                         "additionalProperties": {
2021-07-18T14:15:01.8168580Z [cluster1]                                             "type": "string"
2021-07-18T14:15:01.8169184Z [cluster1]                                         },
2021-07-18T14:15:01.8169993Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8170409Z [cluster1]                                     },
2021-07-18T14:15:01.8170901Z [cluster1]                                     "loadBalancerEnabled": {
2021-07-18T14:15:01.8171417Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8171906Z [cluster1]                                     },
2021-07-18T14:15:01.8173668Z [cluster1]                                     "namespace": {
2021-07-18T14:15:01.8174142Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8176182Z [cluster1]                                     },
2021-07-18T14:15:01.8176710Z [cluster1]                                     "natEnabled": {
2021-07-18T14:15:01.8177259Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8177782Z [cluster1]                                     },
2021-07-18T14:15:01.8178295Z [cluster1]                                     "repository": {
2021-07-18T14:15:01.8179204Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8179621Z [cluster1]                                     },
2021-07-18T14:15:01.8180401Z [cluster1]                                     "serviceCIDR": {
2021-07-18T14:15:01.8181211Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8181659Z [cluster1]                                     },
2021-07-18T14:15:01.8182236Z [cluster1]                                     "serviceDiscoveryEnabled": {
2021-07-18T14:15:01.8182836Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8183281Z [cluster1]                                     },
2021-07-18T14:15:01.8184019Z [cluster1]                                     "version": {
2021-07-18T14:15:01.8184441Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8184860Z [cluster1]                                     }
2021-07-18T14:15:01.8191922Z [cluster1]                                 },
2021-07-18T14:15:01.8192771Z [cluster1]                                 "required": [
2021-07-18T14:15:01.8193219Z [cluster1]                                     "broker",
2021-07-18T14:15:01.8193742Z [cluster1]                                     "brokerK8sApiServer",
2021-07-18T14:15:01.8194544Z [cluster1]                                     "brokerK8sApiServerToken",
2021-07-18T14:15:01.8195175Z [cluster1]                                     "brokerK8sCA",
2021-07-18T14:15:01.8196173Z [cluster1]                                     "brokerK8sRemoteNamespace",
2021-07-18T14:15:01.8196980Z [cluster1]                                     "ceIPSecDebug",
2021-07-18T14:15:01.8197483Z [cluster1]                                     "ceIPSecPSK",
2021-07-18T14:15:01.8197954Z [cluster1]                                     "clusterCIDR",
2021-07-18T14:15:01.8198518Z [cluster1]                                     "clusterID",
2021-07-18T14:15:01.8198988Z [cluster1]                                     "debug",
2021-07-18T14:15:01.8199434Z [cluster1]                                     "namespace",
2021-07-18T14:15:01.8200100Z [cluster1]                                     "natEnabled",
2021-07-18T14:15:01.8200568Z [cluster1]                                     "serviceCIDR"
2021-07-18T14:15:01.8201001Z [cluster1]                                 ],
2021-07-18T14:15:01.8201422Z [cluster1]                                 "type": "object"
2021-07-18T14:15:01.8201834Z [cluster1]                             },
2021-07-18T14:15:01.8202214Z [cluster1]                             "status": {
2021-07-18T14:15:01.8203275Z [cluster1]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-18T14:15:01.8203975Z [cluster1]                                 "properties": {
2021-07-18T14:15:01.8204606Z [cluster1]                                     "clusterCIDR": {
2021-07-18T14:15:01.8205086Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8205644Z [cluster1]                                     },
2021-07-18T14:15:01.8206063Z [cluster1]                                     "clusterID": {
2021-07-18T14:15:01.8206496Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8206915Z [cluster1]                                     },
2021-07-18T14:15:01.8207472Z [cluster1]                                     "colorCodes": {
2021-07-18T14:15:01.8208335Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8209540Z [cluster1]                                     },
2021-07-18T14:15:01.8210355Z [cluster1]                                     "deploymentInfo": {
2021-07-18T14:15:01.8211044Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8211511Z [cluster1]                                             "cloudProvider": {
2021-07-18T14:15:01.8212000Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8212398Z [cluster1]                                             },
2021-07-18T14:15:01.8212846Z [cluster1]                                             "kubernetesType": {
2021-07-18T14:15:01.8213314Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8213730Z [cluster1]                                             },
2021-07-18T14:15:01.8214418Z [cluster1]                                             "kubernetesTypeVersion": {
2021-07-18T14:15:01.8215120Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8215718Z [cluster1]                                             },
2021-07-18T14:15:01.8217175Z [cluster1]                                             "kubernetesVersion": {
2021-07-18T14:15:01.8217811Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8218313Z [cluster1]                                             }
2021-07-18T14:15:01.8218777Z [cluster1]                                         },
2021-07-18T14:15:01.8219946Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8220450Z [cluster1]                                     },
2021-07-18T14:15:01.8221630Z [cluster1]                                     "gatewayDaemonSetStatus": {
2021-07-18T14:15:01.8223241Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8223834Z [cluster1]                                             "lastResourceVersion": {
2021-07-18T14:15:01.8224379Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8224815Z [cluster1]                                             },
2021-07-18T14:15:01.8225381Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-18T14:15:01.8226011Z [cluster1]                                                 "type": "boolean"
2021-07-18T14:15:01.8226615Z [cluster1]                                             },
2021-07-18T14:15:01.8227292Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-18T14:15:01.8227844Z [cluster1]                                                 "items": {
2021-07-18T14:15:01.8228832Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:01.8229859Z [cluster1]                                                     "properties": {
2021-07-18T14:15:01.8230317Z [cluster1]                                                         "running": {
2021-07-18T14:15:01.8232946Z [cluster1]                                                             "description": "Details about a running container",
2021-07-18T14:15:01.8234431Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8235282Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8236307Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:01.8237314Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8237813Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8238265Z [cluster1]                                                                 }
2021-07-18T14:15:01.8238679Z [cluster1]                                                             },
2021-07-18T14:15:01.8239110Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8239554Z [cluster1]                                                         },
2021-07-18T14:15:01.8239991Z [cluster1]                                                         "terminated": {
2021-07-18T14:15:01.8240607Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:01.8241213Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8241722Z [cluster1]                                                                 "containerID": {
2021-07-18T14:15:01.8242661Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:01.8243321Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8256616Z [cluster1]                                                                 },
2021-07-18T14:15:01.8257284Z [cluster1]                                                                 "exitCode": {
2021-07-18T14:15:01.8258959Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:01.8259783Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8260582Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8261524Z [cluster1]                                                                 },
2021-07-18T14:15:01.8262278Z [cluster1]                                                                 "finishedAt": {
2021-07-18T14:15:01.8262900Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:01.8265002Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8265521Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8265968Z [cluster1]                                                                 },
2021-07-18T14:15:01.8266734Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8268399Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:01.8269880Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8270327Z [cluster1]                                                                 },
2021-07-18T14:15:01.8270778Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8271430Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:01.8272722Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8273182Z [cluster1]                                                                 },
2021-07-18T14:15:01.8273606Z [cluster1]                                                                 "signal": {
2021-07-18T14:15:01.8274255Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:01.8276712Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8277398Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8278374Z [cluster1]                                                                 },
2021-07-18T14:15:01.8278941Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8279934Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:01.8281861Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8282661Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8283215Z [cluster1]                                                                 }
2021-07-18T14:15:01.8283697Z [cluster1]                                                             },
2021-07-18T14:15:01.8284229Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8284791Z [cluster1]                                                                 "exitCode"
2021-07-18T14:15:01.8285323Z [cluster1]                                                             ],
2021-07-18T14:15:01.8286116Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8286583Z [cluster1]                                                         },
2021-07-18T14:15:01.8287035Z [cluster1]                                                         "waiting": {
2021-07-18T14:15:01.8287907Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:01.8293788Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8294347Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8295045Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:01.8295884Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8296349Z [cluster1]                                                                 },
2021-07-18T14:15:01.8296793Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8297412Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:01.8298374Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8298826Z [cluster1]                                                                 }
2021-07-18T14:15:01.8299246Z [cluster1]                                                             },
2021-07-18T14:15:01.8299704Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8300193Z [cluster1]                                                         }
2021-07-18T14:15:01.8300603Z [cluster1]                                                     },
2021-07-18T14:15:01.8301153Z [cluster1]                                                     "type": "object"
2021-07-18T14:15:01.8301599Z [cluster1]                                                 },
2021-07-18T14:15:01.8302020Z [cluster1]                                                 "type": "array"
2021-07-18T14:15:01.8302449Z [cluster1]                                             },
2021-07-18T14:15:01.8302868Z [cluster1]                                             "status": {
2021-07-18T14:15:01.8303782Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:01.8308431Z [cluster1]                                                 "properties": {
2021-07-18T14:15:01.8317827Z [cluster1]                                                     "collisionCount": {
2021-07-18T14:15:01.8319322Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:01.8320717Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8321191Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8321635Z [cluster1]                                                     },
2021-07-18T14:15:01.8322254Z [cluster1]                                                     "conditions": {
2021-07-18T14:15:01.8323398Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:01.8324327Z [cluster1]                                                         "items": {
2021-07-18T14:15:01.8325242Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:01.8326194Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8326737Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-18T14:15:01.8327491Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:01.8329188Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8329884Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8330335Z [cluster1]                                                                 },
2021-07-18T14:15:01.8330759Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8331654Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:01.8332380Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8333155Z [cluster1]                                                                 },
2021-07-18T14:15:01.8381798Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8382739Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:01.8383654Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8384090Z [cluster1]                                                                 },
2021-07-18T14:15:01.8384494Z [cluster1]                                                                 "status": {
2021-07-18T14:15:01.8385278Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:01.8385891Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8386327Z [cluster1]                                                                 },
2021-07-18T14:15:01.8386908Z [cluster1]                                                                 "type": {
2021-07-18T14:15:01.8387441Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:01.8388183Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8388603Z [cluster1]                                                                 }
2021-07-18T14:15:01.8388995Z [cluster1]                                                             },
2021-07-18T14:15:01.8389412Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8389861Z [cluster1]                                                                 "status",
2021-07-18T14:15:01.8390294Z [cluster1]                                                                 "type"
2021-07-18T14:15:01.8390686Z [cluster1]                                                             ],
2021-07-18T14:15:01.8391121Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8391531Z [cluster1]                                                         },
2021-07-18T14:15:01.8392120Z [cluster1]                                                         "type": "array"
2021-07-18T14:15:01.8392511Z [cluster1]                                                     },
2021-07-18T14:15:01.8393027Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-18T14:15:01.8394245Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8395232Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8395687Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8396210Z [cluster1]                                                     },
2021-07-18T14:15:01.8396727Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:01.8397881Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8398963Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8399412Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8399834Z [cluster1]                                                     },
2021-07-18T14:15:01.8400266Z [cluster1]                                                     "numberAvailable": {
2021-07-18T14:15:01.8401208Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8402103Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8402541Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8402959Z [cluster1]                                                     },
2021-07-18T14:15:01.8403537Z [cluster1]                                                     "numberMisscheduled": {
2021-07-18T14:15:01.8404779Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8405759Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8406202Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8406622Z [cluster1]                                                     },
2021-07-18T14:15:01.8407028Z [cluster1]                                                     "numberReady": {
2021-07-18T14:15:01.8407896Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:01.8408637Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8409072Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8409489Z [cluster1]                                                     },
2021-07-18T14:15:01.8409938Z [cluster1]                                                     "numberUnavailable": {
2021-07-18T14:15:01.8410880Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8411763Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8412199Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8412618Z [cluster1]                                                     },
2021-07-18T14:15:01.8413079Z [cluster1]                                                     "observedGeneration": {
2021-07-18T14:15:01.8414330Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:01.8415189Z [cluster1]                                                         "format": "int64",
2021-07-18T14:15:01.8415781Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8416251Z [cluster1]                                                     },
2021-07-18T14:15:01.8416793Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:01.8418057Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:01.8418648Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8419102Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8419523Z [cluster1]                                                     }
2021-07-18T14:15:01.8419879Z [cluster1]                                                 },
2021-07-18T14:15:01.8420371Z [cluster1]                                                 "required": [
2021-07-18T14:15:01.8420960Z [cluster1]                                                     "currentNumberScheduled",
2021-07-18T14:15:01.8421615Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-18T14:15:01.8422208Z [cluster1]                                                     "numberMisscheduled",
2021-07-18T14:15:01.8422723Z [cluster1]                                                     "numberReady"
2021-07-18T14:15:01.8423140Z [cluster1]                                                 ],
2021-07-18T14:15:01.8423712Z [cluster1]                                                 "type": "object"
2021-07-18T14:15:01.8424225Z [cluster1]                                             }
2021-07-18T14:15:01.8424580Z [cluster1]                                         },
2021-07-18T14:15:01.8424988Z [cluster1]                                         "required": [
2021-07-18T14:15:01.8425551Z [cluster1]                                             "mismatchedContainerImages"
2021-07-18T14:15:01.8426478Z [cluster1]                                         ],
2021-07-18T14:15:01.8427059Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8427473Z [cluster1]                                     },
2021-07-18T14:15:01.8427881Z [cluster1]                                     "gateways": {
2021-07-18T14:15:01.8428294Z [cluster1]                                         "items": {
2021-07-18T14:15:01.8428743Z [cluster1]                                             "properties": {
2021-07-18T14:15:01.8429545Z [cluster1]                                                 "connections": {
2021-07-18T14:15:01.8429981Z [cluster1]                                                     "items": {
2021-07-18T14:15:01.8430404Z [cluster1]                                                         "properties": {
2021-07-18T14:15:01.8430863Z [cluster1]                                                             "endpoint": {
2021-07-18T14:15:01.8431325Z [cluster1]                                                                 "properties": {
2021-07-18T14:15:01.8431774Z [cluster1]                                                                     "backend": {
2021-07-18T14:15:01.8432230Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8432644Z [cluster1]                                                                     },
2021-07-18T14:15:01.8433077Z [cluster1]                                                                     "backend_config": {
2021-07-18T14:15:01.8433615Z [cluster1]                                                                         "additionalProperties": {
2021-07-18T14:15:01.8434171Z [cluster1]                                                                             "type": "string"
2021-07-18T14:15:01.8434600Z [cluster1]                                                                         },
2021-07-18T14:15:01.8435018Z [cluster1]                                                                         "type": "object"
2021-07-18T14:15:01.8435508Z [cluster1]                                                                     },
2021-07-18T14:15:01.8435927Z [cluster1]                                                                     "cable_name": {
2021-07-18T14:15:01.8436377Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8436800Z [cluster1]                                                                     },
2021-07-18T14:15:01.8437206Z [cluster1]                                                                     "cluster_id": {
2021-07-18T14:15:01.8437667Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8438078Z [cluster1]                                                                     },
2021-07-18T14:15:01.8438530Z [cluster1]                                                                     "healthCheckIP": {
2021-07-18T14:15:01.8439013Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8439440Z [cluster1]                                                                     },
2021-07-18T14:15:01.8439857Z [cluster1]                                                                     "hostname": {
2021-07-18T14:15:01.8440299Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8440725Z [cluster1]                                                                     },
2021-07-18T14:15:01.8441209Z [cluster1]                                                                     "nat_enabled": {
2021-07-18T14:15:01.8441673Z [cluster1]                                                                         "type": "boolean"
2021-07-18T14:15:01.8442106Z [cluster1]                                                                     },
2021-07-18T14:15:01.8442515Z [cluster1]                                                                     "private_ip": {
2021-07-18T14:15:01.8442986Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8443397Z [cluster1]                                                                     },
2021-07-18T14:15:01.8443814Z [cluster1]                                                                     "public_ip": {
2021-07-18T14:15:01.8444429Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8444867Z [cluster1]                                                                     },
2021-07-18T14:15:01.8445298Z [cluster1]                                                                     "subnets": {
2021-07-18T14:15:01.8445726Z [cluster1]                                                                         "items": {
2021-07-18T14:15:01.8446361Z [cluster1]                                                                             "type": "string"
2021-07-18T14:15:01.8466822Z [cluster1]                                                                         },
2021-07-18T14:15:01.8467464Z [cluster1]                                                                         "type": "array"
2021-07-18T14:15:01.8468134Z [cluster1]                                                                     }
2021-07-18T14:15:01.8468556Z [cluster1]                                                                 },
2021-07-18T14:15:01.8469100Z [cluster1]                                                                 "required": [
2021-07-18T14:15:01.8469600Z [cluster1]                                                                     "backend",
2021-07-18T14:15:01.8470470Z [cluster1]                                                                     "cable_name",
2021-07-18T14:15:01.8470932Z [cluster1]                                                                     "cluster_id",
2021-07-18T14:15:01.8471403Z [cluster1]                                                                     "hostname",
2021-07-18T14:15:01.8472023Z [cluster1]                                                                     "nat_enabled",
2021-07-18T14:15:01.8472517Z [cluster1]                                                                     "private_ip",
2021-07-18T14:15:01.8472999Z [cluster1]                                                                     "public_ip",
2021-07-18T14:15:01.8473451Z [cluster1]                                                                     "subnets"
2021-07-18T14:15:01.8473889Z [cluster1]                                                                 ],
2021-07-18T14:15:01.8474326Z [cluster1]                                                                 "type": "object"
2021-07-18T14:15:01.8474766Z [cluster1]                                                             },
2021-07-18T14:15:01.8475220Z [cluster1]                                                             "latencyRTT": {
2021-07-18T14:15:01.8476054Z [cluster1]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-18T14:15:01.8477850Z [cluster1]                                                                 "properties": {
2021-07-18T14:15:01.8479334Z [cluster1]                                                                     "average": {
2021-07-18T14:15:01.8479936Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8480488Z [cluster1]                                                                     },
2021-07-18T14:15:01.8481192Z [cluster1]                                                                     "last": {
2021-07-18T14:15:01.8481766Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8482641Z [cluster1]                                                                     },
2021-07-18T14:15:01.8483404Z [cluster1]                                                                     "max": {
2021-07-18T14:15:01.8483854Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8484484Z [cluster1]                                                                     },
2021-07-18T14:15:01.8484919Z [cluster1]                                                                     "min": {
2021-07-18T14:15:01.8485379Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8485852Z [cluster1]                                                                     },
2021-07-18T14:15:01.8486285Z [cluster1]                                                                     "stdDev": {
2021-07-18T14:15:01.8486771Z [cluster1]                                                                         "type": "string"
2021-07-18T14:15:01.8487239Z [cluster1]                                                                     }
2021-07-18T14:15:01.8488428Z [cluster1]                                                                 },
2021-07-18T14:15:01.8488909Z [cluster1]                                                                 "type": "object"
2021-07-18T14:15:01.8489337Z [cluster1]                                                             },
2021-07-18T14:15:01.8489764Z [cluster1]                                                             "status": {
2021-07-18T14:15:01.8490215Z [cluster1]                                                                 "type": "string"
2021-07-18T14:15:01.8490663Z [cluster1]                                                             },
2021-07-18T14:15:01.8491128Z [cluster1]                                                             "statusMessage": {
2021-07-18T14:15:01.8491623Z [cluster1]                                                                 "type": "string"
2021-07-18T14:15:01.8492173Z [cluster1]                                                             },
2021-07-18T14:15:01.8492711Z [cluster1]                                                             "usingIP": {
2021-07-18T14:15:01.8493204Z [cluster1]                                                                 "type": "string"
2021-07-18T14:15:01.8493631Z [cluster1]                                                             },
2021-07-18T14:15:01.8494071Z [cluster1]                                                             "usingNAT": {
2021-07-18T14:15:01.8494552Z [cluster1]                                                                 "type": "boolean"
2021-07-18T14:15:01.8494992Z [cluster1]                                                             }
2021-07-18T14:15:01.8495397Z [cluster1]                                                         },
2021-07-18T14:15:01.8495818Z [cluster1]                                                         "required": [
2021-07-18T14:15:01.8496287Z [cluster1]                                                             "endpoint",
2021-07-18T14:15:01.8496737Z [cluster1]                                                             "status",
2021-07-18T14:15:01.8497226Z [cluster1]                                                             "statusMessage"
2021-07-18T14:15:01.8497989Z [cluster1]                                                         ],
2021-07-18T14:15:01.8498428Z [cluster1]                                                         "type": "object"
2021-07-18T14:15:01.8498876Z [cluster1]                                                     },
2021-07-18T14:15:01.8499305Z [cluster1]                                                     "type": "array"
2021-07-18T14:15:01.8499955Z [cluster1]                                                 },
2021-07-18T14:15:01.8500377Z [cluster1]                                                 "haStatus": {
2021-07-18T14:15:01.8500850Z [cluster1]                                                     "type": "string"
2021-07-18T14:15:01.8501286Z [cluster1]                                                 },
2021-07-18T14:15:01.8501743Z [cluster1]                                                 "localEndpoint": {
2021-07-18T14:15:01.8502607Z [cluster1]                                                     "properties": {
2021-07-18T14:15:01.8503076Z [cluster1]                                                         "backend": {
2021-07-18T14:15:01.8503551Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8503986Z [cluster1]                                                         },
2021-07-18T14:15:01.8504443Z [cluster1]                                                         "backend_config": {
2021-07-18T14:15:01.8505666Z [cluster1]                                                             "additionalProperties": {
2021-07-18T14:15:01.8506402Z [cluster1]                                                                 "type": "string"
2021-07-18T14:15:01.8506858Z [cluster1]                                                             },
2021-07-18T14:15:01.8507663Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8508313Z [cluster1]                                                         },
2021-07-18T14:15:01.8509112Z [cluster1]                                                         "cable_name": {
2021-07-18T14:15:01.8510760Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8511377Z [cluster1]                                                         },
2021-07-18T14:15:01.8511954Z [cluster1]                                                         "cluster_id": {
2021-07-18T14:15:01.8513585Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8514176Z [cluster1]                                                         },
2021-07-18T14:15:01.8514623Z [cluster1]                                                         "healthCheckIP": {
2021-07-18T14:15:01.8515085Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8515629Z [cluster1]                                                         },
2021-07-18T14:15:01.8516065Z [cluster1]                                                         "hostname": {
2021-07-18T14:15:01.8516490Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8516905Z [cluster1]                                                         },
2021-07-18T14:15:01.8517305Z [cluster1]                                                         "nat_enabled": {
2021-07-18T14:15:01.8517770Z [cluster1]                                                             "type": "boolean"
2021-07-18T14:15:01.8518171Z [cluster1]                                                         },
2021-07-18T14:15:01.8518588Z [cluster1]                                                         "private_ip": {
2021-07-18T14:15:01.8520509Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8520952Z [cluster1]                                                         },
2021-07-18T14:15:01.8521358Z [cluster1]                                                         "public_ip": {
2021-07-18T14:15:01.8521787Z [cluster1]                                                             "type": "string"
2021-07-18T14:15:01.8522196Z [cluster1]                                                         },
2021-07-18T14:15:01.8522584Z [cluster1]                                                         "subnets": {
2021-07-18T14:15:01.8523140Z [cluster1]                                                             "items": {
2021-07-18T14:15:01.8523581Z [cluster1]                                                                 "type": "string"
2021-07-18T14:15:01.8523987Z [cluster1]                                                             },
2021-07-18T14:15:01.8524401Z [cluster1]                                                             "type": "array"
2021-07-18T14:15:01.8524800Z [cluster1]                                                         }
2021-07-18T14:15:01.8525174Z [cluster1]                                                     },
2021-07-18T14:15:01.8525567Z [cluster1]                                                     "required": [
2021-07-18T14:15:01.8526004Z [cluster1]                                                         "backend",
2021-07-18T14:15:01.8526437Z [cluster1]                                                         "cable_name",
2021-07-18T14:15:01.8526855Z [cluster1]                                                         "cluster_id",
2021-07-18T14:15:01.8528050Z [cluster1]                                                         "hostname",
2021-07-18T14:15:01.8528790Z [cluster1]                                                         "nat_enabled",
2021-07-18T14:15:01.8529691Z [cluster1]                                                         "private_ip",
2021-07-18T14:15:01.8531599Z [cluster1]                                                         "public_ip",
2021-07-18T14:15:01.8532914Z [cluster1]                                                         "subnets"
2021-07-18T14:15:01.8533671Z [cluster1]                                                     ],
2021-07-18T14:15:01.8534605Z [cluster1]                                                     "type": "object"
2021-07-18T14:15:01.8535486Z [cluster1]                                                 },
2021-07-18T14:15:01.8536355Z [cluster1]                                                 "statusFailure": {
2021-07-18T14:15:01.8537533Z [cluster1]                                                     "type": "string"
2021-07-18T14:15:01.8538191Z [cluster1]                                                 },
2021-07-18T14:15:01.8538725Z [cluster1]                                                 "version": {
2021-07-18T14:15:01.8539299Z [cluster1]                                                     "type": "string"
2021-07-18T14:15:01.8539808Z [cluster1]                                                 }
2021-07-18T14:15:01.8540311Z [cluster1]                                             },
2021-07-18T14:15:01.8540884Z [cluster1]                                             "required": [
2021-07-18T14:15:01.8541460Z [cluster1]                                                 "connections",
2021-07-18T14:15:01.8541899Z [cluster1]                                                 "haStatus",
2021-07-18T14:15:01.8542489Z [cluster1]                                                 "localEndpoint",
2021-07-18T14:15:01.8543101Z [cluster1]                                                 "statusFailure",
2021-07-18T14:15:01.8543658Z [cluster1]                                                 "version"
2021-07-18T14:15:01.8544067Z [cluster1]                                             ],
2021-07-18T14:15:01.8544581Z [cluster1]                                             "type": "object"
2021-07-18T14:15:01.8544976Z [cluster1]                                         },
2021-07-18T14:15:01.8545482Z [cluster1]                                         "type": "array"
2021-07-18T14:15:01.8545996Z [cluster1]                                     },
2021-07-18T14:15:01.8546395Z [cluster1]                                     "globalCIDR": {
2021-07-18T14:15:01.8546959Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8547349Z [cluster1]                                     },
2021-07-18T14:15:01.8547979Z [cluster1]                                     "globalnetDaemonSetStatus": {
2021-07-18T14:15:01.8548682Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8549304Z [cluster1]                                             "lastResourceVersion": {
2021-07-18T14:15:01.8549809Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8550197Z [cluster1]                                             },
2021-07-18T14:15:01.8550729Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-18T14:15:01.8551312Z [cluster1]                                                 "type": "boolean"
2021-07-18T14:15:01.8552128Z [cluster1]                                             },
2021-07-18T14:15:01.8552659Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-18T14:15:01.8553191Z [cluster1]                                                 "items": {
2021-07-18T14:15:01.8554190Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:01.8555373Z [cluster1]                                                     "properties": {
2021-07-18T14:15:01.8555817Z [cluster1]                                                         "running": {
2021-07-18T14:15:01.8556363Z [cluster1]                                                             "description": "Details about a running container",
2021-07-18T14:15:01.8557111Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8557592Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8558547Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:01.8559369Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8559875Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8560470Z [cluster1]                                                                 }
2021-07-18T14:15:01.8560855Z [cluster1]                                                             },
2021-07-18T14:15:01.8561260Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8561783Z [cluster1]                                                         },
2021-07-18T14:15:01.8562207Z [cluster1]                                                         "terminated": {
2021-07-18T14:15:01.8562794Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:01.8563380Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8563843Z [cluster1]                                                                 "containerID": {
2021-07-18T14:15:01.8564750Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:01.8565367Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8565794Z [cluster1]                                                                 },
2021-07-18T14:15:01.8566221Z [cluster1]                                                                 "exitCode": {
2021-07-18T14:15:01.8566827Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:01.8567444Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8568038Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8568469Z [cluster1]                                                                 },
2021-07-18T14:15:01.8569027Z [cluster1]                                                                 "finishedAt": {
2021-07-18T14:15:01.8569795Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:01.8571522Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8572264Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8572774Z [cluster1]                                                                 },
2021-07-18T14:15:01.8573240Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8574280Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:01.8575095Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8575511Z [cluster1]                                                                 },
2021-07-18T14:15:01.8575932Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8576552Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:01.8577190Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8577919Z [cluster1]                                                                 },
2021-07-18T14:15:01.8578335Z [cluster1]                                                                 "signal": {
2021-07-18T14:15:01.8580480Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:01.8581499Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8582104Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8582880Z [cluster1]                                                                 },
2021-07-18T14:15:01.8583342Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8584361Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:01.8585729Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8586425Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8586861Z [cluster1]                                                                 }
2021-07-18T14:15:01.8587247Z [cluster1]                                                             },
2021-07-18T14:15:01.8587673Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8588118Z [cluster1]                                                                 "exitCode"
2021-07-18T14:15:01.8588832Z [cluster1]                                                             ],
2021-07-18T14:15:01.8589424Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8589839Z [cluster1]                                                         },
2021-07-18T14:15:01.8590242Z [cluster1]                                                         "waiting": {
2021-07-18T14:15:01.8590778Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:01.8591351Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8592096Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8593047Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:01.8593676Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8594120Z [cluster1]                                                                 },
2021-07-18T14:15:01.8594537Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8595121Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:01.8595932Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8596530Z [cluster1]                                                                 }
2021-07-18T14:15:01.8596920Z [cluster1]                                                             },
2021-07-18T14:15:01.8597342Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8597744Z [cluster1]                                                         }
2021-07-18T14:15:01.8598119Z [cluster1]                                                     },
2021-07-18T14:15:01.8598518Z [cluster1]                                                     "type": "object"
2021-07-18T14:15:01.8598928Z [cluster1]                                                 },
2021-07-18T14:15:01.8599313Z [cluster1]                                                 "type": "array"
2021-07-18T14:15:01.8599708Z [cluster1]                                             },
2021-07-18T14:15:01.8600094Z [cluster1]                                             "status": {
2021-07-18T14:15:01.8600716Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:01.8601384Z [cluster1]                                                 "properties": {
2021-07-18T14:15:01.8601849Z [cluster1]                                                     "collisionCount": {
2021-07-18T14:15:01.8602993Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:01.8604252Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8604690Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8605111Z [cluster1]                                                     },
2021-07-18T14:15:01.8605509Z [cluster1]                                                     "conditions": {
2021-07-18T14:15:01.8606517Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:01.8607186Z [cluster1]                                                         "items": {
2021-07-18T14:15:01.8608008Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:01.8608737Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8609248Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-18T14:15:01.8609954Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:01.8610810Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8611426Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8611849Z [cluster1]                                                                 },
2021-07-18T14:15:01.8612248Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8612911Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:01.8613561Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8613984Z [cluster1]                                                                 },
2021-07-18T14:15:01.8614389Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8615203Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:01.8615812Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8616219Z [cluster1]                                                                 },
2021-07-18T14:15:01.8616621Z [cluster1]                                                                 "status": {
2021-07-18T14:15:01.8617224Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:01.8617814Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8618422Z [cluster1]                                                                 },
2021-07-18T14:15:01.8619001Z [cluster1]                                                                 "type": {
2021-07-18T14:15:01.8619767Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:01.8620548Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8621212Z [cluster1]                                                                 }
2021-07-18T14:15:01.8621658Z [cluster1]                                                             },
2021-07-18T14:15:01.8622379Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8622884Z [cluster1]                                                                 "status",
2021-07-18T14:15:01.8623503Z [cluster1]                                                                 "type"
2021-07-18T14:15:01.8623939Z [cluster1]                                                             ],
2021-07-18T14:15:01.8624528Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8624976Z [cluster1]                                                         },
2021-07-18T14:15:01.8625570Z [cluster1]                                                         "type": "array"
2021-07-18T14:15:01.8625971Z [cluster1]                                                     },
2021-07-18T14:15:01.8626497Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-18T14:15:01.8627621Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8628826Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8629313Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8629740Z [cluster1]                                                     },
2021-07-18T14:15:01.8630368Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:01.8631577Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8632836Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8633305Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8633717Z [cluster1]                                                     },
2021-07-18T14:15:01.8634366Z [cluster1]                                                     "numberAvailable": {
2021-07-18T14:15:01.8635348Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8636302Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8636782Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8637373Z [cluster1]                                                     },
2021-07-18T14:15:01.8637850Z [cluster1]                                                     "numberMisscheduled": {
2021-07-18T14:15:01.8638887Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8639866Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8640320Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8640721Z [cluster1]                                                     },
2021-07-18T14:15:01.8641145Z [cluster1]                                                     "numberReady": {
2021-07-18T14:15:01.8641871Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:01.8642667Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8643139Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8643537Z [cluster1]                                                     },
2021-07-18T14:15:01.8643998Z [cluster1]                                                     "numberUnavailable": {
2021-07-18T14:15:01.8645386Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8646463Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8646911Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8647313Z [cluster1]                                                     },
2021-07-18T14:15:01.8647892Z [cluster1]                                                     "observedGeneration": {
2021-07-18T14:15:01.8648602Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:01.8649245Z [cluster1]                                                         "format": "int64",
2021-07-18T14:15:01.8649682Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8650251Z [cluster1]                                                     },
2021-07-18T14:15:01.8650765Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:01.8651652Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:01.8652459Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8652927Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8653359Z [cluster1]                                                     }
2021-07-18T14:15:01.8653750Z [cluster1]                                                 },
2021-07-18T14:15:01.8654158Z [cluster1]                                                 "required": [
2021-07-18T14:15:01.8654732Z [cluster1]                                                     "currentNumberScheduled",
2021-07-18T14:15:01.8655411Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-18T14:15:01.8656208Z [cluster1]                                                     "numberMisscheduled",
2021-07-18T14:15:01.8656723Z [cluster1]                                                     "numberReady"
2021-07-18T14:15:01.8657156Z [cluster1]                                                 ],
2021-07-18T14:15:01.8657561Z [cluster1]                                                 "type": "object"
2021-07-18T14:15:01.8657974Z [cluster1]                                             }
2021-07-18T14:15:01.8658347Z [cluster1]                                         },
2021-07-18T14:15:01.8658734Z [cluster1]                                         "required": [
2021-07-18T14:15:01.8659309Z [cluster1]                                             "mismatchedContainerImages"
2021-07-18T14:15:01.8659837Z [cluster1]                                         ],
2021-07-18T14:15:01.8660242Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8660632Z [cluster1]                                     },
2021-07-18T14:15:01.8661096Z [cluster1]                                     "loadBalancerStatus": {
2021-07-18T14:15:01.8661612Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8662035Z [cluster1]                                             "status": {
2021-07-18T14:15:01.8663125Z [cluster1]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-18T14:15:01.8663851Z [cluster1]                                                 "properties": {
2021-07-18T14:15:01.8664306Z [cluster1]                                                     "ingress": {
2021-07-18T14:15:01.8665616Z [cluster1]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-18T14:15:01.8666455Z [cluster1]                                                         "items": {
2021-07-18T14:15:01.8667810Z [cluster1]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-18T14:15:01.8668753Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8669234Z [cluster1]                                                                 "hostname": {
2021-07-18T14:15:01.8670265Z [cluster1]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-18T14:15:01.8671194Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8671719Z [cluster1]                                                                 },
2021-07-18T14:15:01.8672100Z [cluster1]                                                                 "ip": {
2021-07-18T14:15:01.8673132Z [cluster1]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-18T14:15:01.8674343Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8674776Z [cluster1]                                                                 }
2021-07-18T14:15:01.8675187Z [cluster1]                                                             },
2021-07-18T14:15:01.8675618Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8676060Z [cluster1]                                                         },
2021-07-18T14:15:01.8676478Z [cluster1]                                                         "type": "array"
2021-07-18T14:15:01.8676918Z [cluster1]                                                     }
2021-07-18T14:15:01.8677314Z [cluster1]                                                 },
2021-07-18T14:15:01.8677728Z [cluster1]                                                 "type": "object"
2021-07-18T14:15:01.8678154Z [cluster1]                                             }
2021-07-18T14:15:01.8678516Z [cluster1]                                         },
2021-07-18T14:15:01.8678938Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8680753Z [cluster1]                                     },
2021-07-18T14:15:01.8681285Z [cluster1]                                     "natEnabled": {
2021-07-18T14:15:01.8681839Z [cluster1]                                         "type": "boolean"
2021-07-18T14:15:01.8682351Z [cluster1]                                     },
2021-07-18T14:15:01.8682890Z [cluster1]                                     "networkPlugin": {
2021-07-18T14:15:01.8683804Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8684570Z [cluster1]                                     },
2021-07-18T14:15:01.8685485Z [cluster1]                                     "routeAgentDaemonSetStatus": {
2021-07-18T14:15:01.8686118Z [cluster1]                                         "properties": {
2021-07-18T14:15:01.8686670Z [cluster1]                                             "lastResourceVersion": {
2021-07-18T14:15:01.8691324Z [cluster1]                                                 "type": "string"
2021-07-18T14:15:01.8691824Z [cluster1]                                             },
2021-07-18T14:15:01.8692360Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-18T14:15:01.8693130Z [cluster1]                                                 "type": "boolean"
2021-07-18T14:15:01.8693546Z [cluster1]                                             },
2021-07-18T14:15:01.8694906Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-18T14:15:01.8695700Z [cluster1]                                                 "items": {
2021-07-18T14:15:01.8697092Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:01.8698499Z [cluster1]                                                     "properties": {
2021-07-18T14:15:01.8698957Z [cluster1]                                                         "running": {
2021-07-18T14:15:01.8699538Z [cluster1]                                                             "description": "Details about a running container",
2021-07-18T14:15:01.8700125Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8700783Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8702060Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:01.8703018Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8703518Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8703942Z [cluster1]                                                                 }
2021-07-18T14:15:01.8704337Z [cluster1]                                                             },
2021-07-18T14:15:01.8704755Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8705184Z [cluster1]                                                         },
2021-07-18T14:15:01.8705620Z [cluster1]                                                         "terminated": {
2021-07-18T14:15:01.8706388Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:01.8706978Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8707622Z [cluster1]                                                                 "containerID": {
2021-07-18T14:15:01.8708528Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:01.8709180Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8709602Z [cluster1]                                                                 },
2021-07-18T14:15:01.8710038Z [cluster1]                                                                 "exitCode": {
2021-07-18T14:15:01.8710830Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:01.8711446Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8711910Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8712325Z [cluster1]                                                                 },
2021-07-18T14:15:01.8712846Z [cluster1]                                                                 "finishedAt": {
2021-07-18T14:15:01.8713450Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:01.8714266Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8714735Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8715167Z [cluster1]                                                                 },
2021-07-18T14:15:01.8715583Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8716194Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:01.8716824Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8717408Z [cluster1]                                                                 },
2021-07-18T14:15:01.8717834Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8718461Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:01.8719084Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8719618Z [cluster1]                                                                 },
2021-07-18T14:15:01.8720021Z [cluster1]                                                                 "signal": {
2021-07-18T14:15:01.8720802Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:01.8721940Z [cluster1]                                                                     "format": "int32",
2021-07-18T14:15:01.8722593Z [cluster1]                                                                     "type": "integer"
2021-07-18T14:15:01.8723027Z [cluster1]                                                                 },
2021-07-18T14:15:01.8723438Z [cluster1]                                                                 "startedAt": {
2021-07-18T14:15:01.8724071Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:01.8724978Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8725466Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8726072Z [cluster1]                                                                 }
2021-07-18T14:15:01.8727403Z [cluster1]                                                             },
2021-07-18T14:15:01.8728415Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8728979Z [cluster1]                                                                 "exitCode"
2021-07-18T14:15:01.8729516Z [cluster1]                                                             ],
2021-07-18T14:15:01.8730184Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8731295Z [cluster1]                                                         },
2021-07-18T14:15:01.8731880Z [cluster1]                                                         "waiting": {
2021-07-18T14:15:01.8732431Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:01.8733014Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8733761Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8734401Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:01.8735219Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8735637Z [cluster1]                                                                 },
2021-07-18T14:15:01.8736053Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8736645Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:01.8737428Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8737871Z [cluster1]                                                                 }
2021-07-18T14:15:01.8738416Z [cluster1]                                                             },
2021-07-18T14:15:01.8738849Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8739262Z [cluster1]                                                         }
2021-07-18T14:15:01.8739649Z [cluster1]                                                     },
2021-07-18T14:15:01.8740057Z [cluster1]                                                     "type": "object"
2021-07-18T14:15:01.8740645Z [cluster1]                                                 },
2021-07-18T14:15:01.8741133Z [cluster1]                                                 "type": "array"
2021-07-18T14:15:01.8741514Z [cluster1]                                             },
2021-07-18T14:15:01.8741899Z [cluster1]                                             "status": {
2021-07-18T14:15:01.8742520Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:01.8743188Z [cluster1]                                                 "properties": {
2021-07-18T14:15:01.8743653Z [cluster1]                                                     "collisionCount": {
2021-07-18T14:15:01.8744701Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:01.8745900Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8746350Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8746777Z [cluster1]                                                     },
2021-07-18T14:15:01.8747185Z [cluster1]                                                     "conditions": {
2021-07-18T14:15:01.8748769Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:01.8749496Z [cluster1]                                                         "items": {
2021-07-18T14:15:01.8750366Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:01.8751085Z [cluster1]                                                             "properties": {
2021-07-18T14:15:01.8751599Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-18T14:15:01.8752307Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:01.8753216Z [cluster1]                                                                     "format": "date-time",
2021-07-18T14:15:01.8753980Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8754495Z [cluster1]                                                                 },
2021-07-18T14:15:01.8754943Z [cluster1]                                                                 "message": {
2021-07-18T14:15:01.8755704Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:01.8756461Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8757063Z [cluster1]                                                                 },
2021-07-18T14:15:01.8757822Z [cluster1]                                                                 "reason": {
2021-07-18T14:15:01.8758753Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:01.8759419Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8759923Z [cluster1]                                                                 },
2021-07-18T14:15:01.8760359Z [cluster1]                                                                 "status": {
2021-07-18T14:15:01.8761227Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:01.8762019Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8762460Z [cluster1]                                                                 },
2021-07-18T14:15:01.8762925Z [cluster1]                                                                 "type": {
2021-07-18T14:15:01.8763488Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:01.8764144Z [cluster1]                                                                     "type": "string"
2021-07-18T14:15:01.8764643Z [cluster1]                                                                 }
2021-07-18T14:15:01.8765051Z [cluster1]                                                             },
2021-07-18T14:15:01.8765531Z [cluster1]                                                             "required": [
2021-07-18T14:15:01.8765982Z [cluster1]                                                                 "status",
2021-07-18T14:15:01.8782789Z [cluster1]                                                                 "type"
2021-07-18T14:15:01.8783321Z [cluster1]                                                             ],
2021-07-18T14:15:01.8783871Z [cluster1]                                                             "type": "object"
2021-07-18T14:15:01.8784674Z [cluster1]                                                         },
2021-07-18T14:15:01.8785111Z [cluster1]                                                         "type": "array"
2021-07-18T14:15:01.8785514Z [cluster1]                                                     },
2021-07-18T14:15:01.8786217Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-18T14:15:01.8787326Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8788306Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8788955Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8789374Z [cluster1]                                                     },
2021-07-18T14:15:01.8789904Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:01.8791241Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8792678Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8793146Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8793612Z [cluster1]                                                     },
2021-07-18T14:15:01.8794078Z [cluster1]                                                     "numberAvailable": {
2021-07-18T14:15:01.8795045Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8796107Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8796565Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8796968Z [cluster1]                                                     },
2021-07-18T14:15:01.8797439Z [cluster1]                                                     "numberMisscheduled": {
2021-07-18T14:15:01.8798490Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:01.8799554Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8800007Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8800416Z [cluster1]                                                     },
2021-07-18T14:15:01.8800842Z [cluster1]                                                     "numberReady": {
2021-07-18T14:15:01.8801591Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:01.8802296Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8802744Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8803148Z [cluster1]                                                     },
2021-07-18T14:15:01.8803612Z [cluster1]                                                     "numberUnavailable": {
2021-07-18T14:15:01.8804551Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:01.8805417Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8805867Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8806266Z [cluster1]                                                     },
2021-07-18T14:15:01.8806741Z [cluster1]                                                     "observedGeneration": {
2021-07-18T14:15:01.8807459Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:01.8808234Z [cluster1]                                                         "format": "int64",
2021-07-18T14:15:01.8808693Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8809276Z [cluster1]                                                     },
2021-07-18T14:15:01.8809892Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:01.8811260Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:01.8811901Z [cluster1]                                                         "format": "int32",
2021-07-18T14:15:01.8812713Z [cluster1]                                                         "type": "integer"
2021-07-18T14:15:01.8813135Z [cluster1]                                                     }
2021-07-18T14:15:01.8813695Z [cluster1]                                                 },
2021-07-18T14:15:01.8814105Z [cluster1]                                                 "required": [
2021-07-18T14:15:01.8814681Z [cluster1]                                                     "currentNumberScheduled",
2021-07-18T14:15:01.8815354Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-18T14:15:01.8816211Z [cluster1]                                                     "numberMisscheduled",
2021-07-18T14:15:01.8816781Z [cluster1]                                                     "numberReady"
2021-07-18T14:15:01.8817228Z [cluster1]                                                 ],
2021-07-18T14:15:01.8817668Z [cluster1]                                                 "type": "object"
2021-07-18T14:15:01.8818091Z [cluster1]                                             }
2021-07-18T14:15:01.8818632Z [cluster1]                                         },
2021-07-18T14:15:01.8819042Z [cluster1]                                         "required": [
2021-07-18T14:15:01.8819809Z [cluster1]                                             "mismatchedContainerImages"
2021-07-18T14:15:01.8820553Z [cluster1]                                         ],
2021-07-18T14:15:01.8820965Z [cluster1]                                         "type": "object"
2021-07-18T14:15:01.8821583Z [cluster1]                                     },
2021-07-18T14:15:01.8822025Z [cluster1]                                     "serviceCIDR": {
2021-07-18T14:15:01.8822520Z [cluster1]                                         "type": "string"
2021-07-18T14:15:01.8822941Z [cluster1]                                     }
2021-07-18T14:15:01.8823333Z [cluster1]                                 },
2021-07-18T14:15:01.8823897Z [cluster1]                                 "required": [
2021-07-18T14:15:01.8824341Z [cluster1]                                     "clusterID",
2021-07-18T14:15:01.8824797Z [cluster1]                                     "natEnabled"
2021-07-18T14:15:01.8825192Z [cluster1]                                 ],
2021-07-18T14:15:01.8825602Z [cluster1]                                 "type": "object"
2021-07-18T14:15:01.8825986Z [cluster1]                             }
2021-07-18T14:15:01.8826342Z [cluster1]                         },
2021-07-18T14:15:01.8826723Z [cluster1]                         "type": "object"
2021-07-18T14:15:01.8827115Z [cluster1]                     }
2021-07-18T14:15:01.8827444Z [cluster1]                 },
2021-07-18T14:15:01.8828033Z [cluster1]                 "served": true,
2021-07-18T14:15:01.8828458Z [cluster1]                 "storage": true,
2021-07-18T14:15:01.8828913Z [cluster1]                 "subresources": {
2021-07-18T14:15:01.8829354Z [cluster1]                     "status": {}
2021-07-18T14:15:01.8829713Z [cluster1]                 }
2021-07-18T14:15:01.8830066Z [cluster1]             }
2021-07-18T14:15:01.8830553Z [cluster1]         ]
2021-07-18T14:15:01.8831764Z [cluster1]     },
2021-07-18T14:15:01.8832111Z [cluster1]     "status": {
2021-07-18T14:15:01.8832688Z [cluster1]         "acceptedNames": {
2021-07-18T14:15:01.8833127Z [cluster1]             "kind": "Submariner",
2021-07-18T14:15:01.8833618Z [cluster1]             "listKind": "SubmarinerList",
2021-07-18T14:15:01.8834109Z [cluster1]             "plural": "submariners",
2021-07-18T14:15:01.8834566Z [cluster1]             "singular": "submariner"
2021-07-18T14:15:01.8835232Z [cluster1]         },
2021-07-18T14:15:01.8835590Z [cluster1]         "conditions": [
2021-07-18T14:15:01.8835952Z [cluster1]             {
2021-07-18T14:15:01.8836691Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:21Z",
2021-07-18T14:15:02.0483561Z [cluster1]                 "message": "nr2]             },
2021-07-18T14:15:02.0491200Z [cluster2]             {
2021-07-18T14:15:02.0494734Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:43Z",
2021-07-18T14:15:02.0517461Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-18T14:15:02.0518301Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:02.0518947Z [cluster2]                 "status": "True",
2021-07-18T14:15:02.0519383Z [cluster2]                 "type": "Established"
2021-07-18T14:15:02.0526572Z [cluster2]             }
2021-07-18T14:15:02.0526911Z [cluster2]         ],
2021-07-18T14:15:02.0527414Z [cluster2]         "storedVersions": [
2021-07-18T14:15:02.0527964Z [cluster2]             "v1"
2021-07-18T14:15:02.0528302Z [cluster2]         ]
2021-07-18T14:15:02.0528608Z [cluster2]     }
2021-07-18T14:15:02.0528922Z [cluster2] }
2021-07-18T14:15:02.0529926Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:15:02.0531122Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-18T14:15:02.0532480Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:02.0533932Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:02.0534917Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:02.0536255Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:02.0537497Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:02.0538507Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:02.0539824Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:02.0541059Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-18T14:15:02.0542047Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-18T14:15:02.0543320Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:02.0544663Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:15:02.0545847Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-18T14:15:02.0547312Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-18T14:15:02.0548505Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-18T14:15:02.0549269Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-18T14:15:02.0550276Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:15:02.0551524Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-18T14:15:02.0553067Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:15:02.0554236Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:15:02.0555706Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-18T14:15:02.0556479Z [cluster2] NAME                        CREATED AT
2021-07-18T14:15:02.0557185Z [cluster2] submariners.submariner.io   2021-07-18T14:13:33Z
2021-07-18T14:15:02.0559277Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:02.0563097Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:15:02.0564730Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:02.0566016Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-18T14:15:02.0567293Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-18T14:15:02.0568207Z [cluster2] {
2021-07-18T14:15:02.0568698Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:02.0569363Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-18T14:15:02.0569878Z [cluster2]     "metadata": {
2021-07-18T14:15:02.0570282Z [cluster2]         "annotations": {
2021-07-18T14:15:02.0611538Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-18T14:15:02.0612199Z [cluster2]         },
2021-07-18T14:15:02.0612879Z [cluster2]         "creationTimestamp": "2021-07-18T14:13:33Z",
2021-07-18T14:15:02.0613421Z [cluster2]         "generation": 1,
2021-07-18T14:15:02.0613882Z [cluster2]         "managedFields": [
2021-07-18T14:15:02.0614478Z [cluster2]             {
2021-07-18T14:15:02.0615144Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:02.0615745Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:02.0616409Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:02.0616805Z [cluster2]                     "f:status": {
2021-07-18T14:15:02.0617260Z [cluster2]                         "f:acceptedNames": {
2021-07-18T14:15:02.0617696Z [cluster2]                             "f:kind": {},
2021-07-18T14:15:02.0618115Z [cluster2]                             "f:listKind": {},
2021-07-18T14:15:02.0618532Z [cluster2]                             "f:plural": {},
2021-07-18T14:15:02.0618962Z [cluster2]                             "f:singular": {}
2021-07-18T14:15:02.0619337Z [cluster2]                         },
2021-07-18T14:15:02.0619738Z [cluster2]                         "f:conditions": {}
2021-07-18T14:15:02.0620118Z [cluster2]                     }
2021-07-18T14:15:02.0620459Z [cluster2]                 },
2021-07-18T14:15:02.0621111Z [cluster2]                 "manager": "kube-apiserver",
2021-07-18T14:15:02.0621778Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:02.0622401Z [cluster2]                 "time": "2021-07-18T14:13:33Z"
2021-07-18T14:15:02.0622766Z [cluster2]             },
2021-07-18T14:15:02.0623106Z [cluster2]             {
2021-07-18T14:15:02.0623610Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-18T14:15:02.0624599Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:02.0625070Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:02.0625516Z [cluster2]                     "f:metadata": {
2021-07-18T14:15:02.0626126Z [cluster2]                         "f:annotations": {
2021-07-18T14:15:02.0626635Z [cluster2]                             ".": {},
2021-07-18T14:15:02.0627627Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-18T14:15:02.0628550Z [cluster2]                         }
2021-07-18T14:15:02.0628904Z [cluster2]                     },
2021-07-18T14:15:02.0629442Z [cluster2]                     "f:spec": {
2021-07-18T14:15:02.0629882Z [cluster2]                         "f:conversion": {
2021-07-18T14:15:02.0630288Z [cluster2]                             ".": {},
2021-07-18T14:15:02.0630704Z [cluster2]                             "f:strategy": {}
2021-07-18T14:15:02.0631093Z [cluster2]                         },
2021-07-18T14:15:02.0631485Z [cluster2]                         "f:group": {},
2021-07-18T14:15:02.0631900Z [cluster2]                         "f:names": {
2021-07-18T14:15:02.0632570Z [cluster2]                             "f:kind": {},
2021-07-18T14:15:02.0632993Z [cluster2]                             "f:listKind": {},
2021-07-18T14:15:02.0633396Z [cluster2]                             "f:plural": {},
2021-07-18T14:15:02.0633810Z [cluster2]                             "f:singular": {}
2021-07-18T14:15:02.0634172Z [cluster2]                         },
2021-07-18T14:15:02.0634547Z [cluster2]                         "f:scope": {},
2021-07-18T14:15:02.0634937Z [cluster2]                         "f:versions": {}
2021-07-18T14:15:02.0635324Z [cluster2]                     },
2021-07-18T14:15:02.0635672Z [cluster2]                     "f:status": {
2021-07-18T14:15:02.0636114Z [cluster2]                         "f:storedVersions": {}
2021-07-18T14:15:02.0636531Z [cluster2]                     }
2021-07-18T14:15:02.0636850Z [cluster2]                 },
2021-07-18T14:15:02.0637233Z [cluster2]                 "manager": "subctl",
2021-07-18T14:15:02.0637663Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:02.0638477Z [cluster2]                 "time": "2021-07-18T14:13:33Z"
2021-07-18T14:15:02.0639022Z [cluster2]             }
2021-07-18T14:15:02.0639368Z [cluster2]         ],
2021-07-18T14:15:02.0639886Z [cluster2]         "name": "submariners.submariner.io",
2021-07-18T14:15:02.0640508Z [cluster2]         "resourceVersion": "1409",
2021-07-18T14:15:02.0641262Z [cluster2]         "uid": "1277aeb3-78b1-4e2c-8998-6cd2d76f9b45"
2021-07-18T14:15:02.0641767Z [cluster2]     },
2021-07-18T14:15:02.0642578Z [cluster2]     "spec": {
2021-07-18T14:15:02.0642945Z [cluster2]         "conversion": {
2021-07-18T14:15:02.0643360Z [cluster2]             "strategy": "None"
2021-07-18T14:15:02.0643717Z [cluster2]         },
2021-07-18T14:15:02.0644124Z [cluster2]         "group": "submariner.io",
2021-07-18T14:15:02.0644532Z [cluster2]         "names": {
2021-07-18T14:15:02.0644934Z [cluster2]             "kind": "Submariner",
2021-07-18T14:15:02.0645405Z [cluster2]             "listKind": "SubmarinerList",
2021-07-18T14:15:02.0645910Z [cluster2]             "plural": "submariners",
2021-07-18T14:15:02.0646365Z [cluster2]             "singular": "submariner"
2021-07-18T14:15:02.0646760Z [cluster2]         },
2021-07-18T14:15:02.0647136Z [cluster2]         "scope": "Namespaced",
2021-07-18T14:15:02.0647552Z [cluster2]         "versions": [
2021-07-18T14:15:02.0648051Z [cluster2]             {
2021-07-18T14:15:02.0648416Z [cluster2]                 "name": "v1alpha1",
2021-07-18T14:15:02.0648818Z [cluster2]                 "schema": {
2021-07-18T14:15:02.0649255Z [cluster2]                     "openAPIV3Schema": {
2021-07-18T14:15:02.0650296Z [cluster2]                         "description": "Submariner is the Schema for the submariners API",
2021-07-18T14:15:02.0650912Z [cluster2]                         "properties": {
2021-07-18T14:15:02.0651379Z [cluster2]                             "apiVersion": {
2021-07-18T14:15:02.0653511Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-18T14:15:02.0655202Z [cluster2]                                 "type": "string"
2021-07-18T14:15:02.0655606Z [cluster2]                             },
2021-07-18T14:15:02.0655973Z [cluster2]                             "kind": {
2021-07-18T14:15:02.0657928Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-18T14:15:02.0659338Z [cluster2]                                 "type": "string"
2021-07-18T14:15:02.0659718Z [cluster2]                             },
2021-07-18T14:15:02.0660211Z [cluster2]                             "metadata": {
2021-07-18T14:15:02.0660657Z [cluster2]                                 "type": "object"
2021-07-18T14:15:02.0661031Z [cluster2]                             },
2021-07-18T14:15:02.0661404Z [cluster2]                             "spec": {
2021-07-18T14:15:02.0662007Z [cluster2]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-18T14:15:02.0662657Z [cluster2]                                 "properties": {
2021-07-18T14:15:02.0663077Z [cluster2]                                     "broker": {
2021-07-18T14:15:02.0663501Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0663904Z [cluster2]                                     },
2021-07-18T14:15:02.0664357Z [cluster2]                                     "brokerK8sApiServer": {
2021-07-18T14:15:02.0664863Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0665249Z [cluster2]                                     },
2021-07-18T14:15:02.0665765Z [cluster2]                                     "brokerK8sApiServerToken": {
2021-07-18T14:15:02.0666303Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0666710Z [cluster2]                                     },
2021-07-18T14:15:02.0667112Z [cluster2]                                     "brokerK8sCA": {
2021-07-18T14:15:02.0667564Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0668054Z [cluster2]                                     },
2021-07-18T14:15:02.0668566Z [cluster2]                                     "brokerK8sRemoteNamespace": {
2021-07-18T14:15:02.0669309Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0669703Z [cluster2]                                     },
2021-07-18T14:15:02.0670128Z [cluster2]                                     "cableDriver": {
2021-07-18T14:15:02.0670584Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0670995Z [cluster2]                                     },
2021-07-18T14:15:02.0671438Z [cluster2]                                     "ceIPSecDebug": {
2021-07-18T14:15:02.0671904Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0672480Z [cluster2]                                     },
2021-07-18T14:15:02.0672972Z [cluster2]                                     "ceIPSecForceUDPEncaps": {
2021-07-18T14:15:02.0673530Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0673917Z [cluster2]                                     },
2021-07-18T14:15:02.0674355Z [cluster2]                                     "ceIPSecIKEPort": {
2021-07-18T14:15:02.0674822Z [cluster2]                                         "type": "integer"
2021-07-18T14:15:02.0675229Z [cluster2]                                     },
2021-07-18T14:15:02.0675678Z [cluster2]                                     "ceIPSecNATTPort": {
2021-07-18T14:15:02.0676153Z [cluster2]                                         "type": "integer"
2021-07-18T14:15:02.0676559Z [cluster2]                                     },
2021-07-18T14:15:02.0677141Z [cluster2]                                     "ceIPSecPSK": {
2021-07-18T14:15:02.0677606Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0677998Z [cluster2]                                     },
2021-07-18T14:15:02.0678786Z [cluster2]                                     "ceIPSecPreferredServer": {
2021-07-18T14:15:02.0679553Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0680335Z [cluster2]                                     },
2021-07-18T14:15:02.0681034Z [cluster2]                                     "clusterCIDR": {
2021-07-18T14:15:02.0681542Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0682234Z [cluster2]                                     },
2021-07-18T14:15:02.0682842Z [cluster2]                                     "clusterID": {
2021-07-18T14:15:02.0683320Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0683896Z [cluster2]                                     },
2021-07-18T14:15:02.0684635Z [cluster2]                                     "colorCodes": {
2021-07-18T14:15:02.0685067Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0685470Z [cluster2]                                     },
2021-07-18T14:15:02.0685968Z [cluster2]                                     "connectionHealthCheck": {
2021-07-18T14:15:02.0686497Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.0686947Z [cluster2]                                             "enabled": {
2021-07-18T14:15:02.0687569Z [cluster2]                                                 "type": "boolean"
2021-07-18T14:15:02.0728682Z [cluster2]                                             },
2021-07-18T14:15:02.0729144Z [cluster2]                                             "intervalSeconds": {
2021-07-18T14:15:02.0729790Z [cluster2]                                                 "description": "The interval at which health check pings are sent.",
2021-07-18T14:15:02.0730388Z [cluster2]                                                 "format": "int64",
2021-07-18T14:15:02.0730833Z [cluster2]                                                 "type": "integer"
2021-07-18T14:15:02.0731426Z [cluster2]                                             },
2021-07-18T14:15:02.0731891Z [cluster2]                                             "maxPacketLossCount": {
2021-07-18T14:15:02.0732679Z [cluster2]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-18T14:15:02.0733402Z [cluster2]                                                 "format": "int64",
2021-07-18T14:15:02.0733854Z [cluster2]                                                 "type": "integer"
2021-07-18T14:15:02.0734278Z [cluster2]                                             }
2021-07-18T14:15:02.0734635Z [cluster2]                                         },
2021-07-18T14:15:02.0735045Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.0735433Z [cluster2]                                     },
2021-07-18T14:15:02.0735916Z [cluster2]                                     "coreDNSCustomConfig": {
2021-07-18T14:15:02.0736448Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.0736917Z [cluster2]                                             "configMapName": {
2021-07-18T14:15:02.0737620Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0738033Z [cluster2]                                             },
2021-07-18T14:15:02.0738462Z [cluster2]                                             "namespace": {
2021-07-18T14:15:02.0738920Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0739520Z [cluster2]                                             }
2021-07-18T14:15:02.0739899Z [cluster2]                                         },
2021-07-18T14:15:02.0740332Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.0740760Z [cluster2]                                     },
2021-07-18T14:15:02.0741196Z [cluster2]                                     "customDomains": {
2021-07-18T14:15:02.0741831Z [cluster2]                                         "items": {
2021-07-18T14:15:02.0742268Z [cluster2]                                             "type": "string"
2021-07-18T14:15:02.0742699Z [cluster2]                                         },
2021-07-18T14:15:02.0743261Z [cluster2]                                         "type": "array",
2021-07-18T14:15:02.0744282Z [cluster2]                                         "x-kubernetes-list-type": "set"
2021-07-18T14:15:02.0744899Z [cluster2]                                     },
2021-07-18T14:15:02.0745459Z [cluster2]                                     "debug": {
2021-07-18T14:15:02.0746091Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0746509Z [cluster2]                                     },
2021-07-18T14:15:02.0746944Z [cluster2]                                     "globalCIDR": {
2021-07-18T14:15:02.0747402Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0747833Z [cluster2]                                     },
2021-07-18T14:15:02.0748283Z [cluster2]                                     "imageOverrides": {
2021-07-18T14:15:02.0749236Z [cluster2]                                         "additionalProperties": {
2021-07-18T14:15:02.0749768Z [cluster2]                                             "type": "string"
2021-07-18T14:15:02.0750502Z [cluster2]                                         },
2021-07-18T14:15:02.0750930Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.0751513Z [cluster2]                                     },
2021-07-18T14:15:02.0752015Z [cluster2]                                     "loadBalancerEnabled": {
2021-07-18T14:15:02.0752588Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0753020Z [cluster2]                                     },
2021-07-18T14:15:02.0753435Z [cluster2]                                     "namespace": {
2021-07-18T14:15:02.0754643Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0755446Z [cluster2]                                     },
2021-07-18T14:15:02.0755908Z [cluster2]                                     "natEnabled": {
2021-07-18T14:15:02.0756439Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0756896Z [cluster2]                                     },
2021-07-18T14:15:02.0757856Z [cluster2]                                     "repository": {
2021-07-18T14:15:02.0758502Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0759105Z [cluster2]                                     },
2021-07-18T14:15:02.0759548Z [cluster2]                                     "serviceCIDR": {
2021-07-18T14:15:02.0760306Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0760910Z [cluster2]                                     },
2021-07-18T14:15:02.0761438Z [cluster2]                                     "serviceDiscoveryEnabled": {
2021-07-18T14:15:02.0762017Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.0762419Z [cluster2]                                     },
2021-07-18T14:15:02.0762820Z [cluster2]                                     "version": {
2021-07-18T14:15:02.0763242Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0763651Z [cluster2]                                     }
2021-07-18T14:15:02.0764448Z [cluster2]                                 },
2021-07-18T14:15:02.0765028Z [cluster2]                                 "required": [
2021-07-18T14:15:02.0765650Z [cluster2]                                     "broker",
2021-07-18T14:15:02.0766171Z [cluster2]                                     "brokerK8sApiServer",
2021-07-18T14:15:02.0766851Z [cluster2]                                     "brokerK8sApiServerToken",
2021-07-18T14:15:02.0767456Z [cluster2]                                     "brokerK8sCA",
2021-07-18T14:15:02.0768679Z [cluster2]                                     "brokerK8sRemoteNamespace",
2021-07-18T14:15:02.0769271Z [cluster2]                                     "ceIPSecDebug",
2021-07-18T14:15:02.0769761Z [cluster2]                                     "ceIPSecPSK",
2021-07-18T14:15:02.0770231Z [cluster2]                                     "clusterCIDR",
2021-07-18T14:15:02.0770678Z [cluster2]                                     "clusterID",
2021-07-18T14:15:02.0771358Z [cluster2]                                     "debug",
2021-07-18T14:15:02.0771780Z [cluster2]                                     "namespace",
2021-07-18T14:15:02.0772220Z [cluster2]                                     "natEnabled",
2021-07-18T14:15:02.0772661Z [cluster2]                                     "serviceCIDR"
2021-07-18T14:15:02.0773071Z [cluster2]                                 ],
2021-07-18T14:15:02.0773459Z [cluster2]                                 "type": "object"
2021-07-18T14:15:02.0773854Z [cluster2]                             },
2021-07-18T14:15:02.0774231Z [cluster2]                             "status": {
2021-07-18T14:15:02.0774856Z [cluster2]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-18T14:15:02.0775718Z [cluster2]                                 "properties": {
2021-07-18T14:15:02.0808868Z [cluster2]                                     "clusterCIDR": {
2021-07-18T14:15:02.0809456Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0810192Z [cluster2]                                     },
2021-07-18T14:15:02.0810599Z [cluster2]                                     "clusterID": {
2021-07-18T14:15:02.0811024Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0811429Z [cluster2]                                     },
2021-07-18T14:15:02.0811842Z [cluster2]                                     "colorCodes": {
2021-07-18T14:15:02.0812441Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.0812844Z [cluster2]                                     },
2021-07-18T14:15:02.0813264Z [cluster2]                                     "deploymentInfo": {
2021-07-18T14:15:02.0813755Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.0814408Z [cluster2]                                             "cloudProvider": {
2021-07-18T14:15:02.0814907Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0815335Z [cluster2]                                             },
2021-07-18T14:15:02.0815781Z [cluster2]                                             "kubernetesType": {
2021-07-18T14:15:02.0816281Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0816691Z [cluster2]                                             },
2021-07-18T14:15:02.0817408Z [cluster2]                                             "kubernetesTypeVersion": {
2021-07-18T14:15:02.0818126Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0818554Z [cluster2]                                             },
2021-07-18T14:15:02.0819043Z [cluster2]                                             "kubernetesVersion": {
2021-07-18T14:15:02.0819546Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0819974Z [cluster2]                                             }
2021-07-18T14:15:02.0820341Z [cluster2]                                         },
2021-07-18T14:15:02.0820918Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.0821308Z [cluster2]                                     },
2021-07-18T14:15:02.0821826Z [cluster2]                                     "gatewayDaemonSetStatus": {
2021-07-18T14:15:02.0822370Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.0822907Z [cluster2]                                             "lastResourceVersion": {
2021-07-18T14:15:02.0823438Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.0823834Z [cluster2]                                             },
2021-07-18T14:15:02.0824579Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-18T14:15:02.0825178Z [cluster2]                                                 "type": "boolean"
2021-07-18T14:15:02.0825690Z [cluster2]                                             },
2021-07-18T14:15:02.0826232Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-18T14:15:02.0826795Z [cluster2]                                                 "items": {
2021-07-18T14:15:02.0827821Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:02.0829020Z [cluster2]                                                     "properties": {
2021-07-18T14:15:02.0829657Z [cluster2]                                                         "running": {
2021-07-18T14:15:02.0830433Z [cluster2]                                                             "description": "Details about a running container",
2021-07-18T14:15:02.0831181Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.0831705Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.0832711Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:02.0833868Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.0834553Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0835098Z [cluster2]                                                                 }
2021-07-18T14:15:02.0835509Z [cluster2]                                                             },
2021-07-18T14:15:02.0835936Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.0836374Z [cluster2]                                                         },
2021-07-18T14:15:02.0836828Z [cluster2]                                                         "terminated": {
2021-07-18T14:15:02.0837591Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:02.0838196Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.0838674Z [cluster2]                                                                 "containerID": {
2021-07-18T14:15:02.0839594Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:02.0840260Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0840683Z [cluster2]                                                                 },
2021-07-18T14:15:02.0841125Z [cluster2]                                                                 "exitCode": {
2021-07-18T14:15:02.0841751Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:02.0842383Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.0842859Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.0843286Z [cluster2]                                                                 },
2021-07-18T14:15:02.0843732Z [cluster2]                                                                 "finishedAt": {
2021-07-18T14:15:02.0844334Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:02.0845153Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.0845741Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0846353Z [cluster2]                                                                 },
2021-07-18T14:15:02.0846795Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.0847741Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:02.0868755Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0869393Z [cluster2]                                                                 },
2021-07-18T14:15:02.0869813Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.0870463Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:02.0871110Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0871563Z [cluster2]                                                                 },
2021-07-18T14:15:02.0871977Z [cluster2]                                                                 "signal": {
2021-07-18T14:15:02.0872761Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:02.0873378Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.0874001Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.0874443Z [cluster2]                                                                 },
2021-07-18T14:15:02.0874862Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.0875523Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:02.0876504Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.0876990Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0877426Z [cluster2]                                                                 }
2021-07-18T14:15:02.0877807Z [cluster2]                                                             },
2021-07-18T14:15:02.0878240Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.0878707Z [cluster2]                                                                 "exitCode"
2021-07-18T14:15:02.0879311Z [cluster2]                                                             ],
2021-07-18T14:15:02.0879753Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.0880179Z [cluster2]                                                         },
2021-07-18T14:15:02.0880609Z [cluster2]                                                         "waiting": {
2021-07-18T14:15:02.0881361Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:02.0882142Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.0882624Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.0883268Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:02.0883928Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0884357Z [cluster2]                                                                 },
2021-07-18T14:15:02.0885037Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.0885851Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:02.0886460Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0886905Z [cluster2]                                                                 }
2021-07-18T14:15:02.0887305Z [cluster2]                                                             },
2021-07-18T14:15:02.0888066Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.0888747Z [cluster2]                                                         }
2021-07-18T14:15:02.0889138Z [cluster2]                                                     },
2021-07-18T14:15:02.0889560Z [cluster2]                                                     "type": "object"
2021-07-18T14:15:02.0890055Z [cluster2]                                                 },
2021-07-18T14:15:02.0890475Z [cluster2]                                                 "type": "array"
2021-07-18T14:15:02.0890872Z [cluster2]                                             },
2021-07-18T14:15:02.0891269Z [cluster2]                                             "status": {
2021-07-18T14:15:02.0891909Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:02.0892701Z [cluster2]                                                 "properties": {
2021-07-18T14:15:02.0893196Z [cluster2]                                                     "collisionCount": {
2021-07-18T14:15:02.0894260Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:02.0895314Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0895778Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0896196Z [cluster2]                                                     },
2021-07-18T14:15:02.0896620Z [cluster2]                                                     "conditions": {
2021-07-18T14:15:02.0897622Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:02.0898333Z [cluster2]                                                         "items": {
2021-07-18T14:15:02.0899044Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:02.0901545Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.0902273Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-18T14:15:02.0903177Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:02.0904769Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.0905445Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0906010Z [cluster2]                                                                 },
2021-07-18T14:15:02.0906786Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.0907587Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:02.0908294Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0908729Z [cluster2]                                                                 },
2021-07-18T14:15:02.0909137Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.0910000Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:02.0910786Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0911238Z [cluster2]                                                                 },
2021-07-18T14:15:02.0911669Z [cluster2]                                                                 "status": {
2021-07-18T14:15:02.0912291Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:02.0913112Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0914082Z [cluster2]                                                                 },
2021-07-18T14:15:02.0914792Z [cluster2]                                                                 "type": {
2021-07-18T14:15:02.0915474Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:02.0916309Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.0916862Z [cluster2]                                                                 }
2021-07-18T14:15:02.0917336Z [cluster2]                                                             },
2021-07-18T14:15:02.0918494Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.0918936Z [cluster2]                                                                 "status",
2021-07-18T14:15:02.0919370Z [cluster2]                                                                 "type"
2021-07-18T14:15:02.0919766Z [cluster2]                                                             ],
2021-07-18T14:15:02.0920200Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.0920627Z [cluster2]                                                         },
2021-07-18T14:15:02.0921218Z [cluster2]                                                         "type": "array"
2021-07-18T14:15:02.0921831Z [cluster2]                                                     },
2021-07-18T14:15:02.0922360Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-18T14:15:02.0923535Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.0924592Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0925063Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0925511Z [cluster2]                                                     },
2021-07-18T14:15:02.0963372Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:02.0964689Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.0966297Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0966924Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0967365Z [cluster2]                                                     },
2021-07-18T14:15:02.0968010Z [cluster2]                                                     "numberAvailable": {
2021-07-18T14:15:02.0968974Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.0969983Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0970452Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0970866Z [cluster2]                                                     },
2021-07-18T14:15:02.0971350Z [cluster2]                                                     "numberMisscheduled": {
2021-07-18T14:15:02.0972421Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.0973431Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0974076Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0974617Z [cluster2]                                                     },
2021-07-18T14:15:02.0975069Z [cluster2]                                                     "numberReady": {
2021-07-18T14:15:02.0975851Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:02.0976628Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0977224Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0977654Z [cluster2]                                                     },
2021-07-18T14:15:02.0978149Z [cluster2]                                                     "numberUnavailable": {
2021-07-18T14:15:02.0979273Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.0980184Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0980628Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0981058Z [cluster2]                                                     },
2021-07-18T14:15:02.0981555Z [cluster2]                                                     "observedGeneration": {
2021-07-18T14:15:02.0982455Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:02.0983142Z [cluster2]                                                         "format": "int64",
2021-07-18T14:15:02.0983788Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0984230Z [cluster2]                                                     },
2021-07-18T14:15:02.0984783Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:02.0985538Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:02.0986453Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.0986998Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.0987441Z [cluster2]                                                     }
2021-07-18T14:15:02.0987813Z [cluster2]                                                 },
2021-07-18T14:15:02.0988229Z [cluster2]                                                 "required": [
2021-07-18T14:15:02.0988793Z [cluster2]                                                     "currentNumberScheduled",
2021-07-18T14:15:02.0989628Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-18T14:15:02.0990277Z [cluster2]                                                     "numberMisscheduled",
2021-07-18T14:15:02.0990820Z [cluster2]                                                     "numberReady"
2021-07-18T14:15:02.0991263Z [cluster2]                                                 ],
2021-07-18T14:15:02.0991680Z [cluster2]                                                 "type": "object"
2021-07-18T14:15:02.1005218Z [cluster2]                                             }
2021-07-18T14:15:02.1006054Z [cluster2]                                         },
2021-07-18T14:15:02.1006450Z [cluster2]                                         "required": [
2021-07-18T14:15:02.1007031Z [cluster2]                                             "mismatchedContainerImages"
2021-07-18T14:15:02.1007562Z [cluster2]                                         ],
2021-07-18T14:15:02.1008113Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.1008672Z [cluster2]                                     },
2021-07-18T14:15:02.1009254Z [cluster2]                                     "gateways": {
2021-07-18T14:15:02.1009670Z [cluster2]                                         "items": {
2021-07-18T14:15:02.1010379Z [cluster2]                                             "properties": {
2021-07-18T14:15:02.1011206Z [cluster2]                                                 "connections": {
2021-07-18T14:15:02.1011693Z [cluster2]                                                     "items": {
2021-07-18T14:15:02.1012264Z [cluster2]                                                         "properties": {
2021-07-18T14:15:02.1012829Z [cluster2]                                                             "endpoint": {
2021-07-18T14:15:02.1013513Z [cluster2]                                                                 "properties": {
2021-07-18T14:15:02.1014152Z [cluster2]                                                                     "backend": {
2021-07-18T14:15:02.1014639Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1015094Z [cluster2]                                                                     },
2021-07-18T14:15:02.1015539Z [cluster2]                                                                     "backend_config": {
2021-07-18T14:15:02.1016305Z [cluster2]                                                                         "additionalProperties": {
2021-07-18T14:15:02.1016894Z [cluster2]                                                                             "type": "string"
2021-07-18T14:15:02.1017362Z [cluster2]                                                                         },
2021-07-18T14:15:02.1017833Z [cluster2]                                                                         "type": "object"
2021-07-18T14:15:02.1018280Z [cluster2]                                                                     },
2021-07-18T14:15:02.1018744Z [cluster2]                                                                     "cable_name": {
2021-07-18T14:15:02.1033219Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1033728Z [cluster2]                                                                     },
2021-07-18T14:15:02.1034152Z [cluster2]                                                                     "cluster_id": {
2021-07-18T14:15:02.1034776Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1035245Z [cluster2]                                                                     },
2021-07-18T14:15:02.1035701Z [cluster2]                                                                     "healthCheckIP": {
2021-07-18T14:15:02.1036208Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1036634Z [cluster2]                                                                     },
2021-07-18T14:15:02.1037079Z [cluster2]                                                                     "hostname": {
2021-07-18T14:15:02.1037549Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1037969Z [cluster2]                                                                     },
2021-07-18T14:15:02.1038408Z [cluster2]                                                                     "nat_enabled": {
2021-07-18T14:15:02.1039055Z [cluster2]                                                                         "type": "boolean"
2021-07-18T14:15:02.1039512Z [cluster2]                                                                     },
2021-07-18T14:15:02.1039948Z [cluster2]                                                                     "private_ip": {
2021-07-18T14:15:02.1040439Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1040979Z [cluster2]                                                                     },
2021-07-18T14:15:02.1041592Z [cluster2]                                                                     "public_ip": {
2021-07-18T14:15:02.1042830Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1043284Z [cluster2]                                                                     },
2021-07-18T14:15:02.1043753Z [cluster2]                                                                     "subnets": {
2021-07-18T14:15:02.1044539Z [cluster2]                                                                         "items": {
2021-07-18T14:15:02.1044984Z [cluster2]                                                                             "type": "string"
2021-07-18T14:15:02.1045492Z [cluster2]                                                                         },
2021-07-18T14:15:02.1045922Z [cluster2]                                                                         "type": "array"
2021-07-18T14:15:02.1046364Z [cluster2]                                                                     }
2021-07-18T14:15:02.1046750Z [cluster2]                                                                 },
2021-07-18T14:15:02.1047182Z [cluster2]                                                                 "required": [
2021-07-18T14:15:02.1048553Z [cluster2]                                                                     "backend",
2021-07-18T14:15:02.1049412Z [cluster2]                                                                     "cable_name",
2021-07-18T14:15:02.1049905Z [cluster2]                                                                     "cluster_id",
2021-07-18T14:15:02.1050565Z [cluster2]                                                                     "hostname",
2021-07-18T14:15:02.1051250Z [cluster2]                                                                     "nat_enabled",
2021-07-18T14:15:02.1051778Z [cluster2]                                                                     "private_ip",
2021-07-18T14:15:02.1052305Z [cluster2]                                                                     "public_ip",
2021-07-18T14:15:02.1052821Z [cluster2]                                                                     "subnets"
2021-07-18T14:15:02.1053445Z [cluster2]                                                                 ],
2021-07-18T14:15:02.1054245Z [cluster2]                                                                 "type": "object"
2021-07-18T14:15:02.1054864Z [cluster2]                                                             },
2021-07-18T14:15:02.1055320Z [cluster2]                                                             "latencyRTT": {
2021-07-18T14:15:02.1056356Z [cluster2]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-18T14:15:02.1065149Z [cluster2]                                                                 "properties": {
2021-07-18T14:15:02.1065649Z [cluster2]                                                                     "average": {
2021-07-18T14:15:02.1066106Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1066550Z [cluster2]                                                                     },
2021-07-18T14:15:02.1066985Z [cluster2]                                                                     "last": {
2021-07-18T14:15:02.1067429Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1067869Z [cluster2]                                                                     },
2021-07-18T14:15:02.1068900Z [cluster2]                                                                     "max": {
2021-07-18T14:15:02.1071917Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1074278Z [cluster2]                                                                     },
2021-07-18T14:15:02.1075180Z [cluster2]                                                                     "min": {
2021-07-18T14:15:02.1075645Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1076083Z [cluster2]                                                                     },
2021-07-18T14:15:02.1076510Z [cluster2]                                                                     "stdDev": {
2021-07-18T14:15:02.1076959Z [cluster2]                                                                         "type": "string"
2021-07-18T14:15:02.1077397Z [cluster2]                                                                     }
2021-07-18T14:15:02.1077782Z [cluster2]                                                                 },
2021-07-18T14:15:02.1078236Z [cluster2]                                                                 "type": "object"
2021-07-18T14:15:02.1078669Z [cluster2]                                                             },
2021-07-18T14:15:02.1079069Z [cluster2]                                                             "status": {
2021-07-18T14:15:02.1103134Z [cluster2]                                                                 "type": "string"
2021-07-18T14:15:02.1103692Z [cluster2]                                                             },
2021-07-18T14:15:02.1104277Z [cluster2]                                                             "statusMessage": {
2021-07-18T14:15:02.1105778Z [cluster2]                                                                 "type": "string"
2021-07-18T14:15:02.1108712Z [cluster2]                                                             },
2021-07-18T14:15:02.1109255Z [cluster2]                                                             "usingIP": {
2021-07-18T14:15:02.1116956Z [cluster2]                                                                 "type": "string"
2021-07-18T14:15:02.1117465Z [cluster2]                                                             },
2021-07-18T14:15:02.1118165Z [cluster2]                                                             "usingNAT": {
2021-07-18T14:15:02.1118889Z [cluster2]                                                                 "type": "boolean"
2021-07-18T14:15:02.1119593Z [cluster2]                                                             }
2021-07-18T14:15:02.1120045Z [cluster2]                                                         },
2021-07-18T14:15:02.1120511Z [cluster2]                                                         "required": [
2021-07-18T14:15:02.1122338Z [cluster2]                                                             "endpoint",
2021-07-18T14:15:02.1123300Z [cluster2]                                                             "status",
2021-07-18T14:15:02.1124281Z [cluster2]                                                             "statusMessage"
2021-07-18T14:15:02.1124757Z [cluster2]                                                         ],
2021-07-18T14:15:02.1125204Z [cluster2]                                                         "type": "object"
2021-07-18T14:15:02.1125822Z [cluster2]                                                     },
2021-07-18T14:15:02.1126267Z [cluster2]                                                     "type": "array"
2021-07-18T14:15:02.1126694Z [cluster2]                                                 },
2021-07-18T14:15:02.1127304Z [cluster2]                                                 "haStatus": {
2021-07-18T14:15:02.1128267Z [cluster2]                                                     "type": "string"
2021-07-18T14:15:02.1128750Z [cluster2]                                                 },
2021-07-18T14:15:02.1129234Z [cluster2]                                                 "localEndpoint": {
2021-07-18T14:15:02.1129791Z [cluster2]                                                     "properties": {
2021-07-18T14:15:02.1130776Z [cluster2]                                                         "backend": {
2021-07-18T14:15:02.1131440Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1131882Z [cluster2]                                                         },
2021-07-18T14:15:02.1132317Z [cluster2]                                                         "backend_config": {
2021-07-18T14:15:02.1132901Z [cluster2]                                                             "additionalProperties": {
2021-07-18T14:15:02.1133473Z [cluster2]                                                                 "type": "string"
2021-07-18T14:15:02.1133898Z [cluster2]                                                             },
2021-07-18T14:15:02.1134345Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1134767Z [cluster2]                                                         },
2021-07-18T14:15:02.1135205Z [cluster2]                                                         "cable_name": {
2021-07-18T14:15:02.1135656Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1136095Z [cluster2]                                                         },
2021-07-18T14:15:02.1136529Z [cluster2]                                                         "cluster_id": {
2021-07-18T14:15:02.1136986Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1137427Z [cluster2]                                                         },
2021-07-18T14:15:02.1137881Z [cluster2]                                                         "healthCheckIP": {
2021-07-18T14:15:02.1138387Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1138809Z [cluster2]                                                         },
2021-07-18T14:15:02.1139247Z [cluster2]                                                         "hostname": {
2021-07-18T14:15:02.1139718Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1140141Z [cluster2]                                                         },
2021-07-18T14:15:02.1140579Z [cluster2]                                                         "nat_enabled": {
2021-07-18T14:15:02.1141119Z [cluster2]                                                             "type": "boolean"
2021-07-18T14:15:02.1141583Z [cluster2]                                                         },
2021-07-18T14:15:02.1142152Z [cluster2]                                                         "private_ip": {
2021-07-18T14:15:02.1142616Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1143043Z [cluster2]                                                         },
2021-07-18T14:15:02.1143451Z [cluster2]                                                         "public_ip": {
2021-07-18T14:15:02.1143904Z [cluster2]                                                             "type": "string"
2021-07-18T14:15:02.1144325Z [cluster2]                                                         },
2021-07-18T14:15:02.1144721Z [cluster2]                                                         "subnets": {
2021-07-18T14:15:02.1145149Z [cluster2]                                                             "items": {
2021-07-18T14:15:02.1145586Z [cluster2]                                                                 "type": "string"
2021-07-18T14:15:02.1146014Z [cluster2]                                                             },
2021-07-18T14:15:02.1146442Z [cluster2]                                                             "type": "array"
2021-07-18T14:15:02.1146846Z [cluster2]                                                         }
2021-07-18T14:15:02.1147228Z [cluster2]                                                     },
2021-07-18T14:15:02.1147757Z [cluster2]                                                     "required": [
2021-07-18T14:15:02.1148200Z [cluster2]                                                         "backend",
2021-07-18T14:15:02.1148739Z [cluster2]                                                         "cable_name",
2021-07-18T14:15:02.1149191Z [cluster2]                                                         "cluster_id",
2021-07-18T14:15:02.1149643Z [cluster2]                                                         "hostname",
2021-07-18T14:15:02.1150083Z [cluster2]                                                         "nat_enabled",
2021-07-18T14:15:02.1150543Z [cluster2]                                                         "private_ip",
2021-07-18T14:15:02.1150970Z [cluster2]                                                         "public_ip",
2021-07-18T14:15:02.1151405Z [cluster2]                                                         "subnets"
2021-07-18T14:15:02.1151800Z [cluster2]                                                     ],
2021-07-18T14:15:02.1152228Z [cluster2]                                                     "type": "object"
2021-07-18T14:15:02.1152641Z [cluster2]                                                 },
2021-07-18T14:15:02.1153065Z [cluster2]                                                 "statusFailure": {
2021-07-18T14:15:02.1153538Z [cluster2]                                                     "type": "string"
2021-07-18T14:15:02.1153938Z [cluster2]                                                 },
2021-07-18T14:15:02.1154345Z [cluster2]                                                 "version": {
2021-07-18T14:15:02.1154773Z [cluster2]                                                     "type": "string"
2021-07-18T14:15:02.1155374Z [cluster2]                                                 }
2021-07-18T14:15:02.1155941Z [cluster2]                                             },
2021-07-18T14:15:02.1156355Z [cluster2]                                             "required": [
2021-07-18T14:15:02.1156848Z [cluster2]                                                 "connections",
2021-07-18T14:15:02.1157502Z [cluster2]                                                 "haStatus",
2021-07-18T14:15:02.1158012Z [cluster2]                                                 "localEndpoint",
2021-07-18T14:15:02.1158539Z [cluster2]                                                 "statusFailure",
2021-07-18T14:15:02.1159128Z [cluster2]                                                 "version"
2021-07-18T14:15:02.1159586Z [cluster2]                                             ],
2021-07-18T14:15:02.1160181Z [cluster2]                                             "type": "object"
2021-07-18T14:15:02.1160955Z [cluster2]                                         },
2021-07-18T14:15:02.1161366Z [cluster2]                                         "type": "array"
2021-07-18T14:15:02.1161781Z [cluster2]                                     },
2021-07-18T14:15:02.1162198Z [cluster2]                                     "globalCIDR": {
2021-07-18T14:15:02.1162669Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.1163080Z [cluster2]                                     },
2021-07-18T14:15:02.1163641Z [cluster2]                                     "globalnetDaemonSetStatus": {
2021-07-18T14:15:02.1164402Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.1164937Z [cluster2]                                             "lastResourceVersion": {
2021-07-18T14:15:02.1165477Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.1165887Z [cluster2]                                             },
2021-07-18T14:15:02.1166443Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-18T14:15:02.1167036Z [cluster2]                                                 "type": "boolean"
2021-07-18T14:15:02.1167462Z [cluster2]                                             },
2021-07-18T14:15:02.1168205Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-18T14:15:02.1168756Z [cluster2]                                                 "items": {
2021-07-18T14:15:02.1171573Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:02.1172862Z [cluster2]                                                     "properties": {
2021-07-18T14:15:02.1173349Z [cluster2]                                                         "running": {
2021-07-18T14:15:02.1174130Z [cluster2]                                                             "description": "Details about a running container",
2021-07-18T14:15:02.1190820Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1191364Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.1193019Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:02.1194207Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1194764Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1195268Z [cluster2]                                                                 }
2021-07-18T14:15:02.1195720Z [cluster2]                                                             },
2021-07-18T14:15:02.1196192Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1196830Z [cluster2]                                                         },
2021-07-18T14:15:02.1197286Z [cluster2]                                                         "terminated": {
2021-07-18T14:15:02.1198103Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:02.1198898Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1199391Z [cluster2]                                                                 "containerID": {
2021-07-18T14:15:02.1200709Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:02.1201410Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1202816Z [cluster2]                                                                 },
2021-07-18T14:15:02.1203403Z [cluster2]                                                                 "exitCode": {
2021-07-18T14:15:02.1204202Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:02.1205004Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.1205590Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.1206747Z [cluster2]                                                                 },
2021-07-18T14:15:02.1207205Z [cluster2]                                                                 "finishedAt": {
2021-07-18T14:15:02.1208182Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:02.1209350Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1210220Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1210864Z [cluster2]                                                                 },
2021-07-18T14:15:02.1211316Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1212182Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:02.1212881Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1213504Z [cluster2]                                                                 },
2021-07-18T14:15:02.1219911Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1221283Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:02.1222211Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1222734Z [cluster2]                                                                 },
2021-07-18T14:15:02.1223409Z [cluster2]                                                                 "signal": {
2021-07-18T14:15:02.1225291Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:02.1226153Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.1227134Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.1227670Z [cluster2]                                                                 },
2021-07-18T14:15:02.1228211Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.1229038Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:02.1230255Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1231333Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1231942Z [cluster2]                                                                 }
2021-07-18T14:15:02.1232510Z [cluster2]                                                             },
2021-07-18T14:15:02.1233169Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.1233661Z [cluster2]                                                                 "exitCode"
2021-07-18T14:15:02.1234129Z [cluster2]                                                             ],
2021-07-18T14:15:02.1234586Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1235055Z [cluster2]                                                         },
2021-07-18T14:15:02.1235500Z [cluster2]                                                         "waiting": {
2021-07-18T14:15:02.1236110Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:02.1236811Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1237306Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1238277Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:02.1239224Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1239731Z [cluster2]                                                                 },
2021-07-18T14:15:02.1240222Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1241165Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:02.1242206Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1242682Z [cluster2]                                                                 }
2021-07-18T14:15:02.1243129Z [cluster2]                                                             },
2021-07-18T14:15:02.1243781Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1244277Z [cluster2]                                                         }
2021-07-18T14:15:02.1244722Z [cluster2]                                                     },
2021-07-18T14:15:02.1245194Z [cluster2]                                                     "type": "object"
2021-07-18T14:15:02.1245756Z [cluster2]                                                 },
2021-07-18T14:15:02.1246228Z [cluster2]                                                 "type": "array"
2021-07-18T14:15:02.1250839Z [cluster2]                                             },
2021-07-18T14:15:02.1251285Z [cluster2]                                             "status": {
2021-07-18T14:15:02.1252027Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:02.1252816Z [cluster2]                                                 "properties": {
2021-07-18T14:15:02.1253369Z [cluster2]                                                     "collisionCount": {
2021-07-18T14:15:02.1254603Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:02.1255950Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1256489Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1256980Z [cluster2]                                                     },
2021-07-18T14:15:02.1257439Z [cluster2]                                                     "conditions": {
2021-07-18T14:15:02.1258800Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:02.1259598Z [cluster2]                                                         "items": {
2021-07-18T14:15:02.1260405Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:02.1261239Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1262005Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-18T14:15:02.1262807Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:02.1263782Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1264330Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1264805Z [cluster2]                                                                 },
2021-07-18T14:15:02.1265255Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1265998Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:02.1266840Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1267312Z [cluster2]                                                                 },
2021-07-18T14:15:02.1267755Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1268673Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:02.1269357Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1269818Z [cluster2]                                                                 },
2021-07-18T14:15:02.1270273Z [cluster2]                                                                 "status": {
2021-07-18T14:15:02.1270927Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:02.1271620Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1272095Z [cluster2]                                                                 },
2021-07-18T14:15:02.1272532Z [cluster2]                                                                 "type": {
2021-07-18T14:15:02.1273145Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:02.1273759Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1274235Z [cluster2]                                                                 }
2021-07-18T14:15:02.1274650Z [cluster2]                                                             },
2021-07-18T14:15:02.1275115Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.1275603Z [cluster2]                                                                 "status",
2021-07-18T14:15:02.1276065Z [cluster2]                                                                 "type"
2021-07-18T14:15:02.1276515Z [cluster2]                                                             ],
2021-07-18T14:15:02.1276971Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1277437Z [cluster2]                                                         },
2021-07-18T14:15:02.1277970Z [cluster2]                                                         "type": "array"
2021-07-18T14:15:02.1278442Z [cluster2]                                                     },
2021-07-18T14:15:02.1279021Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-18T14:15:02.1280258Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1281376Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1281871Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1282340Z [cluster2]                                                     },
2021-07-18T14:15:02.1282920Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:02.1284209Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1285472Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1285963Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1286508Z [cluster2]                                                     },
2021-07-18T14:15:02.1286996Z [cluster2]                                                     "numberAvailable": {
2021-07-18T14:15:02.1288929Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.1290151Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1290632Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1291086Z [cluster2]                                                     },
2021-07-18T14:15:02.1291599Z [cluster2]                                                     "numberMisscheduled": {
2021-07-18T14:15:02.1298812Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1299916Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1300400Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1300863Z [cluster2]                                                     },
2021-07-18T14:15:02.1301328Z [cluster2]                                                     "numberReady": {
2021-07-18T14:15:02.1302131Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:02.1304460Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1305052Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1305589Z [cluster2]                                                     },
2021-07-18T14:15:02.1306185Z [cluster2]                                                     "numberUnavailable": {
2021-07-18T14:15:02.1308422Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.1309905Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1310366Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1310806Z [cluster2]                                                     },
2021-07-18T14:15:02.1311309Z [cluster2]                                                     "observedGeneration": {
2021-07-18T14:15:02.1312054Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:02.1312926Z [cluster2]                                                         "format": "int64",
2021-07-18T14:15:02.1313405Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1313854Z [cluster2]                                                     },
2021-07-18T14:15:02.1314401Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:02.1315194Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:02.1315856Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1321694Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1322329Z [cluster2]                                                     }
2021-07-18T14:15:02.1322721Z [cluster2]                                                 },
2021-07-18T14:15:02.1323305Z [cluster2]                                                 "required": [
2021-07-18T14:15:02.1323880Z [cluster2]                                                     "currentNumberScheduled",
2021-07-18T14:15:02.1324554Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-18T14:15:02.1325208Z [cluster2]                                                     "numberMisscheduled",
2021-07-18T14:15:02.1325744Z [cluster2]                                                     "numberReady"
2021-07-18T14:15:02.1331078Z [cluster2]                                                 ],
2021-07-18T14:15:02.1331513Z [cluster2]                                                 "type": "object"
2021-07-18T14:15:02.1331943Z [cluster2]                                             }
2021-07-18T14:15:02.1332323Z [cluster2]                                         },
2021-07-18T14:15:02.1332740Z [cluster2]                                         "required": [
2021-07-18T14:15:02.1333337Z [cluster2]                                             "mismatchedContainerImages"
2021-07-18T14:15:02.1333880Z [cluster2]                                         ],
2021-07-18T14:15:02.1334302Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.1334707Z [cluster2]                                     },
2021-07-18T14:15:02.1335185Z [cluster2]                                     "loadBalancerStatus": {
2021-07-18T14:15:02.1335703Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.1336151Z [cluster2]                                             "status": {
2021-07-18T14:15:02.1337411Z [cluster2]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-18T14:15:02.1338167Z [cluster2]                                                 "properties": {
2021-07-18T14:15:02.1338651Z [cluster2]                                                     "ingress": {
2021-07-18T14:15:02.1339848Z [cluster2]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-18T14:15:02.1341220Z [cluster2]                                                         "items": {
2021-07-18T14:15:02.1342554Z [cluster2]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-18T14:15:02.1343555Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1344058Z [cluster2]                                                                 "hostname": {
2021-07-18T14:15:02.1345347Z [cluster2]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-18T14:15:02.1346159Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1346605Z [cluster2]                                                                 },
2021-07-18T14:15:02.1347016Z [cluster2]                                                                 "ip": {
2021-07-18T14:15:02.1348081Z [cluster2]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-18T14:15:02.1348888Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1349331Z [cluster2]                                                                 }
2021-07-18T14:15:02.1349860Z [cluster2]                                                             },
2021-07-18T14:15:02.1350290Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1350734Z [cluster2]                                                         },
2021-07-18T14:15:02.1351153Z [cluster2]                                                         "type": "array"
2021-07-18T14:15:02.1351582Z [cluster2]                                                     }
2021-07-18T14:15:02.1351958Z [cluster2]                                                 },
2021-07-18T14:15:02.1352380Z [cluster2]                                                 "type": "object"
2021-07-18T14:15:02.1352804Z [cluster2]                                             }
2021-07-18T14:15:02.1353170Z [cluster2]                                         },
2021-07-18T14:15:02.1353589Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.1353993Z [cluster2]                                     },
2021-07-18T14:15:02.1354414Z [cluster2]                                     "natEnabled": {
2021-07-18T14:15:02.1354866Z [cluster2]                                         "type": "boolean"
2021-07-18T14:15:02.1355285Z [cluster2]                                     },
2021-07-18T14:15:02.1355710Z [cluster2]                                     "networkPlugin": {
2021-07-18T14:15:02.1356192Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.1356601Z [cluster2]                                     },
2021-07-18T14:15:02.1357141Z [cluster2]                                     "routeAgentDaemonSetStatus": {
2021-07-18T14:15:02.1357751Z [cluster2]                                         "properties": {
2021-07-18T14:15:02.1358282Z [cluster2]                                             "lastResourceVersion": {
2021-07-18T14:15:02.1358823Z [cluster2]                                                 "type": "string"
2021-07-18T14:15:02.1359234Z [cluster2]                                             },
2021-07-18T14:15:02.1359798Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-18T14:15:02.1360408Z [cluster2]                                                 "type": "boolean"
2021-07-18T14:15:02.1360817Z [cluster2]                                             },
2021-07-18T14:15:02.1361356Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-18T14:15:02.1361970Z [cluster2]                                                 "items": {
2021-07-18T14:15:02.1363025Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-18T14:15:02.1364290Z [cluster2]                                                     "properties": {
2021-07-18T14:15:02.1364764Z [cluster2]                                                         "running": {
2021-07-18T14:15:02.1365359Z [cluster2]                                                             "description": "Details about a running container",
2021-07-18T14:15:02.1365963Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1366463Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.1367505Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-18T14:15:02.1368649Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1369163Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1369588Z [cluster2]                                                                 }
2021-07-18T14:15:02.1370120Z [cluster2]                                                             },
2021-07-18T14:15:02.1370552Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1370993Z [cluster2]                                                         },
2021-07-18T14:15:02.1371420Z [cluster2]                                                         "terminated": {
2021-07-18T14:15:02.1372041Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-18T14:15:02.1372658Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1373148Z [cluster2]                                                                 "containerID": {
2021-07-18T14:15:02.1374098Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-18T14:15:02.1374944Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1375404Z [cluster2]                                                                 },
2021-07-18T14:15:02.1375861Z [cluster2]                                                                 "exitCode": {
2021-07-18T14:15:02.1376517Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-18T14:15:02.1377191Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.1377684Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.1378310Z [cluster2]                                                                 },
2021-07-18T14:15:02.1378764Z [cluster2]                                                                 "finishedAt": {
2021-07-18T14:15:02.1379383Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-18T14:15:02.1380570Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1381072Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1381515Z [cluster2]                                                                 },
2021-07-18T14:15:02.1382218Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1383160Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-18T14:15:02.1383980Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1384510Z [cluster2]                                                                 },
2021-07-18T14:15:02.1385461Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1386674Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-18T14:15:02.1387853Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1388315Z [cluster2]                                                                 },
2021-07-18T14:15:02.1388743Z [cluster2]                                                                 "signal": {
2021-07-18T14:15:02.1389390Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-18T14:15:02.1390030Z [cluster2]                                                                     "format": "int32",
2021-07-18T14:15:02.1390904Z [cluster2]                                                                     "type": "integer"
2021-07-18T14:15:02.1391522Z [cluster2]                                                                 },
2021-07-18T14:15:02.1391958Z [cluster2]                                                                 "startedAt": {
2021-07-18T14:15:02.1392635Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-18T14:15:02.1393585Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1394101Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1394551Z [cluster2]                                                                 }
2021-07-18T14:15:02.1394941Z [cluster2]                                                             },
2021-07-18T14:15:02.1395379Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.1395847Z [cluster2]                                                                 "exitCode"
2021-07-18T14:15:02.1396287Z [cluster2]                                                             ],
2021-07-18T14:15:02.1396719Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1397158Z [cluster2]                                                         },
2021-07-18T14:15:02.1397590Z [cluster2]                                                         "waiting": {
2021-07-18T14:15:02.1398156Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-18T14:15:02.1398758Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1399223Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1399876Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-18T14:15:02.1400523Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1400967Z [cluster2]                                                                 },
2021-07-18T14:15:02.1401395Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1402066Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-18T14:15:02.1402704Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1403132Z [cluster2]                                                                 }
2021-07-18T14:15:02.1403542Z [cluster2]                                                             },
2021-07-18T14:15:02.1404819Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1405367Z [cluster2]                                                         }
2021-07-18T14:15:02.1405846Z [cluster2]                                                     },
2021-07-18T14:15:02.1406350Z [cluster2]                                                     "type": "object"
2021-07-18T14:15:02.1406867Z [cluster2]                                                 },
2021-07-18T14:15:02.1407531Z [cluster2]                                                 "type": "array"
2021-07-18T14:15:02.1408264Z [cluster2]                                             },
2021-07-18T14:15:02.1408670Z [cluster2]                                             "status": {
2021-07-18T14:15:02.1409332Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-18T14:15:02.1410031Z [cluster2]                                                 "properties": {
2021-07-18T14:15:02.1410668Z [cluster2]                                                     "collisionCount": {
2021-07-18T14:15:02.1411790Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-18T14:15:02.1412861Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1413329Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1413767Z [cluster2]                                                     },
2021-07-18T14:15:02.1414188Z [cluster2]                                                     "conditions": {
2021-07-18T14:15:02.1415264Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-18T14:15:02.1415976Z [cluster2]                                                         "items": {
2021-07-18T14:15:02.1416714Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-18T14:15:02.1417472Z [cluster2]                                                             "properties": {
2021-07-18T14:15:02.1418013Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-18T14:15:02.1418763Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-18T14:15:02.1419647Z [cluster2]                                                                     "format": "date-time",
2021-07-18T14:15:02.1420157Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1420604Z [cluster2]                                                                 },
2021-07-18T14:15:02.1421221Z [cluster2]                                                                 "message": {
2021-07-18T14:15:02.1421938Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-18T14:15:02.1422642Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1423193Z [cluster2]                                                                 },
2021-07-18T14:15:02.1423651Z [cluster2]                                                                 "reason": {
2021-07-18T14:15:02.1424674Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-18T14:15:02.1425311Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1425745Z [cluster2]                                                                 },
2021-07-18T14:15:02.1426172Z [cluster2]                                                                 "status": {
2021-07-18T14:15:02.1426805Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-18T14:15:02.1427433Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1427880Z [cluster2]                                                                 },
2021-07-18T14:15:02.1428290Z [cluster2]                                                                 "type": {
2021-07-18T14:15:02.1428865Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-18T14:15:02.1429441Z [cluster2]                                                                     "type": "string"
2021-07-18T14:15:02.1429979Z [cluster2]                                                                 }
2021-07-18T14:15:02.1430386Z [cluster2]                                                             },
2021-07-18T14:15:02.1430991Z [cluster2]                                                             "required": [
2021-07-18T14:15:02.1431652Z [cluster2]                                                                 "status",
2021-07-18T14:15:02.1432111Z [cluster2]                                                                 "type"
2021-07-18T14:15:02.1432558Z [cluster2]                                                             ],
2021-07-18T14:15:02.1433013Z [cluster2]                                                             "type": "object"
2021-07-18T14:15:02.1433484Z [cluster2]                                                         },
2021-07-18T14:15:02.1433942Z [cluster2]                                                         "type": "array"
2021-07-18T14:15:02.1434380Z [cluster2]                                                     },
2021-07-18T14:15:02.1434960Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-18T14:15:02.1436190Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1437455Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1437949Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1438386Z [cluster2]                                                     },
2021-07-18T14:15:02.1438944Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-18T14:15:02.1440187Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1441333Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1441824Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1442257Z [cluster2]                                                     },
2021-07-18T14:15:02.1443070Z [cluster2]                                                     "numberAvailable": {
2021-07-18T14:15:02.1444133Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.1445142Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1445651Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1446100Z [cluster2]                                                     },
2021-07-18T14:15:02.1447521Z [cluster2]                                                     "numberMisscheduled": {
2021-07-18T14:15:02.1449074Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-18T14:15:02.1450154Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1450652Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1451088Z [cluster2]                                                     },
2021-07-18T14:15:02.1451548Z [cluster2]                                                     "numberReady": {
2021-07-18T14:15:02.1454690Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-18T14:15:02.1455518Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1456015Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1456464Z [cluster2]                                                     },
2021-07-18T14:15:02.1456968Z [cluster2]                                                     "numberUnavailable": {
2021-07-18T14:15:02.1457984Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-18T14:15:02.1458953Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1459455Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1459893Z [cluster2]                                                     },
2021-07-18T14:15:02.1460410Z [cluster2]                                                     "observedGeneration": {
2021-07-18T14:15:02.1461177Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-18T14:15:02.1462165Z [cluster2]                                                         "format": "int64",
2021-07-18T14:15:02.1462990Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1463608Z [cluster2]                                                     },
2021-07-18T14:15:02.1464324Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-18T14:15:02.1465287Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-18T14:15:02.1466123Z [cluster2]                                                         "format": "int32",
2021-07-18T14:15:02.1466755Z [cluster2]                                                         "type": "integer"
2021-07-18T14:15:02.1467402Z [cluster2]                                                     }
2021-07-18T14:15:02.1468091Z [cluster2]                                                 },
2021-07-18T14:15:02.1468730Z [cluster2]                                                 "required": [
2021-07-18T14:15:02.1469692Z [cluster2]                                                     "currentNumberScheduled",
2021-07-18T14:15:02.1470601Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-18T14:15:02.1471312Z [cluster2]                                                     "numberMisscheduled",
2021-07-18T14:15:02.1471901Z [cluster2]                                                     "numberReady"
2021-07-18T14:15:02.1472381Z [cluster2]                                                 ],
2021-07-18T14:15:02.1472851Z [cluster2]                                                 "type": "object"
2021-07-18T14:15:02.1473301Z [cluster2]                                             }
2021-07-18T14:15:02.1473874Z [cluster2]                                         },
2021-07-18T14:15:02.1474296Z [cluster2]                                         "required": [
2021-07-18T14:15:02.1474927Z [cluster2]                                             "mismatchedContainerImages"
2021-07-18T14:15:02.1475684Z [cluster2]                                         ],
2021-07-18T14:15:02.1476144Z [cluster2]                                         "type": "object"
2021-07-18T14:15:02.1476583Z [cluster2]                                     },
2021-07-18T14:15:02.1477053Z [cluster2]                                     "serviceCIDR": {
2021-07-18T14:15:02.1477694Z [cluster2]                                         "type": "string"
2021-07-18T14:15:02.1478129Z [cluster2]                                     }
2021-07-18T14:15:02.1478754Z [cluster2]                                 },
2021-07-18T14:15:02.1479337Z [cluster2]                                 "required": [
2021-07-18T14:15:02.1479842Z [cluster2]                                     "clusterID",
2021-07-18T14:15:02.1480625Z [cluster2]                                     "natEnabled"
2021-07-18T14:15:02.1482296Z [cluster2]                                 ],
2021-07-18T14:15:02.1483016Z [cluster2]                                 "type": "object"
2021-07-18T14:15:02.1483711Z [cluster2]                             }
2021-07-18T14:15:02.1484115Z [cluster2]                         },
2021-07-18T14:15:02.1484998Z [cluster2]                         "type": "object"
2021-07-18T14:15:02.1485546Z [cluster2]                     }
2021-07-18T14:15:02.1485886Z [cluster2]                 },
2021-07-18T14:15:02.1486588Z [cluster2]                 "served": true,
2021-07-18T14:15:02.1487135Z [cluster2]                 "storage": true,
2021-07-18T14:15:04.4205631Z [cluster2]                 "subresources": {
2021-07-18T14:15:04.4206123Z [cluster2]                     "status": {}
2021-07-18T14:15:04.4206714Z [cluster2]                 }
2021-07-18T14:15:04.4207272Z [cluster2]             }
2021-07-18T14:15:04.4208145Z [cluster2]         ]
2021-07-18T14:15:04.4208536Z [cluster2]     },
2021-07-18T14:15:04.4209155Z [cluster2]     "status": {
2021-07-18T14:15:04.4209651Z [cluster2]         "acceptedNames": {
2021-07-18T14:15:04.4210737Z [cluster2]             "kind": "Submariner",
2021-07-18T14:15:04.4211424Z [cluster2]             "listKind": "SubmarinerList",
2021-07-18T14:15:04.4211944Z [cluster2]             "plural": "submariners",
2021-07-18T14:15:04.4212841Z [cluster2]             "singular": "submariner"
2021-07-18T14:15:04.4213245Z [cluster2]         },
2021-07-18T14:15:04.4213631Z [cluster2]         "conditions": [
2021-07-18T14:15:04.4214011Z [cluster2]             {
2021-07-18T14:15:04.4215081Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:33Z",
2021-07-18T14:15:04.4215658Z [cluster2]                 "message": "no conflicts found",
2021-07-18T14:15:04.4216181Z [cluster2]                 "reason": "NoConflicts",
2021-07-18T14:15:04.4216636Z [cluster2]                 "status": "True",
2021-07-18T14:15:04.4217116Z [cluster2]                 "type": "NamesAccepted"
2021-07-18T14:15:04.4217790Z [cluster2]             },
2021-07-18T14:15:04.4218277Z [cluster2]             {
2021-07-18T14:15:04.4219165Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:33Z",
2021-07-18T14:15:04.4219777Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-18T14:15:04.4220424Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:04.4220947Z [cluster2]                 "status": "True",
2021-07-18T14:15:04.4221394Z [cluster2]                 "type": "Established"
2021-07-18T14:15:04.4221917Z [cluster2]             }
2021-07-18T14:15:04.4222436Z [cluster2]         ],
2021-07-18T14:15:04.4222838Z [cluster2]         "storedVersions": [
2021-07-18T14:15:04.4223288Z [cluster2]             "v1alpha1"
2021-07-18T14:15:04.4223662Z [cluster2]         ]
2021-07-18T14:15:04.4223986Z [cluster2]     }
2021-07-18T14:15:04.4224320Z [cluster2] }
2021-07-18T14:15:04.4225430Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:15:04.4226819Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:15:04.4228391Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:04.4230439Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:04.4231682Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-18T14:15:04.4233502Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:04.4235295Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:04.4236287Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-18T14:15:04.4237575Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:04.4238846Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-18T14:15:04.4239882Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-18T14:15:04.4241207Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-18T14:15:04.4242389Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-18T14:15:04.4243207Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-18T14:15:04.4244107Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-18T14:15:04.4245102Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-18T14:15:04.4246186Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-18T14:15:04.4247095Z [cluster2] NAME                  STATUS   AGE
2021-07-18T14:15:04.4248369Z [cluster2] submariner-operator   Active   89s
2021-07-18T14:15:04.4249802Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:15:04.4251562Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-18T14:15:04.4253086Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-18T14:15:04.4254070Z [cluster2] NAME                        CREATED AT
2021-07-18T14:15:04.4255493Z [cluster2] submariners.submariner.io   2021-07-18T14:13:33Z
2021-07-18T14:15:04.4256976Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-18T14:15:04.4257893Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-18T14:15:04.4258903Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-18T14:15:04.4260189Z [submariner-operator]$ [cluster2] grep submariners
2021-07-18T14:15:04.4261007Z [cluster2] submariners                                    submariner.io/v1alpha1                 true         Submariner
2021-07-18T14:15:04.4262175Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.4263573Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.4265070Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5541481Z [cluster2] NAMo conflicts found",
2021-07-18T14:15:04.5542026Z [cluster1]                 "reason": "NoConflicts",
2021-07-18T14:15:04.5542503Z [cluster1]                 "status": "True",
2021-07-18T14:15:04.5542976Z [cluster1]                 "type": "NamesAccepted"
2021-07-18T14:15:04.5543575Z [cluster1]             },
2021-07-18T14:15:04.5545723Z [cluster1]             {
2021-07-18T14:15:04.5547001Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:21Z",
2021-07-18T14:15:04.5547780Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-18T14:15:04.5548683Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-18T14:15:04.5549291Z [cluster1]                 "status": "True",
2021-07-18T14:15:04.5549945Z [cluster1]                 "type": "Established"
2021-07-18T14:15:04.5550544Z [cluster1]             }
2021-07-18T14:15:04.5550887Z [cluster1]         ],
2021-07-18T14:15:04.5551724Z [cluster1]         "storedVersions": [
2021-07-18T14:15:04.5552315Z [cluster1]             "v1alpha1"
2021-07-18T14:15:04.5552678Z [cluster1]         ]
2021-07-18T14:15:04.5553010Z [cluster1]     }
2021-07-18T14:15:04.5553318Z [cluster1] }
2021-07-18T14:15:04.5554438Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:15:04.5556106Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-18T14:15:04.5557792Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:04.5559243Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:04.5560231Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-18T14:15:04.5561513Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:04.5562777Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:04.5563790Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-18T14:15:04.5565063Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:04.5567175Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-18T14:15:04.5570232Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-18T14:15:04.5572491Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-18T14:15:04.5573881Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-18T14:15:04.5575111Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-18T14:15:04.5576461Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-18T14:15:04.5577533Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-18T14:15:04.5578704Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-18T14:15:04.5579394Z [cluster1] NAME                  STATUS   AGE
2021-07-18T14:15:04.5580026Z [cluster1] submariner-operator   Active   101s
2021-07-18T14:15:04.5580938Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:15:04.5582746Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-18T14:15:04.5584312Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-18T14:15:04.5585426Z [cluster1] NAME                        CREATED AT
2021-07-18T14:15:04.5586330Z [cluster1] submariners.submariner.io   2021-07-18T14:13:21Z
2021-07-18T14:15:04.5587163Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-18T14:15:04.5588164Z [submariner-operator]$ [cluster1] grep submariners
2021-07-18T14:15:04.5588983Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-18T14:15:04.5589900Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-18T14:15:04.5590704Z [cluster1] submariners                                    submariner.io/v1alpha1                 true         Submariner
2021-07-18T14:15:04.5591785Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5593065Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5594434Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5595422Z [cluster1] NAME                  SECRETS   AGE
2021-07-18T14:15:04.5596144Z [cluster1] submariner-operator   1         103s
2021-07-18T14:15:04.5597303Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5598606Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5600041Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:04.5600909Z [cluster1] NAME                  CREATED AT
2021-07-18T14:15:04.5601557Z [cluster1] submariner-operator   2021-07-18T14:13:21Z
2021-07-18T14:15:06.0321917Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0323497Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0325105Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0326280Z [cluster1] NAME                  ROLE                       AGE
2021-07-18T14:15:06.0327216Z [cluster1] submariner-operator   Role/submariner-operator   103s
2021-07-18T14:15:06.0328551Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0329968Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0331501Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.0332644Z [cluster1] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-18T14:15:06.0333368Z [cluster1] submariner-operator   1/1     1            1           98s
2021-07-18T14:15:06.0334461Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-18T14:15:06.0335257Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-18T14:15:06.0336492Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:15:06.0338297Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.0340136Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.0342294Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.0345031Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o json
2021-07-18T14:15:06.0347969Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o json
2021-07-18T14:15:06.0349760Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o json
2021-07-18T14:15:06.0350748Z [cluster1] {
2021-07-18T14:15:06.0351113Z [cluster1]     "apiVersion": "v1",
2021-07-18T14:15:06.0351491Z [cluster1]     "kind": "Pod",
2021-07-18T14:15:06.0351860Z [cluster1]     "metadata": {
2021-07-18T14:15:06.0352473Z [cluster1]         "creationTimestamp": "2021-07-18T14:13:27Z",
2021-07-18T14:15:06.0353338Z [cluster1]         "generateName": "submariner-operator-5bfdb87494-",
2021-07-18T14:15:06.0354139Z [cluster1]         "labels": {
2021-07-18T14:15:06.0354750Z [cluster1]             "name": "submariner-operator",
2021-07-18T14:15:06.0355449Z [cluster1]             "pod-template-hash": "5bfdb87494"
2021-07-18T14:15:06.0356048Z [cluster1]         },
2021-07-18T14:15:06.0356442Z [cluster1]         "managedFields": [
2021-07-18T14:15:06.0356819Z [cluster1]             {
2021-07-18T14:15:06.0357203Z [cluster1]                 "apiVersion": "v1",
2021-07-18T14:15:06.0357832Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:06.0358479Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:06.0358896Z [cluster1]                     "f:metadata": {
2021-07-18T14:15:06.0360017Z [cluster1]                         "f:generateName": {},
2021-07-18T14:15:06.0360690Z [cluster1]                         "f:labels": {
2021-07-18T14:15:06.0361510Z [cluster1]                             ".": {},
2021-07-18T14:15:06.0362079Z [cluster1]                             "f:name": {},
2021-07-18T14:15:06.0363206Z [cluster1]                             "f:pod-template-hash": {}
2021-07-18T14:15:06.0364029Z [cluster1]                         },
2021-07-18T14:15:06.0364487Z [cluster1]                         "f:ownerReferences": {
2021-07-18T14:15:06.0365198Z [cluster1]                             ".": {},
2021-07-18T14:15:06.0366206Z [cluster1]                             "k:{\"uid\":\"3eb8090f-47a0-411c-98b8-307103fab9ce\"}": {
2021-07-18T14:15:06.0366802Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0367274Z [cluster1]                                 "f:apiVersion": {},
2021-07-18T14:15:06.0369044Z [cluster1]                                 "f:blockOwnerDeletion": {},
2021-07-18T14:15:06.0369595Z [cluster1]                                 "f:controller": {},
2021-07-18T14:15:06.0370044Z [cluster1]                                 "f:kind": {},
2021-07-18T14:15:06.0370459Z [cluster1]                                 "f:name": {},
2021-07-18T14:15:06.0371014Z [cluster1]                                 "f:uid": {}
2021-07-18T14:15:06.0371390Z [cluster1]                             }
2021-07-18T14:15:06.0371905Z [cluster1]                         }
2021-07-18T14:15:06.0372266Z [cluster1]                     },
2021-07-18T14:15:06.0372639Z [cluster1]                     "f:spec": {
2021-07-18T14:15:06.0373074Z [cluster1]                         "f:containers": {
2021-07-18T14:15:06.0373858Z [cluster1]                             "k:{\"name\":\"submariner-operator\"}": {
2021-07-18T14:15:06.0374725Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0375474Z [cluster1]                                 "f:command": {},
2021-07-18T14:15:06.0376162Z [cluster1]                                 "f:env": {
2021-07-18T14:15:06.0376576Z [cluster1]                                     ".": {},
2021-07-18T14:15:06.0377249Z [cluster1]                                     "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-18T14:15:06.0377722Z [cluster1]                                         ".": {},
2021-07-18T14:15:06.0378125Z [cluster1]                                         "f:name": {},
2021-07-18T14:15:06.0378554Z [cluster1]                                         "f:value": {}
2021-07-18T14:15:06.0379295Z [cluster1]                                     },
2021-07-18T14:15:06.0379737Z [cluster1]                                     "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:15:06.0380344Z [cluster1]                                         ".": {},
2021-07-18T14:15:06.0381253Z [cluster1]                                         "f:name": {},
2021-07-18T14:15:06.0382305Z [cluster1]                                         "f:valueFrom": {
2021-07-18T14:15:06.0383063Z [cluster1]                                             ".": {},
2021-07-18T14:15:06.0383586Z [cluster1]                                             "f:fieldRef": {
2021-07-18T14:15:06.0384086Z [cluster1]                                                 ".": {},
2021-07-18T14:15:06.0384630Z [cluster1]                                                 "f:apiVersion": {},
2021-07-18T14:15:06.0385219Z [cluster1]                                                 "f:fieldPath": {}
2021-07-18T14:15:06.0385728Z [cluster1]                                             }
2021-07-18T14:15:06.0386793Z [cluster1]                                         }
2021-07-18T14:15:06.0387379Z [cluster1]                                     },
2021-07-18T14:15:06.0388024Z [cluster1]                                     "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-18T14:15:06.0388677Z [cluster1]                                         ".": {},
2021-07-18T14:15:06.0389530Z [cluster1]                                         "f:name": {},
2021-07-18T14:15:06.0390061Z [cluster1]                                         "f:valueFrom": {
2021-07-18T14:15:06.0390577Z [cluster1]                                             ".": {},
2021-07-18T14:15:06.0391094Z [cluster1]                                             "f:fieldRef": {
2021-07-18T14:15:06.0391599Z [cluster1]                                                 ".": {},
2021-07-18T14:15:06.0392145Z [cluster1]                                                 "f:apiVersion": {},
2021-07-18T14:15:06.0392833Z [cluster1]                                                 "f:fieldPath": {}
2021-07-18T14:15:06.0393808Z [cluster1]                                             }
2021-07-18T14:15:06.0394172Z [cluster1]                                         }
2021-07-18T14:15:06.0395735Z [cluster1]                                     }
2021-07-18T14:15:06.0396179Z [cluster1]                                 },
2021-07-18T14:15:06.0396658Z [cluster1]                                 "f:image": {},
2021-07-18T14:15:06.0397256Z [cluster1]                                 "f:imagePullPolicy": {},
2021-07-18T14:15:06.0397820Z [cluster1]                                 "f:name": {},
2021-07-18T14:15:06.0398346Z [cluster1]                                 "f:resources": {},
2021-07-18T14:15:06.0399308Z [cluster1]                                 "f:terminationMessagePath": {},
2021-07-18T14:15:06.0400138Z [cluster1]                                 "f:terminationMessagePolicy": {}
2021-07-18T14:15:06.0401024Z [cluster1]                             }
2021-07-18T14:15:06.0401608Z [cluster1]                         },
2021-07-18T14:15:06.0402193Z [cluster1]                         "f:dnsPolicy": {},
2021-07-18T14:15:06.0402745Z [cluster1]                         "f:enableServiceLinks": {},
2021-07-18T14:15:06.0403323Z [cluster1]                         "f:restartPolicy": {},
2021-07-18T14:15:06.0403837Z [cluster1]                         "f:schedulerName": {},
2021-07-18T14:15:06.0404382Z [cluster1]                         "f:securityContext": {},
2021-07-18T14:15:06.0405534Z [cluster1]                         "f:serviceAccount": {},
2021-07-18T14:15:06.0406094Z [cluster1]                         "f:serviceAccountName": {},
2021-07-18T14:15:06.0406950Z [cluster1]                         "f:terminationGracePeriodSeconds": {}
2021-07-18T14:15:06.0407540Z [cluster1]                     }
2021-07-18T14:15:06.0408000Z [cluster1]                 },
2021-07-18T14:15:06.0408966Z [cluster1]                 "manager": "kube-controller-manager",
2021-07-18T14:15:06.0409538Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:06.0410122Z [cluster1]                 "time": "2021-07-18T14:13:27Z"
2021-07-18T14:15:06.0410495Z [cluster1]             },
2021-07-18T14:15:06.0410808Z [cluster1]             {
2021-07-18T14:15:06.0411192Z [cluster1]                 "apiVersion": "v1",
2021-07-18T14:15:06.0411646Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:06.0412092Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:06.0412660Z [cluster1]                     "f:status": {
2021-07-18T14:15:06.0413082Z [cluster1]                         "f:conditions": {
2021-07-18T14:15:06.0413600Z [cluster1]                             "k:{\"type\":\"ContainersReady\"}": {
2021-07-18T14:15:06.0414446Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0415127Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.0416090Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.0416821Z [cluster1]                                 "f:status": {},
2021-07-18T14:15:06.0417441Z [cluster1]                                 "f:type": {}
2021-07-18T14:15:06.0418211Z [cluster1]                             },
2021-07-18T14:15:06.0418813Z [cluster1]                             "k:{\"type\":\"Initialized\"}": {
2021-07-18T14:15:06.0419784Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0420448Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.0421458Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.0422099Z [cluster1]                                 "f:status": {},
2021-07-18T14:15:06.0422587Z [cluster1]                                 "f:type": {}
2021-07-18T14:15:06.0423056Z [cluster1]                             },
2021-07-18T14:15:06.0423538Z [cluster1]                             "k:{\"type\":\"Ready\"}": {
2021-07-18T14:15:06.0424039Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0424568Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.0425528Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.0426278Z [cluster1]                                 "f:status": {},
2021-07-18T14:15:06.0426730Z [cluster1]                                 "f:type": {}
2021-07-18T14:15:06.0427165Z [cluster1]                             }
2021-07-18T14:15:06.0427552Z [cluster1]                         },
2021-07-18T14:15:06.0428390Z [cluster1]                         "f:containerStatuses": {},
2021-07-18T14:15:06.0429058Z [cluster1]                         "f:hostIP": {},
2021-07-18T14:15:06.0429642Z [cluster1]                         "f:phase": {},
2021-07-18T14:15:06.0430039Z [cluster1]                         "f:podIP": {},
2021-07-18T14:15:06.0430454Z [cluster1]                         "f:podIPs": {
2021-07-18T14:15:06.0430905Z [cluster1]                             ".": {},
2021-07-18T14:15:06.0431291Z [cluster1]                             "k:{\"ip\":\"10.0.0.3\"}": {
2021-07-18T14:15:06.0431701Z [cluster1]                                 ".": {},
2021-07-18T14:15:06.0432073Z [cluster1]                                 "f:ip": {}
2021-07-18T14:15:06.0432449Z [cluster1]                             }
2021-07-18T14:15:06.0432792Z [cluster1]                         },
2021-07-18T14:15:06.0433193Z [cluster1]                         "f:startTime": {}
2021-07-18T14:15:06.0433570Z [cluster1]                     }
2021-07-18T14:15:06.0433998Z [cluster1]                 },
2021-07-18T14:15:06.0434511Z [cluster1]                 "manager": "kubelet",
2021-07-18T14:15:06.0434968Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:06.0435609Z [cluster1]                 "time": "2021-07-18T14:13:37Z"
2021-07-18T14:15:06.0435968Z [cluster1]             }
2021-07-18T14:15:06.0436298Z [cluster1]         ],
2021-07-18T14:15:06.0437073Z [cluster1]         "name": "submariner-operator-5bfdb87494-wxkzw",
2021-07-18T14:15:06.0437996Z [cluster1]         "namespace": "submariner-operator",
2021-07-18T14:15:06.0438539Z [cluster1]         "ownerReferences": [
2021-07-18T14:15:06.0438948Z [cluster1]             {
2021-07-18T14:15:06.0439332Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-18T14:15:06.0439858Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-18T14:15:06.0440353Z [cluster1]                 "controller": true,
2021-07-18T14:15:06.0440808Z [cluster1]                 "kind": "ReplicaSet",
2021-07-18T14:15:06.0441612Z [cluster1]                 "name": "submariner-operator-5bfdb87494",
2021-07-18T14:15:06.0442479Z [cluster1]                 "uid": "3eb8090f-47a0-411c-98b8-307103fab9ce"
2021-07-18T14:15:06.0442952Z [cluster1]             }
2021-07-18T14:15:06.0443265Z [cluster1]         ],
2021-07-18T14:15:06.0443674Z [cluster1]         "resourceVersion": "1567",
2021-07-18T14:15:06.0444420Z [cluster1]         "uid": "d87968ae-ffcb-4ebc-a5ac-221077ab074d"
2021-07-18T14:15:06.0444942Z [cluster1]     },
2021-07-18T14:15:06.0445377Z [cluster1]     "spec": {
2021-07-18T14:15:06.0445758Z [cluster1]         "containers": [
2021-07-18T14:15:06.0446109Z [cluster1]             {
2021-07-18T14:15:06.0446462Z [cluster1]                 "command": [
2021-07-18T14:15:06.0447106Z [cluster1]                     "submariner-operator",
2021-07-18T14:15:06.0449760Z [cluster1]                     "-alsologtostderr",
2021-07-18T14:15:06.0450456Z [cluster1]                     "-v=1"
2021-07-18T14:15:06.0450800Z [cluster1]                 ],
2021-07-18T14:15:06.0451151Z [cluster1]                 "env": [
2021-07-18T14:15:06.0451485Z [cluster1]                     {
2021-07-18T14:15:06.0451905Z [cluster1]                         "name": "WATCH_NAMESPACE",
2021-07-18T14:15:06.0452343Z [cluster1]                         "valueFrom": {
2021-07-18T14:15:06.0452763Z [cluster1]                             "fieldRef": {
2021-07-18T14:15:06.0453188Z [cluster1]                                 "apiVersion": "v1",
2021-07-18T14:15:06.0453743Z [cluster1]                                 "fieldPath": "metadata.namespace"
2021-07-18T14:15:06.0454353Z [cluster1]                             }
2021-07-18T14:15:06.0454673Z [cluster1]                         }
2021-07-18T14:15:06.0455004Z [cluster1]                     },
2021-07-18T14:15:06.0455317Z [cluster1]                     {
2021-07-18T14:15:06.0455698Z [cluster1]                         "name": "POD_NAME",
2021-07-18T14:15:06.0456093Z [cluster1]                         "valueFrom": {
2021-07-18T14:15:06.0456502Z [cluster1]                             "fieldRef": {
2021-07-18T14:15:06.0456914Z [cluster1]                                 "apiVersion": "v1",
2021-07-18T14:15:06.0457408Z [cluster1]                                 "fieldPath": "metadata.name"
2021-07-18T14:15:06.0457828Z [cluster1]                             }
2021-07-18T14:15:06.0458168Z [cluster1]                         }
2021-07-18T14:15:06.0458502Z [cluster1]                     },
2021-07-18T14:15:06.0458816Z [cluster1]                     {
2021-07-18T14:15:06.0459216Z [cluster1]                         "name": "OPERATOR_NAME",
2021-07-18T14:15:06.0459893Z [cluster1]                         "value": "submariner-operator"
2021-07-18T14:15:06.0460353Z [cluster1]                     }
2021-07-18T14:15:06.0460663Z [cluster1]                 ],
2021-07-18T14:15:06.0461320Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:15:06.0462093Z [cluster1]                 "imagePullPolicy": "IfNotPresent",
2021-07-18T14:15:06.0462867Z [cluster1]                 "name": "submariner-operator",
2021-07-18T14:15:06.0463361Z [cluster1]                 "resources": {},
2021-07-18T14:15:06.0464089Z [cluster1]                 "terminationMessagePath": "/dev/termination-log",
2021-07-18T14:15:06.0464821Z [cluster1]                 "terminationMessagePolicy": "File",
2021-07-18T14:15:06.0465363Z [cluster1]                 "volumeMounts": [
2021-07-18T14:15:06.0465745Z [cluster1]                     {
2021-07-18T14:15:06.0466277Z [cluster1]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-18T14:15:06.0467606Z [cluster1]                         "name": "submariner-operator-token-r2vlt",
2021-07-18T14:15:06.0468232Z [cluster1]                         "readOnly": true
2021-07-18T14:15:06.0468608Z [cluster1]                     }
2021-07-18T14:15:06.0469108Z [cluster1]                 ]
2021-07-18T14:15:06.0469427Z [cluster1]             }
2021-07-18T14:15:06.0469761Z [cluster1]         ],
2021-07-18T14:15:06.0470165Z [cluster1]         "dnsPolicy": "ClusterFirst",
2021-07-18T14:15:06.0470705Z [cluster1]         "enableServiceLinks": true,
2021-07-18T14:15:06.0471412Z [cluster1]         "nodeName": "cluster1-worker2",
2021-07-18T14:15:06.0472084Z [cluster1]         "preemptionPolicy": "PreemptLowerPriority",
2021-07-18T14:15:06.0472805Z [cluster1]         "priority": 0,
2021-07-18T14:15:06.0473424Z [cluster1]         "restartPolicy": "Always",
2021-07-18T14:15:06.0474278Z [cluster1]         "schedulerName": "default-scheduler",
2021-07-18T14:15:06.0474843Z [cluster1]         "securityContext": {},
2021-07-18T14:15:06.0475578Z [cluster1]         "serviceAccount": "submariner-operator",
2021-07-18T14:15:06.0476596Z [cluster1]         "serviceAccountName": "submariner-operator",
2021-07-18T14:15:06.0477344Z [cluster1]         "terminationGracePeriodSeconds": 30,
2021-07-18T14:15:06.0478205Z [cluster1]         "tolerations": [
2021-07-18T14:15:06.0478580Z [cluster1]             {
2021-07-18T14:15:06.0478952Z [cluster1]                 "effect": "NoExecute",
2021-07-18T14:15:06.0479675Z [cluster1]                 "key": "node.kubernetes.io/not-ready",
2021-07-18T14:15:06.0480183Z [cluster1]                 "operator": "Exists",
2021-07-18T14:15:06.0480657Z [cluster1]                 "tolerationSeconds": 300
2021-07-18T14:15:06.0481054Z [cluster1]             },
2021-07-18T14:15:06.0481376Z [cluster1]             {
2021-07-18T14:15:06.0481767Z [cluster1]                 "effect": "NoExecute",
2021-07-18T14:15:06.0482296Z [cluster1]                 "key": "node.kubernetes.io/unreachable",
2021-07-18T14:15:06.0482828Z [cluster1]                 "operator": "Exists",
2021-07-18T14:15:06.0483283Z [cluster1]                 "tolerationSeconds": 300
2021-07-18T14:15:06.0483694Z [cluster1]             }
2021-07-18T14:15:06.0483994Z [cluster1]         ],
2021-07-18T14:15:06.0484330Z [cluster1]         "volumes": [
2021-07-18T14:15:06.0484656Z [cluster1]             {
2021-07-18T14:15:06.0485395Z [cluster1]                 "name": "submariner-operator-token-r2vlt",
2021-07-18T14:15:06.0485978Z [cluster1]                 "secret": {
2021-07-18T14:15:06.0486384Z [cluster1]                     "defaultMode": 420,
2021-07-18T14:15:06.0487198Z [cluster1]                     "secretName": "submariner-operator-token-r2vlt"
2021-07-18T14:15:06.0487938Z [cluster1]                 }
2021-07-18T14:15:06.0488264Z [cluster1]             }
2021-07-18T14:15:06.0488563Z [cluster1]         ]
2021-07-18T14:15:06.0488878Z [cluster1]     },
2021-07-18T14:15:06.0489191Z [cluster1]     "status": {
2021-07-18T14:15:06.0489564Z [cluster1]         "conditions": [
2021-07-18T14:15:06.0489901Z [cluster1]             {
2021-07-18T14:15:06.0490302Z [cluster1]                 "lastProbeTime": null,
2021-07-18T14:15:06.0490999Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:27Z",
2021-07-18T14:15:06.0491485Z [cluster1]                 "status": "True",
2021-07-18T14:15:06.0492014Z [cluster1]                 "type": "Initialized"
2021-07-18T14:15:06.0492418Z [cluster1]             },
2021-07-18T14:15:06.0492739Z [cluster1]             {
2021-07-18T14:15:06.0493124Z [cluster1]                 "lastProbeTime": null,
2021-07-18T14:15:06.0493832Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:37Z",
2021-07-18T14:15:06.0494302Z [cluster1]                 "status": "True",
2021-07-18T14:15:06.0494695Z [cluster1]                 "type": "Ready"
2021-07-18T14:15:06.0496837Z [cluster1]             },
2021-07-18T14:15:06.0497275Z [cluster1]             {
2021-07-18T14:15:06.0497779Z [cluster1]                 "lastProbeTime": null,
2021-07-18T14:15:06.0498782Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:37Z",
2021-07-18T14:15:06.0499398Z [cluster1]                 "status": "True",
2021-07-18T14:15:06.0500934Z [cluster1]                 "type": "ContainersReady"
2021-07-18T14:15:06.0501681Z [cluster1]             },
2021-07-18T14:15:06.0502075Z [cluster1]             {
2021-07-18T14:15:06.0502597Z [cluster1]                 "lastProbeTime": null,
2021-07-18T14:15:06.0504467Z [cluster1]                 "lastTransitionTime": "2021-07-18T14:13:27Z",
2021-07-18T14:15:06.0505173Z [cluster1]                 "status": "True",
2021-07-18T14:15:06.0505985Z [cluster1]                 "type": "PodScheduled"
2021-07-18T14:15:06.0506552Z [cluster1]             }
2021-07-18T14:15:06.0506877Z [cluster1]         ],
2021-07-18T14:15:06.0507294Z [cluster1]         "containerStatuses": [
2021-07-18T14:15:06.0507892Z [cluster1]             {
2021-07-18T14:15:06.0509259Z [cluster1]                 "containerID": "containerd://50a5aaa60feb6935e200a6a655d10ea331bd9663eaf0085f5389f095cdfb1de1",
2021-07-18T14:15:06.0528556Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:15:06.0530315Z [cluster1]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-18T14:15:06.0531230Z [cluster1]                 "lastState": {
2021-07-18T14:15:06.0531629Z [cluster1]                     "terminated": {
2021-07-18T14:15:06.0533044Z [cluster1]                         "containerID": "containerd://978fe69bf308e91d614dbd79ff7b3f9e78fd4e2de705f106adab14b486419b2c",
2021-07-18T14:15:06.0534452Z [cluster1]                         "exitCode": 1,
2021-07-18T14:15:06.0535255Z [cluster1]                         "finishedAt": "2021-07-18T14:13:36Z",
2021-07-18T14:15:06.6685638Z [cluster1]                   E                  SECRETS   AGE
2021-07-18T14:15:06.6687332Z [cluster2] submariner-operator   1         91s
2021-07-18T14:15:06.6692115Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6693577Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6695142Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6696065Z [cluster2] NAME                  CREATED AT
2021-07-18T14:15:06.6696763Z [cluster2] submariner-operator   2021-07-18T14:13:33Z
2021-07-18T14:15:06.6697925Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6699509Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6701302Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6702263Z [cluster2] NAME                  ROLE                       AGE
2021-07-18T14:15:06.6703068Z [cluster2] submariner-operator   Role/submariner-operator   92s
2021-07-18T14:15:06.6704659Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6706491Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6708124Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-18T14:15:06.6709273Z [cluster2] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-18T14:15:06.6710022Z [cluster2] submariner-operator   1/1     1            1           86s
2021-07-18T14:15:06.6710811Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-18T14:15:06.6711603Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-18T14:15:06.6712889Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-18T14:15:06.6714568Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.6716465Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.6718293Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-18T14:15:06.6720297Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o json
2021-07-18T14:15:06.6722253Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o json
2021-07-18T14:15:06.6724327Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o json
2021-07-18T14:15:06.6725359Z [cluster2] {
2021-07-18T14:15:06.6725748Z [cluster2]     "apiVersion": "v1",
2021-07-18T14:15:06.6726151Z [cluster2]     "kind": "Pod",
2021-07-18T14:15:06.6726544Z [cluster2]     "metadata": {
2021-07-18T14:15:06.6727190Z [cluster2]         "creationTimestamp": "2021-07-18T14:13:39Z",
2021-07-18T14:15:06.6728398Z [cluster2]         "generateName": "submariner-operator-5bfdb87494-",
2021-07-18T14:15:06.6729044Z [cluster2]         "labels": {
2021-07-18T14:15:06.6729748Z [cluster2]             "name": "submariner-operator",
2021-07-18T14:15:06.6730498Z [cluster2]             "pod-template-hash": "5bfdb87494"
2021-07-18T14:15:06.6730936Z [cluster2]         },
2021-07-18T14:15:06.6731326Z [cluster2]         "managedFields": [
2021-07-18T14:15:06.6731705Z [cluster2]             {
2021-07-18T14:15:06.6732089Z [cluster2]                 "apiVersion": "v1",
2021-07-18T14:15:06.6732538Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:06.6732982Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:06.6733377Z [cluster2]                     "f:metadata": {
2021-07-18T14:15:06.6733822Z [cluster2]                         "f:generateName": {},
2021-07-18T14:15:06.6734259Z [cluster2]                         "f:labels": {
2021-07-18T14:15:06.6734623Z [cluster2]                             ".": {},
2021-07-18T14:15:06.6734996Z [cluster2]                             "f:name": {},
2021-07-18T14:15:06.6735619Z [cluster2]                             "f:pod-template-hash": {}
2021-07-18T14:15:06.6736163Z [cluster2]                         },
2021-07-18T14:15:06.6736595Z [cluster2]                         "f:ownerReferences": {
2021-07-18T14:15:06.6737032Z [cluster2]                             ".": {},
2021-07-18T14:15:06.6737749Z [cluster2]                             "k:{\"uid\":\"a135bfa3-3297-40cc-98d7-0951ee20eeb9\"}": {
2021-07-18T14:15:06.6738285Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6738824Z [cluster2]                                 "f:apiVersion": {},
2021-07-18T14:15:06.6739460Z [cluster2]                                 "f:blockOwnerDeletion": {},
2021-07-18T14:15:06.6739979Z [cluster2]                                 "f:controller": {},
2021-07-18T14:15:06.6740398Z [cluster2]                                 "f:kind": {},
2021-07-18T14:15:06.6740777Z [cluster2]                                 "f:name": {},
2021-07-18T14:15:06.6741173Z [cluster2]                                 "f:uid": {}
2021-07-18T14:15:06.6741521Z [cluster2]                             }
2021-07-18T14:15:06.6741875Z [cluster2]                         }
2021-07-18T14:15:06.6742216Z [cluster2]                     },
2021-07-18T14:15:06.6742562Z [cluster2]                     "f:spec": {
2021-07-18T14:15:06.6742970Z [cluster2]                         "f:containers": {
2021-07-18T14:15:06.6745618Z [cluster2]                             "k:{\"name\":\"submariner-operator\"}": {
2021-07-18T14:15:06.6746255Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6746744Z [cluster2]                                 "f:command": {},
2021-07-18T14:15:06.6747254Z [cluster2]                                 "f:env": {
2021-07-18T14:15:06.6747891Z [cluster2]                                     ".": {},
2021-07-18T14:15:06.6748614Z [cluster2]                                     "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-18T14:15:06.6749165Z [cluster2]                                         ".": {},
2021-07-18T14:15:06.6749634Z [cluster2]                                         "f:name": {},
2021-07-18T14:15:06.6750344Z [cluster2]                                         "f:value": {}
2021-07-18T14:15:06.6750811Z [cluster2]                                     },
2021-07-18T14:15:06.6751336Z [cluster2]                                     "k:{\"name\":\"POD_NAME\"}": {
2021-07-18T14:15:06.6752021Z [cluster2]                                         ".": {},
2021-07-18T14:15:06.6752510Z [cluster2]                                         "f:name": {},
2021-07-18T14:15:06.6753039Z [cluster2]                                         "f:valueFrom": {
2021-07-18T14:15:06.6753560Z [cluster2]                                             ".": {},
2021-07-18T14:15:06.6754075Z [cluster2]                                             "f:fieldRef": {
2021-07-18T14:15:06.6754581Z [cluster2]                                                 ".": {},
2021-07-18T14:15:06.6755446Z [cluster2]                                                 "f:apiVersion": {},
2021-07-18T14:15:06.6756443Z [cluster2]                                                 "f:fieldPath": {}
2021-07-18T14:15:06.6757050Z [cluster2]                                             }
2021-07-18T14:15:06.6757415Z [cluster2]                                         }
2021-07-18T14:15:06.6757785Z [cluster2]                                     },
2021-07-18T14:15:06.6758461Z [cluster2]                                     "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-18T14:15:06.6758922Z [cluster2]                                         ".": {},
2021-07-18T14:15:06.6759344Z [cluster2]                                         "f:name": {},
2021-07-18T14:15:06.6759848Z [cluster2]                                         "f:valueFrom": {
2021-07-18T14:15:06.6760363Z [cluster2]                                             ".": {},
2021-07-18T14:15:06.6761011Z [cluster2]                                             "f:fieldRef": {
2021-07-18T14:15:06.6761747Z [cluster2]                                                 ".": {},
2021-07-18T14:15:06.6762260Z [cluster2]                                                 "f:apiVersion": {},
2021-07-18T14:15:06.6763530Z [cluster2]                                                 "f:fieldPath": {}
2021-07-18T14:15:06.6764219Z [cluster2]                                             }
2021-07-18T14:15:06.6764881Z [cluster2]                                         }
2021-07-18T14:15:06.6765376Z [cluster2]                                     }
2021-07-18T14:15:06.6765908Z [cluster2]                                 },
2021-07-18T14:15:06.6766525Z [cluster2]                                 "f:image": {},
2021-07-18T14:15:06.6802729Z [cluster2]                                 "f:imagePullPolicy": {},
2021-07-18T14:15:06.6803300Z [cluster2]                                 "f:name": {},
2021-07-18T14:15:06.6803831Z [cluster2]                                 "f:resources": {},
2021-07-18T14:15:06.6804589Z [cluster2]                                 "f:terminationMessagePath": {},
2021-07-18T14:15:06.6805590Z [cluster2]                                 "f:terminationMessagePolicy": {}
2021-07-18T14:15:06.6806235Z [cluster2]                             }
2021-07-18T14:15:06.6806624Z [cluster2]                         },
2021-07-18T14:15:06.6807125Z [cluster2]                         "f:dnsPolicy": {},
2021-07-18T14:15:06.6808012Z [cluster2]                         "f:enableServiceLinks": {},
2021-07-18T14:15:06.6808677Z [cluster2]                         "f:restartPolicy": {},
2021-07-18T14:15:06.6809197Z [cluster2]                         "f:schedulerName": {},
2021-07-18T14:15:06.6809794Z [cluster2]                         "f:securityContext": {},
2021-07-18T14:15:06.6810853Z [cluster2]                         "f:serviceAccount": {},
2021-07-18T14:15:06.6811511Z [cluster2]                         "f:serviceAccountName": {},
2021-07-18T14:15:06.6812323Z [cluster2]                         "f:terminationGracePeriodSeconds": {}
2021-07-18T14:15:06.6812939Z [cluster2]                     }
2021-07-18T14:15:06.6813349Z [cluster2]                 },
2021-07-18T14:15:06.6814411Z [cluster2]                 "manager": "kube-controller-manager",
2021-07-18T14:15:06.6828588Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:06.6829842Z [cluster2]                 "time": "2021-07-18T14:13:39Z"
2021-07-18T14:15:06.6830390Z [cluster2]             },
2021-07-18T14:15:06.6830880Z [cluster2]             {
2021-07-18T14:15:06.6831267Z [cluster2]                 "apiVersion": "v1",
2021-07-18T14:15:06.6831754Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:06.6832281Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:06.6832699Z [cluster2]                     "f:status": {
2021-07-18T14:15:06.6833117Z [cluster2]                         "f:conditions": {
2021-07-18T14:15:06.6833729Z [cluster2]                             "k:{\"type\":\"ContainersReady\"}": {
2021-07-18T14:15:06.6834221Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6834657Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.6835600Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.6836482Z [cluster2]                                 "f:status": {},
2021-07-18T14:15:06.6837335Z [cluster2]                                 "f:type": {}
2021-07-18T14:15:06.6837787Z [cluster2]                             },
2021-07-18T14:15:06.6838377Z [cluster2]                             "k:{\"type\":\"Initialized\"}": {
2021-07-18T14:15:06.6841621Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6842326Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.6843014Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.6843615Z [cluster2]                                 "f:status": {},
2021-07-18T14:15:06.6844121Z [cluster2]                                 "f:type": {}
2021-07-18T14:15:06.6845919Z [cluster2]                             },
2021-07-18T14:15:06.6846459Z [cluster2]                             "k:{\"type\":\"Ready\"}": {
2021-07-18T14:15:06.6846966Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6847750Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-18T14:15:06.6848422Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-18T14:15:06.6849295Z [cluster2]                                 "f:status": {},
2021-07-18T14:15:06.6852067Z [cluster2]                                 "f:type": {}
2021-07-18T14:15:06.6852941Z [cluster2]                             }
2021-07-18T14:15:06.6853350Z [cluster2]                         },
2021-07-18T14:15:06.6853815Z [cluster2]                         "f:containerStatuses": {},
2021-07-18T14:15:06.6854326Z [cluster2]                         "f:hostIP": {},
2021-07-18T14:15:06.6855024Z [cluster2]                         "f:phase": {},
2021-07-18T14:15:06.6860509Z [cluster2]                         "f:podIP": {},
2021-07-18T14:15:06.6861153Z [cluster2]                         "f:podIPs": {
2021-07-18T14:15:06.6861567Z [cluster2]                             ".": {},
2021-07-18T14:15:06.6862632Z [cluster2]                             "k:{\"ip\":\"10.0.0.3\"}": {
2021-07-18T14:15:06.6863048Z [cluster2]                                 ".": {},
2021-07-18T14:15:06.6863441Z [cluster2]                                 "f:ip": {}
2021-07-18T14:15:06.6863802Z [cluster2]                             }
2021-07-18T14:15:06.6864166Z [cluster2]                         },
2021-07-18T14:15:06.6864562Z [cluster2]                         "f:startTime": {}
2021-07-18T14:15:06.6864962Z [cluster2]                     }
2021-07-18T14:15:06.6865295Z [cluster2]                 },
2021-07-18T14:15:06.6865704Z [cluster2]                 "manager": "kubelet",
2021-07-18T14:15:06.6866160Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:06.6866917Z [cluster2]                 "time": "2021-07-18T14:13:59Z"
2021-07-18T14:15:06.6867308Z [cluster2]             }
2021-07-18T14:15:06.6867630Z [cluster2]         ],
2021-07-18T14:15:06.6869465Z [cluster2]         "name": "submariner-operator-5bfdb87494-p5qx9",
2021-07-18T14:15:06.6870578Z [cluster2]         "namespace": "submariner-operator",
2021-07-18T14:15:06.6871649Z [cluster2]         "ownerReferences": [
2021-07-18T14:15:06.6872096Z [cluster2]             {
2021-07-18T14:15:06.6873048Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-18T14:15:06.6876611Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-18T14:15:06.6877353Z [cluster2]                 "controller": true,
2021-07-18T14:15:06.6877808Z [cluster2]                 "kind": "ReplicaSet",
2021-07-18T14:15:06.6878761Z [cluster2]                 "name": "submariner-operator-5bfdb87494",
2021-07-18T14:15:06.6879695Z [cluster2]                 "uid": "a135bfa3-3297-40cc-98d7-0951ee20eeb9"
2021-07-18T14:15:06.6880450Z [cluster2]             }
2021-07-18T14:15:06.6880792Z [cluster2]         ],
2021-07-18T14:15:06.6881202Z [cluster2]         "resourceVersion": "1578",
2021-07-18T14:15:06.6881994Z [cluster2]         "uid": "9c87a5c5-7216-4a3e-953d-b4f080a1e905"
2021-07-18T14:15:06.6882459Z [cluster2]     },
2021-07-18T14:15:06.6882973Z [cluster2]     "spec": {
2021-07-18T14:15:06.6883834Z [cluster2]         "containers": [
2021-07-18T14:15:06.6884212Z [cluster2]             {
2021-07-18T14:15:06.6884553Z [cluster2]                 "command": [
2021-07-18T14:15:06.6885248Z [cluster2]                     "submariner-operator",
2021-07-18T14:15:06.6885896Z [cluster2]                     "-alsologtostderr",
2021-07-18T14:15:06.6886459Z [cluster2]                     "-v=1"
2021-07-18T14:15:06.6886812Z [cluster2]                 ],
2021-07-18T14:15:06.6887149Z [cluster2]                 "env": [
2021-07-18T14:15:06.6887505Z [cluster2]                     {
2021-07-18T14:15:06.6888560Z [cluster2]                         "name": "WATCH_NAMESPACE",
2021-07-18T14:15:06.6889023Z [cluster2]                         "valueFrom": {
2021-07-18T14:15:06.6889820Z [cluster2]                             "fieldRef": {
2021-07-18T14:15:06.6890419Z [cluster2]                                 "apiVersion": "v1",
2021-07-18T14:15:06.6891004Z [cluster2]                                 "fieldPath": "metadata.namespace"
2021-07-18T14:15:06.6891544Z [cluster2]                             }
2021-07-18T14:15:06.6891909Z [cluster2]                         }
2021-07-18T14:15:06.6892451Z [cluster2]                     },
2021-07-18T14:15:06.6892812Z [cluster2]                     {
2021-07-18T14:15:06.6893517Z [cluster2]                         "name": "POD_NAME",
2021-07-18T14:15:06.6936520Z [cluster2]                         "valueFrom": {
2021-07-18T14:15:06.6937097Z [cluster2]                             "fieldRef": {
2021-07-18T14:15:06.6937575Z [cluster2]                                 "apiVersion": "v1",
2021-07-18T14:15:06.6938090Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-18T14:15:06.6938562Z [cluster2]                             }
2021-07-18T14:15:06.6938908Z [cluster2]                         }
2021-07-18T14:15:06.6939283Z [cluster2]                     },
2021-07-18T14:15:06.6939622Z [cluster2]                     {
2021-07-18T14:15:06.6940048Z [cluster2]                         "name": "OPERATOR_NAME",
2021-07-18T14:15:06.6940909Z [cluster2]                         "value": "submariner-operator"
2021-07-18T14:15:06.6941384Z [cluster2]                     }
2021-07-18T14:15:06.6941737Z [cluster2]                 ],
2021-07-18T14:15:06.6942584Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:15:06.6943357Z [cluster2]                 "imagePullPolicy": "IfNotPresent",
2021-07-18T14:15:06.6944127Z [cluster2]                 "name": "submariner-operator",
2021-07-18T14:15:06.6944732Z [cluster2]                 "resources": {},
2021-07-18T14:15:06.6946934Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-18T14:15:06.6947949Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-18T14:15:06.6948884Z [cluster2]                 "volumeMounts": [
2021-07-18T14:15:06.6949360Z [cluster2]                     {
2021-07-18T14:15:06.6950517Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-18T14:15:06.6951996Z [cluster2]                         "name": "submariner-operator-token-jmt2z",
2021-07-18T14:15:06.6952694Z [cluster2]                         "readOnly": true
2021-07-18T14:15:06.6953094Z [cluster2]                     }
2021-07-18T14:15:06.6953464Z [cluster2]                 ]
2021-07-18T14:15:06.6953809Z [cluster2]             }
2021-07-18T14:15:06.6954161Z [cluster2]         ],
2021-07-18T14:15:06.6954771Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-18T14:15:06.6955322Z [cluster2]         "enableServiceLinks": true,
2021-07-18T14:15:06.6956065Z [cluster2]         "nodeName": "cluster2-worker2",
2021-07-18T14:15:06.6956738Z [cluster2]         "preemptionPolicy": "PreemptLowerPriority",
2021-07-18T14:15:06.6957339Z [cluster2]         "priority": 0,
2021-07-18T14:15:06.6958227Z [cluster2]         "restartPolicy": "Always",
2021-07-18T14:15:06.6959013Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-18T14:15:06.6959617Z [cluster2]         "securityContext": {},
2021-07-18T14:15:06.6960418Z [cluster2]         "serviceAccount": "submariner-operator",
2021-07-18T14:15:06.6961713Z [cluster2]         "serviceAccountName": "submariner-operator",
2021-07-18T14:15:06.6962891Z [cluster2]         "terminationGracePeriodSeconds": 30,
2021-07-18T14:15:06.6963540Z [cluster2]         "tolerations": [
2021-07-18T14:15:06.6964111Z [cluster2]             {
2021-07-18T14:15:06.6964553Z [cluster2]                 "effect": "NoExecute",
2021-07-18T14:15:06.6965320Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-18T14:15:06.6966065Z [cluster2]                 "operator": "Exists",
2021-07-18T14:15:06.6966569Z [cluster2]                 "tolerationSeconds": 300
2021-07-18T14:15:06.6967183Z [cluster2]             },
2021-07-18T14:15:06.6967518Z [cluster2]             {
2021-07-18T14:15:06.6968140Z [cluster2]                 "effect": "NoExecute",
2021-07-18T14:15:06.6968705Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-18T14:15:06.6969276Z [cluster2]                 "operator": "Exists",
2021-07-18T14:15:06.6969880Z [cluster2]                 "tolerationSeconds": 300
2021-07-18T14:15:06.6970405Z [cluster2]             }
2021-07-18T14:15:06.6970750Z [cluster2]         ],
2021-07-18T14:15:06.6971222Z [cluster2]         "volumes": [
2021-07-18T14:15:06.6971609Z [cluster2]             {
2021-07-18T14:15:06.6972431Z [cluster2]                 "name": "submariner-operator-token-jmt2z",
2021-07-18T14:15:06.6973075Z [cluster2]                 "secret": {
2021-07-18T14:15:06.6973492Z [cluster2]                     "defaultMode": 420,
2021-07-18T14:15:06.6974354Z [cluster2]                     "secretName": "submariner-operator-token-jmt2z"
2021-07-18T14:15:06.6974979Z [cluster2]                 }
2021-07-18T14:15:06.6975335Z [cluster2]             }
2021-07-18T14:15:06.6975675Z [cluster2]         ]
2021-07-18T14:15:06.6975994Z [cluster2]     },
2021-07-18T14:15:06.6976352Z [cluster2]     "status": {
2021-07-18T14:15:06.6976888Z [cluster2]         "conditions": [
2021-07-18T14:15:06.6977255Z [cluster2]             {
2021-07-18T14:15:06.6983581Z [cluster2]                 "lastProbeTime": null,
2021-07-18T14:15:06.6984564Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:39Z",
2021-07-18T14:15:06.6985152Z [cluster2]                 "status": "True",
2021-07-18T14:15:06.6985608Z [cluster2]                 "type": "Initialized"
2021-07-18T14:15:06.6986171Z [cluster2]             },
2021-07-18T14:15:06.6986514Z [cluster2]             {
2021-07-18T14:15:06.6986927Z [cluster2]                 "lastProbeTime": null,
2021-07-18T14:15:06.6987678Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:59Z",
2021-07-18T14:15:06.6989776Z [cluster2]                 "status": "True",
2021-07-18T14:15:06.6990359Z [cluster2]                 "type": "Ready"
2021-07-18T14:15:06.6990730Z [cluster2]             },
2021-07-18T14:15:06.6991505Z [cluster2]             {
2021-07-18T14:15:06.6991947Z [cluster2]                 "lastProbeTime": null,
2021-07-18T14:15:06.6994009Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:59Z",
2021-07-18T14:15:06.6994753Z [cluster2]                 "status": "True",
2021-07-18T14:15:06.6995225Z [cluster2]                 "type": "ContainersReady"
2021-07-18T14:15:06.7009251Z [cluster2]             },
2021-07-18T14:15:06.7009599Z [cluster2]             {
2021-07-18T14:15:06.7010036Z [cluster2]                 "lastProbeTime": null,
2021-07-18T14:15:06.7010949Z [cluster2]                 "lastTransitionTime": "2021-07-18T14:13:39Z",
2021-07-18T14:15:06.7011603Z [cluster2]                 "status": "True",
2021-07-18T14:15:06.7012060Z [cluster2]                 "type": "PodScheduled"
2021-07-18T14:15:06.7012457Z [cluster2]             }
2021-07-18T14:15:06.7012791Z [cluster2]         ],
2021-07-18T14:15:06.7013195Z [cluster2]         "containerStatuses": [
2021-07-18T14:15:06.7013616Z [cluster2]             {
2021-07-18T14:15:06.7014922Z [cluster2]                 "containerID": "containerd://1422c474d7fa1452dff355e9bc84d6107d4c070b2d70c82ab54c977048cf0abd",
2021-07-18T14:15:06.8340336Z [clus      "reason": "Error",
2021-07-18T14:15:06.8341718Z [cluster1]                         "startedAt": "2021-07-18T14:13:29Z"
2021-07-18T14:15:06.8342332Z [cluster1]                     }
2021-07-18T14:15:06.8342834Z [cluster1]                 },
2021-07-18T14:15:06.8343676Z [cluster1]                 "name": "submariner-operator",
2021-07-18T14:15:06.8344440Z [cluster1]                 "ready": true,
2021-07-18T14:15:06.8345020Z [cluster1]                 "restartCount": 1,
2021-07-18T14:15:06.8345577Z [cluster1]                 "started": true,
2021-07-18T14:15:06.8346090Z [cluster1]                 "state": {
2021-07-18T14:15:06.8346606Z [cluster1]                     "running": {
2021-07-18T14:15:06.8347394Z [cluster1]                         "startedAt": "2021-07-18T14:13:36Z"
2021-07-18T14:15:06.8347965Z [cluster1]                     }
2021-07-18T14:15:06.8348431Z [cluster1]                 }
2021-07-18T14:15:06.8349266Z [cluster1]             }
2021-07-18T14:15:06.8349799Z [cluster1]         ],
2021-07-18T14:15:06.8350283Z [cluster1]         "hostIP": "172.18.0.4",
2021-07-18T14:15:06.8350826Z [cluster1]         "phase": "Running",
2021-07-18T14:15:06.8351571Z [cluster1]         "podIP": "10.0.0.3",
2021-07-18T14:15:06.8352145Z [cluster1]         "podIPs": [
2021-07-18T14:15:06.8352644Z [cluster1]             {
2021-07-18T14:15:06.8353106Z [cluster1]                 "ip": "10.0.0.3"
2021-07-18T14:15:06.8353572Z [cluster1]             }
2021-07-18T14:15:06.8354010Z [cluster1]         ],
2021-07-18T14:15:06.8354537Z [cluster1]         "qosClass": "BestEffort",
2021-07-18T14:15:06.8355397Z [cluster1]         "startTime": "2021-07-18T14:13:27Z"
2021-07-18T14:15:06.8355952Z [cluster1]     }
2021-07-18T14:15:06.8356385Z [cluster1] }
2021-07-18T14:15:06.8359737Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:06.8362156Z [submariner-operator]$ [cluster1] grep Running
2021-07-18T14:15:06.8364492Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:06.8371171Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:06.8372660Z [cluster1] Running
2021-07-18T14:15:06.8373976Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator
2021-07-18T14:15:06.8375821Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator
2021-07-18T14:15:06.8378316Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-wxkzw --namespace=submariner-operator
2021-07-18T14:15:06.8379558Z [cluster1] I0718 14:13:37.198455       1 main.go:77] cmd "msg"="Go Version: go1.16.5"  
2021-07-18T14:15:06.8380302Z [cluster1] I0718 14:13:37.198510       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"  
2021-07-18T14:15:06.8381228Z [cluster1] I0718 14:13:37.198517       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"  
2021-07-18T14:15:06.8382184Z [cluster1] I0718 14:13:37.198523       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"  
2021-07-18T14:15:06.8383091Z [cluster1] I0718 14:13:37.198861       1 leader.go:89] leader "msg"="Trying to become the leader."  
2021-07-18T14:15:06.8384040Z [cluster1] I0718 14:13:37.806694       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."  
2021-07-18T14:15:06.8384820Z [cluster1] I0718 14:13:37.806731       1 leader.go:123] leader "msg"="Continuing as the leader."  
2021-07-18T14:15:06.8385951Z [cluster1] I0718 14:13:38.409884       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-18T14:15:06.8386799Z [cluster1] I0718 14:13:38.410418       1 main.go:129] cmd "msg"="Registering Components."  
2021-07-18T14:15:06.8387494Z [cluster1] I0718 14:13:38.410523       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"  
2021-07-18T14:15:06.8388393Z [cluster1] I0718 14:13:42.196240       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8390130Z [cluster1] I0718 14:13:42.196348       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8391186Z [cluster1] I0718 14:13:42.196409       1 main.go:203] cmd "msg"="Starting the Cmd."  
2021-07-18T14:15:06.8392239Z [cluster1] I0718 14:13:42.196959       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-18T14:15:06.8397184Z [cluster1] I0718 14:13:42.197503       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:15:06.8405332Z [cluster1] I0718 14:13:42.197688       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:15:06.8433536Z [cluster1] I0718 14:13:42.197818       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:15:06.8438904Z [cluster1] I0718 14:13:42.197948       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:15:06.8443771Z [cluster1] I0718 14:13:42.198067       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-18T14:15:06.8448828Z [cluster1] I0718 14:13:42.299810       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-18T14:15:06.8453067Z [cluster1] I0718 14:13:42.303057       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:15:06.8464859Z [cluster1] I0718 14:13:42.306017       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker" 
2021-07-18T14:15:06.8468118Z [cluster1] I0718 14:13:42.306221       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-18T14:15:06.8473238Z [cluster1] I0718 14:13:42.306427       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:06.8475793Z [cluster1] I0718 14:13:42.306561       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-18T14:15:06.8492899Z [cluster1] I0718 14:13:42.308349       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:15:06.8495446Z [cluster1] I0718 14:13:42.310307       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"  
2021-07-18T14:15:06.8505147Z [cluster1] I0718 14:13:42.400557       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-18T14:15:06.8508179Z [cluster1] I0718 14:13:42.404875       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-18T14:15:06.8513479Z [cluster1] I0718 14:13:42.404962       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-18T14:15:06.8520835Z [cluster1] I0718 14:13:42.405023       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8523497Z [cluster1] I0718 14:13:42.417228       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-18T14:15:06.8531230Z [cluster1] I0718 14:13:42.446948       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"  
2021-07-18T14:15:06.8532991Z [cluster1] I0718 14:13:42.446981       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-18T14:15:06.8539477Z [cluster1] I0718 14:13:42.447083       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8542899Z [cluster1] I0718 14:13:42.447178       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8549696Z [cluster1] I0718 14:13:42.455222       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8557540Z [cluster1] I0718 14:13:42.501754       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"  
2021-07-18T14:15:06.8561451Z [cluster1] I0718 14:13:42.501921       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-18T14:15:06.8585176Z [cluster1] I0718 14:13:42.502057       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8586650Z [cluster1] I0718 14:13:42.502184       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8590301Z [cluster1] I0718 14:13:42.502284       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8592594Z [cluster1] I0718 14:13:42.537829       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8595079Z [cluster1] I0718 14:13:42.589509       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8598608Z [cluster1] E0718 14:13:42.630097       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-18T14:15:06.8601396Z [cluster1] I0718 14:13:42.635600       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8602672Z [cluster1] I0718 14:13:42.635727       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8603893Z [cluster1] I0718 14:13:42.635796       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8608984Z [cluster1] I0718 14:13:42.649313       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8617778Z [cluster1] I0718 14:13:42.662629       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8621701Z [cluster1] I0718 14:13:43.192984       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8626289Z [cluster1] I0718 14:13:43.237121       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8629862Z [cluster1] I0718 14:13:43.259641       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8633331Z [cluster1] I0718 14:13:43.271964       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8635812Z [cluster1] I0718 14:13:43.315998       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8638855Z [cluster1] I0718 14:13:43.321111       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8642515Z [cluster1] I0718 14:13:43.379175       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8646395Z [cluster1] I0718 14:13:43.596165       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8663094Z [cluster1] I0718 14:13:43.941632       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8666749Z [cluster1] I0718 14:13:43.962674       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8670125Z [cluster1] I0718 14:13:43.963115       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8673937Z [cluster1] I0718 14:13:43.981848       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8677082Z [cluster1] I0718 14:13:43.989976       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-18T14:15:06.8680349Z [cluster1] E0718 14:13:44.027734       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:06.8683357Z [cluster1] I0718 14:13:44.032906       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8685903Z [cluster1] I0718 14:13:44.148266       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8688736Z [cluster1] I0718 14:13:44.232488       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8691403Z [cluster1] I0718 14:13:44.254376       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8693916Z [cluster1] I0718 14:13:44.367760       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8695367Z [cluster1] I0718 14:13:44.367806       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8696501Z [cluster1] I0718 14:13:44.367815       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8698646Z [cluster1] I0718 14:13:44.511371       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8701443Z [cluster1] E0718 14:13:44.553380       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8703770Z [cluster1] I0718 14:13:44.553424       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8705064Z [cluster1] I0718 14:13:44.553475       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8706126Z [cluster1] I0718 14:13:44.553485       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8709150Z [cluster1] I0718 14:13:44.611017       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8713441Z [cluster1] I0718 14:13:44.624613       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8716126Z [cluster1] I0718 14:13:44.635132       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8719937Z [cluster1] I0718 14:13:44.772205       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8723518Z [cluster1] I0718 14:13:45.212447       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8726023Z [cluster1] I0718 14:13:45.226121       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8751711Z [cluster1] E0718 14:13:45.287043       1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"  
2021-07-18T14:15:06.8755712Z [cluster1] E0718 14:13:45.287149       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:06.8759277Z [cluster1] I0718 14:13:45.287276       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-18T14:15:06.8763936Z [cluster1] I0718 14:13:45.298627       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8766660Z [cluster1] I0718 14:13:45.315751       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8769369Z [cluster1] I0718 14:13:45.316000       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8772017Z [cluster1] I0718 14:13:45.361261       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8775559Z [cluster1] I0718 14:13:45.388061       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8778644Z [cluster1] I0718 14:13:45.411644       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8782799Z [cluster1] I0718 14:13:45.490950       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8787795Z [cluster1] I0718 14:13:45.548973       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8790929Z [cluster1] I0718 14:13:45.663661       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8794168Z [cluster1] E0718 14:13:45.664403       1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"  
2021-07-18T14:15:06.8797818Z [cluster1] E0718 14:13:45.664444       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-18T14:15:06.8800759Z [cluster1] I0718 14:13:45.664472       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8803330Z [cluster1] I0718 14:13:45.872629       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8805984Z [cluster1] I0718 14:13:45.998721       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8830046Z [cluster1] I0718 14:13:46.100338       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8833230Z [cluster1] I0718 14:13:46.217169       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8835824Z [cluster1] I0718 14:13:46.297194       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8838789Z [cluster1] I0718 14:13:46.454819       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8841307Z [cluster1] I0718 14:13:46.455715       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8842618Z [cluster1] I0718 14:13:46.455754       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8843735Z [cluster1] I0718 14:13:46.455765       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8845870Z [cluster1] I0718 14:13:46.992231       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8848972Z [cluster1] I0718 14:13:47.093478       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8852382Z [cluster1] I0718 14:13:47.140013       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8855904Z [cluster1] I0718 14:13:47.162932       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8859927Z [cluster1] I0718 14:13:47.337768       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8865105Z [cluster1] I0718 14:13:47.385979       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8868470Z [cluster1] I0718 14:13:47.403636       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8871173Z [cluster1] I0718 14:13:47.940430       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8873752Z [cluster1] I0718 14:13:48.006202       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8876578Z [cluster1] I0718 14:13:48.013646       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8880031Z [cluster1] I0718 14:13:48.081630       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8883748Z [cluster1] E0718 14:13:48.087337       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8886369Z [cluster1] I0718 14:13:48.087625       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8928456Z [cluster1] I0718 14:13:48.087694       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.8930772Z [cluster1] I0718 14:13:48.087726       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.8933960Z [cluster1] I0718 14:13:48.092587       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8939202Z [cluster1] I0718 14:13:48.092615       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.109.108\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"  
2021-07-18T14:15:06.8943364Z [cluster1] I0718 14:13:48.226957       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8945931Z [cluster1] I0718 14:13:48.406431       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8948420Z [cluster1] I0718 14:13:48.608926       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8950898Z [cluster1] I0718 14:13:48.625484       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8953583Z [cluster1] I0718 14:13:48.642210       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8956331Z [cluster1] I0718 14:13:48.649941       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8959579Z [cluster1] I0718 14:13:48.706224       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8964949Z [cluster1] I0718 14:13:48.708378       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8970853Z [cluster1] I0718 14:13:48.708410       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.109.108\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"  
2021-07-18T14:15:06.8975104Z [cluster1] I0718 14:13:48.718737       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.8979122Z [cluster1] I0718 14:13:48.768325       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.8983334Z [cluster1] I0718 14:13:48.792669       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8986807Z [cluster1] I0718 14:13:49.016292       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.8989736Z [cluster1] I0718 14:13:49.091060       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8992666Z [cluster1] I0718 14:13:49.192054       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.8995685Z [cluster1] I0718 14:13:49.250722       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.8999119Z [cluster1] I0718 14:13:49.256095       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9001881Z [cluster1] I0718 14:13:49.396849       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9006096Z [cluster1] I0718 14:13:49.467020       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.9009663Z [cluster1] I0718 14:13:49.500760       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9012560Z [cluster1] I0718 14:13:49.856545       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9015222Z [cluster1] I0718 14:13:50.108213       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9017825Z [cluster1] I0718 14:13:50.133403       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9050339Z [cluster1] I0718 14:13:50.133445       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.109.108\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"  
2021-07-18T14:15:06.9053662Z [cluster1] I0718 14:14:01.208360       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9055161Z [cluster1] I0718 14:14:01.208414       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9056300Z [cluster1] I0718 14:14:01.208425       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9058295Z [cluster1] I0718 14:14:01.378011       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9061542Z [cluster1] I0718 14:14:01.531749       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9065528Z [cluster1] I0718 14:14:02.142661       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9069201Z [cluster1] I0718 14:14:02.173475       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9072662Z [cluster1] I0718 14:14:02.215259       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9076470Z [cluster1] I0718 14:14:02.267595       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9080212Z [cluster1] I0718 14:14:02.871276       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9083042Z [cluster1] I0718 14:14:02.892219       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9084381Z [cluster1] I0718 14:14:02.892263       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9085605Z [cluster1] I0718 14:14:02.892291       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9087448Z [cluster1] I0718 14:14:02.902892       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9089194Z [cluster1] I0718 14:14:02.902927       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9090954Z [cluster1] I0718 14:14:02.902937       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9093979Z [cluster1] I0718 14:14:02.915822       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9126326Z [cluster1] I0718 14:14:02.928096       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9130002Z [cluster1] I0718 14:14:02.941423       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9133113Z [cluster1] I0718 14:14:02.949441       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9136017Z [cluster1] I0718 14:14:03.176994       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9138974Z [cluster1] I0718 14:14:03.203888       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.9142613Z [cluster1] I0718 14:14:03.241818       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9146525Z [cluster1] I0718 14:14:03.556574       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9149383Z [cluster1] I0718 14:14:03.556632       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9152419Z [cluster1] I0718 14:14:03.616030       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9155473Z [cluster1] I0718 14:14:03.616757       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9159627Z [cluster1] I0718 14:14:03.646120       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9162449Z [cluster1] I0718 14:14:03.646758       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9167585Z [cluster1] I0718 14:14:03.681431       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9171140Z [cluster1] I0718 14:14:03.683895       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9175671Z [cluster1] I0718 14:14:03.849694       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9179195Z [cluster1] I0718 14:14:03.861677       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.9182579Z [cluster1] I0718 14:14:03.874747       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9185889Z [cluster1] I0718 14:14:04.305189       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9188725Z [cluster1] I0718 14:14:04.305571       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9192130Z [cluster1] E0718 14:14:04.451664       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9194985Z [cluster1] I0718 14:14:04.463836       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9196940Z [cluster1] I0718 14:14:04.476379       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9198409Z [cluster1] I0718 14:14:04.477263       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9199640Z [cluster1] I0718 14:14:04.477287       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9200843Z [cluster1] I0718 14:14:04.485498       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9202070Z [cluster1] I0718 14:14:04.485520       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9204359Z [cluster1] I0718 14:14:04.585435       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9207198Z [cluster1] I0718 14:14:04.657205       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9243555Z [cluster1] I0718 14:14:04.660302       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9247361Z [cluster1] I0718 14:14:04.702888       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9252088Z [cluster1] I0718 14:14:04.705713       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.109.108\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"  
2021-07-18T14:15:06.9256431Z [cluster1] I0718 14:14:04.733752       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9259325Z [cluster1] I0718 14:14:04.734088       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9262137Z [cluster1] I0718 14:14:04.734628       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9266178Z [cluster1] I0718 14:14:04.814125       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.9269941Z [cluster1] I0718 14:14:04.880051       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9273651Z [cluster1] I0718 14:14:05.341862       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9276705Z [cluster1] I0718 14:14:05.347275       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9279800Z [cluster1] I0718 14:14:05.361889       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9283052Z [cluster1] I0718 14:14:05.392247       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9285850Z [cluster1] I0718 14:14:05.392504       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9322836Z [cluster1] I0718 14:14:05.429611       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9326687Z [cluster1] I0718 14:14:05.437954       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9330076Z [cluster1] I0718 14:14:05.482723       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9333507Z [cluster1] I0718 14:14:05.539529       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:06.9337190Z [cluster1] I0718 14:14:05.539701       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9341449Z [cluster1] I0718 14:14:05.622592       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9344865Z [cluster1] I0718 14:14:06.040393       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9347205Z [cluster1] I0718 14:14:06.094708       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9348668Z [cluster1] I0718 14:14:06.094971       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9349894Z [cluster1] I0718 14:14:06.095125       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9352058Z [cluster1] I0718 14:14:06.142238       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9354843Z [cluster1] I0718 14:14:06.145186       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9357842Z [cluster1] I0718 14:14:06.239424       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9360663Z [cluster1] I0718 14:14:06.263661       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9363398Z [cluster1] I0718 14:14:06.263968       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9384109Z [cluster1] I0718 14:14:06.264014       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.109.108\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"  
2021-07-18T14:15:06.9387811Z [cluster1] I0718 14:14:06.866163       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9390678Z [cluster1] I0718 14:14:06.877853       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9393618Z [cluster1] I0718 14:14:06.894704       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9396526Z [cluster1] I0718 14:14:06.908372       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9399253Z [cluster1] I0718 14:14:07.538849       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9401432Z [cluster1] I0718 14:14:07.589518       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9402812Z [cluster1] I0718 14:14:07.589706       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9403953Z [cluster1] I0718 14:14:07.589776       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9406093Z [cluster1] I0718 14:14:07.649594       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9448307Z [cluster1] I0718 14:14:07.649905       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9449607Z [cluster1] I0718 14:14:07.650085       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9451747Z [cluster1] I0718 14:14:07.657400       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9454333Z [cluster1] I0718 14:14:07.685757       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9457134Z [cluster1] I0718 14:14:07.721832       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9459694Z [cluster1] I0718 14:14:07.741650       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9462185Z [cluster1] I0718 14:14:08.288979       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9464643Z [cluster1] I0718 14:14:08.296480       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9469130Z [cluster1] I0718 14:14:08.320442       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9471709Z [cluster1] I0718 14:14:08.340193       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9474441Z [cluster1] I0718 14:14:08.367212       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9476884Z [cluster1] I0718 14:14:08.391362       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9479359Z [cluster1] I0718 14:14:08.446561       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9482069Z [cluster1] I0718 14:14:08.461847       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9484648Z [cluster1] I0718 14:14:08.942727       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9487372Z [cluster1] I0718 14:14:09.065205       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9489669Z [cluster1] I0718 14:14:11.460258       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9490967Z [cluster1] I0718 14:14:11.460309       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9492331Z [cluster1] I0718 14:14:11.460318       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9494356Z [cluster1] I0718 14:14:11.495202       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9497029Z [cluster1] I0718 14:14:11.503922       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9499495Z [cluster1] I0718 14:14:12.118712       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9501955Z [cluster1] I0718 14:14:12.130105       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9504440Z [cluster1] I0718 14:14:12.144837       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9507071Z [cluster1] I0718 14:14:12.153971       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9509580Z [cluster1] I0718 14:14:12.756242       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9511620Z [cluster1] I0718 14:14:12.780803       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9512891Z [cluster1] I0718 14:14:12.781241       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9513983Z [cluster1] I0718 14:14:12.781385       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9515522Z [cluster1] I0718 14:14:12.782681       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9517620Z [cluster1] I0718 14:14:12.785789       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9518903Z [cluster1] I0718 14:14:12.786240       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9521187Z [cluster1] I0718 14:14:12.819255       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9524029Z [cluster1] I0718 14:14:12.819830       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9552418Z [cluster1] I0718 14:14:12.839643       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9555163Z [cluster1] I0718 14:14:12.840028       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9557668Z [cluster1] I0718 14:14:13.441099       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9560078Z [cluster1] I0718 14:14:13.446352       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9563857Z [cluster1] I0718 14:14:13.456219       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9569043Z [cluster1] I0718 14:14:13.466707       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9572812Z [cluster1] I0718 14:14:13.493263       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9576393Z [cluster1] I0718 14:14:13.493718       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9579996Z [cluster1] I0718 14:14:13.507442       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9583588Z [cluster1] I0718 14:14:13.509523       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9586900Z [cluster1] I0718 14:14:14.110356       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9589863Z [cluster1] I0718 14:14:14.114798       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9593087Z [cluster1] I0718 14:14:32.364732       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9595869Z [cluster1] I0718 14:14:32.364900       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9597509Z [cluster1] I0718 14:14:32.364926       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9600390Z [cluster1] I0718 14:14:32.374119       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9603646Z [cluster1] I0718 14:14:32.378294       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9606772Z [cluster1] I0718 14:14:32.980549       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9640458Z [cluster1] I0718 14:14:32.988263       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9643983Z [cluster1] I0718 14:14:32.991904       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9647596Z [cluster1] I0718 14:14:32.995862       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9650473Z [cluster1] I0718 14:14:33.597427       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9652998Z [cluster1] I0718 14:14:33.608176       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9654316Z [cluster1] I0718 14:14:33.608466       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9655600Z [cluster1] I0718 14:14:33.608629       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9657154Z [cluster1] I0718 14:14:33.610904       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9658619Z [cluster1] I0718 14:14:33.611203       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9659732Z [cluster1] I0718 14:14:33.611456       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9661687Z [cluster1] I0718 14:14:33.619301       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9664799Z [cluster1] I0718 14:14:33.621782       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9669424Z [cluster1] I0718 14:14:33.623582       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9673593Z [cluster1] I0718 14:14:33.634677       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9676972Z [cluster1] I0718 14:14:34.225497       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9679434Z [cluster1] I0718 14:14:34.235863       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9681897Z [cluster1] I0718 14:14:34.238779       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9684496Z [cluster1] I0718 14:14:34.243497       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9687202Z [cluster1] I0718 14:14:34.249694       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9730314Z [cluster1] I0718 14:14:34.254395       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9732889Z [cluster1] I0718 14:14:34.282321       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9735411Z [cluster1] I0718 14:14:34.291214       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9737916Z [cluster1] I0718 14:14:34.856335       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9740334Z [cluster1] I0718 14:14:34.892752       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9742562Z [cluster1] I0718 14:14:37.394076       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9743903Z [cluster1] I0718 14:14:37.394136       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9745341Z [cluster1] I0718 14:14:37.394147       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9747303Z [cluster1] I0718 14:14:37.406036       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9749789Z [cluster1] I0718 14:14:37.411347       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9752492Z [cluster1] I0718 14:14:38.013763       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9755161Z [cluster1] I0718 14:14:38.025277       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9757630Z [cluster1] I0718 14:14:38.037383       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9760289Z [cluster1] I0718 14:14:38.079315       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9762798Z [cluster1] I0718 14:14:38.680942       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9764824Z [cluster1] I0718 14:14:38.695092       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9766121Z [cluster1] I0718 14:14:38.695384       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9768898Z [cluster1] I0718 14:14:38.695851       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9771092Z [cluster1] I0718 14:14:38.710617       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9773016Z [cluster1] I0718 14:14:38.710654       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9774350Z [cluster1] I0718 14:14:38.710664       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9776840Z [cluster1] I0718 14:14:38.734324       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9779893Z [cluster1] I0718 14:14:38.745875       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9782862Z [cluster1] I0718 14:14:38.746531       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9785732Z [cluster1] I0718 14:14:38.769602       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9788697Z [cluster1] I0718 14:14:39.347780       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9791314Z [cluster1] I0718 14:14:39.356616       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9794027Z [cluster1] I0718 14:14:39.361525       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9797014Z [cluster1] I0718 14:14:39.366433       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9800078Z [cluster1] I0718 14:14:39.378447       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9802542Z [cluster1] I0718 14:14:39.403406       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9805008Z [cluster1] I0718 14:14:39.418713       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9807531Z [cluster1] I0718 14:14:39.427841       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9850555Z [cluster1] I0718 14:14:39.968993       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9853280Z [cluster1] I0718 14:14:40.029882       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9855608Z [cluster1] I0718 14:14:42.423838       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9857289Z [cluster1] I0718 14:14:42.423963       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9858879Z [cluster1] I0718 14:14:42.423990       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9861222Z [cluster1] I0718 14:14:42.434995       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9864311Z [cluster1] I0718 14:14:42.439129       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9869802Z [cluster1] I0718 14:14:43.040714       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9874324Z [cluster1] I0718 14:14:43.048887       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9877749Z [cluster1] I0718 14:14:43.058860       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9882394Z [cluster1] I0718 14:14:43.065987       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9886188Z [cluster1] I0718 14:14:43.676384       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9888972Z [cluster1] I0718 14:14:43.690877       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9890438Z [cluster1] I0718 14:14:43.690918       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9891582Z [cluster1] I0718 14:14:43.690930       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9893088Z [cluster1] I0718 14:14:43.691890       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9894350Z [cluster1] I0718 14:14:43.691926       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9895383Z [cluster1] I0718 14:14:43.691935       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9897253Z [cluster1] I0718 14:14:43.699917       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9899627Z [cluster1] I0718 14:14:43.703419       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9903012Z [cluster1] I0718 14:14:43.705269       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9906661Z [cluster1] I0718 14:14:43.712933       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9909590Z [cluster1] I0718 14:14:44.307507       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9912601Z [cluster1] I0718 14:14:44.315007       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9915999Z [cluster1] I0718 14:14:44.316333       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9918726Z [cluster1] I0718 14:14:44.320427       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9921504Z [cluster1] I0718 14:14:44.324851       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9923908Z [cluster1] I0718 14:14:44.328611       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:06.9976878Z [cluster1] I0718 14:14:44.329284       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9981953Z [cluster1] I0718 14:14:44.335233       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:06.9985699Z [cluster1] I0718 14:14:44.932106       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9989332Z [cluster1] I0718 14:14:44.936187       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:06.9992051Z [cluster1] I0718 14:14:47.446127       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:06.9993596Z [cluster1] I0718 14:14:47.446184       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:06.9996205Z [cluster1] I0718 14:14:47.446195       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:06.9998896Z [cluster1] I0718 14:14:47.498763       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0002911Z [cluster1] I0718 14:14:47.508731       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0005828Z [cluster1] I0718 14:14:48.111527       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0008417Z [cluster1] I0718 14:14:48.120336       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0011368Z [cluster1] I0718 14:14:48.126279       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0014299Z [cluster1] I0718 14:14:48.132086       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0017883Z [cluster1] I0718 14:14:48.738465       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0020568Z [cluster1] I0718 14:14:48.777765       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0022213Z [cluster1] I0718 14:14:48.777877       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0024366Z [cluster1] I0718 14:14:48.777946       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0026296Z [cluster1] I0718 14:14:48.779068       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0028304Z [cluster1] I0718 14:14:48.779220       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0030545Z [cluster1] I0718 14:14:48.781299       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0032982Z [cluster1] I0718 14:14:48.788373       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0036757Z [cluster1] I0718 14:14:48.806512       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0042344Z [cluster1] I0718 14:14:48.807013       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0045993Z [cluster1] I0718 14:14:48.841550       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0091799Z [cluster1] I0718 14:14:49.408621       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0095967Z [cluster1] I0718 14:14:49.428825       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0099567Z [cluster1] I0718 14:14:49.437044       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0102933Z [cluster1] I0718 14:14:49.441373       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0106015Z [cluster1] I0718 14:14:49.454511       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0108784Z [cluster1] I0718 14:14:49.460050       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0113494Z [cluster1] I0718 14:14:49.464462       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0116596Z [cluster1] I0718 14:14:49.468223       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0119156Z [cluster1] I0718 14:14:50.042676       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0123246Z [cluster1] I0718 14:14:50.069932       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0126764Z [cluster1] I0718 14:14:52.515853       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0151720Z [cluster1] I0718 14:14:52.515909       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0152930Z [cluster1] I0718 14:14:52.515919       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0155818Z [cluster1] I0718 14:14:52.526601       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0159141Z [cluster1] I0718 14:14:52.536303       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0162578Z [cluster1] I0718 14:14:53.137425       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0165388Z [cluster1] I0718 14:14:53.143277       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0168430Z [cluster1] I0718 14:14:53.148116       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0174330Z [cluster1] I0718 14:14:53.152460       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0178451Z [cluster1] I0718 14:14:53.753937       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0181822Z [cluster1] I0718 14:14:53.765395       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0184339Z [cluster1] I0718 14:14:53.766127       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0186863Z [cluster1] I0718 14:14:53.766145       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0188977Z [cluster1] I0718 14:14:53.767504       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0190590Z [cluster1] I0718 14:14:53.767617       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0192664Z [cluster1] I0718 14:14:53.767736       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0194800Z [cluster1] I0718 14:14:53.777512       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0197588Z [cluster1] I0718 14:14:53.779363       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0200524Z [cluster1] I0718 14:14:53.782910       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0204055Z [cluster1] I0718 14:14:53.782932       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0248797Z [cluster1] I0718 14:14:54.386429       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0251621Z [cluster1] I0718 14:14:54.386655       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0254329Z [cluster1] I0718 14:14:54.392740       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0257166Z [cluster1] I0718 14:14:54.393741       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0260518Z [cluster1] I0718 14:14:54.398727       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0264545Z [cluster1] I0718 14:14:54.399245       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0267313Z [cluster1] I0718 14:14:54.401787       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0270114Z [cluster1] I0718 14:14:54.403183       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0273704Z [cluster1] I0718 14:14:55.005093       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0276947Z [cluster1] I0718 14:14:55.013862       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0279179Z [cluster1] I0718 14:14:57.549502       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0280609Z [cluster1] I0718 14:14:57.549559       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0281800Z [cluster1] I0718 14:14:57.549569       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0284036Z [cluster1] I0718 14:14:57.577813       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0286824Z [cluster1] I0718 14:14:57.612208       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0330755Z [cluster1] I0718 14:14:58.214386       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0334095Z [cluster1] I0718 14:14:58.221191       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0336609Z [cluster1] I0718 14:14:58.227158       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0339297Z [cluster1] I0718 14:14:58.232780       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0342115Z [cluster1] I0718 14:14:58.834601       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0345133Z [cluster1] I0718 14:14:58.851629       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0346902Z [cluster1] I0718 14:14:58.851755       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0348633Z [cluster1] I0718 14:14:58.851843       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0350209Z [cluster1] I0718 14:14:58.854653       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0351546Z [cluster1] I0718 14:14:58.854757       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0352997Z [cluster1] I0718 14:14:58.854796       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0354952Z [cluster1] I0718 14:14:58.862455       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0357518Z [cluster1] I0718 14:14:58.869832       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0360425Z [cluster1] I0718 14:14:58.892475       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0363183Z [cluster1] I0718 14:14:58.903785       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0365727Z [cluster1] I0718 14:14:59.479615       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0369403Z [cluster1] I0718 14:14:59.492537       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0373996Z [cluster1] I0718 14:14:59.506391       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0378986Z [cluster1] I0718 14:14:59.514826       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0383021Z [cluster1] I0718 14:14:59.516741       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0387700Z [cluster1] I0718 14:14:59.525795       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0390501Z [cluster1] I0718 14:14:59.526688       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0393157Z [cluster1] I0718 14:14:59.538501       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0396126Z [cluster1] I0718 14:15:00.128736       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0398607Z [cluster1] I0718 14:15:00.142828       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0400688Z [cluster1] I0718 14:15:02.586643       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0402025Z [cluster1] I0718 14:15:02.586699       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0403142Z [cluster1] I0718 14:15:02.586709       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0405404Z [cluster1] I0718 14:15:02.600524       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0408191Z [cluster1] I0718 14:15:02.610292       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0410935Z [cluster1] I0718 14:15:03.212453       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0413430Z [cluster1] I0718 14:15:03.219840       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0415906Z [cluster1] I0718 14:15:03.224212       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0418403Z [cluster1] I0718 14:15:03.227416       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0421051Z [cluster1] I0718 14:15:03.829184       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0423091Z [cluster1] I0718 14:15:03.840548       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0424362Z [cluster1] I0718 14:15:03.840717       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0425433Z [cluster1] I0718 14:15:03.840829       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0426970Z [cluster1] I0718 14:15:03.846069       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.0428239Z [cluster1] I0718 14:15:03.846125       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.0429303Z [cluster1] I0718 14:15:03.846136       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.0431414Z [cluster1] I0718 14:15:03.859993       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0434188Z [cluster1] I0718 14:15:03.860895       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.0436977Z [cluster1] I0718 14:15:03.866154       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0439618Z [cluster1] I0718 14:15:03.867075       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.0442230Z [cluster1] I0718 14:15:04.468898       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0444756Z [cluster1] I0718 14:15:04.469939       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.0447207Z [cluster1] I0718 14:15:04.483126       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.7087318Z [cluster1] I0718 14:15:04.485229       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.7091219Z [cluster1] I0718 14:15:04.493451       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.7093783Z [cluster1] I0718 14:15:04.497717       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.7096307Z [cluster1] I0718 14:15:04.512920       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.7098824Z [cluster1] I0718 14:15:04.519868       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.7101516Z [cluster1] I0718 14:15:05.098790       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.7104754Z [cluster1] I0718 14:15:05.121813       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.7106970Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-18T14:15:07.7107741Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-18T14:15:07.7108716Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:15:07.7110091Z [submariner-operator]$ [cluster1] grep submariner
2021-07-18T14:15:07.7111149Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:15:07.7112490Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-18T14:15:07.7113977Z [cluster1] submariner   88s
2021-07-18T14:15:07.7115242Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-18T14:15:07.7116547Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:07.7118137Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-18T14:15:07.7119528Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:07.7121403Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:07.7122387Z [cluster1] {
2021-07-18T14:15:07.7122861Z [cluster1]     "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:07.7123373Z [cluster1]     "kind": "Submariner",
2021-07-18T14:15:07.7123795Z [cluster1]     "metadata": {
2021-07-18T14:15:07.7124446Z [cluster1]         "creationTimestamp": "2021-07-18T14:13:39Z",
2021-07-18T14:15:07.7124956Z [cluster1]         "generation": 1,
2021-07-18T14:15:07.7125544Z [cluster1]         "managedFields": [
2021-07-18T14:15:07.7125939Z [cluster1]             {
2021-07-18T14:15:07.7126409Z [cluster1]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:07.7127395Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:07.7128045Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:07.7128637Z [cluster1]                     "f:spec": {
2021-07-18T14:15:07.7129189Z [cluster1]                         ".": {},
2021-07-18T14:15:07.7129568Z [cluster1]                         "f:broker": {},
2021-07-18T14:15:07.7130075Z [cluster1]                         "f:brokerK8sApiServer": {},
2021-07-18T14:15:07.7131070Z [cluster1]                         "f:brokerK8sApiServerToken": {},
2021-07-18T14:15:07.7131688Z [cluster1]                         "f:brokerK8sCA": {},
2021-07-18T14:15:07.7132330Z [cluster1]                         "f:brokerK8sRemoteNamespace": {},
2021-07-18T14:15:07.7132947Z [cluster1]                         "f:cableDriver": {},
2021-07-18T14:15:07.7133621Z [cluster1]                         "f:ceIPSecDebug": {},
2021-07-18T14:15:07.7134286Z [cluster1]                         "f:ceIPSecIKEPort": {},
2021-07-18T14:15:07.7134803Z [cluster1]                         "f:ceIPSecNATTPort": {},
2021-07-18T14:15:07.7135280Z [cluster1]                         "f:ceIPSecPSK": {},
2021-07-18T14:15:07.7135743Z [cluster1]                         "f:clusterCIDR": {},
2021-07-18T14:15:07.7136172Z [cluster1]                         "f:clusterID": {},
2021-07-18T14:15:07.7136611Z [cluster1]                         "f:colorCodes": {},
2021-07-18T14:15:07.7137151Z [cluster1]                         "f:connectionHealthCheck": {
2021-07-18T14:15:07.7137625Z [cluster1]                             ".": {},
2021-07-18T14:15:07.7138017Z [cluster1]                             "f:enabled": {},
2021-07-18T14:15:07.7138478Z [cluster1]                             "f:intervalSeconds": {},
2021-07-18T14:15:07.7139156Z [cluster1]                             "f:maxPacketLossCount": {}
2021-07-18T14:15:07.7139602Z [cluster1]                         },
2021-07-18T14:15:07.7139976Z [cluster1]                         "f:debug": {},
2021-07-18T14:15:07.7140382Z [cluster1]                         "f:globalCIDR": {},
2021-07-18T14:15:07.7140824Z [cluster1]                         "f:namespace": {},
2021-07-18T14:15:07.7141274Z [cluster1]                         "f:natEnabled": {},
2021-07-18T14:15:07.7141702Z [cluster1]                         "f:repository": {},
2021-07-18T14:15:07.7142468Z [cluster1]                         "f:serviceCIDR": {},
2021-07-18T14:15:07.7143273Z [cluster1]                         "f:serviceDiscoveryEnabled": {},
2021-07-18T14:15:07.7143846Z [cluster1]                         "f:version": {}
2021-07-18T14:15:07.7144228Z [cluster1]                     }
2021-07-18T14:15:07.7144586Z [cluster1]                 },
2021-07-18T14:15:07.7145088Z [cluster1]                 "manager": "subctl",
2021-07-18T14:15:07.7145589Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:07.7146891Z [cluster1]                 "time": "2021-07-18T14:13:39Z"
2021-07-18T14:15:07.7147282Z [cluster1]             },
2021-07-18T14:15:07.7147629Z [cluster1]             {
2021-07-18T14:15:07.7148100Z [cluster1]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:07.7148671Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:07.7149305Z [cluster1]                 "fieldsV1": {
2021-07-18T14:15:07.7149729Z [cluster1]                     "f:status": {
2021-07-18T14:15:07.7150115Z [cluster1]                         ".": {},
2021-07-18T14:15:07.7150706Z [cluster1]                         "f:clusterCIDR": {},
2021-07-18T14:15:07.7151153Z [cluster1]                         "f:clusterID": {},
2021-07-18T14:15:07.7151606Z [cluster1]                         "f:colorCodes": {},
2021-07-18T14:15:07.7152082Z [cluster1]                         "f:deploymentInfo": {},
2021-07-18T14:15:07.7152832Z [cluster1]                         "f:gatewayDaemonSetStatus": {
2021-07-18T14:15:07.7153336Z [cluster1]                             ".": {},
2021-07-18T14:15:07.7153799Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-18T14:15:07.7154447Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:07.7155122Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:07.7155909Z [cluster1]                             "f:status": {
2021-07-18T14:15:07.7156279Z [cluster1]                                 ".": {},
2021-07-18T14:15:07.7156792Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:07.7157447Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:07.7158018Z [cluster1]                                 "f:numberAvailable": {},
2021-07-18T14:15:07.7158571Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:07.7159079Z [cluster1]                                 "f:numberReady": {},
2021-07-18T14:15:07.7159597Z [cluster1]                                 "f:observedGeneration": {},
2021-07-18T14:15:07.7160196Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:07.7160693Z [cluster1]                             }
2021-07-18T14:15:07.7161025Z [cluster1]                         },
2021-07-18T14:15:07.7161418Z [cluster1]                         "f:gateways": {},
2021-07-18T14:15:07.7161847Z [cluster1]                         "f:globalCIDR": {},
2021-07-18T14:15:07.7162388Z [cluster1]                         "f:globalnetDaemonSetStatus": {
2021-07-18T14:15:07.7162908Z [cluster1]                             ".": {},
2021-07-18T14:15:07.7163367Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-18T14:15:07.7164020Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:07.7164879Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:07.7165427Z [cluster1]                             "f:status": {
2021-07-18T14:15:07.7165805Z [cluster1]                                 ".": {},
2021-07-18T14:15:07.7166328Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:07.7167000Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:07.7167591Z [cluster1]                                 "f:numberAvailable": {},
2021-07-18T14:15:07.7216834Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:07.7217555Z [cluster1]                                 "f:numberReady": {},
2021-07-18T14:15:07.7218474Z [cluster1]                                 "f:observedGeneration": {},
2021-07-18T14:15:07.7219526Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:07.7220515Z [cluster1]                             }
2021-07-18T14:15:07.7220980Z [cluster1]                         },
2021-07-18T14:15:07.7221533Z [cluster1]                         "f:loadBalancerStatus": {},
2021-07-18T14:15:07.7222160Z [cluster1]                         "f:natEnabled": {},
2021-07-18T14:15:07.7222729Z [cluster1]                         "f:networkPlugin": {},
2021-07-18T14:15:07.7223923Z [cluster1]                         "f:routeAgentDaemonSetStatus": {
2021-07-18T14:15:07.7224799Z [cluster1]                             ".": {},
2021-07-18T14:15:07.7225499Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-18T14:15:07.7226527Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:07.7227265Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:07.7227834Z [cluster1]                             "f:status": {
2021-07-18T14:15:07.7228221Z [cluster1]                                 ".": {},
2021-07-18T14:15:07.7228772Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:07.7229453Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:07.7230569Z [cluster1]                                 "f:numberAvailable": {},
2021-07-18T14:15:07.7231305Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:07.7231857Z [cluster1]                                 "f:numberReady": {},
2021-07-18T14:15:07.7232503Z [cluster1]                                 "f:observedGeneration": {},
2021-07-18T14:15:07.7233527Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:07.7234218Z [cluster1]                             }
2021-07-18T14:15:07.7234557Z [cluster1]                         },
2021-07-18T14:15:07.7234972Z [cluster1]                         "f:serviceCIDR": {}
2021-07-18T14:15:07.7235363Z [cluster1]                     }
2021-07-18T14:15:07.7235702Z [cluster1]                 },
2021-07-18T14:15:07.7236663Z [cluster1]                 "manager": "submariner-operator",
2021-07-18T14:15:07.7237212Z [cluster1]                 "operation": "Update",
2021-07-18T14:15:07.7237793Z [cluster1]                 "time": "2021-07-18T14:14:12Z"
2021-07-18T14:15:07.7238347Z [cluster1]             }
2021-07-18T14:15:07.7238885Z [cluster1]         ],
2021-07-18T14:15:07.7239438Z [cluster1]         "name": "submariner",
2021-07-18T14:15:07.7240183Z [cluster1]         "namespace": "submariner-operator",
2021-07-18T14:15:07.7240767Z [cluster1]         "resourceVersion": "2076",
2021-07-18T14:15:07.7241550Z [cluster1]         "uid": "bc8a78d4-4cf4-4c71-9ba3-30f085b4566e"
2021-07-18T14:15:07.7242213Z [cluster1]     },
2021-07-18T14:15:07.7242556Z [cluster1]     "spec": {
2021-07-18T14:15:07.7242929Z [cluster1]         "broker": "k8s",
2021-07-18T14:15:07.7243421Z [cluster1]         "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-18T14:15:07.7463754Z [cluster1]         "brokerK8sApiServerToken": "***",
2021-07-18T14:15:07.8128247Z [cluster1]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:15:07.8777806Z [cluster1]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-18T14:15:07.8778562Z [cluster1]         "cableDriver": "libreswan",
2021-07-18T14:15:07.8779051Z [cluster1]         "ceIPSecDebug": false,
2021-07-18T14:15:07.8779538Z [cluster1]         "ceIPSecIKEPort": 500,
2021-07-18T14:15:07.8780013Z [cluster1]         "ceIPSecNATTPort": 4500,
2021-07-18T14:15:07.8782396Z [cluster1]         "ceIPSecPSK": "aweXRyYV8J2Mt4yR3MPtcEtyzUN0xJPRXKS4Dmoq5N0hsP1EvsvVoEwcyJGZHltr",
2021-07-18T14:15:07.8784244Z [cluster1]         "clusterCIDR": "",
2021-07-18T14:15:07.8784931Z [cluster1]         "clusterID": "cluster1",
2021-07-18T14:15:07.8785884Z [cluster1]         "colorCodes": "blue",
2021-07-18T14:15:07.8786576Z [cluster1]         "connectionHealthCheck": {
2021-07-18T14:15:07.8787308Z [cluster1]             "enabled": true,
2021-07-18T14:15:07.8787779Z [cluster1]             "intervalSeconds": 1,
2021-07-18T14:15:07.8788328Z [cluster1]             "maxPacketLossCount": 5
2021-07-18T14:15:07.8788765Z [cluster1]         },
2021-07-18T14:15:07.8789388Z [cluster1]         "debug": false,
2021-07-18T14:15:07.8789970Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-18T14:15:07.8790738Z [cluster1]         "namespace": "submariner-operator",
2021-07-18T14:15:07.8791294Z [cluster1]         "natEnabled": false,
2021-07-18T14:15:07.8791764Z [cluster1]         "repository": "localhost:5000",
2021-07-18T14:15:07.8792415Z [cluster1]         "serviceCIDR": "",
2021-07-18T14:15:07.8792988Z [cluster1]         "serviceDiscoveryEnabled": true,
2021-07-18T14:15:07.8793711Z [cluster1]         "version": "local"
2021-07-18T14:15:07.8794071Z [cluster1]     },
2021-07-18T14:15:07.8794422Z [cluster1]     "status": {
2021-07-18T14:15:07.8794823Z [cluster1]         "clusterCIDR": "10.0.0.0/16",
2021-07-18T14:15:07.8795482Z [cluster1]         "clusterID": "cluster1",
2021-07-18T14:15:07.8795925Z [cluster1]         "colorCodes": "blue",
2021-07-18T14:15:07.8796380Z [cluster1]         "deploymentInfo": {},
2021-07-18T14:15:07.8796916Z [cluster1]         "gatewayDaemonSetStatus": {
2021-07-18T14:15:07.8797506Z [cluster1]             "lastResourceVersion": "1764",
2021-07-18T14:15:07.8799538Z [cluster1]             "mismatchedContainerImages": false,
2021-07-18T14:15:07.8800435Z [cluster1]             "nonReadyContainerStates": [],
2021-07-18T14:15:07.8801071Z [cluster1]             "status": {
2021-07-18T14:15:07.8801684Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-18T14:15:07.8802699Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-18T14:15:07.8803523Z [cluster1]                 "numberAvailable": 1,
2021-07-18T14:15:07.8804280Z [cluster1]                 "numberMisscheduled": 0,
2021-07-18T14:15:07.8804822Z [cluster1]                 "numberReady": 1,
2021-07-18T14:15:07.8805537Z [cluster1]                 "observedGeneration": 1,
2021-07-18T14:15:07.8806478Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-18T14:15:07.8807111Z [cluster1]             }
2021-07-18T14:15:07.8807441Z [cluster1]         },
2021-07-18T14:15:07.8808167Z [cluster1]         "gateways": [
2021-07-18T14:15:07.8808539Z [cluster1]             {
2021-07-18T14:15:07.8808918Z [cluster1]                 "connections": [
2021-07-18T14:15:07.8809311Z [cluster1]                     {
2021-07-18T14:15:07.8809685Z [cluster1]                         "endpoint": {
2021-07-18T14:15:07.8810149Z [cluster1]                             "backend": "libreswan",
2021-07-18T14:15:07.8810769Z [cluster1]                             "backend_config": {
2021-07-18T14:15:07.8811774Z [cluster1]                                 "natt-discovery-port": "4490",
2021-07-18T14:15:07.8812510Z [cluster1]                                 "preferred-server": "false"
2021-07-18T14:15:07.8812958Z [cluster1]                             },
2021-07-18T14:15:07.8813804Z [cluster1]                             "cable_name": "submariner-cable-cluster2-172-18-0-6",
2021-07-18T14:15:07.8814528Z [cluster1]                             "cluster_id": "cluster2",
2021-07-18T14:15:07.8815212Z [cluster1]                             "hostname": "cluster2-worker",
2021-07-18T14:15:07.8815718Z [cluster1]                             "nat_enabled": false,
2021-07-18T14:15:07.8816170Z [cluster1]                             "private_ip": "172.18.0.6",
2021-07-18T14:15:07.8816598Z [cluster1]                             "public_ip": "104.210.193.16",
2021-07-18T14:15:07.8817018Z [cluster1]                             "subnets": [
2021-07-18T14:15:07.8817424Z [cluster1]                                 "242.254.2.0/24"
2021-07-18T14:15:07.8817771Z [cluster1]                             ]
2021-07-18T14:15:07.8818121Z [cluster1]                         },
2021-07-18T14:15:07.8818502Z [cluster1]                         "latencyRTT": {
2021-07-18T14:15:07.8819131Z [cluster1]                             "average": "220.856µs",
2021-07-18T14:15:07.8819884Z [cluster1]                             "last": "199.002µs",
2021-07-18T14:15:07.8820437Z [cluster1]                             "max": "570.204µs",
2021-07-18T14:15:07.8821131Z [cluster1]                             "min": "137.101µs",
2021-07-18T14:15:07.8823026Z [cluster1]                             "stdDev": "92.95µs"
2021-07-18T14:15:07.8823621Z [cluster1]                         },
2021-07-18T14:15:07.8824197Z [cluster1]                         "status": "connected",
2021-07-18T14:15:07.8824688Z [cluster1]                         "statusMessage": "",
2021-07-18T14:15:07.8825139Z [cluster1]                         "usingIP": "172.18.0.6"
2021-07-18T14:15:07.8825546Z [cluster1]                     }
2021-07-18T14:15:07.8825887Z [cluster1]                 ],
2021-07-18T14:15:07.8826289Z [cluster1]                 "haStatus": "active",
2021-07-18T14:15:07.8826743Z [cluster1]                 "localEndpoint": {
2021-07-18T14:15:07.8827225Z [cluster1]                     "backend": "libreswan",
2021-07-18T14:15:07.8827851Z [cluster1]                     "backend_config": {
2021-07-18T14:15:07.8828554Z [cluster1]                         "natt-discovery-port": "4490",
2021-07-18T14:15:07.8829282Z [cluster1]                         "preferred-server": "false"
2021-07-18T14:15:07.8829719Z [cluster1]                     },
2021-07-18T14:15:07.8830552Z [cluster1]                     "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-18T14:15:07.8833723Z [cluster1]                     "cluster_id": "cluster1",
2021-07-18T14:15:07.8835118Z [cluster1]                     "hoster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-18T14:15:07.8836778Z [cluster2]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-18T14:15:07.8837661Z [cluster2]                 "lastState": {
2021-07-18T14:15:07.8838089Z [cluster2]                     "terminated": {
2021-07-18T14:15:07.8839349Z [cluster2]                         "containerID": "containerd://51cc403c72817908886a78c085621e49d1d77ab68070dc6338e760dfce6db604",
2021-07-18T14:15:07.8840615Z [cluster2]                         "exitCode": 1,
2021-07-18T14:15:07.8841233Z [cluster2]                         "finishedAt": "2021-07-18T14:13:49Z",
2021-07-18T14:15:07.8841696Z [cluster2]                         "reason": "Error",
2021-07-18T14:15:07.8842299Z [cluster2]                         "startedAt": "2021-07-18T14:13:40Z"
2021-07-18T14:15:07.8842690Z [cluster2]                     }
2021-07-18T14:15:07.8843026Z [cluster2]                 },
2021-07-18T14:15:07.8843752Z [cluster2]                 "name": "submariner-operator",
2021-07-18T14:15:07.8844271Z [cluster2]                 "ready": true,
2021-07-18T14:15:07.8844683Z [cluster2]                 "restartCount": 1,
2021-07-18T14:15:07.8845119Z [cluster2]                 "started": true,
2021-07-18T14:15:07.8845497Z [cluster2]                 "state": {
2021-07-18T14:15:07.8845881Z [cluster2]                     "running": {
2021-07-18T14:15:07.8846514Z [cluster2]                         "startedAt": "2021-07-18T14:13:59Z"
2021-07-18T14:15:07.8846910Z [cluster2]                     }
2021-07-18T14:15:07.8847254Z [cluster2]                 }
2021-07-18T14:15:07.8847569Z [cluster2]             }
2021-07-18T14:15:07.8848171Z [cluster2]         ],
2021-07-18T14:15:07.8848697Z [cluster2]         "hostIP": "172.18.0.7",
2021-07-18T14:15:07.8849115Z [cluster2]         "phase": "Running",
2021-07-18T14:15:07.8849517Z [cluster2]         "podIP": "10.0.0.3",
2021-07-18T14:15:07.8849909Z [cluster2]         "podIPs": [
2021-07-18T14:15:07.8850262Z [cluster2]             {
2021-07-18T14:15:07.8850620Z [cluster2]                 "ip": "10.0.0.3"
2021-07-18T14:15:07.8850959Z [cluster2]             }
2021-07-18T14:15:07.8851294Z [cluster2]         ],
2021-07-18T14:15:07.8851862Z [cluster2]         "qosClass": "BestEffort",
2021-07-18T14:15:07.8852499Z [cluster2]         "startTime": "2021-07-18T14:13:39Z"
2021-07-18T14:15:07.8852883Z [cluster2]     }
2021-07-18T14:15:07.8853185Z [cluster2] }
2021-07-18T14:15:07.8854424Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:07.8856489Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:07.8857788Z [submariner-operator]$ [cluster2] grep Running
2021-07-18T14:15:07.8860007Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-18T14:15:07.8861382Z [cluster2] Running
2021-07-18T14:15:07.8862864Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator
2021-07-18T14:15:07.8865624Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator
2021-07-18T14:15:07.8867686Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-p5qx9 --namespace=submariner-operator
2021-07-18T14:15:07.8868795Z [cluster2] I0718 14:13:59.973168       1 main.go:77] cmd "msg"="Go Version: go1.16.5"  
2021-07-18T14:15:07.8869359Z [cluster2] I0718 14:13:59.973245       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"  
2021-07-18T14:15:07.8870395Z [cluster2] I0718 14:13:59.973255       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"  
2021-07-18T14:15:07.8871699Z [cluster2] I0718 14:13:59.973262       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"  
2021-07-18T14:15:07.8872442Z [cluster2] I0718 14:13:59.973500       1 leader.go:89] leader "msg"="Trying to become the leader."  
2021-07-18T14:15:07.8874785Z [cluster2] I0718 14:14:00.596292       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."  
2021-07-18T14:15:07.8876096Z [cluster2] I0718 14:14:00.596358       1 leader.go:123] leader "msg"="Continuing as the leader."  
2021-07-18T14:15:07.8878381Z [cluster2] I0718 14:14:01.200399       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-18T14:15:07.8879349Z [cluster2] I0718 14:14:01.201110       1 main.go:129] cmd "msg"="Registering Components."  
2021-07-18T14:15:07.8880140Z [cluster2] I0718 14:14:01.201489       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"  
2021-07-18T14:15:07.8881259Z [cluster2] I0718 14:14:05.222950       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.8883347Z [cluster2] I0718 14:14:05.223124       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.8884456Z [cluster2] I0718 14:14:05.223268       1 main.go:203] cmd "msg"="Starting the Cmd."  
2021-07-18T14:15:07.8885760Z [cluster2] I0718 14:14:05.223628       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-18T14:15:07.8891156Z [cluster2] I0718 14:14:05.224403       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:15:07.8899089Z [cluster2] I0718 14:14:05.224840       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-18T14:15:07.8911428Z [cluster2] I0718 14:14:05.226156       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:15:07.8916589Z [cluster2] I0718 14:14:05.227792       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-18T14:15:07.8920083Z [cluster2] I0718 14:14:05.229001       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-18T14:15:07.8923155Z [cluster2] I0718 14:14:05.326859       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:15:07.8928124Z [cluster2] I0718 14:14:05.327069       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-18T14:15:07.8933982Z [cluster2] I0718 14:14:05.327207       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-18T14:15:07.8936980Z [cluster2] I0718 14:14:05.331411       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker" 
2021-07-18T14:15:07.8940866Z [cluster2] I0718 14:14:05.331502       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:07.8944738Z [cluster2] I0718 14:14:05.427942       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-18T14:15:07.8948604Z [cluster2] I0718 14:14:05.428051       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-18T14:15:07.8951679Z [cluster2] I0718 14:14:05.428205       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.8954920Z [cluster2] I0718 14:14:05.430134       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-18T14:15:07.8957504Z [cluster2] I0718 14:14:05.430382       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"  
2021-07-18T14:15:07.8959289Z [cluster2] I0718 14:14:05.437484       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-18T14:15:07.8961342Z [cluster2] I0718 14:14:05.437535       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-18T14:15:07.8962997Z [cluster2] I0718 14:14:05.530882       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-18T14:15:07.8964499Z [cluster2] I0718 14:14:05.530967       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"  
2021-07-18T14:15:07.8965929Z [cluster2] I0718 14:14:05.530985       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-18T14:15:07.8967882Z [cluster2] I0718 14:14:05.531052       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.8969155Z [cluster2] I0718 14:14:05.578048       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"  
2021-07-18T14:15:07.8970539Z [cluster2] I0718 14:14:05.578244       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-18T14:15:07.8971800Z [cluster2] I0718 14:14:05.578326       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.8973158Z [cluster2] I0718 14:14:05.578386       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.8975122Z [cluster2] I0718 14:14:05.590252       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.8977088Z [cluster2] I0718 14:14:05.646938       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"  
2021-07-18T14:15:07.8978502Z [cluster2] I0718 14:14:05.647133       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-18T14:15:07.8979674Z [cluster2] I0718 14:14:05.647235       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.8980881Z [cluster2] I0718 14:14:05.647342       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.8982877Z [cluster2] I0718 14:14:05.681931       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.8985693Z [cluster2] I0718 14:14:05.786738       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.8988563Z [cluster2] E0718 14:14:05.786835       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" 
2021-07-18T14:15:07.8991216Z [cluster2] I0718 14:14:05.786932       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.8992708Z [cluster2] I0718 14:14:05.787007       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.8993782Z [cluster2] I0718 14:14:05.787024       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.8996277Z [cluster2] E0718 14:14:05.895743       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-18T14:15:07.8999084Z [cluster2] I0718 14:14:05.902946       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9002353Z [cluster2] I0718 14:14:05.903031       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9003773Z [cluster2] I0718 14:14:05.903043       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9006929Z [cluster2] I0718 14:14:05.935538       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9010178Z [cluster2] I0718 14:14:05.971580       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9013086Z [cluster2] I0718 14:14:05.973484       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9015527Z [cluster2] I0718 14:14:06.040169       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9017924Z [cluster2] I0718 14:14:06.584451       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9020291Z [cluster2] I0718 14:14:06.613739       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9022836Z [cluster2] I0718 14:14:06.629637       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9025201Z [cluster2] I0718 14:14:06.653521       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9027580Z [cluster2] I0718 14:14:06.713045       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9030169Z [cluster2] I0718 14:14:06.729107       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9032586Z [cluster2] I0718 14:14:07.400294       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9035139Z [cluster2] I0718 14:14:07.467991       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9037418Z [cluster2] I0718 14:14:07.559631       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9039653Z [cluster2] I0718 14:14:07.559744       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9041920Z [cluster2] I0718 14:14:07.567158       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-18T14:15:07.9044499Z [cluster2] I0718 14:14:07.650411       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9047849Z [cluster2] E0718 14:14:07.650525       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-18T14:15:07.9050621Z [cluster2] I0718 14:14:07.651086       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9053077Z [cluster2] I0718 14:14:07.748265       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9070235Z [cluster2] E0718 14:14:07.754820       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:07.9075644Z [cluster2] I0718 14:14:07.760077       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9078835Z [cluster2] I0718 14:14:07.858831       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9081414Z [cluster2] I0718 14:14:07.884074       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9083225Z [cluster2] I0718 14:14:07.907524       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9084489Z [cluster2] I0718 14:14:07.907596       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9086996Z [cluster2] I0718 14:14:07.922546       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9089721Z [cluster2] I0718 14:14:08.009277       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9092583Z [cluster2] I0718 14:14:08.071101       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9097933Z [cluster2] E0718 14:14:08.071156       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-18T14:15:07.9103143Z [cluster2] I0718 14:14:08.071181       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9106543Z [cluster2] I0718 14:14:08.083383       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9109455Z [cluster2] I0718 14:14:08.387251       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9112338Z [cluster2] I0718 14:14:08.476454       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9115975Z [cluster2] E0718 14:14:08.477571       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9118447Z [cluster2] I0718 14:14:08.479718       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9120251Z [cluster2] I0718 14:14:08.479753       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9121309Z [cluster2] I0718 14:14:08.479762       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9124202Z [cluster2] E0718 14:14:08.556078       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:07.9129026Z [cluster2] I0718 14:14:08.620932       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9132130Z [cluster2] I0718 14:14:08.650530       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9134780Z [cluster2] I0718 14:14:08.650906       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9137495Z [cluster2] I0718 14:14:08.710604       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9140156Z [cluster2] I0718 14:14:08.792863       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9143577Z [cluster2] I0718 14:14:08.817803       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9147900Z [cluster2] I0718 14:14:08.825517       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9150923Z [cluster2] I0718 14:14:08.954773       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9153940Z [cluster2] I0718 14:14:08.960694       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9156798Z [cluster2] I0718 14:14:08.985431       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9159330Z [cluster2] I0718 14:14:09.252252       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9161960Z [cluster2] I0718 14:14:09.390371       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-18T14:15:07.9164728Z [cluster2] I0718 14:14:09.422267       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9167306Z [cluster2] I0718 14:14:09.436248       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9171576Z [cluster2] I0718 14:14:09.572191       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9174289Z [cluster2] I0718 14:14:09.603574       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9176916Z [cluster2] I0718 14:14:09.609694       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9179677Z [cluster2] I0718 14:14:10.206090       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9184123Z [cluster2] I0718 14:14:10.264583       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9187722Z [cluster2] I0718 14:14:10.321402       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9191119Z [cluster2] I0718 14:14:10.345410       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9192964Z [cluster2] I0718 14:14:10.345535       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9194062Z [cluster2] I0718 14:14:10.345602       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9196568Z [cluster2] I0718 14:14:10.463898       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9200478Z [cluster2] I0718 14:14:10.732931       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9206559Z [cluster2] E0718 14:14:10.733114       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: Service \"submariner-lighthouse-coredns-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-18T14:15:07.9210729Z [cluster2] I0718 14:14:10.733144       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9213834Z [cluster2] I0718 14:14:10.792974       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9216464Z [cluster2] I0718 14:14:10.919405       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9219285Z [cluster2] I0718 14:14:11.206177       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9225211Z [cluster2] E0718 14:14:11.206812       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-18T14:15:07.9228466Z [cluster2] I0718 14:14:11.206848       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9230728Z [cluster2] I0718 14:14:11.342725       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9233494Z [cluster2] E0718 14:14:11.434868       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9235742Z [cluster2] I0718 14:14:11.434959       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9236991Z [cluster2] I0718 14:14:11.435022       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9238384Z [cluster2] I0718 14:14:11.435032       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9241232Z [cluster2] I0718 14:14:11.445160       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9244835Z [cluster2] I0718 14:14:11.576299       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9247805Z [cluster2] I0718 14:14:11.695662       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9252013Z [cluster2] I0718 14:14:11.700179       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9256100Z [cluster2] I0718 14:14:11.859058       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9258502Z [cluster2] I0718 14:14:12.041318       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9260879Z [cluster2] I0718 14:14:12.095562       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9263389Z [cluster2] I0718 14:14:12.117433       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9265886Z [cluster2] I0718 14:14:12.167778       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9268392Z [cluster2] I0718 14:14:12.276310       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9271091Z [cluster2] I0718 14:14:12.295526       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9273961Z [cluster2] I0718 14:14:12.322371       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9276883Z [cluster2] I0718 14:14:12.421298       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9307822Z [cluster2] I0718 14:14:12.447099       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9311825Z [cluster2] I0718 14:14:12.464587       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9315890Z [cluster2] I0718 14:14:12.551397       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9318979Z [cluster2] I0718 14:14:12.651558       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9323334Z [cluster2] I0718 14:14:12.689553       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9326069Z [cluster2] I0718 14:14:12.802518       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9328713Z [cluster2] I0718 14:14:12.803662       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9331533Z [cluster2] I0718 14:14:12.983487       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9337901Z [cluster2] I0718 14:14:13.013904       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9341523Z [cluster2] I0718 14:14:13.013950       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.192.159\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"  
2021-07-18T14:15:07.9344626Z [cluster2] I0718 14:14:13.060851       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9346943Z [cluster2] I0718 14:14:13.102980       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9350011Z [cluster2] I0718 14:14:13.103268       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9352757Z [cluster2] I0718 14:14:13.151648       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9355985Z [cluster2] I0718 14:14:13.151689       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.192.159\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"  
2021-07-18T14:15:07.9363857Z [cluster2] I0718 14:14:13.154210       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9367416Z [cluster2] I0718 14:14:13.404214       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9371619Z [cluster2] I0718 14:14:13.761903       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9374884Z [cluster2] I0718 14:14:13.781540       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9377869Z [cluster2] I0718 14:14:13.790651       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9381508Z [cluster2] I0718 14:14:14.392690       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9386209Z [cluster2] I0718 14:14:14.397358       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9390170Z [cluster2] I0718 14:14:14.397434       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.192.159\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"  
2021-07-18T14:15:07.9393540Z [cluster2] I0718 14:14:24.501188       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9395707Z [cluster2] I0718 14:14:24.501238       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9397858Z [cluster2] I0718 14:14:24.501248       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9400194Z [cluster2] I0718 14:14:24.620330       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9403237Z [cluster2] I0718 14:14:24.643723       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9410538Z [cluster2] I0718 14:14:25.272742       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9416077Z [cluster2] I0718 14:14:25.656506       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9420867Z [cluster2] I0718 14:14:25.724546       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9424714Z [cluster2] I0718 14:14:25.782331       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9432642Z [cluster2] I0718 14:14:26.353067       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9436429Z [cluster2] I0718 14:14:26.383849       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9440950Z [cluster2] I0718 14:14:26.398936       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9444718Z [cluster2] I0718 14:14:26.425981       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9450488Z [cluster2] I0718 14:14:26.445096       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9452276Z [cluster2] I0718 14:14:26.445549       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9453623Z [cluster2] I0718 14:14:26.446272       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9455360Z [cluster2] I0718 14:14:26.461544       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9456709Z [cluster2] I0718 14:14:26.461581       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9457974Z [cluster2] I0718 14:14:26.461689       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9460865Z [cluster2] I0718 14:14:26.701149       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9463505Z [cluster2] I0718 14:14:26.773782       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9466079Z [cluster2] I0718 14:14:26.909598       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9468922Z [cluster2] I0718 14:14:26.910156       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9472504Z [cluster2] I0718 14:14:27.143219       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9476076Z [cluster2] I0718 14:14:27.383763       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9479473Z [cluster2] I0718 14:14:27.549345       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9482602Z [cluster2] I0718 14:14:27.549956       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9485234Z [cluster2] I0718 14:14:27.585030       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9487911Z [cluster2] I0718 14:14:27.669822       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9490358Z [cluster2] I0718 14:14:27.694889       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9492916Z [cluster2] I0718 14:14:27.771080       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9495510Z [cluster2] I0718 14:14:27.816491       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9498020Z [cluster2] I0718 14:14:27.864458       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9500911Z [cluster2] I0718 14:14:27.926864       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9503735Z [cluster2] I0718 14:14:28.312980       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9507937Z [cluster2] I0718 14:14:28.362653       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9512567Z [cluster2] I0718 14:14:28.362889       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.192.159\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"  
2021-07-18T14:15:07.9515855Z [cluster2] I0718 14:14:28.485387       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9518528Z [cluster2] I0718 14:14:28.493606       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9522038Z [cluster2] I0718 14:14:28.550733       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9526141Z [cluster2] I0718 14:14:28.566068       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9529015Z [cluster2] I0718 14:14:28.632206       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9531258Z [cluster2] I0718 14:14:28.685006       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9533128Z [cluster2] I0718 14:14:28.693233       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9534334Z [cluster2] I0718 14:14:28.693250       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9536374Z [cluster2] I0718 14:14:28.687095       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9537846Z [cluster2] I0718 14:14:28.694400       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9539162Z [cluster2] I0718 14:14:28.694411       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9541600Z [cluster2] I0718 14:14:28.732486       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9544697Z [cluster2] I0718 14:14:28.737895       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9547365Z [cluster2] I0718 14:14:28.750638       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9549890Z [cluster2] I0718 14:14:28.751754       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9552571Z [cluster2] I0718 14:14:29.170607       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9555384Z [cluster2] I0718 14:14:29.189674       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-18T14:15:07.9558361Z [cluster2] I0718 14:14:29.214078       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9561067Z [cluster2] I0718 14:14:29.360186       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9566248Z [cluster2] I0718 14:14:29.363562       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9571631Z [cluster2] I0718 14:14:29.388649       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9574332Z [cluster2] I0718 14:14:29.388833       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9576932Z [cluster2] I0718 14:14:29.400306       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9580412Z [cluster2] I0718 14:14:29.403596       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9583042Z [cluster2] I0718 14:14:29.410849       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9585638Z [cluster2] I0718 14:14:29.411196       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9588237Z [cluster2] I0718 14:14:29.815596       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9591410Z [cluster2] I0718 14:14:29.817395       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9595214Z [cluster2] I0718 14:14:29.817434       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.192.159\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"  
2021-07-18T14:15:07.9599935Z [cluster2] I0718 14:14:30.017484       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9602534Z [cluster2] I0718 14:14:30.017862       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9605559Z [cluster2] E0718 14:14:30.036506       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9610237Z [cluster2] I0718 14:14:30.036651       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9612894Z [cluster2] I0718 14:14:30.036811       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9614034Z [cluster2] I0718 14:14:30.036882       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9615821Z [cluster2] I0718 14:14:30.040077       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9617321Z [cluster2] I0718 14:14:30.040172       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9618975Z [cluster2] I0718 14:14:30.040261       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9622258Z [cluster2] I0718 14:14:30.048165       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9625789Z [cluster2] I0718 14:14:30.048802       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9628362Z [cluster2] I0718 14:14:30.053690       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9631549Z [cluster2] I0718 14:14:30.054090       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9635262Z [cluster2] I0718 14:14:30.655648       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9638353Z [cluster2] I0718 14:14:30.655709       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9640811Z [cluster2] I0718 14:14:30.727952       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9643737Z [cluster2] I0718 14:14:30.729491       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9646491Z [cluster2] I0718 14:14:30.736302       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9650337Z [cluster2] I0718 14:14:30.739276       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9654570Z [cluster2] I0718 14:14:30.743198       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9657834Z [cluster2] I0718 14:14:30.748024       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9660882Z [cluster2] I0718 14:14:31.344655       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9663567Z [cluster2] I0718 14:14:31.349524       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9666034Z [cluster2] I0718 14:14:31.363679       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9667304Z [cluster2] I0718 14:14:31.363832       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9668578Z [cluster2] I0718 14:14:31.363877       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9670892Z [cluster2] E0718 14:14:31.365150       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9673911Z [cluster2] I0718 14:14:31.365265       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9676173Z [cluster2] I0718 14:14:31.365324       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9677285Z [cluster2] I0718 14:14:31.365355       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9679445Z [cluster2] I0718 14:14:31.383606       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9681888Z [cluster2] I0718 14:14:31.384218       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9684372Z [cluster2] I0718 14:14:31.390360       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9687800Z [cluster2] I0718 14:14:31.390839       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9710186Z [cluster2] I0718 14:14:31.995332       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9713859Z [cluster2] I0718 14:14:31.996298       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9717629Z [cluster2] I0718 14:14:32.016552       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9721088Z [cluster2] I0718 14:14:32.017578       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9724455Z [cluster2] I0718 14:14:32.028565       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9729141Z [cluster2] I0718 14:14:32.029538       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9732766Z [cluster2] I0718 14:14:32.036464       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9736399Z [cluster2] I0718 14:14:32.042738       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9739646Z [cluster2] I0718 14:14:32.638112       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9742913Z [cluster2] I0718 14:14:32.647326       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9744644Z [cluster2] I0718 14:14:32.647376       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9746253Z [cluster2] I0718 14:14:32.647409       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9749193Z [cluster2] I0718 14:14:32.650648       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9752035Z [cluster2] I0718 14:14:32.656071       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9755522Z [cluster2] E0718 14:14:32.663524       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9757998Z [cluster2] I0718 14:14:32.663556       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9759283Z [cluster2] I0718 14:14:32.663585       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9760341Z [cluster2] I0718 14:14:32.663602       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9762286Z [cluster2] I0718 14:14:32.670400       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9764771Z [cluster2] I0718 14:14:32.689035       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9768583Z [cluster2] I0718 14:14:32.692605       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9771586Z [cluster2] I0718 14:14:33.272291       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9774316Z [cluster2] I0718 14:14:33.277303       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9777287Z [cluster2] I0718 14:14:33.281070       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9780849Z [cluster2] I0718 14:14:33.285089       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9784616Z [cluster2] I0718 14:14:33.295374       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9787731Z [cluster2] I0718 14:14:33.301184       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9790661Z [cluster2] I0718 14:14:33.305751       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9793577Z [cluster2] I0718 14:14:33.308545       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9796427Z [cluster2] I0718 14:14:33.886907       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9799395Z [cluster2] E0718 14:14:33.893806       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9801785Z [cluster2] I0718 14:14:33.893883       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9803246Z [cluster2] I0718 14:14:33.893956       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9804309Z [cluster2] I0718 14:14:33.893984       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9806224Z [cluster2] I0718 14:14:33.901469       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9809032Z [cluster2] I0718 14:14:33.906464       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9813393Z [cluster2] I0718 14:14:33.918630       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9816134Z [cluster2] I0718 14:14:34.508658       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9818826Z [cluster2] I0718 14:14:34.517356       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9822187Z [cluster2] I0718 14:14:34.524272       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9825731Z [cluster2] I0718 14:14:34.528576       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9828231Z [cluster2] I0718 14:14:35.131289       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9830717Z [cluster2] I0718 14:14:35.753419       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9832164Z [cluster2] I0718 14:14:35.753754       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9835257Z [cluster2] I0718 14:14:35.753905       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9837297Z [cluster2] I0718 14:14:35.763073       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9840123Z [cluster2] I0718 14:14:35.768071       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9842817Z [cluster2] I0718 14:14:36.370496       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9845452Z [cluster2] I0718 14:14:36.376623       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9848302Z [cluster2] I0718 14:14:36.381759       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9850850Z [cluster2] I0718 14:14:36.387692       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9854031Z [cluster2] I0718 14:14:36.990165       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9856129Z [cluster2] I0718 14:14:37.014101       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9857423Z [cluster2] I0718 14:14:37.014211       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9858503Z [cluster2] I0718 14:14:37.014273       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9860301Z [cluster2] I0718 14:14:37.023771       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9861622Z [cluster2] I0718 14:14:37.023824       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9862684Z [cluster2] I0718 14:14:37.023838       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9864643Z [cluster2] I0718 14:14:37.036890       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9867250Z [cluster2] I0718 14:14:37.046192       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9869733Z [cluster2] I0718 14:14:37.049049       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9872237Z [cluster2] I0718 14:14:37.052009       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9875073Z [cluster2] I0718 14:14:37.660121       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9878396Z [cluster2] I0718 14:14:37.674213       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9882364Z [cluster2] I0718 14:14:37.701842       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9884860Z [cluster2] I0718 14:14:37.710018       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9887347Z [cluster2] I0718 14:14:37.717255       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9890060Z [cluster2] I0718 14:14:37.721596       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9892603Z [cluster2] I0718 14:14:37.738000       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9895381Z [cluster2] I0718 14:14:37.738106       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9898093Z [cluster2] I0718 14:14:38.340415       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9900679Z [cluster2] I0718 14:14:38.346214       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9902782Z [cluster2] I0718 14:14:40.773058       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9904354Z [cluster2] I0718 14:14:40.773172       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9905409Z [cluster2] I0718 14:14:40.773184       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9907349Z [cluster2] I0718 14:14:40.783170       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9910015Z [cluster2] I0718 14:14:40.787444       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9917686Z [cluster2] I0718 14:14:41.390220       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9921200Z [cluster2] I0718 14:14:41.396077       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9924033Z [cluster2] I0718 14:14:41.401374       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9927156Z [cluster2] I0718 14:14:41.416612       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9930166Z [cluster2] I0718 14:14:42.018788       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9932814Z [cluster2] I0718 14:14:42.032320       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9934131Z [cluster2] I0718 14:14:42.032503       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9935236Z [cluster2] I0718 14:14:42.032929       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9936823Z [cluster2] I0718 14:14:42.037119       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9938108Z [cluster2] I0718 14:14:42.039200       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9939168Z [cluster2] I0718 14:14:42.039222       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9941076Z [cluster2] I0718 14:14:42.051071       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9943667Z [cluster2] I0718 14:14:42.052809       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9946315Z [cluster2] I0718 14:14:42.058046       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9948906Z [cluster2] I0718 14:14:42.060581       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9951753Z [cluster2] I0718 14:14:42.659624       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9954361Z [cluster2] I0718 14:14:42.671747       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9957240Z [cluster2] I0718 14:14:42.687521       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9960353Z [cluster2] I0718 14:14:42.696986       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9963300Z [cluster2] I0718 14:14:42.709397       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9966471Z [cluster2] I0718 14:14:42.710437       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9969863Z [cluster2] I0718 14:14:42.721996       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9973097Z [cluster2] I0718 14:14:42.722907       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9975596Z [cluster2] I0718 14:14:43.324161       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9978021Z [cluster2] I0718 14:14:43.327109       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9980065Z [cluster2] I0718 14:14:45.797152       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:07.9981487Z [cluster2] I0718 14:14:45.797206       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:07.9982552Z [cluster2] I0718 14:14:45.797218       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:07.9984499Z [cluster2] I0718 14:14:45.808994       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9986984Z [cluster2] I0718 14:14:45.813728       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9989444Z [cluster2] I0718 14:14:46.416200       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:07.9991889Z [cluster2] I0718 14:14:46.430064       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9994367Z [cluster2] I0718 14:14:46.437554       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:07.9996855Z [cluster2] I0718 14:14:46.443905       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:07.9999361Z [cluster2] I0718 14:14:47.046025       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0001736Z [cluster2] I0718 14:14:47.057704       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0003064Z [cluster2] I0718 14:14:47.057792       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0005143Z [cluster2] I0718 14:14:47.057805       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0006917Z [cluster2] I0718 14:14:47.062601       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0008853Z [cluster2] I0718 14:14:47.062690       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0009936Z [cluster2] I0718 14:14:47.062710       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0012915Z [cluster2] I0718 14:14:47.401084       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0016686Z [cluster2] I0718 14:14:47.401382       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0019401Z [cluster2] I0718 14:14:47.410497       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0021933Z [cluster2] I0718 14:14:47.429090       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0024376Z [cluster2] I0718 14:14:48.012483       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0027022Z [cluster2] I0718 14:14:48.020300       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0029850Z [cluster2] I0718 14:14:48.032024       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0033577Z [cluster2] I0718 14:14:48.032024       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0037118Z [cluster2] I0718 14:14:48.039635       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0040387Z [cluster2] I0718 14:14:48.041682       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0043178Z [cluster2] I0718 14:14:48.045181       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0045671Z [cluster2] I0718 14:14:48.059746       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0048683Z [cluster2] I0718 14:14:48.643780       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0051502Z [cluster2] I0718 14:14:48.662450       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0053540Z [cluster2] I0718 14:14:50.829654       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0054952Z [cluster2] I0718 14:14:50.829770       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0056027Z [cluster2] I0718 14:14:50.829798       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0058528Z [cluster2] I0718 14:14:50.852803       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0061324Z [cluster2] I0718 14:14:50.858660       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0063988Z [cluster2] I0718 14:14:51.460434       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0075231Z [cluster2] I0718 14:14:51.465873       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0078231Z [cluster2] I0718 14:14:51.470340       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0081028Z [cluster2] I0718 14:14:51.485198       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0084077Z [cluster2] I0718 14:14:52.087345       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0087219Z [cluster2] I0718 14:14:52.103804       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0088807Z [cluster2] I0718 14:14:52.103862       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0089954Z [cluster2] I0718 14:14:52.103877       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0092157Z [cluster2] I0718 14:14:52.104039       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0093882Z [cluster2] I0718 14:14:52.104200       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0095061Z [cluster2] I0718 14:14:52.104299       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0097724Z [cluster2] I0718 14:14:52.113878       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0100851Z [cluster2] I0718 14:14:52.117054       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0103738Z [cluster2] I0718 14:14:52.118785       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0107340Z [cluster2] I0718 14:14:52.123362       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0113907Z [cluster2] I0718 14:14:52.721311       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0118366Z [cluster2] I0718 14:14:52.726183       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0121225Z [cluster2] I0718 14:14:52.736215       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0123706Z [cluster2] I0718 14:14:52.741375       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0126193Z [cluster2] I0718 14:14:52.748826       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0128940Z [cluster2] I0718 14:14:52.759777       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0131574Z [cluster2] I0718 14:14:52.762380       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0134152Z [cluster2] I0718 14:14:52.783519       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0137699Z [cluster2] I0718 14:14:53.363748       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0140721Z [cluster2] I0718 14:14:53.385459       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0142954Z [cluster2] I0718 14:14:55.873611       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0144395Z [cluster2] I0718 14:14:55.873672       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0145479Z [cluster2] I0718 14:14:55.873682       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0147552Z [cluster2] I0718 14:14:55.886122       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0151688Z [cluster2] I0718 14:14:55.892042       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0154568Z [cluster2] I0718 14:14:56.493595       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0157023Z [cluster2] I0718 14:14:56.500505       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0159767Z [cluster2] I0718 14:14:56.507835       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0162875Z [cluster2] I0718 14:14:56.526044       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0165933Z [cluster2] I0718 14:14:57.128450       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0168958Z [cluster2] I0718 14:14:57.143795       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0170521Z [cluster2] I0718 14:14:57.143852       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0171780Z [cluster2] I0718 14:14:57.143864       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0173380Z [cluster2] I0718 14:14:57.146171       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0174662Z [cluster2] I0718 14:14:57.146377       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0175741Z [cluster2] I0718 14:14:57.146397       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0178010Z [cluster2] I0718 14:14:57.162315       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0180596Z [cluster2] I0718 14:14:57.164077       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0183915Z [cluster2] I0718 14:14:57.176984       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0187421Z [cluster2] I0718 14:14:57.177515       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0191939Z [cluster2] I0718 14:14:57.779287       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0195158Z [cluster2] I0718 14:14:57.779314       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0197792Z [cluster2] I0718 14:14:57.785937       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0200287Z [cluster2] I0718 14:14:57.789643       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0202888Z [cluster2] I0718 14:14:57.792926       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0207243Z [cluster2] I0718 14:14:57.800406       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0210860Z [cluster2] I0718 14:14:57.801633       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0215131Z [cluster2] I0718 14:14:57.821495       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0218751Z [cluster2] I0718 14:14:58.401455       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0221337Z [cluster2] I0718 14:14:58.425100       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0223789Z [cluster2] I0718 14:15:00.902389       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0226141Z [cluster2] I0718 14:15:00.902452       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0228154Z [cluster2] I0718 14:15:00.902464       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0230204Z [cluster2] I0718 14:15:00.920536       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0233583Z [cluster2] I0718 14:15:00.925066       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0236936Z [cluster2] I0718 14:15:01.527760       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0239408Z [cluster2] I0718 14:15:01.534801       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0241883Z [cluster2] I0718 14:15:01.540993       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0244395Z [cluster2] I0718 14:15:01.545911       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0246878Z [cluster2] I0718 14:15:02.148075       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0250009Z [cluster2] I0718 14:15:02.160256       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0251845Z [cluster2] I0718 14:15:02.160411       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0254241Z [cluster2] I0718 14:15:02.160429       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0256518Z [cluster2] I0718 14:15:02.170330       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0258191Z [cluster2] I0718 14:15:02.170457       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0262346Z [cluster2] I0718 14:15:02.170551       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0265750Z [cluster2] I0718 14:15:02.172230       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0269212Z [cluster2] I0718 14:15:02.178768       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0272724Z [cluster2] I0718 14:15:02.184203       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0275827Z [cluster2] I0718 14:15:02.194854       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0279571Z [cluster2] I0718 14:15:02.786464       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0282063Z [cluster2] I0718 14:15:02.800177       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0284689Z [cluster2] I0718 14:15:02.804304       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0287173Z [cluster2] I0718 14:15:02.809084       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0290664Z [cluster2] I0718 14:15:02.810044       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0294135Z [cluster2] I0718 14:15:02.819367       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0296928Z [cluster2] I0718 14:15:02.821855       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0299487Z [cluster2] I0718 14:15:02.843381       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0302210Z [cluster2] I0718 14:15:03.423561       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0305005Z [cluster2] I0718 14:15:03.445652       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0308011Z [cluster2] I0718 14:15:05.932938       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0309958Z [cluster2] I0718 14:15:05.933079       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0311313Z [cluster2] I0718 14:15:05.933092       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0313267Z [cluster2] I0718 14:15:05.951384       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0318072Z [cluster2] I0718 14:15:05.956752       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0321373Z [cluster2] I0718 14:15:06.559196       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0323996Z [cluster2] I0718 14:15:06.577228       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0326632Z [cluster2] I0718 14:15:06.583348       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0330449Z [cluster2] I0718 14:15:06.588833       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0336336Z [cluster2] I0718 14:15:07.193917       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-18T14:15:08.0339176Z [cluster2] I0718 14:15:07.213541       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0341257Z [cluster2] I0718 14:15:07.213641       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0342339Z [cluster2] I0718 14:15:07.213653       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0344555Z [cluster2] I0718 14:15:07.213591       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-18T14:15:08.0348969Z [cluster2] I0718 14:15:07.213697       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-18T14:15:08.0350058Z [cluster2] I0718 14:15:07.213705       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-18T14:15:08.0352273Z [cluster2] I0718 14:15:07.248371       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0355865Z [cluster2] I0718 14:15:07.254878       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0362030Z [cluster2] I0718 14:15:07.256543       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-18T14:15:08.0364920Z [cluster2] I0718 14:15:07.287269       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-18T14:15:08.0366484Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-18T14:15:08.0367258Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-18T14:15:08.3028934Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-otname": "cluster1-worker",
2021-07-18T14:15:08.3029864Z [cluster1]                     "nat_enabled": false,
2021-07-18T14:15:08.3030327Z [cluster1]                     "private_ip": "172.18.0.5",
2021-07-18T14:15:08.3030915Z [cluster1]                     "public_ip": "104.210.193.16",
2021-07-18T14:15:08.3031339Z [cluster1]                     "subnets": [
2021-07-18T14:15:08.3031718Z [cluster1]                         "242.254.1.0/24"
2021-07-18T14:15:08.3032064Z [cluster1]                     ]
2021-07-18T14:15:08.3032401Z [cluster1]                 },
2021-07-18T14:15:08.3032791Z [cluster1]                 "statusFailure": "",
2021-07-18T14:15:08.3033464Z [cluster1]                 "version": "devel-1441a80"
2021-07-18T14:15:08.3033858Z [cluster1]             }
2021-07-18T14:15:08.3034186Z [cluster1]         ],
2021-07-18T14:15:08.3034554Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-18T14:15:08.3035104Z [cluster1]         "globalnetDaemonSetStatus": {
2021-07-18T14:15:08.3035713Z [cluster1]             "lastResourceVersion": "1848",
2021-07-18T14:15:08.3036354Z [cluster1]             "mismatchedContainerImages": false,
2021-07-18T14:15:08.3037033Z [cluster1]             "nonReadyContainerStates": [],
2021-07-18T14:15:08.3037523Z [cluster1]             "status": {
2021-07-18T14:15:08.3038022Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-18T14:15:08.3038631Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-18T14:15:08.3039397Z [cluster1]                 "numberAvailable": 1,
2021-07-18T14:15:08.3040080Z [cluster1]                 "numberMisscheduled": 0,
2021-07-18T14:15:08.3040766Z [cluster1]                 "numberReady": 1,
2021-07-18T14:15:08.3041257Z [cluster1]                 "observedGeneration": 1,
2021-07-18T14:15:08.3041862Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-18T14:15:08.3043593Z [cluster1]             }
2021-07-18T14:15:08.3044001Z [cluster1]         },
2021-07-18T14:15:08.3044542Z [cluster1]         "loadBalancerStatus": {},
2021-07-18T14:15:08.3045158Z [cluster1]         "natEnabled": false,
2021-07-18T14:15:08.3046413Z [cluster1]         "networkPlugin": "weave-net",
2021-07-18T14:15:08.3047059Z [cluster1]         "routeAgentDaemonSetStatus": {
2021-07-18T14:15:08.3048389Z [cluster1]             "lastResourceVersion": "1825",
2021-07-18T14:15:08.3049281Z [cluster1]             "mismatchedContainerImages": false,
2021-07-18T14:15:08.3049980Z [cluster1]             "nonReadyContainerStates": [],
2021-07-18T14:15:08.3050498Z [cluster1]             "status": {
2021-07-18T14:15:08.3051025Z [cluster1]                 "currentNumberScheduled": 3,
2021-07-18T14:15:08.3051669Z [cluster1]                 "desiredNumberScheduled": 3,
2021-07-18T14:15:08.3052238Z [cluster1]                 "numberAvailable": 3,
2021-07-18T14:15:08.3052772Z [cluster1]                 "numberMisscheduled": 0,
2021-07-18T14:15:08.3053263Z [cluster1]                 "numberReady": 3,
2021-07-18T14:15:08.3053772Z [cluster1]                 "observedGeneration": 1,
2021-07-18T14:15:08.3054567Z [cluster1]                 "updatedNumberScheduled": 3
2021-07-18T14:15:08.3055736Z [cluster1]             }
2021-07-18T14:15:08.3056092Z [cluster1]         },
2021-07-18T14:15:08.3056509Z [cluster1]         "serviceCIDR": "100.0.0.0/16"
2021-07-18T14:15:08.3056900Z [cluster1]     }
2021-07-18T14:15:08.3057406Z [cluster1] }
2021-07-18T14:15:08.3058523Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:15:08.3059844Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:15:08.3061182Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-18T14:15:08.3062555Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:15:08.3063713Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:15:08.3064891Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-18T14:15:08.3066112Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-18T14:15:08.3067047Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-18T14:15:08.3068069Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-18T14:15:08.3069260Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-18T14:15:08.3070309Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-18T14:15:08.3071444Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-18T14:15:08.3072637Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-18T14:15:08.3073938Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-18T14:15:08.3075438Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-18T14:15:08.3858972Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:15:08.3992687Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:15:08.3994500Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-18T14:15:08.4673291Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:15:08.8911563Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURperator
2021-07-18T14:15:08.9143184Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-18T14:15:08.9144539Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-18T14:15:08.9145603Z [submariner-operator]$ [cluster2] grep submariner
2021-07-18T14:15:08.9146286Z [cluster2] submariner   81s
2021-07-18T14:15:08.9147092Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-18T14:15:08.9148255Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:08.9149521Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:08.9150872Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:08.9152056Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-18T14:15:08.9152650Z [cluster2] {
2021-07-18T14:15:08.9153078Z [cluster2]     "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:08.9153579Z [cluster2]     "kind": "Submariner",
2021-07-18T14:15:08.9153960Z [cluster2]     "metadata": {
2021-07-18T14:15:08.9154580Z [cluster2]         "creationTimestamp": "2021-07-18T14:13:47Z",
2021-07-18T14:15:08.9155044Z [cluster2]         "generation": 1,
2021-07-18T14:15:08.9155466Z [cluster2]         "managedFields": [
2021-07-18T14:15:08.9156066Z [cluster2]             {
2021-07-18T14:15:08.9156535Z [cluster2]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:08.9157069Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:08.9157486Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:08.9157864Z [cluster2]                     "f:spec": {
2021-07-18T14:15:08.9158209Z [cluster2]                         ".": {},
2021-07-18T14:15:08.9158581Z [cluster2]                         "f:broker": {},
2021-07-18T14:15:08.9159045Z [cluster2]                         "f:brokerK8sApiServer": {},
2021-07-18T14:15:08.9159638Z [cluster2]                         "f:brokerK8sApiServerToken": {},
2021-07-18T14:15:08.9160179Z [cluster2]                         "f:brokerK8sCA": {},
2021-07-18T14:15:08.9160713Z [cluster2]                         "f:brokerK8sRemoteNamespace": {},
2021-07-18T14:15:08.9161267Z [cluster2]                         "f:cableDriver": {},
2021-07-18T14:15:08.9161705Z [cluster2]                         "f:ceIPSecDebug": {},
2021-07-18T14:15:08.9162191Z [cluster2]                         "f:ceIPSecIKEPort": {},
2021-07-18T14:15:08.9162857Z [cluster2]                         "f:ceIPSecNATTPort": {},
2021-07-18T14:15:08.9163341Z [cluster2]                         "f:ceIPSecPSK": {},
2021-07-18T14:15:08.9163780Z [cluster2]                         "f:clusterCIDR": {},
2021-07-18T14:15:08.9164219Z [cluster2]                         "f:clusterID": {},
2021-07-18T14:15:08.9164658Z [cluster2]                         "f:colorCodes": {},
2021-07-18T14:15:08.9165290Z [cluster2]                         "f:connectionHealthCheck": {
2021-07-18T14:15:08.9165777Z [cluster2]                             ".": {},
2021-07-18T14:15:08.9166325Z [cluster2]                             "f:enabled": {},
2021-07-18T14:15:08.9166778Z [cluster2]                             "f:intervalSeconds": {},
2021-07-18T14:15:08.9167290Z [cluster2]                             "f:maxPacketLossCount": {}
2021-07-18T14:15:08.9168273Z [cluster2]                         },
2021-07-18T14:15:08.9168644Z [cluster2]                         "f:debug": {},
2021-07-18T14:15:08.9169080Z [cluster2]                         "f:globalCIDR": {},
2021-07-18T14:15:08.9169526Z [cluster2]                         "f:namespace": {},
2021-07-18T14:15:08.9169962Z [cluster2]                         "f:natEnabled": {},
2021-07-18T14:15:08.9213603Z [cluster2]                         "f:repository": {},
2021-07-18T14:15:08.9214223Z [cluster2]                         "f:serviceCIDR": {},
2021-07-18T14:15:08.9214789Z [cluster2]                         "f:serviceDiscoveryEnabled": {},
2021-07-18T14:15:08.9215394Z [cluster2]                         "f:version": {}
2021-07-18T14:15:08.9215760Z [cluster2]                     }
2021-07-18T14:15:08.9216071Z [cluster2]                 },
2021-07-18T14:15:08.9216530Z [cluster2]                 "manager": "subctl",
2021-07-18T14:15:08.9216961Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:08.9219424Z [cluster2]                 "time": "2021-07-18T14:13:47Z"
2021-07-18T14:15:08.9219901Z [cluster2]             },
2021-07-18T14:15:08.9220297Z [cluster2]             {
2021-07-18T14:15:08.9220889Z [cluster2]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-18T14:15:08.9221716Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-18T14:15:08.9222779Z [cluster2]                 "fieldsV1": {
2021-07-18T14:15:08.9223322Z [cluster2]                     "f:status": {
2021-07-18T14:15:08.9223690Z [cluster2]                         ".": {},
2021-07-18T14:15:08.9224078Z [cluster2]                         "f:clusterCIDR": {},
2021-07-18T14:15:08.9224506Z [cluster2]                         "f:clusterID": {},
2021-07-18T14:15:08.9224932Z [cluster2]                         "f:colorCodes": {},
2021-07-18T14:15:08.9225374Z [cluster2]                         "f:deploymentInfo": {},
2021-07-18T14:15:08.9225929Z [cluster2]                         "f:gatewayDaemonSetStatus": {
2021-07-18T14:15:08.9226548Z [cluster2]                             ".": {},
2021-07-18T14:15:08.9227038Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-18T14:15:08.9227654Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:08.9228321Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:08.9228827Z [cluster2]                             "f:status": {
2021-07-18T14:15:08.9229195Z [cluster2]                                 ".": {},
2021-07-18T14:15:08.9229693Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:08.9230317Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:08.9230889Z [cluster2]                                 "f:numberAvailable": {},
2021-07-18T14:15:08.9231404Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:08.9232095Z [cluster2]                                 "f:numberReady": {},
2021-07-18T14:15:08.9232602Z [cluster2]                                 "f:observedGeneration": {},
2021-07-18T14:15:08.9233218Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:08.9233703Z [cluster2]                             }
2021-07-18T14:15:08.9234226Z [cluster2]                         },
2021-07-18T14:15:08.9234622Z [cluster2]                         "f:gateways": {},
2021-07-18T14:15:08.9235048Z [cluster2]                         "f:globalCIDR": {},
2021-07-18T14:15:08.9235772Z [cluster2]                         "f:globalnetDaemonSetStatus": {
2021-07-18T14:15:08.9236364Z [cluster2]                             ".": {},
2021-07-18T14:15:08.9236835Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-18T14:15:08.9237469Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:08.9238311Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:08.9238818Z [cluster2]                             "f:status": {
2021-07-18T14:15:08.9239194Z [cluster2]                                 ".": {},
2021-07-18T14:15:08.9239689Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:08.9240307Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:08.9240876Z [cluster2]                                 "f:numberAvailable": {},
2021-07-18T14:15:08.9241388Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:08.9241892Z [cluster2]                                 "f:numberReady": {},
2021-07-18T14:15:08.9242381Z [cluster2]                                 "f:observedGeneration": {},
2021-07-18T14:15:08.9242973Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:08.9243633Z [cluster2]                             }
2021-07-18T14:15:08.9243966Z [cluster2]                         },
2021-07-18T14:15:08.9244422Z [cluster2]                         "f:loadBalancerStatus": {},
2021-07-18T14:15:08.9244909Z [cluster2]                         "f:natEnabled": {},
2021-07-18T14:15:08.9245375Z [cluster2]                         "f:networkPlugin": {},
2021-07-18T14:15:08.9245956Z [cluster2]                         "f:routeAgentDaemonSetStatus": {
2021-07-18T14:15:08.9246486Z [cluster2]                             ".": {},
2021-07-18T14:15:08.9247121Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-18T14:15:08.9247874Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-18T14:15:08.9248557Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-18T14:15:08.9249059Z [cluster2]                             "f:status": {
2021-07-18T14:15:08.9249431Z [cluster2]                                 ".": {},
2021-07-18T14:15:08.9250100Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-18T14:15:08.9251402Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-18T14:15:08.9252261Z [cluster2]                                 "f:numberAvailable": {},
2021-07-18T14:15:08.9253124Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-18T14:15:08.9253825Z [cluster2]                                 "f:numberReady": {},
2021-07-18T14:15:08.9255040Z [cluster2]                                 "f:observedGeneration": {},
2021-07-18T14:15:08.9256060Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-18T14:15:08.9256628Z [cluster2]                             }
2021-07-18T14:15:08.9257245Z [cluster2]                         },
2021-07-18T14:15:08.9257680Z [cluster2]                         "f:serviceCIDR": {}
2021-07-18T14:15:08.9258145Z [cluster2]                     }
2021-07-18T14:15:08.9258500Z [cluster2]                 },
2021-07-18T14:15:08.9259284Z [cluster2]                 "manager": "submariner-operator",
2021-07-18T14:15:08.9259869Z [cluster2]                 "operation": "Update",
2021-07-18T14:15:08.9273954Z [cluster2]                 "time": "2021-07-18T14:14:32Z"
2021-07-18T14:15:08.9274390Z [cluster2]             }
2021-07-18T14:15:08.9274734Z [cluster2]         ],
2021-07-18T14:15:08.9275106Z [cluster2]         "name": "submariner",
2021-07-18T14:15:08.9275919Z [cluster2]         "namespace": "submariner-operator",
2021-07-18T14:15:08.9276472Z [cluster2]         "resourceVersion": "1972",
2021-07-18T14:15:08.9277546Z [cluster2]         "uid": "cfd012d9-1c47-46f3-9f0a-fc2040ce12a2"
2021-07-18T14:15:08.9278070Z [cluster2]     },
2021-07-18T14:15:08.9278576Z [cluster2]     "spec": {
2021-07-18T14:15:08.9278960Z [cluster2]         "broker": "k8s",
2021-07-18T14:15:08.9279439Z [cluster2]         "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-18T14:15:08.9386620Z [cluster2]         "brokerK8sApiServerToken": "***",
2021-07-18T14:15:08.9909259Z [cluster2]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-18T14:15:09.0417321Z [cluster2]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-18T14:15:09.0418102Z [cluster2]         "cableDriver": "libreswan",
2021-07-18T14:15:09.0418721Z [cluster2]         "ceIPSecDebug": false,
2021-07-18T14:15:09.0419231Z [cluster2]         "ceIPSecIKEPort": 500,
2021-07-18T14:15:09.0419741Z [cluster2]         "ceIPSecNATTPort": 4500,
2021-07-18T14:15:09.0421230Z [cluster2]         "ceIPSecPSK": "aweXRyYV8J2Mt4yR3MPtcEtyzUN0xJPRXKS4Dmoq5N0hsP1EvsvVoEwcyJGZHltr",
2021-07-18T14:15:09.0422548Z [cluster2]         "clusterCIDR": "",
2021-07-18T14:15:09.0423008Z [cluster2]         "clusterID": "cluster2",
2021-07-18T14:15:09.0423486Z [cluster2]         "colorCodes": "blue",
2021-07-18T14:15:09.0424463Z [cluster2]         "connectionHealthCheck": {
2021-07-18T14:15:09.0424997Z [cluster2]             "enabled": true,
2021-07-18T14:15:09.0425467Z [cluster2]             "intervalSeconds": 1,
2021-07-18T14:15:09.0425982Z [cluster2]             "maxPacketLossCount": 5
2021-07-18T14:15:09.0426424Z [cluster2]         },
2021-07-18T14:15:09.0426787Z [cluster2]         "debug": false,
2021-07-18T14:15:09.0427212Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-18T14:15:09.0427954Z [cluster2]         "namespace": "submariner-operator",
2021-07-18T14:15:09.0428668Z [cluster2]         "natEnabled": false,
2021-07-18T14:15:09.0429124Z [cluster2]         "repository": "localhost:5000",
2021-07-18T14:15:09.0429586Z [cluster2]         "serviceCIDR": "",
2021-07-18T14:15:09.0430115Z [cluster2]         "serviceDiscoveryEnabled": true,
2021-07-18T14:15:09.0430652Z [cluster2]         "version": "local"
2021-07-18T14:15:09.0431202Z [cluster2]     },
2021-07-18T14:15:09.0432934Z [cluster2]     "status": {
2021-07-18T14:15:09.0433638Z [cluster2]         "clusterCIDR": "10.0.0.0/16",
2021-07-18T14:15:09.0434195Z [cluster2]         "clusterID": "cluster2",
2021-07-18T14:15:09.0434765Z [cluster2]         "colorCodes": "blue",
2021-07-18T14:15:09.0435335Z [cluster2]         "deploymentInfo": {},
2021-07-18T14:15:09.0436644Z [cluster2]         "gatewayDaemonSetStatus": {
2021-07-18T14:15:09.0437424Z [cluster2]             "lastResourceVersion": "1755",
2021-07-18T14:15:09.0438078Z [cluster2]             "mismatchedContainerImages": false,
2021-07-18T14:15:09.0438956Z [cluster2]             "nonReadyContainerStates": [],
2021-07-18T14:15:09.0439466Z [cluster2]             "status": {
2021-07-18T14:15:09.0439986Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-18T14:15:09.0440620Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-18T14:15:09.0441208Z [cluster2]                 "numberAvailable": 1,
2021-07-18T14:15:09.0441746Z [cluster2]                 "numberMisscheduled": 0,
2021-07-18T14:15:09.0442583Z [cluster2]                 "numberReady": 1,
2021-07-18T14:15:09.0443095Z [cluster2]                 "observedGeneration": 1,
2021-07-18T14:15:09.0443876Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-18T14:15:09.0444385Z [cluster2]             }
2021-07-18T14:15:09.0444716Z [cluster2]         },
2021-07-18T14:15:09.0445097Z [cluster2]         "gateways": [
2021-07-18T14:15:09.0445802Z [cluster2]             {
2021-07-18T14:15:09.0446206Z [cluster2]                 "connections": [
2021-07-18T14:15:09.0446613Z [cluster2]                     {
2021-07-18T14:15:09.0447020Z [cluster2]                         "endpoint": {
2021-07-18T14:15:09.0447483Z [cluster2]                             "backend": "libreswan",
2021-07-18T14:15:09.0448601Z [cluster2]                             "backend_config": {
2021-07-18T14:15:09.0449670Z [cluster2]                                 "natt-discovery-port": "4490",
2021-07-18T14:15:09.0450517Z [cluster2]                                 "preferred-server": "false"
2021-07-18T14:15:09.0451071Z [cluster2]                             },
2021-07-18T14:15:09.0452351Z [cluster2]                             "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-18T14:15:09.0453457Z [cluster2]                             "cluster_id": "cluster1",
2021-07-18T14:15:09.0454145Z [cluster2]                             "healthCheckIP": "242.254.1.254",
2021-07-18T14:15:09.0454862Z [cluster2]                             "hostname": "cluster1-worker",
2021-07-18T14:15:09.0455406Z [cluster2]                             "nat_enabled": false,
2021-07-18T14:15:09.0455863Z [cluster2]                             "private_ip": "172.18.0.5",
2021-07-18T14:15:09.0456323Z [cluster2]                             "public_ip": "104.210.193.16",
2021-07-18T14:15:09.0456893Z [cluster2]                             "subnets": [
2021-07-18T14:15:09.0457296Z [cluster2]                                 "242.254.1.0/24"
2021-07-18T14:15:09.0457644Z [cluster2]                             ]
2021-07-18T14:15:09.0458132Z [cluster2]                         },
2021-07-18T14:15:09.0458528Z [cluster2]                         "latencyRTT": {
2021-07-18T14:15:09.0459169Z [cluster2]                             "average": "274.344µs",
2021-07-18T14:15:09.0459908Z [cluster2]                             "last": "218.902µs",
2021-07-18T14:15:09.0460309Z [cluster2]                             "max": "1.41801ms",
2021-07-18T14:15:09.0460858Z [cluster2]                             "min": "124.701µs",
2021-07-18T14:15:09.0461625Z [cluster2]                             "stdDev": "234.069µs"
2021-07-18T14:15:09.0462032Z [cluster2]                         },
2021-07-18T14:15:09.0462639Z [cluster2]                         "status": "connected",
2021-07-18T14:15:09.0463326Z [cluster2]                         "statusMessage": "",
2021-07-18T14:15:09.0463792Z [cluster2]                         "usingIP": "172.18.0.5"
2021-07-18T14:15:09.0464198Z [cluster2]                     }
2021-07-18T14:15:09.0464715Z [cluster2]                 ],
2021-07-18T14:15:09.0465270Z [cluster2]                 "haStatus": "active",
2021-07-18T14:15:09.0465729Z [cluster2]                 "localEndpoint": {
2021-07-18T14:15:09.0466184Z [cluster2]                     "backend": "libreswan",
2021-07-18T14:15:09.0466637Z [cluster2]                     "backend_config": {
2021-07-18T14:15:09.0467288Z [cluster2]                         "natt-discovery-port": "4490",
2021-07-18T14:15:09.0467994Z [cluster2]                         "preferred-server": "false"
2021-07-18T14:15:09.0468549Z [cluster2]                     },
2021-07-18T14:15:09.0470404Z [cluster2]                     "cable_name": "submariner-cable-cluster2-172-18-0-6",
2021-07-18T14:15:09.0471208Z [cluster2]                     "cluster_id": "cluster2",
2021-07-18T14:15:09.0471997Z [cluster2]                     "hostname": "cluster2-worker",
2021-07-18T14:15:09.0472895Z [cluster2]                     "nat_enabled": false,
2021-07-18T14:15:09.0473359Z [cluster2]                     "private_ip": "172.18.0.6",
2021-07-18T14:15:09.0473828Z [cluster2]                     "public_ip": "104.210.193.16",
2021-07-18T14:15:09.0474249Z [cluster2]                     "subnets": [
2021-07-18T14:15:09.0474653Z [cluster2]                         "242.254.2.0/24"
2021-07-18T14:15:09.0475011Z [cluster2]                     ]
2021-07-18T14:15:09.0475372Z [cluster2]                 },
2021-07-18T14:15:09.0475938Z [cluster2]                 "statusFailure": "",
2021-07-18T14:15:09.0476604Z [cluster2]                 "version": "devel-1441a80"
2021-07-18T14:15:09.0477034Z [cluster2]             }
2021-07-18T14:15:09.0477357Z [cluster2]         ],
2021-07-18T14:15:09.0477754Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-18T14:15:09.0478303Z [cluster2]         "globalnetDaemonSetStatus": {
2021-07-18T14:15:09.0478937Z [cluster2]             "lastResourceVersion": "1797",
2021-07-18T14:15:09.0479771Z [cluster2]             "mismatchedContainerImages": false,
2021-07-18T14:15:09.0480499Z [cluster2]             "nonReadyContainerStates": [],
2021-07-18T14:15:09.0481023Z [cluster2]             "status": {
2021-07-18T14:15:09.0482442Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-18T14:15:09.0483249Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-18T14:15:09.0483835Z [cluster2]                 "numberAvailable": 1,
2021-07-18T14:15:09.0484376Z [cluster2]                 "numberMisscheduled": 0,
2021-07-18T14:15:09.0484868Z [cluster2]                 "numberReady": 1,
2021-07-18T14:15:09.0485397Z [cluster2]                 "observedGeneration": 1,
2021-07-18T14:15:09.0485986Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-18T14:15:09.0486480Z [cluster2]             }
2021-07-18T14:15:09.0487103Z [cluster2]         },
2021-07-18T14:15:09.0487559Z [cluster2]         "loadBalancerStatus": {},
2021-07-18T14:15:09.0488210Z [cluster2]         "natEnabled": false,
2021-07-18T14:15:09.0489097Z [cluster2]         "networkPlugin": "weave-net",
2021-07-18T14:15:09.0489908Z [cluster2]         "routeAgentDaemonSetStatus": {
2021-07-18T14:15:09.0490933Z [cluster2]             "lastResourceVersion": "1838",
2021-07-18T14:15:09.0492545Z [cluster2]             "mismatchedContainerImages": false,
2021-07-18T14:15:09.0493450Z [cluster2]             "nonReadyContainerStates": [],
2021-07-18T14:15:09.0494011Z [cluster2]             "status": {
2021-07-18T14:15:09.0494863Z [cluster2]                 "currentNumberScheduled": 3,
2021-07-18T14:15:09.0495514Z [cluster2]                 "desiredNumberScheduled": 3,
2021-07-18T14:15:09.0496091Z [cluster2]                 "numberAvailable": 3,
2021-07-18T14:15:09.0496632Z [cluster2]                 "numberMisscheduled": 0,
2021-07-18T14:15:09.0497122Z [cluster2]                 "numberReady": 3,
2021-07-18T14:15:09.0497636Z [cluster2]                 "observedGeneration": 1,
2021-07-18T14:15:09.4178406Z [cluster2]                 "uWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:15:09.4294519Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4297694Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:15:09.4300227Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:15:09.4301994Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4303525Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:15:09.4306021Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:15:09.4308446Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4310379Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:15:09.4311936Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:15:09.4313586Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4314872Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:15:09.4315954Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:15:09.4317208Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4318426Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-18T14:15:09.4319549Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-18T14:15:09.4321035Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4322195Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-18T14:15:09.4323181Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-18T14:15:09.4324265Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4325336Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-18T14:15:09.4326277Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-18T14:15:09.4328728Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4330436Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4331275Z [cluster1] Generated cluster id: cluster1
2021-07-18T14:15:09.4333168Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-18T14:15:09.4334175Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-18T14:15:09.4335342Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4336443Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-18T14:15:09.4337377Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-18T14:15:09.4338455Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4339642Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-18T14:15:09.4340843Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-18T14:15:09.4342067Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4343656Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-18T14:15:09.4344690Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-18T14:15:09.4346569Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-18T14:15:09.4348086Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-18T14:15:09.4349053Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-18T14:15:09.4442918Z [submariner-operator]$ [cluster1] with_retries 5 veripdatedNumberScheduled": 3
2021-07-18T14:15:09.4443619Z [cluster2]             }
2021-07-18T14:15:09.4443941Z [cluster2]         },
2021-07-18T14:15:09.4444335Z [cluster2]         "serviceCIDR": "100.0.0.0/16"
2021-07-18T14:15:09.4444700Z [cluster2]     }
2021-07-18T14:15:09.4445016Z [cluster2] }
2021-07-18T14:15:09.4445905Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:15:09.4447144Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-18T14:15:09.4448665Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-18T14:15:09.4449830Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:15:09.4450906Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-18T14:15:09.4452009Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-18T14:15:09.4453046Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-18T14:15:09.4453942Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-18T14:15:09.4454944Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-18T14:15:09.4455992Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-18T14:15:09.4457127Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-18T14:15:09.4458250Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-18T14:15:09.4459513Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-18T14:15:09.4460682Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-18T14:15:09.4462076Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-18T14:15:09.4603282Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:15:09.4790727Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-18T14:15:09.4792738Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-18T14:15:09.8260821Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:15:09.9303014Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPREUwTURZeU1sb1hEVE14TURjeE5qRTBNRFl5TWxvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTHVQCmJodk1yc21QUFAyRDhmcFgxSVJ2a05NdnJ3ZnhjcGkzbU5WRTBtT2puaUo1RUFTQ0p1ZWdyWG5iTXk2UVZNUkcKS1ppZVVVcVc4M1VkK003dXA5NGVaTVNBT3FEemlVdDA5d2ZOdmxJZTBhVTA5VC9RYncxelZ3a2taVFcxNjRKbwpYSTUxcWFQaENBZVRQTHIxbU0xcWQ2K1ZNdnZnMG5kMmNxUG9wOFRWQ0o0WlpGR0dsVUZOQng1Tk11SnlEcW1sCmtoUjhPKzlMWXlqT3lYUldQY0ZYWHM3MnF5UzJWMmx3ZHNDc2JhUTJaVVJLV3U3bi9TTTBnUXBub3pibDkvQXIKdzN0M0lKbXc5eTl1RzB5UFlLTjE2NE5mVHh2Wm5pM3lqaStEcDd4M1E3MlZzZXM4a0k1aEVGT2M1SDFuVHNVegpGVHFvaEVHQmVtOXdnTU9jSTA4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZFY2p2Y2Y3UTBvSU04bUp2WkJ2RC82RWRDR2NNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBVGdYWjRsWjAvZmVIN3d1V2pqc1NpT0JQb3c4RHg3WUVMd3NHYjYxNXhsT0tFbE50dgpuUlNzeUhzc2JwbXkrTTFhdy94ODdndnJUV2pzaThySnVabVF1ejhLb2cwdmVIb0Yxc0tIUGNRbmpTZHFMaWMrCmR0OUtXNTd6bU5Rc0x3NHFwY0o3MnRaalJUeHJ4VDZLV290QzByVjhhaVFQaDdsZXlGUFpJL2dtSzg5U2xiL3QKc1RKMDF3ZkYvL1FoSW84NE5wSzhwRm85YXg3OEpmZ0xWSG5OTzEzdE12WnVXV0l6OWdNTDBnbjRLbmU3c3U0dgpWeXcxUCtmQ0dSajgxeVpwMllHK3JEQ2VHckc5TUV4Rk9ENmk0UG11RWlUZTJXRzJqSzVZanM5LzZxRTRXQ1ZPCnJxcGUzYWIrN2ttS0dtOFhxclRoSFMrc2h3MzBhNlVSemVwYgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-18T14:15:09.9798356Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-18T14:15:09.9799756Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:15:09.9801224Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-18T14:15:09.9802673Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-18T14:15:09.9804129Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:15:09.9805212Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-18T14:15:09.9806333Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-18T14:15:09.9807453Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:15:09.9808609Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-18T14:15:09.9809976Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-18T14:15:09.9811159Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:15:09.9812204Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-18T14:15:09.9813569Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8258020Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-18T14:15:10.8259669Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-18T14:15:10.8261324Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8262558Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-18T14:15:10.8264250Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-18T14:15:10.8265464Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8266629Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-18T14:15:10.8267816Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-18T14:15:10.8268977Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8270257Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8271476Z [cluster2] Generated cluster id: cluster2
2021-07-18T14:15:10.8272420Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-18T14:15:10.8273529Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-18T14:15:10.8275491Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8277213Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-18T14:15:10.8278254Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-18T14:15:10.8279457Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8280919Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-18T14:15:10.8282185Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-18T14:15:10.8283729Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8284954Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-18T14:15:10.8286071Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-18T14:15:10.8287477Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8288777Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-18T14:15:10.8289754Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-18T14:15:10.8290719Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-18T14:15:10.8291869Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-18T14:15:10.8293069Z [submariner-operator]$ [cluster2] iteration=1
2021-07-18T14:15:10.8294082Z [submariner-operator]$ [cluster2] wait 8773
2021-07-18T14:15:10.8294952Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-18T14:15:10.8296127Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-18T14:15:10.8297013Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-18T14:15:10.8298261Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-18T14:15:10.8299381Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-18T14:15:10.8300229Z [cluster2] 
2021-07-18T14:15:10.8300738Z [cluster2] 
2021-07-18T14:15:10.8302035Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:10.8303710Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-18T14:15:10.8304938Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-18T14:15:10.8306189Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8307637Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-18T14:15:10.8308776Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-18T14:15:10.8310237Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-18T14:15:10.8311520Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:15:10.8312484Z [submariner-operator]$ [cluster2] return 0
2021-07-18T14:15:10.8313841Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-18T14:15:10.8315213Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-18T14:15:10.8316553Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:15:10.8318240Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:15:10.8319616Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-18T14:15:10.8320708Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-18T14:15:11.1608914Z [submariner-operator]$ [clustfy_subm_cr_status_
2021-07-18T14:15:11.1609869Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-18T14:15:11.1610806Z [submariner-operator]$ [cluster1] iteration=1
2021-07-18T14:15:11.1611576Z [submariner-operator]$ [cluster1] wait 8671
2021-07-18T14:15:11.1612500Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-18T14:15:11.1613306Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-18T14:15:11.1614131Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-18T14:15:11.1615077Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-18T14:15:11.1616142Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-18T14:15:11.1616889Z [cluster1] 
2021-07-18T14:15:11.1617324Z [cluster1] 
2021-07-18T14:15:11.1618325Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-18T14:15:11.1619589Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-18T14:15:11.1620627Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-18T14:15:11.1621762Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-18T14:15:11.1623118Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-18T14:15:11.1624193Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-18T14:15:11.1625347Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-18T14:15:11.1626306Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:15:11.1627038Z [submariner-operator]$ [cluster1] return 0
2021-07-18T14:15:11.1627863Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-18T14:15:11.1629007Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-18T14:15:11.1630101Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-18T14:15:11.1631492Z [submariner-operator]$ [cluster1] verify_daemonset submariner-