subm_random_fail_20210719

logs.txt

2021-07-19T00:08:06.5429474Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-19T00:08:06.5429540Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-19T00:08:12.9033270Z Current runner version: '2.278.0'
2021-07-19T00:08:12.9058015Z ##[group]Operating System
2021-07-19T00:08:12.9058855Z Ubuntu
2021-07-19T00:08:12.9059302Z 20.04.2
2021-07-19T00:08:12.9059691Z LTS
2021-07-19T00:08:12.9060187Z ##[endgroup]
2021-07-19T00:08:12.9060698Z ##[group]Virtual Environment
2021-07-19T00:08:12.9061336Z Environment: ubuntu-20.04
2021-07-19T00:08:12.9061843Z Version: 20210712.0
2021-07-19T00:08:12.9062816Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-19T00:08:12.9064147Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-19T00:08:12.9064973Z ##[endgroup]
2021-07-19T00:08:12.9066935Z ##[group]GITHUB_TOKEN Permissions
2021-07-19T00:08:12.9068056Z Actions: write
2021-07-19T00:08:12.9068545Z Checks: write
2021-07-19T00:08:12.9069100Z Contents: write
2021-07-19T00:08:12.9069590Z Deployments: write
2021-07-19T00:08:12.9070203Z Discussions: write
2021-07-19T00:08:12.9070734Z Issues: write
2021-07-19T00:08:12.9071261Z Metadata: read
2021-07-19T00:08:12.9071773Z Packages: write
2021-07-19T00:08:12.9072315Z PullRequests: write
2021-07-19T00:08:12.9072896Z RepositoryProjects: write
2021-07-19T00:08:12.9073528Z SecurityEvents: write
2021-07-19T00:08:12.9074051Z Statuses: write
2021-07-19T00:08:12.9074667Z ##[endgroup]
2021-07-19T00:08:12.9077570Z Prepare workflow directory
2021-07-19T00:08:12.9656428Z Prepare all required actions
2021-07-19T00:08:12.9666835Z Getting action download info
2021-07-19T00:08:13.3590085Z Download action repository 'actions/checkout@v2'
2021-07-19T00:08:15.1324563Z Download action repository 'submariner-io/shipyard@devel'
2021-07-19T00:08:15.4841006Z ##[group]Run actions/checkout@v2
2021-07-19T00:08:15.4841638Z with:
2021-07-19T00:08:15.4842277Z   repository: submariner-io/submariner-operator
2021-07-19T00:08:15.4843291Z   token: ***
2021-07-19T00:08:15.4843718Z   ssh-strict: true
2021-07-19T00:08:15.4844254Z   persist-credentials: true
2021-07-19T00:08:15.4844792Z   clean: true
2021-07-19T00:08:15.4845228Z   fetch-depth: 1
2021-07-19T00:08:15.4845646Z   lfs: false
2021-07-19T00:08:15.4846080Z   submodules: false
2021-07-19T00:08:15.4846653Z ##[endgroup]
2021-07-19T00:08:15.7084775Z Syncing repository: submariner-io/submariner-operator
2021-07-19T00:08:15.7085949Z ##[group]Getting Git version info
2021-07-19T00:08:15.7105252Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T00:08:15.7134562Z [command]/usr/bin/git version
2021-07-19T00:08:15.7243012Z git version 2.32.0
2021-07-19T00:08:15.7262137Z ##[endgroup]
2021-07-19T00:08:15.7267835Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T00:08:15.7271081Z ##[group]Initializing the repository
2021-07-19T00:08:15.7275037Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-19T00:08:15.7333184Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-19T00:08:15.7334285Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-19T00:08:15.7335218Z hint: of your new repositories, which will suppress this warning, call:
2021-07-19T00:08:15.7335950Z hint: 
2021-07-19T00:08:15.7336820Z hint: 	git config --global init.defaultBranch <name>
2021-07-19T00:08:15.7337526Z hint: 
2021-07-19T00:08:15.7338385Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-19T00:08:15.7339510Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-19T00:08:15.7340270Z hint: 
2021-07-19T00:08:15.7340957Z hint: 	git branch -m <name>
2021-07-19T00:08:15.7350343Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-19T00:08:15.7360525Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-19T00:08:15.7392033Z ##[endgroup]
2021-07-19T00:08:15.7392908Z ##[group]Disabling automatic garbage collection
2021-07-19T00:08:15.7396158Z [command]/usr/bin/git config --local gc.auto 0
2021-07-19T00:08:15.7423718Z ##[endgroup]
2021-07-19T00:08:15.7427760Z ##[group]Setting up auth
2021-07-19T00:08:15.7433834Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-19T00:08:15.7461468Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-19T00:08:15.7776379Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-19T00:08:15.7821462Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-19T00:08:16.1626309Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-19T00:08:16.1627530Z ##[endgroup]
2021-07-19T00:08:16.1628172Z ##[group]Fetching the repository
2021-07-19T00:08:16.1630425Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-19T00:08:16.1631681Z remote: Enumerating objects: 486, done.        
2021-07-19T00:08:16.1632381Z remote: Counting objects:   0% (1/486)        
2021-07-19T00:08:16.1633035Z remote: Counting objects:   1% (5/486)        
2021-07-19T00:08:16.1633672Z remote: Counting objects:   2% (10/486)        
2021-07-19T00:08:16.1634316Z remote: Counting objects:   3% (15/486)        
2021-07-19T00:08:16.1635140Z remote: Counting objects:   4% (20/486)        
2021-07-19T00:08:16.1635812Z remote: Counting objects:   5% (25/486)        
2021-07-19T00:08:16.1636462Z remote: Counting objects:   6% (30/486)        
2021-07-19T00:08:16.1637097Z remote: Counting objects:   7% (35/486)        
2021-07-19T00:08:16.1637773Z remote: Counting objects:   8% (39/486)        
2021-07-19T00:08:16.1638415Z remote: Counting objects:   9% (44/486)        
2021-07-19T00:08:16.1639050Z remote: Counting objects:  10% (49/486)        
2021-07-19T00:08:16.1639692Z remote: Counting objects:  11% (54/486)        
2021-07-19T00:08:16.1640327Z remote: Counting objects:  12% (59/486)        
2021-07-19T00:08:16.1640973Z remote: Counting objects:  13% (64/486)        
2021-07-19T00:08:16.1641615Z remote: Counting objects:  14% (69/486)        
2021-07-19T00:08:16.1642248Z remote: Counting objects:  15% (73/486)        
2021-07-19T00:08:16.1643017Z remote: Counting objects:  16% (78/486)        
2021-07-19T00:08:16.1643662Z remote: Counting objects:  17% (83/486)        
2021-07-19T00:08:16.1644315Z remote: Counting objects:  18% (88/486)        
2021-07-19T00:08:16.1644971Z remote: Counting objects:  19% (93/486)        
2021-07-19T00:08:16.1645605Z remote: Counting objects:  20% (98/486)        
2021-07-19T00:08:16.1646260Z remote: Counting objects:  21% (103/486)        
2021-07-19T00:08:16.1647187Z remote: Counting objects:  22% (107/486)        
2021-07-19T00:08:16.1699163Z remote: Counting objects:  23% (112/486)        
2021-07-19T00:08:16.1706495Z remote: Counting objects:  24% (117/486)        
2021-07-19T00:08:16.1707376Z remote: Counting objects:  25% (122/486)        
2021-07-19T00:08:16.1708105Z remote: Counting objects:  26% (127/486)        
2021-07-19T00:08:16.1708767Z remote: Counting objects:  27% (132/486)        
2021-07-19T00:08:16.1709408Z remote: Counting objects:  28% (137/486)        
2021-07-19T00:08:16.1710063Z remote: Counting objects:  29% (141/486)        
2021-07-19T00:08:16.1710718Z remote: Counting objects:  30% (146/486)        
2021-07-19T00:08:16.1711371Z remote: Counting objects:  31% (151/486)        
2021-07-19T00:08:16.1712021Z remote: Counting objects:  32% (156/486)        
2021-07-19T00:08:16.1712658Z remote: Counting objects:  33% (161/486)        
2021-07-19T00:08:16.1713310Z remote: Counting objects:  34% (166/486)        
2021-07-19T00:08:16.1714122Z remote: Counting objects:  35% (171/486)        
2021-07-19T00:08:16.1714766Z remote: Counting objects:  36% (175/486)        
2021-07-19T00:08:16.1715410Z remote: Counting objects:  37% (180/486)        
2021-07-19T00:08:16.1716043Z remote: Counting objects:  38% (185/486)        
2021-07-19T00:08:16.1716691Z remote: Counting objects:  39% (190/486)        
2021-07-19T00:08:16.1717323Z remote: Counting objects:  40% (195/486)        
2021-07-19T00:08:16.1718163Z remote: Counting objects:  41% (200/486)        
2021-07-19T00:08:16.1718834Z remote: Counting objects:  42% (205/486)        
2021-07-19T00:08:16.1719483Z remote: Counting objects:  43% (209/486)        
2021-07-19T00:08:16.1720132Z remote: Counting objects:  44% (214/486)        
2021-07-19T00:08:16.1720777Z remote: Counting objects:  45% (219/486)        
2021-07-19T00:08:16.1721412Z remote: Counting objects:  46% (224/486)        
2021-07-19T00:08:16.1722174Z remote: Counting objects:  47% (229/486)        
2021-07-19T00:08:16.1722821Z remote: Counting objects:  48% (234/486)        
2021-07-19T00:08:16.1723470Z remote: Counting objects:  49% (239/486)        
2021-07-19T00:08:16.1724109Z remote: Counting objects:  50% (243/486)        
2021-07-19T00:08:16.1724738Z remote: Counting objects:  51% (248/486)        
2021-07-19T00:08:16.1725388Z remote: Counting objects:  52% (253/486)        
2021-07-19T00:08:16.1726020Z remote: Counting objects:  53% (258/486)        
2021-07-19T00:08:16.1727761Z remote: Counting objects:  54% (263/486)        
2021-07-19T00:08:16.1728419Z remote: Counting objects:  55% (268/486)        
2021-07-19T00:08:16.1729181Z remote: Counting objects:  56% (273/486)        
2021-07-19T00:08:16.1729838Z remote: Counting objects:  57% (278/486)        
2021-07-19T00:08:16.1730478Z remote: Counting objects:  58% (282/486)        
2021-07-19T00:08:16.1731127Z remote: Counting objects:  59% (287/486)        
2021-07-19T00:08:16.1731772Z remote: Counting objects:  60% (292/486)        
2021-07-19T00:08:16.1732424Z remote: Counting objects:  61% (297/486)        
2021-07-19T00:08:16.1733063Z remote: Counting objects:  62% (302/486)        
2021-07-19T00:08:16.1733710Z remote: Counting objects:  63% (307/486)        
2021-07-19T00:08:16.1734343Z remote: Counting objects:  64% (312/486)        
2021-07-19T00:08:16.1734994Z remote: Counting objects:  65% (316/486)        
2021-07-19T00:08:16.1735626Z remote: Counting objects:  66% (321/486)        
2021-07-19T00:08:16.1736269Z remote: Counting objects:  67% (326/486)        
2021-07-19T00:08:16.1736910Z remote: Counting objects:  68% (331/486)        
2021-07-19T00:08:16.1737543Z remote: Counting objects:  69% (336/486)        
2021-07-19T00:08:16.1738194Z remote: Counting objects:  70% (341/486)        
2021-07-19T00:08:16.1738889Z remote: Counting objects:  71% (346/486)        
2021-07-19T00:08:16.1739531Z remote: Counting objects:  72% (350/486)        
2021-07-19T00:08:16.1740178Z remote: Counting objects:  73% (355/486)        
2021-07-19T00:08:16.1740818Z remote: Counting objects:  74% (360/486)        
2021-07-19T00:08:16.1741459Z remote: Counting objects:  75% (365/486)        
2021-07-19T00:08:16.1742090Z remote: Counting objects:  76% (370/486)        
2021-07-19T00:08:16.1742741Z remote: Counting objects:  77% (375/486)        
2021-07-19T00:08:16.1743385Z remote: Counting objects:  78% (380/486)        
2021-07-19T00:08:16.1744017Z remote: Counting objects:  79% (384/486)        
2021-07-19T00:08:16.1744659Z remote: Counting objects:  80% (389/486)        
2021-07-19T00:08:16.1745300Z remote: Counting objects:  81% (394/486)        
2021-07-19T00:08:16.1745930Z remote: Counting objects:  82% (399/486)        
2021-07-19T00:08:16.1746582Z remote: Counting objects:  83% (404/486)        
2021-07-19T00:08:16.1747210Z remote: Counting objects:  84% (409/486)        
2021-07-19T00:08:16.1747853Z remote: Counting objects:  85% (414/486)        
2021-07-19T00:08:16.1748496Z remote: Counting objects:  86% (418/486)        
2021-07-19T00:08:16.1749232Z remote: Counting objects:  87% (423/486)        
2021-07-19T00:08:16.1749882Z remote: Counting objects:  88% (428/486)        
2021-07-19T00:08:16.1750708Z remote: Counting objects:  89% (433/486)        
2021-07-19T00:08:16.1751343Z remote: Counting objects:  90% (438/486)        
2021-07-19T00:08:16.1751986Z remote: Counting objects:  91% (443/486)        
2021-07-19T00:08:16.1752612Z remote: Counting objects:  92% (448/486)        
2021-07-19T00:08:16.1753258Z remote: Counting objects:  93% (452/486)        
2021-07-19T00:08:16.1753901Z remote: Counting objects:  94% (457/486)        
2021-07-19T00:08:16.1754530Z remote: Counting objects:  95% (462/486)        
2021-07-19T00:08:16.1755182Z remote: Counting objects:  96% (467/486)        
2021-07-19T00:08:16.1755835Z remote: Counting objects:  97% (472/486)        
2021-07-19T00:08:16.1756471Z remote: Counting objects:  98% (477/486)        
2021-07-19T00:08:16.1757119Z remote: Counting objects:  99% (482/486)        
2021-07-19T00:08:16.1757750Z remote: Counting objects: 100% (486/486)        
2021-07-19T00:08:16.1758423Z remote: Counting objects: 100% (486/486), done.        
2021-07-19T00:08:16.1759117Z remote: Compressing objects:   0% (1/352)        
2021-07-19T00:08:16.1759790Z remote: Compressing objects:   1% (4/352)        
2021-07-19T00:08:16.1760473Z remote: Compressing objects:   2% (8/352)        
2021-07-19T00:08:16.1761153Z remote: Compressing objects:   3% (11/352)        
2021-07-19T00:08:16.1761829Z remote: Compressing objects:   4% (15/352)        
2021-07-19T00:08:16.1762519Z remote: Compressing objects:   5% (18/352)        
2021-07-19T00:08:16.1763188Z remote: Compressing objects:   6% (22/352)        
2021-07-19T00:08:16.1763965Z remote: Compressing objects:   7% (25/352)        
2021-07-19T00:08:16.1764669Z remote: Compressing objects:   8% (29/352)        
2021-07-19T00:08:16.1765347Z remote: Compressing objects:   9% (32/352)        
2021-07-19T00:08:16.1766038Z remote: Compressing objects:  10% (36/352)        
2021-07-19T00:08:16.1766881Z remote: Compressing objects:  11% (39/352)        
2021-07-19T00:08:16.1767572Z remote: Compressing objects:  12% (43/352)        
2021-07-19T00:08:16.1768258Z remote: Compressing objects:  13% (46/352)        
2021-07-19T00:08:16.1768931Z remote: Compressing objects:  14% (50/352)        
2021-07-19T00:08:16.1769621Z remote: Compressing objects:  15% (53/352)        
2021-07-19T00:08:16.1770290Z remote: Compressing objects:  16% (57/352)        
2021-07-19T00:08:16.1770979Z remote: Compressing objects:  17% (60/352)        
2021-07-19T00:08:16.1771661Z remote: Compressing objects:  18% (64/352)        
2021-07-19T00:08:16.1772344Z remote: Compressing objects:  19% (67/352)        
2021-07-19T00:08:16.1773030Z remote: Compressing objects:  20% (71/352)        
2021-07-19T00:08:16.1773713Z remote: Compressing objects:  21% (74/352)        
2021-07-19T00:08:16.1774390Z remote: Compressing objects:  22% (78/352)        
2021-07-19T00:08:16.1775077Z remote: Compressing objects:  23% (81/352)        
2021-07-19T00:08:16.1775761Z remote: Compressing objects:  24% (85/352)        
2021-07-19T00:08:16.1776449Z remote: Compressing objects:  25% (88/352)        
2021-07-19T00:08:16.1777129Z remote: Compressing objects:  26% (92/352)        
2021-07-19T00:08:16.1777801Z remote: Compressing objects:  27% (96/352)        
2021-07-19T00:08:16.1778484Z remote: Compressing objects:  28% (99/352)        
2021-07-19T00:08:16.1779158Z remote: Compressing objects:  29% (103/352)        
2021-07-19T00:08:16.1779846Z remote: Compressing objects:  30% (106/352)        
2021-07-19T00:08:16.1780527Z remote: Compressing objects:  31% (110/352)        
2021-07-19T00:08:16.1781211Z remote: Compressing objects:  32% (113/352)        
2021-07-19T00:08:16.1781900Z remote: Compressing objects:  33% (117/352)        
2021-07-19T00:08:16.1782587Z remote: Compressing objects:  34% (120/352)        
2021-07-19T00:08:16.1783262Z remote: Compressing objects:  35% (124/352)        
2021-07-19T00:08:16.1783948Z remote: Compressing objects:  36% (127/352)        
2021-07-19T00:08:16.1784721Z remote: Compressing objects:  37% (131/352)        
2021-07-19T00:08:16.1785703Z remote: Compressing objects:  38% (134/352)        
2021-07-19T00:08:16.1790805Z remote: Compressing objects:  39% (138/352)        
2021-07-19T00:08:16.1791776Z remote: Compressing objects:  40% (141/352)        
2021-07-19T00:08:16.1856239Z remote: Compressing objects:  41% (145/352)        
2021-07-19T00:08:16.1857041Z remote: Compressing objects:  42% (148/352)        
2021-07-19T00:08:16.1857759Z remote: Compressing objects:  43% (152/352)        
2021-07-19T00:08:16.1858462Z remote: Compressing objects:  44% (155/352)        
2021-07-19T00:08:16.1859170Z remote: Compressing objects:  45% (159/352)        
2021-07-19T00:08:16.1860041Z remote: Compressing objects:  46% (162/352)        
2021-07-19T00:08:16.1860736Z remote: Compressing objects:  47% (166/352)        
2021-07-19T00:08:16.1861411Z remote: Compressing objects:  48% (169/352)        
2021-07-19T00:08:16.1862131Z remote: Compressing objects:  49% (173/352)        
2021-07-19T00:08:16.1862825Z remote: Compressing objects:  50% (176/352)        
2021-07-19T00:08:16.1863507Z remote: Compressing objects:  51% (180/352)        
2021-07-19T00:08:16.1864200Z remote: Compressing objects:  52% (184/352)        
2021-07-19T00:08:16.1864880Z remote: Compressing objects:  53% (187/352)        
2021-07-19T00:08:16.1865566Z remote: Compressing objects:  54% (191/352)        
2021-07-19T00:08:16.1866254Z remote: Compressing objects:  55% (194/352)        
2021-07-19T00:08:16.1866929Z remote: Compressing objects:  56% (198/352)        
2021-07-19T00:08:16.1867618Z remote: Compressing objects:  57% (201/352)        
2021-07-19T00:08:16.1868437Z remote: Compressing objects:  58% (205/352)        
2021-07-19T00:08:16.1869148Z remote: Compressing objects:  59% (208/352)        
2021-07-19T00:08:16.1869844Z remote: Compressing objects:  60% (212/352)        
2021-07-19T00:08:16.1870520Z remote: Compressing objects:  61% (215/352)        
2021-07-19T00:08:16.1871220Z remote: Compressing objects:  62% (219/352)        
2021-07-19T00:08:16.1871895Z remote: Compressing objects:  63% (222/352)        
2021-07-19T00:08:16.1872579Z remote: Compressing objects:  64% (226/352)        
2021-07-19T00:08:16.1873269Z remote: Compressing objects:  65% (229/352)        
2021-07-19T00:08:16.1873942Z remote: Compressing objects:  66% (233/352)        
2021-07-19T00:08:16.1874640Z remote: Compressing objects:  67% (236/352)        
2021-07-19T00:08:16.1875336Z remote: Compressing objects:  68% (240/352)        
2021-07-19T00:08:16.1876017Z remote: Compressing objects:  69% (243/352)        
2021-07-19T00:08:16.1876716Z remote: Compressing objects:  70% (247/352)        
2021-07-19T00:08:16.1877398Z remote: Compressing objects:  71% (250/352)        
2021-07-19T00:08:16.1878088Z remote: Compressing objects:  72% (254/352)        
2021-07-19T00:08:16.1878776Z remote: Compressing objects:  73% (257/352)        
2021-07-19T00:08:16.1879450Z remote: Compressing objects:  74% (261/352)        
2021-07-19T00:08:16.1880143Z remote: Compressing objects:  75% (264/352)        
2021-07-19T00:08:16.1880815Z remote: Compressing objects:  76% (268/352)        
2021-07-19T00:08:16.1881506Z remote: Compressing objects:  77% (272/352)        
2021-07-19T00:08:16.1882195Z remote: Compressing objects:  78% (275/352)        
2021-07-19T00:08:16.1882871Z remote: Compressing objects:  79% (279/352)        
2021-07-19T00:08:16.1883556Z remote: Compressing objects:  80% (282/352)        
2021-07-19T00:08:16.1884248Z remote: Compressing objects:  81% (286/352)        
2021-07-19T00:08:16.1884922Z remote: Compressing objects:  82% (289/352)        
2021-07-19T00:08:16.1885620Z remote: Compressing objects:  83% (293/352)        
2021-07-19T00:08:16.1886523Z remote: Compressing objects:  84% (296/352)        
2021-07-19T00:08:16.1887240Z remote: Compressing objects:  85% (300/352)        
2021-07-19T00:08:16.1887928Z remote: Compressing objects:  86% (303/352)        
2021-07-19T00:08:16.1888719Z remote: Compressing objects:  87% (307/352)        
2021-07-19T00:08:16.1889432Z remote: Compressing objects:  88% (310/352)        
2021-07-19T00:08:16.1890102Z remote: Compressing objects:  89% (314/352)        
2021-07-19T00:08:16.1890783Z remote: Compressing objects:  90% (317/352)        
2021-07-19T00:08:16.1891477Z remote: Compressing objects:  91% (321/352)        
2021-07-19T00:08:16.1892148Z remote: Compressing objects:  92% (324/352)        
2021-07-19T00:08:16.1892830Z remote: Compressing objects:  93% (328/352)        
2021-07-19T00:08:16.1893519Z remote: Compressing objects:  94% (331/352)        
2021-07-19T00:08:16.1894200Z remote: Compressing objects:  95% (335/352)        
2021-07-19T00:08:16.1894901Z remote: Compressing objects:  96% (338/352)        
2021-07-19T00:08:16.1895582Z remote: Compressing objects:  97% (342/352)        
2021-07-19T00:08:16.1896268Z remote: Compressing objects:  98% (345/352)        
2021-07-19T00:08:16.1896950Z remote: Compressing objects:  99% (349/352)        
2021-07-19T00:08:16.1897636Z remote: Compressing objects: 100% (352/352)        
2021-07-19T00:08:16.1898344Z remote: Compressing objects: 100% (352/352), done.        
2021-07-19T00:08:16.1898991Z Receiving objects:   0% (1/486)
2021-07-19T00:08:16.1899605Z Receiving objects:   1% (5/486)
2021-07-19T00:08:16.1900203Z Receiving objects:   2% (10/486)
2021-07-19T00:08:16.1900790Z Receiving objects:   3% (15/486)
2021-07-19T00:08:16.1901387Z Receiving objects:   4% (20/486)
2021-07-19T00:08:16.1901967Z Receiving objects:   5% (25/486)
2021-07-19T00:08:16.1902563Z Receiving objects:   6% (30/486)
2021-07-19T00:08:16.1903160Z Receiving objects:   7% (35/486)
2021-07-19T00:08:16.1903826Z Receiving objects:   8% (39/486)
2021-07-19T00:08:16.1904443Z Receiving objects:   9% (44/486)
2021-07-19T00:08:16.1905026Z Receiving objects:  10% (49/486)
2021-07-19T00:08:16.1905621Z Receiving objects:  11% (54/486)
2021-07-19T00:08:16.1906215Z Receiving objects:  12% (59/486)
2021-07-19T00:08:16.1906829Z Receiving objects:  13% (64/486)
2021-07-19T00:08:16.1907417Z Receiving objects:  14% (69/486)
2021-07-19T00:08:16.1908011Z Receiving objects:  15% (73/486)
2021-07-19T00:08:16.1908607Z Receiving objects:  16% (78/486)
2021-07-19T00:08:16.1909187Z Receiving objects:  17% (83/486)
2021-07-19T00:08:16.1909782Z Receiving objects:  18% (88/486)
2021-07-19T00:08:16.1910363Z Receiving objects:  19% (93/486)
2021-07-19T00:08:16.1910958Z Receiving objects:  20% (98/486)
2021-07-19T00:08:16.1911553Z Receiving objects:  21% (103/486)
2021-07-19T00:08:16.1912139Z Receiving objects:  22% (107/486)
2021-07-19T00:08:16.1912740Z Receiving objects:  23% (112/486)
2021-07-19T00:08:16.1913332Z Receiving objects:  24% (117/486)
2021-07-19T00:08:16.1913929Z Receiving objects:  25% (122/486)
2021-07-19T00:08:16.1914526Z Receiving objects:  26% (127/486)
2021-07-19T00:08:16.1915110Z Receiving objects:  27% (132/486)
2021-07-19T00:08:16.1915714Z Receiving objects:  28% (137/486)
2021-07-19T00:08:16.1916298Z Receiving objects:  29% (141/486)
2021-07-19T00:08:16.1916908Z Receiving objects:  30% (146/486)
2021-07-19T00:08:16.1917502Z Receiving objects:  31% (151/486)
2021-07-19T00:08:16.1918087Z Receiving objects:  32% (156/486)
2021-07-19T00:08:16.1918683Z Receiving objects:  33% (161/486)
2021-07-19T00:08:16.1919259Z Receiving objects:  34% (166/486)
2021-07-19T00:08:16.1919854Z Receiving objects:  35% (171/486)
2021-07-19T00:08:16.1920445Z Receiving objects:  36% (175/486)
2021-07-19T00:08:16.1921031Z Receiving objects:  37% (180/486)
2021-07-19T00:08:16.1921626Z Receiving objects:  38% (185/486)
2021-07-19T00:08:16.1922203Z Receiving objects:  39% (190/486)
2021-07-19T00:08:16.1922805Z Receiving objects:  40% (195/486)
2021-07-19T00:08:16.1923408Z Receiving objects:  41% (200/486)
2021-07-19T00:08:16.1924000Z Receiving objects:  42% (205/486)
2021-07-19T00:08:16.1924597Z Receiving objects:  43% (209/486)
2021-07-19T00:08:16.1925174Z Receiving objects:  44% (214/486)
2021-07-19T00:08:16.1925775Z Receiving objects:  45% (219/486)
2021-07-19T00:08:16.1926577Z Receiving objects:  46% (224/486)
2021-07-19T00:08:16.1927181Z Receiving objects:  47% (229/486)
2021-07-19T00:08:16.1927775Z Receiving objects:  48% (234/486)
2021-07-19T00:08:16.1928366Z Receiving objects:  49% (239/486)
2021-07-19T00:08:16.1928961Z Receiving objects:  50% (243/486)
2021-07-19T00:08:16.1929557Z Receiving objects:  51% (248/486)
2021-07-19T00:08:16.1930146Z Receiving objects:  52% (253/486)
2021-07-19T00:08:16.1930742Z Receiving objects:  53% (258/486)
2021-07-19T00:08:16.1931323Z Receiving objects:  54% (263/486)
2021-07-19T00:08:16.1931924Z Receiving objects:  55% (268/486)
2021-07-19T00:08:16.1932520Z Receiving objects:  56% (273/486)
2021-07-19T00:08:16.1933117Z Receiving objects:  57% (278/486)
2021-07-19T00:08:16.1933713Z Receiving objects:  58% (282/486)
2021-07-19T00:08:16.1934293Z Receiving objects:  59% (287/486)
2021-07-19T00:08:16.1934894Z Receiving objects:  60% (292/486)
2021-07-19T00:08:16.1935491Z Receiving objects:  61% (297/486)
2021-07-19T00:08:16.1936077Z Receiving objects:  62% (302/486)
2021-07-19T00:08:16.1936681Z Receiving objects:  63% (307/486)
2021-07-19T00:08:16.1937265Z Receiving objects:  64% (312/486)
2021-07-19T00:08:16.1937868Z Receiving objects:  65% (316/486)
2021-07-19T00:08:16.1938460Z Receiving objects:  66% (321/486)
2021-07-19T00:08:16.1939055Z Receiving objects:  67% (326/486)
2021-07-19T00:08:16.1939651Z Receiving objects:  68% (331/486)
2021-07-19T00:08:16.1940240Z Receiving objects:  69% (336/486)
2021-07-19T00:08:16.1940837Z Receiving objects:  70% (341/486)
2021-07-19T00:08:16.1941457Z Receiving objects:  71% (346/486)
2021-07-19T00:08:16.1942044Z Receiving objects:  72% (350/486)
2021-07-19T00:08:16.1942737Z Receiving objects:  73% (355/486)
2021-07-19T00:08:16.1943339Z Receiving objects:  74% (360/486)
2021-07-19T00:08:16.1943936Z Receiving objects:  75% (365/486)
2021-07-19T00:08:16.1944540Z Receiving objects:  76% (370/486)
2021-07-19T00:08:16.1945130Z Receiving objects:  77% (375/486)
2021-07-19T00:08:16.1945726Z Receiving objects:  78% (380/486)
2021-07-19T00:08:16.1946324Z Receiving objects:  79% (384/486)
2021-07-19T00:08:16.1946915Z Receiving objects:  80% (389/486)
2021-07-19T00:08:16.1947513Z Receiving objects:  81% (394/486)
2021-07-19T00:08:16.1948099Z Receiving objects:  82% (399/486)
2021-07-19T00:08:16.1948694Z Receiving objects:  83% (404/486)
2021-07-19T00:08:16.1949276Z Receiving objects:  84% (409/486)
2021-07-19T00:08:16.1949875Z Receiving objects:  85% (414/486)
2021-07-19T00:08:16.1950468Z Receiving objects:  86% (418/486)
2021-07-19T00:08:16.1951057Z Receiving objects:  87% (423/486)
2021-07-19T00:08:16.1951654Z Receiving objects:  88% (428/486)
2021-07-19T00:08:16.1952241Z Receiving objects:  89% (433/486)
2021-07-19T00:08:16.1952839Z Receiving objects:  90% (438/486)
2021-07-19T00:08:16.1953438Z Receiving objects:  91% (443/486)
2021-07-19T00:08:16.1954019Z Receiving objects:  92% (448/486)
2021-07-19T00:08:16.1954617Z Receiving objects:  93% (452/486)
2021-07-19T00:08:16.1955855Z remote: Total 486 (delta 155), reused 305 (delta 88), pack-reused 0        
2021-07-19T00:08:16.1956587Z Receiving objects:  94% (457/486)
2021-07-19T00:08:16.1957191Z Receiving objects:  95% (462/486)
2021-07-19T00:08:16.1957782Z Receiving objects:  96% (467/486)
2021-07-19T00:08:16.1958378Z Receiving objects:  97% (472/486)
2021-07-19T00:08:16.1958961Z Receiving objects:  98% (477/486)
2021-07-19T00:08:16.1959559Z Receiving objects:  99% (482/486)
2021-07-19T00:08:16.1960156Z Receiving objects: 100% (486/486)
2021-07-19T00:08:16.1960808Z Receiving objects: 100% (486/486), 349.04 KiB | 6.98 MiB/s, done.
2021-07-19T00:08:16.1961466Z Resolving deltas:   0% (0/155)
2021-07-19T00:08:16.1962043Z Resolving deltas:   1% (2/155)
2021-07-19T00:08:16.1962638Z Resolving deltas:   2% (4/155)
2021-07-19T00:08:16.1963228Z Resolving deltas:   3% (5/155)
2021-07-19T00:08:16.1963801Z Resolving deltas:   4% (7/155)
2021-07-19T00:08:16.1964390Z Resolving deltas:   5% (8/155)
2021-07-19T00:08:16.1964969Z Resolving deltas:   6% (10/155)
2021-07-19T00:08:16.1965558Z Resolving deltas:   7% (11/155)
2021-07-19T00:08:16.1966266Z Resolving deltas:   8% (13/155)
2021-07-19T00:08:16.1966962Z Resolving deltas:   9% (14/155)
2021-07-19T00:08:16.1967546Z Resolving deltas:  10% (16/155)
2021-07-19T00:08:16.1968131Z Resolving deltas:  11% (18/155)
2021-07-19T00:08:16.1968710Z Resolving deltas:  12% (19/155)
2021-07-19T00:08:16.1969297Z Resolving deltas:  13% (21/155)
2021-07-19T00:08:16.1969871Z Resolving deltas:  14% (22/155)
2021-07-19T00:08:16.1970456Z Resolving deltas:  15% (24/155)
2021-07-19T00:08:16.1971028Z Resolving deltas:  16% (25/155)
2021-07-19T00:08:16.1971611Z Resolving deltas:  17% (27/155)
2021-07-19T00:08:16.1972199Z Resolving deltas:  18% (28/155)
2021-07-19T00:08:16.1972782Z Resolving deltas:  19% (30/155)
2021-07-19T00:08:16.1973367Z Resolving deltas:  20% (31/155)
2021-07-19T00:08:16.1973946Z Resolving deltas:  21% (33/155)
2021-07-19T00:08:16.1974529Z Resolving deltas:  22% (35/155)
2021-07-19T00:08:16.1975113Z Resolving deltas:  23% (36/155)
2021-07-19T00:08:16.1975696Z Resolving deltas:  24% (38/155)
2021-07-19T00:08:16.1976281Z Resolving deltas:  25% (39/155)
2021-07-19T00:08:16.1977035Z Resolving deltas:  26% (41/155)
2021-07-19T00:08:16.1977939Z Resolving deltas:  27% (42/155)
2021-07-19T00:08:16.1978643Z Resolving deltas:  28% (44/155)
2021-07-19T00:08:16.1979221Z Resolving deltas:  29% (45/155)
2021-07-19T00:08:16.1979807Z Resolving deltas:  30% (47/155)
2021-07-19T00:08:16.1980382Z Resolving deltas:  31% (49/155)
2021-07-19T00:08:16.1980967Z Resolving deltas:  32% (50/155)
2021-07-19T00:08:16.1981557Z Resolving deltas:  33% (52/155)
2021-07-19T00:08:16.1982144Z Resolving deltas:  34% (53/155)
2021-07-19T00:08:16.1982835Z Resolving deltas:  35% (55/155)
2021-07-19T00:08:16.1983426Z Resolving deltas:  36% (56/155)
2021-07-19T00:08:16.1984017Z Resolving deltas:  37% (58/155)
2021-07-19T00:08:16.1984598Z Resolving deltas:  38% (59/155)
2021-07-19T00:08:16.1985178Z Resolving deltas:  39% (61/155)
2021-07-19T00:08:16.1985763Z Resolving deltas:  40% (62/155)
2021-07-19T00:08:16.1986341Z Resolving deltas:  41% (65/155)
2021-07-19T00:08:16.1986935Z Resolving deltas:  42% (66/155)
2021-07-19T00:08:16.1987513Z Resolving deltas:  43% (67/155)
2021-07-19T00:08:16.1988089Z Resolving deltas:  44% (69/155)
2021-07-19T00:08:16.1988675Z Resolving deltas:  45% (70/155)
2021-07-19T00:08:16.1989278Z Resolving deltas:  46% (72/155)
2021-07-19T00:08:16.1989873Z Resolving deltas:  47% (73/155)
2021-07-19T00:08:16.1990461Z Resolving deltas:  48% (75/155)
2021-07-19T00:08:16.1991034Z Resolving deltas:  49% (76/155)
2021-07-19T00:08:16.1991621Z Resolving deltas:  50% (78/155)
2021-07-19T00:08:16.1992192Z Resolving deltas:  51% (80/155)
2021-07-19T00:08:16.1992790Z Resolving deltas:  52% (81/155)
2021-07-19T00:08:16.1993372Z Resolving deltas:  53% (83/155)
2021-07-19T00:08:16.1993949Z Resolving deltas:  54% (84/155)
2021-07-19T00:08:16.1994541Z Resolving deltas:  55% (86/155)
2021-07-19T00:08:16.1995113Z Resolving deltas:  56% (87/155)
2021-07-19T00:08:16.1995710Z Resolving deltas:  57% (89/155)
2021-07-19T00:08:16.1996303Z Resolving deltas:  58% (90/155)
2021-07-19T00:08:16.1996876Z Resolving deltas:  59% (92/155)
2021-07-19T00:08:16.1997469Z Resolving deltas:  60% (93/155)
2021-07-19T00:08:16.1998040Z Resolving deltas:  61% (95/155)
2021-07-19T00:08:16.1998629Z Resolving deltas:  62% (97/155)
2021-07-19T00:08:16.1999207Z Resolving deltas:  63% (98/155)
2021-07-19T00:08:16.1999782Z Resolving deltas:  64% (100/155)
2021-07-19T00:08:16.2000372Z Resolving deltas:  65% (101/155)
2021-07-19T00:08:16.2000947Z Resolving deltas:  66% (103/155)
2021-07-19T00:08:16.2001542Z Resolving deltas:  67% (104/155)
2021-07-19T00:08:16.2002124Z Resolving deltas:  68% (106/155)
2021-07-19T00:08:16.2002702Z Resolving deltas:  69% (107/155)
2021-07-19T00:08:16.2003299Z Resolving deltas:  70% (109/155)
2021-07-19T00:08:16.2003872Z Resolving deltas:  71% (111/155)
2021-07-19T00:08:16.2004463Z Resolving deltas:  72% (112/155)
2021-07-19T00:08:16.2005046Z Resolving deltas:  73% (114/155)
2021-07-19T00:08:16.2005623Z Resolving deltas:  74% (115/155)
2021-07-19T00:08:16.2006433Z Resolving deltas:  75% (117/155)
2021-07-19T00:08:16.2020348Z Resolving deltas:  76% (118/155)
2021-07-19T00:08:16.2021042Z Resolving deltas:  77% (120/155)
2021-07-19T00:08:16.2021651Z Resolving deltas:  78% (121/155)
2021-07-19T00:08:16.2022232Z Resolving deltas:  79% (123/155)
2021-07-19T00:08:16.2022823Z Resolving deltas:  80% (124/155)
2021-07-19T00:08:16.2023401Z Resolving deltas:  81% (126/155)
2021-07-19T00:08:16.2023990Z Resolving deltas:  82% (128/155)
2021-07-19T00:08:16.2024576Z Resolving deltas:  83% (129/155)
2021-07-19T00:08:16.2025153Z Resolving deltas:  84% (131/155)
2021-07-19T00:08:16.2025760Z Resolving deltas:  85% (132/155)
2021-07-19T00:08:16.2026336Z Resolving deltas:  86% (134/155)
2021-07-19T00:08:16.2026927Z Resolving deltas:  87% (135/155)
2021-07-19T00:08:16.2027512Z Resolving deltas:  88% (137/155)
2021-07-19T00:08:16.2028084Z Resolving deltas:  89% (138/155)
2021-07-19T00:08:16.2028669Z Resolving deltas:  90% (140/155)
2021-07-19T00:08:16.2029250Z Resolving deltas:  91% (142/155)
2021-07-19T00:08:16.2029838Z Resolving deltas:  92% (143/155)
2021-07-19T00:08:16.2030424Z Resolving deltas:  93% (145/155)
2021-07-19T00:08:16.2031005Z Resolving deltas:  94% (146/155)
2021-07-19T00:08:16.2031585Z Resolving deltas:  95% (148/155)
2021-07-19T00:08:16.2032157Z Resolving deltas:  96% (149/155)
2021-07-19T00:08:16.2032749Z Resolving deltas:  97% (151/155)
2021-07-19T00:08:16.2033340Z Resolving deltas:  98% (152/155)
2021-07-19T00:08:16.2033920Z Resolving deltas:  99% (154/155)
2021-07-19T00:08:16.2034507Z Resolving deltas: 100% (155/155)
2021-07-19T00:08:16.2035104Z Resolving deltas: 100% (155/155), done.
2021-07-19T00:08:16.2036499Z From https://github.com/submariner-io/submariner-operator
2021-07-19T00:08:16.2037728Z  * [new ref]         0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-19T00:08:16.2038534Z ##[endgroup]
2021-07-19T00:08:16.2039188Z ##[group]Determining the checkout info
2021-07-19T00:08:16.2039809Z ##[endgroup]
2021-07-19T00:08:16.2040389Z ##[group]Checking out the ref
2021-07-19T00:08:16.2041395Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-19T00:08:16.2042340Z Switched to a new branch 'devel'
2021-07-19T00:08:16.2043238Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-19T00:08:16.2043925Z ##[endgroup]
2021-07-19T00:08:16.2044655Z [command]/usr/bin/git log -1 --format='%H'
2021-07-19T00:08:16.2045518Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-19T00:08:16.2231544Z ##[group]Run submariner-io/shipyard/gh-actions/e2e@devel
2021-07-19T00:08:16.2232150Z with:
2021-07-19T00:08:16.2232557Z   k8s_version: 1.19
2021-07-19T00:08:16.2232982Z   using:  globalnet 
2021-07-19T00:08:16.2233481Z   working-directory: .
2021-07-19T00:08:16.2233947Z   target: e2e
2021-07-19T00:08:16.2234348Z   focus: \[.*\]
2021-07-19T00:08:16.2234836Z   skip: \[external-dataplane\]
2021-07-19T00:08:16.2235359Z   testdir: test/e2e
2021-07-19T00:08:16.2235794Z ##[endgroup]
2021-07-19T00:08:17.1329485Z ##[group]Reclaiming free space
2021-07-19T00:08:29.2510450Z Filesystem      Size  Used Avail Use% Mounted on
2021-07-19T00:08:29.2519384Z /dev/root        84G   42G   43G  50% /
2021-07-19T00:08:29.2521039Z devtmpfs        3.4G     0  3.4G   0% /dev
2021-07-19T00:08:29.2527875Z tmpfs           3.4G   12K  3.4G   1% /dev/shm
2021-07-19T00:08:29.2529692Z tmpfs           696M  1.1M  695M   1% /run
2021-07-19T00:08:29.2531152Z tmpfs           5.0M     0  5.0M   0% /run/lock
2021-07-19T00:08:29.2532955Z tmpfs           3.4G     0  3.4G   0% /sys/fs/cgroup
2021-07-19T00:08:29.2534469Z /dev/sdb15      105M  7.9M   97M   8% /boot/efi
2021-07-19T00:08:29.2535908Z /dev/loop2       33M   33M     0 100% /snap/snapd/12398
2021-07-19T00:08:29.2537319Z /dev/loop1       33M   33M     0 100% /snap/snapd/12159
2021-07-19T00:08:29.2538840Z /dev/loop0       68M   68M     0 100% /snap/lxd/20326
2021-07-19T00:08:29.2540119Z /dev/loop3       56M   56M     0 100% /snap/core18/2066
2021-07-19T00:08:29.2541801Z /dev/loop4       56M   56M     0 100% /snap/core18/2074
2021-07-19T00:08:29.2543219Z /dev/sda1        14G  4.1G  9.0G  32% /mnt
2021-07-19T00:08:29.2544975Z ##[endgroup]
2021-07-19T00:08:29.2696496Z ##[group]Disable swap
2021-07-19T00:08:29.3026483Z ##[endgroup]
2021-07-19T00:08:29.3156683Z ##[group]Report available RAM
2021-07-19T00:08:29.3244584Z               total        used        free      shared  buff/cache   available
2021-07-19T00:08:29.3245209Z Mem:          6.8Gi       483Mi       5.2Gi       7.0Mi       1.1Gi       6.0Gi
2021-07-19T00:08:29.3245689Z Swap:            0B          0B          0B
2021-07-19T00:08:29.3246125Z ##[endgroup]
2021-07-19T00:08:29.3517414Z Downloading Makefile.dapper
2021-07-19T00:08:29.3901396Z Downloading dapper
2021-07-19T00:08:29.5699492Z .dapper.tmp version v0.5.6
2021-07-19T00:08:29.5741986Z Downloading Dockerfile.dapper
2021-07-19T00:08:29.6093860Z docker network create -d bridge kind
2021-07-19T00:08:29.9557661Z 9faca4a116d42a089fa94315f5323e886b0d62b7f011828f2bfde2788c27f7ea
2021-07-19T00:08:29.9573968Z ./.dapper -m bind  make --debug=b e2e
2021-07-19T00:08:30.1719546Z Sending build context to Docker daemon  7.517MB
2021-07-19T00:08:30.1720311Z 
2021-07-19T00:08:30.1778788Z Step 1/8 : ARG BASE_BRANCH
2021-07-19T00:08:30.1781689Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-19T00:08:30.6049999Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-19T00:08:30.6077326Z b1495d80d526: Pulling fs layer
2021-07-19T00:08:30.6078118Z fb3037ce215d: Pulling fs layer
2021-07-19T00:08:30.6078673Z 95344349df1d: Pulling fs layer
2021-07-19T00:08:30.6079216Z a3e11b0fdbf6: Pulling fs layer
2021-07-19T00:08:30.6079827Z b2d0ef6cbe4f: Pulling fs layer
2021-07-19T00:08:30.6080427Z fa188fe30729: Pulling fs layer
2021-07-19T00:08:30.6081154Z 05ca4b0545ef: Pulling fs layer
2021-07-19T00:08:30.6082590Z b17ce80b21da: Pulling fs layer
2021-07-19T00:08:30.6083049Z fa188fe30729: Waiting
2021-07-19T00:08:30.6083457Z a3e11b0fdbf6: Waiting
2021-07-19T00:08:30.6083976Z b2d0ef6cbe4f: Waiting
2021-07-19T00:08:30.6084383Z 05ca4b0545ef: Waiting
2021-07-19T00:08:30.6084761Z b17ce80b21da: Waiting
2021-07-19T00:08:31.1807589Z 95344349df1d: Verifying Checksum
2021-07-19T00:08:31.1810734Z 95344349df1d: Download complete
2021-07-19T00:08:31.2779592Z a3e11b0fdbf6: Verifying Checksum
2021-07-19T00:08:31.2864718Z a3e11b0fdbf6: Download complete
2021-07-19T00:08:31.3663932Z b1495d80d526: Verifying Checksum
2021-07-19T00:08:31.3709020Z b1495d80d526: Download complete
2021-07-19T00:08:31.4054150Z b2d0ef6cbe4f: Verifying Checksum
2021-07-19T00:08:31.4055706Z b2d0ef6cbe4f: Download complete
2021-07-19T00:08:31.4911334Z fa188fe30729: Verifying Checksum
2021-07-19T00:08:31.4911881Z fa188fe30729: Download complete
2021-07-19T00:08:31.5478072Z 05ca4b0545ef: Verifying Checksum
2021-07-19T00:08:31.5478665Z 05ca4b0545ef: Download complete
2021-07-19T00:08:32.1369649Z b17ce80b21da: Verifying Checksum
2021-07-19T00:08:32.1370255Z b17ce80b21da: Download complete
2021-07-19T00:08:33.2581953Z fb3037ce215d: Verifying Checksum
2021-07-19T00:08:33.2582556Z fb3037ce215d: Download complete
2021-07-19T00:08:34.4678411Z b1495d80d526: Pull complete
2021-07-19T00:08:44.8517681Z fb3037ce215d: Pull complete
2021-07-19T00:08:46.2147100Z 95344349df1d: Pull complete
2021-07-19T00:08:46.2763005Z a3e11b0fdbf6: Pull complete
2021-07-19T00:08:46.3412152Z b2d0ef6cbe4f: Pull complete
2021-07-19T00:08:46.4888649Z fa188fe30729: Pull complete
2021-07-19T00:08:46.5489521Z 05ca4b0545ef: Pull complete
2021-07-19T00:08:46.6325859Z b17ce80b21da: Pull complete
2021-07-19T00:08:46.6360437Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-19T00:08:46.6373532Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-19T00:08:46.6386676Z  ---> 92b726655a41
2021-07-19T00:08:46.6387090Z Step 3/8 : ARG PROJECT
2021-07-19T00:08:46.6555721Z  ---> Running in 313d7408a636
2021-07-19T00:08:47.5323135Z Removing intermediate container 313d7408a636
2021-07-19T00:08:47.5329621Z  ---> 6f0de52fdfdc
2021-07-19T00:08:47.5331485Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR"     DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-19T00:08:47.5545665Z  ---> Running in 0702b8d29e2b
2021-07-19T00:08:48.4263889Z Removing intermediate container 0702b8d29e2b
2021-07-19T00:08:48.4265117Z  ---> 21ecc298519f
2021-07-19T00:08:48.4265712Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-19T00:08:48.4426462Z  ---> Running in d160b4adf071
2021-07-19T00:08:49.3082024Z Removing intermediate container d160b4adf071
2021-07-19T00:08:49.3083336Z  ---> e9b21a373112
2021-07-19T00:08:49.3083787Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-19T00:08:49.3202869Z  ---> Running in 6d10b0244349
2021-07-19T00:08:50.1950407Z Removing intermediate container 6d10b0244349
2021-07-19T00:08:50.1951576Z  ---> 718cfdf2adff
2021-07-19T00:08:50.1952137Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-19T00:08:50.2074121Z  ---> Running in 9108ecfea74a
2021-07-19T00:08:51.0736434Z Removing intermediate container 9108ecfea74a
2021-07-19T00:08:51.0737561Z  ---> 08d318e0c14b
2021-07-19T00:08:51.0737930Z Step 8/8 : CMD ["sh"]
2021-07-19T00:08:51.0913237Z  ---> Running in 6027f1086e33
2021-07-19T00:08:52.0491818Z Removing intermediate container 6027f1086e33
2021-07-19T00:08:52.0493914Z  ---> d39421547752
2021-07-19T00:08:52.0651981Z Successfully built d39421547752
2021-07-19T00:08:52.0704264Z Successfully tagged submariner-operator:devel
2021-07-19T00:08:52.5261150Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-19T00:08:52.5282650Z [submariner-operator]$ mkdir -p bin dist output
2021-07-19T00:08:52.5294711Z [submariner-operator]$ make --debug=b e2e
2021-07-19T00:08:52.5309404Z GNU Make 4.3
2021-07-19T00:08:52.5310293Z Built for x86_64-redhat-linux-gnu
2021-07-19T00:08:52.5311039Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-19T00:08:52.5311807Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-19T00:08:52.5312574Z This is free software: you are free to change and redistribute it.
2021-07-19T00:08:52.5313230Z There is NO WARRANTY, to the extent permitted by law.
2021-07-19T00:08:52.5313765Z Reading makefiles...
2021-07-19T00:08:52.6395506Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-19T00:08:52.6396897Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-19T00:08:52.8401023Z Updating makefiles....
2021-07-19T00:08:52.8410359Z Updating goal targets....
2021-07-19T00:08:52.8411447Z  File 'e2e' does not exist.
2021-07-19T00:08:52.8412024Z      File 'clusters' does not exist.
2021-07-19T00:08:52.8412625Z     Must remake target 'clusters'.
2021-07-19T00:08:52.8413929Z /opt/shipyard/scripts/clusters.sh --k8s_version="1.19" --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T00:08:52.8438579Z Downloading shflags 1.0.3
2021-07-19T00:08:52.8494074Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-07-19T00:08:52.8494755Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-07-19T00:08:52.8495098Z 
2021-07-19T00:08:52.8809335Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-07-19T00:08:52.8810195Z 100 31091  100 31091    0     0   979k      0 --:--:-- --:--:-- --:--:--  979k
2021-07-19T00:08:52.9420743Z Running with: k8s_version=1.19.11, olm_version=0.14.1, olm=false, globalnet=true, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-19T00:08:52.9441760Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T00:08:52.9451032Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:08:52.9462460Z [submariner-operator]$ script_name=utils
2021-07-19T00:08:52.9473304Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T00:08:52.9491174Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T00:08:52.9502738Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:08:52.9514271Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:08:52.9525343Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T00:08:52.9544581Z [submariner-operator]$ broker=cluster1
2021-07-19T00:08:52.9555709Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T00:08:52.9567663Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T00:08:52.9579345Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T00:08:52.9591030Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T00:08:52.9602138Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T00:08:52.9614476Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T00:08:52.9625427Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T00:08:52.9635212Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T00:08:52.9646185Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T00:08:52.9658440Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T00:08:52.9666212Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T00:08:52.9677259Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T00:08:52.9687139Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:08:52.9697208Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:08:52.9707146Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T00:08:52.9726891Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T00:08:52.9738087Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T00:08:52.9763155Z [submariner-operator]$ cat <<EOM
2021-07-19T00:08:52.9764310Z Cluster settings::
2021-07-19T00:08:52.9764858Z   broker - ${broker@Q}
2021-07-19T00:08:52.9765393Z   clusters - ${clusters[*]@Q}
2021-07-19T00:08:52.9766192Z   cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-19T00:08:52.9767441Z   nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-19T00:08:52.9768220Z   install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-19T00:08:52.9768808Z EOM
2021-07-19T00:08:52.9786894Z [submariner-operator]$ typeset -p cluster_cni
2021-07-19T00:08:52.9799835Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T00:08:52.9826317Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-19T00:08:52.9839262Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T00:08:52.9865036Z [submariner-operator]$ typeset -p cluster_subm
2021-07-19T00:08:52.9877932Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T00:08:52.9896592Z Cluster settings::
2021-07-19T00:08:52.9897274Z   broker - 'cluster1'
2021-07-19T00:08:52.9897850Z   clusters - 'cluster1' 'cluster2'
2021-07-19T00:08:52.9898516Z   cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-19T00:08:52.9899682Z   nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-19T00:08:52.9900820Z   install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-19T00:08:52.9912946Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T00:08:52.9930176Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T00:08:52.9948553Z [submariner-operator]$ run_local_registry
2021-07-19T00:08:52.9959155Z [submariner-operator]$ run_local_registry
2021-07-19T00:08:52.9969845Z [submariner-operator]$ registry_running
2021-07-19T00:08:52.9980246Z [submariner-operator]$ registry_running
2021-07-19T00:08:52.9990797Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-19T00:08:53.0003370Z [submariner-operator]$ grep kind-registry
2021-07-19T00:08:53.2636059Z [submariner-operator]$ return 0
2021-07-19T00:08:53.2639021Z Deploying local registry kind-registry to serve images centrally.
2021-07-19T00:08:53.2652263Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-19T00:08:53.2663257Z [submariner-operator]$ selinuxenabled
2021-07-19T00:08:53.2685072Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-19T00:08:53.5034049Z Unable to find image 'registry:2' locally
2021-07-19T00:08:53.9664216Z 2: Pulling from library/registry
2021-07-19T00:08:54.0345050Z ddad3d7c1e96: Already exists
2021-07-19T00:08:54.0362323Z 6eda6749503f: Pulling fs layer
2021-07-19T00:08:54.0362898Z 363ab70c2143: Pulling fs layer
2021-07-19T00:08:54.0363402Z 5b94580856e6: Pulling fs layer
2021-07-19T00:08:54.0363868Z 12008541203a: Pulling fs layer
2021-07-19T00:08:54.0364302Z 12008541203a: Waiting
2021-07-19T00:08:54.1313453Z 5b94580856e6: Verifying Checksum
2021-07-19T00:08:54.1314151Z 5b94580856e6: Download complete
2021-07-19T00:08:54.1484926Z 6eda6749503f: Verifying Checksum
2021-07-19T00:08:54.1485444Z 6eda6749503f: Download complete
2021-07-19T00:08:54.2101991Z 12008541203a: Verifying Checksum
2021-07-19T00:08:54.2102480Z 12008541203a: Download complete
2021-07-19T00:08:54.2214499Z 363ab70c2143: Verifying Checksum
2021-07-19T00:08:54.2247182Z 363ab70c2143: Download complete
2021-07-19T00:08:54.3360753Z 6eda6749503f: Pull complete
2021-07-19T00:08:54.6095202Z 363ab70c2143: Pull complete
2021-07-19T00:08:54.6776488Z 5b94580856e6: Pull complete
2021-07-19T00:08:54.7380036Z 12008541203a: Pull complete
2021-07-19T00:08:54.7438546Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-19T00:08:54.7439819Z Status: Downloaded newer image for registry:2
2021-07-19T00:08:54.7610082Z 6b8587e117505200c0f0648549185a03021a243b17439061bf3b886a6c32315d
2021-07-19T00:08:55.2596000Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-19T00:08:55.6084366Z [submariner-operator]$ declare_cidrs
2021-07-19T00:08:55.6091652Z [submariner-operator]$ declare_cidrs
2021-07-19T00:08:55.6099811Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T00:08:55.6107911Z [submariner-operator]$ i=1
2021-07-19T00:08:55.6116614Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:08:55.6132274Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:08:55.6144331Z [submariner-operator]$ [cluster1] val=0
2021-07-19T00:08:55.6145249Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-19T00:08:55.6160486Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-19T00:08:55.6168572Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-19T00:08:55.6173444Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T00:08:55.6184993Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:08:55.6194820Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:08:55.6202664Z [submariner-operator]$ [cluster2] val=0
2021-07-19T00:08:55.6211542Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-19T00:08:55.6216656Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-19T00:08:55.6227011Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-19T00:08:55.6238513Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T00:08:55.6253025Z [submariner-operator]$ [cluster2] wait 238
2021-07-19T00:08:55.6257995Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6268614Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6278425Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6290262Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6301870Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T00:08:55.6317186Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T00:08:55.6335706Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T00:08:55.6338530Z [submariner-operator]$ [cluster1] pids[cluster1]=247
2021-07-19T00:08:55.6350332Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6358049Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T00:08:55.6368132Z [submariner-operator]$ [cluster2] pids[cluster2]=250
2021-07-19T00:08:55.6375763Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-19T00:08:55.6380373Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T00:08:55.6389426Z [submariner-operator]$ [cluster2] wait 250
2021-07-19T00:08:55.6397547Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T00:10:46.5653776Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T00:10:46.5654932Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:10:46.5655849Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T00:10:46.5656694Z [submariner-operator]$ [cluster2] wait 271
2021-07-19T00:10:46.5657525Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T00:10:46.5659150Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:10:46.5661245Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:10:46.5662556Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-19T00:10:46.5663441Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-19T00:10:46.5664048Z [cluster2] No kind clusters found.
2021-07-19T00:10:46.5664562Z [cluster2] Creating KIND cluster...
2021-07-19T00:10:46.5665469Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-19T00:10:46.5666387Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-19T00:10:46.5667279Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-19T00:10:46.5668085Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T00:10:46.5668817Z [cluster2] - role: control-plane
2021-07-19T00:10:46.5669605Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T00:10:46.5670311Z [cluster2] - role: control-plane
2021-07-19T00:10:46.5670895Z [cluster2] - role: worker
2021-07-19T00:10:46.5671570Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T00:10:46.5672268Z [cluster2] - role: control-plane
2021-07-19T00:10:46.5672833Z [cluster2] - role: worker
2021-07-19T00:10:46.5673380Z [cluster2] - role: worker
2021-07-19T00:10:46.5673879Z [cluster2] 
2021-07-19T00:10:46.5674353Z [cluster2] 
2021-07-19T00:10:46.5675041Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-19T00:10:46.5676359Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-19T00:10:46.5677693Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.19.11
2021-07-19T00:10:46.5678626Z [submariner-operator]$ [cluster2] kind version
2021-07-19T00:10:46.5679233Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T00:10:46.5680214Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-19T00:10:46.5681071Z [cluster2] ---
2021-07-19T00:10:46.5681457Z [cluster2] kind: Cluster
2021-07-19T00:10:46.5682121Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T00:10:46.5682732Z [cluster2] networking:
2021-07-19T00:10:46.5683256Z [cluster2]   disableDefaultCNI: true
2021-07-19T00:10:46.5683776Z [cluster2]   podSubnet: 10.0.0.0/16
2021-07-19T00:10:46.5684265Z [cluster2]   serviceSubnet: 100.0.0.0/16
2021-07-19T00:10:46.5684863Z [cluster2] containerdConfigPatches:
2021-07-19T00:10:46.5685523Z [cluster2]   - |-
2021-07-19T00:10:46.5686251Z [cluster2]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T00:10:46.5687421Z [cluster2]       endpoint = ["http://kind-registry:5000"]
2021-07-19T00:10:46.5688119Z [cluster2] kubeadmConfigPatches:
2021-07-19T00:10:46.5688709Z [cluster2]   - |
2021-07-19T00:10:46.5689283Z [cluster2]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T00:10:46.5689913Z [cluster2]     kind: ClusterConfiguration
2021-07-19T00:10:46.5690442Z [cluster2]     metadata:
2021-07-19T00:10:46.5690848Z [cluster2]       name: config
2021-07-19T00:10:46.5691284Z [cluster2]     networking:
2021-07-19T00:10:46.5691808Z [cluster2]       podSubnet: 10.0.0.0/16
2021-07-19T00:10:46.5692301Z [cluster2]       serviceSubnet: 100.0.0.0/16
2021-07-19T00:10:46.5692834Z [cluster2]       dnsDomain: cluster2.local
2021-07-19T00:10:46.5693311Z [cluster2] nodes: 
2021-07-19T00:10:46.5693899Z [cluster2] - role: control-plane
2021-07-19T00:10:46.5694473Z [cluster2] - role: worker
2021-07-19T00:10:46.5695011Z [cluster2] - role: worker
2021-07-19T00:10:46.5696249Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.19.11 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-19T00:10:46.5697305Z [cluster2] Creating cluster "cluster2" ...
2021-07-19T00:10:46.5699265Z [cluster2]  • Ensuring node image (kindest/node:v1.19.11) 🖼  ...
2021-07-19T00:10:46.5700322Z [cluster2]  ✓ Ensuring node image (kindest/node:v1.19.11) 🖼
2021-07-19T00:10:46.5701036Z [cluster2]  • Preparing nodes 📦 📦 📦   ...
2021-07-19T00:10:46.5701677Z [cluster2]  ✓ Preparing nodes 📦 📦 📦 
2021-07-19T00:10:46.5702335Z [cluster2]  • Writing configuration 📜  ...
2021-07-19T00:10:46.5702998Z [cluster2]  ✓ Writing configuration 📜
2021-07-19T00:10:46.5703704Z [cluster2]  • Starting control-plane 🕹️  ...
2021-07-19T00:10:46.5704390Z [cluster2]  ✓ Starting control-plane 🕹️
2021-07-19T00:10:46.5705094Z [cluster2]  • Installing StorageClass 💾  ...
2021-07-19T00:10:46.5705799Z [cluster2]  ✓ Installing StorageClass 💾
2021-07-19T00:10:46.5706473Z [cluster2]  • Joining worker nodes 🚜  ...
2021-07-19T00:10:46.5707092Z [cluster2]  ✓ Joining worker nodes 🚜
2021-07-19T00:10:46.5707793Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-19T00:10:46.5708366Z [cluster2] You can now use your cluster with:
2021-07-19T00:10:46.5708807Z [cluster2] 
2021-07-19T00:10:46.5709474Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-19T00:10:46.5710013Z [cluster2] 
2021-07-19T00:10:46.5710941Z [cluster2] Have a question, bug, or feature request? Let us know! https://kind.sigs.k8s.io/#community 🙂
2021-07-19T00:10:46.5711995Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T00:10:46.5712867Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T00:10:46.5714226Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-19T00:10:51.7853839Z [submariner-operator]$ [cluster2] head -n 1[submariner-operator]$ [cluster1] with_retries
2021-07-19T00:10:51.7854960Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T00:10:51.7855838Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T00:10:51.7856791Z [submariner-operator]$ [cluster1] wait 267
2021-07-19T00:10:51.7857675Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T00:10:51.7859299Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:10:51.7861265Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:10:51.7862631Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-19T00:10:51.7863528Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-19T00:10:51.7864140Z [cluster1] No kind clusters found.
2021-07-19T00:10:51.7864648Z [cluster1] Creating KIND cluster...
2021-07-19T00:10:51.7865436Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-19T00:10:51.7866444Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-19T00:10:51.7867500Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-19T00:10:51.7868312Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T00:10:51.7869046Z [cluster1] - role: control-plane
2021-07-19T00:10:51.7869758Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T00:10:51.7870468Z [cluster1] - role: control-plane
2021-07-19T00:10:51.7871054Z [cluster1] - role: worker
2021-07-19T00:10:51.7871737Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T00:10:51.7872424Z [cluster1] - role: control-plane
2021-07-19T00:10:51.7873012Z [cluster1] - role: worker
2021-07-19T00:10:51.7873548Z [cluster1] - role: worker
2021-07-19T00:10:51.7874066Z [cluster1] 
2021-07-19T00:10:51.7874525Z [cluster1] 
2021-07-19T00:10:51.7875296Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-19T00:10:51.7876540Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-19T00:10:51.7877761Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.19.11
2021-07-19T00:10:51.7878725Z [submariner-operator]$ [cluster1] kind version
2021-07-19T00:10:51.7879511Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T00:10:51.7880682Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-19T00:10:51.7881524Z [cluster1] ---
2021-07-19T00:10:51.7881924Z [cluster1] kind: Cluster
2021-07-19T00:10:51.7882570Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T00:10:51.7883190Z [cluster1] networking:
2021-07-19T00:10:51.7883716Z [cluster1]   disableDefaultCNI: true
2021-07-19T00:10:51.7884240Z [cluster1]   podSubnet: 10.0.0.0/16
2021-07-19T00:10:51.7884732Z [cluster1]   serviceSubnet: 100.0.0.0/16
2021-07-19T00:10:51.7885329Z [cluster1] containerdConfigPatches:
2021-07-19T00:10:51.7885980Z [cluster1]   - |-
2021-07-19T00:10:51.7887090Z [cluster1]     [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T00:10:51.7888200Z [cluster1]       endpoint = ["http://kind-registry:5000"]
2021-07-19T00:10:51.7888888Z [cluster1] kubeadmConfigPatches:
2021-07-19T00:10:51.7889494Z [cluster1]   - |
2021-07-19T00:10:51.7889992Z [cluster1]     apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T00:10:51.7890635Z [cluster1]     kind: ClusterConfiguration
2021-07-19T00:10:51.7891158Z [cluster1]     metadata:
2021-07-19T00:10:51.7891565Z [cluster1]       name: config
2021-07-19T00:10:51.7892002Z [cluster1]     networking:
2021-07-19T00:10:51.7892489Z [cluster1]       podSubnet: 10.0.0.0/16
2021-07-19T00:10:51.7893012Z [cluster1]       serviceSubnet: 100.0.0.0/16
2021-07-19T00:10:51.7893679Z [cluster1]       dnsDomain: cluster1.local
2021-07-19T00:10:51.7894160Z [cluster1] nodes: 
2021-07-19T00:10:51.7894865Z [cluster1] - role: control-plane
2021-07-19T00:10:51.7895461Z [cluster1] - role: worker
2021-07-19T00:10:51.7895982Z [cluster1] - role: worker
2021-07-19T00:10:51.7897285Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.19.11 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-19T00:10:51.7898358Z [cluster1] Creating cluster "cluster1" ...
2021-07-19T00:10:51.7899219Z [cluster1]  • Ensuring node image (kindest/node:v1.19.11) 🖼  ...
2021-07-19T00:10:51.7900125Z [cluster1]  ✓ Ensuring node image (kindest/node:v1.19.11) 🖼
2021-07-19T00:10:51.7900913Z [cluster1]  • Preparing nodes 📦 📦 📦   ...
2021-07-19T00:10:51.7926992Z [cluster1]  ✓ Preparing nodes 📦 📦 📦 
2021-07-19T00:10:51.7928013Z [cluster1]  • Writing configuration 📜  ...
2021-07-19T00:10:51.7928700Z [cluster1]  ✓ Writing configuration 📜
2021-07-19T00:10:51.7929457Z [cluster1]  • Starting control-plane 🕹️  ...
2021-07-19T00:10:51.7930164Z [cluster1]  ✓ Starting control-plane 🕹️
2021-07-19T00:10:51.7930856Z [cluster1]  • Installing StorageClass 💾  ...
2021-07-19T00:10:51.7931565Z [cluster1]  ✓ Installing StorageClass 💾
2021-07-19T00:10:51.7932231Z [cluster1]  • Joining worker nodes 🚜  ...
2021-07-19T00:10:51.7932845Z [cluster1]  ✓ Joining worker nodes 🚜
2021-07-19T00:10:51.7933551Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-19T00:10:51.7934154Z [cluster1] You can now use your cluster with:
2021-07-19T00:10:51.7934593Z [cluster1] 
2021-07-19T00:10:51.7935254Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-19T00:10:51.7935790Z [cluster1] 
2021-07-19T00:10:51.7936681Z [cluster1] Not sure what to do next? 😅  Check out https://kind.sigs.k8s.io/docs/user/quick-start/
2021-07-19T00:10:51.7937726Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T00:10:51.7938592Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T00:10:51.7939990Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-19T00:10:51.7941240Z [submariner-operator]$ [cluster1] head -n 1
2021-07-19T00:11:15.4275187Z 
2021-07-19T00:11:15.4277043Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4280637Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4282670Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4284719Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4287053Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4289064Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T00:11:15.4290332Z [submariner-operator]$ [cluster2] wait 1484
2021-07-19T00:11:15.4291269Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-19T00:11:15.4292263Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-19T00:11:15.4293170Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-19T00:11:15.4293986Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-19T00:11:15.4294880Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-19T00:11:15.4295902Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-19T00:11:15.4296771Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-19T00:11:15.4297395Z [cluster2] Applying weave network...
2021-07-19T00:11:15.4298647Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:15.4300317Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:15.4302080Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:15.4303345Z [cluster2] serviceaccount/weave-net created
2021-07-19T00:11:15.4304442Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:15.4305945Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:15.4307444Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:15.4308662Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:15.4309720Z [cluster2] daemonset.apps/weave-net created
2021-07-19T00:11:15.4310481Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-19T00:11:15.4367624Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:15.4369481Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:15.4371050Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:15.4372307Z [cluster2] pod/weave-net-bp8q8 condition met
2021-07-19T00:11:15.4373086Z [cluster2] pod/weave-net-bzs22 condition met
2021-07-19T00:11:15.4373853Z [cluster2] pod/weave-net-qqqdl condition met
2021-07-19T00:11:15.4374645Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-19T00:11:15.4375800Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:15.4377064Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:15.4378659Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:15.4379795Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T00:11:15.4380745Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T00:11:15.4381873Z [cluster2] deployment "coredns" successfully rolled out
2021-07-19T00:11:15.4383821Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:11:15.4384884Z [submariner-operator]$ [cluster2] wait 247
2021-07-19T00:11:22.2321697Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2323816Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2325834Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2328413Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2330770Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2332769Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T00:11:22.2334019Z [submariner-operator]$ [cluster1] wait 1604
2021-07-19T00:11:22.2334950Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-19T00:11:22.2335953Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-19T00:11:22.2336849Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-19T00:11:22.2337671Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-19T00:11:22.2338530Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-19T00:11:22.2339424Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-19T00:11:22.2340286Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-19T00:11:22.2340924Z [cluster1] Applying weave network...
2021-07-19T00:11:22.2342152Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:22.2343819Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:22.2345595Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.19.11&env.IPALLOC_RANGE=10.0.0.0/16
2021-07-19T00:11:22.2346845Z [cluster1] serviceaccount/weave-net created
2021-07-19T00:11:22.2347930Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:22.2349427Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:22.2350783Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:22.2352024Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T00:11:22.2353062Z [cluster1] daemonset.apps/weave-net created
2021-07-19T00:11:22.2353838Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-19T00:11:22.2354939Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:22.2356432Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:22.2357963Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T00:11:22.2359086Z [cluster1] pod/weave-net-45z65 condition met
2021-07-19T00:11:22.2359848Z [cluster1] pod/weave-net-4fbgh condition met
2021-07-19T00:11:22.2360595Z [cluster1] pod/weave-net-ntxqm condition met
2021-07-19T00:11:22.2361391Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-19T00:11:22.2362476Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:22.2363738Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:22.2365113Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T00:11:22.2366217Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T00:11:22.2368627Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T00:11:22.2369450Z [cluster1] deployment "coredns" successfully rolled out
2021-07-19T00:11:22.2370356Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:11:22.2401322Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T00:11:22.2413749Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T00:11:22.2437640Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-19T00:11:22.2438412Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T00:11:22.2438895Z 
2021-07-19T00:11:22.2439804Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T00:11:22.2440362Z 
2021-07-19T00:11:22.2441052Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T00:11:22.2441475Z 
2021-07-19T00:11:22.2442063Z To clean everthing up, just run: make clean-clusters
2021-07-19T00:11:22.2442638Z EOM
2021-07-19T00:11:22.2493394Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T00:11:22.2493899Z 
2021-07-19T00:11:22.2494883Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T00:11:22.2495444Z 
2021-07-19T00:11:22.2496126Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T00:11:22.2496553Z 
2021-07-19T00:11:22.2497154Z To clean everthing up, just run: make clean-clusters
2021-07-19T00:11:22.2516070Z     Successfully remade target file 'clusters'.
2021-07-19T00:11:22.2522324Z      File 'preload-images' does not exist.
2021-07-19T00:11:22.2523108Z        File 'images' does not exist.
2021-07-19T00:11:22.2529206Z          File 'package/.image.submariner-operator' does not exist.
2021-07-19T00:11:22.2667010Z find: 'bin/submariner-operator': No such file or directory
2021-07-19T00:11:22.5300791Z              File 'bin/submariner-operator' does not exist.
2021-07-19T00:11:22.5301887Z                File 'vendor/modules.txt' does not exist.
2021-07-19T00:11:22.5302709Z               Must remake target 'vendor/modules.txt'.
2021-07-19T00:11:22.5303290Z go mod download
2021-07-19T00:12:13.4617841Z go mod vendor
2021-07-19T00:12:15.3659066Z go mod tidy
2021-07-19T00:12:15.9462276Z               Successfully remade target file 'vendor/modules.txt'.
2021-07-19T00:12:15.9463375Z                File 'generate-embeddedyamls' does not exist.
2021-07-19T00:12:15.9464149Z                  File 'generate' does not exist.
2021-07-19T00:12:15.9465139Z                    File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-19T00:12:15.9466454Z                   Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T00:12:15.9467937Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-19T00:12:15.9506092Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-19T00:12:33.5080091Z                   Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T00:12:33.5081255Z                 Must remake target 'generate'.
2021-07-19T00:12:33.5115968Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-19T00:12:44.2179677Z                 Successfully remade target file 'generate'.
2021-07-19T00:12:44.2180723Z                  File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-19T00:12:44.2186926Z                    File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-19T00:12:44.2193499Z                   Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T00:12:44.2197781Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-19T00:12:46.2604066Z                   Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T00:12:46.2605583Z                    File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-19T00:12:46.2609444Z                   Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T00:12:46.2611253Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-19T00:12:47.4063943Z                   Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T00:12:47.4156100Z                 Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T00:12:47.4156967Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-19T00:12:48.0199367Z Generating yamls.go
2021-07-19T00:12:48.0204641Z deploy/crds/submariner.io_brokers.yaml
2021-07-19T00:12:48.0209757Z deploy/crds/submariner.io_submariners.yaml
2021-07-19T00:12:48.0250676Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-19T00:12:48.0256975Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-19T00:12:48.0258055Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-19T00:12:48.0262061Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-19T00:12:48.0266529Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-19T00:12:48.0271814Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-19T00:12:48.0280041Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-19T00:12:48.0288608Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-19T00:12:48.0296717Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-19T00:12:48.0307269Z config/broker/broker-admin/service_account.yaml
2021-07-19T00:12:48.0312643Z config/broker/broker-admin/role.yaml
2021-07-19T00:12:48.0314465Z config/broker/broker-admin/role_binding.yaml
2021-07-19T00:12:48.0318872Z config/broker/broker-client/service_account.yaml
2021-07-19T00:12:48.0322199Z config/broker/broker-client/role.yaml
2021-07-19T00:12:48.0326669Z config/broker/broker-client/role_binding.yaml
2021-07-19T00:12:48.0330969Z config/rbac/submariner-operator/service_account.yaml
2021-07-19T00:12:48.0333657Z config/rbac/submariner-operator/role.yaml
2021-07-19T00:12:48.0336623Z config/rbac/submariner-operator/role_binding.yaml
2021-07-19T00:12:48.0338608Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-19T00:12:48.0342260Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-19T00:12:48.0345088Z config/rbac/submariner-gateway/service_account.yaml
2021-07-19T00:12:48.0346872Z config/rbac/submariner-gateway/role.yaml
2021-07-19T00:12:48.0351863Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-19T00:12:48.0354436Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-19T00:12:48.0357657Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-19T00:12:48.0360274Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-19T00:12:48.0363562Z config/rbac/submariner-route-agent/role.yaml
2021-07-19T00:12:48.0367666Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-19T00:12:48.0369993Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-19T00:12:48.0375650Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-19T00:12:48.0377766Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-19T00:12:48.0381289Z config/rbac/submariner-globalnet/role.yaml
2021-07-19T00:12:48.0384403Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-19T00:12:48.0389183Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-19T00:12:48.0391828Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-19T00:12:48.0394224Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-19T00:12:48.0399365Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-19T00:12:48.0403527Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-19T00:12:48.0409969Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-19T00:12:48.0411521Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-19T00:12:48.0414233Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-19T00:12:48.0416676Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-19T00:12:48.0421697Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-19T00:12:48.0425088Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-19T00:12:48.0428491Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-19T00:12:48.0431408Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-19T00:12:48.0458275Z                 Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T00:12:48.0459301Z               Must remake target 'generate-embeddedyamls'.
2021-07-19T00:12:48.0460285Z               Successfully remade target file 'generate-embeddedyamls'.
2021-07-19T00:12:48.0461217Z             Must remake target 'bin/submariner-operator'.
2021-07-19T00:12:48.0461818Z /opt/shipyard/scripts/compile.sh \
2021-07-19T00:12:48.0462861Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-19T00:12:48.0463851Z bin/submariner-operator main.go 
2021-07-19T00:12:48.0990482Z [submariner-operator]$ mkdir -p bin
2021-07-19T00:12:48.1008377Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-19T00:12:48.1021844Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-19T00:12:48.1033895Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-19T00:14:08.7344281Z [submariner-operator]$ upx bin/submariner-operator
2021-07-19T00:14:13.6878392Z                        Ultimate Packer for eXecutables
2021-07-19T00:14:13.6880150Z                           Copyright (C) 1996 - 2020
2021-07-19T00:14:13.6881037Z UPX 3.96        Markus Oberhumer, Laszlo Molnar & John Reiser   Jan 23rd 2020
2021-07-19T00:14:13.6881672Z 
2021-07-19T00:14:13.6882260Z         File size         Ratio      Format      Name
2021-07-19T00:14:13.6883228Z    --------------------   ------   -----------   -----------
2021-07-19T00:14:13.6884025Z   34459648 ->   9933112   28.83%   linux/amd64   submariner-operator
2021-07-19T00:14:13.6884408Z 
2021-07-19T00:14:13.6884724Z Packed 1 file.
2021-07-19T00:14:13.6890059Z             Successfully remade target file 'bin/submariner-operator'.
2021-07-19T00:14:13.6891427Z            Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-19T00:14:13.6892807Z           Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-19T00:14:13.6895905Z           Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-19T00:14:13.6897341Z            File 'FORCE_IMAGE' does not exist.
2021-07-19T00:14:13.6898064Z           Must remake target 'FORCE_IMAGE'.
2021-07-19T00:14:13.6898743Z           Successfully remade target file 'FORCE_IMAGE'.
2021-07-19T00:14:13.6899628Z         Must remake target 'package/.image.submariner-operator'.
2021-07-19T00:14:13.6901187Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator 
2021-07-19T00:14:13.7366807Z flags:WARN flag short name (h) already defined
2021-07-19T00:14:13.7908490Z [submariner-operator]$ set -e
2021-07-19T00:14:13.7918859Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:13.7927988Z [submariner-operator]$ cache_flag=
2021-07-19T00:14:13.7940597Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:13.7956701Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:14.0479810Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:14.5300981Z devel: Pulling from submariner/submariner-operator
2021-07-19T00:14:14.5309056Z 9aabc6bb514c: Pulling fs layer
2021-07-19T00:14:14.7157870Z 9aabc6bb514c: Verifying Checksum
2021-07-19T00:14:14.7158482Z 9aabc6bb514c: Download complete
2021-07-19T00:14:14.9033149Z 9aabc6bb514c: Pull complete
2021-07-19T00:14:14.9075118Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-19T00:14:14.9090822Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:14.9127025Z quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:14.9169050Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-19T00:14:14.9170117Z [submariner-operator]$ cut -f2 -d 
2021-07-19T00:14:14.9197127Z [submariner-operator]$ grep -v scratch
2021-07-19T00:14:14.9227476Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-19T00:14:14.9237540Z 
2021-07-19T00:14:15.6383844Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-19T00:14:16.3641957Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-19T00:14:16.3684869Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-19T00:14:17.0804457Z buildx_builder
2021-07-19T00:14:17.0855583Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-19T00:14:17.7974417Z #1 [internal] booting buildkit
2021-07-19T00:14:17.7975620Z #1 sha256:ddc79b51c9b1ec23e4ae36d56d57dc3d541fa7c9854f2888daf9689c6fb03289
2021-07-19T00:14:17.9478021Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-19T00:14:21.4005784Z #1 pulling image moby/buildkit:buildx-stable-1 3.5s done
2021-07-19T00:14:21.4007590Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-19T00:14:21.8130746Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-19T00:14:21.9629706Z #1 DONE 4.0s
2021-07-19T00:14:22.0647617Z 
2021-07-19T00:14:22.0649556Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-19T00:14:22.0650944Z #2 sha256:5cfe1b57537cbd3f8490eacb0f99505ca09ab67f9251491c4e7f66bd35005f89
2021-07-19T00:14:22.0651945Z #2 transferring dockerfile: 230B 0.0s done
2021-07-19T00:14:22.0652453Z #2 DONE 0.0s
2021-07-19T00:14:22.0660163Z 
2021-07-19T00:14:22.0660696Z #3 [internal] load .dockerignore
2021-07-19T00:14:22.0661701Z #3 sha256:ef2658c30bc58a86fae8ddd0440f0e837781db82063b323eb6d48a1781b948de
2021-07-19T00:14:22.0662816Z #3 transferring context: 2B done
2021-07-19T00:14:22.0663297Z #3 DONE 0.0s
2021-07-19T00:14:22.0663541Z 
2021-07-19T00:14:22.0664559Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:22.0665827Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-19T00:14:22.2155396Z #6 ...
2021-07-19T00:14:22.2155826Z 
2021-07-19T00:14:22.2156277Z #4 [internal] load build context
2021-07-19T00:14:22.2157247Z #4 sha256:9cc739dbc1172549bccbba0c3cb90adf5c076290a225274804727262d60740ef
2021-07-19T00:14:22.2158164Z #4 DONE 0.0s
2021-07-19T00:14:22.3653112Z 
2021-07-19T00:14:22.3654666Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:22.3656051Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-19T00:14:22.5171755Z #6 DONE 0.3s
2021-07-19T00:14:22.5182286Z 
2021-07-19T00:14:22.5185230Z #4 [internal] load build context
2021-07-19T00:14:22.5186181Z #4 sha256:9cc739dbc1172549bccbba0c3cb90adf5c076290a225274804727262d60740ef
2021-07-19T00:14:22.6198425Z #4 transferring context: 9.94MB 0.2s done
2021-07-19T00:14:22.6238769Z #4 DONE 0.2s
2021-07-19T00:14:22.6239021Z 
2021-07-19T00:14:22.6240173Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T00:14:22.6241116Z #5 sha256:5f8c753924b426f1b72378d6624a80076207cb4670de467f51cddad47055fbad
2021-07-19T00:14:22.6241772Z #5 CACHED
2021-07-19T00:14:22.6241991Z 
2021-07-19T00:14:22.6242363Z #7 exporting to oci image format
2021-07-19T00:14:22.6243288Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T00:14:22.6244178Z #7 exporting layers done
2021-07-19T00:14:22.6245203Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-19T00:14:22.6246889Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-19T00:14:22.9202398Z #7 ...
2021-07-19T00:14:22.9202800Z 
2021-07-19T00:14:22.9204088Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T00:14:22.9205167Z #5 sha256:5f8c753924b426f1b72378d6624a80076207cb4670de467f51cddad47055fbad
2021-07-19T00:14:22.9206835Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 1.05MB / 9.62MB 0.2s
2021-07-19T00:14:22.9207865Z #5 CACHED
2021-07-19T00:14:23.0702474Z 
2021-07-19T00:14:23.0704320Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T00:14:23.0705469Z #5 sha256:5f8c753924b426f1b72378d6624a80076207cb4670de467f51cddad47055fbad
2021-07-19T00:14:23.0706874Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 5.24MB / 9.62MB 0.3s
2021-07-19T00:14:23.0707883Z #5 CACHED
2021-07-19T00:14:23.0708205Z 
2021-07-19T00:14:23.0708595Z #7 exporting to oci image format
2021-07-19T00:14:23.0709609Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T00:14:23.2256809Z #7 ...
2021-07-19T00:14:23.2257322Z 
2021-07-19T00:14:23.2259134Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T00:14:23.2260343Z #5 sha256:5f8c753924b426f1b72378d6624a80076207cb4670de467f51cddad47055fbad
2021-07-19T00:14:23.2261690Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.5s done
2021-07-19T00:14:23.2262680Z #5 CACHED
2021-07-19T00:14:23.2262923Z 
2021-07-19T00:14:23.2263522Z #7 exporting to oci image format
2021-07-19T00:14:23.2264751Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T00:14:23.2265928Z #7 sending tarball
2021-07-19T00:14:23.3857111Z #7 sending tarball 0.3s done
2021-07-19T00:14:23.3857916Z #7 DONE 0.8s
2021-07-19T00:14:23.3858205Z 
2021-07-19T00:14:23.3858652Z #9 exporting cache
2021-07-19T00:14:23.3859580Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-19T00:14:23.3860841Z #9 preparing build cache for export done
2021-07-19T00:14:23.3861472Z #9 DONE 0.0s
2021-07-19T00:14:23.3861798Z 
2021-07-19T00:14:23.3862159Z #8 importing to docker
2021-07-19T00:14:23.3863105Z #8 sha256:e8e4eb79d722f4eac3f85ba02673943a7db090a773ae9d7d82830ec49a882504
2021-07-19T00:14:23.3864105Z #8 DONE 0.0s
2021-07-19T00:14:23.3976788Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-19T00:14:23.6413219Z         Successfully remade target file 'package/.image.submariner-operator'.
2021-07-19T00:14:23.6414158Z          File 'build' does not exist.
2021-07-19T00:14:23.6414780Z            File 'bin/subctl' does not exist.
2021-07-19T00:14:23.6415658Z              File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-19T00:14:23.6619066Z             Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T00:14:23.6619852Z mkdir -p bin
2021-07-19T00:14:23.6642799Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-19T00:14:23.6643448Z target=${target%.exe}; \
2021-07-19T00:14:23.6644040Z components=($(echo ${target//-/ })); \
2021-07-19T00:14:23.6644862Z GOOS=${components[-2]}; \
2021-07-19T00:14:23.6645523Z GOARCH=${components[-1]}; \
2021-07-19T00:14:23.6645934Z export GOARCH GOOS; \
2021-07-19T00:14:23.6646764Z /opt/shipyard/scripts/compile.sh \
2021-07-19T00:14:23.6647818Z 	--ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-19T00:14:23.6649551Z 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-19T00:14:23.6651297Z 	--noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go 
2021-07-19T00:14:23.7258190Z [submariner-operator]$ mkdir -p bin
2021-07-19T00:14:23.7273328Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-19T00:14:23.7289184Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-19T00:14:23.7303829Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d 		   -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-19T00:14:54.7111437Z             Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T00:14:54.7112919Z           Must remake target 'bin/subctl'.
2021-07-19T00:14:54.7113994Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-19T00:14:54.7139684Z           Successfully remade target file 'bin/subctl'.
2021-07-19T00:14:54.7140597Z         Must remake target 'build'.
2021-07-19T00:14:54.7141385Z         Successfully remade target file 'build'.
2021-07-19T00:14:54.7142186Z       Must remake target 'images'.
2021-07-19T00:14:54.7142971Z       Successfully remade target file 'images'.
2021-07-19T00:14:54.7146329Z     Must remake target 'preload-images'.
2021-07-19T00:14:54.7147090Z set -e;\
2021-07-19T00:14:54.7147635Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-19T00:14:54.7148308Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-19T00:14:54.7150412Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns submariner-globalnet; do\
2021-07-19T00:14:54.7151755Z 	import_image quay.io/submariner/${image};\
2021-07-19T00:14:54.7152271Z done
2021-07-19T00:14:54.7196432Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-19T00:14:54.7207194Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-19T00:14:54.7222550Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-19T00:14:54.9716974Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-19T00:14:55.2205268Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-19T00:14:55.2543088Z f9269f9cee12: Preparing
2021-07-19T00:14:55.7756368Z f9269f9cee12: Pushed
2021-07-19T00:14:55.7929614Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-19T00:14:55.7964906Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-19T00:14:55.7976992Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-19T00:14:55.7982683Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-19T00:14:56.0341822Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-19T00:14:56.0362625Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-19T00:14:56.5266967Z devel: Pulling from submariner/submariner-gateway
2021-07-19T00:14:56.5267787Z 8c741e919b67: Pulling fs layer
2021-07-19T00:14:56.5268231Z 13495efbbac4: Pulling fs layer
2021-07-19T00:14:56.5268673Z 6df6df193f2d: Pulling fs layer
2021-07-19T00:14:56.5269137Z 3afbe9ee7387: Pulling fs layer
2021-07-19T00:14:56.5269571Z 3afbe9ee7387: Waiting
2021-07-19T00:14:56.6109728Z 13495efbbac4: Verifying Checksum
2021-07-19T00:14:56.6110395Z 13495efbbac4: Download complete
2021-07-19T00:14:56.7623517Z 6df6df193f2d: Verifying Checksum
2021-07-19T00:14:56.7624223Z 6df6df193f2d: Download complete
2021-07-19T00:14:56.7866670Z 3afbe9ee7387: Verifying Checksum
2021-07-19T00:14:56.7867487Z 3afbe9ee7387: Download complete
2021-07-19T00:14:57.1128656Z 8c741e919b67: Verifying Checksum
2021-07-19T00:14:57.1129184Z 8c741e919b67: Download complete
2021-07-19T00:14:59.5624399Z 8c741e919b67: Pull complete
2021-07-19T00:15:00.7157238Z 13495efbbac4: Pull complete
2021-07-19T00:15:01.7121054Z 6df6df193f2d: Pull complete
2021-07-19T00:15:01.8756323Z 3afbe9ee7387: Pull complete
2021-07-19T00:15:01.9049625Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-19T00:15:01.9074441Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-19T00:15:01.9078466Z quay.io/submariner/submariner-gateway:devel
2021-07-19T00:15:01.9106472Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-19T00:15:02.1740194Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-19T00:15:02.4146460Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-19T00:15:02.6525276Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-19T00:15:02.6578092Z 71972a942ed4: Preparing
2021-07-19T00:15:02.6578646Z 3c7f2d60eacb: Preparing
2021-07-19T00:15:02.6579096Z 00c5f6897675: Preparing
2021-07-19T00:15:02.6579510Z b3b62c837788: Preparing
2021-07-19T00:15:03.1942292Z 00c5f6897675: Pushed
2021-07-19T00:15:03.7723546Z 71972a942ed4: Pushed
2021-07-19T00:15:06.5501753Z 3c7f2d60eacb: Pushed
2021-07-19T00:15:13.0703164Z b3b62c837788: Pushed
2021-07-19T00:15:13.0865425Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-19T00:15:13.0900708Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-19T00:15:13.0914314Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-19T00:15:13.0918827Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-19T00:15:13.3283480Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-19T00:15:13.3305333Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-19T00:15:13.8383231Z devel: Pulling from submariner/submariner-route-agent
2021-07-19T00:15:13.8388363Z 8c741e919b67: Already exists
2021-07-19T00:15:13.8404984Z 13495efbbac4: Already exists
2021-07-19T00:15:13.8421093Z 70cc6422093d: Pulling fs layer
2021-07-19T00:15:13.8421952Z 7ba74d821748: Pulling fs layer
2021-07-19T00:15:13.8422426Z 62b0802bcf90: Pulling fs layer
2021-07-19T00:15:13.8424905Z 3e9c83283ee4: Pulling fs layer
2021-07-19T00:15:13.8425517Z 3e9c83283ee4: Waiting
2021-07-19T00:15:14.7387099Z 62b0802bcf90: Verifying Checksum
2021-07-19T00:15:14.7387738Z 62b0802bcf90: Download complete
2021-07-19T00:15:14.7389809Z 7ba74d821748: Verifying Checksum
2021-07-19T00:15:14.7390285Z 7ba74d821748: Download complete
2021-07-19T00:15:14.7390766Z 3e9c83283ee4: Verifying Checksum
2021-07-19T00:15:14.7391239Z 3e9c83283ee4: Download complete
2021-07-19T00:15:14.7391715Z 70cc6422093d: Verifying Checksum
2021-07-19T00:15:14.7392163Z 70cc6422093d: Download complete
2021-07-19T00:15:15.3688554Z 70cc6422093d: Pull complete
2021-07-19T00:15:15.5140314Z 7ba74d821748: Pull complete
2021-07-19T00:15:15.5873742Z 62b0802bcf90: Pull complete
2021-07-19T00:15:15.6512195Z 3e9c83283ee4: Pull complete
2021-07-19T00:15:15.6543206Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-19T00:15:15.6562984Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-19T00:15:15.6587571Z quay.io/submariner/submariner-route-agent:devel
2021-07-19T00:15:15.6649504Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-19T00:15:15.9017466Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-19T00:15:16.1409662Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-19T00:15:16.3825868Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-19T00:15:16.3919722Z 1d810a4c0610: Preparing
2021-07-19T00:15:16.3920178Z 7a86b74623fc: Preparing
2021-07-19T00:15:16.3920583Z 26de773c4486: Preparing
2021-07-19T00:15:16.3921000Z 6931e591f8e2: Preparing
2021-07-19T00:15:16.3921388Z 00c5f6897675: Preparing
2021-07-19T00:15:16.3921799Z b3b62c837788: Preparing
2021-07-19T00:15:16.3922184Z b3b62c837788: Waiting
2021-07-19T00:15:16.9498360Z 00c5f6897675: Mounted from submariner-gateway
2021-07-19T00:15:16.9522881Z 1d810a4c0610: Pushed
2021-07-19T00:15:16.9612623Z 7a86b74623fc: Pushed
2021-07-19T00:15:16.9662714Z 26de773c4486: Pushed
2021-07-19T00:15:16.9743183Z b3b62c837788: Mounted from submariner-gateway
2021-07-19T00:15:20.3305603Z 6931e591f8e2: Pushed
2021-07-19T00:15:20.3547133Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-19T00:15:20.3585046Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-19T00:15:20.3598394Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-19T00:15:20.3614252Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-19T00:15:20.6001141Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-19T00:15:20.6022377Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-19T00:15:21.1049908Z devel: Pulling from submariner/lighthouse-agent
2021-07-19T00:15:21.1050644Z ecd69139dc76: Pulling fs layer
2021-07-19T00:15:21.1051079Z 8261c1767de3: Pulling fs layer
2021-07-19T00:15:21.1961904Z ecd69139dc76: Download complete
2021-07-19T00:15:21.2510854Z 8261c1767de3: Verifying Checksum
2021-07-19T00:15:21.2511414Z 8261c1767de3: Download complete
2021-07-19T00:15:21.2947237Z ecd69139dc76: Pull complete
2021-07-19T00:15:21.4393539Z 8261c1767de3: Pull complete
2021-07-19T00:15:21.4428532Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-19T00:15:21.4443509Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-19T00:15:21.4472616Z quay.io/submariner/lighthouse-agent:devel
2021-07-19T00:15:21.4494405Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-19T00:15:21.6949144Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-19T00:15:21.9361688Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-19T00:15:22.1820451Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-19T00:15:22.1859394Z 83c79e393e11: Preparing
2021-07-19T00:15:22.1867992Z 0026d2f62bbf: Preparing
2021-07-19T00:15:22.2447249Z 0026d2f62bbf: Pushed
2021-07-19T00:15:22.6363819Z 83c79e393e11: Pushed
2021-07-19T00:15:22.6520954Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-19T00:15:22.6561310Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-19T00:15:22.6570916Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-19T00:15:22.6575228Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-19T00:15:22.8993579Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-19T00:15:22.9014944Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-19T00:15:23.4027505Z devel: Pulling from submariner/lighthouse-coredns
2021-07-19T00:15:23.4028330Z 088e56360f76: Pulling fs layer
2021-07-19T00:15:23.4028822Z 18aed70882d2: Pulling fs layer
2021-07-19T00:15:23.5058072Z 088e56360f76: Verifying Checksum
2021-07-19T00:15:23.5058884Z 088e56360f76: Download complete
2021-07-19T00:15:23.5943864Z 18aed70882d2: Verifying Checksum
2021-07-19T00:15:23.5944426Z 18aed70882d2: Download complete
2021-07-19T00:15:23.6131839Z 088e56360f76: Pull complete
2021-07-19T00:15:23.8184541Z 18aed70882d2: Pull complete
2021-07-19T00:15:23.8214839Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-19T00:15:23.8233450Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-19T00:15:23.8263396Z quay.io/submariner/lighthouse-coredns:devel
2021-07-19T00:15:23.8292093Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-19T00:15:24.0677223Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-19T00:15:24.3072521Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-19T00:15:24.5432271Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-19T00:15:24.5479177Z 7fca351e51be: Preparing
2021-07-19T00:15:24.5479939Z 4fa0ece06e25: Preparing
2021-07-19T00:15:24.5926233Z 4fa0ece06e25: Pushed
2021-07-19T00:15:25.2169486Z 7fca351e51be: Pushed
2021-07-19T00:15:25.2373009Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-19T00:15:25.2406203Z [submariner-operator]$ import_image quay.io/submariner/submariner-globalnet
2021-07-19T00:15:25.2416253Z [submariner-operator]$ import_image quay.io/submariner/submariner-globalnet
2021-07-19T00:15:25.2427984Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local
2021-07-19T00:15:25.4783540Z Error response from daemon: No such image: quay.io/submariner/submariner-globalnet:dev
2021-07-19T00:15:25.4804619Z [submariner-operator]$ docker pull quay.io/submariner/submariner-globalnet:devel
2021-07-19T00:15:25.9931380Z devel: Pulling from submariner/submariner-globalnet
2021-07-19T00:15:25.9932267Z 8c741e919b67: Already exists
2021-07-19T00:15:25.9947166Z 13495efbbac4: Already exists
2021-07-19T00:15:25.9963141Z bb77c1f3f2df: Pulling fs layer
2021-07-19T00:15:25.9963795Z 8d0ffdb5918e: Pulling fs layer
2021-07-19T00:15:25.9964275Z bcf8fc53d486: Pulling fs layer
2021-07-19T00:15:25.9964713Z 218c178ba1a9: Pulling fs layer
2021-07-19T00:15:25.9965126Z 218c178ba1a9: Waiting
2021-07-19T00:15:26.0769746Z bcf8fc53d486: Verifying Checksum
2021-07-19T00:15:26.0770338Z bcf8fc53d486: Download complete
2021-07-19T00:15:26.1474444Z bb77c1f3f2df: Verifying Checksum
2021-07-19T00:15:26.1475255Z bb77c1f3f2df: Download complete
2021-07-19T00:15:26.1826817Z 218c178ba1a9: Verifying Checksum
2021-07-19T00:15:26.1827534Z 218c178ba1a9: Download complete
2021-07-19T00:15:26.2120671Z 8d0ffdb5918e: Verifying Checksum
2021-07-19T00:15:26.2121240Z 8d0ffdb5918e: Download complete
2021-07-19T00:15:26.7123761Z bb77c1f3f2df: Pull complete
2021-07-19T00:15:26.8699796Z 8d0ffdb5918e: Pull complete
2021-07-19T00:15:26.9329668Z bcf8fc53d486: Pull complete
2021-07-19T00:15:27.0230144Z 218c178ba1a9: Pull complete
2021-07-19T00:15:27.0262903Z Digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69
2021-07-19T00:15:27.0281459Z Status: Downloaded newer image for quay.io/submariner/submariner-globalnet:devel
2021-07-19T00:15:27.0306279Z quay.io/submariner/submariner-globalnet:devel
2021-07-19T00:15:27.0328916Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:devel quay.io/submariner/submariner-globalnet:dev
2021-07-19T00:15:27.2805822Z [submariner-operator]$ docker tag quay.io/submariner/submariner-globalnet:dev localhost:5000/submariner-globalnet:local
2021-07-19T00:15:27.5220129Z [submariner-operator]$ docker push localhost:5000/submariner-globalnet:local
2021-07-19T00:15:27.7653275Z The push refers to repository [localhost:5000/submariner-globalnet]
2021-07-19T00:15:27.7672826Z a395ed568a2f: Preparing
2021-07-19T00:15:27.7673371Z 39ac285976a0: Preparing
2021-07-19T00:15:27.7674149Z de48a84fa0cb: Preparing
2021-07-19T00:15:27.7674586Z 70c3bf07b5e8: Preparing
2021-07-19T00:15:27.7675002Z 00c5f6897675: Preparing
2021-07-19T00:15:27.7677825Z b3b62c837788: Preparing
2021-07-19T00:15:27.7678322Z b3b62c837788: Waiting
2021-07-19T00:15:27.7778332Z 00c5f6897675: Mounted from submariner-route-agent
2021-07-19T00:15:28.1342327Z a395ed568a2f: Pushed
2021-07-19T00:15:28.1344078Z b3b62c837788: Mounted from submariner-route-agent
2021-07-19T00:15:28.3712765Z 39ac285976a0: Pushed
2021-07-19T00:15:28.3804711Z de48a84fa0cb: Pushed
2021-07-19T00:15:29.1187070Z 70c3bf07b5e8: Pushed
2021-07-19T00:15:29.1350742Z local: digest: sha256:623e38998e0624d9a74f0c3638833e968ba472ef2ae235b724a67de11f113a69 size: 1574
2021-07-19T00:15:29.1389120Z     Successfully remade target file 'preload-images'.
2021-07-19T00:15:29.1390066Z    Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-19T00:15:29.1390971Z    Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-19T00:15:29.1391855Z    Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-19T00:15:29.1392547Z   Must remake target 'deploy'.
2021-07-19T00:15:29.1393755Z /opt/shipyard/scripts/deploy.sh --globalnet --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T00:15:29.2252448Z Running with: globalnet='true', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-19T00:15:29.2276712Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T00:15:29.2299304Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:15:29.2309030Z [submariner-operator]$ script_name=utils
2021-07-19T00:15:29.2319550Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T00:15:29.2340973Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-19T00:15:29.2351698Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:15:29.2370638Z [submariner-operator]$ script_name=deploy_funcs
2021-07-19T00:15:29.2381079Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T00:15:29.2401226Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T00:15:29.2422373Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:15:29.2432031Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:15:29.2441721Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T00:15:29.2459419Z [submariner-operator]$ broker=cluster1
2021-07-19T00:15:29.2468992Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T00:15:29.2480897Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T00:15:29.2494451Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T00:15:29.2505794Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T00:15:29.2516941Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T00:15:29.2530132Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T00:15:29.2541566Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T00:15:29.2552379Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T00:15:29.2562890Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T00:15:29.2574383Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T00:15:29.2585432Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T00:15:29.2598636Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T00:15:29.2610712Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:15:29.2622097Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:15:29.2633593Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T00:15:29.2653026Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T00:15:29.2664872Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T00:15:29.2691214Z [submariner-operator]$ declare_cidrs
2021-07-19T00:15:29.2701864Z [submariner-operator]$ declare_cidrs
2021-07-19T00:15:29.2712794Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T00:15:29.2723759Z [submariner-operator]$ i=1
2021-07-19T00:15:29.2736342Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:15:29.2748806Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:15:29.2761965Z [submariner-operator]$ [cluster1] val=0
2021-07-19T00:15:29.2773885Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-19T00:15:29.2785823Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-19T00:15:29.2798810Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-19T00:15:29.2812018Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T00:15:29.2824906Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:15:29.2836644Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:15:29.2853116Z [submariner-operator]$ [cluster2] val=0
2021-07-19T00:15:29.2865049Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-19T00:15:29.2877713Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-19T00:15:29.2890991Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-19T00:15:29.2919695Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T00:15:29.2931272Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T00:15:29.2942579Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T00:15:29.2957985Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-19T00:15:29.2975510Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-19T00:15:29.2986874Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-19T00:15:29.3002751Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-19T00:15:29.3035521Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-19T00:15:29.4322844Z Installing subctl version devel
2021-07-19T00:15:29.4323680Z   OS detected:           linux
2021-07-19T00:15:29.4324135Z   Architecture detected: amd64
2021-07-19T00:15:29.4330266Z   Download URL:          https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-19T00:15:29.4331230Z 
2021-07-19T00:15:29.4331601Z Downloading...
2021-07-19T00:15:30.3561102Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-19T00:15:30.3744111Z This provides subctl version: devel
2021-07-19T00:15:30.3759330Z 
2021-07-19T00:15:30.3760923Z please update your path (and consider adding it to ~/.profile):
2021-07-19T00:15:30.3761529Z     export PATH=$PATH:/go/bin
2021-07-19T00:15:30.3761880Z     
2021-07-19T00:15:30.3857431Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T00:15:30.3870591Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T00:15:30.3874496Z Will deploy submariner using operator
2021-07-19T00:15:30.3884431Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-19T00:15:30.3900708Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:15:30.3913564Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-19T00:15:30.3925824Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-19T00:15:30.3946103Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T00:15:30.3958285Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T00:15:30.3971405Z 
2021-07-19T00:15:30.3984396Z [submariner-operator]$ [cluster2] subctl version
2021-07-19T00:15:30.4206071Z subctl version: devel-0105e4d
2021-07-19T00:15:30.4240978Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T00:15:30.4249770Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T00:15:30.4261589Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-19T00:15:30.4274579Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T00:15:30.4298034Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:15:30.4310145Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T00:15:30.4322219Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T00:15:30.4333885Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T00:15:30.4369936Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-19T00:15:30.4379914Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-19T00:15:30.4392403Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T00:15:30.4410244Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T00:15:30.4429671Z [submariner-operator]$ [cluster1] pids[cluster1]=7232
2021-07-19T00:15:30.4435970Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T00:15:30.4450430Z [submariner-operator]$ [cluster2] pids[cluster2]=7235
2021-07-19T00:15:30.4453240Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T00:15:30.4466780Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T00:15:30.4475664Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T00:15:30.4476590Z [submariner-operator]$ [cluster2] wait 7235
2021-07-19T00:15:30.4489262Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T00:15:30.4509792Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T00:15:30.7872522Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T00:15:30.7874035Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T00:15:30.7876642Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T00:15:30.7878093Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.7879521Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.7881048Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.7882198Z [cluster1] node/cluster1-worker labeled
2021-07-19T00:15:30.8148318Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T00:15:30.8149287Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T00:15:30.8150208Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T00:15:30.8151399Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.8152820Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.8154487Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T00:15:30.8155624Z [cluster2] node/cluster2-worker labeled
2021-07-19T00:15:30.8167977Z [submariner-operator]$ [cluster2] wait 7232
2021-07-19T00:15:30.8179221Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T00:15:30.8189030Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T00:15:30.8199812Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T00:15:30.8209661Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T00:15:30.8221235Z [submariner-operator]$ [cluster1] gn=--globalnet
2021-07-19T00:15:30.8224963Z Installing broker...
2021-07-19T00:15:30.8237358Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T00:15:30.8256096Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-19T00:15:30.8293008Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-19T00:15:30.8304381Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local --globalnet
2021-07-19T00:15:30.8509324Z  • Setting up broker RBAC  ...
2021-07-19T00:15:30.9193715Z  ✓ Setting up broker RBAC
2021-07-19T00:15:30.9198206Z  • Deploying the Submariner operator  ...
2021-07-19T00:15:42.1209707Z  ✓ Deploying the Submariner operator
2021-07-19T00:15:42.1210847Z  ✓ Created operator CRDs
2021-07-19T00:15:42.1211740Z  ✓ Created operator namespace: submariner-operator
2021-07-19T00:15:42.1212692Z  ✓ Created operator service account and role
2021-07-19T00:15:42.1213555Z  ✓ Created lighthouse service account and role
2021-07-19T00:15:42.1214525Z  ✓ Created Lighthouse service accounts and roles
2021-07-19T00:15:42.1215382Z  ✓ Deployed the operator successfully
2021-07-19T00:15:42.1216130Z  • Deploying the broker  ...
2021-07-19T00:15:42.1294567Z  ✓ Deploying the broker
2021-07-19T00:15:42.1295241Z  ✓ The broker has been deployed
2021-07-19T00:15:42.1295905Z  • Creating broker-info.subm file  ...
2021-07-19T00:15:42.1371704Z  ✓ Creating broker-info.subm file
2021-07-19T00:15:42.1391808Z  ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-19T00:15:42.1438015Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T00:15:42.1452348Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T00:15:42.1464736Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T00:15:42.1475748Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T00:15:42.1484972Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T00:15:42.1514419Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-19T00:15:42.1524176Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-19T00:15:42.1601905Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T00:15:42.1618587Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T00:15:42.1637143Z [submariner-operator]$ [cluster1] pids[cluster1]=7298
2021-07-19T00:15:42.1660105Z [submariner-operator]$ [cluster2] pids[cluster2]=7300
2021-07-19T00:15:42.1667085Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T00:15:42.1689065Z [submariner-operator]$ [cluster2] wait 7300
2021-07-19T00:15:42.1693136Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T00:15:42.1698949Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T00:15:42.1711129Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T00:15:42.1718311Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T00:15:42.1730666Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T00:15:49.2050876Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T00:15:49.2052437Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T00:15:49.2053708Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-19T00:15:49.2054914Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-19T00:15:49.2057705Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.1.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T00:15:49.2060596Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-19T00:15:49.2061875Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-19T00:15:49.2062760Z [cluster1]   - cluster1-worker
2021-07-19T00:15:49.2063872Z [cluster1]  • Discovering network details  ...
2021-07-19T00:15:49.2064736Z [cluster1]         Network plugin:  weave-net
2021-07-19T00:15:49.2065387Z [cluster1]         Service CIDRs:   [100.0.0.0/16]
2021-07-19T00:15:49.2065970Z [cluster1]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-19T00:15:49.2066758Z [cluster1]  ✓ Discovering network details
2021-07-19T00:15:49.2067606Z [cluster1]  • Discovering multi cluster details  ...
2021-07-19T00:15:49.2068527Z [cluster1]  • Validating Globalnet configurations  ...
2021-07-19T00:15:49.2069497Z [cluster1]  ✓ Validating Globalnet configurations
2021-07-19T00:15:49.2070443Z [cluster1]  • Assigning Globalnet IPs  ...
2021-07-19T00:15:49.2071280Z [cluster1]  ✓ Assigning Globalnet IPs
2021-07-19T00:15:49.2072051Z [cluster1]  ✓ GlobalCIDR is: 242.254.1.0/24
2021-07-19T00:15:49.2074484Z [cluster1]  ✓ Discovering multi cluster details
2021-07-19T00:15:49.2075252Z [cluster1]  • Deploying the Submariner operator  ...
2021-07-19T00:15:49.2076016Z [cluster1]  ✓ Deploying the Submariner operator
2021-07-19T00:15:49.2076841Z [cluster1]  ✓ Created Lighthouse service accounts and roles
2021-07-19T00:15:49.2077572Z [cluster1]  • Creating SA for cluster  ...
2021-07-19T00:15:49.2078193Z [cluster1]  ✓ Creating SA for cluster
2021-07-19T00:15:49.2078835Z [cluster1]  • Deploying Submariner  ...
2021-07-19T00:15:49.2079478Z [cluster1]  ✓ Deploying Submariner
2021-07-19T00:15:49.2080135Z [cluster1]  ✓ Submariner is up and running
2021-07-19T00:15:55.6306207Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T00:15:55.6307570Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-19T00:15:55.6308664Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-19T00:15:55.6309713Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-19T00:15:55.6312414Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr 242.254.2.0/24 --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T00:15:55.6315157Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-19T00:15:55.6316174Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-19T00:15:55.6316862Z [cluster2]   - cluster2-worker
2021-07-19T00:15:55.6317578Z [cluster2]  • Discovering network details  ...
2021-07-19T00:15:55.6318505Z [cluster2]         Network plugin:  weave-net
2021-07-19T00:15:55.6319041Z [cluster2]         Service CIDRs:   [100.0.0.0/16]
2021-07-19T00:15:55.6319517Z [cluster2]         Cluster CIDRs:   [10.0.0.0/16]
2021-07-19T00:15:55.6320190Z [cluster2]  ✓ Discovering network details
2021-07-19T00:15:55.6320907Z [cluster2]  • Discovering multi cluster details  ...
2021-07-19T00:15:55.6321725Z [cluster2]  • Validating Globalnet configurations  ...
2021-07-19T00:15:55.6322542Z [cluster2]  ✓ Validating Globalnet configurations
2021-07-19T00:15:55.6323257Z [cluster2]  • Assigning Globalnet IPs  ...
2021-07-19T00:15:55.6323919Z [cluster2]  ✓ Assigning Globalnet IPs
2021-07-19T00:15:55.6324554Z [cluster2]  ✓ GlobalCIDR is: 242.254.2.0/24
2021-07-19T00:15:55.6325233Z [cluster2]  ✓ Discovering multi cluster details
2021-07-19T00:15:55.6325972Z [cluster2]  • Deploying the Submariner operator  ...
2021-07-19T00:15:55.6326859Z [cluster2]  ✓ Deploying the Submariner operator
2021-07-19T00:15:55.6327533Z [cluster2]  ✓ Created operator CRDs
2021-07-19T00:15:55.6328353Z [cluster2]  ✓ Created operator namespace: submariner-operator
2021-07-19T00:15:55.6329225Z [cluster2]  ✓ Created operator service account and role
2021-07-19T00:15:55.6330009Z [cluster2]  ✓ Created lighthouse service account and role
2021-07-19T00:15:55.6330827Z [cluster2]  ✓ Created Lighthouse service accounts and roles
2021-07-19T00:15:55.6331771Z [cluster2]  ✓ Deployed the operator successfully
2021-07-19T00:15:55.6332503Z [cluster2]  • Creating SA for cluster  ...
2021-07-19T00:15:55.6333127Z [cluster2]  ✓ Creating SA for cluster
2021-07-19T00:15:55.6333773Z [cluster2]  • Deploying Submariner  ...
2021-07-19T00:15:55.6334412Z [cluster2]  ✓ Deploying Submariner
2021-07-19T00:15:55.6335073Z [cluster2]  ✓ Submariner is up and running
2021-07-19T00:15:55.6371313Z [submariner-operator]$ [cluster2] wait 7298
2021-07-19T00:15:55.6394243Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T00:15:55.6408069Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T00:15:55.6423164Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-19T00:15:55.6434818Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T00:15:55.6459658Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:15:55.6543110Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:15:55.6555120Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:15:55.6575484Z [submariner-operator]$ [cluster2] wait 7341
2021-07-19T00:15:55.6601662Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:15:55.6617256Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:15:55.6641426Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:15:57.0908309Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:15:57.0932774Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:15:57.4894875Z  • Showing Connections  ...
2021-07-19T00:15:57.6726144Z  ✗ Showing Connections
2021-07-19T00:15:57.6726956Z  ✗ There are no gateways detected
2021-07-19T00:15:57.6781445Z  • Showing Connections  ...
2021-07-19T00:15:57.6830190Z  ✗ Showing Connections
2021-07-19T00:15:57.6830805Z  ✗ There are no gateways detected
2021-07-19T00:15:57.6895651Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:15:57.6906552Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:03.6965060Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:03.7012576Z [submariner-operator]$ [cluster2] wait 7369
2021-07-19T00:16:03.7030927Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:03.7052362Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:03.7071141Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:03.7085001Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:03.7120900Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:04.0136605Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:04.0151086Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:04.1317731Z  • Showing Connections  ...
2021-07-19T00:16:04.1478833Z  ✗ Showing Connections
2021-07-19T00:16:04.1479565Z  ✗ There are no gateways detected
2021-07-19T00:16:04.2097447Z  • Showing Connections  ...
2021-07-19T00:16:04.2658157Z  ✗ Showing Connections
2021-07-19T00:16:04.2658850Z  ✗ There are no gateways detected
2021-07-19T00:16:04.2686217Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:16:04.2700447Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:10.2723781Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:10.2773113Z [submariner-operator]$ [cluster2] wait 7396
2021-07-19T00:16:10.2775651Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:10.2785744Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:10.2808987Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:10.2820223Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:10.2834083Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:10.5252656Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:10.5269066Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:11.0419148Z  • Showing Connections  ...
2021-07-19T00:16:11.0592599Z  ✗ Showing Connections
2021-07-19T00:16:11.0593236Z  ✗ No connections found
2021-07-19T00:16:11.4891051Z  • Showing Connections  ...
2021-07-19T00:16:11.5179126Z  ✗ Showing Connections
2021-07-19T00:16:11.5213300Z  ✗ There are no gateways detected
2021-07-19T00:16:11.5292473Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:16:11.5303729Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:17.5328098Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:17.5363708Z [submariner-operator]$ [cluster2] wait 7422
2021-07-19T00:16:17.5368376Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:17.5392785Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:17.5402767Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:17.5427231Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:17.5441489Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:17.6822547Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:17.6843824Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:18.1717714Z  • Showing Connections  ...
2021-07-19T00:16:18.1961880Z  ✗ Showing Connections
2021-07-19T00:16:18.1962507Z  ✗ No connections found
2021-07-19T00:16:18.2276224Z  • Showing Connections  ...
2021-07-19T00:16:18.2475125Z  ✗ Showing Connections
2021-07-19T00:16:18.2475769Z  ✗ There are no gateways detected
2021-07-19T00:16:18.2503667Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:16:18.2514030Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:24.2538302Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:24.2574503Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:24.2593435Z [submariner-operator]$ [cluster2] wait 7449
2021-07-19T00:16:24.2624200Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:24.2637198Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:24.2657210Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:24.2676334Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:24.7879215Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:24.7895127Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:24.8899351Z  • Showing Connections  ...
2021-07-19T00:16:24.8946656Z  ✗ Showing Connections
2021-07-19T00:16:24.8947300Z  ✗ No connections found
2021-07-19T00:16:24.9134816Z  • Showing Connections  ...
2021-07-19T00:16:24.9171519Z  ✗ Showing Connections
2021-07-19T00:16:24.9172268Z  ✗ There are no gateways detected
2021-07-19T00:16:24.9198754Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:16:24.9218393Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:30.9258696Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:30.9291584Z [submariner-operator]$ [cluster2] wait 7475
2021-07-19T00:16:30.9297399Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:30.9309102Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:30.9322663Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:30.9339172Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:30.9355202Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:31.0668887Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:31.0688779Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:31.1611856Z  • Showing Connections  ...
2021-07-19T00:16:31.1674148Z  ✗ Showing Connections
2021-07-19T00:16:31.1685910Z  ✗ No connections found
2021-07-19T00:16:31.2349822Z  • Showing Connections  ...
2021-07-19T00:16:31.2433286Z  ✗ Showing Connections
2021-07-19T00:16:31.2433894Z  ✗ No connections found
2021-07-19T00:16:31.2475916Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-19T00:16:31.2490094Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T00:16:37.2517723Z [submariner-operator]$ [cluster2] return 1
2021-07-19T00:16:37.2555255Z [submariner-operator]$ [cluster2] wait 7501
2021-07-19T00:16:37.2558270Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:37.2569903Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T00:16:37.2579803Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T00:16:37.2589800Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:37.2603762Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T00:16:37.3402737Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T00:16:37.3416123Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T00:16:37.3783992Z  • Showing Connections  ...
2021-07-19T00:16:37.3811012Z  ✓ Showing Connections
2021-07-19T00:16:37.3920527Z  • Showing Connections  ...
2021-07-19T00:16:37.3943049Z  ✓ Showing Connections
2021-07-19T00:16:37.3964947Z cluster2-worker  cluster2  172.18.0.5  no   libreswan     242.254.2.0/24  connected  190.152µs   
2021-07-19T00:16:37.3966107Z cluster1-worker  cluster1  172.18.0.6  no   libreswan     242.254.1.0/24  connected  0s        
2021-07-19T00:16:37.3990296Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:16:37.4005062Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:16:37.4017223Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T00:16:37.4028328Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T00:16:37.4039979Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-19T00:16:37.4050563Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-19T00:16:37.4062740Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-19T00:16:37.4073882Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T00:16:37.4085278Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T00:16:37.4100671Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-19T00:16:37.6698382Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-19T00:16:37.6751627Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-19T00:16:38.1871467Z devel: Pulling from submariner/nettest
2021-07-19T00:16:38.1873242Z 5843afab3874: Already exists
2021-07-19T00:16:38.1895932Z 9565bb92f43f: Pulling fs layer
2021-07-19T00:16:38.1901323Z a31c0d5b4ad6: Pulling fs layer
2021-07-19T00:16:38.1901850Z dc3d13650205: Pulling fs layer
2021-07-19T00:16:38.2921669Z 9565bb92f43f: Verifying Checksum
2021-07-19T00:16:38.2922464Z 9565bb92f43f: Download complete
2021-07-19T00:16:38.3233513Z dc3d13650205: Verifying Checksum
2021-07-19T00:16:38.3234153Z dc3d13650205: Download complete
2021-07-19T00:16:38.3570106Z a31c0d5b4ad6: Verifying Checksum
2021-07-19T00:16:38.3570650Z a31c0d5b4ad6: Download complete
2021-07-19T00:16:38.4350360Z 9565bb92f43f: Pull complete
2021-07-19T00:16:38.7294240Z a31c0d5b4ad6: Pull complete
2021-07-19T00:16:38.8144782Z dc3d13650205: Pull complete
2021-07-19T00:16:38.8326134Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-19T00:16:38.8327453Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-19T00:16:38.8331081Z quay.io/submariner/nettest:devel
2021-07-19T00:16:38.8339925Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-19T00:16:39.0921261Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-19T00:16:39.3503299Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-19T00:16:39.6022831Z The push refers to repository [localhost:5000/nettest]
2021-07-19T00:16:39.6107444Z 4f2cdf68c81d: Preparing
2021-07-19T00:16:39.6107922Z 1f803d62c8b3: Preparing
2021-07-19T00:16:39.6108349Z 80c9eaab4c9e: Preparing
2021-07-19T00:16:39.6108815Z 72e830a4dff5: Preparing
2021-07-19T00:16:40.2605377Z 80c9eaab4c9e: Pushed
2021-07-19T00:16:40.2630673Z 4f2cdf68c81d: Pushed
2021-07-19T00:16:40.2784482Z 72e830a4dff5: Pushed
2021-07-19T00:16:40.6023270Z 1f803d62c8b3: Pushed
2021-07-19T00:16:40.6226449Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-19T00:16:40.6299517Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:40.6308954Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:40.6324179Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T00:16:40.6339682Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-19T00:16:40.6363458Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:40.6377030Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:40.6391210Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:41.0947918Z deployment.apps/netshoot created
2021-07-19T00:16:41.1059368Z Waiting for netshoot pods to be ready.
2021-07-19T00:16:41.1077142Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T00:16:41.1093280Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T00:16:41.1108415Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-19T00:16:41.4911023Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-19T00:16:42.9611257Z deployment "netshoot" successfully rolled out
2021-07-19T00:16:42.9672496Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:42.9688624Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:42.9705274Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:42.9718616Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-19T00:16:42.9730987Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T00:16:42.9747653Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-19T00:16:42.9767692Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:42.9778966Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:42.9789799Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:43.5014010Z deployment.apps/nginx-demo created
2021-07-19T00:16:43.5227956Z service/nginx-demo created
2021-07-19T00:16:43.6330818Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-19T00:16:43.6395009Z Waiting for nginx-demo pods to be ready.
2021-07-19T00:16:43.6410322Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T00:16:43.6432807Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T00:16:43.6472953Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-19T00:16:44.0291288Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T00:16:49.1304129Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T00:16:49.9974183Z deployment "nginx-demo" successfully rolled out
2021-07-19T00:16:50.0077735Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-19T00:16:50.0100944Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T00:16:50.0131774Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-19T00:16:50.0162244Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T00:16:50.0199540Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-19T00:16:50.3160319Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-19T00:16:50.3180640Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T00:16:50.3190174Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T00:16:50.3204516Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-19T00:16:50.3217231Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-19T00:16:50.3231803Z [submariner-operator]$ [cluster1] svc_ip=$(with_retries 30 get_globalip "${svc_name}")
2021-07-19T00:16:50.3246696Z [submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo
2021-07-19T00:16:50.3256820Z [submariner-operator]$ [cluster1] with_retries 30 get_globalip nginx-demo
2021-07-19T00:16:50.3267378Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T00:16:50.3288832Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-19T00:16:50.3297506Z [submariner-operator]$ [cluster1] wait 7642
2021-07-19T00:16:50.3305497Z [submariner-operator]$ [cluster1] get_globalip
2021-07-19T00:16:50.3317049Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-19T00:16:50.3333676Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:50.3345382Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:50.3358584Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:50.5989278Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-19T00:16:50.6002625Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:50.6016755Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:50.6031727Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:50.8666552Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-19T00:16:50.8716360Z [submariner-operator]$ [cluster1] sleep 1
2021-07-19T00:16:51.8746583Z [submariner-operator]$ [cluster1] return 1
2021-07-19T00:16:51.8779516Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-19T00:16:51.8780471Z [submariner-operator]$ [cluster1] wait 7671
2021-07-19T00:16:51.8792791Z [submariner-operator]$ [cluster1] get_globalip
2021-07-19T00:16:51.8806166Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-19T00:16:51.8824973Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:51.8835397Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:51.8849601Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:52.1437428Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-19T00:16:52.1456408Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:52.1467928Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:52.1476024Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:52.4032834Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-19T00:16:52.4084412Z [submariner-operator]$ [cluster1] sleep 1
2021-07-19T00:16:53.4109585Z [submariner-operator]$ [cluster1] return 1
2021-07-19T00:16:53.4148803Z [submariner-operator]$ [cluster1] wait 7700
2021-07-19T00:16:53.4158926Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-19T00:16:53.4166900Z [submariner-operator]$ [cluster1] get_globalip
2021-07-19T00:16:53.4197793Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-19T00:16:53.4213899Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:53.4235562Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:53.4245899Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:53.6756550Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-19T00:16:53.6772913Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:53.6783344Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:53.6796319Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:53.9351402Z Error from server (NotFound): globalingressips.submariner.io "nginx-demo" not found
2021-07-19T00:16:53.9403117Z [submariner-operator]$ [cluster1] sleep 1
2021-07-19T00:16:54.9428084Z [submariner-operator]$ [cluster1] return 1
2021-07-19T00:16:54.9462977Z [submariner-operator]$ [cluster1] get_globalip nginx-demo
2021-07-19T00:16:54.9464844Z [submariner-operator]$ [cluster1] wait 7729
2021-07-19T00:16:54.9475660Z [submariner-operator]$ [cluster1] get_globalip
2021-07-19T00:16:54.9489261Z [submariner-operator]$ [cluster1] gip=$(kubectl get svc "$svc_name" -o jsonpath='{.metadata.annotations.submariner\.io/globalIp}')
2021-07-19T00:16:54.9505066Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:54.9515992Z [submariner-operator]$ [cluster1] kubectl get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:54.9530003Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc nginx-demo -o jsonpath={.metadata.annotations.submariner\.io/globalIp}
2021-07-19T00:16:55.2237536Z [submariner-operator]$ [cluster1] gip=$(kubectl get giip "$svc_name" -o jsonpath='{.status.allocatedIP}')
2021-07-19T00:16:55.2262188Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:55.2275856Z [submariner-operator]$ [cluster1] kubectl get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:55.2286658Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get giip nginx-demo -o jsonpath={.status.allocatedIP}
2021-07-19T00:16:55.4940933Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:16:55.4963924Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-4jtf4 242.254.1.252
2021-07-19T00:16:55.4978190Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-4jtf4 242.254.1.252
2021-07-19T00:16:55.4993106Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:16:55.5018478Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-4jtf4 242.254.1.252
2021-07-19T00:16:55.5022720Z [submariner-operator]$ [cluster2] wait 7758
2021-07-19T00:16:55.5036148Z [submariner-operator]$ [cluster2] test_connection
2021-07-19T00:16:55.5039950Z Attempting connectivity between clusters - netshoot-57677568b8-4jtf4 --> 242.254.1.252
2021-07-19T00:16:55.5051241Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-19T00:16:55.5059928Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-19T00:16:55.5073561Z [submariner-operator]$ [cluster2] date +%s
2021-07-19T00:16:55.5106335Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-4jtf4 -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-19T00:16:55.5119270Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-4jtf4 -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-19T00:16:55.5130934Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-4jtf4 -- curl --output /dev/null -m 30 --silent --head --fail 242.254.1.252
2021-07-19T00:16:55.8842739Z Connection test was successful!
2021-07-19T00:16:55.8860860Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:16:55.8869999Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:55.8881334Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:55.8894124Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:55.8905173Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:55.8918151Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T00:16:56.1986401Z deployment.apps "netshoot" deleted
2021-07-19T00:16:56.2055952Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.2075337Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.2087303Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.2097968Z [submariner-operator]$ [cluster1] remove_resource
2021-07-19T00:16:56.2109744Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.2119973Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.2131844Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T00:16:56.4759608Z deployment.apps "nginx-demo" deleted
2021-07-19T00:16:56.5656643Z service "nginx-demo" deleted
2021-07-19T00:16:56.5731304Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-19T00:16:56.5886206Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T00:16:56.5900924Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T00:16:56.5915192Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-19T00:16:56.5933930Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T00:16:56.5973491Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:16:56.5979260Z   Successfully remade target file 'deploy'.
2021-07-19T00:16:56.5979950Z Must remake target 'e2e'.
2021-07-19T00:16:56.5982485Z scripts/kind-e2e/e2e.sh
2021-07-19T00:16:56.6094100Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T00:16:56.6112164Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:16:56.6119726Z [submariner-operator]$ script_name=utils
2021-07-19T00:16:56.6128903Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T00:16:56.6148374Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-19T00:16:56.6173470Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:16:56.6182118Z [submariner-operator]$ script_name=deploy_funcs
2021-07-19T00:16:56.6192494Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T00:16:56.6208181Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-19T00:16:56.6218720Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:16:56.6228964Z [submariner-operator]$ script_name=deploy_operator
2021-07-19T00:16:56.6238206Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T00:16:56.6256056Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T00:16:56.6267864Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:16:56.6277047Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:16:56.6298400Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T00:16:56.6315385Z [submariner-operator]$ broker=cluster1
2021-07-19T00:16:56.6325489Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T00:16:56.6336670Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T00:16:56.6347525Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T00:16:56.6359111Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T00:16:56.6370583Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T00:16:56.6381709Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T00:16:56.6393404Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T00:16:56.6404857Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T00:16:56.6415399Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T00:16:56.6426377Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T00:16:56.6437112Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T00:16:56.6448369Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T00:16:56.6459496Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T00:16:56.6468895Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T00:16:56.6478030Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T00:16:56.6498079Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T00:16:56.6515758Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T00:16:56.6539223Z [submariner-operator]$ globalnet=true
2021-07-19T00:16:56.6553815Z [submariner-operator]$ timeout=2m
2021-07-19T00:16:56.6577772Z [submariner-operator]$ declare_kubeconfig
2021-07-19T00:16:56.6589633Z [submariner-operator]$ declare_kubeconfig
2021-07-19T00:16:56.6600687Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-19T00:16:56.6617388Z [submariner-operator]$ export KUBECONFIG
2021-07-19T00:16:56.6630004Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-19T00:16:56.6669930Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-19T00:16:56.6716204Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-19T00:16:56.6740630Z [submariner-operator]$ create_subm_vars
2021-07-19T00:16:56.6751615Z [submariner-operator]$ create_subm_vars
2021-07-19T00:16:56.6763488Z [submariner-operator]$ deployment_name=submariner
2021-07-19T00:16:56.6779399Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-19T00:16:56.6789532Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-19T00:16:56.6844736Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-19T00:16:56.6855378Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-19T00:16:56.6862265Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-19T00:16:56.6869582Z [submariner-operator]$ declare_cidrs
2021-07-19T00:16:56.6877885Z [submariner-operator]$ declare_cidrs
2021-07-19T00:16:56.6886553Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T00:16:56.6894155Z [submariner-operator]$ i=1
2021-07-19T00:16:56.6903289Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:16:56.6911433Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T00:16:56.6936762Z [submariner-operator]$ [cluster1] val=0
2021-07-19T00:16:56.6944234Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.0.0.0/16
2021-07-19T00:16:56.6951844Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.0.0.0/16
2021-07-19T00:16:56.6960141Z [submariner-operator]$ [cluster1] global_CIDRs[cluster1]=242.254.1.0/24
2021-07-19T00:16:56.6968055Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T00:16:56.6980905Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:16:56.6993425Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T00:16:56.7011012Z [submariner-operator]$ [cluster2] val=0
2021-07-19T00:16:56.7020276Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.0.0.0/16
2021-07-19T00:16:56.7029992Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.0.0.0/16
2021-07-19T00:16:56.7041514Z [submariner-operator]$ [cluster2] global_CIDRs[cluster2]=242.254.2.0/24
2021-07-19T00:16:56.7055797Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T00:16:56.7068075Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-19T00:16:56.7080220Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-19T00:16:56.7094606Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-19T00:16:56.7113907Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-19T00:16:56.7134946Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-19T00:16:56.7148939Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-19T00:16:56.7162416Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-19T00:16:56.7175873Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-19T00:16:56.7187199Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-19T00:16:56.7242194Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-19T00:16:56.7258179Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-19T00:16:56.7279417Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-19T00:16:56.7331631Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-19T00:16:56.7345693Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-19T00:16:56.7359607Z [submariner-operator]$ [cluster1] broker_vars
2021-07-19T00:16:56.7417668Z [submariner-operator]$ [cluster1] broker_vars
2021-07-19T00:16:56.7435959Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-19T00:16:56.7460132Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T00:16:56.7490270Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T00:16:56.7503928Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T00:16:57.0932792Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-19T00:16:57.1004293Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T00:16:57.1039177Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T00:16:57.1069621Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T00:16:57.5492307Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-19T00:16:57.5512301Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T00:16:57.5530269Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T00:16:57.5535043Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-19T00:16:57.5557089Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T00:16:57.8408292Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-19T00:16:57.8419414Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-19T00:16:57.8433506Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-19T00:16:57.8445547Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-19T00:16:57.9008421Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:16:58.0115524Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:16:58.0683230Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-19T00:16:58.0684828Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-19T00:16:58.0686093Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-19T00:16:58.0701621Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-19T00:16:58.0702747Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-19T00:16:58.0704445Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-19T00:16:58.2873514Z [submariner-operator]$ [cluster1] return
2021-07-19T00:16:58.2885914Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-19T00:16:58.2897786Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-19T00:16:58.2910417Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-19T00:16:58.5396941Z NAME                                       TYPE                                  DATA   AGE
2021-07-19T00:16:58.5399051Z cluster-cluster1-token-sdkb5               kubernetes.io/service-account-token   3      69s
2021-07-19T00:16:58.5400562Z cluster-cluster2-token-9hchv               kubernetes.io/service-account-token   3      64s
2021-07-19T00:16:58.5401949Z default-token-jfsn5                        kubernetes.io/service-account-token   3      88s
2021-07-19T00:16:58.5403508Z submariner-k8s-broker-admin-token-fzlkm    kubernetes.io/service-account-token   3      88s
2021-07-19T00:16:58.5405304Z submariner-k8s-broker-client-token-zkn6v   kubernetes.io/service-account-token   3      88s
2021-07-19T00:16:58.5453573Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T00:16:58.5463474Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T00:16:58.5473349Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T00:16:58.8219510Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:58.8229835Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-zkn6v -n submariner-k8s-broker -o json
2021-07-19T00:16:58.8273943Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:58.8297956Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-zkn6v -n submariner-k8s-broker -o json
2021-07-19T00:16:58.8312031Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-zkn6v -n submariner-k8s-broker -o json
2021-07-19T00:16:59.0829338Z {
2021-07-19T00:16:59.0829804Z     "apiVersion": "v1",
2021-07-19T00:16:59.0830157Z     "data": {
2021-07-19T00:16:59.1465068Z         "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T00:16:59.2063023Z         "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-19T00:16:59.2539080Z         "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklqTlZka1J0Wld4UU1ISnNTSFowU0dOQlVsUkVPVlYzYzB4eVZEbFNhRmxmUkdOS2IydGhNMlJKZFVVaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxNmEyNDJkaUlzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTWpnell6WmlOVGN0Wm1SbE5pMDBZV1UzTFRnMFptTXRZekExTlRSbVpqQTVNemt4SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLm1abmh0NkYyM0tIWDVPVndQdnNJT3ZoaHUtQ2FqcHFCWWJVWWRZM21tcTc0TXdwektBa1Z6akZWbEw4TWkxNWlxWV9QN1h5RTNubjJBLTJXNjI2VDBPeGhYYU1pRk9HVTZsQ3hTdzVPbVB3U2RGektMQ2FMcmE0WUl4Nk5GOGdqQ18wSUx0bThKem4yVG5aTXVWcFpWZ3NOQ1NpWjN4cmktb09ScHFLRE9ZN1JHUmRJM3pOX2V1aVF2aGp3aU05djY3ZnVGNlJrdGxFUEozZGFocW9zd09jaHluVjJQcVBaaWZFb2xMaGpYLVQ0SDBGVDVWMUp2MHZ0a0xZbnBYZGpPQjJtbGhPb2VmcThTd3JHdnQ2N2F3TFB6WkxOWHBmTnF5QWN5R3JSNHV0amo5S1JtQnBaTHNEU1VHd3ZvZDBnUklpQXM3UHB5Q3FrekJzWkZLTURmUQ=="
2021-07-19T00:16:59.2979754Z     },
2021-07-19T00:16:59.2980150Z     "kind": "Secret",
2021-07-19T00:16:59.2980513Z     "metadata": {
2021-07-19T00:16:59.2980903Z         "annotations": {
2021-07-19T00:16:59.2982298Z             "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-19T00:16:59.2983619Z             "kubernetes.io/service-account.uid": "283c6b57-fde6-4ae7-84fc-c0554ff09391"
2021-07-19T00:16:59.2984291Z         },
2021-07-19T00:16:59.2984864Z         "creationTimestamp": "2021-07-19T00:15:30Z",
2021-07-19T00:16:59.2985369Z         "managedFields": [
2021-07-19T00:16:59.2985724Z             {
2021-07-19T00:16:59.2986084Z                 "apiVersion": "v1",
2021-07-19T00:16:59.2986528Z                 "fieldsType": "FieldsV1",
2021-07-19T00:16:59.2986958Z                 "fieldsV1": {
2021-07-19T00:16:59.2987312Z                     "f:data": {
2021-07-19T00:16:59.2987646Z                         ".": {},
2021-07-19T00:16:59.2987990Z                         "f:ca.crt": {},
2021-07-19T00:16:59.2988368Z                         "f:namespace": {},
2021-07-19T00:16:59.2988758Z                         "f:token": {}
2021-07-19T00:16:59.2989075Z                     },
2021-07-19T00:16:59.2989424Z                     "f:metadata": {
2021-07-19T00:16:59.2990011Z                         "f:annotations": {
2021-07-19T00:16:59.2990399Z                             ".": {},
2021-07-19T00:16:59.2991097Z                             "f:kubernetes.io/service-account.name": {},
2021-07-19T00:16:59.2991979Z                             "f:kubernetes.io/service-account.uid": {}
2021-07-19T00:16:59.2992478Z                         }
2021-07-19T00:16:59.2992786Z                     },
2021-07-19T00:16:59.2993118Z                     "f:type": {}
2021-07-19T00:16:59.2993430Z                 },
2021-07-19T00:16:59.2994079Z                 "manager": "kube-controller-manager",
2021-07-19T00:16:59.2994635Z                 "operation": "Update",
2021-07-19T00:16:59.2995191Z                 "time": "2021-07-19T00:15:30Z"
2021-07-19T00:16:59.2995516Z             }
2021-07-19T00:16:59.2995805Z         ],
2021-07-19T00:16:59.2996653Z         "name": "submariner-k8s-broker-client-token-zkn6v",
2021-07-19T00:16:59.2997691Z         "namespace": "submariner-k8s-broker",
2021-07-19T00:16:59.2998256Z         "resourceVersion": "1498",
2021-07-19T00:16:59.2999937Z         "selfLink": "/api/v1/namespaces/submariner-k8s-broker/secrets/submariner-k8s-broker-client-token-zkn6v",
2021-07-19T00:16:59.3001531Z         "uid": "fc20c2f5-0c51-4638-a236-3d92c1537ea2"
2021-07-19T00:16:59.3001992Z     },
2021-07-19T00:16:59.3002822Z     "type": "kubernetes.io/service-account-token"
2021-07-19T00:16:59.3003473Z }
2021-07-19T00:16:59.3005666Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-19T00:16:59.3015834Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-19T00:16:59.3017776Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:59.3019803Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-19T00:16:59.3022593Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-19T00:16:59.3024579Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:59.3026746Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-zkn6v
2021-07-19T00:16:59.3028730Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-zkn6v
2021-07-19T00:16:59.3030994Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:59.3130555Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-19T00:16:59.3146486Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-19T00:16:59.3160123Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:59.3470840Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-zkn6v.cluster1.json
2021-07-19T00:16:59.3767413Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-19T00:16:59.3782370Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-19T00:16:59.3796112Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-19T00:16:59.3810595Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T00:16:59.3842162Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-19T00:16:59.3856984Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-19T00:16:59.3871804Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T00:16:59.3890717Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T00:16:59.3912802Z [submariner-operator]$ [cluster1] pids[cluster1]=8010
2021-07-19T00:16:59.3913784Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T00:16:59.3928864Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-19T00:16:59.3946489Z [submariner-operator]$ [cluster2] pids[cluster2]=8014
2021-07-19T00:16:59.3950893Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T00:16:59.3964014Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T00:16:59.3969371Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-19T00:16:59.3985926Z [submariner-operator]$ [cluster2] wait 8014
2021-07-19T00:16:59.4005858Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T00:17:00.1766527Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-19T00:17:00.1767810Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-19T00:17:00.1768765Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-19T00:17:00.1769888Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T00:17:00.1771182Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T00:17:00.1772416Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-19T00:17:00.1773634Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-19T00:17:00.1775166Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-19T00:17:00.1776048Z [cluster1] NAME                      CREATED AT
2021-07-19T00:17:00.1776819Z [cluster1] endpoints.submariner.io   2021-07-19T00:15:40Z
2021-07-19T00:17:00.1778083Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.1779531Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.1780936Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.1782349Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.1783714Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.1784531Z [cluster1] {
2021-07-19T00:17:00.1785081Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:00.1785829Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:00.1786430Z [cluster1]     "metadata": {
2021-07-19T00:17:00.1786864Z [cluster1]         "annotations": {
2021-07-19T00:17:00.1787732Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:00.1788368Z [cluster1]         },
2021-07-19T00:17:00.1789023Z [cluster1]         "creationTimestamp": "2021-07-19T00:15:40Z",
2021-07-19T00:17:00.1789560Z [cluster1]         "generation": 1,
2021-07-19T00:17:00.1790054Z [cluster1]         "managedFields": [
2021-07-19T00:17:00.1790475Z [cluster1]             {
2021-07-19T00:17:00.1791043Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:00.1791696Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:00.1792186Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:00.1792641Z [cluster1]                     "f:metadata": {
2021-07-19T00:17:00.1793113Z [cluster1]                         "f:annotations": {
2021-07-19T00:17:00.1793564Z [cluster1]                             ".": {},
2021-07-19T00:17:00.1794400Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:00.1795062Z [cluster1]                         }
2021-07-19T00:17:00.1795433Z [cluster1]                     },
2021-07-19T00:17:00.1795833Z [cluster1]                     "f:spec": {
2021-07-19T00:17:00.1796388Z [cluster1]                         "f:conversion": {
2021-07-19T00:17:00.1796841Z [cluster1]                             ".": {},
2021-07-19T00:17:00.1797279Z [cluster1]                             "f:strategy": {}
2021-07-19T00:17:00.1797693Z [cluster1]                         },
2021-07-19T00:17:00.1798104Z [cluster1]                         "f:group": {},
2021-07-19T00:17:00.1798528Z [cluster1]                         "f:names": {
2021-07-19T00:17:00.1798964Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:00.1799410Z [cluster1]                             "f:listKind": {},
2021-07-19T00:17:00.1799874Z [cluster1]                             "f:plural": {},
2021-07-19T00:17:00.1800320Z [cluster1]                             "f:singular": {}
2021-07-19T00:17:00.1800745Z [cluster1]                         },
2021-07-19T00:17:00.1801154Z [cluster1]                         "f:scope": {},
2021-07-19T00:17:00.1801595Z [cluster1]                         "f:versions": {}
2021-07-19T00:17:00.1802016Z [cluster1]                     },
2021-07-19T00:17:00.1802413Z [cluster1]                     "f:status": {
2021-07-19T00:17:00.1802897Z [cluster1]                         "f:acceptedNames": {
2021-07-19T00:17:00.1803367Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:00.1803809Z [cluster1]                             "f:plural": {}
2021-07-19T00:17:00.1804209Z [cluster1]                         },
2021-07-19T00:17:00.1804647Z [cluster1]                         "f:conditions": {},
2021-07-19T00:17:00.1805397Z [cluster1]                         "f:storedVersions": {}
2021-07-19T00:17:00.1805866Z [cluster1]                     }
2021-07-19T00:17:00.1806241Z [cluster1]                 },
2021-07-19T00:17:00.1807603Z [cluster1]                 "manager": "submariner-operator",
2021-07-19T00:17:00.1808215Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:00.1808965Z [cluster1]                 "time": "2021-07-19T00:15:46Z"
2021-07-19T00:17:00.1809377Z [cluster1]             }
2021-07-19T00:17:00.1809808Z [cluster1]         ],
2021-07-19T00:17:00.1810361Z [cluster1]         "name": "endpoints.submariner.io",
2021-07-19T00:17:00.1810992Z [cluster1]         "resourceVersion": "1694",
2021-07-19T00:17:00.1812012Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-19T00:17:00.1813255Z [cluster1]         "uid": "6700ca27-3521-483c-b6fc-1b6d99fe5508"
2021-07-19T00:17:00.1813750Z [cluster1]     },
2021-07-19T00:17:00.1814130Z [cluster1]     "spec": {
2021-07-19T00:17:00.1814548Z [cluster1]         "conversion": {
2021-07-19T00:17:00.1815014Z [cluster1]             "strategy": "None"
2021-07-19T00:17:00.1815416Z [cluster1]         },
2021-07-19T00:17:00.1815866Z [cluster1]         "group": "submariner.io",
2021-07-19T00:17:00.1816321Z [cluster1]         "names": {
2021-07-19T00:17:00.1816758Z [cluster1]             "kind": "Endpoint",
2021-07-19T00:17:00.1817264Z [cluster1]             "listKind": "EndpointList",
2021-07-19T00:17:00.1817813Z [cluster1]             "plural": "endpoints",
2021-07-19T00:17:00.1818313Z [cluster1]             "singular": "endpoint"
2021-07-19T00:17:00.1818749Z [cluster1]         },
2021-07-19T00:17:00.1819188Z [cluster1]         "scope": "Namespaced",
2021-07-19T00:17:00.1819647Z [cluster1]         "versions": [
2021-07-19T00:17:00.1820049Z [cluster1]             {
2021-07-19T00:17:00.1820429Z [cluster1]                 "name": "v1",
2021-07-19T00:17:00.1820856Z [cluster1]                 "schema": {
2021-07-19T00:17:00.1821343Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T00:17:00.1821878Z [cluster1]                         "properties": {
2021-07-19T00:17:00.1822357Z [cluster1]                             "apiVersion": {
2021-07-19T00:17:00.1824644Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:00.1826288Z [cluster1]                                 "type": "string"
2021-07-19T00:17:00.1826714Z [cluster1]                             },
2021-07-19T00:17:00.1827132Z [cluster1]                             "kind": {
2021-07-19T00:17:00.1829119Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:00.1830697Z [cluster1]                                 "type": "string"
2021-07-19T00:17:00.1831131Z [cluster1]                             },
2021-07-19T00:17:00.1831548Z [cluster1]                             "metadata": {
2021-07-19T00:17:00.1832030Z [cluster1]                                 "type": "object"
2021-07-19T00:17:00.1832461Z [cluster1]                             },
2021-07-19T00:17:00.1832854Z [cluster1]                             "spec": {
2021-07-19T00:17:00.1833319Z [cluster1]                                 "properties": {
2021-07-19T00:17:00.1833792Z [cluster1]                                     "backend": {
2021-07-19T00:17:00.1834267Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1834697Z [cluster1]                                     },
2021-07-19T00:17:00.1835230Z [cluster1]                                     "backend_config": {
2021-07-19T00:17:00.1835836Z [cluster1]                                         "additionalProperties": {
2021-07-19T00:17:00.1836423Z [cluster1]                                             "type": "string"
2021-07-19T00:17:00.1836881Z [cluster1]                                         },
2021-07-19T00:17:00.1837326Z [cluster1]                                         "type": "object"
2021-07-19T00:17:00.1837777Z [cluster1]                                     },
2021-07-19T00:17:00.1838201Z [cluster1]                                     "cable_name": {
2021-07-19T00:17:00.1838678Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1839113Z [cluster1]                                     },
2021-07-19T00:17:00.1839556Z [cluster1]                                     "cluster_id": {
2021-07-19T00:17:00.1840042Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1840477Z [cluster1]                                     },
2021-07-19T00:17:00.1840965Z [cluster1]                                     "healthCheckIP": {
2021-07-19T00:17:00.1841478Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1841921Z [cluster1]                                     },
2021-07-19T00:17:00.1842346Z [cluster1]                                     "hostname": {
2021-07-19T00:17:00.1842828Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1843256Z [cluster1]                                     },
2021-07-19T00:17:00.1843703Z [cluster1]                                     "nat_enabled": {
2021-07-19T00:17:00.1844199Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:00.1844635Z [cluster1]                                     },
2021-07-19T00:17:00.1845078Z [cluster1]                                     "private_ip": {
2021-07-19T00:17:00.1845562Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1846009Z [cluster1]                                     },
2021-07-19T00:17:00.1865001Z [cluster1]                                     "public_ip": {
2021-07-19T00:17:00.1865566Z [cluster1]                                         "type": "string"
2021-07-19T00:17:00.1866024Z [cluster1]                                     },
2021-07-19T00:17:00.1866451Z [cluster1]                                     "subnets": {
2021-07-19T00:17:00.1867075Z [cluster1]                                         "items": {
2021-07-19T00:17:00.1867632Z [cluster1]                                             "type": "string"
2021-07-19T00:17:00.1868092Z [cluster1]                                         },
2021-07-19T00:17:00.1868526Z [cluster1]                                         "type": "array"
2021-07-19T00:17:00.1868969Z [cluster1]                                     }
2021-07-19T00:17:00.1869356Z [cluster1]                                 },
2021-07-19T00:17:00.1869804Z [cluster1]                                 "required": [
2021-07-19T00:17:00.1870333Z [cluster1]                                     "backend",
2021-07-19T00:17:00.2162949Z [cluster1]                                   [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-19T00:17:00.2164182Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-19T00:17:00.2165111Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-19T00:17:00.2168341Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T00:17:00.2169646Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T00:17:00.2170882Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-19T00:17:00.2172107Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-19T00:17:00.2173454Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-19T00:17:00.2174515Z [cluster2] NAME                      CREATED AT
2021-07-19T00:17:00.2175431Z [cluster2] endpoints.submariner.io   2021-07-19T00:15:54Z
2021-07-19T00:17:00.2176684Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.2178118Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.2179364Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.2180789Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.2182440Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-19T00:17:00.2183249Z [cluster2] {
2021-07-19T00:17:00.2183810Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:00.2184562Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:00.2185163Z [cluster2]     "metadata": {
2021-07-19T00:17:00.2185601Z [cluster2]         "annotations": {
2021-07-19T00:17:00.2186485Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:00.2187127Z [cluster2]         },
2021-07-19T00:17:00.2187784Z [cluster2]         "creationTimestamp": "2021-07-19T00:15:54Z",
2021-07-19T00:17:00.2188334Z [cluster2]         "generation": 1,
2021-07-19T00:17:00.2188811Z [cluster2]         "managedFields": [
2021-07-19T00:17:00.2189249Z [cluster2]             {
2021-07-19T00:17:00.2189800Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:00.2190454Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:00.2190943Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:00.2191400Z [cluster2]                     "f:metadata": {
2021-07-19T00:17:00.2191865Z [cluster2]                         "f:annotations": {
2021-07-19T00:17:00.2192317Z [cluster2]                             ".": {},
2021-07-19T00:17:00.2193144Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:00.2193813Z [cluster2]                         }
2021-07-19T00:17:00.2194196Z [cluster2]                     },
2021-07-19T00:17:00.2194583Z [cluster2]                     "f:spec": {
2021-07-19T00:17:00.2195043Z [cluster2]                         "f:conversion": {
2021-07-19T00:17:00.2195578Z [cluster2]                             ".": {},
2021-07-19T00:17:00.2196025Z [cluster2]                             "f:strategy": {}
2021-07-19T00:17:00.2196439Z [cluster2]                         },
2021-07-19T00:17:00.2196853Z [cluster2]                         "f:group": {},
2021-07-19T00:17:00.2197274Z [cluster2]                         "f:names": {
2021-07-19T00:17:00.2197703Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:00.2198143Z [cluster2]                             "f:listKind": {},
2021-07-19T00:17:00.2198614Z [cluster2]                             "f:plural": {},
2021-07-19T00:17:00.2199078Z [cluster2]                             "f:singular": {}
2021-07-19T00:17:00.2199491Z [cluster2]                         },
2021-07-19T00:17:00.2199903Z [cluster2]                         "f:scope": {},
2021-07-19T00:17:00.2200343Z [cluster2]                         "f:versions": {}
2021-07-19T00:17:00.2200764Z [cluster2]                     },
2021-07-19T00:17:00.2201158Z [cluster2]                     "f:status": {
2021-07-19T00:17:00.2201650Z [cluster2]                         "f:acceptedNames": {
2021-07-19T00:17:00.2202123Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:00.2202565Z [cluster2]                             "f:plural": {}
2021-07-19T00:17:00.2202976Z [cluster2]                         },
2021-07-19T00:17:00.2203404Z [cluster2]                         "f:conditions": {},
2021-07-19T00:17:00.2203928Z [cluster2]                         "f:storedVersions": {}
2021-07-19T00:17:00.2204437Z [cluster2]                     }
2021-07-19T00:17:00.2204811Z [cluster2]                 },
2021-07-19T00:17:00.2205501Z [cluster2]                 "manager": "submariner-operator",
2021-07-19T00:17:00.2206103Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:00.2206882Z [cluster2]                 "time": "2021-07-19T00:16:05Z"
2021-07-19T00:17:00.2207293Z [cluster2]             }
2021-07-19T00:17:00.2207648Z [cluster2]         ],
2021-07-19T00:17:00.2208206Z [cluster2]         "name": "endpoints.submariner.io",
2021-07-19T00:17:00.2208854Z [cluster2]         "resourceVersion": "1718",
2021-07-19T00:17:00.2209854Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/endpoints.submariner.io",
2021-07-19T00:17:00.2211085Z [cluster2]         "uid": "3894f87e-6ac4-456a-8f53-f432b934c16d"
2021-07-19T00:17:00.2211584Z [cluster2]     },
2021-07-19T00:17:00.2211959Z [cluster2]     "spec": {
2021-07-19T00:17:00.2212372Z [cluster2]         "conversion": {
2021-07-19T00:17:00.2212841Z [cluster2]             "strategy": "None"
2021-07-19T00:17:00.2213244Z [cluster2]         },
2021-07-19T00:17:00.2213695Z [cluster2]         "group": "submariner.io",
2021-07-19T00:17:00.2214150Z [cluster2]         "names": {
2021-07-19T00:17:00.2214588Z [cluster2]             "kind": "Endpoint",
2021-07-19T00:17:00.2215183Z [cluster2]             "listKind": "EndpointList",
2021-07-19T00:17:00.2215716Z [cluster2]             "plural": "endpoints",
2021-07-19T00:17:00.2216241Z [cluster2]             "singular": "endpoint"
2021-07-19T00:17:00.2216661Z [cluster2]         },
2021-07-19T00:17:00.2217099Z [cluster2]         "scope": "Namespaced",
2021-07-19T00:17:00.2217557Z [cluster2]         "versions": [
2021-07-19T00:17:00.2217963Z [cluster2]             {
2021-07-19T00:17:00.2218341Z [cluster2]                 "name": "v1",
2021-07-19T00:17:00.2218762Z [cluster2]                 "schema": {
2021-07-19T00:17:00.2219264Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T00:17:00.2219782Z [cluster2]                         "properties": {
2021-07-19T00:17:00.2220288Z [cluster2]                             "apiVersion": {
2021-07-19T00:17:00.2222431Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:00.2224077Z [cluster2]                                 "type": "string"
2021-07-19T00:17:00.2224520Z [cluster2]                             },
2021-07-19T00:17:00.2224916Z [cluster2]                             "kind": {
2021-07-19T00:17:00.2226899Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:00.2228503Z [cluster2]                                 "type": "string"
2021-07-19T00:17:00.2228927Z [cluster2]                             },
2021-07-19T00:17:00.2229357Z [cluster2]                             "metadata": {
2021-07-19T00:17:00.2229822Z [cluster2]                                 "type": "object"
2021-07-19T00:17:00.2230263Z [cluster2]                             },
2021-07-19T00:17:00.2230663Z [cluster2]                             "spec": {
2021-07-19T00:17:00.2231133Z [cluster2]                                 "properties": {
2021-07-19T00:17:00.2231780Z [cluster2]                                     "backend": {
2021-07-19T00:17:00.2232250Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2232798Z [cluster2]                                     },
2021-07-19T00:17:00.2233248Z [cluster2]                                     "backend_config": {
2021-07-19T00:17:00.2233939Z [cluster2]                                         "additionalProperties": {
2021-07-19T00:17:00.2234639Z [cluster2]                                             "type": "string"
2021-07-19T00:17:00.2235101Z [cluster2]                                         },
2021-07-19T00:17:00.2235555Z [cluster2]                                         "type": "object"
2021-07-19T00:17:00.2235990Z [cluster2]                                     },
2021-07-19T00:17:00.2236445Z [cluster2]                                     "cable_name": {
2021-07-19T00:17:00.2236916Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2237359Z [cluster2]                                     },
2021-07-19T00:17:00.2237793Z [cluster2]                                     "cluster_id": {
2021-07-19T00:17:00.2238276Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2238707Z [cluster2]                                     },
2021-07-19T00:17:00.2239294Z [cluster2]                                     "healthCheckIP": {
2021-07-19T00:17:00.2239818Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2240249Z [cluster2]                                     },
2021-07-19T00:17:00.2240835Z [cluster2]                                     "hostname": {
2021-07-19T00:17:00.2241302Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2241750Z [cluster2]                                     },
2021-07-19T00:17:00.2242181Z [cluster2]                                     "nat_enabled": {
2021-07-19T00:17:00.2242675Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:00.2243130Z [cluster2]                                     },
2021-07-19T00:17:00.2243561Z [cluster2]                                     "private_ip": {
2021-07-19T00:17:00.2244048Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2244487Z [cluster2]                                     },
2021-07-19T00:17:00.2244926Z [cluster2]                                     "public_ip": {
2021-07-19T00:17:00.2245394Z [cluster2]                                         "type": "string"
2021-07-19T00:17:00.2245834Z [cluster2]                                     },
2021-07-19T00:17:00.2246259Z [cluster2]                                     "subnets": {
2021-07-19T00:17:00.2273023Z [cluster2]                                         "items": {
2021-07-19T00:17:00.2273523Z [cluster2]                                             "type": "string"
2021-07-19T00:17:00.2273972Z [cluster2]                                         },
2021-07-19T00:17:00.2274429Z [cluster2]                                         "type": "array"
2021-07-19T00:17:00.2274858Z [cluster2]                                     }
2021-07-19T00:17:00.2275264Z [cluster2]                                 },
2021-07-19T00:17:00.2275688Z [cluster2]                                 "required": [
2021-07-19T00:17:00.2276166Z [cluster2]                                     "backend",
2021-07-19T00:17:00.3961068Z [cluster2]                                     "cable_name",
2021-07-19T00:17:00.3961588Z [cluster1]                                     "cluster_id",
2021-07-19T00:17:00.3962068Z [cluster1]                                     "hostname",
2021-07-19T00:17:00.3962532Z [cluster1]                                     "nat_enabled",
2021-07-19T00:17:00.3963040Z [cluster1]                                     "private_ip",
2021-07-19T00:17:00.3963503Z [cluster1]                                     "public_ip",
2021-07-19T00:17:00.3963962Z [cluster1]                                     "subnets"
2021-07-19T00:17:00.3964375Z [cluster1]                                 ],
2021-07-19T00:17:00.3964813Z [cluster1]                                 "type": "object"
2021-07-19T00:17:00.3965248Z [cluster1]                             }
2021-07-19T00:17:00.3965622Z [cluster1]                         },
2021-07-19T00:17:00.3966196Z [cluster1]                         "required": [
2021-07-19T00:17:00.3966782Z [cluster1]                             "spec"
2021-07-19T00:17:00.3967182Z [cluster1]                         ],
2021-07-19T00:17:00.3967599Z [cluster1]                         "type": "object"
2021-07-19T00:17:00.3968024Z [cluster1]                     }
2021-07-19T00:17:00.3968383Z [cluster1]                 },
2021-07-19T00:17:00.3968799Z [cluster1]                 "served": true,
2021-07-19T00:17:00.3969249Z [cluster1]                 "storage": true
2021-07-19T00:17:00.3969664Z [cluster1]             }
2021-07-19T00:17:00.3970012Z [cluster1]         ]
2021-07-19T00:17:00.3970368Z [cluster1]     },
2021-07-19T00:17:00.3970745Z [cluster1]     "status": {
2021-07-19T00:17:00.3971191Z [cluster1]         "acceptedNames": {
2021-07-19T00:17:00.3971685Z [cluster1]             "kind": "Endpoint",
2021-07-19T00:17:00.3972189Z [cluster1]             "listKind": "EndpointList",
2021-07-19T00:17:00.3972731Z [cluster1]             "plural": "endpoints",
2021-07-19T00:17:00.3973227Z [cluster1]             "singular": "endpoint"
2021-07-19T00:17:00.3973658Z [cluster1]         },
2021-07-19T00:17:00.3974053Z [cluster1]         "conditions": [
2021-07-19T00:17:00.3974459Z [cluster1]             {
2021-07-19T00:17:00.3975562Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:40Z",
2021-07-19T00:17:00.3976182Z [cluster1]                 "message": "no conflicts found",
2021-07-19T00:17:00.3976740Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T00:17:00.3977220Z [cluster1]                 "status": "True",
2021-07-19T00:17:00.3977730Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T00:17:00.3978176Z [cluster1]             },
2021-07-19T00:17:00.3978545Z [cluster1]             {
2021-07-19T00:17:00.3979219Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:40Z",
2021-07-19T00:17:00.3979898Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T00:17:00.3980596Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:00.3981179Z [cluster1]                 "status": "True",
2021-07-19T00:17:00.3981650Z [cluster1]                 "type": "Established"
2021-07-19T00:17:00.3982086Z [cluster1]             }
2021-07-19T00:17:00.3982445Z [cluster1]         ],
2021-07-19T00:17:00.3982876Z [cluster1]         "storedVersions": [
2021-07-19T00:17:00.3983326Z [cluster1]             "v1"
2021-07-19T00:17:00.3983820Z [cluster1]         ]
2021-07-19T00:17:00.3984184Z [cluster1]     }
2021-07-19T00:17:00.3984523Z [cluster1] }
2021-07-19T00:17:00.3985508Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T00:17:00.3986880Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T00:17:00.3988449Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.3989875Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:00.3990961Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:00.3992367Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.3993761Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:00.3994885Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:00.3996292Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.3997687Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-19T00:17:00.3998817Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-19T00:17:00.4000286Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.4001921Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T00:17:00.4003261Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T00:17:00.4004950Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T00:17:00.4006501Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-19T00:17:00.4007409Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-19T00:17:00.4008600Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T00:17:00.4009826Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T00:17:00.4011123Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-19T00:17:00.4012308Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-19T00:17:00.4224943Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd  "cable_name",
2021-07-19T00:17:00.4225721Z [cluster2]                                     "cluster_id",
2021-07-19T00:17:00.4226201Z [cluster2]                                     "hostname",
2021-07-19T00:17:00.4226673Z [cluster2]                                     "nat_enabled",
2021-07-19T00:17:00.4227177Z [cluster2]                                     "private_ip",
2021-07-19T00:17:00.4227645Z [cluster2]                                     "public_ip",
2021-07-19T00:17:00.4228106Z [cluster2]                                     "subnets"
2021-07-19T00:17:00.4228520Z [cluster2]                                 ],
2021-07-19T00:17:00.4228960Z [cluster2]                                 "type": "object"
2021-07-19T00:17:00.4229378Z [cluster2]                             }
2021-07-19T00:17:00.4229764Z [cluster2]                         },
2021-07-19T00:17:00.4230196Z [cluster2]                         "required": [
2021-07-19T00:17:00.4230620Z [cluster2]                             "spec"
2021-07-19T00:17:00.4231015Z [cluster2]                         ],
2021-07-19T00:17:00.4231428Z [cluster2]                         "type": "object"
2021-07-19T00:17:00.4231852Z [cluster2]                     }
2021-07-19T00:17:00.4232213Z [cluster2]                 },
2021-07-19T00:17:00.4232625Z [cluster2]                 "served": true,
2021-07-19T00:17:00.4233217Z [cluster2]                 "storage": true
2021-07-19T00:17:00.4233632Z [cluster2]             }
2021-07-19T00:17:00.4233980Z [cluster2]         ]
2021-07-19T00:17:00.4234337Z [cluster2]     },
2021-07-19T00:17:00.4234700Z [cluster2]     "status": {
2021-07-19T00:17:00.4235162Z [cluster2]         "acceptedNames": {
2021-07-19T00:17:00.4235660Z [cluster2]             "kind": "Endpoint",
2021-07-19T00:17:00.4236168Z [cluster2]             "listKind": "EndpointList",
2021-07-19T00:17:00.4236837Z [cluster2]             "plural": "endpoints",
2021-07-19T00:17:00.4237335Z [cluster2]             "singular": "endpoint"
2021-07-19T00:17:00.4237770Z [cluster2]         },
2021-07-19T00:17:00.4238162Z [cluster2]         "conditions": [
2021-07-19T00:17:00.4238573Z [cluster2]             {
2021-07-19T00:17:00.4239303Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:54Z",
2021-07-19T00:17:00.4239928Z [cluster2]                 "message": "no conflicts found",
2021-07-19T00:17:00.4240468Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T00:17:00.4240967Z [cluster2]                 "status": "True",
2021-07-19T00:17:00.4241482Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T00:17:00.4241932Z [cluster2]             },
2021-07-19T00:17:00.4242297Z [cluster2]             {
2021-07-19T00:17:00.4242968Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:54Z",
2021-07-19T00:17:00.4243749Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T00:17:00.4244530Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:00.4245118Z [cluster2]                 "status": "True",
2021-07-19T00:17:00.4245593Z [cluster2]                 "type": "Established"
2021-07-19T00:17:00.4246033Z [cluster2]             }
2021-07-19T00:17:00.4246470Z [cluster2]         ],
2021-07-19T00:17:00.4246917Z [cluster2]         "storedVersions": [
2021-07-19T00:17:00.4247372Z [cluster2]             "v1"
2021-07-19T00:17:00.4247729Z [cluster2]         ]
2021-07-19T00:17:00.4248084Z [cluster2]     }
2021-07-19T00:17:00.4248424Z [cluster2] }
2021-07-19T00:17:00.4249418Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T00:17:00.4250868Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T00:17:00.4252448Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.4253849Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:00.4254949Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:00.4256361Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.4257756Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:00.4258892Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:00.4260301Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.4261708Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-19T00:17:00.4262821Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-19T00:17:00.4264293Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.4265854Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T00:17:00.4267200Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T00:17:00.4268888Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T00:17:00.4270396Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-19T00:17:00.4271315Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-19T00:17:00.4272404Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T00:17:00.4273626Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T00:17:00.4274831Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-19T00:17:00.4276011Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-19T00:17:01.0181004Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-19T00:17:01.0182083Z [cluster1] NAME                     CREATED AT
2021-07-19T00:17:01.0182843Z [cluster1] clusters.submariner.io   2021-07-19T00:15:40Z
2021-07-19T00:17:01.0184119Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:01.0185504Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-19T00:17:01.0186881Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:01.0188242Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-19T00:17:01.0189711Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-19T00:17:01.0190687Z [cluster1] {
2021-07-19T00:17:01.0191226Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:01.0191989Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:01.0192608Z [cluster1]     "metadata": {
2021-07-19T00:17:01.0193061Z [cluster1]         "annotations": {
2021-07-19T00:17:01.0193934Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:01.0194589Z [cluster1]         },
2021-07-19T00:17:01.0195239Z [cluster1]         "creationTimestamp": "2021-07-19T00:15:40Z",
2021-07-19T00:17:01.0195788Z [cluster1]         "generation": 1,
2021-07-19T00:17:01.0196357Z [cluster1]         "managedFields": [
2021-07-19T00:17:01.0196777Z [cluster1]             {
2021-07-19T00:17:01.0197337Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:01.0197984Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:01.0198483Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:01.0198928Z [cluster1]                     "f:metadata": {
2021-07-19T00:17:01.0199409Z [cluster1]                         "f:annotations": {
2021-07-19T00:17:01.0199848Z [cluster1]                             ".": {},
2021-07-19T00:17:01.0200703Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:01.0201369Z [cluster1]                         }
2021-07-19T00:17:01.0201736Z [cluster1]                     },
2021-07-19T00:17:01.0202140Z [cluster1]                     "f:spec": {
2021-07-19T00:17:01.0202584Z [cluster1]                         "f:conversion": {
2021-07-19T00:17:01.0203033Z [cluster1]                             ".": {},
2021-07-19T00:17:01.0203454Z [cluster1]                             "f:strategy": {}
2021-07-19T00:17:01.0203880Z [cluster1]                         },
2021-07-19T00:17:01.0204281Z [cluster1]                         "f:group": {},
2021-07-19T00:17:01.0204711Z [cluster1]                         "f:names": {
2021-07-19T00:17:01.0205133Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:01.0205582Z [cluster1]                             "f:listKind": {},
2021-07-19T00:17:01.0206044Z [cluster1]                             "f:plural": {},
2021-07-19T00:17:01.0243583Z [cluster1]                             "f:singular": {}
2021-07-19T00:17:01.0244148Z [cluster1]                         },
2021-07-19T00:17:01.0244561Z [cluster1]                         "f:scope": {},
2021-07-19T00:17:01.0245234Z [cluster1]                         "f:versions": {}
2021-07-19T00:17:01.0245655Z [cluster1]                     },
2021-07-19T00:17:01.0246114Z [cluster1]                     "f:status": {
2021-07-19T00:17:01.0246721Z [cluster1]                         "f:acceptedNames": {
2021-07-19T00:17:01.0247216Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:01.0247649Z [cluster1]                             "f:plural": {}
2021-07-19T00:17:01.0248072Z [cluster1]                         },
2021-07-19T00:17:01.0248528Z [cluster1]                         "f:conditions": {},
2021-07-19T00:17:01.0249036Z [cluster1]                         "f:storedVersions": {}
2021-07-19T00:17:01.0249502Z [cluster1]                     }
2021-07-19T00:17:01.0249870Z [cluster1]                 },
2021-07-19T00:17:01.0250803Z [cluster1]                 "manager": "submariner-operator",
2021-07-19T00:17:01.0251396Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:01.0252046Z [cluster1]                 "time": "2021-07-19T00:15:46Z"
2021-07-19T00:17:01.0252444Z [cluster1]             }
2021-07-19T00:17:01.0252812Z [cluster1]         ],
2021-07-19T00:17:01.0253335Z [cluster1]         "name": "clusters.submariner.io",
2021-07-19T00:17:01.0253961Z [cluster1]         "resourceVersion": "1693",
2021-07-19T00:17:01.0254964Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-19T00:17:01.0256159Z [cluster1]         "uid": "434389f4-71c6-438c-95de-56c17e9c46a7"
2021-07-19T00:17:01.0256758Z [cluster1]     },
2021-07-19T00:17:01.0257120Z [cluster1]     "spec": {
2021-07-19T00:17:01.0257544Z [cluster1]         "conversion": {
2021-07-19T00:17:01.0257996Z [cluster1]             "strategy": "None"
2021-07-19T00:17:01.0258410Z [cluster1]         },
2021-07-19T00:17:01.0258853Z [cluster1]         "group": "submariner.io",
2021-07-19T00:17:01.0259322Z [cluster1]         "names": {
2021-07-19T00:17:01.0259737Z [cluster1]             "kind": "Cluster",
2021-07-19T00:17:01.0260362Z [cluster1]             "listKind": "ClusterList",
2021-07-19T00:17:01.0260886Z [cluster1]             "plural": "clusters",
2021-07-19T00:17:01.0261377Z [cluster1]             "singular": "cluster"
2021-07-19T00:17:01.0261806Z [cluster1]         },
2021-07-19T00:17:01.0262227Z [cluster1]         "scope": "Namespaced",
2021-07-19T00:17:01.0262702Z [cluster1]         "versions": [
2021-07-19T00:17:01.0263086Z [cluster1]             {
2021-07-19T00:17:01.0263480Z [cluster1]                 "name": "v1",
2021-07-19T00:17:01.0263896Z [cluster1]                 "schema": {
2021-07-19T00:17:01.0264395Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T00:17:01.0264911Z [cluster1]                         "properties": {
2021-07-19T00:17:01.0265408Z [cluster1]                             "apiVersion": {
2021-07-19T00:17:01.0267491Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:01.0283286Z [cluster1]                                 "type": "string"
2021-07-19T00:17:01.0283849Z [cluster1]                             },
2021-07-19T00:17:01.0284273Z [cluster1]                             "kind": {
2021-07-19T00:17:01.0286625Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:01.0288371Z [cluster1]                                 "type": "string"
2021-07-19T00:17:01.0288819Z [cluster1]                             },
2021-07-19T00:17:01.0291077Z [cluster1]                             "metadata": {
2021-07-19T00:17:01.0291831Z [cluster1]                                 "type": "object"
2021-07-19T00:17:01.0292359Z [cluster1]                             },
2021-07-19T00:17:01.0292791Z [cluster1]                             "spec": {
2021-07-19T00:17:01.0293283Z [cluster1]                                 "properties": {
2021-07-19T00:17:01.0293796Z [cluster1]                                     "cluster_cidr": {
2021-07-19T00:17:01.0294258Z [cluster1]                                         "items": {
2021-07-19T00:17:01.0294758Z [cluster1]                                             "type": "string"
2021-07-19T00:17:01.0295215Z [cluster1]                                         },
2021-07-19T00:17:01.0295651Z [cluster1]                                         "type": "array"
2021-07-19T00:17:01.0296089Z [cluster1]                                     },
2021-07-19T00:17:01.0296519Z [cluster1]                                     "cluster_id": {
2021-07-19T00:17:01.0297004Z [cluster1]                                         "type": "string"
2021-07-19T00:17:01.0297441Z [cluster1]                                     },
2021-07-19T00:17:01.0297883Z [cluster1]                                     "color_codes": {
2021-07-19T00:17:01.0298345Z [cluster1]                                         "items": {
2021-07-19T00:17:01.0298804Z [cluster1]                                             "type": "string"
2021-07-19T00:17:01.0299254Z [cluster1]                                         },
2021-07-19T00:17:01.0299798Z [cluster1]                                         "type": "array"
2021-07-19T00:17:01.0300241Z [cluster1]                                     },
2021-07-19T00:17:01.0300670Z [cluster1]                                     "global_cidr": {
2021-07-19T00:17:01.0301129Z [cluster1]                                         "items": {
2021-07-19T00:17:01.0301588Z [cluster1]                                             "type": "string"
2021-07-19T00:17:01.0302049Z [cluster1]                                         },
2021-07-19T00:17:01.0302498Z [cluster1]                                         "type": "array"
2021-07-19T00:17:01.0302924Z [cluster1]                                     },
2021-07-19T00:17:01.0303374Z [cluster1]                                     "service_cidr": {
2021-07-19T00:17:01.0303834Z [cluster1]                                         "items": {
2021-07-19T00:17:01.0304302Z [cluster1]                                             "type": "string"
2021-07-19T00:17:01.0304744Z [cluster1]                                         },
2021-07-19T00:17:01.0305187Z [cluster1]                                         "type": "array"
2021-07-19T00:17:01.0305614Z [cluster1]                                     }
2021-07-19T00:17:01.0306011Z [cluster1]                                 },
2021-07-19T00:17:01.0306441Z [cluster1]                                 "required": [
2021-07-19T00:17:01.0306909Z [cluster1]                                     "cluster_cidr",
2021-07-19T00:17:01.0307390Z [cluster1]                                     "cluster_id",
2021-07-19T00:17:01.0307849Z [cluster1]                                     "color_codes",
2021-07-19T00:17:01.0308318Z [cluster1]                                     "global_cidr",
2021-07-19T00:17:01.0308783Z [cluster1]                                     "service_cidr"
2021-07-19T00:17:01.0309227Z [cluster1]                                 ],
2021-07-19T00:17:01.0309656Z [cluster1]                                 "type": "object"
2021-07-19T00:17:01.0310093Z [cluster1]                             }
2021-07-19T00:17:01.0310481Z [cluster1]                         },
2021-07-19T00:17:01.0310891Z [cluster1]                         "required": [
2021-07-19T00:17:01.0311333Z [cluster1]                             "spec"
2021-07-19T00:17:01.0311721Z [cluster1]                         ],
2021-07-19T00:17:01.0312149Z [cluster1]                         "type": "object"
2021-07-19T00:17:01.0312560Z [cluster1]                     }
2021-07-19T00:17:01.0312987Z [cluster1]                 },
2021-07-19T00:17:01.0313395Z [cluster1]                 "served": true,
2021-07-19T00:17:01.0313856Z [cluster1]                 "storage": true
2021-07-19T00:17:01.0314253Z [cluster1]             }
2021-07-19T00:17:01.0314617Z [cluster1]         ]
2021-07-19T00:17:01.0314973Z [cluster1]     },
2021-07-19T00:17:01.0315970Z [cluster1]     "status": {
2021-07-19T00:17:01.0316578Z [cluster1]         "acceptedNames": {
2021-07-19T00:17:01.0317077Z [cluster1]             "kind": "Cluster",
2021-07-19T00:17:01.0317591Z [cluster1]             "listKind": "ClusterList",
2021-07-19T00:17:01.0318099Z [cluster1]             "plural": "clusters",
2021-07-19T00:17:01.0318592Z [cluster1]             "singular": "cluster"
2021-07-19T00:17:01.0319002Z [cluster1]         },
2021-07-19T00:17:01.0319412Z [cluster1]         "conditions": [
2021-07-19T00:17:01.0319805Z [cluster1]             {
2021-07-19T00:17:01.1712181Z [cluster1]                 "lastTransitionTime": "2021-07-19Ts clusters.submariner.io
2021-07-19T00:17:01.1713060Z [cluster2] NAME                     CREATED AT
2021-07-19T00:17:01.1713821Z [cluster2] clusters.submariner.io   2021-07-19T00:15:54Z
2021-07-19T00:17:01.1715073Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:01.1716469Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-19T00:17:01.1717829Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:01.1719414Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-19T00:17:01.1720749Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-19T00:17:01.1721554Z [cluster2] {
2021-07-19T00:17:01.1722108Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:01.1722853Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:01.1723460Z [cluster2]     "metadata": {
2021-07-19T00:17:01.1723897Z [cluster2]         "annotations": {
2021-07-19T00:17:01.1724906Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:01.1725545Z [cluster2]         },
2021-07-19T00:17:01.1726215Z [cluster2]         "creationTimestamp": "2021-07-19T00:15:54Z",
2021-07-19T00:17:01.1726890Z [cluster2]         "generation": 1,
2021-07-19T00:17:01.1727385Z [cluster2]         "managedFields": [
2021-07-19T00:17:01.1727817Z [cluster2]             {
2021-07-19T00:17:01.1728385Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:01.1729044Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:01.1729532Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:01.1729992Z [cluster2]                     "f:metadata": {
2021-07-19T00:17:01.1730456Z [cluster2]                         "f:annotations": {
2021-07-19T00:17:01.1730984Z [cluster2]                             ".": {},
2021-07-19T00:17:01.1731834Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:01.1732503Z [cluster2]                         }
2021-07-19T00:17:01.1732878Z [cluster2]                     },
2021-07-19T00:17:01.1733280Z [cluster2]                     "f:spec": {
2021-07-19T00:17:01.1733736Z [cluster2]                         "f:conversion": {
2021-07-19T00:17:01.1734165Z [cluster2]                             ".": {},
2021-07-19T00:17:01.1734603Z [cluster2]                             "f:strategy": {}
2021-07-19T00:17:01.1735017Z [cluster2]                         },
2021-07-19T00:17:01.1735428Z [cluster2]                         "f:group": {},
2021-07-19T00:17:01.1735851Z [cluster2]                         "f:names": {
2021-07-19T00:17:01.1736278Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:01.1736719Z [cluster2]                             "f:listKind": {},
2021-07-19T00:17:01.1737181Z [cluster2]                             "f:plural": {},
2021-07-19T00:17:01.1737761Z [cluster2]                             "f:singular": {}
2021-07-19T00:17:01.1738191Z [cluster2]                         },
2021-07-19T00:17:01.1738609Z [cluster2]                         "f:scope": {},
2021-07-19T00:17:01.1739048Z [cluster2]                         "f:versions": {}
2021-07-19T00:17:01.1739468Z [cluster2]                     },
2021-07-19T00:17:01.1739859Z [cluster2]                     "f:status": {
2021-07-19T00:17:01.1740355Z [cluster2]                         "f:acceptedNames": {
2021-07-19T00:17:01.1740835Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:01.1741277Z [cluster2]                             "f:plural": {}
2021-07-19T00:17:01.1741679Z [cluster2]                         },
2021-07-19T00:17:01.1742122Z [cluster2]                         "f:conditions": {},
2021-07-19T00:17:01.1742644Z [cluster2]                         "f:storedVersions": {}
2021-07-19T00:17:01.1743103Z [cluster2]                     }
2021-07-19T00:17:01.1743634Z [cluster2]                 },
2021-07-19T00:17:01.1744377Z [cluster2]                 "manager": "submariner-operator",
2021-07-19T00:17:01.1744980Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:01.1745598Z [cluster2]                 "time": "2021-07-19T00:16:05Z"
2021-07-19T00:17:01.1746004Z [cluster2]             }
2021-07-19T00:17:01.1746352Z [cluster2]         ],
2021-07-19T00:17:01.1746881Z [cluster2]         "name": "clusters.submariner.io",
2021-07-19T00:17:01.1747596Z [cluster2]         "resourceVersion": "1717",
2021-07-19T00:17:01.1748595Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/clusters.submariner.io",
2021-07-19T00:17:01.1749926Z [cluster2]         "uid": "fcd5f00f-dbeb-434c-b009-7ea9975b02be"
2021-07-19T00:17:01.1750531Z [cluster2]     },
2021-07-19T00:17:01.1750915Z [cluster2]     "spec": {
2021-07-19T00:17:01.1751334Z [cluster2]         "conversion": {
2021-07-19T00:17:01.1751795Z [cluster2]             "strategy": "None"
2021-07-19T00:17:01.1752201Z [cluster2]         },
2021-07-19T00:17:01.1752652Z [cluster2]         "group": "submariner.io",
2021-07-19T00:17:01.1753107Z [cluster2]         "names": {
2021-07-19T00:17:01.1753536Z [cluster2]             "kind": "Cluster",
2021-07-19T00:17:01.1754026Z [cluster2]             "listKind": "ClusterList",
2021-07-19T00:17:01.1754547Z [cluster2]             "plural": "clusters",
2021-07-19T00:17:01.1755042Z [cluster2]             "singular": "cluster"
2021-07-19T00:17:01.1755458Z [cluster2]         },
2021-07-19T00:17:01.1755893Z [cluster2]         "scope": "Namespaced",
2021-07-19T00:17:01.1756348Z [cluster2]         "versions": [
2021-07-19T00:17:01.1756743Z [cluster2]             {
2021-07-19T00:17:01.1757122Z [cluster2]                 "name": "v1",
2021-07-19T00:17:01.1757543Z [cluster2]                 "schema": {
2021-07-19T00:17:01.1758025Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T00:17:01.1758554Z [cluster2]                         "properties": {
2021-07-19T00:17:01.1759041Z [cluster2]                             "apiVersion": {
2021-07-19T00:17:01.1789120Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:01.1790836Z [cluster2]                                 "type": "string"
2021-07-19T00:17:01.1791302Z [cluster2]                             },
2021-07-19T00:17:01.1791708Z [cluster2]                             "kind": {
2021-07-19T00:17:01.1793842Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:01.1795455Z [cluster2]                                 "type": "string"
2021-07-19T00:17:01.1795886Z [cluster2]                             },
2021-07-19T00:17:01.1796323Z [cluster2]                             "metadata": {
2021-07-19T00:17:01.1796789Z [cluster2]                                 "type": "object"
2021-07-19T00:17:01.1797227Z [cluster2]                             },
2021-07-19T00:17:01.1797644Z [cluster2]                             "spec": {
2021-07-19T00:17:01.1798111Z [cluster2]                                 "properties": {
2021-07-19T00:17:01.1798612Z [cluster2]                                     "cluster_cidr": {
2021-07-19T00:17:01.1799066Z [cluster2]                                         "items": {
2021-07-19T00:17:01.1799538Z [cluster2]                                             "type": "string"
2021-07-19T00:17:01.1799980Z [cluster2]                                         },
2021-07-19T00:17:01.1800442Z [cluster2]                                         "type": "array"
2021-07-19T00:17:01.1800868Z [cluster2]                                     },
2021-07-19T00:17:01.1801309Z [cluster2]                                     "cluster_id": {
2021-07-19T00:17:01.1801790Z [cluster2]                                         "type": "string"
2021-07-19T00:17:01.1802230Z [cluster2]                                     },
2021-07-19T00:17:01.1802670Z [cluster2]                                     "color_codes": {
2021-07-19T00:17:01.1803203Z [cluster2]                                         "items": {
2021-07-19T00:17:01.1803681Z [cluster2]                                             "type": "string"
2021-07-19T00:17:01.1804120Z [cluster2]                                         },
2021-07-19T00:17:01.1804564Z [cluster2]                                         "type": "array"
2021-07-19T00:17:01.1805007Z [cluster2]                                     },
2021-07-19T00:17:01.1805434Z [cluster2]                                     "global_cidr": {
2021-07-19T00:17:01.1805890Z [cluster2]                                         "items": {
2021-07-19T00:17:01.1806501Z [cluster2]                                             "type": "string"
2021-07-19T00:17:01.1806962Z [cluster2]                                         },
2021-07-19T00:17:01.1807398Z [cluster2]                                         "type": "array"
2021-07-19T00:17:01.1807836Z [cluster2]                                     },
2021-07-19T00:17:01.1808278Z [cluster2]                                     "service_cidr": {
2021-07-19T00:17:01.1808750Z [cluster2]                                         "items": {
2021-07-19T00:17:01.1809229Z [cluster2]                                             "type": "string"
2021-07-19T00:17:01.1809673Z [cluster2]                                         },
2021-07-19T00:17:01.1810119Z [cluster2]                                         "type": "array"
2021-07-19T00:17:01.1810547Z [cluster2]                                     }
2021-07-19T00:17:01.1810952Z [cluster2]                                 },
2021-07-19T00:17:01.1811375Z [cluster2]                                 "required": [
2021-07-19T00:17:01.1811863Z [cluster2]                                     "cluster_cidr",
2021-07-19T00:17:01.1812325Z [cluster2]                                     "cluster_id",
2021-07-19T00:17:01.1812799Z [cluster2]                                     "color_codes",
2021-07-19T00:17:01.1813269Z [cluster2]                                     "global_cidr",
2021-07-19T00:17:01.1813893Z [cluster2]                                     "service_cidr"
2021-07-19T00:17:01.1814337Z [cluster2]                                 ],
2021-07-19T00:17:01.1814770Z [cluster2]                                 "type": "object"
2021-07-19T00:17:01.1815212Z [cluster2]                             }
2021-07-19T00:17:01.1815591Z [cluster2]                         },
2021-07-19T00:17:01.1816015Z [cluster2]                         "required": [
2021-07-19T00:17:01.1816514Z [cluster2]                             "spec"
2021-07-19T00:17:01.1816917Z [cluster2]                         ],
2021-07-19T00:17:01.1817328Z [cluster2]                         "type": "object"
2021-07-19T00:17:01.1817860Z [cluster2]                     }
2021-07-19T00:17:01.1818235Z [cluster2]                 },
2021-07-19T00:17:01.1818637Z [cluster2]                 "served": true,
2021-07-19T00:17:01.1819096Z [cluster2]                 "storage": true
2021-07-19T00:17:01.1819492Z [cluster2]             }
2021-07-19T00:17:01.1819860Z [cluster2]         ]
2021-07-19T00:17:01.1820204Z [cluster2]     },
2021-07-19T00:17:01.1820583Z [cluster2]     "status": {
2021-07-19T00:17:01.1821033Z [cluster2]         "acceptedNames": {
2021-07-19T00:17:01.1821526Z [cluster2]             "kind": "Cluster",
2021-07-19T00:17:01.1822015Z [cluster2]             "listKind": "ClusterList",
2021-07-19T00:17:01.1822541Z [cluster2]             "plural": "clusters",
2021-07-19T00:17:01.1823031Z [cluster2]             "singular": "cluster"
2021-07-19T00:17:01.1823572Z [cluster2]         },
2021-07-19T00:17:01.1823987Z [cluster2]         "conditions": [
2021-07-19T00:17:01.1824385Z [cluster2]             {
2021-07-19T00:17:02.1056206Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:54Z",
2021-07-19T00:17:02.1057473Z [cluster2]                 "message": "no conflicts found",
2021-07-19T00:17:02.1059842Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T00:17:02.1060460Z [cluster2]                 "status": "True",
2021-07-19T00:17:02.1061881Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T00:17:02.1062487Z [cluster2]             },
2021-07-19T00:17:02.1062844Z [cluster2]             {
2021-07-19T00:17:02.1063972Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:54Z",
2021-07-19T00:17:02.1064849Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T00:17:02.1065693Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:02.1066470Z [cluster2]                 "status": "True",
2021-07-19T00:17:02.1067268Z [cluster2]                 "type": "Established"
2021-07-19T00:17:02.1067821Z [cluster2]             }
2021-07-19T00:17:02.1068186Z [cluster2]         ],
2021-07-19T00:17:02.1068801Z [cluster2]         "storedVersions": [
2021-07-19T00:17:02.1069473Z [cluster2]             "v1"
2021-07-19T00:17:02.1069962Z [cluster2]         ]
2021-07-19T00:17:02.1070318Z [cluster2]     }
2021-07-19T00:17:02.1070868Z [cluster2] }
2021-07-19T00:17:02.1072133Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-19T00:17:02.1074091Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-19T00:17:02.1076191Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:02.1077931Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:02.1079410Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:02.1081254Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:02.1083147Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:02.1084541Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:02.1087019Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:02.1088760Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-19T00:17:02.1090258Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-19T00:17:02.1092215Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:02.1094530Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T00:17:02.1096328Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T00:17:02.1098588Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-19T00:17:02.1100346Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-19T00:17:02.1101525Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-19T00:17:02.1103005Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T00:17:02.1104754Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T00:17:02.1106330Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T00:17:02.1107860Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T00:17:02.1109598Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-19T00:17:02.1110608Z [cluster2] NAME                        CREATED AT
2021-07-19T00:17:02.1111545Z [cluster2] submariners.submariner.io   2021-07-19T00:15:42Z
2021-07-19T00:17:02.1113108Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:02.1114926Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-19T00:17:02.1116592Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-19T00:17:02.1118287Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-19T00:17:02.1120189Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:02.1121228Z [cluster2] {
2021-07-19T00:17:02.1121896Z [cluster2]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:02.1122748Z [cluster2]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:02.1123467Z [cluster2]     "metadata": {
2021-07-19T00:17:02.1124004Z [cluster2]         "annotations": {
2021-07-19T00:17:02.1125030Z [cluster2]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:02.1125777Z [cluster2]         },
2021-07-19T00:17:02.1139094Z [cluster2]         "creationTimestamp": "2021-07-19T00:15:42Z",
2021-07-19T00:17:02.1139792Z [cluster2]         "generation": 1,
2021-07-19T00:17:02.1140408Z [cluster2]         "managedFields": [
2021-07-19T00:17:02.1140850Z [cluster2]             {
2021-07-19T00:17:02.1151955Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:02.1152761Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:02.1153370Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:02.1153930Z [cluster2]                     "f:status": {
2021-07-19T00:17:02.1154451Z [cluster2]                         "f:acceptedNames": {
2021-07-19T00:17:02.1155051Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:02.1155608Z [cluster2]                             "f:listKind": {},
2021-07-19T00:17:02.1156184Z [cluster2]                             "f:plural": {},
2021-07-19T00:17:02.1156641Z [cluster2]                             "f:singular": {}
2021-07-19T00:17:02.1157182Z [cluster2]                         },
2021-07-19T00:17:02.1157727Z [cluster2]                         "f:conditions": {}
2021-07-19T00:17:02.1158158Z [cluster2]                     }
2021-07-19T00:17:02.1158639Z [cluster2]                 },
2021-07-19T00:17:02.1159632Z [cluster2]                 "manager": "kube-apiserver",
2021-07-19T00:17:02.1160318Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:02.1161087Z [cluster2]                 "time": "2021-07-19T00:15:42Z"
2021-07-19T00:17:02.1161619Z [cluster2]             },
2021-07-19T00:17:02.1161983Z [cluster2]             {
2021-07-19T00:17:02.1162824Z [cluster2]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:02.1163481Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:02.1164107Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:02.1164568Z [cluster2]                     "f:metadata": {
2021-07-19T00:17:02.1165030Z [cluster2]                         "f:annotations": {
2021-07-19T00:17:02.1165475Z [cluster2]                             ".": {},
2021-07-19T00:17:02.1207790Z [cluster2]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:02.1208507Z [cluster2]                         }
2021-07-19T00:17:02.1208881Z [cluster2]                     },
2021-07-19T00:17:02.1209285Z [cluster2]                     "f:spec": {
2021-07-19T00:17:02.1209729Z [cluster2]                         "f:conversion": {
2021-07-19T00:17:02.1210176Z [cluster2]                             ".": {},
2021-07-19T00:17:02.1210604Z [cluster2]                             "f:strategy": {}
2021-07-19T00:17:02.1211043Z [cluster2]                         },
2021-07-19T00:17:02.1211454Z [cluster2]                         "f:group": {},
2021-07-19T00:17:02.1211870Z [cluster2]                         "f:names": {
2021-07-19T00:17:02.1212299Z [cluster2]                             "f:kind": {},
2021-07-19T00:17:02.1212740Z [cluster2]                             "f:listKind": {},
2021-07-19T00:17:02.1213208Z [cluster2]                             "f:plural": {},
2021-07-19T00:17:02.1213848Z [cluster2]                             "f:singular": {}
2021-07-19T00:17:02.1214273Z [cluster2]                         },
2021-07-19T00:17:02.1214674Z [cluster2]                         "f:scope": {},
2021-07-19T00:17:02.1215129Z [cluster2]                         "f:versions": {}
2021-07-19T00:17:02.1215549Z [cluster2]                     },
2021-07-19T00:17:02.1215939Z [cluster2]                     "f:status": {
2021-07-19T00:17:02.1216439Z [cluster2]                         "f:storedVersions": {}
2021-07-19T00:17:02.1216893Z [cluster2]                     }
2021-07-19T00:17:02.1217304Z [cluster2]                 },
2021-07-19T00:17:02.1217722Z [cluster2]                 "manager": "subctl",
2021-07-19T00:17:02.1218222Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:02.1218921Z [cluster2]                 "time": "2021-07-19T00:15:42Z"
2021-07-19T00:17:02.1219433Z [cluster2]             }
2021-07-19T00:17:02.1219786Z [cluster2]         ],
2021-07-19T00:17:02.1220359Z [cluster2]         "name": "submariners.submariner.io",
2021-07-19T00:17:02.1221032Z [cluster2]         "resourceVersion": "1541",
2021-07-19T00:17:02.1222184Z [cluster2]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-19T00:17:02.1223487Z [cluster2]         "uid": "bc541ac5-8f78-4580-8f3c-2b26eb8c06f3"
2021-07-19T00:17:02.1224014Z [cluster2]     },
2021-07-19T00:17:02.1224397Z [cluster2]     "spec": {
2021-07-19T00:17:02.1224811Z [cluster2]         "conversion": {
2021-07-19T00:17:02.1225279Z [cluster2]             "strategy": "None"
2021-07-19T00:17:02.1225678Z [cluster2]         },
2021-07-19T00:17:02.1226131Z [cluster2]         "group": "submariner.io",
2021-07-19T00:17:02.1226586Z [cluster2]         "names": {
2021-07-19T00:17:02.1227037Z [cluster2]             "kind": "Submariner",
2021-07-19T00:17:02.1227580Z [cluster2]             "listKind": "SubmarinerList",
2021-07-19T00:17:02.1228131Z [cluster2]             "plural": "submariners",
2021-07-19T00:17:02.1228661Z [cluster2]             "singular": "submariner"
2021-07-19T00:17:02.1229089Z [cluster2]         },
2021-07-19T00:17:02.1229522Z [cluster2]         "scope": "Namespaced",
2021-07-19T00:17:02.1229978Z [cluster2]         "versions": [
2021-07-19T00:17:02.1230372Z [cluster2]             {
2021-07-19T00:17:02.1230779Z [cluster2]                 "name": "v1alpha1",
2021-07-19T00:17:02.1231228Z [cluster2]                 "schema": {
2021-07-19T00:17:02.1231714Z [cluster2]                     "openAPIV3Schema": {
2021-07-19T00:17:02.1232519Z [cluster2]                         "description": "Submariner is the Schema for the submariners API",
2021-07-19T00:17:02.1233191Z [cluster2]                         "properties": {
2021-07-19T00:17:02.1233671Z [cluster2]                             "apiVersion": {
2021-07-19T00:17:02.1235749Z [cluster2]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:02.1237469Z [cluster2]                                 "type": "string"
2021-07-19T00:17:02.1237910Z [cluster2]                             },
2021-07-19T00:17:02.1238329Z [cluster2]                             "kind": {
2021-07-19T00:17:02.1241114Z [cluster2]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:02.1242859Z [cluster2]                                 "type": "string"
2021-07-19T00:17:02.1243415Z [cluster2]                             },
2021-07-19T00:17:02.1243924Z [cluster2]                             "metadata": {
2021-07-19T00:17:02.1244590Z [cluster2]                                 "type": "object"
2021-07-19T00:17:02.1245119Z [cluster2]                             },
2021-07-19T00:17:02.1245608Z [cluster2]                             "spec": {
2021-07-19T00:17:02.1246506Z [cluster2]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T00:17:02.1247333Z [cluster2]                                 "properties": {
2021-07-19T00:17:02.1247914Z [cluster2]                                     "broker": {
2021-07-19T00:17:02.1248500Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1249027Z [cluster2]                                     },
2021-07-19T00:17:02.1249643Z [cluster2]                                     "brokerK8sApiServer": {
2021-07-19T00:17:02.1250299Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1250815Z [cluster2]                                     },
2021-07-19T00:17:02.1251504Z [cluster2]                                     "brokerK8sApiServerToken": {
2021-07-19T00:17:02.1252203Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1252730Z [cluster2]                                     },
2021-07-19T00:17:02.1253270Z [cluster2]                                     "brokerK8sCA": {
2021-07-19T00:17:02.1253845Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1254380Z [cluster2]                                     },
2021-07-19T00:17:02.1255044Z [cluster2]                                     "brokerK8sRemoteNamespace": {
2021-07-19T00:17:02.1255765Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1256293Z [cluster2]                                     },
2021-07-19T00:17:02.1256828Z [cluster2]                                     "cableDriver": {
2021-07-19T00:17:02.1257410Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1257921Z [cluster2]                                     },
2021-07-19T00:17:02.1258478Z [cluster2]                                     "ceIPSecDebug": {
2021-07-19T00:17:02.1259086Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1259610Z [cluster2]                                     },
2021-07-19T00:17:02.1260260Z [cluster2]                                     "ceIPSecForceUDPEncaps": {
2021-07-19T00:17:02.1261050Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1261584Z [cluster2]                                     },
2021-07-19T00:17:02.1262163Z [cluster2]                                     "ceIPSecIKEPort": {
2021-07-19T00:17:02.1262776Z [cluster2]                                         "type": "integer"
2021-07-19T00:17:02.1263317Z [cluster2]                                     },
2021-07-19T00:17:02.1263890Z [cluster2]                                     "ceIPSecNATTPort": {
2021-07-19T00:17:02.1264514Z [cluster2]                                         "type": "integer"
2021-07-19T00:17:02.1265051Z [cluster2]                                     },
2021-07-19T00:17:02.1265598Z [cluster2]                                     "ceIPSecPSK": {
2021-07-19T00:17:02.1266170Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1266702Z [cluster2]                                     },
2021-07-19T00:17:02.1267354Z [cluster2]                                     "ceIPSecPreferredServer": {
2021-07-19T00:17:02.1268850Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1269525Z [cluster2]                                     },
2021-07-19T00:17:02.1270066Z [cluster2]                                     "clusterCIDR": {
2021-07-19T00:17:02.1270650Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1271169Z [cluster2]                                     },
2021-07-19T00:17:02.1271709Z [cluster2]                                     "clusterID": {
2021-07-19T00:17:02.1272392Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1272904Z [cluster2]                                     },
2021-07-19T00:17:02.1273440Z [cluster2]                                     "colorCodes": {
2021-07-19T00:17:02.1274017Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1274535Z [cluster2]                                     },
2021-07-19T00:17:02.1275180Z [cluster2]                                     "connectionHealthCheck": {
2021-07-19T00:17:02.1275867Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.1276453Z [cluster2]                                             "enabled": {
2021-07-19T00:17:02.1277040Z [cluster2]                                                 "type": "boolean"
2021-07-19T00:17:02.1277578Z [cluster2]                                             },
2021-07-19T00:17:02.1278168Z [cluster2]                                             "intervalSeconds": {
2021-07-19T00:17:02.1278974Z [cluster2]                                                 "description": "The interval at which health check pings are sent.",
2021-07-19T00:17:02.1282880Z [cluster2]                                                 "format": "int64",
2021-07-19T00:17:02.1283544Z [cluster2]                                                 "type": "integer"
2021-07-19T00:17:02.1284253Z [cluster2]                                             },
2021-07-19T00:17:02.1285012Z [cluster2]                                             "maxPacketLossCount": {
2021-07-19T00:17:02.1287303Z [cluster2]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T00:17:02.1288330Z [cluster2]                                                 "format": "int64",
2021-07-19T00:17:02.1289067Z [cluster2]                                                 "type": "integer"
2021-07-19T00:17:02.1289760Z [cluster2]                                             }
2021-07-19T00:17:02.1290372Z [cluster2]                                         },
2021-07-19T00:17:02.1291015Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.1291653Z [cluster2]                                     },
2021-07-19T00:17:02.1292409Z [cluster2]                                     "coreDNSCustomConfig": {
2021-07-19T00:17:02.1293339Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.1294092Z [cluster2]                                             "configMapName": {
2021-07-19T00:17:02.1294839Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1295507Z [cluster2]                                             },
2021-07-19T00:17:02.1296060Z [cluster2]                                             "namespace": {
2021-07-19T00:17:02.1304463Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1305229Z [cluster2]                                             }
2021-07-19T00:17:02.1305852Z [cluster2]                                         },
2021-07-19T00:17:02.1306416Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.1307063Z [cluster2]                                     },
2021-07-19T00:17:02.1307750Z [cluster2]                                     "customDomains": {
2021-07-19T00:17:02.1308467Z [cluster2]                                         "items": {
2021-07-19T00:17:02.1309135Z [cluster2]                                             "type": "string"
2021-07-19T00:17:02.1309836Z [cluster2]                                         },
2021-07-19T00:17:02.1310466Z [cluster2]                                         "type": "array",
2021-07-19T00:17:02.1311663Z [cluster2]                                         "x-kubernetes-list-type": "set"
2021-07-19T00:17:02.1312474Z [cluster2]                                     },
2021-07-19T00:17:02.1313286Z [cluster2]                                     "debug": {
2021-07-19T00:17:02.1313969Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1314622Z [cluster2]                                     },
2021-07-19T00:17:02.1315346Z [cluster2]                                     "globalCIDR": {
2021-07-19T00:17:02.1316067Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1316714Z [cluster2]                                     },
2021-07-19T00:17:02.1317406Z [cluster2]                                     "imageOverrides": {
2021-07-19T00:17:02.1318459Z [cluster2]                                         "additionalProperties": {
2021-07-19T00:17:02.1319344Z [cluster2]                                             "type": "string"
2021-07-19T00:17:02.1320052Z [cluster2]                                         },
2021-07-19T00:17:02.1320750Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.1321496Z [cluster2]                                     },
2021-07-19T00:17:02.1322234Z [cluster2]                                     "loadBalancerEnabled": {
2021-07-19T00:17:02.1323070Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1323790Z [cluster2]                                     },
2021-07-19T00:17:02.1324666Z [cluster2]                                     "namespace": {
2021-07-19T00:17:02.1325372Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1325928Z [cluster2]                                     },
2021-07-19T00:17:02.1326816Z [cluster2]                                     "natEnabled": {
2021-07-19T00:17:02.1327649Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1328365Z [cluster2]                                     },
2021-07-19T00:17:02.1329213Z [cluster2]                                     "repository": {
2021-07-19T00:17:02.1329988Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1330554Z [cluster2]                                     },
2021-07-19T00:17:02.1331285Z [cluster2]                                     "serviceCIDR": {
2021-07-19T00:17:02.1333657Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1334441Z [cluster2]                                     },
2021-07-19T00:17:02.1335193Z [cluster2]                                     "serviceDiscoveryEnabled": {
2021-07-19T00:17:02.1561131Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.1561743Z [cluster2]                                     },
2021-07-19T00:17:02.1562285Z [cluster2]                                     "version": {
2021-07-19T00:17:02.1562836Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1563370Z [cluster2]                                     }
2021-07-19T00:17:02.1563873Z [cluster2]                                 },
2021-07-19T00:17:02.1564571Z [cluster2]                                 "required": [
2021-07-19T00:17:02.1565106Z [cluster2]                                     "broker",
2021-07-19T00:17:02.1565852Z [cluster2]                                     "brokerK8sApiServer",
2021-07-19T00:17:02.1566825Z [cluster2]                                     "brokerK8sApiServerToken",
2021-07-19T00:17:02.1568101Z [cluster2]                                     "brokerK8sCA",
2021-07-19T00:17:02.1568969Z [cluster2]                                     "brokerK8sRemoteNamespace",
2021-07-19T00:17:02.1569841Z [cluster2]                                     "ceIPSecDebug",
2021-07-19T00:17:02.1570582Z [cluster2]                                     "ceIPSecPSK",
2021-07-19T00:17:02.1571356Z [cluster2]                                     "clusterCIDR",
2021-07-19T00:17:02.1572116Z [cluster2]                                     "clusterID",
2021-07-19T00:17:02.1572894Z [cluster2]                                     "debug",
2021-07-19T00:17:02.1573716Z [cluster2]                                     "namespace",
2021-07-19T00:17:02.1574475Z [cluster2]                                     "natEnabled",
2021-07-19T00:17:02.1575178Z [cluster2]                                     "serviceCIDR"
2021-07-19T00:17:02.1575849Z [cluster2]                                 ],
2021-07-19T00:17:02.1576381Z [cluster2]                                 "type": "object"
2021-07-19T00:17:02.1577019Z [cluster2]                             },
2021-07-19T00:17:02.1577654Z [cluster2]                             "status": {
2021-07-19T00:17:02.1578575Z [cluster2]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T00:17:02.1579650Z [cluster2]                                 "properties": {
2021-07-19T00:17:02.1580351Z [cluster2]                                     "clusterCIDR": {
2021-07-19T00:17:02.1581063Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1581628Z [cluster2]                                     },
2021-07-19T00:17:02.1582283Z [cluster2]                                     "clusterID": {
2021-07-19T00:17:02.1582973Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1583637Z [cluster2]                                     },
2021-07-19T00:17:02.1584274Z [cluster2]                                     "colorCodes": {
2021-07-19T00:17:02.1584976Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1585612Z [cluster2]                                     },
2021-07-19T00:17:02.1586231Z [cluster2]                                     "deploymentInfo": {
2021-07-19T00:17:02.1586994Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.1587721Z [cluster2]                                             "cloudProvider": {
2021-07-19T00:17:02.1588464Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1589132Z [cluster2]                                             },
2021-07-19T00:17:02.1589821Z [cluster2]                                             "kubernetesType": {
2021-07-19T00:17:02.1590578Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1591238Z [cluster2]                                             },
2021-07-19T00:17:02.1592064Z [cluster2]                                             "kubernetesTypeVersion": {
2021-07-19T00:17:02.1592988Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1593685Z [cluster2]                                             },
2021-07-19T00:17:02.1594437Z [cluster2]                                             "kubernetesVersion": {
2021-07-19T00:17:02.1595204Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1595878Z [cluster2]                                             }
2021-07-19T00:17:02.1596517Z [cluster2]                                         },
2021-07-19T00:17:02.1597161Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.1597818Z [cluster2]                                     },
2021-07-19T00:17:02.1598611Z [cluster2]                                     "gatewayDaemonSetStatus": {
2021-07-19T00:17:02.1599448Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.1600276Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T00:17:02.1601061Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1601837Z [cluster2]                                             },
2021-07-19T00:17:02.1602664Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.1603543Z [cluster2]                                                 "type": "boolean"
2021-07-19T00:17:02.1604234Z [cluster2]                                             },
2021-07-19T00:17:02.1605013Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.1605814Z [cluster2]                                                 "items": {
2021-07-19T00:17:02.1607255Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.1608651Z [cluster2]                                                     "properties": {
2021-07-19T00:17:02.1609248Z [cluster2]                                                         "running": {
2021-07-19T00:17:02.1609990Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.1618458Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.1619191Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.1620616Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.1621597Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.1622230Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1622815Z [cluster2]                                                                 }
2021-07-19T00:17:02.1623360Z [cluster2]                                                             },
2021-07-19T00:17:02.1623910Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.1624470Z [cluster2]                                                         },
2021-07-19T00:17:02.1625043Z [cluster2]                                                         "terminated": {
2021-07-19T00:17:02.1625970Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.1626737Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.1627373Z [cluster2]                                                                 "containerID": {
2021-07-19T00:17:02.1628654Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.1629499Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1630073Z [cluster2]                                                                 },
2021-07-19T00:17:02.1630631Z [cluster2]                                                                 "exitCode": {
2021-07-19T00:17:02.1631434Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.1632225Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.1632831Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.1633402Z [cluster2]                                                                 },
2021-07-19T00:17:02.1633981Z [cluster2]                                                                 "finishedAt": {
2021-07-19T00:17:02.1634765Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.1635767Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.1636409Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1636955Z [cluster2]                                                                 },
2021-07-19T00:17:02.1637618Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.1638439Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.1639435Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1640010Z [cluster2]                                                                 },
2021-07-19T00:17:02.1640536Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.1641326Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.1642115Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1642674Z [cluster2]                                                                 },
2021-07-19T00:17:02.1643219Z [cluster2]                                                                 "signal": {
2021-07-19T00:17:02.1643986Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.1644746Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.1645362Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.1645967Z [cluster2]                                                                 },
2021-07-19T00:17:02.1665439Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.1666367Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.1667646Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.1668285Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1669401Z [cluster2]                                                                 }
2021-07-19T00:17:02.1670006Z [cluster2]                                                             },
2021-07-19T00:17:02.1670735Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.1671415Z [cluster2]                                                                 "exitCode"
2021-07-19T00:17:02.1671976Z [cluster2]                                                             ],
2021-07-19T00:17:02.1672545Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.1673109Z [cluster2]                                                         },
2021-07-19T00:17:02.1673647Z [cluster2]                                                         "waiting": {
2021-07-19T00:17:02.1674360Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.1675107Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.1675702Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.1676505Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.1677399Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1677957Z [cluster2]                                                                 },
2021-07-19T00:17:02.1678508Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.1679339Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.1680102Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1680688Z [cluster2]                                                                 }
2021-07-19T00:17:02.1681197Z [cluster2]                                                             },
2021-07-19T00:17:02.1681763Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.1682327Z [cluster2]                                                         }
2021-07-19T00:17:02.1682827Z [cluster2]                                                     },
2021-07-19T00:17:02.1683377Z [cluster2]                                                     "type": "object"
2021-07-19T00:17:02.1683921Z [cluster2]                                                 },
2021-07-19T00:17:02.1684454Z [cluster2]                                                 "type": "array"
2021-07-19T00:17:02.1684992Z [cluster2]                                             },
2021-07-19T00:17:02.1685504Z [cluster2]                                             "status": {
2021-07-19T00:17:02.1686403Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.1687268Z [cluster2]                                                 "properties": {
2021-07-19T00:17:02.1687898Z [cluster2]                                                     "collisionCount": {
2021-07-19T00:17:02.1689202Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.1690466Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1691082Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1691637Z [cluster2]                                                     },
2021-07-19T00:17:02.1692199Z [cluster2]                                                     "conditions": {
2021-07-19T00:17:02.1693516Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.1694411Z [cluster2]                                                         "items": {
2021-07-19T00:17:02.1695300Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.1696216Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.1696898Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.1697809Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.1698879Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.1699516Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1700092Z [cluster2]                                                                 },
2021-07-19T00:17:02.1700636Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.1701474Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.1702314Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1702960Z [cluster2]                                                                 },
2021-07-19T00:17:02.1703511Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.1704510Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.1705274Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1705838Z [cluster2]                                                                 },
2021-07-19T00:17:02.1706389Z [cluster2]                                                                 "status": {
2021-07-19T00:17:02.1707145Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.1707923Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1708485Z [cluster2]                                                                 },
2021-07-19T00:17:02.1709015Z [cluster2]                                                                 "type": {
2021-07-19T00:17:02.1709720Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.1710450Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.1710999Z [cluster2]                                                                 }
2021-07-19T00:17:02.1711523Z [cluster2]                                                             },
2021-07-19T00:17:02.1712067Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.1712646Z [cluster2]                                                                 "status",
2021-07-19T00:17:02.1713209Z [cluster2]                                                                 "type"
2021-07-19T00:17:02.1713730Z [cluster2]                                                             ],
2021-07-19T00:17:02.1714285Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.1714837Z [cluster2]                                                         },
2021-07-19T00:17:02.1715453Z [cluster2]                                                         "type": "array"
2021-07-19T00:17:02.1716008Z [cluster2]                                                     },
2021-07-19T00:17:02.1766757Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.1768531Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.1770280Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1772911Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1773855Z [cluster2]                                                     },
2021-07-19T00:17:02.1774819Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.1776882Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.1778334Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1782310Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1839311Z [cluster2]                                                     },
2021-07-19T00:17:02.1844104Z [cluster2]                                                     "numberAvailable": {
2021-07-19T00:17:02.1847734Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.1848798Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1849311Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1849792Z [cluster2]                                                     },
2021-07-19T00:17:02.1850472Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.1851805Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.1853039Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1853633Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1854306Z [cluster2]                                                     },
2021-07-19T00:17:02.1854886Z [cluster2]                                                     "numberReady": {
2021-07-19T00:17:02.1855922Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.1856934Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1857536Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1858098Z [cluster2]                                                     },
2021-07-19T00:17:02.1858711Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T00:17:02.1860165Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.1861258Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1862031Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1862595Z [cluster2]                                                     },
2021-07-19T00:17:02.1863215Z [cluster2]                                                     "observedGeneration": {
2021-07-19T00:17:02.1864129Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.1864955Z [cluster2]                                                         "format": "int64",
2021-07-19T00:17:02.1865546Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1866102Z [cluster2]                                                     },
2021-07-19T00:17:02.1866771Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.1867687Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.1868465Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.1869055Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.1869617Z [cluster2]                                                     }
2021-07-19T00:17:02.1870235Z [cluster2]                                                 },
2021-07-19T00:17:02.1870794Z [cluster2]                                                 "required": [
2021-07-19T00:17:02.1871498Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.1872306Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.1873094Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T00:17:02.1873788Z [cluster2]                                                     "numberReady"
2021-07-19T00:17:02.1874341Z [cluster2]                                                 ],
2021-07-19T00:17:02.1874919Z [cluster2]                                                 "type": "object"
2021-07-19T00:17:02.1875462Z [cluster2]                                             }
2021-07-19T00:17:02.1875949Z [cluster2]                                         },
2021-07-19T00:17:02.1876559Z [cluster2]                                         "required": [
2021-07-19T00:17:02.1877292Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.1877994Z [cluster2]                                         ],
2021-07-19T00:17:02.1878533Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.1879050Z [cluster2]                                     },
2021-07-19T00:17:02.1879586Z [cluster2]                                     "gateways": {
2021-07-19T00:17:02.1880136Z [cluster2]                                         "items": {
2021-07-19T00:17:02.1880635Z [cluster2]                                             "properties": {
2021-07-19T00:17:02.1881255Z [cluster2]                                                 "connections": {
2021-07-19T00:17:02.1881827Z [cluster2]                                                     "items": {
2021-07-19T00:17:02.1882410Z [cluster2]                                                         "properties": {
2021-07-19T00:17:02.1883029Z [cluster2]                                                             "endpoint": {
2021-07-19T00:17:02.1883623Z [cluster2]                                                                 "properties": {
2021-07-19T00:17:02.1884231Z [cluster2]                                                                     "backend": {
2021-07-19T00:17:02.1884902Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1885473Z [cluster2]                                                                     },
2021-07-19T00:17:02.1886064Z [cluster2]                                                                     "backend_config": {
2021-07-19T00:17:02.1887130Z [cluster2]                                                                         "additionalProperties": {
2021-07-19T00:17:02.1887855Z [cluster2]                                                                             "type": "string"
2021-07-19T00:17:02.1888429Z [cluster2]                                                                         },
2021-07-19T00:17:02.1888998Z [cluster2]                                                                         "type": "object"
2021-07-19T00:17:02.1889573Z [cluster2]                                                                     },
2021-07-19T00:17:02.1890117Z [cluster2]                                                                     "cable_name": {
2021-07-19T00:17:02.1890711Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1891285Z [cluster2]                                                                     },
2021-07-19T00:17:02.1891857Z [cluster2]                                                                     "cluster_id": {
2021-07-19T00:17:02.1892455Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1893149Z [cluster2]                                                                     },
2021-07-19T00:17:02.1893946Z [cluster2]                                                                     "healthCheckIP": {
2021-07-19T00:17:02.1894594Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1895172Z [cluster2]                                                                     },
2021-07-19T00:17:02.1895730Z [cluster2]                                                                     "hostname": {
2021-07-19T00:17:02.1896353Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1896920Z [cluster2]                                                                     },
2021-07-19T00:17:02.1897482Z [cluster2]                                                                     "nat_enabled": {
2021-07-19T00:17:02.1898109Z [cluster2]                                                                         "type": "boolean"
2021-07-19T00:17:02.1898689Z [cluster2]                                                                     },
2021-07-19T00:17:02.1899247Z [cluster2]                                                                     "private_ip": {
2021-07-19T00:17:02.1899857Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1900437Z [cluster2]                                                                     },
2021-07-19T00:17:02.1900989Z [cluster2]                                                                     "public_ip": {
2021-07-19T00:17:02.1901586Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1902162Z [cluster2]                                                                     },
2021-07-19T00:17:02.1902713Z [cluster2]                                                                     "subnets": {
2021-07-19T00:17:02.1903300Z [cluster2]                                                                         "items": {
2021-07-19T00:17:02.1903888Z [cluster2]                                                                             "type": "string"
2021-07-19T00:17:02.1904472Z [cluster2]                                                                         },
2021-07-19T00:17:02.1905048Z [cluster2]                                                                         "type": "array"
2021-07-19T00:17:02.1905668Z [cluster2]                                                                     }
2021-07-19T00:17:02.1906202Z [cluster2]                                                                 },
2021-07-19T00:17:02.1906771Z [cluster2]                                                                 "required": [
2021-07-19T00:17:02.1907351Z [cluster2]                                                                     "backend",
2021-07-19T00:17:02.1907939Z [cluster2]                                                                     "cable_name",
2021-07-19T00:17:02.1908546Z [cluster2]                                                                     "cluster_id",
2021-07-19T00:17:02.1909133Z [cluster2]                                                                     "hostname",
2021-07-19T00:17:02.1909726Z [cluster2]                                                                     "nat_enabled",
2021-07-19T00:17:02.1910329Z [cluster2]                                                                     "private_ip",
2021-07-19T00:17:02.1910930Z [cluster2]                                                                     "public_ip",
2021-07-19T00:17:02.1911521Z [cluster2]                                                                     "subnets"
2021-07-19T00:17:02.1912059Z [cluster2]                                                                 ],
2021-07-19T00:17:02.1912630Z [cluster2]                                                                 "type": "object"
2021-07-19T00:17:02.1913415Z [cluster2]                                                             },
2021-07-19T00:17:02.1914035Z [cluster2]                                                             "latencyRTT": {
2021-07-19T00:17:02.1915035Z [cluster2]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T00:17:02.1916030Z [cluster2]                                                                 "properties": {
2021-07-19T00:17:02.1916624Z [cluster2]                                                                     "average": {
2021-07-19T00:17:02.1917227Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1917794Z [cluster2]                                                                     },
2021-07-19T00:17:02.1928080Z [cluster2]                                                                     "last": {
2021-07-19T00:17:02.1928726Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1929302Z [cluster2]                                                                     },
2021-07-19T00:17:02.1929858Z [cluster2]                                                                     "max": {
2021-07-19T00:17:02.1930444Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1931002Z [cluster2]                                                                     },
2021-07-19T00:17:02.1931568Z [cluster2]                                                                     "min": {
2021-07-19T00:17:02.1932154Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1932714Z [cluster2]                                                                     },
2021-07-19T00:17:02.1933254Z [cluster2]                                                                     "stdDev": {
2021-07-19T00:17:02.1933856Z [cluster2]                                                                         "type": "string"
2021-07-19T00:17:02.1934422Z [cluster2]                                                                     }
2021-07-19T00:17:02.1934952Z [cluster2]                                                                 },
2021-07-19T00:17:02.1935510Z [cluster2]                                                                 "type": "object"
2021-07-19T00:17:02.1936199Z [cluster2]                                                             },
2021-07-19T00:17:02.1936756Z [cluster2]                                                             "status": {
2021-07-19T00:17:02.1937321Z [cluster2]                                                                 "type": "string"
2021-07-19T00:17:02.1937875Z [cluster2]                                                             },
2021-07-19T00:17:02.1938469Z [cluster2]                                                             "statusMessage": {
2021-07-19T00:17:02.1939096Z [cluster2]                                                                 "type": "string"
2021-07-19T00:17:02.1939664Z [cluster2]                                                             },
2021-07-19T00:17:02.1940224Z [cluster2]                                                             "usingIP": {
2021-07-19T00:17:02.1940803Z [cluster2]                                                                 "type": "string"
2021-07-19T00:17:02.1941365Z [cluster2]                                                             },
2021-07-19T00:17:02.1941918Z [cluster2]                                                             "usingNAT": {
2021-07-19T00:17:02.1942523Z [cluster2]                                                                 "type": "boolean"
2021-07-19T00:17:02.1943095Z [cluster2]                                                             }
2021-07-19T00:17:02.1943609Z [cluster2]                                                         },
2021-07-19T00:17:02.1944246Z [cluster2]                                                         "required": [
2021-07-19T00:17:02.1944849Z [cluster2]                                                             "endpoint",
2021-07-19T00:17:02.1945415Z [cluster2]                                                             "status",
2021-07-19T00:17:02.1946033Z [cluster2]                                                             "statusMessage"
2021-07-19T00:17:02.1946612Z [cluster2]                                                         ],
2021-07-19T00:17:02.1947178Z [cluster2]                                                         "type": "object"
2021-07-19T00:17:02.1947734Z [cluster2]                                                     },
2021-07-19T00:17:02.1948267Z [cluster2]                                                     "type": "array"
2021-07-19T00:17:02.1948806Z [cluster2]                                                 },
2021-07-19T00:17:02.1949341Z [cluster2]                                                 "haStatus": {
2021-07-19T00:17:02.1949996Z [cluster2]                                                     "type": "string"
2021-07-19T00:17:02.1950547Z [cluster2]                                                 },
2021-07-19T00:17:02.1951109Z [cluster2]                                                 "localEndpoint": {
2021-07-19T00:17:02.1951739Z [cluster2]                                                     "properties": {
2021-07-19T00:17:02.1952347Z [cluster2]                                                         "backend": {
2021-07-19T00:17:02.1952922Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1953481Z [cluster2]                                                         },
2021-07-19T00:17:02.1954057Z [cluster2]                                                         "backend_config": {
2021-07-19T00:17:02.1954757Z [cluster2]                                                             "additionalProperties": {
2021-07-19T00:17:02.1955457Z [cluster2]                                                                 "type": "string"
2021-07-19T00:17:02.1956020Z [cluster2]                                                             },
2021-07-19T00:17:02.1956561Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.1957115Z [cluster2]                                                         },
2021-07-19T00:17:02.1957719Z [cluster2]                                                         "cable_name": {
2021-07-19T00:17:02.1958324Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1958867Z [cluster2]                                                         },
2021-07-19T00:17:02.1959408Z [cluster2]                                                         "cluster_id": {
2021-07-19T00:17:02.1960001Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1960563Z [cluster2]                                                         },
2021-07-19T00:17:02.1961147Z [cluster2]                                                         "healthCheckIP": {
2021-07-19T00:17:02.1961782Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1962325Z [cluster2]                                                         },
2021-07-19T00:17:02.1962884Z [cluster2]                                                         "hostname": {
2021-07-19T00:17:02.1963475Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1964018Z [cluster2]                                                         },
2021-07-19T00:17:02.1964561Z [cluster2]                                                         "nat_enabled": {
2021-07-19T00:17:02.1965165Z [cluster2]                                                             "type": "boolean"
2021-07-19T00:17:02.1965714Z [cluster2]                                                         },
2021-07-19T00:17:02.1966410Z [cluster2]                                                         "private_ip": {
2021-07-19T00:17:02.1967000Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1967559Z [cluster2]                                                         },
2021-07-19T00:17:02.1968106Z [cluster2]                                                         "public_ip": {
2021-07-19T00:17:02.1968689Z [cluster2]                                                             "type": "string"
2021-07-19T00:17:02.1969249Z [cluster2]                                                         },
2021-07-19T00:17:02.1969793Z [cluster2]                                                         "subnets": {
2021-07-19T00:17:02.1970325Z [cluster2]                                                             "items": {
2021-07-19T00:17:02.1970901Z [cluster2]                                                                 "type": "string"
2021-07-19T00:17:02.1971469Z [cluster2]                                                             },
2021-07-19T00:17:02.1972007Z [cluster2]                                                             "type": "array"
2021-07-19T00:17:02.1972550Z [cluster2]                                                         }
2021-07-19T00:17:02.1973052Z [cluster2]                                                     },
2021-07-19T00:17:02.1973604Z [cluster2]                                                     "required": [
2021-07-19T00:17:02.1974197Z [cluster2]                                                         "backend",
2021-07-19T00:17:02.1975261Z [cluster2]                                                         "cable_name",
2021-07-19T00:17:02.1976089Z [cluster2]                                                         "cluster_id",
2021-07-19T00:17:02.1976759Z [cluster2]                                                         "hostname",
2021-07-19T00:17:02.1977489Z [cluster2]                                                         "nat_enabled",
2021-07-19T00:17:02.1978171Z [cluster2]                                                         "private_ip",
2021-07-19T00:17:02.1978806Z [cluster2]                                                         "public_ip",
2021-07-19T00:17:02.1979536Z [cluster2]                                                         "subnets"
2021-07-19T00:17:02.1980028Z [cluster2]                                                     ],
2021-07-19T00:17:02.1980830Z [cluster2]                                                     "type": "object"
2021-07-19T00:17:02.1981480Z [cluster2]                                                 },
2021-07-19T00:17:02.1982206Z [cluster2]                                                 "statusFailure": {
2021-07-19T00:17:02.1982907Z [cluster2]                                                     "type": "string"
2021-07-19T00:17:02.1983539Z [cluster2]                                                 },
2021-07-19T00:17:02.1984129Z [cluster2]                                                 "version": {
2021-07-19T00:17:02.1984667Z [cluster2]                                                     "type": "string"
2021-07-19T00:17:02.1985287Z [cluster2]                                                 }
2021-07-19T00:17:02.1985911Z [cluster2]                                             },
2021-07-19T00:17:02.1986511Z [cluster2]                                             "required": [
2021-07-19T00:17:02.1987166Z [cluster2]                                                 "connections",
2021-07-19T00:17:02.1987721Z [cluster2]                                                 "haStatus",
2021-07-19T00:17:02.1988408Z [cluster2]                                                 "localEndpoint",
2021-07-19T00:17:02.1989118Z [cluster2]                                                 "statusFailure",
2021-07-19T00:17:02.1989870Z [cluster2]                                                 "version"
2021-07-19T00:17:02.1990891Z [cluster2]                                             ],
2021-07-19T00:17:02.1991724Z [cluster2]                                             "type": "object"
2021-07-19T00:17:02.1992423Z [cluster2]                                         },
2021-07-19T00:17:02.1993003Z [cluster2]                                         "type": "array"
2021-07-19T00:17:02.1993481Z [cluster2]                                     },
2021-07-19T00:17:02.1994167Z [cluster2]                                     "globalCIDR": {
2021-07-19T00:17:02.1994821Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.1995429Z [cluster2]                                     },
2021-07-19T00:17:02.1996165Z [cluster2]                                     "globalnetDaemonSetStatus": {
2021-07-19T00:17:02.1997052Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.1997878Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T00:17:02.1998689Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.1999381Z [cluster2]                                             },
2021-07-19T00:17:02.2000215Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.2001127Z [cluster2]                                                 "type": "boolean"
2021-07-19T00:17:02.2001821Z [cluster2]                                             },
2021-07-19T00:17:02.2002633Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.2003494Z [cluster2]                                                 "items": {
2021-07-19T00:17:02.2005407Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.2007044Z [cluster2]                                                     "properties": {
2021-07-19T00:17:02.2009974Z [cluster2]                                                         "running": {
2021-07-19T00:17:02.2010773Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.2011511Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2012135Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.2013652Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.2015212Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2016028Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2016738Z [cluster2]                                                                 }
2021-07-19T00:17:02.2017576Z [cluster2]                                                             },
2021-07-19T00:17:02.2018444Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2019158Z [cluster2]                                                         },
2021-07-19T00:17:02.2019945Z [cluster2]                                                         "terminated": {
2021-07-19T00:17:02.2020851Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.2021736Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2022907Z [cluster2]                                                                 "containerID": {
2021-07-19T00:17:02.2024549Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.2026204Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2026924Z [cluster2]                                                                 },
2021-07-19T00:17:02.2027491Z [cluster2]                                                                 "exitCode": {
2021-07-19T00:17:02.2028453Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.2029421Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.2030036Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.2030599Z [cluster2]                                                                 },
2021-07-19T00:17:02.2031194Z [cluster2]                                                                 "finishedAt": {
2021-07-19T00:17:02.2031964Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.2033018Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2033662Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2034225Z [cluster2]                                                                 },
2021-07-19T00:17:02.2034777Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2035581Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.2036444Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2037011Z [cluster2]                                                                 },
2021-07-19T00:17:02.2037568Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2038336Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.2039129Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2039783Z [cluster2]                                                                 },
2021-07-19T00:17:02.2040327Z [cluster2]                                                                 "signal": {
2021-07-19T00:17:02.2041091Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.2041873Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.2042475Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.2043049Z [cluster2]                                                                 },
2021-07-19T00:17:02.2043587Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.2044407Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.2045463Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2046091Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2047046Z [cluster2]                                                                 }
2021-07-19T00:17:02.2047575Z [cluster2]                                                             },
2021-07-19T00:17:02.2048118Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.2048827Z [cluster2]                                                                 "exitCode"
2021-07-19T00:17:02.2049383Z [cluster2]                                                             ],
2021-07-19T00:17:02.2050099Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2050802Z [cluster2]                                                         },
2021-07-19T00:17:02.2051340Z [cluster2]                                                         "waiting": {
2021-07-19T00:17:02.2052053Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.2052791Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2053389Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2054348Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.2055356Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2056087Z [cluster2]                                                                 },
2021-07-19T00:17:02.2056777Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2057670Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.2058563Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2059281Z [cluster2]                                                                 }
2021-07-19T00:17:02.2060068Z [cluster2]                                                             },
2021-07-19T00:17:02.2060768Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2061469Z [cluster2]                                                         }
2021-07-19T00:17:02.2062098Z [cluster2]                                                     },
2021-07-19T00:17:02.2062674Z [cluster2]                                                     "type": "object"
2021-07-19T00:17:02.2063358Z [cluster2]                                                 },
2021-07-19T00:17:02.2064111Z [cluster2]                                                 "type": "array"
2021-07-19T00:17:02.2064821Z [cluster2]                                             },
2021-07-19T00:17:02.2065485Z [cluster2]                                             "status": {
2021-07-19T00:17:02.2066478Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.2067583Z [cluster2]                                                 "properties": {
2021-07-19T00:17:02.2068501Z [cluster2]                                                     "collisionCount": {
2021-07-19T00:17:02.2070430Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.2071860Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2072538Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2073096Z [cluster2]                                                     },
2021-07-19T00:17:02.2073655Z [cluster2]                                                     "conditions": {
2021-07-19T00:17:02.2074928Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.2075902Z [cluster2]                                                         "items": {
2021-07-19T00:17:02.2076779Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.2077679Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2078385Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.2083514Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.2084775Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2085428Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2086100Z [cluster2]                                                                 },
2021-07-19T00:17:02.2086795Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2087783Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.2088863Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2089425Z [cluster2]                                                                 },
2021-07-19T00:17:02.2090051Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2091081Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.2091847Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2092423Z [cluster2]                                                                 },
2021-07-19T00:17:02.2092952Z [cluster2]                                                                 "status": {
2021-07-19T00:17:02.2093729Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.2094665Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2095228Z [cluster2]                                                                 },
2021-07-19T00:17:02.2095779Z [cluster2]                                                                 "type": {
2021-07-19T00:17:02.2096489Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.2097214Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2097781Z [cluster2]                                                                 }
2021-07-19T00:17:02.2098306Z [cluster2]                                                             },
2021-07-19T00:17:02.2098851Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.2099432Z [cluster2]                                                                 "status",
2021-07-19T00:17:02.2099998Z [cluster2]                                                                 "type"
2021-07-19T00:17:02.2100535Z [cluster2]                                                             ],
2021-07-19T00:17:02.2101099Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2101640Z [cluster2]                                                         },
2021-07-19T00:17:02.2104004Z [cluster2]                                                         "type": "array"
2021-07-19T00:17:02.2106452Z [cluster2]                                                     },
2021-07-19T00:17:02.2107129Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.2108516Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2109752Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2110348Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2110896Z [cluster2]                                                     },
2021-07-19T00:17:02.2111582Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.2113000Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2114296Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2114912Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2115469Z [cluster2]                                                     },
2021-07-19T00:17:02.2116068Z [cluster2]                                                     "numberAvailable": {
2021-07-19T00:17:02.2117237Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2118343Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2118944Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2119505Z [cluster2]                                                     },
2021-07-19T00:17:02.2120294Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.2121869Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2123308Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2123937Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2124502Z [cluster2]                                                     },
2021-07-19T00:17:02.2125058Z [cluster2]                                                     "numberReady": {
2021-07-19T00:17:02.2126009Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.2127032Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2127626Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2128191Z [cluster2]                                                     },
2021-07-19T00:17:02.2128813Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T00:17:02.2129973Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2131176Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2131785Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2132336Z [cluster2]                                                     },
2021-07-19T00:17:02.2133332Z [cluster2]                                                     "observedGeneration": {
2021-07-19T00:17:02.2135102Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.2135926Z [cluster2]                                                         "format": "int64",
2021-07-19T00:17:02.2136533Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2137092Z [cluster2]                                                     },
2021-07-19T00:17:02.2137760Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.2138685Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.2139462Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2140292Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2140881Z [cluster2]                                                     }
2021-07-19T00:17:02.2141382Z [cluster2]                                                 },
2021-07-19T00:17:02.2141927Z [cluster2]                                                 "required": [
2021-07-19T00:17:02.2142638Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.2143519Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.2144310Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T00:17:02.2144994Z [cluster2]                                                     "numberReady"
2021-07-19T00:17:02.2145551Z [cluster2]                                                 ],
2021-07-19T00:17:02.2146095Z [cluster2]                                                 "type": "object"
2021-07-19T00:17:02.2146628Z [cluster2]                                             }
2021-07-19T00:17:02.2147133Z [cluster2]                                         },
2021-07-19T00:17:02.2147761Z [cluster2]                                         "required": [
2021-07-19T00:17:02.2148500Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.2149199Z [cluster2]                                         ],
2021-07-19T00:17:02.2149725Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.2150255Z [cluster2]                                     },
2021-07-19T00:17:02.2150868Z [cluster2]                                     "loadBalancerStatus": {
2021-07-19T00:17:02.2151526Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.2152108Z [cluster2]                                             "status": {
2021-07-19T00:17:02.2153338Z [cluster2]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T00:17:02.2154217Z [cluster2]                                                 "properties": {
2021-07-19T00:17:02.2154819Z [cluster2]                                                     "ingress": {
2021-07-19T00:17:02.2156593Z [cluster2]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T00:17:02.2157663Z [cluster2]                                                         "items": {
2021-07-19T00:17:02.2159133Z [cluster2]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T00:17:02.2160424Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2161025Z [cluster2]                                                                 "hostname": {
2021-07-19T00:17:02.2162276Z [cluster2]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T00:17:02.2163232Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2163791Z [cluster2]                                                                 },
2021-07-19T00:17:02.2164327Z [cluster2]                                                                 "ip": {
2021-07-19T00:17:02.2165570Z [cluster2]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T00:17:02.2179971Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2180703Z [cluster2]                                                                 }
2021-07-19T00:17:02.2181252Z [cluster2]                                                             },
2021-07-19T00:17:02.2181815Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2182380Z [cluster2]                                                         },
2021-07-19T00:17:02.2182920Z [cluster2]                                                         "type": "array"
2021-07-19T00:17:02.2183470Z [cluster2]                                                     }
2021-07-19T00:17:02.2183983Z [cluster2]                                                 },
2021-07-19T00:17:02.2184530Z [cluster2]                                                 "type": "object"
2021-07-19T00:17:02.2185076Z [cluster2]                                             }
2021-07-19T00:17:02.2185572Z [cluster2]                                         },
2021-07-19T00:17:02.2186101Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.2186644Z [cluster2]                                     },
2021-07-19T00:17:02.2187312Z [cluster2]                                     "natEnabled": {
2021-07-19T00:17:02.2187903Z [cluster2]                                         "type": "boolean"
2021-07-19T00:17:02.2188439Z [cluster2]                                     },
2021-07-19T00:17:02.2188995Z [cluster2]                                     "networkPlugin": {
2021-07-19T00:17:02.2189599Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.2190436Z [cluster2]                                     },
2021-07-19T00:17:02.2191163Z [cluster2]                                     "routeAgentDaemonSetStatus": {
2021-07-19T00:17:02.2191926Z [cluster2]                                         "properties": {
2021-07-19T00:17:02.2192600Z [cluster2]                                             "lastResourceVersion": {
2021-07-19T00:17:02.2193275Z [cluster2]                                                 "type": "string"
2021-07-19T00:17:02.2193818Z [cluster2]                                             },
2021-07-19T00:17:02.2194520Z [cluster2]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.2195268Z [cluster2]                                                 "type": "boolean"
2021-07-19T00:17:02.2195802Z [cluster2]                                             },
2021-07-19T00:17:02.2196478Z [cluster2]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.2197182Z [cluster2]                                                 "items": {
2021-07-19T00:17:02.2199041Z [cluster2]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.2200323Z [cluster2]                                                     "properties": {
2021-07-19T00:17:02.2201102Z [cluster2]                                                         "running": {
2021-07-19T00:17:02.2201819Z [cluster2]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.2202567Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2203179Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.2204305Z [cluster2]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.2205483Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2206461Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2207050Z [cluster2]                                                                 }
2021-07-19T00:17:02.2207574Z [cluster2]                                                             },
2021-07-19T00:17:02.2208130Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2208689Z [cluster2]                                                         },
2021-07-19T00:17:02.2209252Z [cluster2]                                                         "terminated": {
2021-07-19T00:17:02.2209994Z [cluster2]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.2210758Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2211385Z [cluster2]                                                                 "containerID": {
2021-07-19T00:17:02.2212492Z [cluster2]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.2213439Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2214023Z [cluster2]                                                                 },
2021-07-19T00:17:02.2214579Z [cluster2]                                                                 "exitCode": {
2021-07-19T00:17:02.2215367Z [cluster2]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.2216149Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.2216760Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.2217329Z [cluster2]                                                                 },
2021-07-19T00:17:02.2217888Z [cluster2]                                                                 "finishedAt": {
2021-07-19T00:17:02.2218671Z [cluster2]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.2219972Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2220610Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2221177Z [cluster2]                                                                 },
2021-07-19T00:17:02.2221734Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2222636Z [cluster2]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.2223448Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2224008Z [cluster2]                                                                 },
2021-07-19T00:17:02.2224798Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2226102Z [cluster2]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.2227102Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2227847Z [cluster2]                                                                 },
2021-07-19T00:17:02.2228704Z [cluster2]                                                                 "signal": {
2021-07-19T00:17:02.2229678Z [cluster2]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.2230583Z [cluster2]                                                                     "format": "int32",
2021-07-19T00:17:02.2231337Z [cluster2]                                                                     "type": "integer"
2021-07-19T00:17:02.2232087Z [cluster2]                                                                 },
2021-07-19T00:17:02.2232935Z [cluster2]                                                                 "startedAt": {
2021-07-19T00:17:02.2234041Z [cluster2]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.2235278Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2236082Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2242499Z [cluster2]                                                                 }
2021-07-19T00:17:02.2243159Z [cluster2]                                                             },
2021-07-19T00:17:02.2243757Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.2244779Z [cluster2]                                                                 "exitCode"
2021-07-19T00:17:02.2245377Z [cluster2]                                                             ],
2021-07-19T00:17:02.2246104Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2246874Z [cluster2]                                                         },
2021-07-19T00:17:02.2247554Z [cluster2]                                                         "waiting": {
2021-07-19T00:17:02.2248414Z [cluster2]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.2249401Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2250152Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2251103Z [cluster2]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.2252024Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2252861Z [cluster2]                                                                 },
2021-07-19T00:17:02.2253596Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2254464Z [cluster2]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.2255486Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2256194Z [cluster2]                                                                 }
2021-07-19T00:17:02.2256846Z [cluster2]                                                             },
2021-07-19T00:17:02.2257550Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2258258Z [cluster2]                                                         }
2021-07-19T00:17:02.2258888Z [cluster2]                                                     },
2021-07-19T00:17:02.2259574Z [cluster2]                                                     "type": "object"
2021-07-19T00:17:02.2260135Z [cluster2]                                                 },
2021-07-19T00:17:02.2260815Z [cluster2]                                                 "type": "array"
2021-07-19T00:17:02.2261495Z [cluster2]                                             },
2021-07-19T00:17:02.2262157Z [cluster2]                                             "status": {
2021-07-19T00:17:02.2263110Z [cluster2]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.2264226Z [cluster2]                                                 "properties": {
2021-07-19T00:17:02.2265003Z [cluster2]                                                     "collisionCount": {
2021-07-19T00:17:02.2266557Z [cluster2]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.2268073Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2268802Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2269396Z [cluster2]                                                     },
2021-07-19T00:17:02.2270077Z [cluster2]                                                     "conditions": {
2021-07-19T00:17:02.2271502Z [cluster2]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.2272497Z [cluster2]                                                         "items": {
2021-07-19T00:17:02.2273516Z [cluster2]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.2274464Z [cluster2]                                                             "properties": {
2021-07-19T00:17:02.2275153Z [cluster2]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.2276043Z [cluster2]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.2277220Z [cluster2]                                                                     "format": "date-time",
2021-07-19T00:17:02.2277867Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2278427Z [cluster2]                                                                 },
2021-07-19T00:17:02.2278990Z [cluster2]                                                                 "message": {
2021-07-19T00:17:02.2279837Z [cluster2]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.2280666Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2281231Z [cluster2]                                                                 },
2021-07-19T00:17:02.2281876Z [cluster2]                                                                 "reason": {
2021-07-19T00:17:02.2282872Z [cluster2]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.2283649Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2284222Z [cluster2]                                                                 },
2021-07-19T00:17:02.2284758Z [cluster2]                                                                 "status": {
2021-07-19T00:17:02.2285522Z [cluster2]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.2286830Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2287959Z [cluster2]                                                                 },
2021-07-19T00:17:02.2288686Z [cluster2]                                                                 "type": {
2021-07-19T00:17:02.2289386Z [cluster2]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.2290114Z [cluster2]                                                                     "type": "string"
2021-07-19T00:17:02.2290693Z [cluster2]                                                                 }
2021-07-19T00:17:02.2291205Z [cluster2]                                                             },
2021-07-19T00:17:02.2291763Z [cluster2]                                                             "required": [
2021-07-19T00:17:02.2292358Z [cluster2]                                                                 "status",
2021-07-19T00:17:02.2292907Z [cluster2]                                                                 "type"
2021-07-19T00:17:02.2293448Z [cluster2]                                                             ],
2021-07-19T00:17:02.2294008Z [cluster2]                                                             "type": "object"
2021-07-19T00:17:02.2294574Z [cluster2]                                                         },
2021-07-19T00:17:02.2295119Z [cluster2]                                                         "type": "array"
2021-07-19T00:17:02.2295657Z [cluster2]                                                     },
2021-07-19T00:17:02.2296440Z [cluster2]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.2298026Z [cluster2]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2299341Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2299954Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2300522Z [cluster2]                                                     },
2021-07-19T00:17:02.2301187Z [cluster2]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.2302619Z [cluster2]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2303919Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2304511Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2305074Z [cluster2]                                                     },
2021-07-19T00:17:02.2305672Z [cluster2]                                                     "numberAvailable": {
2021-07-19T00:17:02.2306926Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2308054Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2308661Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2309213Z [cluster2]                                                     },
2021-07-19T00:17:02.2310458Z [cluster2]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.2311802Z [cluster2]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2313024Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2313627Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2314192Z [cluster2]                                                     },
2021-07-19T00:17:02.2314747Z [cluster2]                                                     "numberReady": {
2021-07-19T00:17:02.2315693Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.2316584Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2317187Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2318092Z [cluster2]                                                     },
2021-07-19T00:17:02.2318780Z [cluster2]                                                     "numberUnavailable": {
2021-07-19T00:17:02.2319984Z [cluster2]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2321083Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2321757Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2322329Z [cluster2]                                                     },
2021-07-19T00:17:02.2322961Z [cluster2]                                                     "observedGeneration": {
2021-07-19T00:17:02.2323858Z [cluster2]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.2324677Z [cluster2]                                                         "format": "int64",
2021-07-19T00:17:02.2325281Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2325830Z [cluster2]                                                     },
2021-07-19T00:17:02.2326646Z [cluster2]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.2327578Z [cluster2]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.2328347Z [cluster2]                                                         "format": "int32",
2021-07-19T00:17:02.2328945Z [cluster2]                                                         "type": "integer"
2021-07-19T00:17:02.2329496Z [cluster2]                                                     }
2021-07-19T00:17:02.2330005Z [cluster2]                                                 },
2021-07-19T00:17:02.2330637Z [cluster2]                                                 "required": [
2021-07-19T00:17:02.2331336Z [cluster2]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.2332211Z [cluster2]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.2333001Z [cluster2]                                                     "numberMisscheduled",
2021-07-19T00:17:02.2333690Z [cluster2]                                                     "numberReady"
2021-07-19T00:17:02.2334254Z [cluster2]                                                 ],
2021-07-19T00:17:02.2339265Z [cluster2]                                                 "type": "object"
2021-07-19T00:17:02.2339834Z [cluster2]                                             }
2021-07-19T00:17:02.2340347Z [cluster2]                                         },
2021-07-19T00:17:02.2340872Z [cluster2]                                         "required": [
2021-07-19T00:17:02.2341626Z [cluster2]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.2342624Z [cluster2]                                         ],
2021-07-19T00:17:02.2343204Z [cluster2]                                         "type": "object"
2021-07-19T00:17:02.2343741Z [cluster2]                                     },
2021-07-19T00:17:02.2344281Z [cluster2]                                     "serviceCIDR": {
2021-07-19T00:17:02.2344875Z [cluster2]                                         "type": "string"
2021-07-19T00:17:02.2345491Z [cluster2]                                     }
2021-07-19T00:17:02.2345961Z [cluster2]                                 },
2021-07-19T00:17:02.2346485Z [cluster2]                                 "required": [
2021-07-19T00:17:02.2347039Z [cluster2]                                     "clusterID",
2021-07-19T00:17:02.2347625Z [cluster2]                                     "natEnabled"
2021-07-19T00:17:02.2349335Z [cluster2]                                 ],
2021-07-19T00:17:02.2350046Z [cluster2]                          00:15:40Z",
2021-07-19T00:17:02.2350862Z [cluster1]                 "message": "no conflicts found",
2021-07-19T00:17:02.2351718Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T00:17:02.2352290Z [cluster1]                 "status": "True",
2021-07-19T00:17:02.2352890Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T00:17:02.2353425Z [cluster1]             },
2021-07-19T00:17:02.2353874Z [cluster1]             {
2021-07-19T00:17:02.2354995Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:40Z",
2021-07-19T00:17:02.2355782Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T00:17:02.2356574Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:02.2357211Z [cluster1]                 "status": "True",
2021-07-19T00:17:02.2357784Z [cluster1]                 "type": "Established"
2021-07-19T00:17:02.2358311Z [cluster1]             }
2021-07-19T00:17:02.2358755Z [cluster1]         ],
2021-07-19T00:17:02.2359294Z [cluster1]         "storedVersions": [
2021-07-19T00:17:02.2359818Z [cluster1]             "v1"
2021-07-19T00:17:02.2360265Z [cluster1]         ]
2021-07-19T00:17:02.2360700Z [cluster1]     }
2021-07-19T00:17:02.2361121Z [cluster1] }
2021-07-19T00:17:02.2362184Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-19T00:17:02.2363625Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-19T00:17:02.2365275Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:02.2367039Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:02.2368236Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:02.2369726Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:02.2371331Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:02.2372555Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:02.2374055Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:02.2375523Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-19T00:17:02.2376754Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-19T00:17:02.2378288Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:02.2379990Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T00:17:02.2381451Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T00:17:02.2383225Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-19T00:17:02.2384699Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-19T00:17:02.2385653Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-19T00:17:02.2386906Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T00:17:02.2388400Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T00:17:02.2389828Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T00:17:02.2391180Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T00:17:02.2392682Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-19T00:17:02.2393663Z [cluster1] NAME                        CREATED AT
2021-07-19T00:17:02.2394801Z [cluster1] submariners.submariner.io   2021-07-19T00:15:30Z
2021-07-19T00:17:02.2396361Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:02.2398093Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-19T00:17:02.2399643Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:02.2401309Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-19T00:17:02.2402864Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-19T00:17:02.2403772Z [cluster1] {
2021-07-19T00:17:02.2404401Z [cluster1]     "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:02.2405223Z [cluster1]     "kind": "CustomResourceDefinition",
2021-07-19T00:17:02.2405910Z [cluster1]     "metadata": {
2021-07-19T00:17:02.2407472Z [cluster1]         "annotations": {
2021-07-19T00:17:02.2408551Z [cluster1]             "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T00:17:02.2409297Z [cluster1]         },
2021-07-19T00:17:02.2410040Z [cluster1]         "creationTimestamp": "2021-07-19T00:15:30Z",
2021-07-19T00:17:02.2410683Z [cluster1]         "generation": 1,
2021-07-19T00:17:02.2411250Z [cluster1]         "managedFields": [
2021-07-19T00:17:02.2411768Z [cluster1]             {
2021-07-19T00:17:02.2412423Z [cluster1]                 "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T00:17:02.2413147Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:02.2413732Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:02.2414267Z [cluster1]                     "f:metadata": {
2021-07-19T00:17:02.2414813Z [cluster1]                         "f:annotations": {
2021-07-19T00:17:02.2415341Z [cluster1]                             ".": {},
2021-07-19T00:17:02.2416284Z [cluster1]                             "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T00:17:02.2417163Z [cluster1]                         }
2021-07-19T00:17:02.2417626Z [cluster1]                     },
2021-07-19T00:17:02.2418113Z [cluster1]                     "f:spec": {
2021-07-19T00:17:02.2418651Z [cluster1]                         "f:conversion": {
2021-07-19T00:17:02.2419175Z [cluster1]                             ".": {},
2021-07-19T00:17:02.2419714Z [cluster1]                             "f:strategy": {}
2021-07-19T00:17:02.2420231Z [cluster1]                         },
2021-07-19T00:17:02.2420714Z [cluster1]                         "f:group": {},
2021-07-19T00:17:02.2421237Z [cluster1]                         "f:names": {
2021-07-19T00:17:02.2421751Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:02.2422391Z [cluster1]                             "f:listKind": {},
2021-07-19T00:17:02.2422936Z [cluster1]                             "f:plural": {},
2021-07-19T00:17:02.2423473Z [cluster1]                             "f:singular": {}
2021-07-19T00:17:02.2423987Z [cluster1]                         },
2021-07-19T00:17:02.2424488Z [cluster1]                         "f:scope": {},
2021-07-19T00:17:02.2425011Z [cluster1]                         "f:versions": {}
2021-07-19T00:17:02.2425513Z [cluster1]                     },
2021-07-19T00:17:02.2425991Z [cluster1]                     "f:status": {
2021-07-19T00:17:02.2426569Z [cluster1]                         "f:acceptedNames": {
2021-07-19T00:17:02.2427147Z [cluster1]                             "f:kind": {},
2021-07-19T00:17:02.2427661Z [cluster1]                             "f:plural": {}
2021-07-19T00:17:02.2428169Z [cluster1]                         },
2021-07-19T00:17:02.2428679Z [cluster1]                         "f:conditions": {},
2021-07-19T00:17:02.2429286Z [cluster1]                         "f:storedVersions": {}
2021-07-19T00:17:02.2429842Z [cluster1]                     }
2021-07-19T00:17:02.2430284Z [cluster1]                 },
2021-07-19T00:17:02.2430798Z [cluster1]                 "manager": "subctl",
2021-07-19T00:17:02.2431310Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:02.2434551Z [cluster1]                 "time": "2021-07-19T00:15:42Z"
2021-07-19T00:17:02.2434970Z [cluster1]             }
2021-07-19T00:17:02.2435315Z [cluster1]         ],
2021-07-19T00:17:02.2435881Z [cluster1]         "name": "submariners.submariner.io",
2021-07-19T00:17:02.2436667Z [cluster1]         "resourceVersion": "1647",
2021-07-19T00:17:02.2437925Z [cluster1]         "selfLink": "/apis/apiextensions.k8s.io/v1/customresourcedefinitions/submariners.submariner.io",
2021-07-19T00:17:02.2439304Z [cluster1]         "uid": "f1b86331-812f-4bb2-9ad1-52e4cdcc0d7d"
2021-07-19T00:17:02.2439923Z [cluster1]     },
2021-07-19T00:17:02.2440380Z [cluster1]     "spec": {
2021-07-19T00:17:02.2440882Z [cluster1]         "conversion": {
2021-07-19T00:17:02.2441431Z [cluster1]             "strategy": "None"
2021-07-19T00:17:02.2441931Z [cluster1]         },
2021-07-19T00:17:02.2442461Z [cluster1]         "group": "submariner.io",
2021-07-19T00:17:02.2443164Z [cluster1]         "names": {
2021-07-19T00:17:02.2443689Z [cluster1]             "kind": "Submariner",
2021-07-19T00:17:02.2444317Z [cluster1]             "listKind": "SubmarinerList",
2021-07-19T00:17:02.2444968Z [cluster1]             "plural": "submariners",
2021-07-19T00:17:02.2445951Z [cluster1]             "singular": "submariner"
2021-07-19T00:17:02.2447067Z [cluster1]         },
2021-07-19T00:17:02.2447591Z [cluster1]         "scope": "Namespaced",
2021-07-19T00:17:02.2448084Z [cluster1]         "versions": [
2021-07-19T00:17:02.2459990Z [cluster1]             {
2021-07-19T00:17:02.2460560Z [cluster1]                 "name": "v1alpha1",
2021-07-19T00:17:02.2461110Z [cluster1]                 "schema": {
2021-07-19T00:17:02.2461699Z [cluster1]                     "openAPIV3Schema": {
2021-07-19T00:17:02.2462495Z [cluster1]                         "description": "Submariner is the Schema for the submariners API",
2021-07-19T00:17:02.2463400Z [cluster1]                         "properties": {
2021-07-19T00:17:02.2463970Z [cluster1]                             "apiVersion": {
2021-07-19T00:17:02.2466241Z [cluster1]                                 "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T00:17:02.2467959Z [cluster1]                                 "type": "string"
2021-07-19T00:17:02.2468470Z [cluster1]                             },
2021-07-19T00:17:02.2468965Z [cluster1]                             "kind": {
2021-07-19T00:17:02.2471029Z [cluster1]                                 "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T00:17:02.2472715Z [cluster1]                                 "type": "string"
2021-07-19T00:17:02.2473234Z [cluster1]                             },
2021-07-19T00:17:02.2473744Z [cluster1]                             "metadata": {
2021-07-19T00:17:02.2474295Z [cluster1]                                 "type": "object"
2021-07-19T00:17:02.2474823Z [cluster1]                             },
2021-07-19T00:17:02.2475320Z [cluster1]                             "spec": {
2021-07-19T00:17:02.2476086Z [cluster1]                                 "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T00:17:02.2476902Z [cluster1]                                 "properties": {
2021-07-19T00:17:02.2477465Z [cluster1]                                     "broker": {
2021-07-19T00:17:02.2478009Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2478542Z [cluster1]                                     },
2021-07-19T00:17:02.2480550Z [cluster1]                                     "brokerK8sApiServer": {
2021-07-19T00:17:02.2481212Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2481749Z [cluster1]                                     },
2021-07-19T00:17:02.2482401Z [cluster1]                                     "brokerK8sApiServerToken": {
2021-07-19T00:17:02.2483233Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2483781Z [cluster1]                                     },
2021-07-19T00:17:02.2484335Z [cluster1]                                     "brokerK8sCA": {
2021-07-19T00:17:02.2484925Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2485462Z [cluster1]                                     },
2021-07-19T00:17:02.2486144Z [cluster1]                                     "brokerK8sRemoteNamespace": {
2021-07-19T00:17:02.2487383Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2488314Z [cluster1]                                     },
2021-07-19T00:17:02.2489027Z [cluster1]                                     "cableDriver": {
2021-07-19T00:17:02.2489813Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2490353Z [cluster1]                                     },
2021-07-19T00:17:02.2490925Z [cluster1]                                     "ceIPSecDebug": {
2021-07-19T00:17:02.2491526Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2492062Z [cluster1]                                     },
2021-07-19T00:17:02.2492714Z [cluster1]                                     "ceIPSecForceUDPEncaps": {
2021-07-19T00:17:02.2493404Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2493942Z [cluster1]                                     },
2021-07-19T00:17:02.2494758Z [cluster1]                                     "ceIPSecIKEPort": {
2021-07-19T00:17:02.2495500Z [cluster1]                                         "type": "integer"
2021-07-19T00:17:02.2496542Z [cluster1]                                     },
2021-07-19T00:17:02.2497129Z [cluster1]                                     "ceIPSecNATTPort": {
2021-07-19T00:17:02.2498035Z [cluster1]                                         "type": "integer"
2021-07-19T00:17:02.2498589Z [cluster1]                                     },
2021-07-19T00:17:02.2499324Z [cluster1]                                     "ceIPSecPSK": {
2021-07-19T00:17:02.2499926Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2500449Z [cluster1]                                     },
2021-07-19T00:17:02.2501124Z [cluster1]                                     "ceIPSecPreferredServer": {
2021-07-19T00:17:02.2501839Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2502366Z [cluster1]                                     },
2021-07-19T00:17:02.2502917Z [cluster1]                                     "clusterCIDR": {
2021-07-19T00:17:02.2503488Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2504023Z [cluster1]                                     },
2021-07-19T00:17:02.2504555Z [cluster1]                                     "clusterID": {
2021-07-19T00:17:02.2505117Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2505649Z [cluster1]                                     },
2021-07-19T00:17:02.2506183Z [cluster1]                                     "colorCodes": {
2021-07-19T00:17:02.2506769Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2507293Z [cluster1]                                     },
2021-07-19T00:17:02.2508018Z [cluster1]                                     "connectionHealthCheck": {
2021-07-19T00:17:02.2508713Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.2509298Z [cluster1]                                             "enabled": {
2021-07-19T00:17:02.2509872Z [cluster1]                                                 "type": "boolean"
2021-07-19T00:17:02.2510362Z [cluster1]                                             },
2021-07-19T00:17:02.2511127Z [cluster1]                                             "intervalSeconds": {
2021-07-19T00:17:02.2512078Z [cluster1]                                                 "description": "The interval at which health check pings are sent.",
2021-07-19T00:17:02.2512838Z [cluster1]                                                 "format": "int64",
2021-07-19T00:17:02.2513497Z [cluster1]                                                 "type": "integer"
2021-07-19T00:17:02.2514045Z [cluster1]                                             },
2021-07-19T00:17:02.2514602Z [cluster1]                                             "maxPacketLossCount": {
2021-07-19T00:17:02.2516080Z [cluster1]                                                 "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T00:17:02.2516982Z [cluster1]                                                 "format": "int64",
2021-07-19T00:17:02.2517585Z [cluster1]                                                 "type": "integer"
2021-07-19T00:17:02.2518123Z [cluster1]                                             }
2021-07-19T00:17:02.2518558Z [cluster1]                                         },
2021-07-19T00:17:02.2534607Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.2535219Z [cluster1]                                     },
2021-07-19T00:17:02.2535859Z [cluster1]                                     "coreDNSCustomConfig": {
2021-07-19T00:17:02.2536530Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.2537159Z [cluster1]                                             "configMapName": {
2021-07-19T00:17:02.2537937Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2538475Z [cluster1]                                             },
2021-07-19T00:17:02.2539063Z [cluster1]                                             "namespace": {
2021-07-19T00:17:02.2539637Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2540185Z [cluster1]                                             }
2021-07-19T00:17:02.2540690Z [cluster1]                                         },
2021-07-19T00:17:02.2541218Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.2541751Z [cluster1]                                     },
2021-07-19T00:17:02.2542671Z [cluster1]                                     "customDomains": {
2021-07-19T00:17:02.2543243Z [cluster1]                                         "items": {
2021-07-19T00:17:02.2543800Z [cluster1]                                             "type": "string"
2021-07-19T00:17:02.2544332Z [cluster1]                                         },
2021-07-19T00:17:02.2544859Z [cluster1]                                         "type": "array",
2021-07-19T00:17:02.2545876Z [cluster1]                                         "x-kubernetes-list-type": "set"
2021-07-19T00:17:02.2546781Z [cluster1]                                     },
2021-07-19T00:17:02.2547287Z [cluster1]                                     "debug": {
2021-07-19T00:17:02.2547841Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2548379Z [cluster1]                                     },
2021-07-19T00:17:02.2548919Z [cluster1]                                     "globalCIDR": {
2021-07-19T00:17:02.2549482Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2550013Z [cluster1]                                     },
2021-07-19T00:17:02.2550589Z [cluster1]                                     "imageOverrides": {
2021-07-19T00:17:02.2551291Z [cluster1]                                         "additionalProperties": {
2021-07-19T00:17:02.2551977Z [cluster1]                                             "type": "string"
2021-07-19T00:17:02.2552504Z [cluster1]                                         },
2021-07-19T00:17:02.2553045Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.2553579Z [cluster1]                                     },
2021-07-19T00:17:02.2554301Z [cluster1]                                     "loadBalancerEnabled": {
2021-07-19T00:17:02.2554977Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2555496Z [cluster1]                                     },
2021-07-19T00:17:02.2556029Z [cluster1]                                     "namespace": {
2021-07-19T00:17:02.2556607Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2557126Z [cluster1]                                     },
2021-07-19T00:17:02.2557659Z [cluster1]                                     "natEnabled": {
2021-07-19T00:17:02.2558246Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2558770Z [cluster1]                                     },
2021-07-19T00:17:02.2559302Z [cluster1]                                     "repository": {
2021-07-19T00:17:02.2559865Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2560396Z [cluster1]                                     },
2021-07-19T00:17:02.2560945Z [cluster1]                                     "serviceCIDR": {
2021-07-19T00:17:02.2561514Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2562039Z [cluster1]                                     },
2021-07-19T00:17:02.2562692Z [cluster1]                                     "serviceDiscoveryEnabled": {
2021-07-19T00:17:02.2563408Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.2563941Z [cluster1]                                     },
2021-07-19T00:17:02.2564526Z [cluster1]                                     "version": {
2021-07-19T00:17:02.2565087Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2565626Z [cluster1]                                     }
2021-07-19T00:17:02.2566096Z [cluster1]                                 },
2021-07-19T00:17:02.2567013Z [cluster1]                                 "required": [
2021-07-19T00:17:02.2567546Z [cluster1]                                     "broker",
2021-07-19T00:17:02.2568194Z [cluster1]                                     "brokerK8sApiServer",
2021-07-19T00:17:02.2568992Z [cluster1]                                     "brokerK8sApiServerToken",
2021-07-19T00:17:02.2569699Z [cluster1]                                     "brokerK8sCA",
2021-07-19T00:17:02.2570432Z [cluster1]                                     "brokerK8sRemoteNamespace",
2021-07-19T00:17:02.2571176Z [cluster1]                                     "ceIPSecDebug",
2021-07-19T00:17:02.2571783Z [cluster1]                                     "ceIPSecPSK",
2021-07-19T00:17:02.2572376Z [cluster1]                                     "clusterCIDR",
2021-07-19T00:17:02.2572943Z [cluster1]                                     "clusterID",
2021-07-19T00:17:02.2573492Z [cluster1]                                     "debug",
2021-07-19T00:17:02.2574044Z [cluster1]                                     "namespace",
2021-07-19T00:17:02.2574748Z [cluster1]                                     "natEnabled",
2021-07-19T00:17:02.2575494Z [cluster1]                                     "serviceCIDR"
2021-07-19T00:17:02.2576156Z [cluster1]                                 ],
2021-07-19T00:17:02.2576682Z [cluster1]                                 "type": "object"
2021-07-19T00:17:02.2607285Z [cluster1]                             },
2021-07-19T00:17:02.2607831Z [cluster1]                             "status": {
2021-07-19T00:17:02.2608641Z [cluster1]                                 "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T00:17:02.2609488Z [cluster1]                                 "properties": {
2021-07-19T00:17:02.2610076Z [cluster1]                                     "clusterCIDR": {
2021-07-19T00:17:02.2610671Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2611190Z [cluster1]                                     },
2021-07-19T00:17:02.2611726Z [cluster1]                                     "clusterID": {
2021-07-19T00:17:02.2612418Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2612949Z [cluster1]                                     },
2021-07-19T00:17:02.2613494Z [cluster1]                                     "colorCodes": {
2021-07-19T00:17:02.2614070Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2614605Z [cluster1]                                     },
2021-07-19T00:17:02.2615178Z [cluster1]                                     "deploymentInfo": {
2021-07-19T00:17:02.2615802Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.2616440Z [cluster1]                                             "cloudProvider": {
2021-07-19T00:17:02.2617064Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2617596Z [cluster1]                                             },
2021-07-19T00:17:02.2618185Z [cluster1]                                             "kubernetesType": {
2021-07-19T00:17:02.2618809Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2619355Z [cluster1]                                             },
2021-07-19T00:17:02.2620024Z [cluster1]                                             "kubernetesTypeVersion": {
2021-07-19T00:17:02.2620713Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2621259Z [cluster1]                                             },
2021-07-19T00:17:02.2622001Z [cluster1]                                             "kubernetesVersion": {
2021-07-19T00:17:02.2622677Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2623222Z [cluster1]                                             }
2021-07-19T00:17:02.2623710Z [cluster1]                                         },
2021-07-19T00:17:02.2624247Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.2624783Z [cluster1]                                     },
2021-07-19T00:17:02.2625434Z [cluster1]                                     "gatewayDaemonSetStatus": {
2021-07-19T00:17:02.2626151Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.2626827Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T00:17:02.2627504Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2628043Z [cluster1]                                             },
2021-07-19T00:17:02.2628736Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.2629522Z [cluster1]                                                 "type": "boolean"
2021-07-19T00:17:02.2630073Z [cluster1]                                             },
2021-07-19T00:17:02.2630740Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.2631446Z [cluster1]                                                 "items": {
2021-07-19T00:17:02.2632663Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.2671285Z [cluster1]                                                     "properties": {
2021-07-19T00:17:02.2671918Z [cluster1]                                                         "running": {
2021-07-19T00:17:02.2672656Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.2673405Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2674057Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.2675341Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.2676352Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2677000Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2677563Z [cluster1]                                                                 }
2021-07-19T00:17:02.2678071Z [cluster1]                                                             },
2021-07-19T00:17:02.2678865Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2679587Z [cluster1]                                                         },
2021-07-19T00:17:02.2680140Z [cluster1]                                                         "terminated": {
2021-07-19T00:17:02.2680903Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.2681663Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2682282Z [cluster1]                                                                 "containerID": {
2021-07-19T00:17:02.2683406Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.2684226Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2684890Z [cluster1]                                                                 },
2021-07-19T00:17:02.2685467Z [cluster1]                                                                 "exitCode": {
2021-07-19T00:17:02.2686263Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.2687138Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.2687758Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.2688330Z [cluster1]                                                                 },
2021-07-19T00:17:02.2688924Z [cluster1]                                                                 "finishedAt": {
2021-07-19T00:17:02.2689705Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.2690718Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2691347Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2691910Z [cluster1]                                                                 },
2021-07-19T00:17:02.2692591Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.2693404Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.2694213Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2694770Z [cluster1]                                                                 },
2021-07-19T00:17:02.2695320Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.2696112Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.2696885Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2697443Z [cluster1]                                                                 },
2021-07-19T00:17:02.2698078Z [cluster1]                                                                 "signal": {
2021-07-19T00:17:02.2698834Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.2699599Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.2700209Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.2700770Z [cluster1]                                                                 },
2021-07-19T00:17:02.2701350Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.2702180Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.2703224Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2703860Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2704422Z [cluster1]                                                                 }
2021-07-19T00:17:02.2704942Z [cluster1]                                                             },
2021-07-19T00:17:02.2705495Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.2706084Z [cluster1]                                                                 "exitCode"
2021-07-19T00:17:02.2706722Z [cluster1]                                                             ],
2021-07-19T00:17:02.2707281Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2707827Z [cluster1]                                                         },
2021-07-19T00:17:02.2708374Z [cluster1]                                                         "waiting": {
2021-07-19T00:17:02.2709091Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.2709814Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2710417Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.2711197Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.2711999Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2712563Z [cluster1]                                                                 },
2021-07-19T00:17:02.2713111Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.2713864Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.2714624Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2715172Z [cluster1]                                                                 }
2021-07-19T00:17:02.2715697Z [cluster1]                                                             },
2021-07-19T00:17:02.2716259Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2716811Z [cluster1]                                                         }
2021-07-19T00:17:02.2717329Z [cluster1]                                                     },
2021-07-19T00:17:02.2717862Z [cluster1]                                                     "type": "object"
2021-07-19T00:17:02.2718406Z [cluster1]                                                 },
2021-07-19T00:17:02.2718940Z [cluster1]                                                 "type": "array"
2021-07-19T00:17:02.2719522Z [cluster1]                                             },
2021-07-19T00:17:02.2720050Z [cluster1]                                             "status": {
2021-07-19T00:17:02.2720879Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.2721708Z [cluster1]                                                 "properties": {
2021-07-19T00:17:02.2722347Z [cluster1]                                                     "collisionCount": {
2021-07-19T00:17:02.2723654Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.2724895Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2725504Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2726073Z [cluster1]                                                     },
2021-07-19T00:17:02.2736129Z [cluster1]                                                     "conditions": {
2021-07-19T00:17:02.2737514Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.2738420Z [cluster1]                                                         "items": {
2021-07-19T00:17:02.2739537Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.2740457Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2741147Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.2742039Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.2743107Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2743753Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2745030Z [cluster1]                                                                 },
2021-07-19T00:17:02.2745620Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.2746465Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.2747297Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2747860Z [cluster1]                                                                 },
2021-07-19T00:17:02.2748412Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.2749432Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.2750204Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2750763Z [cluster1]                                                                 },
2021-07-19T00:17:02.2751307Z [cluster1]                                                                 "status": {
2021-07-19T00:17:02.2752072Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.2752835Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2753506Z [cluster1]                                                                 },
2021-07-19T00:17:02.2754062Z [cluster1]                                                                 "type": {
2021-07-19T00:17:02.2754755Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.2755480Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2756043Z [cluster1]                                                                 }
2021-07-19T00:17:02.2756561Z [cluster1]                                                             },
2021-07-19T00:17:02.2757117Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.2757703Z [cluster1]                                                                 "status",
2021-07-19T00:17:02.2758255Z [cluster1]                                                                 "type"
2021-07-19T00:17:02.2758795Z [cluster1]                                                             ],
2021-07-19T00:17:02.2759345Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2759904Z [cluster1]                                                         },
2021-07-19T00:17:02.2760453Z [cluster1]                                                         "type": "array"
2021-07-19T00:17:02.2760994Z [cluster1]                                                     },
2021-07-19T00:17:02.2761741Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.2763115Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2764512Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2765133Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2765705Z [cluster1]                                                     },
2021-07-19T00:17:02.2766466Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.2767904Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2775504Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2776132Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2776699Z [cluster1]                                                     },
2021-07-19T00:17:02.2777306Z [cluster1]                                                     "numberAvailable": {
2021-07-19T00:17:02.2778483Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2779588Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2780194Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2780760Z [cluster1]                                                     },
2021-07-19T00:17:02.2781381Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.2782815Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.2784030Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2784981Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2785556Z [cluster1]                                                     },
2021-07-19T00:17:02.2786116Z [cluster1]                                                     "numberReady": {
2021-07-19T00:17:02.2787061Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.2787993Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2788577Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2789139Z [cluster1]                                                     },
2021-07-19T00:17:02.2789756Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T00:17:02.2797875Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.2799146Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2799917Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2800471Z [cluster1]                                                     },
2021-07-19T00:17:02.2801104Z [cluster1]                                                     "observedGeneration": {
2021-07-19T00:17:02.2802011Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.2802826Z [cluster1]                                                         "format": "int64",
2021-07-19T00:17:02.2803433Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2810423Z [cluster1]                                                     },
2021-07-19T00:17:02.2811169Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.2812102Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.2812889Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.2813497Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.2814060Z [cluster1]                                                     }
2021-07-19T00:17:02.2814553Z [cluster1]                                                 },
2021-07-19T00:17:02.2815095Z [cluster1]                                                 "required": [
2021-07-19T00:17:02.2815803Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.2816986Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.2818109Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T00:17:02.2818983Z [cluster1]                                                     "numberReady"
2021-07-19T00:17:02.2819545Z [cluster1]                                                 ],
2021-07-19T00:17:02.2820091Z [cluster1]                                                 "type": "object"
2021-07-19T00:17:02.2820624Z [cluster1]                                             }
2021-07-19T00:17:02.2821118Z [cluster1]                                         },
2021-07-19T00:17:02.2821652Z [cluster1]                                         "required": [
2021-07-19T00:17:02.2822509Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.2823218Z [cluster1]                                         ],
2021-07-19T00:17:02.2823746Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.2824289Z [cluster1]                                     },
2021-07-19T00:17:02.2824815Z [cluster1]                                     "gateways": {
2021-07-19T00:17:02.2825351Z [cluster1]                                         "items": {
2021-07-19T00:17:02.2825927Z [cluster1]                                             "properties": {
2021-07-19T00:17:02.2826556Z [cluster1]                                                 "connections": {
2021-07-19T00:17:02.2827448Z [cluster1]                                                     "items": {
2021-07-19T00:17:02.2828042Z [cluster1]                                                         "properties": {
2021-07-19T00:17:02.2828645Z [cluster1]                                                             "endpoint": {
2021-07-19T00:17:02.2829293Z [cluster1]                                                                 "properties": {
2021-07-19T00:17:02.2829905Z [cluster1]                                                                     "backend": {
2021-07-19T00:17:02.2830500Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2831073Z [cluster1]                                                                     },
2021-07-19T00:17:02.2831744Z [cluster1]                                                                     "backend_config": {
2021-07-19T00:17:02.2832465Z [cluster1]                                                                         "additionalProperties": {
2021-07-19T00:17:02.2833180Z [cluster1]                                                                             "type": "string"
2021-07-19T00:17:02.2833758Z [cluster1]                                                                         },
2021-07-19T00:17:02.2834331Z [cluster1]                                                                         "type": "object"
2021-07-19T00:17:02.2834899Z [cluster1]                                                                     },
2021-07-19T00:17:02.2835461Z [cluster1]                                                                     "cable_name": {
2021-07-19T00:17:02.2836054Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2837167Z [cluster1]                                                                     },
2021-07-19T00:17:02.2837727Z [cluster1]                                                                     "cluster_id": {
2021-07-19T00:17:02.2838331Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2838902Z [cluster1]                                                                     },
2021-07-19T00:17:02.2839495Z [cluster1]                                                                     "healthCheckIP": {
2021-07-19T00:17:02.2840147Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2840722Z [cluster1]                                                                     },
2021-07-19T00:17:02.2841276Z [cluster1]                                                                     "hostname": {
2021-07-19T00:17:02.2841877Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2842456Z [cluster1]                                                                     },
2021-07-19T00:17:02.2843009Z [cluster1]                                                                     "nat_enabled": {
2021-07-19T00:17:02.2843625Z [cluster1]                                                                         "type": "boolean"
2021-07-19T00:17:02.2844253Z [cluster1]                                                                     },
2021-07-19T00:17:02.2844834Z [cluster1]                                                                     "private_ip": {
2021-07-19T00:17:02.2845444Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2845998Z [cluster1]                                                                     },
2021-07-19T00:17:02.2846898Z [cluster1]                                                                     "public_ip": {
2021-07-19T00:17:02.2847531Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2848093Z [cluster1]                                                                     },
2021-07-19T00:17:02.2848653Z [cluster1]                                                                     "subnets": {
2021-07-19T00:17:02.2849228Z [cluster1]                                                                         "items": {
2021-07-19T00:17:02.2849813Z [cluster1]                                                                             "type": "string"
2021-07-19T00:17:02.2850379Z [cluster1]                                                                         },
2021-07-19T00:17:02.2850951Z [cluster1]                                                                         "type": "array"
2021-07-19T00:17:02.2851507Z [cluster1]                                                                     }
2021-07-19T00:17:02.2852034Z [cluster1]                                                                 },
2021-07-19T00:17:02.2852671Z [cluster1]                                                                 "required": [
2021-07-19T00:17:02.2853358Z [cluster1]                                                                     "backend",
2021-07-19T00:17:02.2853948Z [cluster1]                                                                     "cable_name",
2021-07-19T00:17:02.2854531Z [cluster1]                                                                     "cluster_id",
2021-07-19T00:17:02.2855119Z [cluster1]                                                                     "hostname",
2021-07-19T00:17:02.2855717Z [cluster1]                                                                     "nat_enabled",
2021-07-19T00:17:02.2856308Z [cluster1]                                                                     "private_ip",
2021-07-19T00:17:02.2856908Z [cluster1]                                                                     "public_ip",
2021-07-19T00:17:02.2857507Z [cluster1]                                                                     "subnets"
2021-07-19T00:17:02.2858049Z [cluster1]                                                                 ],
2021-07-19T00:17:02.2858625Z [cluster1]                                                                 "type": "object"
2021-07-19T00:17:02.2859174Z [cluster1]                                                             },
2021-07-19T00:17:02.2859749Z [cluster1]                                                             "latencyRTT": {
2021-07-19T00:17:02.2860744Z [cluster1]                                                                 "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T00:17:02.2861722Z [cluster1]                                                                 "properties": {
2021-07-19T00:17:02.2862329Z [cluster1]                                                                     "average": {
2021-07-19T00:17:02.2862933Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2863488Z [cluster1]                                                                     },
2021-07-19T00:17:02.2864037Z [cluster1]                                                                     "last": {
2021-07-19T00:17:02.2864623Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2865545Z [cluster1]                                                                     },
2021-07-19T00:17:02.2866099Z [cluster1]                                                                     "max": {
2021-07-19T00:17:02.2866665Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2867240Z [cluster1]                                                                     },
2021-07-19T00:17:02.2890083Z [cluster1]                                                                     "min": {
2021-07-19T00:17:02.2890818Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2891414Z [cluster1]                                                                     },
2021-07-19T00:17:02.2891983Z [cluster1]                                                                     "stdDev": {
2021-07-19T00:17:02.2892578Z [cluster1]                                                                         "type": "string"
2021-07-19T00:17:02.2893154Z [cluster1]                                                                     }
2021-07-19T00:17:02.2893684Z [cluster1]                                                                 },
2021-07-19T00:17:02.2894245Z [cluster1]                                                                 "type": "object"
2021-07-19T00:17:02.2894808Z [cluster1]                                                             },
2021-07-19T00:17:02.2895355Z [cluster1]                                                             "status": {
2021-07-19T00:17:02.2896069Z [cluster1]                                                                 "type": "string"
2021-07-19T00:17:02.2896638Z [cluster1]                                                             },
2021-07-19T00:17:02.2897226Z [cluster1]                                                             "statusMessage": {
2021-07-19T00:17:02.2897862Z [cluster1]                                                                 "type": "string"
2021-07-19T00:17:02.2898420Z [cluster1]                                                             },
2021-07-19T00:17:02.2898959Z [cluster1]                                                             "usingIP": {
2021-07-19T00:17:02.2899556Z [cluster1]                                                                 "type": "string"
2021-07-19T00:17:02.2900121Z [cluster1]                                                             },
2021-07-19T00:17:02.2900670Z [cluster1]                                                             "usingNAT": {
2021-07-19T00:17:02.2901280Z [cluster1]                                                                 "type": "boolean"
2021-07-19T00:17:02.2901838Z [cluster1]                                                             }
2021-07-19T00:17:02.2902354Z [cluster1]                                                         },
2021-07-19T00:17:02.2902905Z [cluster1]                                                         "required": [
2021-07-19T00:17:02.2909799Z [cluster1]                                                             "endpoint",
2021-07-19T00:17:02.2910415Z [cluster1]                                                             "status",
2021-07-19T00:17:02.2911035Z [cluster1]                                                             "statusMessage"
2021-07-19T00:17:02.2911613Z [cluster1]                                                         ],
2021-07-19T00:17:02.2912176Z [cluster1]                                                         "type": "object"
2021-07-19T00:17:02.2912741Z [cluster1]                                                     },
2021-07-19T00:17:02.2913278Z [cluster1]                                                     "type": "array"
2021-07-19T00:17:02.2913821Z [cluster1]                                                 },
2021-07-19T00:17:02.2914349Z [cluster1]                                                 "haStatus": {
2021-07-19T00:17:02.2915059Z [cluster1]                                                     "type": "string"
2021-07-19T00:17:02.2915616Z [cluster1]                                                 },
2021-07-19T00:17:02.2916176Z [cluster1]                                                 "localEndpoint": {
2021-07-19T00:17:02.2917128Z [cluster1]                                                     "properties": {
2021-07-19T00:17:02.2929280Z [cluster1]                                                         "backend": {
2021-07-19T00:17:02.2929883Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2930467Z [cluster1]                                                         },
2021-07-19T00:17:02.2931024Z [cluster1]                                                         "backend_config": {
2021-07-19T00:17:02.2931726Z [cluster1]                                                             "additionalProperties": {
2021-07-19T00:17:02.2932421Z [cluster1]                                                                 "type": "string"
2021-07-19T00:17:02.2932968Z [cluster1]                                                             },
2021-07-19T00:17:02.2933527Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2934077Z [cluster1]                                                         },
2021-07-19T00:17:02.2934609Z [cluster1]                                                         "cable_name": {
2021-07-19T00:17:02.2935203Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2935878Z [cluster1]                                                         },
2021-07-19T00:17:02.2936425Z [cluster1]                                                         "cluster_id": {
2021-07-19T00:17:02.2937014Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2938359Z [cluster1]                                                         },
2021-07-19T00:17:02.2938969Z [cluster1]                                                         "healthCheckIP": {
2021-07-19T00:17:02.2939609Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2940156Z [cluster1]                                                         },
2021-07-19T00:17:02.2940703Z [cluster1]                                                         "hostname": {
2021-07-19T00:17:02.2941294Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2941842Z [cluster1]                                                         },
2021-07-19T00:17:02.2942398Z [cluster1]                                                         "nat_enabled": {
2021-07-19T00:17:02.2942987Z [cluster1]                                                             "type": "boolean"
2021-07-19T00:17:02.2943548Z [cluster1]                                                         },
2021-07-19T00:17:02.2944103Z [cluster1]                                                         "private_ip": {
2021-07-19T00:17:02.2944695Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2945247Z [cluster1]                                                         },
2021-07-19T00:17:02.2945790Z [cluster1]                                                         "public_ip": {
2021-07-19T00:17:02.2946372Z [cluster1]                                                             "type": "string"
2021-07-19T00:17:02.2946929Z [cluster1]                                                         },
2021-07-19T00:17:02.2947461Z [cluster1]                                                         "subnets": {
2021-07-19T00:17:02.2948027Z [cluster1]                                                             "items": {
2021-07-19T00:17:02.2948600Z [cluster1]                                                                 "type": "string"
2021-07-19T00:17:02.2949151Z [cluster1]                                                             },
2021-07-19T00:17:02.2949799Z [cluster1]                                                             "type": "array"
2021-07-19T00:17:02.2950371Z [cluster1]                                                         }
2021-07-19T00:17:02.2950867Z [cluster1]                                                     },
2021-07-19T00:17:02.2951411Z [cluster1]                                                     "required": [
2021-07-19T00:17:02.2951977Z [cluster1]                                                         "backend",
2021-07-19T00:17:02.2952556Z [cluster1]                                                         "cable_name",
2021-07-19T00:17:02.2953138Z [cluster1]                                                         "cluster_id",
2021-07-19T00:17:02.2953709Z [cluster1]                                                         "hostname",
2021-07-19T00:17:02.2954295Z [cluster1]                                                         "nat_enabled",
2021-07-19T00:17:02.2954887Z [cluster1]                                                         "private_ip",
2021-07-19T00:17:02.2955458Z [cluster1]                                                         "public_ip",
2021-07-19T00:17:02.2956034Z [cluster1]                                                         "subnets"
2021-07-19T00:17:02.2956571Z [cluster1]                                                     ],
2021-07-19T00:17:02.2957112Z [cluster1]                                                     "type": "object"
2021-07-19T00:17:02.2957664Z [cluster1]                                                 },
2021-07-19T00:17:02.2958291Z [cluster1]                                                 "statusFailure": {
2021-07-19T00:17:02.2958937Z [cluster1]                                                     "type": "string"
2021-07-19T00:17:02.2959487Z [cluster1]                                                 },
2021-07-19T00:17:02.2960011Z [cluster1]                                                 "version": {
2021-07-19T00:17:02.2960584Z [cluster1]                                                     "type": "string"
2021-07-19T00:17:02.2961141Z [cluster1]                                                 }
2021-07-19T00:17:02.2961629Z [cluster1]                                             },
2021-07-19T00:17:02.2962164Z [cluster1]                                             "required": [
2021-07-19T00:17:02.2962737Z [cluster1]                                                 "connections",
2021-07-19T00:17:02.2963325Z [cluster1]                                                 "haStatus",
2021-07-19T00:17:02.2963938Z [cluster1]                                                 "localEndpoint",
2021-07-19T00:17:02.2964573Z [cluster1]                                                 "statusFailure",
2021-07-19T00:17:02.2965168Z [cluster1]                                                 "version"
2021-07-19T00:17:02.2965685Z [cluster1]                                             ],
2021-07-19T00:17:02.2966231Z [cluster1]                                             "type": "object"
2021-07-19T00:17:02.2967105Z [cluster1]                                         },
2021-07-19T00:17:02.2967628Z [cluster1]                                         "type": "array"
2021-07-19T00:17:02.2968150Z [cluster1]                                     },
2021-07-19T00:17:02.2968679Z [cluster1]                                     "globalCIDR": {
2021-07-19T00:17:02.2969264Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.2969791Z [cluster1]                                     },
2021-07-19T00:17:02.2970469Z [cluster1]                                     "globalnetDaemonSetStatus": {
2021-07-19T00:17:02.2971214Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.2971895Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T00:17:02.2972553Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.2973095Z [cluster1]                                             },
2021-07-19T00:17:02.2973918Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.2974674Z [cluster1]                                                 "type": "boolean"
2021-07-19T00:17:02.2975221Z [cluster1]                                             },
2021-07-19T00:17:02.2975885Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.2976580Z [cluster1]                                                 "items": {
2021-07-19T00:17:02.2977800Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.2979035Z [cluster1]                                                     "properties": {
2021-07-19T00:17:02.2979621Z [cluster1]                                                         "running": {
2021-07-19T00:17:02.2980335Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.2981064Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2981679Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.2982841Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.2983924Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2984570Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2985120Z [cluster1]                                                                 }
2021-07-19T00:17:02.2985643Z [cluster1]                                                             },
2021-07-19T00:17:02.2986211Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.2986756Z [cluster1]                                                         },
2021-07-19T00:17:02.2987319Z [cluster1]                                                         "terminated": {
2021-07-19T00:17:02.2988079Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.2988836Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.2989467Z [cluster1]                                                                 "containerID": {
2021-07-19T00:17:02.2990549Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.2991362Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2991931Z [cluster1]                                                                 },
2021-07-19T00:17:02.2992498Z [cluster1]                                                                 "exitCode": {
2021-07-19T00:17:02.2993284Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.2994074Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.2994682Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.2995261Z [cluster1]                                                                 },
2021-07-19T00:17:02.2995834Z [cluster1]                                                                 "finishedAt": {
2021-07-19T00:17:02.2996658Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.2997665Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.2998305Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.2998862Z [cluster1]                                                                 },
2021-07-19T00:17:02.2999420Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3000232Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.3001042Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3001607Z [cluster1]                                                                 },
2021-07-19T00:17:02.3002161Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3002939Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.3003731Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3004291Z [cluster1]                                                                 },
2021-07-19T00:17:02.3004834Z [cluster1]                                                                 "signal": {
2021-07-19T00:17:02.3012426Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.3013564Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.3014431Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.3015050Z [cluster1]                                                                 },
2021-07-19T00:17:02.3015611Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.3016435Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.3018648Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3019443Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3020164Z [cluster1]                                                                 }
2021-07-19T00:17:02.3020824Z [cluster1]                                                             },
2021-07-19T00:17:02.3021520Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.3022162Z [cluster1]                                                                 "exitCode"
2021-07-19T00:17:02.3022730Z [cluster1]                                                             ],
2021-07-19T00:17:02.3023282Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3023841Z [cluster1]                                                         },
2021-07-19T00:17:02.3024665Z [cluster1]                                                         "waiting": {
2021-07-19T00:17:02.3026072Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.3026834Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3027426Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3028215Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.3029962Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3030720Z [cluster1]                                                                 },
2021-07-19T00:17:02.3031408Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3032310Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.3033214Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3033924Z [cluster1]                                                                 }
2021-07-19T00:17:02.3034586Z [cluster1]                                                             },
2021-07-19T00:17:02.3036400Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3036972Z [cluster1]                                                         }
2021-07-19T00:17:02.3037473Z [cluster1]                                                     },
2021-07-19T00:17:02.3038024Z [cluster1]                                                     "type": "object"
2021-07-19T00:17:02.3038838Z [cluster1]                                                 },
2021-07-19T00:17:02.3039367Z [cluster1]                                                 "type": "array"
2021-07-19T00:17:02.3039904Z [cluster1]                                             },
2021-07-19T00:17:02.3040538Z [cluster1]                                             "status": {
2021-07-19T00:17:02.3041364Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.3042216Z [cluster1]                                                 "properties": {
2021-07-19T00:17:02.3042858Z [cluster1]                                                     "collisionCount": {
2021-07-19T00:17:02.3044162Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.3045413Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3046000Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3046996Z [cluster1]                                                     },
2021-07-19T00:17:02.3048018Z [cluster1]                                                     "conditions": {
2021-07-19T00:17:02.3049561Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.3050448Z [cluster1]                                                         "items": {
2021-07-19T00:17:02.3051347Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.3052245Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3052937Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.3053851Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.3054904Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3055548Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3056115Z [cluster1]                                                                 },
2021-07-19T00:17:02.3056774Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3058051Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.3058898Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3059455Z [cluster1]                                                                 },
2021-07-19T00:17:02.3060015Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3061038Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.3061816Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3062381Z [cluster1]                                                                 },
2021-07-19T00:17:02.3062919Z [cluster1]                                                                 "status": {
2021-07-19T00:17:02.3063685Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.3064460Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3065017Z [cluster1]                                                                 },
2021-07-19T00:17:02.3065676Z [cluster1]                                                                 "type": {
2021-07-19T00:17:02.3066382Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.3067098Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3067670Z [cluster1]                                                                 }
2021-07-19T00:17:02.3068597Z [cluster1]                                                             },
2021-07-19T00:17:02.3069157Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.3069743Z [cluster1]                                                                 "status",
2021-07-19T00:17:02.3070289Z [cluster1]                                                                 "type"
2021-07-19T00:17:02.3070825Z [cluster1]                                                             ],
2021-07-19T00:17:02.3071399Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3071945Z [cluster1]                                                         },
2021-07-19T00:17:02.3072507Z [cluster1]                                                         "type": "array"
2021-07-19T00:17:02.3073042Z [cluster1]                                                     },
2021-07-19T00:17:02.3073920Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.3075585Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3077236Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3077839Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3078406Z [cluster1]                                                     },
2021-07-19T00:17:02.3081215Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.3082777Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3084094Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3084701Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3085235Z [cluster1]                                                     },
2021-07-19T00:17:02.3085837Z [cluster1]                                                     "numberAvailable": {
2021-07-19T00:17:02.3087178Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.3129838Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3130631Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3131213Z [cluster1]                                                     },
2021-07-19T00:17:02.3131835Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.3133157Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3134638Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3135260Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3135836Z [cluster1]                                                     },
2021-07-19T00:17:02.3136398Z [cluster1]                                                     "numberReady": {
2021-07-19T00:17:02.3137335Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.3138242Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3138845Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3139427Z [cluster1]                                                     },
2021-07-19T00:17:02.3140039Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T00:17:02.3141216Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.3142303Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3142900Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3143463Z [cluster1]                                                     },
2021-07-19T00:17:02.3144083Z [cluster1]                                                     "observedGeneration": {
2021-07-19T00:17:02.3144990Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.3145818Z [cluster1]                                                         "format": "int64",
2021-07-19T00:17:02.3146412Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3146970Z [cluster1]                                                     },
2021-07-19T00:17:02.3147642Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.3148633Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.3149419Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3150022Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3150570Z [cluster1]                                                     }
2021-07-19T00:17:02.3151076Z [cluster1]                                                 },
2021-07-19T00:17:02.3151603Z [cluster1]                                                 "required": [
2021-07-19T00:17:02.3152316Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.3153147Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.3153922Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T00:17:02.3154606Z [cluster1]                                                     "numberReady"
2021-07-19T00:17:02.3155170Z [cluster1]                                                 ],
2021-07-19T00:17:02.3155711Z [cluster1]                                                 "type": "object"
2021-07-19T00:17:02.3156257Z [cluster1]                                             }
2021-07-19T00:17:02.3156736Z [cluster1]                                         },
2021-07-19T00:17:02.3157266Z [cluster1]                                         "required": [
2021-07-19T00:17:02.3158002Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.3158754Z [cluster1]                                         ],
2021-07-19T00:17:02.3159298Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.3159917Z [cluster1]                                     },
2021-07-19T00:17:02.3160521Z [cluster1]                                     "loadBalancerStatus": {
2021-07-19T00:17:02.3161184Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.3161753Z [cluster1]                                             "status": {
2021-07-19T00:17:02.3163001Z [cluster1]                                                 "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T00:17:02.3163833Z [cluster1]                                                 "properties": {
2021-07-19T00:17:02.3184276Z [cluster1]                                                     "ingress": {
2021-07-19T00:17:02.3185768Z [cluster1]                                                         "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T00:17:02.3186852Z [cluster1]                                                         "items": {
2021-07-19T00:17:02.3188251Z [cluster1]                                                             "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T00:17:02.3189416Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3189966Z [cluster1]                                                                 "hostname": {
2021-07-19T00:17:02.3196110Z [cluster1]                                                                     "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T00:17:02.3197026Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3197511Z [cluster1]                                                                 },
2021-07-19T00:17:02.3197949Z [cluster1]                                                                 "ip": {
2021-07-19T00:17:02.3199442Z [cluster1]                                                                     "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T00:17:02.3200467Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3200960Z [cluster1]                                                                 }
2021-07-19T00:17:02.3201525Z [cluster1]                                                             },
2021-07-19T00:17:02.3202099Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3202585Z [cluster1]                                                         },
2021-07-19T00:17:02.3203652Z [cluster1]                                                         "type": "array"
2021-07-19T00:17:02.3204159Z [cluster1]                                                     }
2021-07-19T00:17:02.3204609Z [cluster1]                                                 },
2021-07-19T00:17:02.3206681Z [cluster1]                                                 "type": "object"
2021-07-19T00:17:02.3207234Z [cluster1]                                             }
2021-07-19T00:17:02.3207666Z [cluster1]                                         },
2021-07-19T00:17:02.3208141Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.3208598Z [cluster1]                                     },
2021-07-19T00:17:02.3210313Z [cluster1]                                     "natEnabled": {
2021-07-19T00:17:02.3210901Z [cluster1]                                         "type": "boolean"
2021-07-19T00:17:02.3211511Z [cluster1]                                     },
2021-07-19T00:17:02.3212098Z [cluster1]                                     "networkPlugin": {
2021-07-19T00:17:02.3212629Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.3213088Z [cluster1]                                     },
2021-07-19T00:17:02.3213859Z [cluster1]                                     "routeAgentDaemonSetStatus": {
2021-07-19T00:17:02.3214634Z [cluster1]                                         "properties": {
2021-07-19T00:17:02.3215257Z [cluster1]                                             "lastResourceVersion": {
2021-07-19T00:17:02.3216290Z [cluster1]                                                 "type": "string"
2021-07-19T00:17:02.3216774Z [cluster1]                                             },
2021-07-19T00:17:02.3217407Z [cluster1]                                             "mismatchedContainerImages": {
2021-07-19T00:17:02.3218091Z [cluster1]                                                 "type": "boolean"
2021-07-19T00:17:02.3218575Z [cluster1]                                             },
2021-07-19T00:17:02.3227123Z [cluster1]                                             "nonReadyContainerStates": {
2021-07-19T00:17:02.3227768Z [cluster1]                                                 "items": {
2021-07-19T00:17:02.3228979Z [cluster1]                                                     "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T00:17:02.3230257Z [cluster1]                                                     "properties": {
2021-07-19T00:17:02.3230754Z [cluster1]                                                         "running": {
2021-07-19T00:17:02.3231382Z [cluster1]                                                             "description": "Details about a running container",
2021-07-19T00:17:02.3232026Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3232557Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.3233593Z [cluster1]                                                                     "description": "Time at which the container was last (re-)started",
2021-07-19T00:17:02.3234593Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3235148Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3235609Z [cluster1]                                                                 }
2021-07-19T00:17:02.3236045Z [cluster1]                                                             },
2021-07-19T00:17:02.3236599Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3237063Z [cluster1]                                                         },
2021-07-19T00:17:02.3237543Z [cluster1]                                                         "terminated": {
2021-07-19T00:17:02.3238194Z [cluster1]                                                             "description": "Details about a terminated container",
2021-07-19T00:17:02.3238863Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3239396Z [cluster1]                                                                 "containerID": {
2021-07-19T00:17:02.3240405Z [cluster1]                                                                     "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T00:17:02.3241131Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3241594Z [cluster1]                                                                 },
2021-07-19T00:17:02.3242145Z [cluster1]                                                                 "exitCode": {
2021-07-19T00:17:02.3242838Z [cluster1]                                                                     "description": "Exit status from the last termination of the container",
2021-07-19T00:17:02.3243540Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.3244064Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.3244547Z [cluster1]                                                                 },
2021-07-19T00:17:02.3245033Z [cluster1]                                                                 "finishedAt": {
2021-07-19T00:17:02.3245706Z [cluster1]                                                                     "description": "Time at which the container last terminated",
2021-07-19T00:17:02.3246705Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3247258Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3247727Z [cluster1]                                                                 },
2021-07-19T00:17:02.3248195Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3248903Z [cluster1]                                                                     "description": "Message regarding the last termination of the container",
2021-07-19T00:17:02.3249622Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3250091Z [cluster1]                                                                 },
2021-07-19T00:17:02.3250557Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3251251Z [cluster1]                                                                     "description": "(brief) reason from the last termination of the container",
2021-07-19T00:17:02.3251950Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3252423Z [cluster1]                                                                 },
2021-07-19T00:17:02.3252873Z [cluster1]                                                                 "signal": {
2021-07-19T00:17:02.3253626Z [cluster1]                                                                     "description": "Signal from the last termination of the container",
2021-07-19T00:17:02.3254322Z [cluster1]                                                                     "format": "int32",
2021-07-19T00:17:02.3254832Z [cluster1]                                                                     "type": "integer"
2021-07-19T00:17:02.3255314Z [cluster1]                                                                 },
2021-07-19T00:17:02.3255786Z [cluster1]                                                                 "startedAt": {
2021-07-19T00:17:02.3256521Z [cluster1]                                                                     "description": "Time at which previous execution of the container started",
2021-07-19T00:17:02.3257458Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3257989Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3258473Z [cluster1]                                                                 }
2021-07-19T00:17:02.3258896Z [cluster1]                                                             },
2021-07-19T00:17:02.3259366Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.3259868Z [cluster1]                                                                 "exitCode"
2021-07-19T00:17:02.3260341Z [cluster1]                                                             ],
2021-07-19T00:17:02.3260876Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3261336Z [cluster1]                                                         },
2021-07-19T00:17:02.3261793Z [cluster1]                                                         "waiting": {
2021-07-19T00:17:02.3262406Z [cluster1]                                                             "description": "Details about a waiting container",
2021-07-19T00:17:02.3263062Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3263564Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3264268Z [cluster1]                                                                     "description": "Message regarding why the container is not yet running.",
2021-07-19T00:17:02.3264972Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3265437Z [cluster1]                                                                 },
2021-07-19T00:17:02.3265896Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3266545Z [cluster1]                                                                     "description": "(brief) reason the container is not yet running.",
2021-07-19T00:17:02.3267215Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3267690Z [cluster1]                                                                 }
2021-07-19T00:17:02.3268112Z [cluster1]                                                             },
2021-07-19T00:17:02.3270476Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3270957Z [cluster1]                                                         }
2021-07-19T00:17:02.3271383Z [cluster1]                                                     },
2021-07-19T00:17:02.3271844Z [cluster1]                                                     "type": "object"
2021-07-19T00:17:02.3272303Z [cluster1]                                                 },
2021-07-19T00:17:02.3272759Z [cluster1]                                                 "type": "array"
2021-07-19T00:17:02.3273192Z [cluster1]                                             },
2021-07-19T00:17:02.3273631Z [cluster1]                                             "status": {
2021-07-19T00:17:02.3274455Z [cluster1]                                                 "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T00:17:02.3275225Z [cluster1]                                                 "properties": {
2021-07-19T00:17:02.3275769Z [cluster1]                                                     "collisionCount": {
2021-07-19T00:17:02.3276986Z [cluster1]                                                         "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T00:17:02.3278165Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3278672Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3280415Z [cluster1]                                                     },
2021-07-19T00:17:02.3280896Z [cluster1]                                                     "conditions": {
2021-07-19T00:17:02.3282045Z [cluster1]                                                         "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T00:17:02.3283161Z [cluster1]                                                         "items": {
2021-07-19T00:17:02.3284101Z [cluster1]                                                             "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T00:17:02.3285161Z [cluster1]                                                             "properties": {
2021-07-19T00:17:02.3285905Z [cluster1]                                                                 "lastTransitionTime": {
2021-07-19T00:17:02.3287074Z [cluster1]                                                                     "description": "Last time the condition transitioned from one status to another.",
2021-07-19T00:17:02.3288219Z [cluster1]                                                                     "format": "date-time",
2021-07-19T00:17:02.3288916Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3289738Z [cluster1]                                                                 },
2021-07-19T00:17:02.3290634Z [cluster1]                                                                 "message": {
2021-07-19T00:17:02.3291371Z [cluster1]                                                                     "description": "A human readable message indicating details about the transition.",
2021-07-19T00:17:02.3292135Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3292598Z [cluster1]                                                                 },
2021-07-19T00:17:02.3293061Z [cluster1]                                                                 "reason": {
2021-07-19T00:17:02.3294006Z [cluster1]                                                                     "description": "The reason for the condition's last transition.",
2021-07-19T00:17:02.3294677Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3295152Z [cluster1]                                                                 },
2021-07-19T00:17:02.3295599Z [cluster1]                                                                 "status": {
2021-07-19T00:17:02.3296286Z [cluster1]                                                                     "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T00:17:02.3296973Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3297437Z [cluster1]                                                                 },
2021-07-19T00:17:02.3297896Z [cluster1]                                                                 "type": {
2021-07-19T00:17:02.3298607Z [cluster1]                                                                     "description": "Type of DaemonSet condition.",
2021-07-19T00:17:02.3299253Z [cluster1]                                                                     "type": "string"
2021-07-19T00:17:02.3299720Z [cluster1]                                                                 }
2021-07-19T00:17:02.3300161Z [cluster1]                                                             },
2021-07-19T00:17:02.3300635Z [cluster1]                                                             "required": [
2021-07-19T00:17:02.3301502Z [cluster1]                                                                 "status",
2021-07-19T00:17:02.3301980Z [cluster1]                                                                 "type"
2021-07-19T00:17:02.3302420Z [cluster1]                                                             ],
2021-07-19T00:17:02.3302903Z [cluster1]                                                             "type": "object"
2021-07-19T00:17:02.3303375Z [cluster1]                                                         },
2021-07-19T00:17:02.3303827Z [cluster1]                                                         "type": "array"
2021-07-19T00:17:02.3304283Z [cluster1]                                                     },
2021-07-19T00:17:02.3304860Z [cluster1]                                                     "currentNumberScheduled": {
2021-07-19T00:17:02.3306140Z [cluster1]                                                         "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3307362Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3307875Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3308357Z [cluster1]                                                     },
2021-07-19T00:17:02.3308940Z [cluster1]                                                     "desiredNumberScheduled": {
2021-07-19T00:17:02.3310286Z [cluster1]                                                         "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3311826Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3312359Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3312838Z [cluster1]                                                     },
2021-07-19T00:17:02.3313358Z [cluster1]                                                     "numberAvailable": {
2021-07-19T00:17:02.3314430Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.3315459Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3315957Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3316427Z [cluster1]                                                     },
2021-07-19T00:17:02.3316975Z [cluster1]                                                     "numberMisscheduled": {
2021-07-19T00:17:02.3318173Z [cluster1]                                                         "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T00:17:02.3319300Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3319876Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3320361Z [cluster1]                                                     },
2021-07-19T00:17:02.3320841Z [cluster1]                                                     "numberReady": {
2021-07-19T00:17:02.3321681Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T00:17:02.3323003Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3323670Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3324284Z [cluster1]                                                     },
2021-07-19T00:17:02.3324814Z [cluster1]                                                     "numberUnavailable": {
2021-07-19T00:17:02.3325889Z [cluster1]                                                         "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T00:17:02.3326995Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3327493Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3327963Z [cluster1]                                                     },
2021-07-19T00:17:02.3328578Z [cluster1]                                                     "observedGeneration": {
2021-07-19T00:17:02.3329434Z [cluster1]                                                         "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T00:17:02.3330175Z [cluster1]                                                         "format": "int64",
2021-07-19T00:17:02.3330681Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3331156Z [cluster1]                                                     },
2021-07-19T00:17:02.3331735Z [cluster1]                                                     "updatedNumberScheduled": {
2021-07-19T00:17:02.3332568Z [cluster1]                                                         "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T00:17:02.3333598Z [cluster1]                                                         "format": "int32",
2021-07-19T00:17:02.3334111Z [cluster1]                                                         "type": "integer"
2021-07-19T00:17:02.3334587Z [cluster1]                                                     }
2021-07-19T00:17:02.3334995Z [cluster1]                                                 },
2021-07-19T00:17:02.3335448Z [cluster1]                                                 "required": [
2021-07-19T00:17:02.3336057Z [cluster1]                                                     "currentNumberScheduled",
2021-07-19T00:17:02.3336818Z [cluster1]                                                     "desiredNumberScheduled",
2021-07-19T00:17:02.3337524Z [cluster1]                                                     "numberMisscheduled",
2021-07-19T00:17:02.3338112Z [cluster1]                                                     "numberReady"
2021-07-19T00:17:02.3338592Z [cluster1]                                                 ],
2021-07-19T00:17:02.3339036Z [cluster1]                                                 "type": "object"
2021-07-19T00:17:02.3339497Z [cluster1]                                             }
2021-07-19T00:17:02.3339889Z [cluster1]                                         },
2021-07-19T00:17:02.3340330Z [cluster1]                                         "required": [
2021-07-19T00:17:02.3340968Z [cluster1]                                             "mismatchedContainerImages"
2021-07-19T00:17:02.3341568Z [cluster1]                                         ],
2021-07-19T00:17:02.3342087Z [cluster1]                                         "type": "object"
2021-07-19T00:17:02.3342522Z [cluster1]                                     },
2021-07-19T00:17:02.3342981Z [cluster1]                                     "serviceCIDR": {
2021-07-19T00:17:02.3343470Z [cluster1]                                         "type": "string"
2021-07-19T00:17:02.3344233Z [cluster1]                                     }
2021-07-19T00:17:02.3344626Z [cluster1]                                 },
2021-07-19T00:17:02.3345066Z [cluster1]                                 "required": [
2021-07-19T00:17:02.3345548Z [cluster1]                                     "clusterID",
2021-07-19T00:17:02.3346029Z [cluster1]                                     "natEnabled"
2021-07-19T00:17:02.3346471Z [cluster1]                                 ],
2021-07-19T00:17:02.3346898Z [cluster1]                                 "type": "object"
2021-07-19T00:17:02.3347335Z [cluster1]                             }
2021-07-19T00:17:02.3347707Z [cluster1]                         },
2021-07-19T00:17:02.3348141Z [cluster1]                         "type": "object"
2021-07-19T00:17:02.3348546Z [cluster1]                     }
2021-07-19T00:17:02.3348918Z [cluster1]                 },
2021-07-19T00:17:02.3349549Z [cluster1]                 "served": true,
2021-07-19T00:17:02.3350493Z [cluster1]                 "storage": true,
2021-07-19T00:17:02.3350984Z [cluster1]                 "subresources": {
2021-07-19T00:17:02.3351727Z [cluster1]                     "status": {}
2021-07-19T00:17:02.3352253Z [cluster1]                 }
2021-07-19T00:17:02.3352606Z [cluster1]             }
2021-07-19T00:17:02.3352962Z [cluster1]         ]
2021-07-19T00:17:02.3353303Z [cluster1]     },
2021-07-19T00:17:02.3353678Z [cluster1]     "status": {
2021-07-19T00:17:02.3354122Z [cluster1]         "acceptedNames": {
2021-07-19T00:17:02.3354962Z [cluster1]             "kind": "Submariner",
2021-07-19T00:17:03.7418268Z [       "type": "object"
2021-07-19T00:17:03.7418749Z [cluster2]                             }
2021-07-19T00:17:03.7419150Z [cluster2]                         },
2021-07-19T00:17:03.7419570Z [cluster2]                         "type": "object"
2021-07-19T00:17:03.7420001Z [cluster2]                     }
2021-07-19T00:17:03.7420360Z [cluster2]                 },
2021-07-19T00:17:03.7420777Z [cluster2]                 "served": true,
2021-07-19T00:17:03.7421222Z [cluster2]                 "storage": true,
2021-07-19T00:17:03.7421722Z [cluster2]                 "subresources": {
2021-07-19T00:17:03.7422176Z [cluster2]                     "status": {}
2021-07-19T00:17:03.7422568Z [cluster2]                 }
2021-07-19T00:17:03.7422921Z [cluster2]             }
2021-07-19T00:17:03.7423279Z [cluster2]         ]
2021-07-19T00:17:03.7423628Z [cluster2]     },
2021-07-19T00:17:03.7424006Z [cluster2]     "status": {
2021-07-19T00:17:03.7424459Z [cluster2]         "acceptedNames": {
2021-07-19T00:17:03.7424954Z [cluster2]             "kind": "Submariner",
2021-07-19T00:17:03.7425495Z [cluster2]             "listKind": "SubmarinerList",
2021-07-19T00:17:03.7426048Z [cluster2]             "plural": "submariners",
2021-07-19T00:17:03.7426575Z [cluster2]             "singular": "submariner"
2021-07-19T00:17:03.7427002Z [cluster2]         },
2021-07-19T00:17:03.7427404Z [cluster2]         "conditions": [
2021-07-19T00:17:03.7427797Z [cluster2]             {
2021-07-19T00:17:03.7428915Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:42Z",
2021-07-19T00:17:03.7429527Z [cluster2]                 "message": "no conflicts found",
2021-07-19T00:17:03.7430078Z [cluster2]                 "reason": "NoConflicts",
2021-07-19T00:17:03.7430568Z [cluster2]                 "status": "True",
2021-07-19T00:17:03.7431060Z [cluster2]                 "type": "NamesAccepted"
2021-07-19T00:17:03.7431523Z [cluster2]             },
2021-07-19T00:17:03.7431872Z [cluster2]             {
2021-07-19T00:17:03.7432756Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:42Z",
2021-07-19T00:17:03.7433427Z [cluster2]                 "message": "the initial names have been accepted",
2021-07-19T00:17:03.7434129Z [cluster2]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:03.7434698Z [cluster2]                 "status": "True",
2021-07-19T00:17:03.7435189Z [cluster2]                 "type": "Established"
2021-07-19T00:17:03.7435615Z [cluster2]             }
2021-07-19T00:17:03.7435982Z [cluster2]         ],
2021-07-19T00:17:03.7436427Z [cluster2]         "storedVersions": [
2021-07-19T00:17:03.7436887Z [cluster2]             "v1alpha1"
2021-07-19T00:17:03.7437275Z [cluster2]         ]
2021-07-19T00:17:03.7437613Z [cluster2]     }
2021-07-19T00:17:03.7437961Z [cluster2] }
2021-07-19T00:17:03.7438955Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-19T00:17:03.7440380Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-19T00:17:03.7442010Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:03.7443464Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:03.7444561Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T00:17:03.7445991Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:03.7448174Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:03.7449290Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T00:17:03.7450747Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:03.7452202Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-19T00:17:03.7453344Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-19T00:17:03.7454850Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-19T00:17:03.7456302Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-19T00:17:03.7457279Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-19T00:17:03.7458285Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-19T00:17:03.7459412Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-19T00:17:03.7460649Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-19T00:17:03.7461447Z [cluster2] NAME                  STATUS   AGE
2021-07-19T00:17:03.7462143Z [cluster2] submariner-operator   Active   80s
2021-07-19T00:17:03.7463169Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T00:17:03.7464429Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T00:17:03.7465795Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-19T00:17:03.7466673Z [cluster2] NAME                        CREATED AT
2021-07-19T00:17:03.7467455Z [cluster2] submariners.submariner.io   2021-07-19T00:15:42Z
2021-07-19T00:17:03.7468380Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-19T00:17:03.7469340Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-19T00:17:03.7470405Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-19T00:17:03.7471428Z [submariner-operator]$ [cluster2] grep submariners
2021-07-19T00:17:03.7472216Z [cluster2] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-19T00:17:04.0513909Z [submariner-operator]$ [cluscluster1]             "listKind": "SubmarinerList",
2021-07-19T00:17:04.0514673Z [cluster1]             "plural": "submariners",
2021-07-19T00:17:04.0515215Z [cluster1]             "singular": "submariner"
2021-07-19T00:17:04.0515705Z [cluster1]         },
2021-07-19T00:17:04.0516111Z [cluster1]         "conditions": [
2021-07-19T00:17:04.0516518Z [cluster1]             {
2021-07-19T00:17:04.0517220Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:30Z",
2021-07-19T00:17:04.0517834Z [cluster1]                 "message": "no conflicts found",
2021-07-19T00:17:04.0518375Z [cluster1]                 "reason": "NoConflicts",
2021-07-19T00:17:04.0518865Z [cluster1]                 "status": "True",
2021-07-19T00:17:04.0519356Z [cluster1]                 "type": "NamesAccepted"
2021-07-19T00:17:04.0519818Z [cluster1]             },
2021-07-19T00:17:04.0520168Z [cluster1]             {
2021-07-19T00:17:04.0520846Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:30Z",
2021-07-19T00:17:04.0521513Z [cluster1]                 "message": "the initial names have been accepted",
2021-07-19T00:17:04.0522222Z [cluster1]                 "reason": "InitialNamesAccepted",
2021-07-19T00:17:04.0522804Z [cluster1]                 "status": "True",
2021-07-19T00:17:04.0523273Z [cluster1]                 "type": "Established"
2021-07-19T00:17:04.0523715Z [cluster1]             }
2021-07-19T00:17:04.0524062Z [cluster1]         ],
2021-07-19T00:17:04.0524505Z [cluster1]         "storedVersions": [
2021-07-19T00:17:04.0525068Z [cluster1]             "v1alpha1"
2021-07-19T00:17:04.0525457Z [cluster1]         ]
2021-07-19T00:17:04.0525798Z [cluster1]     }
2021-07-19T00:17:04.0526142Z [cluster1] }
2021-07-19T00:17:04.0527270Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-19T00:17:04.0528700Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-19T00:17:04.0530339Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:04.0531767Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:04.0532856Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T00:17:04.0534279Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:04.0535711Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:04.0536837Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T00:17:04.0538272Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:04.0539718Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-19T00:17:04.0540849Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-19T00:17:04.0542356Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-19T00:17:04.0543693Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-19T00:17:04.0544604Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-19T00:17:04.0545615Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-19T00:17:04.0546712Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-19T00:17:04.0547954Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-19T00:17:04.0548753Z [cluster1] NAME                  STATUS   AGE
2021-07-19T00:17:04.0549448Z [cluster1] submariner-operator   Active   92s
2021-07-19T00:17:04.0550471Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T00:17:04.0551811Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T00:17:04.0553208Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-19T00:17:04.0554079Z [cluster1] NAME                        CREATED AT
2021-07-19T00:17:04.0554854Z [cluster1] submariners.submariner.io   2021-07-19T00:15:30Z
2021-07-19T00:17:04.0555783Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-19T00:17:04.0556740Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-19T00:17:04.0557807Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-19T00:17:04.0558830Z [submariner-operator]$ [cluster1] grep submariners
2021-07-19T00:17:04.0559632Z [cluster1] submariners                                    submariner.io/v1alpha1            true         Submariner
2021-07-19T00:17:04.0560868Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:04.0562489Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:04.0564076Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:04.0565052Z [cluster1] NAME                  SECRETS   AGE
2021-07-19T00:17:04.0565745Z [cluster1] submariner-operator   1         93s
2021-07-19T00:17:04.0567104Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8462271Z [submariner-operator]$ [cluster1] kubectl get roles --namespacter2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8464083Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8465741Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8466735Z [cluster2] NAME                  SECRETS   AGE
2021-07-19T00:17:05.8467414Z [cluster2] submariner-operator   1         82s
2021-07-19T00:17:05.8468578Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8470073Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8471704Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8472692Z [cluster2] NAME                  CREATED AT
2021-07-19T00:17:05.8473384Z [cluster2] submariner-operator   2021-07-19T00:15:43Z
2021-07-19T00:17:05.8474608Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8476200Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8477916Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8478959Z [cluster2] NAME                  ROLE                       AGE
2021-07-19T00:17:05.8479782Z [cluster2] submariner-operator   Role/submariner-operator   81s
2021-07-19T00:17:05.8481121Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8482707Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8484422Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8485669Z [cluster2] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-19T00:17:05.8486809Z [cluster2] submariner-operator   1/1     1            1           76s
2021-07-19T00:17:05.8487695Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-19T00:17:05.8488563Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-19T00:17:05.8489976Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T00:17:05.8491835Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8493742Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8495762Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8497791Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o json
2021-07-19T00:17:05.8499776Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o json
2021-07-19T00:17:05.8501891Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o json
2021-07-19T00:17:05.8503143Z [cluster2] {
2021-07-19T00:17:05.8503555Z [cluster2]     "apiVersion": "v1",
2021-07-19T00:17:05.8503985Z [cluster2]     "kind": "Pod",
2021-07-19T00:17:05.8504406Z [cluster2]     "metadata": {
2021-07-19T00:17:05.8505112Z [cluster2]         "creationTimestamp": "2021-07-19T00:15:49Z",
2021-07-19T00:17:05.8506092Z [cluster2]         "generateName": "submariner-operator-5bfdb87494-",
2021-07-19T00:17:05.8506822Z [cluster2]         "labels": {
2021-07-19T00:17:05.8507485Z [cluster2]             "name": "submariner-operator",
2021-07-19T00:17:05.8508277Z [cluster2]             "pod-template-hash": "5bfdb87494"
2021-07-19T00:17:05.8508759Z [cluster2]         },
2021-07-19T00:17:05.8509192Z [cluster2]         "managedFields": [
2021-07-19T00:17:05.8509613Z [cluster2]             {
2021-07-19T00:17:05.8510040Z [cluster2]                 "apiVersion": "v1",
2021-07-19T00:17:05.8510546Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:05.8511046Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:05.8511498Z [cluster2]                     "f:metadata": {
2021-07-19T00:17:05.8511986Z [cluster2]                         "f:generateName": {},
2021-07-19T00:17:05.8512473Z [cluster2]                         "f:labels": {
2021-07-19T00:17:05.8512879Z [cluster2]                             ".": {},
2021-07-19T00:17:05.8513292Z [cluster2]                             "f:name": {},
2021-07-19T00:17:05.8513958Z [cluster2]                             "f:pod-template-hash": {}
2021-07-19T00:17:05.8514451Z [cluster2]                         },
2021-07-19T00:17:05.8514925Z [cluster2]                         "f:ownerReferences": {
2021-07-19T00:17:05.8515413Z [cluster2]                             ".": {},
2021-07-19T00:17:05.8516228Z [cluster2]                             "k:{\"uid\":\"f6a1c5b1-e630-4cb6-bb88-6a2b79dd4a41\"}": {
2021-07-19T00:17:05.8516840Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8517308Z [cluster2]                                 "f:apiVersion": {},
2021-07-19T00:17:05.8517873Z [cluster2]                                 "f:blockOwnerDeletion": {},
2021-07-19T00:17:05.8518448Z [cluster2]                                 "f:controller": {},
2021-07-19T00:17:05.8518905Z [cluster2]                                 "f:kind": {},
2021-07-19T00:17:05.8519336Z [cluster2]                                 "f:name": {},
2021-07-19T00:17:05.8519828Z [cluster2]                                 "f:uid": {}
2021-07-19T00:17:05.8520236Z [cluster2]                             }
2021-07-19T00:17:05.8520621Z [cluster2]                         }
2021-07-19T00:17:05.8520988Z [cluster2]                     },
2021-07-19T00:17:05.8521392Z [cluster2]                     "f:spec": {
2021-07-19T00:17:05.8521834Z [cluster2]                         "f:containers": {
2021-07-19T00:17:05.8522617Z [cluster2]                             "k:{\"name\":\"submariner-operator\"}": {
2021-07-19T00:17:05.8523169Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8523606Z [cluster2]                                 "f:command": {},
2021-07-19T00:17:05.8524043Z [cluster2]                                 "f:env": {
2021-07-19T00:17:05.8524462Z [cluster2]                                     ".": {},
2021-07-19T00:17:05.8524952Z [cluster2]                                     "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-19T00:17:05.8525433Z [cluster2]                                         ".": {},
2021-07-19T00:17:05.8525873Z [cluster2]                                         "f:name": {},
2021-07-19T00:17:05.8555046Z [cluster2]                                         "f:value": {}
2021-07-19T00:17:05.8555662Z [cluster2]                                     },
2021-07-19T00:17:05.8556130Z [cluster2]                                     "k:{\"name\":\"POD_NAME\"}": {
2021-07-19T00:17:05.8556601Z [cluster2]                                         ".": {},
2021-07-19T00:17:05.8557028Z [cluster2]                                         "f:name": {},
2021-07-19T00:17:05.8557683Z [cluster2]                                         "f:valueFrom": {
2021-07-19T00:17:05.8558143Z [cluster2]                                             ".": {},
2021-07-19T00:17:05.8558593Z [cluster2]                                             "f:fieldRef": {
2021-07-19T00:17:05.8559057Z [cluster2]                                                 ".": {},
2021-07-19T00:17:05.8559536Z [cluster2]                                                 "f:apiVersion": {},
2021-07-19T00:17:05.8560059Z [cluster2]                                                 "f:fieldPath": {}
2021-07-19T00:17:05.8560512Z [cluster2]                                             }
2021-07-19T00:17:05.8560979Z [cluster2]                                         }
2021-07-19T00:17:05.8561371Z [cluster2]                                     },
2021-07-19T00:17:05.8561868Z [cluster2]                                     "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-19T00:17:05.8562379Z [cluster2]                                         ".": {},
2021-07-19T00:17:05.8562799Z [cluster2]                                         "f:name": {},
2021-07-19T00:17:05.8563278Z [cluster2]                                         "f:valueFrom": {
2021-07-19T00:17:05.8563725Z [cluster2]                                             ".": {},
2021-07-19T00:17:05.8564186Z [cluster2]                                             "f:fieldRef": {
2021-07-19T00:17:05.8564638Z [cluster2]                                                 ".": {},
2021-07-19T00:17:05.8565115Z [cluster2]                                                 "f:apiVersion": {},
2021-07-19T00:17:05.8565636Z [cluster2]                                                 "f:fieldPath": {}
2021-07-19T00:17:05.8566088Z [cluster2]                                             }
2021-07-19T00:17:05.8576751Z [cluster2]                                         }
2021-07-19T00:17:05.8577150Z [cluster2]                                     }
2021-07-19T00:17:05.8577553Z [cluster2]                                 },
2021-07-19T00:17:05.8577967Z [cluster2]                                 "f:image": {},
2021-07-19T00:17:05.8578492Z [cluster2]                                 "f:imagePullPolicy": {},
2021-07-19T00:17:05.8578999Z [cluster2]                                 "f:name": {},
2021-07-19T00:17:05.8579473Z [cluster2]                                 "f:resources": {},
2021-07-19T00:17:05.8580168Z [cluster2]                                 "f:terminationMessagePath": {},
2021-07-19T00:17:05.8581048Z [cluster2]                                 "f:terminationMessagePolicy": {}
2021-07-19T00:17:05.8581642Z [cluster2]                             }
2021-07-19T00:17:05.8582014Z [cluster2]                         },
2021-07-19T00:17:05.8582448Z [cluster2]                         "f:dnsPolicy": {},
2021-07-19T00:17:05.8582999Z [cluster2]                         "f:enableServiceLinks": {},
2021-07-19T00:17:05.8583591Z [cluster2]                         "f:restartPolicy": {},
2021-07-19T00:17:05.8584122Z [cluster2]                         "f:schedulerName": {},
2021-07-19T00:17:05.8584684Z [cluster2]                         "f:securityContext": {},
2021-07-19T00:17:05.8585251Z [cluster2]                         "f:serviceAccount": {},
2021-07-19T00:17:05.8585836Z [cluster2]                         "f:serviceAccountName": {},
2021-07-19T00:17:05.8586618Z [cluster2]                         "f:terminationGracePeriodSeconds": {}
2021-07-19T00:17:05.8587258Z [cluster2]                     }
2021-07-19T00:17:05.8587634Z [cluster2]                 },
2021-07-19T00:17:05.8588647Z [cluster2]                 "manager": "kube-controller-manager",
2021-07-19T00:17:05.8589293Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:05.8589922Z [cluster2]                 "time": "2021-07-19T00:15:49Z"
2021-07-19T00:17:05.8590332Z [cluster2]             },
2021-07-19T00:17:05.8590697Z [cluster2]             {
2021-07-19T00:17:05.8591112Z [cluster2]                 "apiVersion": "v1",
2021-07-19T00:17:05.8591718Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:05.8592203Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:05.8592758Z [cluster2]                     "f:status": {
2021-07-19T00:17:05.8593204Z [cluster2]                         "f:conditions": {
2021-07-19T00:17:05.8593765Z [cluster2]                             "k:{\"type\":\"ContainersReady\"}": {
2021-07-19T00:17:05.8594358Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8594848Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8595434Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8595981Z [cluster2]                                 "f:status": {},
2021-07-19T00:17:05.8596428Z [cluster2]                                 "f:type": {}
2021-07-19T00:17:05.8596827Z [cluster2]                             },
2021-07-19T00:17:05.8597308Z [cluster2]                             "k:{\"type\":\"Initialized\"}": {
2021-07-19T00:17:05.8597780Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8598262Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8598844Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8599468Z [cluster2]                                 "f:status": {},
2021-07-19T00:17:05.8599916Z [cluster2]                                 "f:type": {}
2021-07-19T00:17:05.8600316Z [cluster2]                             },
2021-07-19T00:17:05.8600752Z [cluster2]                             "k:{\"type\":\"Ready\"}": {
2021-07-19T00:17:05.8601185Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8601724Z [cluster2]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8602311Z [cluster2]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8602851Z [cluster2]                                 "f:status": {},
2021-07-19T00:17:05.8603289Z [cluster2]                                 "f:type": {}
2021-07-19T00:17:05.8603698Z [cluster2]                             }
2021-07-19T00:17:05.8604073Z [cluster2]                         },
2021-07-19T00:17:05.8604570Z [cluster2]                         "f:containerStatuses": {},
2021-07-19T00:17:05.8605101Z [cluster2]                         "f:hostIP": {},
2021-07-19T00:17:05.8605535Z [cluster2]                         "f:phase": {},
2021-07-19T00:17:05.8605976Z [cluster2]                         "f:podIP": {},
2021-07-19T00:17:05.8611167Z [cluster2]                         "f:podIPs": {
2021-07-19T00:17:05.8611682Z [cluster2]                             ".": {},
2021-07-19T00:17:05.8612103Z [cluster2]                             "k:{\"ip\":\"10.0.128.2\"}": {
2021-07-19T00:17:05.8612534Z [cluster2]                                 ".": {},
2021-07-19T00:17:05.8612939Z [cluster2]                                 "f:ip": {}
2021-07-19T00:17:05.8613349Z [cluster2]                             }
2021-07-19T00:17:05.8613744Z [cluster2]                         },
2021-07-19T00:17:05.8614167Z [cluster2]                         "f:startTime": {}
2021-07-19T00:17:05.8614593Z [cluster2]                     }
2021-07-19T00:17:05.8614954Z [cluster2]                 },
2021-07-19T00:17:05.8615392Z [cluster2]                 "manager": "kubelet",
2021-07-19T00:17:05.8615886Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:05.8616723Z [cluster2]                 "time": "2021-07-19T00:16:03Z"
2021-07-19T00:17:05.8617124Z [cluster2]             }
2021-07-19T00:17:05.8617487Z [cluster2]         ],
2021-07-19T00:17:05.8618361Z [cluster2]         "name": "submariner-operator-5bfdb87494-fhr8g",
2021-07-19T00:17:05.8619396Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T00:17:05.8620024Z [cluster2]         "ownerReferences": [
2021-07-19T00:17:05.8620464Z [cluster2]             {
2021-07-19T00:17:05.8620909Z [cluster2]                 "apiVersion": "apps/v1",
2021-07-19T00:17:05.8621484Z [cluster2]                 "blockOwnerDeletion": true,
2021-07-19T00:17:05.8622150Z [cluster2]                 "controller": true,
2021-07-19T00:17:05.8622640Z [cluster2]                 "kind": "ReplicaSet",
2021-07-19T00:17:05.8623525Z [cluster2]                 "name": "submariner-operator-5bfdb87494",
2021-07-19T00:17:05.8624540Z [cluster2]                 "uid": "f6a1c5b1-e630-4cb6-bb88-6a2b79dd4a41"
2021-07-19T00:17:05.8625116Z [cluster2]             }
2021-07-19T00:17:05.8625469Z [cluster2]         ],
2021-07-19T00:17:05.8625931Z [cluster2]         "resourceVersion": "1712",
2021-07-19T00:17:05.8627178Z [cluster2]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-5bfdb87494-fhr8g",
2021-07-19T00:17:05.8628484Z [cluster2]         "uid": "11e1d2d2-3c2b-4a63-abcb-8ab706cf6ae8"
2021-07-19T00:17:05.8629048Z [cluster2]     },
2021-07-19T00:17:05.8629410Z [cluster2]     "spec": {
2021-07-19T00:17:05.8629833Z [cluster2]         "containers": [
2021-07-19T00:17:05.8630225Z [cluster2]             {
2021-07-19T00:17:05.8630621Z [cluster2]                 "command": [
2021-07-19T00:17:05.8644397Z [cluster2]                     "submariner-operator",
2021-07-19T00:17:05.8645429Z [cluster2]                     "-alsologtostderr",
2021-07-19T00:17:05.8646045Z [cluster2]                     "-v=1"
2021-07-19T00:17:05.8646500Z [cluster2]                 ],
2021-07-19T00:17:05.8646890Z [cluster2]                 "env": [
2021-07-19T00:17:05.8647267Z [cluster2]                     {
2021-07-19T00:17:05.8647754Z [cluster2]                         "name": "WATCH_NAMESPACE",
2021-07-19T00:17:05.8648250Z [cluster2]                         "valueFrom": {
2021-07-19T00:17:05.8648721Z [cluster2]                             "fieldRef": {
2021-07-19T00:17:05.8649197Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T00:17:05.8649809Z [cluster2]                                 "fieldPath": "metadata.namespace"
2021-07-19T00:17:05.8650349Z [cluster2]                             }
2021-07-19T00:17:05.8650808Z [cluster2]                         }
2021-07-19T00:17:05.8651185Z [cluster2]                     },
2021-07-19T00:17:05.8651549Z [cluster2]                     {
2021-07-19T00:17:05.8651976Z [cluster2]                         "name": "POD_NAME",
2021-07-19T00:17:05.8652438Z [cluster2]                         "valueFrom": {
2021-07-19T00:17:05.8652908Z [cluster2]                             "fieldRef": {
2021-07-19T00:17:05.8653535Z [cluster2]                                 "apiVersion": "v1",
2021-07-19T00:17:05.8654109Z [cluster2]                                 "fieldPath": "metadata.name"
2021-07-19T00:17:05.8654599Z [cluster2]                             }
2021-07-19T00:17:05.8654986Z [cluster2]                         }
2021-07-19T00:17:05.8655357Z [cluster2]                     },
2021-07-19T00:17:05.8655736Z [cluster2]                     {
2021-07-19T00:17:05.8656192Z [cluster2]                         "name": "OPERATOR_NAME",
2021-07-19T00:17:05.8656971Z [cluster2]                         "value": "submariner-operator"
2021-07-19T00:17:05.8657510Z [cluster2]                     }
2021-07-19T00:17:05.8657872Z [cluster2]                 ],
2021-07-19T00:17:05.8658625Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T00:17:05.8659359Z [cluster2]                 "imagePullPolicy": "IfNotPresent",
2021-07-19T00:17:05.8660177Z [cluster2]                 "name": "submariner-operator",
2021-07-19T00:17:05.8660728Z [cluster2]                 "resources": {},
2021-07-19T00:17:05.8661608Z [cluster2]                 "terminationMessagePath": "/dev/termination-log",
2021-07-19T00:17:05.8662462Z [cluster2]                 "terminationMessagePolicy": "File",
2021-07-19T00:17:05.8663094Z [cluster2]                 "volumeMounts": [
2021-07-19T00:17:05.8663529Z [cluster2]                     {
2021-07-19T00:17:05.8664138Z [cluster2]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T00:17:05.8665222Z [cluster2]                         "name": "submariner-operator-token-lgr8c",
2021-07-19T00:17:05.8666024Z [cluster2]                         "readOnly": true
2021-07-19T00:17:05.8666452Z [cluster2]                     }
2021-07-19T00:17:05.8666807Z [cluster2]                 ]
2021-07-19T00:17:05.8667174Z [cluster2]             }
2021-07-19T00:17:05.8667522Z [cluster2]         ],
2021-07-19T00:17:05.8667989Z [cluster2]         "dnsPolicy": "ClusterFirst",
2021-07-19T00:17:05.8668602Z [cluster2]         "enableServiceLinks": true,
2021-07-19T00:17:05.8669366Z [cluster2]         "nodeName": "cluster2-worker",
2021-07-19T00:17:05.8670116Z [cluster2]         "preemptionPolicy": "PreemptLowerPriority",
2021-07-19T00:17:05.8670756Z [cluster2]         "priority": 0,
2021-07-19T00:17:05.8671251Z [cluster2]         "restartPolicy": "Always",
2021-07-19T00:17:05.8672019Z [cluster2]         "schedulerName": "default-scheduler",
2021-07-19T00:17:05.8672652Z [cluster2]         "securityContext": {},
2021-07-19T00:17:05.8674902Z [cluster2]         "serviceAccount": "submariner-operator",
2021-07-19T00:17:05.8676069Z [cluster2]         "serviceAccountName": "submariner-operator",
2021-07-19T00:17:05.8676954Z [cluster2]         "terminationGracePeriodSeconds": 30,
2021-07-19T00:17:05.8677629Z [cluster2]         "tolerations": [
2021-07-19T00:17:05.8678429Z [cluster2]             {
2021-07-19T00:17:05.8679016Z [cluster2]                 "effect": "NoExecute",
2021-07-19T00:17:05.8679981Z [cluster2]                 "key": "node.kubernetes.io/not-ready",
2021-07-19T00:17:05.8680576Z [cluster2]                 "operator": "Exists",
2021-07-19T00:17:05.8681120Z [cluster2]                 "tolerationSeconds": 300
2021-07-19T00:17:05.8681587Z [cluster2]             },
2021-07-19T00:17:05.8681951Z [cluster2]             {
2021-07-19T00:17:05.8682382Z [cluster2]                 "effect": "NoExecute",
2021-07-19T00:17:05.8683011Z [cluster2]                 "key": "node.kubernetes.io/unreachable",
2021-07-19T00:17:05.8683624Z [cluster2]                 "operator": "Exists",
2021-07-19T00:17:05.8684161Z [cluster2]                 "tolerationSeconds": 300
2021-07-19T00:17:05.8684637Z [cluster2]             }
2021-07-19T00:17:05.8684983Z [cluster2]         ],
2021-07-19T00:17:05.8685374Z [cluster2]         "volumes": [
2021-07-19T00:17:05.8685749Z [cluster2]             {
2021-07-19T00:17:05.8686720Z [cluster2]                 "name": "submariner-operator-token-lgr8c",
2021-07-19T00:17:05.8687408Z [cluster2]                 "secret": {
2021-07-19T00:17:05.8688000Z [cluster2]                     "defaultMode": 420,
2021-07-19T00:17:05.8688949Z [cluster2]                     "secretName": "submariner-operator-token-lgr8c"
2021-07-19T00:17:05.8689655Z [cluster2]                 }
2021-07-19T00:17:05.8696932Z [cluster2]             }
2021-07-19T00:17:05.8697301Z [cluster2]         ]
2021-07-19T00:17:05.8697799Z [cluster2]     },
2021-07-19T00:17:05.8698285Z [cluster2]     "status": {
2021-07-19T00:17:05.8698728Z [cluster2]         "conditions": [
2021-07-19T00:17:05.8699273Z [cluster2]             {
2021-07-19T00:17:05.8699737Z [cluster2]                 "lastProbeTime": null,
2021-07-19T00:17:05.8700664Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:49Z",
2021-07-19T00:17:05.8701228Z [cluster2]                 "status": "True",
2021-07-19T00:17:05.8701705Z [cluster2]                 "type": "Initialized"
2021-07-19T00:17:05.8702145Z [cluster2]             },
2021-07-19T00:17:05.8702501Z [cluster2]             {
2021-07-19T00:17:05.8702972Z [cluster2]                 "lastProbeTime": null,
2021-07-19T00:17:05.8703744Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:16:03Z",
2021-07-19T00:17:05.8704289Z [cluster2]                 "status": "True",
2021-07-19T00:17:05.8704736Z [cluster2]                 "type": "Ready"
2021-07-19T00:17:05.8711843Z [cluster2]             },
2021-07-19T00:17:05.8712384Z [cluster2]             {
2021-07-19T00:17:05.8712960Z [cluster2]                 "lastProbeTime": null,
2021-07-19T00:17:05.8715747Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:16:03Z",
2021-07-19T00:17:05.8716896Z [cluster2]                 "status": "True",
2021-07-19T00:17:05.8717686Z [cluster2]                 "type": "ContainersReady"
2021-07-19T00:17:05.8718400Z [cluster2]             },
2021-07-19T00:17:05.8719018Z [cluster2]             {
2021-07-19T00:17:05.8753425Z [cluste=submariner-operator submariner-operator
2021-07-19T00:17:05.8754859Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8755857Z [cluster1] NAME                  CREATED AT
2021-07-19T00:17:05.8756556Z [cluster1] submariner-operator   2021-07-19T00:15:31Z
2021-07-19T00:17:05.8757798Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8759403Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8761114Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8762150Z [cluster1] NAME                  ROLE                       AGE
2021-07-19T00:17:05.8762964Z [cluster1] submariner-operator   Role/submariner-operator   93s
2021-07-19T00:17:05.8764307Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8765901Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8768159Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-19T00:17:05.8769425Z [cluster1] NAME                  READY   UP-TO-DATE   AVAILABLE   AGE
2021-07-19T00:17:05.8770219Z [cluster1] submariner-operator   1/1     1            1           88s
2021-07-19T00:17:05.8771069Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-19T00:17:05.8771948Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-19T00:17:05.8773340Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T00:17:05.8775379Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8777289Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8779316Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:05.8781362Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o json
2021-07-19T00:17:05.8783336Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o json
2021-07-19T00:17:05.8785444Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o json
2021-07-19T00:17:05.8786588Z [cluster1] {
2021-07-19T00:17:05.8787002Z [cluster1]     "apiVersion": "v1",
2021-07-19T00:17:05.8787449Z [cluster1]     "kind": "Pod",
2021-07-19T00:17:05.8787856Z [cluster1]     "metadata": {
2021-07-19T00:17:05.8788550Z [cluster1]         "creationTimestamp": "2021-07-19T00:15:37Z",
2021-07-19T00:17:05.8789530Z [cluster1]         "generateName": "submariner-operator-5bfdb87494-",
2021-07-19T00:17:05.8790257Z [cluster1]         "labels": {
2021-07-19T00:17:05.8790913Z [cluster1]             "name": "submariner-operator",
2021-07-19T00:17:05.8791799Z [cluster1]             "pod-template-hash": "5bfdb87494"
2021-07-19T00:17:05.8792284Z [cluster1]         },
2021-07-19T00:17:05.8792716Z [cluster1]         "managedFields": [
2021-07-19T00:17:05.8793136Z [cluster1]             {
2021-07-19T00:17:05.8793566Z [cluster1]                 "apiVersion": "v1",
2021-07-19T00:17:05.8794085Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:05.8794574Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:05.8795032Z [cluster1]                     "f:metadata": {
2021-07-19T00:17:05.8795516Z [cluster1]                         "f:generateName": {},
2021-07-19T00:17:05.8796000Z [cluster1]                         "f:labels": {
2021-07-19T00:17:05.8796408Z [cluster1]                             ".": {},
2021-07-19T00:17:05.8796819Z [cluster1]                             "f:name": {},
2021-07-19T00:17:05.8797480Z [cluster1]                             "f:pod-template-hash": {}
2021-07-19T00:17:05.8797979Z [cluster1]                         },
2021-07-19T00:17:05.8798453Z [cluster1]                         "f:ownerReferences": {
2021-07-19T00:17:05.8798942Z [cluster1]                             ".": {},
2021-07-19T00:17:05.8799753Z [cluster1]                             "k:{\"uid\":\"8e71ddb9-e79e-422f-9ef6-097067cc6399\"}": {
2021-07-19T00:17:05.8800364Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8800831Z [cluster1]                                 "f:apiVersion": {},
2021-07-19T00:17:05.8801399Z [cluster1]                                 "f:blockOwnerDeletion": {},
2021-07-19T00:17:05.8801975Z [cluster1]                                 "f:controller": {},
2021-07-19T00:17:05.8802430Z [cluster1]                                 "f:kind": {},
2021-07-19T00:17:05.8802867Z [cluster1]                                 "f:name": {},
2021-07-19T00:17:05.8803308Z [cluster1]                                 "f:uid": {}
2021-07-19T00:17:05.8803698Z [cluster1]                             }
2021-07-19T00:17:05.8804086Z [cluster1]                         }
2021-07-19T00:17:05.8804457Z [cluster1]                     },
2021-07-19T00:17:05.8804857Z [cluster1]                     "f:spec": {
2021-07-19T00:17:05.8805300Z [cluster1]                         "f:containers": {
2021-07-19T00:17:05.8806070Z [cluster1]                             "k:{\"name\":\"submariner-operator\"}": {
2021-07-19T00:17:05.8808358Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8808906Z [cluster1]                                 "f:command": {},
2021-07-19T00:17:05.8809353Z [cluster1]                                 "f:env": {
2021-07-19T00:17:05.8809778Z [cluster1]                                     ".": {},
2021-07-19T00:17:05.8810272Z [cluster1]                                     "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-19T00:17:05.8810756Z [cluster1]                                         ".": {},
2021-07-19T00:17:05.8811195Z [cluster1]                                         "f:name": {},
2021-07-19T00:17:05.8811634Z [cluster1]                                         "f:value": {}
2021-07-19T00:17:05.8812057Z [cluster1]                                     },
2021-07-19T00:17:05.8812506Z [cluster1]                                     "k:{\"name\":\"POD_NAME\"}": {
2021-07-19T00:17:05.8812970Z [cluster1]                                         ".": {},
2021-07-19T00:17:05.8813386Z [cluster1]                                         "f:name": {},
2021-07-19T00:17:05.8813865Z [cluster1]                                         "f:valueFrom": {
2021-07-19T00:17:05.8814329Z [cluster1]                                             ".": {},
2021-07-19T00:17:05.8814775Z [cluster1]                                             "f:fieldRef": {
2021-07-19T00:17:05.8815242Z [cluster1]                                                 ".": {},
2021-07-19T00:17:05.8815711Z [cluster1]                                                 "f:apiVersion": {},
2021-07-19T00:17:05.8816234Z [cluster1]                                                 "f:fieldPath": {}
2021-07-19T00:17:05.8816755Z [cluster1]                                             }
2021-07-19T00:17:05.8817163Z [cluster1]                                         }
2021-07-19T00:17:05.8823438Z [cluster1]                                     },
2021-07-19T00:17:05.8824113Z [cluster1]                                     "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-19T00:17:05.8824625Z [cluster1]                                         ".": {},
2021-07-19T00:17:05.8825065Z [cluster1]                                         "f:name": {},
2021-07-19T00:17:05.8825547Z [cluster1]                                         "f:valueFrom": {
2021-07-19T00:17:05.8825997Z [cluster1]                                             ".": {},
2021-07-19T00:17:05.8826455Z [cluster1]                                             "f:fieldRef": {
2021-07-19T00:17:05.8826907Z [cluster1]                                                 ".": {},
2021-07-19T00:17:05.8827384Z [cluster1]                                                 "f:apiVersion": {},
2021-07-19T00:17:05.8827906Z [cluster1]                                                 "f:fieldPath": {}
2021-07-19T00:17:05.8828359Z [cluster1]                                             }
2021-07-19T00:17:05.8828767Z [cluster1]                                         }
2021-07-19T00:17:05.8829154Z [cluster1]                                     }
2021-07-19T00:17:05.8829549Z [cluster1]                                 },
2021-07-19T00:17:05.8829962Z [cluster1]                                 "f:image": {},
2021-07-19T00:17:05.8830485Z [cluster1]                                 "f:imagePullPolicy": {},
2021-07-19T00:17:05.8831001Z [cluster1]                                 "f:name": {},
2021-07-19T00:17:05.8831453Z [cluster1]                                 "f:resources": {},
2021-07-19T00:17:05.8832067Z [cluster1]                                 "f:terminationMessagePath": {},
2021-07-19T00:17:05.8832822Z [cluster1]                                 "f:terminationMessagePolicy": {}
2021-07-19T00:17:05.8833412Z [cluster1]                             }
2021-07-19T00:17:05.8833779Z [cluster1]                         },
2021-07-19T00:17:05.8834213Z [cluster1]                         "f:dnsPolicy": {},
2021-07-19T00:17:05.8834763Z [cluster1]                         "f:enableServiceLinks": {},
2021-07-19T00:17:05.8835353Z [cluster1]                         "f:restartPolicy": {},
2021-07-19T00:17:05.8836013Z [cluster1]                         "f:schedulerName": {},
2021-07-19T00:17:05.8836564Z [cluster1]                         "f:securityContext": {},
2021-07-19T00:17:05.8837132Z [cluster1]                         "f:serviceAccount": {},
2021-07-19T00:17:05.8837718Z [cluster1]                         "f:serviceAccountName": {},
2021-07-19T00:17:05.8838492Z [cluster1]                         "f:terminationGracePeriodSeconds": {}
2021-07-19T00:17:05.8839133Z [cluster1]                     }
2021-07-19T00:17:05.8839504Z [cluster1]                 },
2021-07-19T00:17:05.8840370Z [cluster1]                 "manager": "kube-controller-manager",
2021-07-19T00:17:05.8841017Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:05.8841662Z [cluster1]                 "time": "2021-07-19T00:15:37Z"
2021-07-19T00:17:05.8842055Z [cluster1]             },
2021-07-19T00:17:05.8842419Z [cluster1]             {
2021-07-19T00:17:05.8842836Z [cluster1]                 "apiVersion": "v1",
2021-07-19T00:17:05.8843359Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:05.8844529Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:05.8844979Z [cluster1]                     "f:status": {
2021-07-19T00:17:05.8845494Z [cluster1]                         "f:conditions": {
2021-07-19T00:17:05.8846056Z [cluster1]                             "k:{\"type\":\"ContainersReady\"}": {
2021-07-19T00:17:05.8846955Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8847446Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8848158Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8848691Z [cluster1]                                 "f:status": {},
2021-07-19T00:17:05.8849138Z [cluster1]                                 "f:type": {}
2021-07-19T00:17:05.8849538Z [cluster1]                             },
2021-07-19T00:17:05.8850017Z [cluster1]                             "k:{\"type\":\"Initialized\"}": {
2021-07-19T00:17:05.8850492Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8850971Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8851557Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8852097Z [cluster1]                                 "f:status": {},
2021-07-19T00:17:05.8852541Z [cluster1]                                 "f:type": {}
2021-07-19T00:17:05.8852940Z [cluster1]                             },
2021-07-19T00:17:05.8853375Z [cluster1]                             "k:{\"type\":\"Ready\"}": {
2021-07-19T00:17:05.8853813Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8854294Z [cluster1]                                 "f:lastProbeTime": {},
2021-07-19T00:17:05.8854874Z [cluster1]                                 "f:lastTransitionTime": {},
2021-07-19T00:17:05.8855413Z [cluster1]                                 "f:status": {},
2021-07-19T00:17:05.8855846Z [cluster1]                                 "f:type": {}
2021-07-19T00:17:05.8856261Z [cluster1]                             }
2021-07-19T00:17:05.8856645Z [cluster1]                         },
2021-07-19T00:17:05.8857134Z [cluster1]                         "f:containerStatuses": {},
2021-07-19T00:17:05.8857665Z [cluster1]                         "f:hostIP": {},
2021-07-19T00:17:05.8858102Z [cluster1]                         "f:phase": {},
2021-07-19T00:17:05.8858540Z [cluster1]                         "f:podIP": {},
2021-07-19T00:17:05.8858977Z [cluster1]                         "f:podIPs": {
2021-07-19T00:17:05.8859406Z [cluster1]                             ".": {},
2021-07-19T00:17:05.8859820Z [cluster1]                             "k:{\"ip\":\"10.0.0.3\"}": {
2021-07-19T00:17:05.8860241Z [cluster1]                                 ".": {},
2021-07-19T00:17:05.8860653Z [cluster1]                                 "f:ip": {}
2021-07-19T00:17:05.8861046Z [cluster1]                             }
2021-07-19T00:17:05.8861430Z [cluster1]                         },
2021-07-19T00:17:05.8861912Z [cluster1]                         "f:startTime": {}
2021-07-19T00:17:05.8871800Z [cluster1]                     }
2021-07-19T00:17:05.8872246Z [cluster1]                 },
2021-07-19T00:17:05.8872691Z [cluster1]                 "manager": "kubelet",
2021-07-19T00:17:05.8873192Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:05.8874038Z [cluster1]                 "time": "2021-07-19T00:15:45Z"
2021-07-19T00:17:05.8874435Z [cluster1]             }
2021-07-19T00:17:05.8874808Z [cluster1]         ],
2021-07-19T00:17:05.8875700Z [cluster1]         "name": "submariner-operator-5bfdb87494-p9sj2",
2021-07-19T00:17:05.8877183Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T00:17:05.8877816Z [cluster1]         "ownerReferences": [
2021-07-19T00:17:05.8878266Z [cluster1]             {
2021-07-19T00:17:05.8878712Z [cluster1]                 "apiVersion": "apps/v1",
2021-07-19T00:17:05.8879290Z [cluster1]                 "blockOwnerDeletion": true,
2021-07-19T00:17:05.8879881Z [cluster1]                 "controller": true,
2021-07-19T00:17:05.8880375Z [cluster1]                 "kind": "ReplicaSet",
2021-07-19T00:17:05.8881255Z [cluster1]                 "name": "submariner-operator-5bfdb87494",
2021-07-19T00:17:05.8882264Z [cluster1]                 "uid": "8e71ddb9-e79e-422f-9ef6-097067cc6399"
2021-07-19T00:17:05.8882836Z [cluster1]             }
2021-07-19T00:17:05.8883200Z [cluster1]         ],
2021-07-19T00:17:05.8883648Z [cluster1]         "resourceVersion": "1686",
2021-07-19T00:17:05.8885048Z [cluster1]         "selfLink": "/api/v1/namespaces/submariner-operator/pods/submariner-operator-5bfdb87494-p9sj2",
2021-07-19T00:17:05.8891299Z [cluster1]         "uid": "1b7b1194-6f0d-4b23-b08e-0c1a17ae5722"
2021-07-19T00:17:05.8891908Z [cluster1]     },
2021-07-19T00:17:05.8892276Z [cluster1]     "spec": {
2021-07-19T00:17:05.8892703Z [cluster1]         "containers": [
2021-07-19T00:17:05.8893102Z [cluster1]             {
2021-07-19T00:17:05.8893499Z [cluster1]                 "command": [
2021-07-19T00:17:05.8894283Z [cluster1]                     "submariner-operator",
2021-07-19T00:17:05.8895026Z [cluster1]                     "-alsologtostderr",
2021-07-19T00:17:05.8895619Z [cluster1]                     "-v=1"
2021-07-19T00:17:05.8895989Z [cluster1]                 ],
2021-07-19T00:17:05.8896378Z [cluster1]                 "env": [
2021-07-19T00:17:05.8896755Z [cluster1]                     {
2021-07-19T00:17:05.8897227Z [cluster1]                         "name": "WATCH_NAMESPACE",
2021-07-19T00:17:05.8897727Z [cluster1]                         "valueFrom": {
2021-07-19T00:17:05.8932738Z [cluster1]                             "fieldRef": {
2021-07-19T00:17:05.8933292Z [cluster1]                                 "apiVersion": "v1",
2021-07-19T00:17:05.8933897Z [cluster1]                                 "fieldPath": "metadata.namespace"
2021-07-19T00:17:05.8934455Z [cluster1]                             }
2021-07-19T00:17:05.8934832Z [cluster1]                         }
2021-07-19T00:17:05.8935228Z [cluster1]                     },
2021-07-19T00:17:05.8935729Z [cluster1]                     {
2021-07-19T00:17:05.8936148Z [cluster1]                         "name": "POD_NAME",
2021-07-19T00:17:05.8936628Z [cluster1]                         "valueFrom": {
2021-07-19T00:17:05.8937085Z [cluster1]                             "fieldRef": {
2021-07-19T00:17:05.8937579Z [cluster1]                                 "apiVersion": "v1",
2021-07-19T00:17:05.8938130Z [cluster1]                                 "fieldPath": "metadata.name"
2021-07-19T00:17:05.8938638Z [cluster1]                             }
2021-07-19T00:17:05.8939011Z [cluster1]                         }
2021-07-19T00:17:05.8939392Z [cluster1]                     },
2021-07-19T00:17:05.8939753Z [cluster1]                     {
2021-07-19T00:17:05.8940209Z [cluster1]                         "name": "OPERATOR_NAME",
2021-07-19T00:17:05.8941109Z [cluster1]                         "value": "submariner-operator"
2021-07-19T00:17:05.8941781Z [cluster1]                     }
2021-07-19T00:17:05.8942159Z [cluster1]                 ],
2021-07-19T00:17:05.8942917Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T00:17:05.8943665Z [cluster1]                 "imagePullPolicy": "IfNotPresent",
2021-07-19T00:17:05.8944474Z [cluster1]                 "name": "submariner-operator",
2021-07-19T00:17:05.8945034Z [cluster1]                 "resources": {},
2021-07-19T00:17:05.8945869Z [cluster1]                 "terminationMessagePath": "/dev/termination-log",
2021-07-19T00:17:05.8946748Z [cluster1]                 "terminationMessagePolicy": "File",
2021-07-19T00:17:05.8947394Z [cluster1]                 "volumeMounts": [
2021-07-19T00:17:05.8947818Z [cluster1]                     {
2021-07-19T00:17:05.8948442Z [cluster1]                         "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T00:17:05.8949514Z [cluster1]                         "name": "submariner-operator-token-qqdkd",
2021-07-19T00:17:05.8950257Z [cluster1]                         "readOnly": true
2021-07-19T00:17:05.8950676Z [cluster1]                     }
2021-07-19T00:17:05.8951050Z [cluster1]                 ]
2021-07-19T00:17:05.8951403Z [cluster1]             }
2021-07-19T00:17:05.8951765Z [cluster1]         ],
2021-07-19T00:17:05.8952225Z [cluster1]         "dnsPolicy": "ClusterFirst",
2021-07-19T00:17:05.8952843Z [cluster1]         "enableServiceLinks": true,
2021-07-19T00:17:05.8953618Z [cluster1]         "nodeName": "cluster1-worker2",
2021-07-19T00:17:05.8954444Z [cluster1]         "preemptionPolicy": "PreemptLowerPriority",
2021-07-19T00:17:05.8955100Z [cluster1]         "priority": 0,
2021-07-19T00:17:05.8955585Z [cluster1]         "restartPolicy": "Always",
2021-07-19T00:17:05.8956377Z [cluster1]         "schedulerName": "default-scheduler",
2021-07-19T00:17:05.8956996Z [cluster1]         "securityContext": {},
2021-07-19T00:17:05.8957800Z [cluster1]         "serviceAccount": "submariner-operator",
2021-07-19T00:17:05.8958758Z [cluster1]         "serviceAccountName": "submariner-operator",
2021-07-19T00:17:05.8959642Z [cluster1]         "terminationGracePeriodSeconds": 30,
2021-07-19T00:17:05.8960327Z [cluster1]         "tolerations": [
2021-07-19T00:17:05.8960732Z [cluster1]             {
2021-07-19T00:17:05.8961176Z [cluster1]                 "effect": "NoExecute",
2021-07-19T00:17:05.8961925Z [cluster1]                 "key": "node.kubernetes.io/not-ready",
2021-07-19T00:17:05.8962526Z [cluster1]                 "operator": "Exists",
2021-07-19T00:17:05.8963067Z [cluster1]                 "tolerationSeconds": 300
2021-07-19T00:17:05.8963547Z [cluster1]             },
2021-07-19T00:17:05.8963896Z [cluster1]             {
2021-07-19T00:17:05.8964340Z [cluster1]                 "effect": "NoExecute",
2021-07-19T00:17:05.8964954Z [cluster1]                 "key": "node.kubernetes.io/unreachable",
2021-07-19T00:17:05.8965573Z [cluster1]                 "operator": "Exists",
2021-07-19T00:17:05.8966122Z [cluster1]                 "tolerationSeconds": 300
2021-07-19T00:17:05.8966705Z [cluster1]             }
2021-07-19T00:17:05.8967065Z [cluster1]         ],
2021-07-19T00:17:05.8967445Z [cluster1]         "volumes": [
2021-07-19T00:17:05.8967838Z [cluster1]             {
2021-07-19T00:17:05.8968658Z [cluster1]                 "name": "submariner-operator-token-qqdkd",
2021-07-19T00:17:05.8969359Z [cluster1]                 "secret": {
2021-07-19T00:17:05.8969810Z [cluster1]                     "defaultMode": 420,
2021-07-19T00:17:05.8970752Z [cluster1]                     "secretName": "submariner-operator-token-qqdkd"
2021-07-19T00:17:05.8971446Z [cluster1]                 }
2021-07-19T00:17:05.8971815Z [cluster1]             }
2021-07-19T00:17:05.8972181Z [cluster1]         ]
2021-07-19T00:17:05.8972523Z [cluster1]     },
2021-07-19T00:17:05.8972905Z [cluster1]     "status": {
2021-07-19T00:17:05.8973324Z [cluster1]         "conditions": [
2021-07-19T00:17:05.8973763Z [cluster1]             {
2021-07-19T00:17:05.8974295Z [cluster1]                 "lastProbeTime": null,
2021-07-19T00:17:05.8975092Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:37Z",
2021-07-19T00:17:05.8975639Z [cluster1]                 "status": "True",
2021-07-19T00:17:05.8976130Z [cluster1]                 "type": "Initialized"
2021-07-19T00:17:05.8998486Z [cluster1]             },
2021-07-19T00:17:05.8998874Z [cluster1]             {
2021-07-19T00:17:05.8999329Z [cluster1]                 "lastProbeTime": null,
2021-07-19T00:17:05.9000246Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:45Z",
2021-07-19T00:17:05.9000807Z [cluster1]                 "status": "True",
2021-07-19T00:17:05.9001251Z [cluster1]                 "type": "Ready"
2021-07-19T00:17:05.9001662Z [cluster1]             },
2021-07-19T00:17:05.9002015Z [cluster1]             {
2021-07-19T00:17:05.9002476Z [cluster1]                 "lastProbeTime": null,
2021-07-19T00:17:05.9003236Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:45Z",
2021-07-19T00:17:05.9003805Z [cluster1]                 "status": "True",
2021-07-19T00:17:05.9004318Z [cluster1]                 "type": "ContainersReady"
2021-07-19T00:17:05.9004793Z [cluster1]             },
2021-07-19T00:17:05.9005145Z [cluster1]             {
2021-07-19T00:17:05.9005600Z [cluster1]                 "lastProbeTime": null,
2021-07-19T00:17:05.9006517Z [cluster1]                 "lastTransitionTime": "2021-07-19T00:15:37Z",
2021-07-19T00:17:05.9007063Z [cluster1]                 "status": "True",
2021-07-19T00:17:05.9007703Z [cluster1]                 "type": "PodScheduled"
2021-07-19T00:17:05.9008140Z [cluster1]             }
2021-07-19T00:17:05.9008498Z [cluster1]         ],
2021-07-19T00:17:05.9009036Z [cluster1]         "containerStatuses": [
2021-07-19T00:17:05.9009507Z [cluster1]             {
2021-07-19T00:17:05.9010993Z [cluster1]                 "containerID": "containerd://562e4940ddc339bd761c07e928489a678a1d7c4ecc960d14eb2098d844e0a198",
2021-07-19T00:17:05.9012893Z [cluster1]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T00:17:06.6524443Z [cluster1]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T00:17:06.6525497Z [cluster1]                 "lastState": {},
2021-07-19T00:17:06.6526243Z [cluster1]                 "name": "submariner-operator",
2021-07-19T00:17:06.6526946Z [cluster1]                 "ready": true,
2021-07-19T00:17:06.6527448Z [cluster1]                 "restartCount": 1,
2021-07-19T00:17:06.6527935Z [cluster1]                 "started": true,
2021-07-19T00:17:06.6528358Z [cluster1]                 "state": {
2021-07-19T00:17:06.6528787Z [cluster1]                     "running": {
2021-07-19T00:17:06.6529432Z [cluster1]                         "startedAt": "2021-07-19T00:15:44Z"
2021-07-19T00:17:06.6529885Z [cluster1]                     }
2021-07-19T00:17:06.6530247Z [cluster1]                 }
2021-07-19T00:17:06.6530621Z [cluster1]             }
2021-07-19T00:17:06.6530969Z [cluster1]         ],
2021-07-19T00:17:06.6531372Z [cluster1]         "hostIP": "172.18.0.8",
2021-07-19T00:17:06.6531814Z [cluster1]         "phase": "Running",
2021-07-19T00:17:06.6532262Z [cluster1]         "podIP": "10.0.0.3",
2021-07-19T00:17:06.6532689Z [cluster1]         "podIPs": [
2021-07-19T00:17:06.6533074Z [cluster1]             {
2021-07-19T00:17:06.6533466Z [cluster1]                 "ip": "10.0.0.3"
2021-07-19T00:17:06.6533835Z [cluster1]             }
2021-07-19T00:17:06.6534206Z [cluster1]         ],
2021-07-19T00:17:06.6534644Z [cluster1]         "qosClass": "BestEffort",
2021-07-19T00:17:06.6535317Z [cluster1]         "startTime": "2021-07-19T00:15:37Z"
2021-07-19T00:17:06.6535734Z [cluster1]     }
2021-07-19T00:17:06.6536091Z [cluster1] }
2021-07-19T00:17:06.6537471Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.6539860Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.6542179Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.6543731Z [submariner-operator]$ [cluster1] grep Running
2021-07-19T00:17:06.6544289Z [cluster1] Running
2021-07-19T00:17:06.6545547Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator
2021-07-19T00:17:06.6547473Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator
2021-07-19T00:17:06.6549508Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-p9sj2 --namespace=submariner-operator
2021-07-19T00:17:06.6550766Z [cluster1] I0719 00:15:45.141179       1 main.go:77] cmd "msg"="Go Version: go1.16.5"  
2021-07-19T00:17:06.6551434Z [cluster1] I0719 00:15:45.141245       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"  
2021-07-19T00:17:06.6552294Z [cluster1] I0719 00:15:45.141251       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"  
2021-07-19T00:17:06.6553278Z [cluster1] I0719 00:15:45.141259       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"  
2021-07-19T00:17:06.6554186Z [cluster1] I0719 00:15:45.141390       1 leader.go:89] leader "msg"="Trying to become the leader."  
2021-07-19T00:17:06.6555012Z [cluster1] I0719 00:15:45.646682       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."  
2021-07-19T00:17:06.6555843Z [cluster1] I0719 00:15:45.646707       1 leader.go:123] leader "msg"="Continuing as the leader."  
2021-07-19T00:17:06.6557001Z [cluster1] I0719 00:15:46.150782       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-19T00:17:06.6557909Z [cluster1] I0719 00:15:46.151186       1 main.go:129] cmd "msg"="Registering Components."  
2021-07-19T00:17:06.6558628Z [cluster1] I0719 00:15:46.151312       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"  
2021-07-19T00:17:06.6559726Z [cluster1] I0719 00:15:49.299762       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6561369Z [cluster1] I0719 00:15:49.299791       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6562435Z [cluster1] I0719 00:15:49.299833       1 main.go:203] cmd "msg"="Starting the Cmd."  
2021-07-19T00:17:06.6657462Z [cluster1] I0719 00:15:49.300661       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T00:17:06.6665873Z [cluster1] I0719 00:15:49.300952       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T00:17:06.6671857Z [cluster1] I0719 00:15:49.301129       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T00:17:06.6676019Z [cluster1] I0719 00:15:49.301294       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T00:17:06.6679280Z [cluster1] I0719 00:15:49.301453       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T00:17:06.6681165Z [cluster1] I0719 00:15:49.306105       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-19T00:17:06.6682755Z [cluster1] I0719 00:15:49.401814       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker" 
2021-07-19T00:17:06.6684619Z [cluster1] I0719 00:15:49.402000       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T00:17:06.6687364Z [cluster1] I0719 00:15:49.404075       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T00:17:06.6690547Z [cluster1] I0719 00:15:49.411195       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T00:17:06.6693120Z [cluster1] I0719 00:15:49.411632       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-19T00:17:06.6696344Z [cluster1] I0719 00:15:49.412554       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T00:17:06.6699268Z [cluster1] I0719 00:15:49.511144       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-19T00:17:06.6701301Z [cluster1] I0719 00:15:49.511313       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T00:17:06.6703258Z [cluster1] I0719 00:15:49.511434       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6755956Z [cluster1] I0719 00:15:49.512115       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T00:17:06.6758235Z [cluster1] I0719 00:15:49.512193       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"  
2021-07-19T00:17:06.6760048Z [cluster1] I0719 00:15:49.512212       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T00:17:06.6762787Z [cluster1] I0719 00:15:49.513399       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T00:17:06.6764845Z [cluster1] I0719 00:15:49.598478       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"  
2021-07-19T00:17:06.6766750Z [cluster1] I0719 00:15:49.598505       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T00:17:06.6768046Z [cluster1] I0719 00:15:49.598518       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.6769253Z [cluster1] I0719 00:15:49.598526       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.6771420Z [cluster1] I0719 00:15:49.610837       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6773549Z [cluster1] I0719 00:15:49.613641       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"  
2021-07-19T00:17:06.6775189Z [cluster1] I0719 00:15:49.613770       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T00:17:06.6776998Z [cluster1] I0719 00:15:49.613879       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6778461Z [cluster1] I0719 00:15:49.613982       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.6779665Z [cluster1] I0719 00:15:49.614043       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.6781811Z [cluster1] I0719 00:15:49.622462       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6784614Z [cluster1] I0719 00:15:49.673718       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6787982Z [cluster1] E0719 00:15:49.673779       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" 
2021-07-19T00:17:06.6790842Z [cluster1] I0719 00:15:49.678962       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6792308Z [cluster1] I0719 00:15:49.679030       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.6837884Z [cluster1] I0719 00:15:49.679149       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.6840402Z [cluster1] I0719 00:15:49.824892       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6843254Z [cluster1] I0719 00:15:49.876357       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6846483Z [cluster1] I0719 00:15:49.880487       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6849326Z [cluster1] I0719 00:15:50.326539       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6852126Z [cluster1] I0719 00:15:50.340378       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6854928Z [cluster1] I0719 00:15:50.358161       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6857682Z [cluster1] I0719 00:15:50.388226       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6860441Z [cluster1] I0719 00:15:50.774641       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6863301Z [cluster1] I0719 00:15:50.837383       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6866144Z [cluster1] I0719 00:15:50.971464       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6869100Z [cluster1] I0719 00:15:51.046924       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6871927Z [cluster1] I0719 00:15:51.338803       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6883867Z [cluster1] I0719 00:15:51.459739       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T00:17:06.6886855Z [cluster1] I0719 00:15:51.460192       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6889263Z [cluster1] I0719 00:15:51.460242       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6894355Z [cluster1] I0719 00:15:51.548982       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.6896989Z [cluster1] I0719 00:15:51.598502       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6900711Z [cluster1] I0719 00:15:51.598543       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.6901946Z [cluster1] I0719 00:15:51.598553       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.6905280Z [cluster1] I0719 00:15:51.650457       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.6908738Z [cluster1] E0719 00:15:51.676484       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6911365Z [cluster1] I0719 00:15:51.676548       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6912823Z [cluster1] I0719 00:15:51.676586       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.6914038Z [cluster1] I0719 00:15:51.676605       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.6916187Z [cluster1] I0719 00:15:51.797359       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6919902Z [cluster1] E0719 00:15:51.798015       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-19T00:17:06.6923164Z [cluster1] I0719 00:15:51.798059       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6925767Z [cluster1] I0719 00:15:51.803429       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.6928946Z [cluster1] I0719 00:15:51.900777       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.6933140Z [cluster1] E0719 00:15:51.900860       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-19T00:17:06.6936689Z [cluster1] I0719 00:15:51.906264       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.6939635Z [cluster1] I0719 00:15:51.964868       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.6942919Z [cluster1] I0719 00:15:51.965380       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7006650Z [cluster1] I0719 00:15:51.987725       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7009826Z [cluster1] I0719 00:15:52.113163       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7012990Z [cluster1] I0719 00:15:52.316200       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7016339Z [cluster1] I0719 00:15:52.447420       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7019402Z [cluster1] I0719 00:15:52.517969       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7022338Z [cluster1] I0719 00:15:52.576230       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7025167Z [cluster1] I0719 00:15:52.595272       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7028185Z [cluster1] I0719 00:15:52.609029       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7031025Z [cluster1] I0719 00:15:52.619548       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7033872Z [cluster1] I0719 00:15:52.662036       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7036698Z [cluster1] I0719 00:15:52.682263       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7039661Z [cluster1] I0719 00:15:52.701980       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7042724Z [cluster1] I0719 00:15:52.826768       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7045828Z [cluster1] I0719 00:15:52.954061       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T00:17:06.7049288Z [cluster1] E0719 00:15:52.954104       1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"  
2021-07-19T00:17:06.7053262Z [cluster1] E0719 00:15:52.954130       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-19T00:17:06.7056493Z [cluster1] I0719 00:15:52.954155       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7059372Z [cluster1] I0719 00:15:52.975934       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7062588Z [cluster1] I0719 00:15:52.976334       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7065767Z [cluster1] I0719 00:15:53.057687       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7068802Z [cluster1] I0719 00:15:53.122140       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7083592Z [cluster1] I0719 00:15:53.151159       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7086809Z [cluster1] I0719 00:15:53.213125       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7089777Z [cluster1] I0719 00:15:53.559693       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7092984Z [cluster1] I0719 00:15:53.562547       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7096165Z [cluster1] I0719 00:15:53.875957       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7100432Z [cluster1] E0719 00:15:53.876025       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: Service \"submariner-lighthouse-coredns-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-19T00:17:06.7104041Z [cluster1] I0719 00:15:53.887622       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7106931Z [cluster1] I0719 00:15:54.276535       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7110256Z [cluster1] I0719 00:15:54.277368       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7113591Z [cluster1] I0719 00:15:54.382708       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7117047Z [cluster1] I0719 00:15:54.430726       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7120379Z [cluster1] I0719 00:15:54.888252       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7123345Z [cluster1] I0719 00:15:54.934857       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7126556Z [cluster1] I0719 00:15:54.944547       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7129946Z [cluster1] I0719 00:15:54.954616       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7132984Z [cluster1] I0719 00:15:55.095648       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7136901Z [cluster1] I0719 00:15:55.095676       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"  
2021-07-19T00:17:06.7140549Z [cluster1] I0719 00:15:55.172414       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7143415Z [cluster1] I0719 00:15:55.204895       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7146744Z [cluster1] I0719 00:15:55.278045       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7149922Z [cluster1] I0719 00:15:55.480920       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7152930Z [cluster1] I0719 00:15:55.790227       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7156137Z [cluster1] I0719 00:15:56.078776       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7159102Z [cluster1] I0719 00:15:56.079268       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7162904Z [cluster1] I0719 00:15:56.079308       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"  
2021-07-19T00:17:06.7204280Z [cluster1] I0719 00:15:56.145018       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7207821Z [cluster1] I0719 00:15:56.657154       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7211054Z [cluster1] I0719 00:15:56.682820       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7214861Z [cluster1] I0719 00:15:56.682854       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"  
2021-07-19T00:17:06.7218003Z [cluster1] I0719 00:16:04.806846       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7219592Z [cluster1] I0719 00:16:04.806915       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7220808Z [cluster1] I0719 00:16:04.806925       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7222967Z [cluster1] I0719 00:16:04.863568       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7225796Z [cluster1] I0719 00:16:04.879573       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7228700Z [cluster1] I0719 00:16:05.381778       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7231739Z [cluster1] I0719 00:16:05.557955       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7234621Z [cluster1] I0719 00:16:05.734874       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7237510Z [cluster1] I0719 00:16:05.796273       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7240347Z [cluster1] I0719 00:16:06.299920       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7242658Z [cluster1] I0719 00:16:06.321653       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7244182Z [cluster1] I0719 00:16:06.321692       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7245385Z [cluster1] I0719 00:16:06.321702       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7247188Z [cluster1] I0719 00:16:06.350001       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7248621Z [cluster1] I0719 00:16:06.350042       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7249827Z [cluster1] I0719 00:16:06.350050       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7252008Z [cluster1] I0719 00:16:06.399086       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7254778Z [cluster1] I0719 00:16:06.399144       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7258266Z [cluster1] I0719 00:16:06.439970       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7261199Z [cluster1] I0719 00:16:06.716289       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7264003Z [cluster1] I0719 00:16:06.946804       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7266861Z [cluster1] I0719 00:16:07.014781       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7269694Z [cluster1] I0719 00:16:07.109453       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7272565Z [cluster1] I0719 00:16:07.142891       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7275382Z [cluster1] I0719 00:16:07.219790       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7278160Z [cluster1] I0719 00:16:07.231398       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7281098Z [cluster1] I0719 00:16:07.274748       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7283959Z [cluster1] I0719 00:16:07.283969       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7286875Z [cluster1] I0719 00:16:07.644906       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7289183Z [cluster1] I0719 00:16:07.665069       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7290649Z [cluster1] I0719 00:16:07.665109       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7291843Z [cluster1] I0719 00:16:07.665118       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7293996Z [cluster1] I0719 00:16:07.712824       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7296816Z [cluster1] I0719 00:16:07.762823       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7299964Z [cluster1] I0719 00:16:07.795262       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7302347Z [cluster1] I0719 00:16:08.030955       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7303805Z [cluster1] I0719 00:16:08.030998       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7304998Z [cluster1] I0719 00:16:08.031030       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7307154Z [cluster1] I0719 00:16:08.068375       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7309989Z [cluster1] I0719 00:16:08.175167       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7312957Z [cluster1] I0719 00:16:08.340837       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7315511Z [cluster1] I0719 00:16:08.377139       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7318977Z [cluster1] I0719 00:16:08.428437       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7322509Z [cluster1] I0719 00:16:08.616295       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7325693Z [cluster1] I0719 00:16:08.621639       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7328607Z [cluster1] I0719 00:16:08.679954       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7331397Z [cluster1] I0719 00:16:08.817847       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7334518Z [cluster1] I0719 00:16:08.860898       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7337646Z [cluster1] I0719 00:16:08.866014       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7340512Z [cluster1] I0719 00:16:08.876725       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7343454Z [cluster1] I0719 00:16:08.915646       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7346639Z [cluster1] I0719 00:16:09.375540       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7349532Z [cluster1] I0719 00:16:09.383979       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7352378Z [cluster1] I0719 00:16:09.420355       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7355503Z [cluster1] E0719 00:16:09.426008       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7358192Z [cluster1] I0719 00:16:09.426186       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7359647Z [cluster1] I0719 00:16:09.426340       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7360861Z [cluster1] I0719 00:16:09.426414       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7363298Z [cluster1] I0719 00:16:09.447787       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7366433Z [cluster1] I0719 00:16:09.501058       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7369573Z [cluster1] I0719 00:16:09.507157       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7372734Z [cluster1] I0719 00:16:09.536814       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7375674Z [cluster1] I0719 00:16:10.009041       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7378502Z [cluster1] I0719 00:16:10.041773       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7409444Z [cluster1] I0719 00:16:10.073677       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7413484Z [cluster1] I0719 00:16:10.073720       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"  
2021-07-19T00:17:06.7422257Z [cluster1] I0719 00:16:10.074073       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7425301Z [cluster1] I0719 00:16:10.083442       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7428069Z [cluster1] I0719 00:16:10.089703       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7430951Z [cluster1] I0719 00:16:10.101453       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7434033Z [cluster1] I0719 00:16:10.107975       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7437211Z [cluster1] I0719 00:16:10.134160       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7440273Z [cluster1] I0719 00:16:10.609832       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7442597Z [cluster1] I0719 00:16:10.639441       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7444057Z [cluster1] I0719 00:16:10.639495       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7445254Z [cluster1] I0719 00:16:10.639504       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7447101Z [cluster1] I0719 00:16:10.664712       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7449633Z [cluster1] I0719 00:16:10.664777       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7451356Z [cluster1] I0719 00:16:10.664796       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7454931Z [cluster1] I0719 00:16:10.668130       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7457890Z [cluster1] I0719 00:16:10.860213       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7461017Z [cluster1] I0719 00:16:10.905414       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7463958Z [cluster1] I0719 00:16:11.036397       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7467038Z [cluster1] I0719 00:16:11.041216       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7470580Z [cluster1] I0719 00:16:11.070647       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7475379Z [cluster1] I0719 00:16:11.071073       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7478195Z [cluster1] I0719 00:16:11.407385       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7481241Z [cluster1] I0719 00:16:11.413268       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7484179Z [cluster1] I0719 00:16:11.419312       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7488266Z [cluster1] I0719 00:16:11.429180       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7491124Z [cluster1] I0719 00:16:11.572607       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7494097Z [cluster1] I0719 00:16:11.573778       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7497189Z [cluster1] I0719 00:16:11.577947       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7501100Z [cluster1] I0719 00:16:11.578093       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"  
2021-07-19T00:17:06.7504735Z [cluster1] I0719 00:16:11.580982       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7507561Z [cluster1] I0719 00:16:11.585798       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7510558Z [cluster1] I0719 00:16:11.589054       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7513400Z [cluster1] I0719 00:16:11.932377       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7516189Z [cluster1] I0719 00:16:11.982503       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7517658Z [cluster1] I0719 00:16:11.982899       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7518861Z [cluster1] I0719 00:16:11.983735       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7521028Z [cluster1] I0719 00:16:12.023620       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7524707Z [cluster1] I0719 00:16:12.030705       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7527679Z [cluster1] I0719 00:16:12.090384       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7530900Z [cluster1] E0719 00:16:12.098443       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7533540Z [cluster1] I0719 00:16:12.098640       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7534994Z [cluster1] I0719 00:16:12.098776       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7536207Z [cluster1] I0719 00:16:12.098853       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7544079Z [cluster1] I0719 00:16:12.116514       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7591781Z [cluster1] I0719 00:16:12.125068       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7594635Z [cluster1] I0719 00:16:12.532384       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7597593Z [cluster1] I0719 00:16:12.539287       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7600419Z [cluster1] I0719 00:16:12.558825       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7603299Z [cluster1] I0719 00:16:12.573687       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7606135Z [cluster1] I0719 00:16:12.630137       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7609177Z [cluster1] I0719 00:16:12.671117       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7612018Z [cluster1] I0719 00:16:12.695028       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7614866Z [cluster1] I0719 00:16:12.700924       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7617707Z [cluster1] I0719 00:16:13.082594       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7620094Z [cluster1] I0719 00:16:13.134073       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7621545Z [cluster1] I0719 00:16:13.134310       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7622757Z [cluster1] I0719 00:16:13.134395       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7624924Z [cluster1] I0719 00:16:13.173986       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7627749Z [cluster1] I0719 00:16:13.180022       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7630560Z [cluster1] I0719 00:16:13.206335       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7633683Z [cluster1] E0719 00:16:13.235483       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7636382Z [cluster1] I0719 00:16:13.235660       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7637826Z [cluster1] I0719 00:16:13.235788       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7639033Z [cluster1] I0719 00:16:13.235846       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7641189Z [cluster1] I0719 00:16:13.326127       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7644028Z [cluster1] I0719 00:16:13.338539       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7646936Z [cluster1] I0719 00:16:13.685413       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7649728Z [cluster1] I0719 00:16:13.737650       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7652573Z [cluster1] I0719 00:16:13.759679       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7655513Z [cluster1] I0719 00:16:13.788004       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7658355Z [cluster1] I0719 00:16:13.839911       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7661107Z [cluster1] I0719 00:16:13.856482       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7663944Z [cluster1] I0719 00:16:13.863549       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7666805Z [cluster1] I0719 00:16:13.872553       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7675361Z [cluster1] I0719 00:16:14.029128       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7690476Z [cluster1] I0719 00:16:14.289804       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7693457Z [cluster1] I0719 00:16:14.373689       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7696485Z [cluster1] I0719 00:16:14.790329       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7699819Z [cluster1] I0719 00:16:14.856762       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7702988Z [cluster1] I0719 00:16:15.361993       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7706146Z [cluster1] I0719 00:16:15.394687       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.7709554Z [cluster1] I0719 00:16:15.419838       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7713005Z [cluster1] I0719 00:16:15.921456       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7715787Z [cluster1] I0719 00:16:15.923805       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7719698Z [cluster1] I0719 00:16:15.923936       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.234.236\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster1.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"  
2021-07-19T00:17:06.7722833Z [cluster1] I0719 00:16:16.032542       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7724279Z [cluster1] I0719 00:16:16.032856       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7725493Z [cluster1] I0719 00:16:16.032942       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7727877Z [cluster1] I0719 00:16:16.063035       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7730700Z [cluster1] I0719 00:16:16.097557       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7733487Z [cluster1] I0719 00:16:16.599080       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7736355Z [cluster1] I0719 00:16:16.603965       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7739177Z [cluster1] I0719 00:16:16.608782       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7742042Z [cluster1] I0719 00:16:16.613070       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7744865Z [cluster1] I0719 00:16:17.114275       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7752543Z [cluster1] I0719 00:16:17.134444       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7754161Z [cluster1] I0719 00:16:17.134641       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7755385Z [cluster1] I0719 00:16:17.134719       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7757101Z [cluster1] I0719 00:16:17.134585       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7758562Z [cluster1] I0719 00:16:17.135876       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7759761Z [cluster1] I0719 00:16:17.135895       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7761912Z [cluster1] I0719 00:16:17.158123       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7764688Z [cluster1] I0719 00:16:17.160006       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7767608Z [cluster1] I0719 00:16:17.170434       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7770562Z [cluster1] I0719 00:16:17.186521       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7773371Z [cluster1] I0719 00:16:17.672467       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7776157Z [cluster1] I0719 00:16:17.677900       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7778954Z [cluster1] I0719 00:16:17.692924       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7781698Z [cluster1] I0719 00:16:17.701300       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7784563Z [cluster1] I0719 00:16:17.712382       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7787455Z [cluster1] I0719 00:16:17.712835       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7790309Z [cluster1] I0719 00:16:17.781800       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7793172Z [cluster1] I0719 00:16:18.127379       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7796012Z [cluster1] I0719 00:16:18.216094       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7798736Z [cluster1] I0719 00:16:18.629100       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7801024Z [cluster1] I0719 00:16:36.130928       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7802482Z [cluster1] I0719 00:16:36.130981       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7803692Z [cluster1] I0719 00:16:36.130991       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7805900Z [cluster1] I0719 00:16:36.138987       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7870707Z [cluster1] I0719 00:16:36.143021       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7873548Z [cluster1] I0719 00:16:36.645297       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7876383Z [cluster1] I0719 00:16:36.650107       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7879231Z [cluster1] I0719 00:16:36.653626       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7882201Z [cluster1] I0719 00:16:36.656450       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7885040Z [cluster1] I0719 00:16:37.158009       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7887438Z [cluster1] I0719 00:16:37.166060       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7889051Z [cluster1] I0719 00:16:37.166098       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7890274Z [cluster1] I0719 00:16:37.166108       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7891997Z [cluster1] I0719 00:16:37.172054       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7893450Z [cluster1] I0719 00:16:37.172094       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7894650Z [cluster1] I0719 00:16:37.172109       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7896808Z [cluster1] I0719 00:16:37.177528       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7899579Z [cluster1] I0719 00:16:37.177960       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7902399Z [cluster1] I0719 00:16:37.181358       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7905337Z [cluster1] I0719 00:16:37.181368       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7908147Z [cluster1] I0719 00:16:37.689618       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7910883Z [cluster1] I0719 00:16:37.694037       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7913651Z [cluster1] I0719 00:16:37.702214       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7916478Z [cluster1] I0719 00:16:37.706850       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7919299Z [cluster1] I0719 00:16:37.711263       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7922122Z [cluster1] I0719 00:16:37.717037       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7925024Z [cluster1] I0719 00:16:37.721848       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7928099Z [cluster1] I0719 00:16:37.739517       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7930936Z [cluster1] I0719 00:16:38.223421       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7933655Z [cluster1] I0719 00:16:38.241767       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7935956Z [cluster1] I0719 00:16:41.152903       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7937414Z [cluster1] I0719 00:16:41.152966       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7938606Z [cluster1] I0719 00:16:41.152975       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7940848Z [cluster1] I0719 00:16:41.215730       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7943676Z [cluster1] I0719 00:16:41.221493       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7946465Z [cluster1] I0719 00:16:41.723424       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7949245Z [cluster1] I0719 00:16:41.728744       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7952099Z [cluster1] I0719 00:16:41.733237       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7954966Z [cluster1] I0719 00:16:41.737513       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7957758Z [cluster1] I0719 00:16:42.239173       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7960056Z [cluster1] I0719 00:16:42.248420       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7961568Z [cluster1] I0719 00:16:42.248558       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7962768Z [cluster1] I0719 00:16:42.248595       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7964485Z [cluster1] I0719 00:16:42.257409       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.7981390Z [cluster1] I0719 00:16:42.257516       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.7982628Z [cluster1] I0719 00:16:42.257533       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.7984949Z [cluster1] I0719 00:16:42.258605       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7987790Z [cluster1] I0719 00:16:42.265280       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7990603Z [cluster1] I0719 00:16:42.269614       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.7993660Z [cluster1] I0719 00:16:42.274897       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.7996485Z [cluster1] I0719 00:16:42.766884       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.7999250Z [cluster1] I0719 00:16:42.772146       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8002053Z [cluster1] I0719 00:16:42.776187       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8004830Z [cluster1] I0719 00:16:42.778398       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8008658Z [cluster1] I0719 00:16:42.785591       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8011598Z [cluster1] I0719 00:16:42.811050       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8014519Z [cluster1] I0719 00:16:42.845784       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8017388Z [cluster1] I0719 00:16:42.854057       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8021270Z [cluster1] I0719 00:16:43.293994       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8024012Z [cluster1] I0719 00:16:43.355669       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8026320Z [cluster1] I0719 00:16:46.180146       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8027781Z [cluster1] I0719 00:16:46.180205       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8029472Z [cluster1] I0719 00:16:46.180215       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8031795Z [cluster1] I0719 00:16:46.197444       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8034630Z [cluster1] I0719 00:16:46.233085       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8037414Z [cluster1] I0719 00:16:46.741827       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8040183Z [cluster1] I0719 00:16:46.747735       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8043012Z [cluster1] I0719 00:16:46.761604       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8045853Z [cluster1] I0719 00:16:46.771863       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8048827Z [cluster1] I0719 00:16:47.274369       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8051155Z [cluster1] I0719 00:16:47.296730       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8052670Z [cluster1] I0719 00:16:47.296768       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8053882Z [cluster1] I0719 00:16:47.296778       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8055620Z [cluster1] I0719 00:16:47.298208       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8057054Z [cluster1] I0719 00:16:47.298964       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8058261Z [cluster1] I0719 00:16:47.298976       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8060424Z [cluster1] I0719 00:16:47.320947       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8063244Z [cluster1] I0719 00:16:47.328308       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8066063Z [cluster1] I0719 00:16:47.341924       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8068956Z [cluster1] I0719 00:16:47.345814       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8071750Z [cluster1] I0719 00:16:47.829489       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8074535Z [cluster1] I0719 00:16:47.835080       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8077359Z [cluster1] I0719 00:16:47.851622       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8080129Z [cluster1] I0719 00:16:47.852728       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8082925Z [cluster1] I0719 00:16:47.858824       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8086670Z [cluster1] I0719 00:16:47.881761       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8089597Z [cluster1] I0719 00:16:47.887329       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8092455Z [cluster1] I0719 00:16:47.893412       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8095354Z [cluster1] I0719 00:16:48.361052       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8098186Z [cluster1] I0719 00:16:48.396275       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8100484Z [cluster1] I0719 00:16:51.240166       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8101929Z [cluster1] I0719 00:16:51.240219       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8103140Z [cluster1] I0719 00:16:51.240228       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8105392Z [cluster1] I0719 00:16:51.248224       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8108210Z [cluster1] I0719 00:16:51.252181       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8111001Z [cluster1] I0719 00:16:51.753888       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8113772Z [cluster1] I0719 00:16:51.760113       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8116579Z [cluster1] I0719 00:16:51.768763       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8119979Z [cluster1] I0719 00:16:51.772334       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8123775Z [cluster1] I0719 00:16:52.273695       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8126201Z [cluster1] I0719 00:16:52.284558       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8127949Z [cluster1] I0719 00:16:52.284691       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8129282Z [cluster1] I0719 00:16:52.284748       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8131093Z [cluster1] I0719 00:16:52.295206       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8132549Z [cluster1] I0719 00:16:52.295308       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8133754Z [cluster1] I0719 00:16:52.295362       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8135906Z [cluster1] I0719 00:16:52.303978       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8138678Z [cluster1] I0719 00:16:52.305686       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8141501Z [cluster1] I0719 00:16:52.314614       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8144446Z [cluster1] I0719 00:16:52.329585       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8147937Z [cluster1] I0719 00:16:52.815759       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8150715Z [cluster1] I0719 00:16:52.820573       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8153577Z [cluster1] I0719 00:16:52.827758       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8156342Z [cluster1] I0719 00:16:52.830361       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8164407Z [cluster1] I0719 00:16:52.831118       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8167394Z [cluster1] I0719 00:16:52.839662       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8170237Z [cluster1] I0719 00:16:52.842783       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8173687Z [cluster1] I0719 00:16:52.845420       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8176878Z [cluster1] I0719 00:16:53.332987       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8179713Z [cluster1] I0719 00:16:53.346996       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8181991Z [cluster1] I0719 00:16:56.259542       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8183518Z [cluster1] I0719 00:16:56.259591       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8184724Z [cluster1] I0719 00:16:56.259600       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8186976Z [cluster1] I0719 00:16:56.271025       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8189807Z [cluster1] I0719 00:16:56.275054       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8192617Z [cluster1] I0719 00:16:56.777877       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8197602Z [cluster1] I0719 00:16:56.785218       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8200477Z [cluster1] I0719 00:16:56.790218       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8203357Z [cluster1] I0719 00:16:56.801302       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8206259Z [cluster1] I0719 00:16:57.304307       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8208687Z [cluster1] I0719 00:16:57.325954       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8210148Z [cluster1] I0719 00:16:57.326004       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8211480Z [cluster1] I0719 00:16:57.326013       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8213194Z [cluster1] I0719 00:16:57.329467       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8214642Z [cluster1] I0719 00:16:57.329502       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8215852Z [cluster1] I0719 00:16:57.329511       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8217996Z [cluster1] I0719 00:16:57.348319       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8220769Z [cluster1] I0719 00:16:57.358552       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8223593Z [cluster1] I0719 00:16:57.382448       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8227228Z [cluster1] I0719 00:16:57.383220       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8230046Z [cluster1] I0719 00:16:57.883657       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8232764Z [cluster1] I0719 00:16:57.885377       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8236244Z [cluster1] I0719 00:16:57.895066       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8239150Z [cluster1] I0719 00:16:57.895729       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8241975Z [cluster1] I0719 00:16:57.905933       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8244780Z [cluster1] I0719 00:16:57.909174       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8247785Z [cluster1] I0719 00:16:57.914675       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8250791Z [cluster1] I0719 00:16:57.930152       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8253665Z [cluster1] I0719 00:16:58.416373       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8256396Z [cluster1] I0719 00:16:58.430992       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8258693Z [cluster1] I0719 00:17:01.282423       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8260159Z [cluster1] I0719 00:17:01.282508       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8261360Z [cluster1] I0719 00:17:01.282523       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8263597Z [cluster1] I0719 00:17:01.330141       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8266428Z [cluster1] I0719 00:17:01.343890       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8269899Z [cluster1] I0719 00:17:01.845253       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8272670Z [cluster1] I0719 00:17:01.850269       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8275505Z [cluster1] I0719 00:17:01.853987       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8278428Z [cluster1] I0719 00:17:01.856800       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8281257Z [cluster1] I0719 00:17:02.358450       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8283568Z [cluster1] I0719 00:17:02.370772       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8285018Z [cluster1] I0719 00:17:02.370995       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8286413Z [cluster1] I0719 00:17:02.371015       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8288153Z [cluster1] I0719 00:17:02.375618       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8289599Z [cluster1] I0719 00:17:02.376548       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8290800Z [cluster1] I0719 00:17:02.376568       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8292956Z [cluster1] I0719 00:17:02.400380       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8295735Z [cluster1] I0719 00:17:02.401987       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8300894Z [cluster1] I0719 00:17:02.408854       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8303925Z [cluster1] I0719 00:17:02.428571       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8308564Z [cluster1] I0719 00:17:02.910897       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8312303Z [cluster1] I0719 00:17:02.916935       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8315914Z [cluster1] I0719 00:17:02.923233       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8328853Z [cluster1] I0719 00:17:02.927380       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8331993Z [cluster1] I0719 00:17:02.936443       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8334844Z [cluster1] I0719 00:17:02.948817       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8337682Z [cluster1] I0719 00:17:02.954668       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8340681Z [cluster1] I0719 00:17:02.971226       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8343508Z [cluster1] I0719 00:17:03.429071       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8346231Z [cluster1] I0719 00:17:03.473119       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8348487Z [cluster1] I0719 00:17:06.338929       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submer2]                 "lastProbeTime": null,
2021-07-19T00:17:06.8349578Z [cluster2]                 "lastTransitionTime": "2021-07-19T00:15:49Z",
2021-07-19T00:17:06.8350128Z [cluster2]                 "status": "True",
2021-07-19T00:17:06.8350629Z [cluster2]                 "type": "PodScheduled"
2021-07-19T00:17:06.8351072Z [cluster2]             }
2021-07-19T00:17:06.8351469Z [cluster2]         ],
2021-07-19T00:17:06.8351929Z [cluster2]         "containerStatuses": [
2021-07-19T00:17:06.8352484Z [cluster2]             {
2021-07-19T00:17:06.8354017Z [cluster2]                 "containerID": "containerd://f4cafc195727b79d01979323b216fb3b85e43d9f98c3ae6e36e0aac7434d2ac1",
2021-07-19T00:17:06.8357305Z [cluster2]                 "image": "localhost:5000/submariner-operator:local",
2021-07-19T00:17:06.8358884Z [cluster2]                 "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T00:17:06.8359894Z [cluster2]                 "lastState": {
2021-07-19T00:17:06.8360367Z [cluster2]                     "terminated": {
2021-07-19T00:17:06.8362023Z [cluster2]                         "containerID": "containerd://4f6dc8f1128a7b978bc1ae860c84db1bfec64ba301b636ceec5231af8d4ca4d2",
2021-07-19T00:17:06.8363686Z [cluster2]                         "exitCode": 1,
2021-07-19T00:17:06.8364614Z [cluster2]                         "finishedAt": "2021-07-19T00:15:59Z",
2021-07-19T00:17:06.8365357Z [cluster2]                         "reason": "Error",
2021-07-19T00:17:06.8366195Z [cluster2]                         "startedAt": "2021-07-19T00:15:50Z"
2021-07-19T00:17:06.8366846Z [cluster2]                     }
2021-07-19T00:17:06.8367359Z [cluster2]                 },
2021-07-19T00:17:06.8368184Z [cluster2]                 "name": "submariner-operator",
2021-07-19T00:17:06.8368875Z [cluster2]                 "ready": true,
2021-07-19T00:17:06.8369354Z [cluster2]                 "restartCount": 1,
2021-07-19T00:17:06.8369977Z [cluster2]                 "started": true,
2021-07-19T00:17:06.8370541Z [cluster2]                 "state": {
2021-07-19T00:17:06.8371093Z [cluster2]                     "running": {
2021-07-19T00:17:06.8371894Z [cluster2]                         "startedAt": "2021-07-19T00:16:03Z"
2021-07-19T00:17:06.8372366Z [cluster2]                     }
2021-07-19T00:17:06.8372870Z [cluster2]                 }
2021-07-19T00:17:06.8373228Z [cluster2]             }
2021-07-19T00:17:06.8373726Z [cluster2]         ],
2021-07-19T00:17:06.8374243Z [cluster2]         "hostIP": "172.18.0.5",
2021-07-19T00:17:06.8374713Z [cluster2]         "phase": "Running",
2021-07-19T00:17:06.8375285Z [cluster2]         "podIP": "10.0.128.2",
2021-07-19T00:17:06.8375837Z [cluster2]         "podIPs": [
2021-07-19T00:17:06.8376232Z [cluster2]             {
2021-07-19T00:17:06.8376754Z [cluster2]                 "ip": "10.0.128.2"
2021-07-19T00:17:06.8377131Z [cluster2]             }
2021-07-19T00:17:06.8377626Z [cluster2]         ],
2021-07-19T00:17:06.8378358Z [cluster2]         "qosClass": "BestEffort",
2021-07-19T00:17:06.8379392Z [cluster2]         "startTime": "2021-07-19T00:15:49Z"
2021-07-19T00:17:06.8379834Z [cluster2]     }
2021-07-19T00:17:06.8380180Z [cluster2] }
2021-07-19T00:17:06.8381759Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.8384109Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.8385596Z [submariner-operator]$ [cluster2] grep Running
2021-07-19T00:17:06.8387380Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T00:17:06.8388657Z [cluster2] Running
2021-07-19T00:17:06.8391614Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator
2021-07-19T00:17:06.8393871Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator
2021-07-19T00:17:06.8395963Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-fhr8g --namespace=submariner-operator
2021-07-19T00:17:06.8399202Z [cluster2] I0719 00:16:04.032225       1 main.go:77] cmd "msg"="Go Version: go1.16.5"  
2021-07-19T00:17:06.8399974Z [cluster2] I0719 00:16:04.032279       1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"  
2021-07-19T00:17:06.8400950Z [cluster2] I0719 00:16:04.032285       1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"  
2021-07-19T00:17:06.8401914Z [cluster2] I0719 00:16:04.032291       1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"  
2021-07-19T00:17:06.8402718Z [cluster2] I0719 00:16:04.032495       1 leader.go:89] leader "msg"="Trying to become the leader."  
2021-07-19T00:17:06.8403555Z [cluster2] I0719 00:16:04.595494       1 leader.go:122] leader "msg"="Found existing lock with my name. I was likely restarted."  
2021-07-19T00:17:06.8404531Z [cluster2] I0719 00:16:04.595520       1 leader.go:123] leader "msg"="Continuing as the leader."  
2021-07-19T00:17:06.8405709Z [cluster2] I0719 00:16:05.098795       1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="0.0.0.0:8383"
2021-07-19T00:17:06.8406927Z [cluster2] I0719 00:16:05.099347       1 main.go:129] cmd "msg"="Registering Components."  
2021-07-19T00:17:06.8407668Z [cluster2] I0719 00:16:05.099551       1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"  
2021-07-19T00:17:06.8408603Z [cluster2] I0719 00:16:08.789835       1 main.go:182] cmd "msg"="Could not create ServiceMonitor object"  "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8410275Z [cluster2] I0719 00:16:08.790028       1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects"  "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8411363Z [cluster2] I0719 00:16:08.790147       1 main.go:203] cmd "msg"="Starting the Cmd."  
2021-07-19T00:17:06.8412424Z [cluster2] I0719 00:16:08.790418       1 internal.go:406] controller-runtime/manager "msg"="starting metrics server"  "path"="/metrics"
2021-07-19T00:17:06.8414328Z [cluster2] I0719 00:16:08.790743       1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T00:17:06.8417655Z [cluster2] I0719 00:16:08.791011       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T00:17:06.8423620Z [cluster2] I0719 00:16:08.791293       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T00:17:06.8431437Z [cluster2] I0719 00:16:08.791463       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T00:17:06.8437706Z [cluster2] I0719 00:16:08.791503       1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T00:17:06.8440673Z [cluster2] I0719 00:16:08.891786       1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker" 
2021-07-19T00:17:06.8442544Z [cluster2] I0719 00:16:08.891821       1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T00:17:06.8444556Z [cluster2] I0719 00:16:08.891856       1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-19T00:17:06.8447340Z [cluster2] I0719 00:16:08.891880       1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T00:17:06.8450220Z [cluster2] I0719 00:16:08.893256       1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T00:17:06.8453879Z [cluster2] I0719 00:16:08.893262       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T00:17:06.8458568Z [cluster2] I0719 00:16:08.893276       1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T00:17:06.8461110Z [cluster2] I0719 00:16:08.994314       1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-19T00:17:06.8463073Z [cluster2] I0719 00:16:08.994515       1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T00:17:06.8465008Z [cluster2] I0719 00:16:08.994673       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8467806Z [cluster2] I0719 00:16:08.994361       1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource"  "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T00:17:06.8470625Z [cluster2] I0719 00:16:08.994388       1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"  
2021-07-19T00:17:06.8472076Z [cluster2] I0719 00:16:09.045389       1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"  
2021-07-19T00:17:06.8473635Z [cluster2] I0719 00:16:09.045551       1 network.go:56] controller_submariner "msg"="Discovered K8s network details"  "clusterCIDRs"=["10.0.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.0.0.0/16"]
2021-07-19T00:17:06.8474917Z [cluster2] I0719 00:16:09.045633       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8476123Z [cluster2] I0719 00:16:09.045709       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8478264Z [cluster2] I0719 00:16:09.055987       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8480852Z [cluster2] I0719 00:16:09.097183       1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"  
2021-07-19T00:17:06.8482615Z [cluster2] I0719 00:16:09.097345       1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T00:17:06.8484351Z [cluster2] I0719 00:16:09.097422       1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers"  "worker count"=1
2021-07-19T00:17:06.8487403Z [cluster2] I0719 00:16:09.097651       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8489189Z [cluster2] I0719 00:16:09.097752       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8490834Z [cluster2] I0719 00:16:09.097827       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8493605Z [cluster2] I0719 00:16:09.184824       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8496949Z [cluster2] I0719 00:16:09.229041       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8501017Z [cluster2] E0719 00:16:09.229253       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-19T00:17:06.8504186Z [cluster2] I0719 00:16:09.234813       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8505637Z [cluster2] I0719 00:16:09.234967       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8506842Z [cluster2] I0719 00:16:09.235056       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8509002Z [cluster2] I0719 00:16:09.276362       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8511924Z [cluster2] I0719 00:16:09.306159       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8515267Z [cluster2] E0719 00:16:09.307259       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" 
2021-07-19T00:17:06.8518025Z [cluster2] I0719 00:16:09.307540       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8519481Z [cluster2] I0719 00:16:09.307670       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8520694Z [cluster2] I0719 00:16:09.307757       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8522843Z [cluster2] I0719 00:16:09.376706       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8525670Z [cluster2] I0719 00:16:09.402729       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8528632Z [cluster2] I0719 00:16:09.809856       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8531474Z [cluster2] I0719 00:16:09.828013       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8534272Z [cluster2] I0719 00:16:09.850259       1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8537622Z [cluster2] E0719 00:16:09.850340       1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-globalnet: DaemonSet.apps \"submariner-globalnet\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner" 
2021-07-19T00:17:06.8540413Z [cluster2] I0719 00:16:09.861647       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8541874Z [cluster2] I0719 00:16:09.861729       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8543084Z [cluster2] I0719 00:16:09.861739       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8545221Z [cluster2] I0719 00:16:09.902190       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8548060Z [cluster2] I0719 00:16:09.903957       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8550833Z [cluster2] I0719 00:16:09.961202       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8553712Z [cluster2] I0719 00:16:10.033365       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8556555Z [cluster2] I0719 00:16:10.120839       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8559375Z [cluster2] I0719 00:16:10.242687       1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8562724Z [cluster2] E0719 00:16:10.242770       1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-globalnet-metrics: Service \"submariner-globalnet-metrics\" not found" "name"="submariner" "namespace"="submariner-operator" 
2021-07-19T00:17:06.8565512Z [cluster2] I0719 00:16:10.242797       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8567046Z [cluster2] I0719 00:16:10.242835       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8568311Z [cluster2] I0719 00:16:10.242844       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8570567Z [cluster2] I0719 00:16:10.473788       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8573388Z [cluster2] I0719 00:16:10.479136       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8576185Z [cluster2] I0719 00:16:10.547225       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8578960Z [cluster2] I0719 00:16:10.573666       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8581786Z [cluster2] I0719 00:16:10.608409       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8584731Z [cluster2] I0719 00:16:10.658690       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8587554Z [cluster2] I0719 00:16:10.982592       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8590316Z [cluster2] I0719 00:16:10.989680       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8593128Z [cluster2] I0719 00:16:11.052525       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8595914Z [cluster2] I0719 00:16:11.184879       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8598450Z [cluster2] I0719 00:16:11.479159       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8600813Z [cluster2] I0719 00:16:11.489501       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8603485Z [cluster2] I0719 00:16:11.539597       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8606892Z [cluster2] I0719 00:16:11.540969       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8609914Z [cluster2] I0719 00:16:11.541348       1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T00:17:06.8613607Z [cluster2] E0719 00:16:11.718559       1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" 
2021-07-19T00:17:06.8617038Z [cluster2] I0719 00:16:11.724418       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8619208Z [cluster2] I0719 00:16:11.730898       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8620676Z [cluster2] I0719 00:16:11.730974       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8621958Z [cluster2] I0719 00:16:11.730997       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8624396Z [cluster2] I0719 00:16:12.085597       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8627435Z [cluster2] I0719 00:16:12.085956       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8630179Z [cluster2] I0719 00:16:12.086577       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8633232Z [cluster2] I0719 00:16:12.087009       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8636352Z [cluster2] I0719 00:16:12.633364       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8639594Z [cluster2] E0719 00:16:12.690355       1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8642215Z [cluster2] I0719 00:16:12.690403       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8643725Z [cluster2] I0719 00:16:12.690442       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8644945Z [cluster2] I0719 00:16:12.690450       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8647410Z [cluster2] I0719 00:16:12.856321       1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T00:17:06.8650728Z [cluster2] I0719 00:16:12.913946       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8653875Z [cluster2] I0719 00:16:12.920513       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8656698Z [cluster2] I0719 00:16:12.927158       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8659803Z [cluster2] I0719 00:16:13.108262       1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8663193Z [cluster2] I0719 00:16:13.396467       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8666121Z [cluster2] I0719 00:16:13.423328       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8669171Z [cluster2] I0719 00:16:13.467901       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8672651Z [cluster2] E0719 00:16:13.467958       1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"  
2021-07-19T00:17:06.8676451Z [cluster2] E0719 00:16:13.468003       1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" 
2021-07-19T00:17:06.8679657Z [cluster2] I0719 00:16:13.468032       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8682260Z [cluster2] I0719 00:16:13.655319       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8685104Z [cluster2] I0719 00:16:14.072861       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8688016Z [cluster2] I0719 00:16:14.138385       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8691046Z [cluster2] I0719 00:16:14.197375       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8694350Z [cluster2] I0719 00:16:14.841524       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8697413Z [cluster2] I0719 00:16:14.841929       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8700304Z [cluster2] I0719 00:16:14.841978       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8703123Z [cluster2] I0719 00:16:14.871773       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8706218Z [cluster2] I0719 00:16:15.076712       1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8709677Z [cluster2] I0719 00:16:15.080713       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8712819Z [cluster2] I0719 00:16:15.144746       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8715748Z [cluster2] I0719 00:16:15.145197       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8718706Z [cluster2] I0719 00:16:15.586122       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8721643Z [cluster2] I0719 00:16:15.586223       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8724495Z [cluster2] I0719 00:16:15.604624       1 servicediscovery_controller.go:487] controller_servicediscovery "msg"="coredns configmap does not have lighthouse configuration hence creating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8728785Z [cluster2] I0719 00:16:15.604740       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n"  
2021-07-19T00:17:06.8732667Z [cluster2] I0719 00:16:15.605085       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8736066Z [cluster2] I0719 00:16:15.642248       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8740205Z [cluster2] I0719 00:16:15.659617       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8743355Z [cluster2] I0719 00:16:15.664988       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8746763Z [cluster2] I0719 00:16:16.151740       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8751476Z [cluster2] I0719 00:16:16.158475       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8755302Z [cluster2] I0719 00:16:16.161805       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n"  
2021-07-19T00:17:06.8758648Z [cluster2] I0719 00:16:16.178301       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8761510Z [cluster2] I0719 00:16:16.201562       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8764956Z [cluster2] I0719 00:16:16.220053       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8768255Z [cluster2] I0719 00:16:16.725994       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8771422Z [cluster2] I0719 00:16:16.738843       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8774822Z [cluster2] I0719 00:16:16.746194       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8778025Z [cluster2] I0719 00:16:17.248090       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8780787Z [cluster2] I0719 00:16:17.251395       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8784681Z [cluster2] I0719 00:16:17.251432       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n"  
2021-07-19T00:17:06.8787814Z [cluster2] I0719 00:16:26.149162       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8789265Z [cluster2] I0719 00:16:26.149224       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8790481Z [cluster2] I0719 00:16:26.149233       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8792667Z [cluster2] I0719 00:16:26.235463       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8795504Z [cluster2] I0719 00:16:26.282077       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8798300Z [cluster2] I0719 00:16:26.783967       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8801153Z [cluster2] I0719 00:16:26.934703       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8804701Z [cluster2] I0719 00:16:26.947920       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8807750Z [cluster2] I0719 00:16:26.951208       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8810858Z [cluster2] I0719 00:16:27.453529       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8813156Z [cluster2] I0719 00:16:27.511338       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8814614Z [cluster2] I0719 00:16:27.511380       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8815832Z [cluster2] I0719 00:16:27.511388       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8817677Z [cluster2] I0719 00:16:27.549928       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8820042Z [cluster2] I0719 00:16:27.549971       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8821297Z [cluster2] I0719 00:16:27.549982       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8823509Z [cluster2] I0719 00:16:27.640787       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8826286Z [cluster2] I0719 00:16:27.641242       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8829247Z [cluster2] I0719 00:16:27.792951       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8832131Z [cluster2] I0719 00:16:27.793209       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8834717Z [cluster2] I0719 00:16:27.852619       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8837601Z [cluster2] I0719 00:16:27.862893       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8841061Z [cluster2] I0719 00:16:27.875786       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8844130Z [cluster2] I0719 00:16:28.301538       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8846989Z [cluster2] I0719 00:16:28.301641       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8849777Z [cluster2] I0719 00:16:28.318537       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8852653Z [cluster2] I0719 00:16:28.319277       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8855442Z [cluster2] I0719 00:16:28.326251       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8858345Z [cluster2] I0719 00:16:28.329220       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8861219Z [cluster2] I0719 00:16:28.344906       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8864171Z [cluster2] I0719 00:16:28.378606       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8867309Z [cluster2] I0719 00:16:28.393268       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8870438Z [cluster2] I0719 00:16:28.395538       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8873626Z [cluster2] I0719 00:16:28.416547       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8876711Z [cluster2] I0719 00:16:28.863081       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8879958Z [cluster2] I0719 00:16:28.969810       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8882854Z [cluster2] I0719 00:16:28.969857       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8885717Z [cluster2] I0719 00:16:29.002682       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8891637Z [cluster2] I0719 00:16:29.002721       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n"  
2021-07-19T00:17:06.8895165Z [cluster2] I0719 00:16:29.105584       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8910550Z [cluster2] I0719 00:16:29.133932       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8912049Z [cluster2] I0719 00:16:29.133985       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8913261Z [cluster2] I0719 00:16:29.133999       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8915735Z [cluster2] I0719 00:16:29.162137       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8918769Z [cluster2] I0719 00:16:29.164719       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8921987Z [cluster2] I0719 00:16:29.176327       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8925109Z [cluster2] I0719 00:16:29.194301       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8928197Z [cluster2] I0719 00:16:29.677912       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8931476Z [cluster2] I0719 00:16:29.692943       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.8934522Z [cluster2] I0719 00:16:29.697259       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8937613Z [cluster2] I0719 00:16:29.705588       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8940731Z [cluster2] I0719 00:16:29.708253       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8943565Z [cluster2] I0719 00:16:29.725859       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8946440Z [cluster2] I0719 00:16:29.741105       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8951167Z [cluster2] I0719 00:16:30.207564       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8954015Z [cluster2] I0719 00:16:30.212518       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8957833Z [cluster2] I0719 00:16:30.212585       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n"  
2021-07-19T00:17:06.8961388Z [cluster2] I0719 00:16:30.243036       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8963687Z [cluster2] I0719 00:16:30.253451       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8965139Z [cluster2] I0719 00:16:30.253496       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8976593Z [cluster2] I0719 00:16:30.253507       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8978650Z [cluster2] I0719 00:16:30.260565       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.8980253Z [cluster2] I0719 00:16:30.260608       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.8981458Z [cluster2] I0719 00:16:30.260617       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.8983642Z [cluster2] I0719 00:16:30.265269       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8986422Z [cluster2] I0719 00:16:30.277396       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.8989241Z [cluster2] I0719 00:16:30.279597       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8992546Z [cluster2] I0719 00:16:30.299611       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.8995509Z [cluster2] I0719 00:16:30.791649       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.8998294Z [cluster2] I0719 00:16:30.809273       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9001080Z [cluster2] I0719 00:16:30.809491       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9003904Z [cluster2] I0719 00:16:30.821637       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9006803Z [cluster2] I0719 00:16:30.850677       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9010671Z [cluster2] I0719 00:16:30.862134       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9013665Z [cluster2] I0719 00:16:30.862426       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9016599Z [cluster2] I0719 00:16:30.866292       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9019327Z [cluster2] I0719 00:16:31.056100       1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9022207Z [cluster2] I0719 00:16:31.078050       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.9025528Z [cluster2] I0719 00:16:31.136473       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9028604Z [cluster2] I0719 00:16:31.365518       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9031663Z [cluster2] I0719 00:16:31.368682       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9033961Z [cluster2] I0719 00:16:31.374356       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9035632Z [cluster2] I0719 00:16:31.374396       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9036853Z [cluster2] I0719 00:16:31.374406       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9039014Z [cluster2] I0719 00:16:31.381283       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9041832Z [cluster2] I0719 00:16:31.383986       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9044760Z [cluster2] I0719 00:16:31.638848       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9048018Z [cluster2] I0719 00:16:31.643143       1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T00:17:06.9051448Z [cluster2] I0719 00:16:31.647281       1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9054544Z [cluster2] I0719 00:16:31.885030       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9057410Z [cluster2] I0719 00:16:31.889288       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9060241Z [cluster2] I0719 00:16:31.892976       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9063096Z [cluster2] I0719 00:16:31.895908       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9066052Z [cluster2] I0719 00:16:32.148577       1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9068821Z [cluster2] I0719 00:16:32.150208       1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9072649Z [cluster2] I0719 00:16:32.150252       1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n    forward . 100.0.238.183\n}\n#lighthouse-end\n.:53 {\n    errors\n    health {\n       lameduck 5s\n    }\n    ready\n    kubernetes cluster2.local in-addr.arpa ip6.arpa {\n       pods insecure\n       fallthrough in-addr.arpa ip6.arpa\n       ttl 30\n    }\n    prometheus :9153\n    forward . /etc/resolv.conf {\n       max_concurrent 1000\n    }\n    cache 30\n    loop\n    reload\n    loadbalance\n}\n\n\n\n\n\n"  
2021-07-19T00:17:06.9076302Z [cluster2] I0719 00:16:32.397233       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9078611Z [cluster2] I0719 00:16:32.405159       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9080057Z [cluster2] I0719 00:16:32.406263       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9081276Z [cluster2] I0719 00:16:32.406279       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9083000Z [cluster2] I0719 00:16:32.406206       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9084447Z [cluster2] I0719 00:16:32.406427       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9085659Z [cluster2] I0719 00:16:32.406460       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9094868Z [cluster2] I0719 00:16:32.415458       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9098242Z [cluster2] I0719 00:16:32.423362       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9101983Z [cluster2] I0719 00:16:32.429454       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9104879Z [cluster2] I0719 00:16:32.430269       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9107672Z [cluster2] I0719 00:16:32.931408       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9110408Z [cluster2] I0719 00:16:32.933536       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9113325Z [cluster2] I0719 00:16:32.940845       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9116142Z [cluster2] I0719 00:16:32.941315       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9119044Z [cluster2] I0719 00:16:32.945332       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9121860Z [cluster2] I0719 00:16:32.949651       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9124727Z [cluster2] I0719 00:16:32.953017       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9132854Z [cluster2] I0719 00:16:32.953222       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9135827Z [cluster2] I0719 00:16:33.454606       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9139298Z [cluster2] I0719 00:16:33.454783       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9141592Z [cluster2] I0719 00:16:34.457158       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9143059Z [cluster2] I0719 00:16:34.457221       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9144409Z [cluster2] I0719 00:16:34.457231       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9146571Z [cluster2] I0719 00:16:34.464258       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9149407Z [cluster2] I0719 00:16:34.467207       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9152257Z [cluster2] I0719 00:16:34.968934       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9155033Z [cluster2] I0719 00:16:34.973671       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9157840Z [cluster2] I0719 00:16:34.980051       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9160803Z [cluster2] I0719 00:16:34.983501       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9163631Z [cluster2] I0719 00:16:35.485624       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9165925Z [cluster2] I0719 00:16:35.492799       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9167537Z [cluster2] I0719 00:16:35.492968       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9168750Z [cluster2] I0719 00:16:35.493051       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9170454Z [cluster2] I0719 00:16:35.494562       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9171905Z [cluster2] I0719 00:16:35.494744       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9173118Z [cluster2] I0719 00:16:35.494829       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9175259Z [cluster2] I0719 00:16:35.501542       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9178028Z [cluster2] I0719 00:16:35.502621       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9180916Z [cluster2] I0719 00:16:35.505078       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9183774Z [cluster2] I0719 00:16:35.506041       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9186574Z [cluster2] I0719 00:16:36.006836       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9189310Z [cluster2] I0719 00:16:36.007778       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9192080Z [cluster2] I0719 00:16:36.012900       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9194900Z [cluster2] I0719 00:16:36.013081       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9197811Z [cluster2] I0719 00:16:36.017385       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9200610Z [cluster2] I0719 00:16:36.018495       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9203450Z [cluster2] I0719 00:16:36.021537       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9208547Z [cluster2] I0719 00:16:36.022037       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9211584Z [cluster2] I0719 00:16:36.523553       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9237383Z [cluster2] I0719 00:16:36.524721       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9239709Z [cluster2] I0719 00:16:39.488747       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9241172Z [cluster2] I0719 00:16:39.488979       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9242523Z [cluster2] I0719 00:16:39.488997       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9244709Z [cluster2] I0719 00:16:39.500540       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9247758Z [cluster2] I0719 00:16:39.505233       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9250586Z [cluster2] I0719 00:16:40.006982       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9253392Z [cluster2] I0719 00:16:40.017901       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9256226Z [cluster2] I0719 00:16:40.027719       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9259184Z [cluster2] I0719 00:16:40.042405       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9262015Z [cluster2] I0719 00:16:40.543986       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9264320Z [cluster2] I0719 00:16:40.553829       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9265771Z [cluster2] I0719 00:16:40.553871       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9266975Z [cluster2] I0719 00:16:40.553881       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9268683Z [cluster2] I0719 00:16:40.569221       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9270140Z [cluster2] I0719 00:16:40.569272       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9271338Z [cluster2] I0719 00:16:40.569283       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9273495Z [cluster2] I0719 00:16:40.580177       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9276261Z [cluster2] I0719 00:16:40.584179       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9279142Z [cluster2] I0719 00:16:40.591153       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9282019Z [cluster2] I0719 00:16:40.592166       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9284804Z [cluster2] I0719 00:16:41.106528       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9287630Z [cluster2] I0719 00:16:41.106483       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9290389Z [cluster2] I0719 00:16:41.134697       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9293232Z [cluster2] I0719 00:16:41.152854       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9296125Z [cluster2] I0719 00:16:41.199383       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9298916Z [cluster2] I0719 00:16:41.206303       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9301763Z [cluster2] I0719 00:16:41.239058       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9304672Z [cluster2] I0719 00:16:41.239511       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9307499Z [cluster2] I0719 00:16:41.747518       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9310198Z [cluster2] I0719 00:16:41.752780       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9312499Z [cluster2] I0719 00:16:44.511614       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9328541Z [cluster2] I0719 00:16:44.511735       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9329956Z [cluster2] I0719 00:16:44.511757       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9332392Z [cluster2] I0719 00:16:44.525046       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9335307Z [cluster2] I0719 00:16:44.529362       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9338105Z [cluster2] I0719 00:16:45.030607       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9340880Z [cluster2] I0719 00:16:45.035989       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9343703Z [cluster2] I0719 00:16:45.040077       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9346642Z [cluster2] I0719 00:16:45.043113       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9349467Z [cluster2] I0719 00:16:45.545292       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9351793Z [cluster2] I0719 00:16:45.553387       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9353245Z [cluster2] I0719 00:16:45.553429       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9354450Z [cluster2] I0719 00:16:45.553439       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9356166Z [cluster2] I0719 00:16:45.555534       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9357605Z [cluster2] I0719 00:16:45.555607       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9358807Z [cluster2] I0719 00:16:45.555623       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9360965Z [cluster2] I0719 00:16:45.594834       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9363730Z [cluster2] I0719 00:16:45.596440       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9367209Z [cluster2] I0719 00:16:45.604353       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9370139Z [cluster2] I0719 00:16:45.610218       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9372947Z [cluster2] I0719 00:16:46.106193       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9375821Z [cluster2] I0719 00:16:46.111607       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9378684Z [cluster2] I0719 00:16:46.112514       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9381435Z [cluster2] I0719 00:16:46.122888       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9384369Z [cluster2] I0719 00:16:46.127177       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9387248Z [cluster2] I0719 00:16:46.141878       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9390062Z [cluster2] I0719 00:16:46.145218       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9392924Z [cluster2] I0719 00:16:46.156238       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9396724Z [cluster2] I0719 00:16:46.628513       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9399506Z [cluster2] I0719 00:16:46.657283       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9401795Z [cluster2] I0719 00:16:49.526687       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9403246Z [cluster2] I0719 00:16:49.526744       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9404543Z [cluster2] I0719 00:16:49.526753       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9406876Z [cluster2] I0719 00:16:49.534663       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9409702Z [cluster2] I0719 00:16:49.537584       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9412509Z [cluster2] I0719 00:16:50.038938       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9415280Z [cluster2] I0719 00:16:50.044365       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9418104Z [cluster2] I0719 00:16:50.051445       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9421040Z [cluster2] I0719 00:16:50.060504       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9423870Z [cluster2] I0719 00:16:50.561870       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9426169Z [cluster2] I0719 00:16:50.573231       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9427602Z [cluster2] I0719 00:16:50.573472       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9428814Z [cluster2] I0719 00:16:50.573561       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9430521Z [cluster2] I0719 00:16:50.573399       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9431959Z [cluster2] I0719 00:16:50.574766       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9433170Z [cluster2] I0719 00:16:50.574871       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9435326Z [cluster2] I0719 00:16:50.589961       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9438077Z [cluster2] I0719 00:16:50.593653       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9440967Z [cluster2] I0719 00:16:50.606770       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9443845Z [cluster2] I0719 00:16:50.619654       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9446718Z [cluster2] I0719 00:16:51.108678       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9450021Z [cluster2] I0719 00:16:51.113446       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9453685Z [cluster2] I0719 00:16:51.117111       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9456540Z [cluster2] I0719 00:16:51.120104       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9459460Z [cluster2] I0719 00:16:51.120721       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9462243Z [cluster2] I0719 00:16:51.128080       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9465049Z [cluster2] I0719 00:16:51.132754       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9468211Z [cluster2] I0719 00:16:51.135424       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9471084Z [cluster2] I0719 00:16:51.621405       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9473816Z [cluster2] I0719 00:16:51.636856       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9476092Z [cluster2] I0719 00:16:54.545112       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9477552Z [cluster2] I0719 00:16:54.545165       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9478940Z [cluster2] I0719 00:16:54.545174       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9481099Z [cluster2] I0719 00:16:54.553014       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9484335Z [cluster2] I0719 00:16:54.555833       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9487280Z [cluster2] I0719 00:16:55.057195       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9490063Z [cluster2] I0719 00:16:55.064088       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9493057Z [cluster2] I0719 00:16:55.078655       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9496160Z [cluster2] I0719 00:16:55.082711       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9499004Z [cluster2] I0719 00:16:55.583878       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9501297Z [cluster2] I0719 00:16:55.595028       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9502755Z [cluster2] I0719 00:16:55.595257       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9503973Z [cluster2] I0719 00:16:55.595348       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9505672Z [cluster2] I0719 00:16:55.604266       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9507127Z [cluster2] I0719 00:16:55.604478       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9508336Z [cluster2] I0719 00:16:55.604567       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9510475Z [cluster2] I0719 00:16:55.611782       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9514103Z [cluster2] I0719 00:16:55.615090       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9517080Z [cluster2] I0719 00:16:55.618258       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9519941Z [cluster2] I0719 00:16:55.633709       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9522748Z [cluster2] I0719 00:16:56.119824       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9525531Z [cluster2] I0719 00:16:56.126288       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9528449Z [cluster2] I0719 00:16:56.130827       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9531213Z [cluster2] I0719 00:16:56.134927       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9534086Z [cluster2] I0719 00:16:56.140865       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9537319Z [cluster2] I0719 00:16:56.152379       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9540680Z [cluster2] I0719 00:16:56.154568       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9544260Z [cluster2] I0719 00:16:56.178177       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9547591Z [cluster2] I0719 00:16:56.656385       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9550935Z [cluster2] I0719 00:16:56.679506       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9553495Z [cluster2] I0719 00:16:59.564856       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9554964Z [cluster2] I0719 00:16:59.565182       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9556178Z [cluster2] I0719 00:16:59.565200       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9558410Z [cluster2] I0719 00:16:59.578479       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9561249Z [cluster2] I0719 00:16:59.586887       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9564049Z [cluster2] I0719 00:17:00.088439       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9566893Z [cluster2] I0719 00:17:00.093972       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9569921Z [cluster2] I0719 00:17:00.097552       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9572781Z [cluster2] I0719 00:17:00.100802       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9575683Z [cluster2] I0719 00:17:00.602952       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9577995Z [cluster2] I0719 00:17:00.617035       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9579444Z [cluster2] I0719 00:17:00.617265       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9580636Z [cluster2] I0719 00:17:00.617333       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9582356Z [cluster2] I0719 00:17:00.617216       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9583807Z [cluster2] I0719 00:17:00.618516       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9584998Z [cluster2] I0719 00:17:00.618583       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9587155Z [cluster2] I0719 00:17:00.633693       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9589935Z [cluster2] I0719 00:17:00.639132       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9593127Z [cluster2] I0719 00:17:00.642033       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9596877Z [cluster2] I0719 00:17:00.653720       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9600187Z [cluster2] I0719 00:17:01.143601       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9604071Z [cluster2] I0719 00:17:01.155923       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9607132Z [cluster2] I0719 00:17:01.156625       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9609903Z [cluster2] I0719 00:17:01.168549       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9612836Z [cluster2] I0719 00:17:01.177054       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9615627Z [cluster2] I0719 00:17:01.188493       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9618504Z [cluster2] I0719 00:17:01.192225       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9621430Z [cluster2] I0719 00:17:01.210796       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9629938Z [cluster2] I0719 00:17:01.693616       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9632969Z [cluster2] I0719 00:17:01.712222       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9635274Z [cluster2] I0719 00:17:04.605781       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9636740Z [cluster2] I0719 00:17:04.605852       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9637947Z [cluster2] I0719 00:17:04.605862       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9641872Z [cluster2] I0719 00:17:04.620515       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9644885Z [cluster2] I0719 00:17:04.623470       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9650441Z [cluster2] I0719 00:17:05.127557       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9653288Z [cluster2] I0719 00:17:05.133584       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9656117Z [cluster2] I0719 00:17:05.156947       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:06.9658995Z [cluster2] I0719 00:17:05.166877       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:06.9661956Z [cluster2] I0719 00:17:05.668864       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:06.9664704Z [cluster2] I0719 00:17:05.683180       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9666161Z [cluster2] I0719 00:17:05.683311       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9667352Z [cluster2] I0719 00:17:05.683370       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:06.9669385Z [cluster2] I0719 00:17:05.685633       1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:06.9670834Z [cluster2] I0719 00:17:05.685817       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:06.9672043Z [cluster2] I0719 00:17:05.685879       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:07.2753687Z [cluster2] I0719 00:17:05.701053       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2756660Z [cluster2] I0719 00:17:05.705504       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2759890Z [cluster2] I0719 00:17:05.710403       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:07.2762894Z [cluster2] I0719 00:17:05.710769       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:07.2765840Z [cluster2] I0719 00:17:06.212220       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:07.2768970Z [cluster2] I0719 00:17:06.212430       1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T00:17:07.2772063Z [cluster2] I0719 00:17:06.222307       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2774996Z [cluster2] I0719 00:17:06.222943       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2777993Z [cluster2] I0719 00:17:06.234883       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2804745Z [cluster2] I0719 00:17:06.235372       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-globalnet" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.2808365Z [cluster2] I0719 00:17:06.239665       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:07.2811303Z [cluster2] I0719 00:17:06.239979       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-globalnet-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:07.2813118Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-19T00:17:07.2813961Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-19T00:17:07.2815075Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-19T00:17:07.2816395Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-19T00:17:07.2817465Z [submariner-operator]$ [cluster2] grep submariner
2021-07-19T00:17:07.2818708Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-19T00:17:07.2819594Z [cluster2] submariner   72s
2021-07-19T00:17:07.2820531Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-19T00:17:07.2821883Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:07.2823194Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-19T00:17:07.2824542Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:07.6712634Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submarinerariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" 
2021-07-19T00:17:07.6714387Z [cluster1] I0719 00:17:06.338983       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="10.0.0.0/16" "type"="Cluster"
2021-07-19T00:17:07.6715684Z [cluster1] I0719 00:17:06.338993       1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR"  "CIDR"="100.0.0.0/16" "type"="Service"
2021-07-19T00:17:07.6717925Z [cluster1] I0719 00:17:06.355825       1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T00:17:07.6720757Z [cluster1] I0719 00:17:06.388450       1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T00:17:07.6722538Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-19T00:17:07.6723402Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-19T00:17:07.6724504Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-19T00:17:07.6725595Z [submariner-operator]$ [cluster1] grep submariner
2021-07-19T00:17:07.6726918Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-19T00:17:07.6728372Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-19T00:17:07.6729274Z [cluster1] submariner   78s
2021-07-19T00:17:07.6730193Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-19T00:17:07.6731574Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:07.6732892Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-19T00:17:07.6734234Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:07.6735808Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:07.6736719Z [cluster1] {
2021-07-19T00:17:07.6737217Z [cluster1]     "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.6737794Z [cluster1]     "kind": "Submariner",
2021-07-19T00:17:07.6738239Z [cluster1]     "metadata": {
2021-07-19T00:17:07.6739031Z [cluster1]         "creationTimestamp": "2021-07-19T00:15:49Z",
2021-07-19T00:17:07.6739569Z [cluster1]         "generation": 1,
2021-07-19T00:17:07.6740059Z [cluster1]         "managedFields": [
2021-07-19T00:17:07.6740496Z [cluster1]             {
2021-07-19T00:17:07.6741101Z [cluster1]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.6741722Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:07.6742289Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:07.6742729Z [cluster1]                     "f:spec": {
2021-07-19T00:17:07.6743130Z [cluster1]                         ".": {},
2021-07-19T00:17:07.6743557Z [cluster1]                         "f:broker": {},
2021-07-19T00:17:07.6744153Z [cluster1]                         "f:brokerK8sApiServer": {},
2021-07-19T00:17:07.6744856Z [cluster1]                         "f:brokerK8sApiServerToken": {},
2021-07-19T00:17:07.6745490Z [cluster1]                         "f:brokerK8sCA": {},
2021-07-19T00:17:07.6746123Z [cluster1]                         "f:brokerK8sRemoteNamespace": {},
2021-07-19T00:17:07.6746766Z [cluster1]                         "f:cableDriver": {},
2021-07-19T00:17:07.6747279Z [cluster1]                         "f:ceIPSecDebug": {},
2021-07-19T00:17:07.6747952Z [cluster1]                         "f:ceIPSecIKEPort": {},
2021-07-19T00:17:07.6748522Z [cluster1]                         "f:ceIPSecNATTPort": {},
2021-07-19T00:17:07.6749077Z [cluster1]                         "f:ceIPSecPSK": {},
2021-07-19T00:17:07.6749574Z [cluster1]                         "f:clusterCIDR": {},
2021-07-19T00:17:07.6750070Z [cluster1]                         "f:clusterID": {},
2021-07-19T00:17:07.6750566Z [cluster1]                         "f:colorCodes": {},
2021-07-19T00:17:07.6751161Z [cluster1]                         "f:connectionHealthCheck": {
2021-07-19T00:17:07.6751715Z [cluster1]                             ".": {},
2021-07-19T00:17:07.6752142Z [cluster1]                             "f:enabled": {},
2021-07-19T00:17:07.6752669Z [cluster1]                             "f:intervalSeconds": {},
2021-07-19T00:17:07.6753278Z [cluster1]                             "f:maxPacketLossCount": {}
2021-07-19T00:17:07.6753788Z [cluster1]                         },
2021-07-19T00:17:07.6754199Z [cluster1]                         "f:debug": {},
2021-07-19T00:17:07.6754668Z [cluster1]                         "f:globalCIDR": {},
2021-07-19T00:17:07.6755157Z [cluster1]                         "f:namespace": {},
2021-07-19T00:17:07.6755643Z [cluster1]                         "f:natEnabled": {},
2021-07-19T00:17:07.6756136Z [cluster1]                         "f:repository": {},
2021-07-19T00:17:07.6756628Z [cluster1]                         "f:serviceCIDR": {},
2021-07-19T00:17:07.6757351Z [cluster1]                         "f:serviceDiscoveryEnabled": {},
2021-07-19T00:17:07.6757947Z [cluster1]                         "f:version": {}
2021-07-19T00:17:07.6758371Z [cluster1]                     }
2021-07-19T00:17:07.6758732Z [cluster1]                 },
2021-07-19T00:17:07.6759160Z [cluster1]                 "manager": "subctl",
2021-07-19T00:17:07.6759644Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:07.6760365Z [cluster1]                 "time": "2021-07-19T00:15:49Z"
2021-07-19T00:17:07.6760784Z [cluster1]             },
2021-07-19T00:17:07.6761146Z [cluster1]             {
2021-07-19T00:17:07.6761678Z [cluster1]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.6762294Z [cluster1]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:07.6762805Z [cluster1]                 "fieldsV1": {
2021-07-19T00:17:07.6763245Z [cluster1]                     "f:status": {
2021-07-19T00:17:07.6763672Z [cluster1]                         ".": {},
2021-07-19T00:17:07.6764120Z [cluster1]                         "f:clusterCIDR": {},
2021-07-19T00:17:07.6764628Z [cluster1]                         "f:clusterID": {},
2021-07-19T00:17:07.6765127Z [cluster1]                         "f:colorCodes": {},
2021-07-19T00:17:07.6765648Z [cluster1]                         "f:deploymentInfo": {},
2021-07-19T00:17:07.6794595Z [cluster1]                         "f:gatewayDaemonSetStatus": {
2021-07-19T00:17:07.6795334Z [cluster1]                             ".": {},
2021-07-19T00:17:07.6796018Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.6796762Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.6797558Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.6798167Z [cluster1]                             "f:status": {
2021-07-19T00:17:07.6798600Z [cluster1]                                 ".": {},
2021-07-19T00:17:07.6799187Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.6799940Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.6800617Z [cluster1]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.6801231Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.6801820Z [cluster1]                                 "f:numberReady": {},
2021-07-19T00:17:07.6802584Z [cluster1]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.6803288Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.6803843Z [cluster1]                             }
2021-07-19T00:17:07.6804238Z [cluster1]                         },
2021-07-19T00:17:07.6804668Z [cluster1]                         "f:gateways": {},
2021-07-19T00:17:07.6805133Z [cluster1]                         "f:globalCIDR": {},
2021-07-19T00:17:07.6805775Z [cluster1]                         "f:globalnetDaemonSetStatus": {
2021-07-19T00:17:07.6806609Z [cluster1]                             ".": {},
2021-07-19T00:17:07.6807151Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.6807874Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.6808661Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.6809250Z [cluster1]                             "f:status": {
2021-07-19T00:17:07.6809680Z [cluster1]                                 ".": {},
2021-07-19T00:17:07.6810257Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.6810985Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.6811653Z [cluster1]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.6812349Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.6812947Z [cluster1]                                 "f:numberReady": {},
2021-07-19T00:17:07.6813619Z [cluster1]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.6814322Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.6814886Z [cluster1]                             }
2021-07-19T00:17:07.6815268Z [cluster1]                         },
2021-07-19T00:17:07.6815783Z [cluster1]                         "f:loadBalancerStatus": {},
2021-07-19T00:17:07.6816336Z [cluster1]                         "f:natEnabled": {},
2021-07-19T00:17:07.6816865Z [cluster1]                         "f:networkPlugin": {},
2021-07-19T00:17:07.6817606Z [cluster1]                         "f:routeAgentDaemonSetStatus": {
2021-07-19T00:17:07.6818216Z [cluster1]                             ".": {},
2021-07-19T00:17:07.6818736Z [cluster1]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.6819470Z [cluster1]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.6820262Z [cluster1]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.6820850Z [cluster1]                             "f:status": {
2021-07-19T00:17:07.6821276Z [cluster1]                                 ".": {},
2021-07-19T00:17:07.6821836Z [cluster1]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.6822584Z [cluster1]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.6823332Z [cluster1]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.6823952Z [cluster1]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.6824594Z [cluster1]                                 "f:numberReady": {},
2021-07-19T00:17:07.6825183Z [cluster1]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.6825875Z [cluster1]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.6826441Z [cluster1]                             }
2021-07-19T00:17:07.6826834Z [cluster1]                         },
2021-07-19T00:17:07.6827277Z [cluster1]                         "f:serviceCIDR": {}
2021-07-19T00:17:07.6827722Z [cluster1]                     }
2021-07-19T00:17:07.6828084Z [cluster1]                 },
2021-07-19T00:17:07.6829066Z [cluster1]                 "manager": "submariner-operator",
2021-07-19T00:17:07.6829659Z [cluster1]                 "operation": "Update",
2021-07-19T00:17:07.6830383Z [cluster1]                 "time": "2021-07-19T00:16:13Z"
2021-07-19T00:17:07.6830803Z [cluster1]             }
2021-07-19T00:17:07.6831157Z [cluster1]         ],
2021-07-19T00:17:07.6831588Z [cluster1]         "name": "submariner",
2021-07-19T00:17:07.6832325Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T00:17:07.6832960Z [cluster1]         "resourceVersion": "2252",
2021-07-19T00:17:07.6834138Z [cluster1]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-19T00:17:07.6835215Z [cluster1]         "uid": "25232b58-60c2-4942-9a8a-64c56298ad91"
2021-07-19T00:17:07.6835678Z [cluster1]     },
2021-07-19T00:17:07.6836062Z [cluster1]     "spec": {
2021-07-19T00:17:07.6836462Z [cluster1]         "broker": "k8s",
2021-07-19T00:17:07.6837005Z [cluster1]         "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-19T00:17:07.7126869Z [cluster1]         "brokerK8sApiServerToken": "***",
2021-07-19T00:17:07.7749495Z [cluster1]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T00:17:07.8295928Z [cluster1]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T00:17:07.8296816Z [cluster1]         "cableDriver": "libreswan",
2021-07-19T00:17:07.8297383Z [cluster1]         "ceIPSecDebug": false,
2021-07-19T00:17:07.8297928Z [cluster1]         "ceIPSecIKEPort": 500,
2021-07-19T00:17:07.8298471Z [cluster1]         "ceIPSecNATTPort": 4500,
2021-07-19T00:17:07.8299752Z [cluster1]         "ceIPSecPSK": "GAU/Z8F0KP44xa82c+Snji3x5FXnlzWZq0dnfY0s4XvrhEBlnB9HcRM773IjEGcN",
2021-07-19T00:17:07.8300969Z [cluster1]         "clusterCIDR": "",
2021-07-19T00:17:07.8301469Z [cluster1]         "clusterID": "cluster1",
2021-07-19T00:17:07.8301975Z [cluster1]         "colorCodes": "blue",
2021-07-19T00:17:07.8302559Z [cluster1]         "connectionHealthCheck": {
2021-07-19T00:17:07.8303126Z [cluster1]             "enabled": true,
2021-07-19T00:17:07.8303766Z [cluster1]             "intervalSeconds": 1,
2021-07-19T00:17:07.8304350Z [cluster1]             "maxPacketLossCount": 5
2021-07-19T00:17:07.8304829Z [cluster1]         },
2021-07-19T00:17:07.8305241Z [cluster1]         "debug": false,
2021-07-19T00:17:07.8305716Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-19T00:17:07.8306481Z [cluster1]         "namespace": "submariner-operator",
2021-07-19T00:17:07.8307092Z [cluster1]         "natEnabled": false,
2021-07-19T00:17:07.8307609Z [cluster1]         "repository": "localhost:5000",
2021-07-19T00:17:07.8308126Z [cluster1]         "serviceCIDR": "",
2021-07-19T00:17:07.8308729Z [cluster1]         "serviceDiscoveryEnabled": true,
2021-07-19T00:17:07.8309341Z [cluster1]         "version": "local"
2021-07-19T00:17:07.8309952Z [cluster1]     },
2021-07-19T00:17:07.8310341Z [cluster1]     "status": {
2021-07-19T00:17:07.8310783Z [cluster1]         "clusterCIDR": "10.0.0.0/16",
2021-07-19T00:17:07.8311296Z [cluster1]         "clusterID": "cluster1",
2021-07-19T00:17:07.8311798Z [cluster1]         "colorCodes": "blue",
2021-07-19T00:17:07.8312298Z [cluster1]         "deploymentInfo": {},
2021-07-19T00:17:07.8312914Z [cluster1]         "gatewayDaemonSetStatus": {
2021-07-19T00:17:07.8313576Z [cluster1]             "lastResourceVersion": "1880",
2021-07-19T00:17:07.8314320Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T00:17:07.8315086Z [cluster1]             "nonReadyContainerStates": [],
2021-07-19T00:17:07.8315659Z [cluster1]             "status": {
2021-07-19T00:17:07.8316208Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-19T00:17:07.8316921Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-19T00:17:07.8317549Z [cluster1]                 "numberAvailable": 1,
2021-07-19T00:17:07.8318138Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T00:17:07.8318692Z [cluster1]                 "numberReady": 1,
2021-07-19T00:17:07.8319235Z [cluster1]                 "observedGeneration": 1,
2021-07-19T00:17:07.8319904Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-19T00:17:07.8320437Z [cluster1]             }
2021-07-19T00:17:07.8320798Z [cluster1]         },
2021-07-19T00:17:07.8321184Z [cluster1]         "gateways": [
2021-07-19T00:17:07.8321669Z [cluster1]             {
2021-07-19T00:17:07.8322082Z [cluster1]                 "connections": [
2021-07-19T00:17:07.8322518Z [cluster1]                     {
2021-07-19T00:17:07.8322926Z [cluster1]                         "endpoint": {
2021-07-19T00:17:07.8323427Z [cluster1]                             "backend": "libreswan",
2021-07-19T00:17:07.8323939Z [cluster1]                             "backend_config": {
2021-07-19T00:17:07.8324707Z [cluster1]                                 "natt-discovery-port": "4490",
2021-07-19T00:17:07.8325519Z [cluster1]                                 "preferred-server": "false"
2021-07-19T00:17:07.8326027Z [cluster1]                             },
2021-07-19T00:17:07.8327158Z [cluster1]                             "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-19T00:17:07.8327994Z [cluster1]                             "cluster_id": "cluster2",
2021-07-19T00:17:07.8328741Z [cluster1]                             "hostname": "cluster2-worker",
2021-07-19T00:17:07.8329326Z [cluster1]                             "nat_enabled": false,
2021-07-19T00:17:07.8329832Z [cluster1]                             "private_ip": "172.18.0.5",
2021-07-19T00:17:07.8330326Z [cluster1]                             "public_ip": "20.98.240.91",
2021-07-19T00:17:07.8330784Z [cluster1]                             "subnets": [
2021-07-19T00:17:07.8331224Z [cluster1]                                 "242.254.2.0/24"
2021-07-19T00:17:07.8331617Z [cluster1]                             ]
2021-07-19T00:17:07.8332019Z [cluster1]                         },
2021-07-19T00:17:07.8332447Z [cluster1]                         "latencyRTT": {
2021-07-19T00:17:07.8333120Z [cluster1]                             "average": "190.801µs",
2021-07-19T00:17:07.8333721Z [cluster1]                             "last": "123.201µs",
2021-07-19T00:17:07.8334311Z [cluster1]                             "max": "414.503µs",
2021-07-19T00:17:07.8334895Z [cluster1]                             "min": "120.801µs",
2021-07-19T00:17:07.8335488Z [cluster1]                             "stdDev": "76.695µs"
2021-07-19T00:17:07.8335916Z [cluster1]                         },
2021-07-19T00:17:07.8336360Z [cluster1]                         "status": "connected",
2021-07-19T00:17:07.8336890Z [cluster1]                         "statusMessage": "",
2021-07-19T00:17:07.8337385Z [cluster1]                         "usingIP": "172.18.0.5"
2021-07-19T00:17:07.8337803Z [cluster1]                     }
2021-07-19T00:17:07.8338264Z [cluster1]                 ],
2021-07-19T00:17:07.8338712Z [cluster1]                 "haStatus": "active",
2021-07-19T00:17:07.8339215Z [cluster1]                 "localEndpoint": {
2021-07-19T00:17:07.8339737Z [cluster1]                     "backend": "libreswan",
2021-07-19T00:17:07.8340240Z [cluster1]                     "backend_config": {
2021-07-19T00:17:07.8340966Z [cluster1]                         "natt-discovery-port": "4490",
2021-07-19T00:17:07.8341753Z [cluster1]                         "preferred-server": "false"
2021-07-19T00:17:07.8342256Z [cluster1]                     },
2021-07-19T00:17:07.8343193Z [cluster1]                     "cable_name": "submariner-cable-cluster1-172-18-0-6",
2021-07-19T00:17:07.8344016Z [cluster1]                     "cluster_id": "cluster1",
2021-07-19T00:17:07.8344738Z [cluster1]                     "hostname": "cluster1-worker",
2021-07-19T00:17:07.8345298Z [cluster1]                     "nat_enabled": false,
2021-07-19T00:17:07.8345785Z [cluster1]                     "private_ip": "172.18.0.6",
2021-07-19T00:17:07.8346262Z [cluster1]                     "public_ip": "20.98.240.91",
2021-07-19T00:17:07.8346705Z [cluster1]                     "subnets": [
2021-07-19T00:17:07.8347126Z [cluster1]                         "242.254.1.0/24"
2021-07-19T00:17:07.8347508Z [cluster1]                     ]
2021-07-19T00:17:07.8347886Z [cluster1]                 },
2021-07-19T00:17:07.8348323Z [cluster1]                 "statusFailure": "",
2021-07-19T00:17:07.8349035Z [cluster1]                 "version": "devel-1441a80"
2021-07-19T00:17:07.8349550Z [cluster1]             }
2021-07-19T00:17:07.8349919Z [cluster1]         ],
2021-07-19T00:17:07.8350343Z [cluster1]         "globalCIDR": "242.254.1.0/24",
2021-07-19T00:17:07.8350951Z [cluster1]         "globalnetDaemonSetStatus": {
2021-07-19T00:17:07.8351655Z [cluster1]             "lastResourceVersion": "1950",
2021-07-19T00:17:07.8352373Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T00:17:07.8370118Z [cluster1]             "nonReadyContainer --namespace=submariner-operator -o json
2021-07-19T00:17:07.8371143Z [cluster2] {
2021-07-19T00:17:07.8371653Z [cluster2]     "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.8372269Z [cluster2]     "kind": "Submariner",
2021-07-19T00:17:07.8372717Z [cluster2]     "metadata": {
2021-07-19T00:17:07.8373467Z [cluster2]         "creationTimestamp": "2021-07-19T00:15:55Z",
2021-07-19T00:17:07.8374006Z [cluster2]         "generation": 1,
2021-07-19T00:17:07.8374506Z [cluster2]         "managedFields": [
2021-07-19T00:17:07.8374928Z [cluster2]             {
2021-07-19T00:17:07.8375453Z [cluster2]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.8376195Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:07.8376694Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:07.8377127Z [cluster2]                     "f:spec": {
2021-07-19T00:17:07.8377525Z [cluster2]                         ".": {},
2021-07-19T00:17:07.8377949Z [cluster2]                         "f:broker": {},
2021-07-19T00:17:07.8378497Z [cluster2]                         "f:brokerK8sApiServer": {},
2021-07-19T00:17:07.8379192Z [cluster2]                         "f:brokerK8sApiServerToken": {},
2021-07-19T00:17:07.8379815Z [cluster2]                         "f:brokerK8sCA": {},
2021-07-19T00:17:07.8380459Z [cluster2]                         "f:brokerK8sRemoteNamespace": {},
2021-07-19T00:17:07.8381096Z [cluster2]                         "f:cableDriver": {},
2021-07-19T00:17:07.8381639Z [cluster2]                         "f:ceIPSecDebug": {},
2021-07-19T00:17:07.8382194Z [cluster2]                         "f:ceIPSecIKEPort": {},
2021-07-19T00:17:07.8382762Z [cluster2]                         "f:ceIPSecNATTPort": {},
2021-07-19T00:17:07.8386630Z [cluster2]                         "f:ceIPSecPSK": {},
2021-07-19T00:17:07.8387152Z [cluster2]                         "f:clusterCIDR": {},
2021-07-19T00:17:07.8387655Z [cluster2]                         "f:clusterID": {},
2021-07-19T00:17:07.8388290Z [cluster2]                         "f:colorCodes": {},
2021-07-19T00:17:07.8388899Z [cluster2]                         "f:connectionHealthCheck": {
2021-07-19T00:17:07.8389446Z [cluster2]                             ".": {},
2021-07-19T00:17:07.8389929Z [cluster2]                             "f:enabled": {},
2021-07-19T00:17:07.8390676Z [cluster2]                             "f:intervalSeconds": {},
2021-07-19T00:17:07.8391282Z [cluster2]                             "f:maxPacketLossCount": {}
2021-07-19T00:17:07.8391906Z [cluster2]                         },
2021-07-19T00:17:07.8392319Z [cluster2]                         "f:debug": {},
2021-07-19T00:17:07.8392791Z [cluster2]                         "f:globalCIDR": {},
2021-07-19T00:17:07.8393268Z [cluster2]                         "f:namespace": {},
2021-07-19T00:17:07.8393767Z [cluster2]                         "f:natEnabled": {},
2021-07-19T00:17:07.8394248Z [cluster2]                         "f:repository": {},
2021-07-19T00:17:07.8394763Z [cluster2]                         "f:serviceCIDR": {},
2021-07-19T00:17:07.8395403Z [cluster2]                         "f:serviceDiscoveryEnabled": {},
2021-07-19T00:17:07.8395995Z [cluster2]                         "f:version": {}
2021-07-19T00:17:07.8396417Z [cluster2]                     }
2021-07-19T00:17:07.8396779Z [cluster2]                 },
2021-07-19T00:17:07.8397208Z [cluster2]                 "manager": "subctl",
2021-07-19T00:17:07.8397802Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:07.8398763Z [cluster2]                 "time": "2021-07-19T00:15:55Z"
2021-07-19T00:17:07.8399163Z [cluster2]             },
2021-07-19T00:17:07.8399528Z [cluster2]             {
2021-07-19T00:17:07.8400043Z [cluster2]                 "apiVersion": "submariner.io/v1alpha1",
2021-07-19T00:17:07.8400659Z [cluster2]                 "fieldsType": "FieldsV1",
2021-07-19T00:17:07.8403396Z [cluster2]                 "fieldsV1": {
2021-07-19T00:17:07.8403854Z [cluster2]                     "f:status": {
2021-07-19T00:17:07.8404272Z [cluster2]                         ".": {},
2021-07-19T00:17:07.8404712Z [cluster2]                         "f:clusterCIDR": {},
2021-07-19T00:17:07.8405519Z [cluster2]                         "f:clusterID": {},
2021-07-19T00:17:07.8406014Z [cluster2]                         "f:colorCodes": {},
2021-07-19T00:17:07.8406673Z [cluster2]                         "f:deploymentInfo": {},
2021-07-19T00:17:07.8407308Z [cluster2]                         "f:gatewayDaemonSetStatus": {
2021-07-19T00:17:07.8407885Z [cluster2]                             ".": {},
2021-07-19T00:17:07.8408932Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.8409669Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.8410554Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.8411149Z [cluster2]                             "f:status": {
2021-07-19T00:17:07.8411583Z [cluster2]                                 ".": {},
2021-07-19T00:17:07.8412149Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.8412894Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.8413551Z [cluster2]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.8414177Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.8414764Z [cluster2]                                 "f:numberReady": {},
2021-07-19T00:17:07.8415347Z [cluster2]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.8416054Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.8416608Z [cluster2]                             }
2021-07-19T00:17:07.8417001Z [cluster2]                         },
2021-07-19T00:17:07.8417421Z [cluster2]                         "f:gateways": {},
2021-07-19T00:17:07.8418020Z [cluster2]                         "f:globalCIDR": {},
2021-07-19T00:17:07.8418650Z [cluster2]                         "f:globalnetDaemonSetStatus": {
2021-07-19T00:17:07.8419244Z [cluster2]                             ".": {},
2021-07-19T00:17:07.8419785Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.8420512Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.8421295Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.8421889Z [cluster2]                             "f:status": {
2021-07-19T00:17:07.8422312Z [cluster2]                                 ".": {},
2021-07-19T00:17:07.8422879Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.8423625Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.8424287Z [cluster2]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.8424898Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.8425489Z [cluster2]                                 "f:numberReady": {},
2021-07-19T00:17:07.8426072Z [cluster2]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.8426768Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.8427323Z [cluster2]                             }
2021-07-19T00:17:07.8427715Z [cluster2]                         },
2021-07-19T00:17:07.8428218Z [cluster2]                         "f:loadBalancerStatus": {},
2021-07-19T00:17:07.8428866Z [cluster2]                         "f:natEnabled": {},
2021-07-19T00:17:07.8429386Z [cluster2]                         "f:networkPlugin": {},
2021-07-19T00:17:07.8430056Z [cluster2]                         "f:routeAgentDaemonSetStatus": {
2021-07-19T00:17:07.8430663Z [cluster2]                             ".": {},
2021-07-19T00:17:07.8431186Z [cluster2]                             "f:lastResourceVersion": {},
2021-07-19T00:17:07.8431934Z [cluster2]                             "f:mismatchedContainerImages": {},
2021-07-19T00:17:07.8432706Z [cluster2]                             "f:nonReadyContainerStates": {},
2021-07-19T00:17:07.8433311Z [cluster2]                             "f:status": {
2021-07-19T00:17:07.8433728Z [cluster2]                                 ".": {},
2021-07-19T00:17:07.8434303Z [cluster2]                                 "f:currentNumberScheduled": {},
2021-07-19T00:17:07.8435047Z [cluster2]                                 "f:desiredNumberScheduled": {},
2021-07-19T00:17:07.8435705Z [cluster2]                                 "f:numberAvailable": {},
2021-07-19T00:17:07.8436320Z [cluster2]                                 "f:numberMisscheduled": {},
2021-07-19T00:17:07.8436897Z [cluster2]                                 "f:numberReady": {},
2021-07-19T00:17:07.8437481Z [cluster2]                                 "f:observedGeneration": {},
2021-07-19T00:17:07.8438992Z [cluster2]                                 "f:updatedNumberScheduled": {}
2021-07-19T00:17:07.8439574Z [cluster2]                             }
2021-07-19T00:17:07.8439964Z [cluster2]                         },
2021-07-19T00:17:07.8440407Z [cluster2]                         "f:serviceCIDR": {}
2021-07-19T00:17:07.8440850Z [cluster2]                     }
2021-07-19T00:17:07.8441212Z [cluster2]                 },
2021-07-19T00:17:07.8442394Z [cluster2]                 "manager": "submariner-operator",
2021-07-19T00:17:07.8443040Z [cluster2]                 "operation": "Update",
2021-07-19T00:17:07.8443697Z [cluster2]                 "time": "2021-07-19T00:16:32Z"
2021-07-19T00:17:07.8444096Z [cluster2]             }
2021-07-19T00:17:07.8444464Z [cluster2]         ],
2021-07-19T00:17:07.8444883Z [cluster2]         "name": "submariner",
2021-07-19T00:17:07.8445630Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T00:17:07.8446265Z [cluster2]         "resourceVersion": "2141",
2021-07-19T00:17:07.8454508Z [cluster2]         "selfLink": "/apis/submariner.io/v1alpha1/namespaces/submariner-operator/submariners/submariner",
2021-07-19T00:17:07.8455911Z [cluster2]         "uid": "cd6abfa2-5043-489c-acf8-3432d9712bf3"
2021-07-19T00:17:07.8456518Z [cluster2]     },
2021-07-19T00:17:07.8456895Z [cluster2]     "spec": {
2021-07-19T00:17:07.8457299Z [cluster2]         "broker": "k8s",
2021-07-19T00:17:07.8458036Z [cluster2]         "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-19T00:17:07.8602991Z [cluster2]         "brokerK8sApiServerToken": "***",
2021-07-19T00:17:07.9164407Z [cluster2]         "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T00:17:07.9665953Z [cluster2]         "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T00:17:07.9666812Z [cluster2]         "cableDriver": "libreswan",
2021-07-19T00:17:07.9667378Z [cluster2]         "ceIPSecDebug": false,
2021-07-19T00:17:07.9667923Z [cluster2]         "ceIPSecIKEPort": 500,
2021-07-19T00:17:07.9674043Z [cluster2]         "ceIPSecNATTPort": 4500,
2021-07-19T00:17:07.9675474Z [cluster2]         "ceIPSecPSK": "GAU/Z8F0KP44xa82c+Snji3x5FXnlzWZq0dnfY0s4XvrhEBlnB9HcRM773IjEGcN",
2021-07-19T00:17:07.9676724Z [cluster2]         "clusterCIDR": "",
2021-07-19T00:17:07.9677222Z [cluster2]         "clusterID": "cluster2",
2021-07-19T00:17:07.9677733Z [cluster2]         "colorCodes": "blue",
2021-07-19T00:17:07.9678309Z [cluster2]         "connectionHealthCheck": {
2021-07-19T00:17:07.9678880Z [cluster2]             "enabled": true,
2021-07-19T00:17:07.9679534Z [cluster2]             "intervalSeconds": 1,
2021-07-19T00:17:07.9680115Z [cluster2]             "maxPacketLossCount": 5
2021-07-19T00:17:07.9680586Z [cluster2]         },
2021-07-19T00:17:07.9681002Z [cluster2]         "debug": false,
2021-07-19T00:17:07.9681465Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-19T00:17:07.9682454Z [cluster2]         "namespace": "submariner-operator",
2021-07-19T00:17:07.9683072Z [cluster2]         "natEnabled": false,
2021-07-19T00:17:07.9683591Z [cluster2]         "repository": "localhost:5000",
2021-07-19T00:17:07.9684120Z [cluster2]         "serviceCIDR": "",
2021-07-19T00:17:07.9684733Z [cluster2]         "serviceDiscoveryEnabled": true,
2021-07-19T00:17:07.9685364Z [cluster2]         "version": "local"
2021-07-19T00:17:07.9685766Z [cluster2]     },
2021-07-19T00:17:07.9686156Z [cluster2]     "status": {
2021-07-19T00:17:07.9686702Z [cluster2]         "clusterCIDR": "10.0.0.0/16",
2021-07-19T00:17:07.9687221Z [cluster2]         "clusterID": "cluster2",
2021-07-19T00:17:07.9687726Z [cluster2]         "colorCodes": "blue",
2021-07-19T00:17:07.9688253Z [cluster2]         "deploymentInfo": {},
2021-07-19T00:17:07.9689137Z [cluster2]         "gatewayDaemonSetStatus": {
2021-07-19T00:17:07.9689811Z [cluster2]             "lastResourceVersion": "1940",
2021-07-19T00:17:07.9690586Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T00:17:07.9691359Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T00:17:07.9691941Z [cluster2]             "status": {
2021-07-19T00:17:07.9692503Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-19T00:17:07.9693230Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-19T00:17:07.9693864Z [cluster2]                 "numberAvailable": 1,
2021-07-19T00:17:07.9694455Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T00:17:07.9695014Z [cluster2]                 "numberReady": 1,
2021-07-19T00:17:07.9695558Z [cluster2]                 "observedGeneration": 1,
2021-07-19T00:17:07.9696224Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-19T00:17:07.9696752Z [cluster2]             }
2021-07-19T00:17:07.9697117Z [cluster2]         },
2021-07-19T00:17:07.9697506Z [cluster2]         "gateways": [
2021-07-19T00:17:07.9697904Z [cluster2]             {
2021-07-19T00:17:07.9698320Z [cluster2]                 "connections": [
2021-07-19T00:17:07.9698755Z [cluster2]                     {
2021-07-19T00:17:07.9699164Z [cluster2]                         "endpoint": {
2021-07-19T00:17:07.9699662Z [cluster2]                             "backend": "libreswan",
2021-07-19T00:17:07.9700164Z [cluster2]                             "backend_config": {
2021-07-19T00:17:07.9701031Z [cluster2]                                 "natt-discovery-port": "4490",
2021-07-19T00:17:07.9701841Z [cluster2]                                 "preferred-server": "false"
2021-07-19T00:17:07.9702348Z [cluster2]                             },
2021-07-19T00:17:07.9703302Z [cluster2]                             "cable_name": "submariner-cable-cluster1-172-18-0-6",
2021-07-19T00:17:07.9704127Z [cluster2]                             "cluster_id": "cluster1",
2021-07-19T00:17:07.9704684Z [cluster2]                             "healthCheckIP": "242.254.1.254",
2021-07-19T00:17:07.9705439Z [cluster2]                             "hostname": "cluster1-worker",
2021-07-19T00:17:07.9706023Z [cluster2]                             "nat_enabled": false,
2021-07-19T00:17:07.9713802Z [cluster2]                             "private_ip": "172.18.0.6",
2021-07-19T00:17:07.9714717Z [cluster2]                             "public_ip": "20.98.240.91",
2021-07-19T00:17:07.9715365Z [cluster2]                             "subnets": [
2021-07-19T00:17:07.9715972Z [cluster2]                                 "242.254.1.0/24"
2021-07-19T00:17:07.9716532Z [cluster2]                             ]
2021-07-19T00:17:07.9717075Z [cluster2]                         },
2021-07-19T00:17:07.9717663Z [cluster2]                         "latencyRTT": {
2021-07-19T00:17:07.9718701Z [cluster2]                             "average": "168.926µs",
2021-07-19T00:17:07.9719547Z [cluster2]                             "last": "188.502µs",
2021-07-19T00:17:07.9720424Z [cluster2]                             "max": "468.104µs",
2021-07-19T00:17:07.9721769Z [cluster2]                             "min": "109.7µs",
2021-07-19T00:17:07.9722530Z [cluster2]                             "stdDev": "61.954µs"
2021-07-19T00:17:07.9723101Z [cluster2]                         },
2021-07-19T00:17:07.9723671Z [cluster2]                         "status": "connected",
2021-07-19T00:17:07.9724316Z [cluster2]                         "statusMessage": "",
2021-07-19T00:17:07.9724950Z [cluster2]                         "usingIP": "172.18.0.6"
2021-07-19T00:17:07.9725484Z [cluster2]                     }
2021-07-19T00:17:07.9725971Z [cluster2]                 ],
2021-07-19T00:17:07.9726739Z [cluster2]                 "haStatus": "active",
2021-07-19T00:17:07.9736085Z [cluster2]                 "localEndpoint": {
2021-07-19T00:17:07.9737870Z [cluster2]                     "backend": "libreswan",
2021-07-19T00:17:07.9747833Z [cluster2]                     "backend_config": {
2021-07-19T00:17:07.9749205Z [cluster2]                         "natt-discovery-port": "4490",
2021-07-19T00:17:07.9750206Z [cluster2]                         "preferred-server": "false"
2021-07-19T00:17:07.9750835Z [cluster2]                     },
2021-07-19T00:17:07.9751893Z [cluster2]                     "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-19T00:17:07.9752852Z [cluster2]                     "cluster_id": "cluster2",
2021-07-19T00:17:07.9753706Z [cluster2]                     "hostname": "cluster2-worker",
2021-07-19T00:17:07.9754375Z [cluster2]                     "nat_enabled": false,
2021-07-19T00:17:07.9754985Z [cluster2]                     "private_ip": "172.18.0.5",
2021-07-19T00:17:07.9755567Z [cluster2]                     "public_ip": "20.98.240.91",
2021-07-19T00:17:07.9756138Z [cluster2]                     "subnets": [
2021-07-19T00:17:07.9756675Z [cluster2]                         "242.254.2.0/24"
2021-07-19T00:17:07.9757153Z [cluster2]                     ]
2021-07-19T00:17:07.9757635Z [cluster2]                 },
2021-07-19T00:17:07.9758195Z [cluster2]                 "statusFailure": "",
2021-07-19T00:17:07.9759005Z [cluster2]                 "version": "devel-1441a80"
2021-07-19T00:17:07.9759577Z [cluster2]             }
2021-07-19T00:17:07.9760037Z [cluster2]         ],
2021-07-19T00:17:07.9760557Z [cluster2]         "globalCIDR": "242.254.2.0/24",
2021-07-19T00:17:07.9761289Z [cluster2]         "globalnetDaemonSetStatus": {
2021-07-19T00:17:07.9762223Z [cluster2]             "lastResourceVersion": "1975",
2021-07-19T00:17:07.9763046Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T00:17:07.9763933Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T00:17:07.9764604Z [cluster2]             "status": {
2021-07-19T00:17:07.9765279Z [cluster2]                 "currentNumberScheduled": 1,
2021-07-19T00:17:07.9766101Z [cluster2]                 "desiredNumberScheduled": 1,
2021-07-19T00:17:07.9767013Z [cluster2]                 "numberAvailable": 1,
2021-07-19T00:17:07.9767719Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T00:17:07.9768363Z [cluster2]                 "numberReady": 1,
2021-07-19T00:17:07.9769035Z [cluster2]                 "observedGeneration": 1,
2021-07-19T00:17:07.9769806Z [cluster2]                 "updatedNumberScheduled": 1
2021-07-19T00:17:07.9770461Z [cluster2]             }
2021-07-19T00:17:07.9770926Z [cluster2]         },
2021-07-19T00:17:07.9771528Z [cluster2]         "loadBalancerStatus": {},
2021-07-19T00:17:07.9772213Z [cluster2]         "natEnabled": false,
2021-07-19T00:17:07.9773074Z [cluster2]         "networkPlugin": "weave-net",
2021-07-19T00:17:07.9773898Z [cluster2]         "routeAgentDaemonSetStatus": {
2021-07-19T00:17:07.9774712Z [cluster2]             "lastResourceVersion": "1929",
2021-07-19T00:17:07.9775561Z [cluster2]             "mismatchedContainerImages": false,
2021-07-19T00:17:07.9776428Z [cluster2]             "nonReadyContainerStates": [],
2021-07-19T00:17:07.9777123Z [cluster2]             "status": {
2021-07-19T00:17:07.9777784Z [cluster2]                 "currentNumberScheduled": 3,
2021-07-19T00:17:07.9778612Z [cluster2]                 "desiredNumberScheduled": 3,
2021-07-19T00:17:07.9779360Z [cluster2]                 "numberAvailable": 3,
2021-07-19T00:17:07.9780041Z [cluster2]                 "numberMisscheduled": 0,
2021-07-19T00:17:07.9780701Z [cluster2]                 "numberReady": 3,
2021-07-19T00:17:07.9781369Z [cluster2]                 "observedGeneration": 1,
2021-07-19T00:17:07.9782136Z [cluster2]                 "updatedNumberScheduled": 3
2021-07-19T00:17:07.9782785Z [cluster2]             }
2021-07-19T00:17:07.9783242Z [cluster2]         },
2021-07-19T00:17:07.9783773Z [cluster2]         "serviceCIDR": "100.0.0.0/16"
2021-07-19T00:17:07.9784311Z [cluster2]     }
2021-07-19T00:17:07.9784773Z [cluster2] }
2021-07-19T00:17:07.9785886Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-19T00:17:07.9787526Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-19T00:17:07.9789155Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-19T00:17:07.9790690Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T00:17:07.9792043Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T00:17:08.1763621Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-19T00:17:08.1764870Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-19T00:17:08.1765880Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-19T00:17:08.1767570Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-19T00:17:08.1768788Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-19T00:17:08.1769911Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-19T00:17:08.1771170Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-19T00:17:08.1772579Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-19T00:17:08.1773881Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-19T00:17:08.1775500Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-19T00:17:08.1928220Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T00:17:08.2139822Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T00:17:08.2141796Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-19T00:17:08.2375203Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWStates": [],
2021-07-19T00:17:08.2546798Z [cluster1]             "status": {
2021-07-19T00:17:08.2547431Z [cluster1]                 "currentNumberScheduled": 1,
2021-07-19T00:17:08.2548156Z [cluster1]                 "desiredNumberScheduled": 1,
2021-07-19T00:17:08.2548797Z [cluster1]                 "numberAvailable": 1,
2021-07-19T00:17:08.2549376Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T00:17:08.2549935Z [cluster1]                 "numberReady": 1,
2021-07-19T00:17:08.2550476Z [cluster1]                 "observedGeneration": 1,
2021-07-19T00:17:08.2551168Z [cluster1]                 "updatedNumberScheduled": 1
2021-07-19T00:17:08.2551695Z [cluster1]             }
2021-07-19T00:17:08.2552063Z [cluster1]         },
2021-07-19T00:17:08.2552550Z [cluster1]         "loadBalancerStatus": {},
2021-07-19T00:17:08.2553097Z [cluster1]         "natEnabled": false,
2021-07-19T00:17:08.2554200Z [cluster1]         "networkPlugin": "weave-net",
2021-07-19T00:17:08.2554885Z [cluster1]         "routeAgentDaemonSetStatus": {
2021-07-19T00:17:08.2555917Z [cluster1]             "lastResourceVersion": "1933",
2021-07-19T00:17:08.2556648Z [cluster1]             "mismatchedContainerImages": false,
2021-07-19T00:17:08.2557427Z [cluster1]             "nonReadyContainerStates": [],
2021-07-19T00:17:08.2557990Z [cluster1]             "status": {
2021-07-19T00:17:08.2558557Z [cluster1]                 "currentNumberScheduled": 3,
2021-07-19T00:17:08.2559260Z [cluster1]                 "desiredNumberScheduled": 3,
2021-07-19T00:17:08.2559901Z [cluster1]                 "numberAvailable": 3,
2021-07-19T00:17:08.2560500Z [cluster1]                 "numberMisscheduled": 0,
2021-07-19T00:17:08.2561041Z [cluster1]                 "numberReady": 3,
2021-07-19T00:17:08.2561598Z [cluster1]                 "observedGeneration": 1,
2021-07-19T00:17:08.2562248Z [cluster1]                 "updatedNumberScheduled": 3
2021-07-19T00:17:08.2562795Z [cluster1]             }
2021-07-19T00:17:08.2563149Z [cluster1]         },
2021-07-19T00:17:08.2563584Z [cluster1]         "serviceCIDR": "100.0.0.0/16"
2021-07-19T00:17:08.2564006Z [cluster1]     }
2021-07-19T00:17:08.2564357Z [cluster1] }
2021-07-19T00:17:08.2565356Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-19T00:17:08.2566875Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-19T00:17:08.2568316Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-19T00:17:08.2569753Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T00:17:08.2570984Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T00:17:08.2572228Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-19T00:17:08.2573391Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-19T00:17:08.2574419Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-19T00:17:08.2575547Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-19T00:17:08.2576739Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-19T00:17:08.2577855Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-19T00:17:08.2579100Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-19T00:17:08.2585225Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-19T00:17:08.2586861Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-19T00:17:08.2588316Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-19T00:17:08.2752187Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T00:17:08.3454440Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T00:17:08.3456584Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-19T00:17:08.4020665Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:17:08.4986511Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:17:08.5501189Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-19T00:17:08.6214116Z [submariURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:17:08.6931389Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEF3TURrME9Wb1hEVE14TURjeE56QXdNRGswT1Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTDdGCllhcE0vQ08rd3FUQ2d2WFVlTEFhL2kxalRrWFF1K0pZVnk1OXpKU1crdUVQVkp2M1ZwcHRiNWI4ZnhlWU5QVnoKZFZQSXdBS1V6WkJZbVpFbTJ1Y0drQ3lzQ21ZM21DcUJDMmxSTFZaQnJCY1hoeTlydjBUTi9uYktiRFRYRExZVApFbFVqNkFaQmgxbUFtdVl3cjBpQXJJa3Q4SktpRk1LMHM2dVUvVGJTaDhmTTBsbldMOGZlbGJRS3g1UTJ3UXhjCllaNjdQOEZ3Y2dQcVRnd1paWlozRkp1MmFjZUpwV0hFT3JpNWFBYVA1T3BySDVOQ0F1VzVNM2lKU1QvV0RrQlQKMUJ0WmtrNmJzdllDdllzUmV2R2NHYjJKQ0tHMFBGQmxlNWpnVUNJUWxBNlBCaFZnUWZuNVBXQmFGWFVCOHlydwpIRjVnNVFGbUNkZThNekVzWXdFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZNc3dpSVk2Sk1INFNNUDM5Z3M0U1ZxdGZ4YWJNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFDeVZsREc3TmxLTFpFTXFmOUJnc0c1YkFOYVhLZGErR2xTVFR6L1l6N3pMZEhtZjhqeApmRlA2cWIvWjM5SmZBVlFkL3l2eWtoZHF0K0R1YXNjb2dSd2lHUzR4MVJBaVRpRmNBTGV5bThlZ2Jwem9SVWYxCkxaT0dHSEtxdmJ1K2FCTTIyQ0RxZ0JsSUtPT2FJM3l0OVo1emM2MWVJYWZzb05VbGM2YUExcTdLSVorcXlHdGIKd2lSNkp1Si95cVphRUJWL1Z3dCtZeHVmRnBQc2s4MUdnenZrVkVuZnFydzJzbGQ5UUJLb2doMGxidWhCU1ZoTQpTYmZpRjIxUzNUQXhYamMvMmlsVVAvNlY0dEZXS0txK29ibWk3SmpLamsxc2JpU25YTW92cElZT0dBTVBjcnBLCmZicHphNElIRTJyMGcvTHlqSmx0K0tiTUtDeTlpTFRCNVdLUgotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T00:17:08.7388571Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7390199Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T00:17:08.7391918Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T00:17:08.7393652Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7395070Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-19T00:17:08.7396244Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-19T00:17:08.7397534Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7398837Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T00:17:08.7400298Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T00:17:08.7401639Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7402978Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T00:17:08.7404161Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T00:17:08.7405528Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7406950Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-19T00:17:08.7408119Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-19T00:17:08.7409393Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7410585Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-19T00:17:08.7411643Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-19T00:17:08.7412820Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-19T00:17:08.7413986Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-19T00:17:08.7414984Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-19T00:17:09.3469059Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /ner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T00:17:09.3471139Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T00:17:09.3472862Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3474309Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-19T00:17:09.3475478Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-19T00:17:09.3476791Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3478093Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T00:17:09.3479459Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T00:17:09.3480816Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3482133Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T00:17:09.3483327Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T00:17:09.3484814Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3486251Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-19T00:17:09.3488141Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-19T00:17:09.3489408Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3490612Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-19T00:17:09.3491651Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-19T00:17:09.3492922Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3494086Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-19T00:17:09.3495100Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-19T00:17:09.3496299Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3497788Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3498658Z [cluster1] Generated cluster id: cluster1
2021-07-19T00:17:09.3499567Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-19T00:17:09.3500665Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-19T00:17:09.3501900Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3503106Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-19T00:17:09.3504130Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-19T00:17:09.3505285Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3506584Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-19T00:17:09.3507882Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-19T00:17:09.3509213Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3510438Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-19T00:17:09.3511528Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-19T00:17:09.3512776Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-19T00:17:09.3513933Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-19T00:17:09.3514920Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-19T00:17:09.3515898Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-19T00:17:09.3516893Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-19T00:17:09.3517806Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T00:17:09.3518617Z [submariner-operator]$ [cluster1] wait 8713
2021-07-19T00:17:09.3519465Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-19T00:17:09.3520349Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-19T00:17:09.3521247Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-19T00:17:09.3522200Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-19T00:17:09.3523284Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-19T00:17:09.3524095Z [cluster1] 
2021-07-19T00:17:09.3524689Z [cluster1] 
2021-07-19T00:17:09.3525828Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:09.6581277Z [submariner-opetmp/submariner.cluster2.json
2021-07-19T00:17:09.6582811Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6583785Z [cluster2] Generated cluster id: cluster2
2021-07-19T00:17:09.6584830Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-19T00:17:09.6586156Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-19T00:17:09.6587513Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6588829Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-19T00:17:09.6589961Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-19T00:17:09.6591223Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6592638Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-19T00:17:09.6594313Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-19T00:17:09.6595767Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6597114Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-19T00:17:09.6598317Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-19T00:17:09.6599684Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6600974Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-19T00:17:09.6602542Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-19T00:17:09.6603659Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-19T00:17:09.6604662Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-19T00:17:09.6605572Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:17:09.6606581Z [submariner-operator]$ [cluster2] wait 8688
2021-07-19T00:17:09.6607446Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-19T00:17:09.6608337Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-19T00:17:09.6609217Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-19T00:17:09.6610114Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-19T00:17:09.6611165Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-19T00:17:09.6611989Z [cluster2] 
2021-07-19T00:17:09.6612464Z [cluster2] 
2021-07-19T00:17:09.6613599Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T00:17:09.6614987Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-19T00:17:09.6616147Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-19T00:17:09.6617510Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6618804Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-19T00:17:09.6619931Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-19T00:17:09.6621380Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-19T00:17:09.6622487Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:17:09.6623397Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:17:09.6624298Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-19T00:17:09.6625304Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-19T00:17:09.6626537Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T00:17:09.6627994Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T00:17:09.6629234Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-19T00:17:09.6630336Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-19T00:17:09.6631401Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-19T00:17:09.6632396Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-19T00:17:09.6633312Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:17:09.6634192Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-19T00:17:09.6635169Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-19T00:17:09.6635847Z [cluster2] 
2021-07-19T00:17:09.6636490Z [submariner-operator]$ [cluster2] wait 8753
2021-07-19T00:17:09.6637394Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:17:09.6638317Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-19T00:17:09.6639341Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-19T00:17:09.6640250Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T00:17:09.6641070Z [submariner-operator]$ [cluster2] wait 8799
2021-07-19T00:17:10.8927893Z [submarinerator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-19T00:17:10.8929570Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.0.0.0/16
2021-07-19T00:17:10.8931048Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-19T00:17:10.8932467Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-19T00:17:10.8933758Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.0.0.0/16
2021-07-19T00:17:10.8935197Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-19T00:17:10.8936417Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:17:10.8937356Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:17:10.8938392Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-19T00:17:10.8939539Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-19T00:17:10.8940877Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T00:17:10.8942364Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T00:17:10.8943845Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-19T00:17:10.8945197Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-19T00:17:10.8946388Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-19T00:17:10.8947677Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-19T00:17:10.8949465Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T00:17:10.8950297Z [submariner-operator]$ [cluster1] wait 8781
2021-07-19T00:17:10.8951149Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-19T00:17:10.8952239Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-19T00:17:10.8953041Z [cluster1] 
2021-07-19T00:17:10.8953686Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:17:10.8954620Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-19T00:17:10.8955631Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-19T00:17:10.8956551Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T00:17:10.8957366Z [submariner-operator]$ [cluster1] wait 8818
2021-07-19T00:17:10.8958229Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-19T00:17:10.8959152Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-19T00:17:10.8960560Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:10.8962411Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:10.8964361Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:10.8966152Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:10.8967840Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:10.8969635Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:10.8970877Z [submariner-operator]$ [cluster1] return 0
2021-07-19T00:17:10.8971734Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-19T00:17:10.8972658Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-19T00:17:10.8974077Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T00:17:10.8975850Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T00:17:10.8977764Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T00:17:10.8979191Z [cluster1] pod/submariner-gateway-sw5m7 condition met
2021-07-19T00:17:10.8980624Z [submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T00:17:10.8982482Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:10.8984366Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-19T00:17:11.5277632Z [submariner-operator]$ [cluster1] command kubectl --conr-operator]$ [cluster2] daemonset_deployed
2021-07-19T00:17:11.5278816Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-19T00:17:11.5280529Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:11.5282389Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:11.5284364Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T00:17:11.5286601Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:11.5288385Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:11.5290069Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T00:17:11.5291311Z [submariner-operator]$ [cluster2] return 0
2021-07-19T00:17:11.5292172Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-19T00:17:11.5293107Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-19T00:17:11.5294508Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T00:17:11.5296294Z [submariner-operator]$ [cluster2