Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 29, 2021 19:19
Show Gist options
  • Save dfarrell07/d9639ee5fe5fb44cf2e329af97bb0d3c to your computer and use it in GitHub Desktop.
Save dfarrell07/d9639ee5fe5fb44cf2e329af97bb0d3c to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210724
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-24T00:05:54.0607479Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-24T00:05:54.0607580Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-24T00:06:02.3157384Z Current runner version: '2.278.0'
2021-07-24T00:06:02.3186037Z ##[group]Operating System
2021-07-24T00:06:02.3187094Z Ubuntu
2021-07-24T00:06:02.3187575Z 20.04.2
2021-07-24T00:06:02.3188126Z LTS
2021-07-24T00:06:02.3188636Z ##[endgroup]
2021-07-24T00:06:02.3189350Z ##[group]Virtual Environment
2021-07-24T00:06:02.3190058Z Environment: ubuntu-20.04
2021-07-24T00:06:02.3190719Z Version: 20210718.1
2021-07-24T00:06:02.3191833Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210718.1/images/linux/Ubuntu2004-README.md
2021-07-24T00:06:02.3193406Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210718.1
2021-07-24T00:06:02.3194463Z ##[endgroup]
2021-07-24T00:06:02.3196720Z ##[group]GITHUB_TOKEN Permissions
2021-07-24T00:06:02.3197934Z Actions: write
2021-07-24T00:06:02.3198502Z Checks: write
2021-07-24T00:06:02.3199228Z Contents: write
2021-07-24T00:06:02.3199902Z Deployments: write
2021-07-24T00:06:02.3200733Z Discussions: write
2021-07-24T00:06:02.3201534Z Issues: write
2021-07-24T00:06:02.3202083Z Metadata: read
2021-07-24T00:06:02.3202819Z Packages: write
2021-07-24T00:06:02.3203379Z PullRequests: write
2021-07-24T00:06:02.3204073Z RepositoryProjects: write
2021-07-24T00:06:02.3204756Z SecurityEvents: write
2021-07-24T00:06:02.3205386Z Statuses: write
2021-07-24T00:06:02.3206221Z ##[endgroup]
2021-07-24T00:06:02.3209377Z Prepare workflow directory
2021-07-24T00:06:02.3895566Z Prepare all required actions
2021-07-24T00:06:02.3907567Z Getting action download info
2021-07-24T00:06:02.7783440Z Download action repository 'actions/checkout@v2'
2021-07-24T00:06:04.9245609Z Download action repository 'submariner-io/shipyard@devel'
2021-07-24T00:06:05.3652661Z ##[group]Run actions/checkout@v2
2021-07-24T00:06:05.3653726Z with:
2021-07-24T00:06:05.3654776Z repository: submariner-io/submariner-operator
2021-07-24T00:06:05.3656321Z token: ***
2021-07-24T00:06:05.3656881Z ssh-strict: true
2021-07-24T00:06:05.3657525Z persist-credentials: true
2021-07-24T00:06:05.3658182Z clean: true
2021-07-24T00:06:05.3658709Z fetch-depth: 1
2021-07-24T00:06:05.3659247Z lfs: false
2021-07-24T00:06:05.3659770Z submodules: false
2021-07-24T00:06:05.3660326Z ##[endgroup]
2021-07-24T00:06:05.6074632Z Syncing repository: submariner-io/submariner-operator
2021-07-24T00:06:05.6078561Z ##[group]Getting Git version info
2021-07-24T00:06:05.6080273Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-24T00:06:05.6127489Z [command]/usr/bin/git version
2021-07-24T00:06:05.6267474Z git version 2.32.0
2021-07-24T00:06:05.6289471Z ##[endgroup]
2021-07-24T00:06:05.6297348Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-24T00:06:05.6301085Z ##[group]Initializing the repository
2021-07-24T00:06:05.6305949Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-24T00:06:05.6374298Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-24T00:06:05.6375758Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-24T00:06:05.6376808Z hint: of your new repositories, which will suppress this warning, call:
2021-07-24T00:06:05.6377616Z hint:
2021-07-24T00:06:05.6378609Z hint: git config --global init.defaultBranch <name>
2021-07-24T00:06:05.6379385Z hint:
2021-07-24T00:06:05.6380357Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-24T00:06:05.6381593Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-24T00:06:05.6382422Z hint:
2021-07-24T00:06:05.6383210Z hint: git branch -m <name>
2021-07-24T00:06:05.6392242Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-24T00:06:05.6405544Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-24T00:06:05.6443787Z ##[endgroup]
2021-07-24T00:06:05.6445102Z ##[group]Disabling automatic garbage collection
2021-07-24T00:06:05.6448664Z [command]/usr/bin/git config --local gc.auto 0
2021-07-24T00:06:05.6482312Z ##[endgroup]
2021-07-24T00:06:05.6487072Z ##[group]Setting up auth
2021-07-24T00:06:05.6494210Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-24T00:06:05.6526698Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-24T00:06:05.6895935Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-24T00:06:05.6946392Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-24T00:06:05.7191812Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-24T00:06:05.7232413Z ##[endgroup]
2021-07-24T00:06:05.7234759Z ##[group]Fetching the repository
2021-07-24T00:06:05.7246911Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +43b98298f28d7d8c7cc577948dd89c55a0e7d78d:refs/remotes/origin/devel
2021-07-24T00:06:06.0607253Z remote: Enumerating objects: 485, done.
2021-07-24T00:06:06.0610530Z remote: Counting objects: 0% (1/485)
2021-07-24T00:06:06.0611598Z remote: Counting objects: 1% (5/485)
2021-07-24T00:06:06.0614761Z remote: Counting objects: 2% (10/485)
2021-07-24T00:06:06.0615778Z remote: Counting objects: 3% (15/485)
2021-07-24T00:06:06.0617489Z remote: Counting objects: 4% (20/485)
2021-07-24T00:06:06.1079334Z remote: Counting objects: 5% (25/485)
2021-07-24T00:06:06.1090713Z remote: Counting objects: 6% (30/485)
2021-07-24T00:06:06.1091490Z remote: Counting objects: 7% (34/485)
2021-07-24T00:06:06.1092183Z remote: Counting objects: 8% (39/485)
2021-07-24T00:06:06.1092829Z remote: Counting objects: 9% (44/485)
2021-07-24T00:06:06.1093470Z remote: Counting objects: 10% (49/485)
2021-07-24T00:06:06.1094039Z remote: Counting objects: 11% (54/485)
2021-07-24T00:06:06.1094708Z remote: Counting objects: 12% (59/485)
2021-07-24T00:06:06.1095227Z remote: Counting objects: 13% (64/485)
2021-07-24T00:06:06.1095755Z remote: Counting objects: 14% (68/485)
2021-07-24T00:06:06.1096424Z remote: Counting objects: 15% (73/485)
2021-07-24T00:06:06.1097063Z remote: Counting objects: 16% (78/485)
2021-07-24T00:06:06.1097706Z remote: Counting objects: 17% (83/485)
2021-07-24T00:06:06.1098312Z remote: Counting objects: 18% (88/485)
2021-07-24T00:06:06.1098946Z remote: Counting objects: 19% (93/485)
2021-07-24T00:06:06.1099580Z remote: Counting objects: 20% (97/485)
2021-07-24T00:06:06.1100130Z remote: Counting objects: 21% (102/485)
2021-07-24T00:06:06.1100774Z remote: Counting objects: 22% (107/485)
2021-07-24T00:06:06.1101402Z remote: Counting objects: 23% (112/485)
2021-07-24T00:06:06.1102217Z remote: Counting objects: 24% (117/485)
2021-07-24T00:06:06.1102902Z remote: Counting objects: 25% (122/485)
2021-07-24T00:06:06.1103568Z remote: Counting objects: 26% (127/485)
2021-07-24T00:06:06.1104246Z remote: Counting objects: 27% (131/485)
2021-07-24T00:06:06.1104930Z remote: Counting objects: 28% (136/485)
2021-07-24T00:06:06.1105590Z remote: Counting objects: 29% (141/485)
2021-07-24T00:06:06.1106271Z remote: Counting objects: 30% (146/485)
2021-07-24T00:06:06.1107029Z remote: Counting objects: 31% (151/485)
2021-07-24T00:06:06.1107715Z remote: Counting objects: 32% (156/485)
2021-07-24T00:06:06.1108379Z remote: Counting objects: 33% (161/485)
2021-07-24T00:06:06.1109062Z remote: Counting objects: 34% (165/485)
2021-07-24T00:06:06.1110028Z remote: Counting objects: 35% (170/485)
2021-07-24T00:06:06.1110718Z remote: Counting objects: 36% (175/485)
2021-07-24T00:06:06.1111344Z remote: Counting objects: 37% (180/485)
2021-07-24T00:06:06.1112317Z remote: Counting objects: 38% (185/485)
2021-07-24T00:06:06.1112936Z remote: Counting objects: 39% (190/485)
2021-07-24T00:06:06.1113564Z remote: Counting objects: 40% (194/485)
2021-07-24T00:06:06.1114179Z remote: Counting objects: 41% (199/485)
2021-07-24T00:06:06.1114811Z remote: Counting objects: 42% (204/485)
2021-07-24T00:06:06.1115444Z remote: Counting objects: 43% (209/485)
2021-07-24T00:06:06.1116060Z remote: Counting objects: 44% (214/485)
2021-07-24T00:06:06.1116686Z remote: Counting objects: 45% (219/485)
2021-07-24T00:06:06.1117312Z remote: Counting objects: 46% (224/485)
2021-07-24T00:06:06.1117924Z remote: Counting objects: 47% (228/485)
2021-07-24T00:06:06.1118560Z remote: Counting objects: 48% (233/485)
2021-07-24T00:06:06.1119223Z remote: Counting objects: 49% (238/485)
2021-07-24T00:06:06.1119856Z remote: Counting objects: 50% (243/485)
2021-07-24T00:06:06.1120486Z remote: Counting objects: 51% (248/485)
2021-07-24T00:06:06.1121101Z remote: Counting objects: 52% (253/485)
2021-07-24T00:06:06.1121726Z remote: Counting objects: 53% (258/485)
2021-07-24T00:06:06.1122338Z remote: Counting objects: 54% (262/485)
2021-07-24T00:06:06.1122969Z remote: Counting objects: 55% (267/485)
2021-07-24T00:06:06.1123700Z remote: Counting objects: 56% (272/485)
2021-07-24T00:06:06.1124334Z remote: Counting objects: 57% (277/485)
2021-07-24T00:06:06.1124964Z remote: Counting objects: 58% (282/485)
2021-07-24T00:06:06.1125580Z remote: Counting objects: 59% (287/485)
2021-07-24T00:06:06.1126209Z remote: Counting objects: 60% (291/485)
2021-07-24T00:06:06.1126839Z remote: Counting objects: 61% (296/485)
2021-07-24T00:06:06.1127458Z remote: Counting objects: 62% (301/485)
2021-07-24T00:06:06.1128085Z remote: Counting objects: 63% (306/485)
2021-07-24T00:06:06.1128712Z remote: Counting objects: 64% (311/485)
2021-07-24T00:06:06.1129327Z remote: Counting objects: 65% (316/485)
2021-07-24T00:06:06.1130003Z remote: Counting objects: 66% (321/485)
2021-07-24T00:06:06.1130547Z remote: Counting objects: 67% (325/485)
2021-07-24T00:06:06.1131109Z remote: Counting objects: 68% (330/485)
2021-07-24T00:06:06.1131660Z remote: Counting objects: 69% (335/485)
2021-07-24T00:06:06.1132202Z remote: Counting objects: 70% (340/485)
2021-07-24T00:06:06.1132762Z remote: Counting objects: 71% (345/485)
2021-07-24T00:06:06.1133302Z remote: Counting objects: 72% (350/485)
2021-07-24T00:06:06.1134029Z remote: Counting objects: 73% (355/485)
2021-07-24T00:06:06.1134803Z remote: Counting objects: 74% (359/485)
2021-07-24T00:06:06.1135427Z remote: Counting objects: 75% (364/485)
2021-07-24T00:06:06.1136054Z remote: Counting objects: 76% (369/485)
2021-07-24T00:06:06.1136674Z remote: Counting objects: 77% (374/485)
2021-07-24T00:06:06.1137305Z remote: Counting objects: 78% (379/485)
2021-07-24T00:06:06.1137935Z remote: Counting objects: 79% (384/485)
2021-07-24T00:06:06.1138553Z remote: Counting objects: 80% (388/485)
2021-07-24T00:06:06.1139188Z remote: Counting objects: 81% (393/485)
2021-07-24T00:06:06.1139821Z remote: Counting objects: 82% (398/485)
2021-07-24T00:06:06.1140448Z remote: Counting objects: 83% (403/485)
2021-07-24T00:06:06.1141080Z remote: Counting objects: 84% (408/485)
2021-07-24T00:06:06.1141644Z remote: Counting objects: 85% (413/485)
2021-07-24T00:06:06.1142175Z remote: Counting objects: 86% (418/485)
2021-07-24T00:06:06.1142806Z remote: Counting objects: 87% (422/485)
2021-07-24T00:06:06.1143335Z remote: Counting objects: 88% (427/485)
2021-07-24T00:06:06.1143978Z remote: Counting objects: 89% (432/485)
2021-07-24T00:06:06.1144590Z remote: Counting objects: 90% (437/485)
2021-07-24T00:06:06.1145219Z remote: Counting objects: 91% (442/485)
2021-07-24T00:06:06.1145839Z remote: Counting objects: 92% (447/485)
2021-07-24T00:06:06.1146472Z remote: Counting objects: 93% (452/485)
2021-07-24T00:06:06.1147136Z remote: Counting objects: 94% (456/485)
2021-07-24T00:06:06.1147678Z remote: Counting objects: 95% (461/485)
2021-07-24T00:06:06.1148241Z remote: Counting objects: 96% (466/485)
2021-07-24T00:06:06.1148784Z remote: Counting objects: 97% (471/485)
2021-07-24T00:06:06.1149341Z remote: Counting objects: 98% (476/485)
2021-07-24T00:06:06.1149896Z remote: Counting objects: 99% (481/485)
2021-07-24T00:06:06.1150430Z remote: Counting objects: 100% (485/485)
2021-07-24T00:06:06.1151014Z remote: Counting objects: 100% (485/485), done.
2021-07-24T00:06:06.1151825Z remote: Compressing objects: 0% (1/349)
2021-07-24T00:06:06.1152348Z remote: Compressing objects: 1% (4/349)
2021-07-24T00:06:06.1152875Z remote: Compressing objects: 2% (7/349)
2021-07-24T00:06:06.1153400Z remote: Compressing objects: 3% (11/349)
2021-07-24T00:06:06.1153921Z remote: Compressing objects: 4% (14/349)
2021-07-24T00:06:06.1154685Z remote: Compressing objects: 5% (18/349)
2021-07-24T00:06:06.1155291Z remote: Compressing objects: 6% (21/349)
2021-07-24T00:06:06.1155957Z remote: Compressing objects: 7% (25/349)
2021-07-24T00:06:06.1156571Z remote: Compressing objects: 8% (28/349)
2021-07-24T00:06:06.1157155Z remote: Compressing objects: 9% (32/349)
2021-07-24T00:06:06.1157762Z remote: Compressing objects: 10% (35/349)
2021-07-24T00:06:06.1158366Z remote: Compressing objects: 11% (39/349)
2021-07-24T00:06:06.1158952Z remote: Compressing objects: 12% (42/349)
2021-07-24T00:06:06.1159547Z remote: Compressing objects: 13% (46/349)
2021-07-24T00:06:06.1160133Z remote: Compressing objects: 14% (49/349)
2021-07-24T00:06:06.1160732Z remote: Compressing objects: 15% (53/349)
2021-07-24T00:06:06.1161328Z remote: Compressing objects: 16% (56/349)
2021-07-24T00:06:06.1162146Z remote: Compressing objects: 17% (60/349)
2021-07-24T00:06:06.1162821Z remote: Compressing objects: 18% (63/349)
2021-07-24T00:06:06.1163487Z remote: Compressing objects: 19% (67/349)
2021-07-24T00:06:06.1164164Z remote: Compressing objects: 20% (70/349)
2021-07-24T00:06:06.1164844Z remote: Compressing objects: 21% (74/349)
2021-07-24T00:06:06.1165499Z remote: Compressing objects: 22% (77/349)
2021-07-24T00:06:06.1166183Z remote: Compressing objects: 23% (81/349)
2021-07-24T00:06:06.1166871Z remote: Compressing objects: 24% (84/349)
2021-07-24T00:06:06.1167531Z remote: Compressing objects: 25% (88/349)
2021-07-24T00:06:06.1168216Z remote: Compressing objects: 26% (91/349)
2021-07-24T00:06:06.1169050Z remote: Compressing objects: 27% (95/349)
2021-07-24T00:06:06.1169786Z remote: Compressing objects: 28% (98/349)
2021-07-24T00:06:06.1172942Z remote: Compressing objects: 29% (102/349)
2021-07-24T00:06:06.1173691Z remote: Compressing objects: 30% (105/349)
2021-07-24T00:06:06.1174551Z remote: Compressing objects: 31% (109/349)
2021-07-24T00:06:06.1175312Z remote: Compressing objects: 32% (112/349)
2021-07-24T00:06:06.1176050Z remote: Compressing objects: 33% (116/349)
2021-07-24T00:06:06.1176783Z remote: Compressing objects: 34% (119/349)
2021-07-24T00:06:06.1177504Z remote: Compressing objects: 35% (123/349)
2021-07-24T00:06:06.1178243Z remote: Compressing objects: 36% (126/349)
2021-07-24T00:06:06.1179139Z remote: Compressing objects: 37% (130/349)
2021-07-24T00:06:06.1179863Z remote: Compressing objects: 38% (133/349)
2021-07-24T00:06:06.1180596Z remote: Compressing objects: 39% (137/349)
2021-07-24T00:06:06.1181318Z remote: Compressing objects: 40% (140/349)
2021-07-24T00:06:06.1182055Z remote: Compressing objects: 41% (144/349)
2021-07-24T00:06:06.1182785Z remote: Compressing objects: 42% (147/349)
2021-07-24T00:06:06.1183501Z remote: Compressing objects: 43% (151/349)
2021-07-24T00:06:06.1184231Z remote: Compressing objects: 44% (154/349)
2021-07-24T00:06:06.1184954Z remote: Compressing objects: 45% (158/349)
2021-07-24T00:06:06.1185686Z remote: Compressing objects: 46% (161/349)
2021-07-24T00:06:06.1186411Z remote: Compressing objects: 47% (165/349)
2021-07-24T00:06:06.1187123Z remote: Compressing objects: 48% (168/349)
2021-07-24T00:06:06.1188114Z remote: Compressing objects: 49% (172/349)
2021-07-24T00:06:06.1188846Z remote: Compressing objects: 50% (175/349)
2021-07-24T00:06:06.1189662Z remote: Compressing objects: 51% (178/349)
2021-07-24T00:06:06.1190351Z remote: Compressing objects: 52% (182/349)
2021-07-24T00:06:06.1191199Z remote: Compressing objects: 53% (185/349)
2021-07-24T00:06:06.1191930Z remote: Compressing objects: 54% (189/349)
2021-07-24T00:06:06.1192767Z remote: Compressing objects: 55% (192/349)
2021-07-24T00:06:06.1193435Z remote: Compressing objects: 56% (196/349)
2021-07-24T00:06:06.1194319Z remote: Compressing objects: 57% (199/349)
2021-07-24T00:06:06.1195121Z remote: Compressing objects: 58% (203/349)
2021-07-24T00:06:06.1195870Z remote: Compressing objects: 59% (206/349)
2021-07-24T00:06:06.1196598Z remote: Compressing objects: 60% (210/349)
2021-07-24T00:06:06.1197310Z remote: Compressing objects: 61% (213/349)
2021-07-24T00:06:06.1198050Z remote: Compressing objects: 62% (217/349)
2021-07-24T00:06:06.1198776Z remote: Compressing objects: 63% (220/349)
2021-07-24T00:06:06.1199488Z remote: Compressing objects: 64% (224/349)
2021-07-24T00:06:06.1200223Z remote: Compressing objects: 65% (227/349)
2021-07-24T00:06:06.1200932Z remote: Compressing objects: 66% (231/349)
2021-07-24T00:06:06.1201663Z remote: Compressing objects: 67% (234/349)
2021-07-24T00:06:06.1202395Z remote: Compressing objects: 68% (238/349)
2021-07-24T00:06:06.1203111Z remote: Compressing objects: 69% (241/349)
2021-07-24T00:06:06.1203844Z remote: Compressing objects: 70% (245/349)
2021-07-24T00:06:06.1204563Z remote: Compressing objects: 71% (248/349)
2021-07-24T00:06:06.1205289Z remote: Compressing objects: 72% (252/349)
2021-07-24T00:06:06.1206014Z remote: Compressing objects: 73% (255/349)
2021-07-24T00:06:06.1206826Z remote: Compressing objects: 74% (259/349)
2021-07-24T00:06:06.1207547Z remote: Compressing objects: 75% (262/349)
2021-07-24T00:06:06.1208215Z remote: Compressing objects: 76% (266/349)
2021-07-24T00:06:06.1208895Z remote: Compressing objects: 77% (269/349)
2021-07-24T00:06:06.1209568Z remote: Compressing objects: 78% (273/349)
2021-07-24T00:06:06.1210231Z remote: Compressing objects: 79% (276/349)
2021-07-24T00:06:06.1210912Z remote: Compressing objects: 80% (280/349)
2021-07-24T00:06:06.1211595Z remote: Compressing objects: 81% (283/349)
2021-07-24T00:06:06.1212264Z remote: Compressing objects: 82% (287/349)
2021-07-24T00:06:06.1212948Z remote: Compressing objects: 83% (290/349)
2021-07-24T00:06:06.1213609Z remote: Compressing objects: 84% (294/349)
2021-07-24T00:06:06.1214285Z remote: Compressing objects: 85% (297/349)
2021-07-24T00:06:06.9235797Z remote: Compressing objects: 86% (301/349)
2021-07-24T00:06:06.9355832Z remote: Compressing objects: 87% (304/349)
2021-07-24T00:06:06.9356634Z remote: Compressing objects: 88% (308/349)
2021-07-24T00:06:06.9357551Z remote: Compressing objects: 89% (311/349)
2021-07-24T00:06:06.9358277Z remote: Compressing objects: 90% (315/349)
2021-07-24T00:06:06.9359019Z remote: Compressing objects: 91% (318/349)
2021-07-24T00:06:06.9359743Z remote: Compressing objects: 92% (322/349)
2021-07-24T00:06:06.9360517Z remote: Compressing objects: 93% (325/349)
2021-07-24T00:06:06.9361254Z remote: Compressing objects: 94% (329/349)
2021-07-24T00:06:06.9361991Z remote: Compressing objects: 95% (332/349)
2021-07-24T00:06:06.9362724Z remote: Compressing objects: 96% (336/349)
2021-07-24T00:06:06.9363439Z remote: Compressing objects: 97% (339/349)
2021-07-24T00:06:06.9364176Z remote: Compressing objects: 98% (343/349)
2021-07-24T00:06:06.9364904Z remote: Compressing objects: 99% (346/349)
2021-07-24T00:06:06.9365629Z remote: Compressing objects: 100% (349/349)
2021-07-24T00:06:06.9366392Z remote: Compressing objects: 100% (349/349), done.
2021-07-24T00:06:06.9367102Z Receiving objects: 0% (1/485)
2021-07-24T00:06:06.9367718Z Receiving objects: 1% (5/485)
2021-07-24T00:06:06.9368345Z Receiving objects: 2% (10/485)
2021-07-24T00:06:06.9368953Z Receiving objects: 3% (15/485)
2021-07-24T00:06:06.9369578Z Receiving objects: 4% (20/485)
2021-07-24T00:06:06.9370236Z Receiving objects: 5% (25/485)
2021-07-24T00:06:06.9370841Z Receiving objects: 6% (30/485)
2021-07-24T00:06:06.9371461Z Receiving objects: 7% (34/485)
2021-07-24T00:06:06.9372248Z Receiving objects: 8% (39/485)
2021-07-24T00:06:06.9372893Z Receiving objects: 9% (44/485)
2021-07-24T00:06:06.9373586Z Receiving objects: 10% (49/485)
2021-07-24T00:06:06.9374149Z Receiving objects: 11% (54/485)
2021-07-24T00:06:06.9374974Z Receiving objects: 12% (59/485)
2021-07-24T00:06:06.9375470Z Receiving objects: 13% (64/485)
2021-07-24T00:06:06.9375984Z Receiving objects: 14% (68/485)
2021-07-24T00:06:06.9376487Z Receiving objects: 15% (73/485)
2021-07-24T00:06:06.9376977Z Receiving objects: 16% (78/485)
2021-07-24T00:06:06.9377487Z Receiving objects: 17% (83/485)
2021-07-24T00:06:06.9377985Z Receiving objects: 18% (88/485)
2021-07-24T00:06:06.9378491Z Receiving objects: 19% (93/485)
2021-07-24T00:06:06.9378997Z Receiving objects: 20% (97/485)
2021-07-24T00:06:06.9379491Z Receiving objects: 21% (102/485)
2021-07-24T00:06:06.9380008Z Receiving objects: 22% (107/485)
2021-07-24T00:06:06.9380503Z Receiving objects: 23% (112/485)
2021-07-24T00:06:06.9381209Z Receiving objects: 24% (117/485)
2021-07-24T00:06:06.9381783Z Receiving objects: 25% (122/485)
2021-07-24T00:06:06.9382345Z Receiving objects: 26% (127/485)
2021-07-24T00:06:06.9382923Z Receiving objects: 27% (131/485)
2021-07-24T00:06:06.9383482Z Receiving objects: 28% (136/485)
2021-07-24T00:06:06.9384056Z Receiving objects: 29% (141/485)
2021-07-24T00:06:06.9384642Z Receiving objects: 30% (146/485)
2021-07-24T00:06:06.9385206Z Receiving objects: 31% (151/485)
2021-07-24T00:06:06.9385969Z Receiving objects: 32% (156/485)
2021-07-24T00:06:06.9386570Z Receiving objects: 33% (161/485)
2021-07-24T00:06:06.9387185Z Receiving objects: 34% (165/485)
2021-07-24T00:06:06.9387799Z Receiving objects: 35% (170/485)
2021-07-24T00:06:06.9388399Z Receiving objects: 36% (175/485)
2021-07-24T00:06:06.9389015Z Receiving objects: 37% (180/485)
2021-07-24T00:06:06.9389617Z Receiving objects: 38% (185/485)
2021-07-24T00:06:06.9390236Z Receiving objects: 39% (190/485)
2021-07-24T00:06:06.9390849Z Receiving objects: 40% (194/485)
2021-07-24T00:06:06.9391454Z Receiving objects: 41% (199/485)
2021-07-24T00:06:06.9392071Z Receiving objects: 42% (204/485)
2021-07-24T00:06:06.9392667Z Receiving objects: 43% (209/485)
2021-07-24T00:06:06.9393286Z Receiving objects: 44% (214/485)
2021-07-24T00:06:06.9393900Z Receiving objects: 45% (219/485)
2021-07-24T00:06:06.9394630Z Receiving objects: 46% (224/485)
2021-07-24T00:06:06.9395251Z Receiving objects: 47% (228/485)
2021-07-24T00:06:06.9395851Z Receiving objects: 48% (233/485)
2021-07-24T00:06:06.9396467Z Receiving objects: 49% (238/485)
2021-07-24T00:06:06.9397182Z Receiving objects: 50% (243/485)
2021-07-24T00:06:06.9397739Z Receiving objects: 51% (248/485)
2021-07-24T00:06:06.9398311Z Receiving objects: 52% (253/485)
2021-07-24T00:06:06.9398870Z Receiving objects: 53% (258/485)
2021-07-24T00:06:06.9399446Z Receiving objects: 54% (262/485)
2021-07-24T00:06:06.9400017Z Receiving objects: 55% (267/485)
2021-07-24T00:06:06.9400582Z Receiving objects: 56% (272/485)
2021-07-24T00:06:06.9401161Z Receiving objects: 57% (277/485)
2021-07-24T00:06:06.9401721Z Receiving objects: 58% (282/485)
2021-07-24T00:06:06.9402296Z Receiving objects: 59% (287/485)
2021-07-24T00:06:06.9402868Z Receiving objects: 60% (291/485)
2021-07-24T00:06:06.9403428Z Receiving objects: 61% (296/485)
2021-07-24T00:06:06.9404001Z Receiving objects: 62% (301/485)
2021-07-24T00:06:06.9404563Z Receiving objects: 63% (306/485)
2021-07-24T00:06:06.9405136Z Receiving objects: 64% (311/485)
2021-07-24T00:06:06.9405710Z Receiving objects: 65% (316/485)
2021-07-24T00:06:06.9406271Z Receiving objects: 66% (321/485)
2021-07-24T00:06:06.9406847Z Receiving objects: 67% (325/485)
2021-07-24T00:06:06.9407406Z Receiving objects: 68% (330/485)
2021-07-24T00:06:06.9408160Z Receiving objects: 69% (335/485)
2021-07-24T00:06:06.9408772Z Receiving objects: 70% (340/485)
2021-07-24T00:06:06.9409373Z Receiving objects: 71% (345/485)
2021-07-24T00:06:06.9409989Z Receiving objects: 72% (350/485)
2021-07-24T00:06:06.9410678Z Receiving objects: 73% (355/485)
2021-07-24T00:06:06.9411316Z Receiving objects: 74% (359/485)
2021-07-24T00:06:06.9411929Z Receiving objects: 75% (364/485)
2021-07-24T00:06:06.9412532Z Receiving objects: 76% (369/485)
2021-07-24T00:06:06.9413147Z Receiving objects: 77% (374/485)
2021-07-24T00:06:06.9413745Z Receiving objects: 78% (379/485)
2021-07-24T00:06:06.9414370Z Receiving objects: 79% (384/485)
2021-07-24T00:06:06.9415117Z Receiving objects: 80% (388/485)
2021-07-24T00:06:06.9415729Z Receiving objects: 81% (393/485)
2021-07-24T00:06:06.9416345Z Receiving objects: 82% (398/485)
2021-07-24T00:06:06.9416945Z Receiving objects: 83% (403/485)
2021-07-24T00:06:06.9417569Z Receiving objects: 84% (408/485)
2021-07-24T00:06:06.9418189Z Receiving objects: 85% (413/485)
2021-07-24T00:06:06.9418797Z Receiving objects: 86% (418/485)
2021-07-24T00:06:06.9419414Z Receiving objects: 87% (422/485)
2021-07-24T00:06:06.9420016Z Receiving objects: 88% (427/485)
2021-07-24T00:06:06.9420648Z Receiving objects: 89% (432/485)
2021-07-24T00:06:06.9421271Z Receiving objects: 90% (437/485)
2021-07-24T00:06:06.9421880Z Receiving objects: 91% (442/485)
2021-07-24T00:06:06.9422497Z Receiving objects: 92% (447/485)
2021-07-24T00:06:06.9423871Z remote: Total 485 (delta 152), reused 296 (delta 90), pack-reused 0
2021-07-24T00:06:06.9424654Z Receiving objects: 93% (452/485)
2021-07-24T00:06:06.9425284Z Receiving objects: 94% (456/485)
2021-07-24T00:06:06.9425895Z Receiving objects: 95% (461/485)
2021-07-24T00:06:06.9426511Z Receiving objects: 96% (466/485)
2021-07-24T00:06:06.9427123Z Receiving objects: 97% (471/485)
2021-07-24T00:06:06.9427735Z Receiving objects: 98% (476/485)
2021-07-24T00:06:06.9428354Z Receiving objects: 99% (481/485)
2021-07-24T00:06:06.9428969Z Receiving objects: 100% (485/485)
2021-07-24T00:06:06.9429672Z Receiving objects: 100% (485/485), 349.09 KiB | 12.47 MiB/s, done.
2021-07-24T00:06:06.9430336Z Resolving deltas: 0% (0/152)
2021-07-24T00:06:06.9430949Z Resolving deltas: 1% (2/152)
2021-07-24T00:06:06.9431669Z Resolving deltas: 2% (4/152)
2021-07-24T00:06:06.9432223Z Resolving deltas: 3% (5/152)
2021-07-24T00:06:06.9432787Z Resolving deltas: 4% (7/152)
2021-07-24T00:06:06.9433326Z Resolving deltas: 5% (8/152)
2021-07-24T00:06:06.9433887Z Resolving deltas: 6% (10/152)
2021-07-24T00:06:06.9434449Z Resolving deltas: 7% (11/152)
2021-07-24T00:06:06.9435207Z Resolving deltas: 8% (13/152)
2021-07-24T00:06:06.9435966Z Resolving deltas: 9% (14/152)
2021-07-24T00:06:06.9436592Z Resolving deltas: 10% (16/152)
2021-07-24T00:06:06.9437195Z Resolving deltas: 11% (17/152)
2021-07-24T00:06:06.9437779Z Resolving deltas: 12% (19/152)
2021-07-24T00:06:06.9438458Z Resolving deltas: 13% (20/152)
2021-07-24T00:06:06.9439003Z Resolving deltas: 14% (22/152)
2021-07-24T00:06:06.9439563Z Resolving deltas: 15% (23/152)
2021-07-24T00:06:06.9440120Z Resolving deltas: 16% (25/152)
2021-07-24T00:06:06.9440662Z Resolving deltas: 17% (26/152)
2021-07-24T00:06:06.9441224Z Resolving deltas: 18% (28/152)
2021-07-24T00:06:06.9441768Z Resolving deltas: 19% (29/152)
2021-07-24T00:06:06.9442323Z Resolving deltas: 20% (31/152)
2021-07-24T00:06:06.9442877Z Resolving deltas: 21% (32/152)
2021-07-24T00:06:06.9443615Z Resolving deltas: 22% (34/152)
2021-07-24T00:06:06.9444294Z Resolving deltas: 23% (35/152)
2021-07-24T00:06:06.9444844Z Resolving deltas: 24% (37/152)
2021-07-24T00:06:06.9445409Z Resolving deltas: 25% (38/152)
2021-07-24T00:06:06.9445963Z Resolving deltas: 26% (40/152)
2021-07-24T00:06:06.9446507Z Resolving deltas: 27% (42/152)
2021-07-24T00:06:06.9447065Z Resolving deltas: 28% (43/152)
2021-07-24T00:06:06.9447609Z Resolving deltas: 29% (45/152)
2021-07-24T00:06:06.9448166Z Resolving deltas: 30% (46/152)
2021-07-24T00:06:06.9448913Z Resolving deltas: 31% (48/152)
2021-07-24T00:06:06.9449732Z Resolving deltas: 32% (49/152)
2021-07-24T00:06:06.9450399Z Resolving deltas: 33% (51/152)
2021-07-24T00:06:06.9450943Z Resolving deltas: 34% (52/152)
2021-07-24T00:06:06.9451594Z Resolving deltas: 35% (54/152)
2021-07-24T00:06:06.9452155Z Resolving deltas: 36% (55/152)
2021-07-24T00:06:06.9452882Z Resolving deltas: 37% (57/152)
2021-07-24T00:06:06.9453480Z Resolving deltas: 38% (58/152)
2021-07-24T00:06:06.9454065Z Resolving deltas: 39% (60/152)
2021-07-24T00:06:06.9454801Z Resolving deltas: 40% (61/152)
2021-07-24T00:06:06.9455599Z Resolving deltas: 41% (63/152)
2021-07-24T00:06:06.9456665Z Resolving deltas: 42% (64/152)
2021-07-24T00:06:06.9457681Z Resolving deltas: 43% (66/152)
2021-07-24T00:06:06.9458539Z Resolving deltas: 44% (67/152)
2021-07-24T00:06:06.9459391Z Resolving deltas: 45% (69/152)
2021-07-24T00:06:06.9460316Z Resolving deltas: 46% (70/152)
2021-07-24T00:06:06.9461130Z Resolving deltas: 47% (72/152)
2021-07-24T00:06:06.9462109Z Resolving deltas: 48% (73/152)
2021-07-24T00:06:06.9462966Z Resolving deltas: 49% (75/152)
2021-07-24T00:06:06.9463829Z Resolving deltas: 50% (76/152)
2021-07-24T00:06:06.9464659Z Resolving deltas: 51% (78/152)
2021-07-24T00:06:06.9465540Z Resolving deltas: 52% (80/152)
2021-07-24T00:06:06.9466389Z Resolving deltas: 53% (81/152)
2021-07-24T00:06:06.9467248Z Resolving deltas: 54% (83/152)
2021-07-24T00:06:06.9468098Z Resolving deltas: 55% (84/152)
2021-07-24T00:06:06.9468939Z Resolving deltas: 56% (86/152)
2021-07-24T00:06:06.9469805Z Resolving deltas: 57% (87/152)
2021-07-24T00:06:06.9470644Z Resolving deltas: 58% (89/152)
2021-07-24T00:06:06.9471512Z Resolving deltas: 59% (90/152)
2021-07-24T00:06:06.9472364Z Resolving deltas: 61% (93/152)
2021-07-24T00:06:06.9473223Z Resolving deltas: 62% (95/152)
2021-07-24T00:06:06.9474086Z Resolving deltas: 63% (96/152)
2021-07-24T00:06:06.9474931Z Resolving deltas: 64% (98/152)
2021-07-24T00:06:06.9475828Z Resolving deltas: 65% (99/152)
2021-07-24T00:06:06.9479581Z Resolving deltas: 66% (101/152)
2021-07-24T00:06:06.9482561Z Resolving deltas: 67% (102/152)
2021-07-24T00:06:06.9483372Z Resolving deltas: 68% (104/152)
2021-07-24T00:06:06.9484064Z Resolving deltas: 69% (105/152)
2021-07-24T00:06:06.9484759Z Resolving deltas: 70% (107/152)
2021-07-24T00:06:06.9485426Z Resolving deltas: 71% (108/152)
2021-07-24T00:06:06.9486085Z Resolving deltas: 72% (110/152)
2021-07-24T00:06:06.9486733Z Resolving deltas: 73% (111/152)
2021-07-24T00:06:06.9487568Z Resolving deltas: 74% (113/152)
2021-07-24T00:06:06.9488208Z Resolving deltas: 75% (114/152)
2021-07-24T00:06:06.9488908Z Resolving deltas: 76% (116/152)
2021-07-24T00:06:06.9489402Z Resolving deltas: 77% (118/152)
2021-07-24T00:06:06.9489907Z Resolving deltas: 78% (119/152)
2021-07-24T00:06:06.9490390Z Resolving deltas: 79% (121/152)
2021-07-24T00:06:06.9490885Z Resolving deltas: 80% (122/152)
2021-07-24T00:06:06.9491368Z Resolving deltas: 81% (124/152)
2021-07-24T00:06:06.9491868Z Resolving deltas: 82% (125/152)
2021-07-24T00:06:06.9492369Z Resolving deltas: 83% (127/152)
2021-07-24T00:06:06.9492852Z Resolving deltas: 84% (128/152)
2021-07-24T00:06:06.9493348Z Resolving deltas: 85% (130/152)
2021-07-24T00:06:06.9493839Z Resolving deltas: 86% (131/152)
2021-07-24T00:06:06.9494333Z Resolving deltas: 87% (133/152)
2021-07-24T00:06:06.9495028Z Resolving deltas: 88% (134/152)
2021-07-24T00:06:06.9495527Z Resolving deltas: 89% (136/152)
2021-07-24T00:06:06.9496010Z Resolving deltas: 90% (137/152)
2021-07-24T00:06:06.9496504Z Resolving deltas: 91% (139/152)
2021-07-24T00:06:06.9496994Z Resolving deltas: 92% (140/152)
2021-07-24T00:06:06.9497490Z Resolving deltas: 93% (142/152)
2021-07-24T00:06:06.9497990Z Resolving deltas: 94% (143/152)
2021-07-24T00:06:06.9498475Z Resolving deltas: 95% (145/152)
2021-07-24T00:06:06.9498967Z Resolving deltas: 96% (146/152)
2021-07-24T00:06:06.9499449Z Resolving deltas: 97% (148/152)
2021-07-24T00:06:06.9499944Z Resolving deltas: 98% (149/152)
2021-07-24T00:06:06.9500428Z Resolving deltas: 99% (151/152)
2021-07-24T00:06:06.9500922Z Resolving deltas: 100% (152/152)
2021-07-24T00:06:06.9501428Z Resolving deltas: 100% (152/152), done.
2021-07-24T00:06:06.9502823Z From https://github.com/submariner-io/submariner-operator
2021-07-24T00:06:06.9504154Z * [new ref] 43b98298f28d7d8c7cc577948dd89c55a0e7d78d -> origin/devel
2021-07-24T00:06:06.9505379Z ##[endgroup]
2021-07-24T00:06:06.9505977Z ##[group]Determining the checkout info
2021-07-24T00:06:06.9506510Z ##[endgroup]
2021-07-24T00:06:06.9506995Z ##[group]Checking out the ref
2021-07-24T00:06:06.9507980Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-24T00:06:06.9509170Z Switched to a new branch 'devel'
2021-07-24T00:06:06.9509951Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-24T00:06:06.9510527Z ##[endgroup]
2021-07-24T00:06:06.9511141Z [command]/usr/bin/git log -1 --format='%H'
2021-07-24T00:06:06.9511913Z '43b98298f28d7d8c7cc577948dd89c55a0e7d78d'
2021-07-24T00:06:06.9604769Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-24T00:06:06.9605480Z ##[endgroup]
2021-07-24T00:06:06.9801512Z ##[group]Reclaiming free space
2021-07-24T00:06:19.2653819Z Filesystem Size Used Avail Use% Mounted on
2021-07-24T00:06:19.2668234Z /dev/root 84G 42G 42G 51% /
2021-07-24T00:06:19.2668898Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-24T00:06:19.2669515Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-24T00:06:19.2670091Z tmpfs 696M 1.1M 695M 1% /run
2021-07-24T00:06:19.2670695Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-24T00:06:19.2671383Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-24T00:06:19.2672025Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-24T00:06:19.2672637Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-24T00:06:19.2673257Z /dev/loop2 33M 33M 0 100% /snap/snapd/12159
2021-07-24T00:06:19.2673869Z /dev/loop3 71M 71M 0 100% /snap/lxd/21029
2021-07-24T00:06:19.2674437Z /dev/sda15 105M 7.9M 97M 8% /boot/efi
2021-07-24T00:06:19.2674982Z /dev/loop4 68M 68M 0 100% /snap/lxd/20326
2021-07-24T00:06:19.2675559Z /dev/loop5 33M 33M 0 100% /snap/snapd/12398
2021-07-24T00:06:19.2676087Z /dev/sdb1 14G 4.1G 9.0G 32% /mnt
2021-07-24T00:06:19.2676976Z ##[endgroup]
2021-07-24T00:06:19.2829190Z ##[group]Disable swap
2021-07-24T00:06:19.3285150Z ##[endgroup]
2021-07-24T00:06:19.3439319Z ##[group]Report available RAM
2021-07-24T00:06:19.3469468Z total used free shared buff/cache available
2021-07-24T00:06:19.3470151Z Mem: 6.8Gi 478Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-24T00:06:19.3470709Z Swap: 0B 0B 0B
2021-07-24T00:06:19.3471286Z ##[endgroup]
2021-07-24T00:06:19.3635188Z Downloading Makefile.dapper
2021-07-24T00:06:19.3916989Z Downloading dapper
2021-07-24T00:06:19.5868007Z .dapper.tmp version v0.5.6
2021-07-24T00:06:19.5905555Z Downloading Dockerfile.dapper
2021-07-24T00:06:19.6770224Z docker network create -d bridge kind
2021-07-24T00:06:20.9255290Z 3dfa74b1648b61ce68399c53732c34166866289078f7b699c72f44d12c923953
2021-07-24T00:06:20.9269223Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-24T00:06:20.9270667Z Sending build context to Docker daemon 7.517MB
2021-07-24T00:06:20.9271347Z
2021-07-24T00:06:20.9272176Z Step 1/8 : ARG BASE_BRANCH
2021-07-24T00:06:20.9273483Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-24T00:06:20.9275125Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-24T00:06:20.9276693Z b1495d80d526: Pulling fs layer
2021-07-24T00:06:20.9277980Z 0cd08c770017: Pulling fs layer
2021-07-24T00:06:20.9278576Z 9884fc44d09c: Pulling fs layer
2021-07-24T00:06:20.9279397Z 6bc473dec104: Pulling fs layer
2021-07-24T00:06:20.9280268Z dc52fc659531: Pulling fs layer
2021-07-24T00:06:20.9281240Z b98e33fef4d7: Pulling fs layer
2021-07-24T00:06:20.9282101Z 0351e7a74eeb: Pulling fs layer
2021-07-24T00:06:20.9282648Z 8ae55f3150c3: Pulling fs layer
2021-07-24T00:06:20.9283255Z dc52fc659531: Waiting
2021-07-24T00:06:20.9285298Z b98e33fef4d7: Waiting
2021-07-24T00:06:20.9286652Z 6bc473dec104: Waiting
2021-07-24T00:06:20.9287290Z 0351e7a74eeb: Waiting
2021-07-24T00:06:20.9288103Z 8ae55f3150c3: Waiting
2021-07-24T00:06:21.0905091Z 9884fc44d09c: Verifying Checksum
2021-07-24T00:06:21.0906134Z 9884fc44d09c: Download complete
2021-07-24T00:06:21.2576558Z b1495d80d526: Verifying Checksum
2021-07-24T00:06:21.2577257Z b1495d80d526: Download complete
2021-07-24T00:06:21.2708318Z 6bc473dec104: Verifying Checksum
2021-07-24T00:06:21.2729871Z 6bc473dec104: Download complete
2021-07-24T00:06:21.3344366Z b98e33fef4d7: Verifying Checksum
2021-07-24T00:06:21.3368303Z b98e33fef4d7: Download complete
2021-07-24T00:06:21.3664558Z dc52fc659531: Verifying Checksum
2021-07-24T00:06:21.3689005Z dc52fc659531: Download complete
2021-07-24T00:06:21.4304951Z 0351e7a74eeb: Verifying Checksum
2021-07-24T00:06:21.4305672Z 0351e7a74eeb: Download complete
2021-07-24T00:06:21.4631753Z 8ae55f3150c3: Verifying Checksum
2021-07-24T00:06:21.4632591Z 8ae55f3150c3: Download complete
2021-07-24T00:06:23.6969667Z 0cd08c770017: Verifying Checksum
2021-07-24T00:06:23.6975471Z 0cd08c770017: Download complete
2021-07-24T00:06:24.5443862Z b1495d80d526: Pull complete
2021-07-24T00:06:34.1956311Z 0cd08c770017: Pull complete
2021-07-24T00:06:35.5991115Z 9884fc44d09c: Pull complete
2021-07-24T00:06:35.6762671Z 6bc473dec104: Pull complete
2021-07-24T00:06:35.7390655Z dc52fc659531: Pull complete
2021-07-24T00:06:35.9035492Z b98e33fef4d7: Pull complete
2021-07-24T00:06:35.9734734Z 0351e7a74eeb: Pull complete
2021-07-24T00:06:36.0524703Z 8ae55f3150c3: Pull complete
2021-07-24T00:06:36.0559272Z Digest: sha256:ca3c180cc9c941a68b314fa4ff8c7ab2608aa727a9bb36c01b64c2b262d47a44
2021-07-24T00:06:36.0605152Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-24T00:06:36.0615543Z ---> bcbbdc39e994
2021-07-24T00:06:36.0617527Z Step 3/8 : ARG PROJECT
2021-07-24T00:06:36.0769990Z ---> Running in f1c353223bb4
2021-07-24T00:06:37.0634021Z Removing intermediate container f1c353223bb4
2021-07-24T00:06:37.0846770Z ---> 18b4e78abbd1
2021-07-24T00:06:37.0849042Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-24T00:06:37.0955710Z ---> Running in b8446d3f1dd8
2021-07-24T00:06:38.0500511Z Removing intermediate container b8446d3f1dd8
2021-07-24T00:06:38.0501883Z ---> c9cadefb5afe
2021-07-24T00:06:38.0502564Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-24T00:06:38.0785044Z ---> Running in 297d263ad811
2021-07-24T00:06:39.0524121Z Removing intermediate container 297d263ad811
2021-07-24T00:06:39.0525330Z ---> 1d39dc0dde26
2021-07-24T00:06:39.0525878Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-24T00:06:39.0736704Z ---> Running in 2af5fa897974
2021-07-24T00:06:40.0554109Z Removing intermediate container 2af5fa897974
2021-07-24T00:06:40.0555320Z ---> 098e96b3224a
2021-07-24T00:06:40.0555899Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-24T00:06:40.0717088Z ---> Running in 63e0cc21cf54
2021-07-24T00:06:41.0651886Z Removing intermediate container 63e0cc21cf54
2021-07-24T00:06:41.0653901Z ---> c251b5f033eb
2021-07-24T00:06:41.0654877Z Step 8/8 : CMD ["sh"]
2021-07-24T00:06:41.0909825Z ---> Running in 68e2689143c5
2021-07-24T00:06:42.0542734Z Removing intermediate container 68e2689143c5
2021-07-24T00:06:42.0544012Z ---> 04bb72b0a125
2021-07-24T00:06:42.0697720Z Successfully built 04bb72b0a125
2021-07-24T00:06:42.0727586Z Successfully tagged submariner-operator:devel
2021-07-24T00:06:42.5669847Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-24T00:06:42.5671679Z [submariner-operator]$ mkdir -p bin dist output
2021-07-24T00:06:42.5700006Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-24T00:06:42.5700703Z GNU Make 4.3
2021-07-24T00:06:42.5712550Z Built for x86_64-redhat-linux-gnu
2021-07-24T00:06:42.5713856Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-24T00:06:42.5714899Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-24T00:06:42.5715952Z This is free software: you are free to change and redistribute it.
2021-07-24T00:06:42.5717006Z There is NO WARRANTY, to the extent permitted by law.
2021-07-24T00:06:42.5721890Z Reading makefiles...
2021-07-24T00:06:43.4310388Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-24T00:06:43.4311637Z Updating makefiles....
2021-07-24T00:06:43.4313568Z Updating goal targets....
2021-07-24T00:06:43.4314612Z File 'upgrade-e2e' does not exist.
2021-07-24T00:06:43.4315547Z File 'deploy-latest' does not exist.
2021-07-24T00:06:43.4317620Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-24T00:06:43.4318585Z Must remake target 'deploy-latest'.
2021-07-24T00:06:43.4320211Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-24T00:06:43.4321210Z curl -L get.submariner.io | VERSION=latest bash
2021-07-24T00:06:43.4322678Z Dload Upload Total Spent Left Speed
2021-07-24T00:06:43.4323291Z Installing subctl version latest
2021-07-24T00:06:43.4324352Z
2021-07-24T00:06:43.4324881Z OS detected: linux
2021-07-24T00:06:43.4326367Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-24T00:06:43.4327374Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-24T00:06:43.4327715Z
2021-07-24T00:06:43.4328433Z 100 4155 0 4155 0 0 54671 0 --:--:-- --:--:-- --:--:-- 54671
2021-07-24T00:06:43.4329158Z Architecture detected: amd64
2021-07-24T00:06:43.4330556Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-24T00:06:43.4331456Z
2021-07-24T00:06:43.4331934Z Downloading...
2021-07-24T00:06:44.2556813Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-24T00:06:44.2929755Z This provides subctl version: v0.9.1
2021-07-24T00:06:44.2950536Z
2021-07-24T00:06:44.2951332Z please update your path (and consider adding it to ~/.profile):
2021-07-24T00:06:44.2952047Z export PATH=$PATH:/root/.local/bin
2021-07-24T00:06:44.2952488Z
2021-07-24T00:06:44.3034186Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-24T00:06:44.3073927Z GNU Make 4.3
2021-07-24T00:06:44.3075262Z Built for x86_64-redhat-linux-gnu
2021-07-24T00:06:44.3076291Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-24T00:06:44.3077379Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-24T00:06:44.3078420Z This is free software: you are free to change and redistribute it.
2021-07-24T00:06:44.3080836Z There is NO WARRANTY, to the extent permitted by law.
2021-07-24T00:06:44.3081474Z Reading makefiles...
2021-07-24T00:06:44.3082774Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-24T00:06:44.4333715Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-24T00:06:44.4335625Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-24T00:06:44.6663281Z Updating makefiles....
2021-07-24T00:06:44.6671736Z Updating goal targets....
2021-07-24T00:06:44.6672832Z File 'clusters' does not exist.
2021-07-24T00:06:44.6673488Z Must remake target 'clusters'.
2021-07-24T00:06:44.6675073Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:06:44.6704668Z Downloading shflags 1.0.3
2021-07-24T00:06:44.6762968Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-24T00:06:44.6763780Z Dload Upload Total Spent Left Speed
2021-07-24T00:06:44.6764186Z
2021-07-24T00:06:44.6972496Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-24T00:06:44.6995128Z 100 31091 100 31091 0 0 1445k 0 --:--:-- --:--:-- --:--:-- 1445k
2021-07-24T00:06:44.7663817Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-24T00:06:44.7685433Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-24T00:06:44.7697066Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:06:44.7708147Z [submariner-operator]$ script_name=utils
2021-07-24T00:06:44.7721024Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:06:44.7738976Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-24T00:06:44.7748984Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:06:44.7762391Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:06:44.7775549Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:06:44.7796709Z [submariner-operator]$ broker=cluster1
2021-07-24T00:06:44.7808447Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-24T00:06:44.7821758Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-24T00:06:44.7833360Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-24T00:06:44.7845938Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-24T00:06:44.7858518Z [submariner-operator]$ declare -gA cluster_subm
2021-07-24T00:06:44.7867673Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-24T00:06:44.7880927Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-24T00:06:44.7893344Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-24T00:06:44.7904209Z [submariner-operator]$ declare -gA cluster_cni
2021-07-24T00:06:44.7917105Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-24T00:06:44.7928685Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-24T00:06:44.7941534Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:06:44.7953458Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:06:44.7966267Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:06:44.7978839Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:06:44.8000957Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-24T00:06:44.8013580Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-24T00:06:44.8046007Z [submariner-operator]$ cat <<EOM
2021-07-24T00:06:44.8047308Z Cluster settings::
2021-07-24T00:06:44.8048028Z broker - ${broker@Q}
2021-07-24T00:06:44.8048600Z clusters - ${clusters[*]@Q}
2021-07-24T00:06:44.8049286Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-24T00:06:44.8050081Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-24T00:06:44.8050969Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-24T00:06:44.8051587Z EOM
2021-07-24T00:06:44.8073542Z [submariner-operator]$ typeset -p cluster_cni
2021-07-24T00:06:44.8088503Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:06:44.8118846Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-24T00:06:44.8132929Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:06:44.8162014Z [submariner-operator]$ typeset -p cluster_subm
2021-07-24T00:06:44.8177287Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:06:44.8194164Z Cluster settings::
2021-07-24T00:06:44.8195126Z broker - 'cluster1'
2021-07-24T00:06:44.8195829Z clusters - 'cluster1' 'cluster2'
2021-07-24T00:06:44.8196594Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-24T00:06:44.8197967Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-24T00:06:44.8199295Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-24T00:06:44.8213235Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-24T00:06:44.8232827Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-24T00:06:44.8253382Z [submariner-operator]$ run_local_registry
2021-07-24T00:06:44.8265569Z [submariner-operator]$ run_local_registry
2021-07-24T00:06:44.8277831Z [submariner-operator]$ registry_running
2021-07-24T00:06:44.8289807Z [submariner-operator]$ registry_running
2021-07-24T00:06:44.8301896Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-24T00:06:44.8316341Z [submariner-operator]$ grep kind-registry
2021-07-24T00:06:45.1028135Z [submariner-operator]$ return 0
2021-07-24T00:06:45.1033091Z Deploying local registry kind-registry to serve images centrally.
2021-07-24T00:06:45.1047315Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-24T00:06:45.1057836Z [submariner-operator]$ selinuxenabled
2021-07-24T00:06:45.1080646Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-24T00:06:45.3795208Z Unable to find image 'registry:2' locally
2021-07-24T00:06:45.5626437Z 2: Pulling from library/registry
2021-07-24T00:06:45.6154767Z ddad3d7c1e96: Already exists
2021-07-24T00:06:45.6186661Z 6eda6749503f: Pulling fs layer
2021-07-24T00:06:45.6187266Z 363ab70c2143: Pulling fs layer
2021-07-24T00:06:45.6187764Z 5b94580856e6: Pulling fs layer
2021-07-24T00:06:45.6188254Z 12008541203a: Pulling fs layer
2021-07-24T00:06:45.6188683Z 12008541203a: Waiting
2021-07-24T00:06:45.6668535Z 5b94580856e6: Verifying Checksum
2021-07-24T00:06:45.6669454Z 5b94580856e6: Download complete
2021-07-24T00:06:45.6782567Z 6eda6749503f: Verifying Checksum
2021-07-24T00:06:45.6783200Z 6eda6749503f: Download complete
2021-07-24T00:06:45.7184867Z 12008541203a: Verifying Checksum
2021-07-24T00:06:45.7185580Z 12008541203a: Download complete
2021-07-24T00:06:45.7690665Z 363ab70c2143: Verifying Checksum
2021-07-24T00:06:45.7691387Z 363ab70c2143: Download complete
2021-07-24T00:06:46.0559716Z 6eda6749503f: Pull complete
2021-07-24T00:06:46.3946918Z 363ab70c2143: Pull complete
2021-07-24T00:06:46.4638736Z 5b94580856e6: Pull complete
2021-07-24T00:06:46.5402869Z 12008541203a: Pull complete
2021-07-24T00:06:46.5458757Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-24T00:06:46.5474054Z Status: Downloaded newer image for registry:2
2021-07-24T00:06:46.5668625Z 511bb83a5fb1381fa99a1e109f27f84e43953de4233d0365b806cc9f19d29e19
2021-07-24T00:06:46.9139262Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-24T00:06:47.3163508Z [submariner-operator]$ declare_cidrs
2021-07-24T00:06:47.3177872Z [submariner-operator]$ declare_cidrs
2021-07-24T00:06:47.3187456Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-24T00:06:47.3199075Z [submariner-operator]$ i=1
2021-07-24T00:06:47.3209962Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:06:47.3211227Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:06:47.3213384Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-24T00:06:47.3217710Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-24T00:06:47.3230272Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-24T00:06:47.3338533Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:06:47.3340382Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:06:47.3341502Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-24T00:06:47.3342755Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-24T00:06:47.3343789Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-24T00:06:47.3344705Z [submariner-operator]$ [cluster2] wait 289
2021-07-24T00:06:47.3346076Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3347420Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3377942Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3390457Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3418196Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:06:47.3419415Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:06:47.3440887Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:06:47.3444059Z [submariner-operator]$ [cluster1] pids[cluster1]=298
2021-07-24T00:06:47.3458094Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3466646Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:06:47.3478980Z [submariner-operator]$ [cluster2] pids[cluster2]=301
2021-07-24T00:06:47.3501098Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-24T00:06:47.3503801Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:06:47.3534010Z [submariner-operator]$ [cluster2] wait 301
2021-07-24T00:06:47.3559599Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:08:48.3154054Z [submariner-operator]$ [cluster2] with_retries
2021-07-24T00:08:48.3155445Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:08:48.3156420Z [submariner-operator]$ [cluster2] wait 317
2021-07-24T00:08:48.3157431Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-24T00:08:48.3158479Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-24T00:08:48.3160204Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:08:48.3162534Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:08:48.3164078Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-24T00:08:48.3165131Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-24T00:08:48.3165848Z [cluster2] No kind clusters found.
2021-07-24T00:08:48.3166827Z [cluster2] Creating KIND cluster...
2021-07-24T00:08:48.3167813Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-24T00:08:48.3169041Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-24T00:08:48.3170341Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-24T00:08:48.3171430Z [submariner-operator]$ [cluster2] nodes=
2021-07-24T00:08:48.3172411Z [cluster2] - role: control-plane
2021-07-24T00:08:48.3179868Z [submariner-operator]$ [cluster2] nodes=
2021-07-24T00:08:48.3180865Z [cluster2] - role: control-plane
2021-07-24T00:08:48.3181586Z [cluster2] - role: worker
2021-07-24T00:08:48.3182383Z [submariner-operator]$ [cluster2] nodes=
2021-07-24T00:08:48.3183216Z [cluster2] - role: control-plane
2021-07-24T00:08:48.3183893Z [cluster2] - role: worker
2021-07-24T00:08:48.3184535Z [cluster2] - role: worker
2021-07-24T00:08:48.3185121Z [cluster2] 
2021-07-24T00:08:48.3185681Z [cluster2] 
2021-07-24T00:08:48.3186518Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-24T00:08:48.3187895Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-24T00:08:48.3189406Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-24T00:08:48.3190587Z [submariner-operator]$ [cluster2] kind version
2021-07-24T00:08:48.3191308Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-24T00:08:48.3192671Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-24T00:08:48.3193703Z [cluster2] ---
2021-07-24T00:08:48.3194169Z [cluster2] kind: Cluster
2021-07-24T00:08:48.3194933Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-24T00:08:48.3195563Z [cluster2] networking:
2021-07-24T00:08:48.3196164Z [cluster2] disableDefaultCNI: true
2021-07-24T00:08:48.3196794Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-24T00:08:48.3197366Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-24T00:08:48.3198098Z [cluster2] containerdConfigPatches:
2021-07-24T00:08:48.3198841Z [cluster2] - |-
2021-07-24T00:08:48.3199708Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-24T00:08:48.3200966Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-24T00:08:48.3201800Z [cluster2] kubeadmConfigPatches:
2021-07-24T00:08:48.3202509Z [cluster2] - |
2021-07-24T00:08:48.3203099Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-24T00:08:48.3203855Z [cluster2] kind: ClusterConfiguration
2021-07-24T00:08:48.3204468Z [cluster2] metadata:
2021-07-24T00:08:48.3204973Z [cluster2] name: config
2021-07-24T00:08:48.3205474Z [cluster2] networking:
2021-07-24T00:08:48.3206014Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-24T00:08:48.3206585Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-24T00:08:48.3207230Z [cluster2] dnsDomain: cluster2.local
2021-07-24T00:08:48.3207783Z [cluster2] nodes:
2021-07-24T00:08:48.3208464Z [cluster2] - role: control-plane
2021-07-24T00:08:48.3209242Z [cluster2] - role: worker
2021-07-24T00:08:48.3209876Z [cluster2] - role: worker
2021-07-24T00:08:48.3211417Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-24T00:08:48.3212657Z [cluster2] Creating cluster "cluster2" ...
2021-07-24T00:08:48.3214887Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-24T00:08:48.3216028Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-24T00:08:48.3216804Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-24T00:08:48.3217491Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-24T00:08:48.3218220Z [cluster2] • Writing configuration 📜 ...
2021-07-24T00:08:48.3218949Z [cluster2] ✓ Writing configuration 📜
2021-07-24T00:08:48.3219724Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-24T00:08:48.3220669Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-24T00:08:48.3221513Z [cluster2] • Installing StorageClass 💾 ...
2021-07-24T00:08:48.3222350Z [cluster2] ✓ Installing StorageClass 💾
2021-07-24T00:08:48.3223135Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-24T00:08:48.3223872Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-24T00:08:48.3224687Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-24T00:08:48.3225385Z [cluster2] You can now use your cluster with:
2021-07-24T00:08:48.3225908Z [cluster2]
2021-07-24T00:08:48.3226716Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-24T00:08:48.3227334Z [cluster2]
2021-07-24T00:08:48.3227939Z [cluster2] Have a nice day! 👋
2021-07-24T00:08:48.3228794Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-24T00:08:48.3229833Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-24T00:08:48.3231473Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-24T00:08:48.3232969Z [submariner-operator]$ [cluster2] head -n 1
2021-07-24T00:08:48.5602434Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\[submariner-operator]$ [cluster1] with_retries
2021-07-24T00:08:48.5603825Z [submariner-operator]$ [cluster1] iteration=1
2021-07-24T00:08:48.5604877Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-24T00:08:48.5606082Z [submariner-operator]$ [cluster1] wait 321
2021-07-24T00:08:48.5607115Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-24T00:08:48.5608923Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:08:48.5611095Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:08:48.5612747Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-24T00:08:48.5613925Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-24T00:08:48.5614801Z [cluster1] No kind clusters found.
2021-07-24T00:08:48.5615387Z [cluster1] Creating KIND cluster...
2021-07-24T00:08:48.5616361Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-24T00:08:48.5617452Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-24T00:08:48.5618500Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-24T00:08:48.5619471Z [submariner-operator]$ [cluster1] nodes=
2021-07-24T00:08:48.5620315Z [cluster1] - role: control-plane
2021-07-24T00:08:48.5621173Z [submariner-operator]$ [cluster1] nodes=
2021-07-24T00:08:48.5621988Z [cluster1] - role: control-plane
2021-07-24T00:08:48.5622691Z [cluster1] - role: worker
2021-07-24T00:08:48.5623475Z [submariner-operator]$ [cluster1] nodes=
2021-07-24T00:08:48.5624304Z [cluster1] - role: control-plane
2021-07-24T00:08:48.5624973Z [cluster1] - role: worker
2021-07-24T00:08:48.5625820Z [cluster1] - role: worker
2021-07-24T00:08:48.5626406Z [cluster1] 
2021-07-24T00:08:48.5626964Z [cluster1] 
2021-07-24T00:08:48.5627797Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-24T00:08:48.5629157Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-24T00:08:48.5630596Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-24T00:08:48.5631676Z [submariner-operator]$ [cluster1] kind version
2021-07-24T00:08:48.5632386Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-24T00:08:48.5633544Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-24T00:08:48.5634536Z [cluster1] ---
2021-07-24T00:08:48.5634988Z [cluster1] kind: Cluster
2021-07-24T00:08:48.5635769Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-24T00:08:48.5636395Z [cluster1] networking:
2021-07-24T00:08:48.5637002Z [cluster1] disableDefaultCNI: true
2021-07-24T00:08:48.5637626Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-24T00:08:48.5638184Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-24T00:08:48.5638896Z [cluster1] containerdConfigPatches:
2021-07-24T00:08:48.5639641Z [cluster1] - |-
2021-07-24T00:08:48.5640507Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-24T00:08:48.5641859Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-24T00:08:48.5642685Z [cluster1] kubeadmConfigPatches:
2021-07-24T00:08:48.5643393Z [cluster1] - |
2021-07-24T00:08:48.5643990Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-24T00:08:48.5644744Z [cluster1] kind: ClusterConfiguration
2021-07-24T00:08:48.5645351Z [cluster1] metadata:
2021-07-24T00:08:48.5645848Z [cluster1] name: config
2021-07-24T00:08:48.5646519Z [cluster1] networking:
2021-07-24T00:08:48.5647065Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-24T00:08:48.5647638Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-24T00:08:48.5648281Z [cluster1] dnsDomain: cluster1.local
2021-07-24T00:08:48.5648826Z [cluster1] nodes:
2021-07-24T00:08:48.5649638Z [cluster1] - role: control-plane
2021-07-24T00:08:48.5650319Z [cluster1] - role: worker
2021-07-24T00:08:48.5650955Z [cluster1] - role: worker
2021-07-24T00:08:48.5652543Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-24T00:08:48.5653812Z [cluster1] Creating cluster "cluster1" ...
2021-07-24T00:08:48.5655327Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-24T00:08:48.5656265Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-24T00:08:48.5657093Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-24T00:08:48.5657824Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-24T00:08:48.5658602Z [cluster1] • Writing configuration 📜 ...
2021-07-24T00:08:48.5659414Z [cluster1] ✓ Writing configuration 📜
2021-07-24T00:08:48.5660220Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-24T00:08:48.5661039Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-24T00:08:48.5661851Z [cluster1] • Installing StorageClass 💾 ...
2021-07-24T00:08:48.5662675Z [cluster1] ✓ Installing StorageClass 💾
2021-07-24T00:08:48.5663448Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-24T00:08:48.5664191Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-24T00:08:48.5664997Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-24T00:08:48.5665684Z [cluster1] You can now use your cluster with:
2021-07-24T00:08:48.5666187Z [cluster1]
2021-07-24T00:08:48.5666978Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-24T00:08:48.5667606Z [cluster1]
2021-07-24T00:08:48.5668220Z [cluster1] Thanks for using kind! 😊
2021-07-24T00:08:48.5669106Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-24T00:08:48.5670123Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-24T00:08:48.5671892Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-24T00:08:48.5673494Z [submariner-operator]$ [cluster1] head -n 1
2021-07-24T00:09:27.2413160Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: h/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2415906Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2418291Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2420716Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2423413Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2427138Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:09:27.2428739Z [submariner-operator]$ [cluster2] wait 1608
2021-07-24T00:09:27.2429813Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-24T00:09:27.2431000Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-24T00:09:27.2432055Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-24T00:09:27.2433031Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-24T00:09:27.2434216Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-24T00:09:27.2435268Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-24T00:09:27.2436297Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-24T00:09:27.2437138Z [cluster2] Applying weave network...
2021-07-24T00:09:27.2438623Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-24T00:09:27.2440822Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-24T00:09:27.2442970Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-24T00:09:27.2444468Z [cluster2] serviceaccount/weave-net created
2021-07-24T00:09:27.2445736Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:27.2448059Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:27.2449779Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:27.2451599Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:27.2452852Z [cluster2] daemonset.apps/weave-net created
2021-07-24T00:09:27.2453752Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-24T00:09:27.2455440Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:27.2457088Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:27.2458871Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:27.2460215Z [cluster2] pod/weave-net-2hfbk condition met
2021-07-24T00:09:27.2461741Z [cluster2] pod/weave-net-j5m48 condition met
2021-07-24T00:09:27.2463530Z [cluster2] pod/weave-net-kgg66 condition met
2021-07-24T00:09:27.2464696Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-24T00:09:27.2466123Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:27.2467620Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:27.2469290Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:27.2470618Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-24T00:09:27.2471746Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-24T00:09:27.2472713Z [cluster2] deployment "coredns" successfully rolled out
2021-07-24T00:09:27.2473674Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:09:27.2499354Z [submariner-operator]$ [cluster2] wait 298
2021-07-24T00:09:28.1755545Z ttps:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1758112Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1760594Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1763078Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1766067Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1768706Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:09:28.1773168Z [submariner-operator]$ [cluster1] wait 1638
2021-07-24T00:09:28.1774257Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-24T00:09:28.1776853Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-24T00:09:28.1777961Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-24T00:09:28.1778944Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-24T00:09:28.1779969Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-24T00:09:28.1781122Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-24T00:09:28.1782153Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-24T00:09:28.1782918Z [cluster1] Applying weave network...
2021-07-24T00:09:28.1784381Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-24T00:09:28.1786343Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-24T00:09:28.1788443Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-24T00:09:28.1789928Z [cluster1] serviceaccount/weave-net created
2021-07-24T00:09:28.1791215Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:28.1792988Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:28.1794656Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:28.1796118Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-24T00:09:28.1797481Z [cluster1] daemonset.apps/weave-net created
2021-07-24T00:09:28.1798396Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-24T00:09:28.1799708Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:28.1801372Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:28.1803153Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-24T00:09:28.1804493Z [cluster1] pod/weave-net-jsskg condition met
2021-07-24T00:09:28.1805402Z [cluster1] pod/weave-net-stl5x condition met
2021-07-24T00:09:28.1806280Z [cluster1] pod/weave-net-w5hbj condition met
2021-07-24T00:09:28.1807215Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-24T00:09:28.1808458Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:28.1809953Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:28.1811555Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-24T00:09:28.1812877Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-24T00:09:28.1814016Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-24T00:09:28.1829357Z [cluster1] deployment "coredns" successfully rolled out
2021-07-24T00:09:28.1830651Z [submariner-operator]$ [cluster1] return 0
2021-07-24T00:09:28.1858283Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-24T00:09:28.1873835Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-24T00:09:28.1890707Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-24T00:09:28.1891608Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-24T00:09:28.1892170Z
2021-07-24T00:09:28.1893174Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-24T00:09:28.1893874Z
2021-07-24T00:09:28.1894978Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-24T00:09:28.1895487Z
2021-07-24T00:09:28.1896503Z To clean everthing up, just run: make clean-clusters
2021-07-24T00:09:28.1897211Z EOM
2021-07-24T00:09:28.1907596Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-24T00:09:28.1908182Z
2021-07-24T00:09:28.1909413Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-24T00:09:28.1910069Z
2021-07-24T00:09:28.1910846Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-24T00:09:28.1911524Z
2021-07-24T00:09:28.1915693Z To clean everthing up, just run: make clean-clusters
2021-07-24T00:09:28.1916632Z Successfully remade target file 'clusters'.
2021-07-24T00:09:28.1917410Z File 'bin/subctl' does not exist.
2021-07-24T00:09:28.1918318Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-24T00:09:28.1939504Z File 'generate-embeddedyamls' does not exist.
2021-07-24T00:09:28.1940414Z File 'generate' does not exist.
2021-07-24T00:09:28.1941588Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-24T00:09:28.1942721Z File 'vendor/modules.txt' does not exist.
2021-07-24T00:09:28.1943587Z Must remake target 'vendor/modules.txt'.
2021-07-24T00:09:28.1944142Z go mod download
2021-07-24T00:10:23.7646867Z go mod vendor
2021-07-24T00:10:25.8246230Z go mod tidy
2021-07-24T00:10:26.4701893Z Successfully remade target file 'vendor/modules.txt'.
2021-07-24T00:10:26.4703639Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-24T00:10:26.4704986Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-24T00:10:26.4749702Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-24T00:10:47.4474898Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-24T00:10:47.4476174Z Must remake target 'generate'.
2021-07-24T00:10:47.4519172Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-24T00:11:00.4793904Z Successfully remade target file 'generate'.
2021-07-24T00:11:00.4795019Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-24T00:11:00.4803077Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-24T00:11:00.4810963Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-24T00:11:00.4812870Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-24T00:11:02.7197385Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-24T00:11:02.7209749Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-24T00:11:02.7211073Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-24T00:11:02.7213196Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-24T00:11:04.1709843Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-24T00:11:04.1814754Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-24T00:11:04.1815828Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-24T00:11:04.9045826Z Generating yamls.go
2021-07-24T00:11:04.9050770Z deploy/crds/submariner.io_brokers.yaml
2021-07-24T00:11:04.9054309Z deploy/crds/submariner.io_submariners.yaml
2021-07-24T00:11:04.9079388Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-24T00:11:04.9082807Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-24T00:11:04.9085564Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-24T00:11:04.9088974Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-24T00:11:04.9095420Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-24T00:11:04.9100794Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-24T00:11:04.9108179Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-24T00:11:04.9113812Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-24T00:11:04.9119430Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-24T00:11:04.9128932Z config/broker/broker-admin/service_account.yaml
2021-07-24T00:11:04.9131655Z config/broker/broker-admin/role.yaml
2021-07-24T00:11:04.9138385Z config/broker/broker-admin/role_binding.yaml
2021-07-24T00:11:04.9144547Z config/broker/broker-client/service_account.yaml
2021-07-24T00:11:04.9149772Z config/broker/broker-client/role.yaml
2021-07-24T00:11:04.9151955Z config/broker/broker-client/role_binding.yaml
2021-07-24T00:11:04.9156699Z config/rbac/submariner-operator/service_account.yaml
2021-07-24T00:11:04.9158671Z config/rbac/submariner-operator/role.yaml
2021-07-24T00:11:04.9164942Z config/rbac/submariner-operator/role_binding.yaml
2021-07-24T00:11:04.9167333Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-24T00:11:04.9174967Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-24T00:11:04.9176996Z config/rbac/submariner-gateway/service_account.yaml
2021-07-24T00:11:04.9196302Z config/rbac/submariner-gateway/role.yaml
2021-07-24T00:11:04.9202542Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-24T00:11:04.9204434Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-24T00:11:04.9209751Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-24T00:11:04.9215036Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-24T00:11:04.9219244Z config/rbac/submariner-route-agent/role.yaml
2021-07-24T00:11:04.9224085Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-24T00:11:04.9227716Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-24T00:11:04.9232042Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-24T00:11:04.9237232Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-24T00:11:04.9241668Z config/rbac/submariner-globalnet/role.yaml
2021-07-24T00:11:04.9246381Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-24T00:11:04.9251380Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-24T00:11:04.9256296Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-24T00:11:04.9262254Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-24T00:11:04.9264632Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-24T00:11:04.9268326Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-24T00:11:04.9270320Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-24T00:11:04.9278339Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-24T00:11:04.9283398Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-24T00:11:04.9289258Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-24T00:11:04.9291649Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-24T00:11:04.9294373Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-24T00:11:04.9297732Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-24T00:11:04.9299786Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-24T00:11:04.9341123Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-24T00:11:04.9342357Z Must remake target 'generate-embeddedyamls'.
2021-07-24T00:11:04.9343478Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-24T00:11:04.9586256Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-24T00:11:04.9587271Z mkdir -p bin
2021-07-24T00:11:04.9610136Z target=bin/subctl-latest-linux-amd64; \
2021-07-24T00:11:04.9611090Z target=${target%.exe}; \
2021-07-24T00:11:04.9611916Z components=($(echo ${target//-/ })); \
2021-07-24T00:11:04.9612552Z GOOS=${components[-2]}; \
2021-07-24T00:11:04.9613137Z GOARCH=${components[-1]}; \
2021-07-24T00:11:04.9613606Z export GOARCH GOOS; \
2021-07-24T00:11:04.9614109Z /opt/shipyard/scripts/compile.sh \
2021-07-24T00:11:04.9615552Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-24T00:11:04.9617448Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-24T00:11:04.9619101Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-24T00:11:05.0269294Z [submariner-operator]$ mkdir -p bin
2021-07-24T00:11:05.0287725Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-24T00:11:05.0298997Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-24T00:11:05.0317620Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-24T00:13:03.5151746Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-24T00:13:03.5152863Z Must remake target 'bin/subctl'.
2021-07-24T00:13:03.5153739Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-24T00:13:03.5186613Z Successfully remade target file 'bin/subctl'.
2021-07-24T00:13:03.5187647Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-24T00:13:03.5188649Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-24T00:13:03.5189707Z Must remake target 'deploy'.
2021-07-24T00:13:03.5196483Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:13:03.6554015Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-24T00:13:03.6610551Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-24T00:13:03.6623401Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:13:03.6634779Z [submariner-operator]$ script_name=utils
2021-07-24T00:13:03.6656406Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:13:03.6663991Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-24T00:13:03.6679399Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:13:03.6691538Z [submariner-operator]$ script_name=deploy_funcs
2021-07-24T00:13:03.6707495Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:13:03.6733295Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-24T00:13:03.6749179Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:13:03.6762723Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:13:03.6775566Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:13:03.6802053Z [submariner-operator]$ broker=cluster1
2021-07-24T00:13:03.6813710Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-24T00:13:03.6825686Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-24T00:13:03.6837193Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-24T00:13:03.6849604Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-24T00:13:03.6861887Z [submariner-operator]$ declare -gA cluster_subm
2021-07-24T00:13:03.6875055Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-24T00:13:03.6888468Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-24T00:13:03.6902516Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-24T00:13:03.6913998Z [submariner-operator]$ declare -gA cluster_cni
2021-07-24T00:13:03.6925548Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-24T00:13:03.6937516Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-24T00:13:03.6950492Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:13:03.6962026Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:13:03.6973538Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:13:03.6985920Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:13:03.7007340Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-24T00:13:03.7020577Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-24T00:13:03.7054696Z [submariner-operator]$ declare_cidrs
2021-07-24T00:13:03.7065209Z [submariner-operator]$ declare_cidrs
2021-07-24T00:13:03.7075388Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-24T00:13:03.7086472Z [submariner-operator]$ i=1
2021-07-24T00:13:03.7101732Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:13:03.7113735Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:13:03.7127925Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-24T00:13:03.7139362Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-24T00:13:03.7151309Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-24T00:13:03.7163147Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:13:03.7178330Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:13:03.7193152Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-24T00:13:03.7212609Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-24T00:13:03.7225384Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-24T00:13:03.7237417Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-24T00:13:03.7251078Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-24T00:13:03.7266979Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-24T00:13:03.7288676Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-24T00:13:03.7303143Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-24T00:13:03.7321442Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-24T00:13:03.7364530Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-24T00:13:03.9517324Z Installing subctl version latest
2021-07-24T00:13:03.9517974Z OS detected: linux
2021-07-24T00:13:03.9518811Z Architecture detected: amd64
2021-07-24T00:13:03.9521332Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-24T00:13:03.9522174Z
2021-07-24T00:13:03.9522561Z Downloading...
2021-07-24T00:13:05.2048556Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-24T00:13:05.2525270Z This provides subctl version: v0.9.1
2021-07-24T00:13:05.2549882Z
2021-07-24T00:13:05.2551880Z please update your path (and consider adding it to ~/.profile):
2021-07-24T00:13:05.2552532Z export PATH=$PATH:/go/bin
2021-07-24T00:13:05.2553153Z
2021-07-24T00:13:05.2665831Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-24T00:13:05.2685678Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-24T00:13:05.2692488Z Will deploy submariner using operator
2021-07-24T00:13:05.2707079Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-24T00:13:05.2779346Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:13:05.2792227Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-24T00:13:05.2804455Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-24T00:13:05.2824372Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-24T00:13:05.2837163Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-24T00:13:05.2849645Z 
2021-07-24T00:13:05.2862424Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-24T00:13:05.4438889Z subctl version: v0.9.1
2021-07-24T00:13:05.4467300Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-24T00:13:05.4479430Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-24T00:13:05.4495645Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-24T00:13:05.4513834Z [submariner-operator]$ [cluster2] grep -q function
2021-07-24T00:13:05.4541923Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:13:05.4557434Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-24T00:13:05.4573028Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-24T00:13:05.4586619Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-24T00:13:05.4623941Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-24T00:13:05.4635967Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-24T00:13:05.4652186Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:13:05.4673140Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:13:05.4695517Z [submariner-operator]$ [cluster1] pids[cluster1]=6312
2021-07-24T00:13:05.4708717Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:13:05.4719322Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-24T00:13:05.4734074Z [submariner-operator]$ [cluster2] pids[cluster2]=6315
2021-07-24T00:13:05.4737882Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:13:05.4764830Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:13:05.4775351Z [submariner-operator]$ [cluster2] wait 6315
2021-07-24T00:13:05.4783881Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-24T00:13:05.4800667Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:13:05.8651205Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-24T00:13:05.8652512Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-24T00:13:05.8653573Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-24T00:13:05.8655623Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8657368Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8659181Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8660507Z [cluster2] node/cluster2-worker labeled
2021-07-24T00:13:05.8709164Z [submariner-operator]$ [cluster2] wait 6312
2021-07-24T00:13:05.8841032Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-24T00:13:05.8842180Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-24T00:13:05.8843236Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-24T00:13:05.8844638Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8846304Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8848212Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:13:05.8849537Z [cluster1] node/cluster1-worker labeled
2021-07-24T00:13:05.8861687Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-24T00:13:05.8879470Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-24T00:13:05.8895398Z [submariner-operator]$ [cluster1] setup_broker
2021-07-24T00:13:05.8908229Z [submariner-operator]$ [cluster1] setup_broker
2021-07-24T00:13:05.8915273Z Installing broker...
2021-07-24T00:13:05.8926964Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-24T00:13:05.8946751Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-24T00:13:05.8958161Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:13:05.9413125Z • Setting up broker RBAC ...
2021-07-24T00:13:06.0404937Z ✓ Setting up broker RBAC
2021-07-24T00:13:06.0405898Z • Deploying the Submariner operator ...
2021-07-24T00:13:16.4872730Z ✓ Deploying the Submariner operator
2021-07-24T00:13:16.4874098Z ✓ Created operator CRDs
2021-07-24T00:13:16.4875264Z ✓ Created operator namespace: submariner-operator
2021-07-24T00:13:16.4876451Z ✓ Created operator service account and role
2021-07-24T00:13:16.4877631Z ✓ Created lighthouse service account and role
2021-07-24T00:13:16.4878911Z ✓ Created Lighthouse service accounts and roles
2021-07-24T00:13:16.4880681Z ✓ Deployed the operator successfully
2021-07-24T00:13:16.4882099Z • Deploying the broker ...
2021-07-24T00:13:16.6073067Z ✓ Deploying the broker
2021-07-24T00:13:16.6073896Z ✓ The broker has been deployed
2021-07-24T00:13:16.6074728Z • Creating broker-info.subm file ...
2021-07-24T00:13:16.6141671Z ✓ Creating broker-info.subm file
2021-07-24T00:13:16.6142718Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-24T00:13:16.6189552Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-24T00:13:16.6205141Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-24T00:13:16.6218753Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-24T00:13:16.6230167Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-24T00:13:16.6251931Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-24T00:13:16.6289094Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-24T00:13:16.6302575Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-24T00:13:16.6314650Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:13:16.6334370Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:13:16.6359509Z [submariner-operator]$ [cluster1] pids[cluster1]=6379
2021-07-24T00:13:16.6382711Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:13:16.6394098Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:13:16.6404933Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-24T00:13:16.6412725Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-24T00:13:16.6424627Z [submariner-operator]$ [cluster2] pids[cluster2]=6381
2021-07-24T00:13:16.6483826Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:13:16.6492500Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:13:16.6512333Z [submariner-operator]$ [cluster2] wait 6381
2021-07-24T00:13:22.6122115Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-24T00:13:22.6123206Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-24T00:13:22.6124641Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-24T00:13:22.6127635Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-24T00:13:22.6131330Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-24T00:13:22.6132619Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-24T00:13:22.6133566Z [cluster1] - cluster1-worker
2021-07-24T00:13:22.6134577Z [cluster1] • Discovering network details ...
2021-07-24T00:13:22.6135452Z [cluster1] Discovered network details:
2021-07-24T00:13:22.6136335Z [cluster1] Network plugin: weave-net
2021-07-24T00:13:22.6137034Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-24T00:13:22.6137626Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-24T00:13:22.6138523Z [cluster1] ✓ Discovering network details
2021-07-24T00:13:22.6139458Z [cluster1] • Discovering multi cluster details ...
2021-07-24T00:13:22.6140490Z [cluster1] • Validating Globalnet configurations ...
2021-07-24T00:13:22.6141466Z [cluster1] ✓ Validating Globalnet configurations
2021-07-24T00:13:22.6142495Z [cluster1] ✓ Discovering multi cluster details
2021-07-24T00:13:22.6143491Z [cluster1] • Deploying the Submariner operator ...
2021-07-24T00:13:22.6144466Z [cluster1] ✓ Deploying the Submariner operator
2021-07-24T00:13:22.6145499Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-24T00:13:22.6146386Z [cluster1] • Creating SA for cluster ...
2021-07-24T00:13:22.6147247Z [cluster1] ✓ Creating SA for cluster
2021-07-24T00:13:22.6148075Z [cluster1] • Deploying Submariner ...
2021-07-24T00:13:22.6148948Z [cluster1] ✓ Deploying Submariner
2021-07-24T00:13:22.6149893Z [cluster1] ✓ Submariner is up and running
2021-07-24T00:13:29.0455651Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-24T00:13:29.0461755Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-24T00:13:29.0462964Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-24T00:13:29.0467319Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-24T00:13:29.0470862Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-24T00:13:29.0473796Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-24T00:13:29.0474768Z [cluster2] - cluster2-worker
2021-07-24T00:13:29.0475709Z [cluster2] • Discovering network details ...
2021-07-24T00:13:29.0476416Z [cluster2] Discovered network details:
2021-07-24T00:13:29.0477318Z [cluster2] Network plugin: weave-net
2021-07-24T00:13:29.0512659Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-24T00:13:29.0513364Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-24T00:13:29.0514480Z [cluster2] ✓ Discovering network details
2021-07-24T00:13:29.0515377Z [cluster2] • Discovering multi cluster details ...
2021-07-24T00:13:29.0516306Z [cluster2] • Validating Globalnet configurations ...
2021-07-24T00:13:29.0517245Z [cluster2] ✓ Validating Globalnet configurations
2021-07-24T00:13:29.0518148Z [cluster2] ✓ Discovering multi cluster details
2021-07-24T00:13:29.0519071Z [cluster2] • Deploying the Submariner operator ...
2021-07-24T00:13:29.0519978Z [cluster2] ✓ Deploying the Submariner operator
2021-07-24T00:13:29.0520791Z [cluster2] ✓ Created operator CRDs
2021-07-24T00:13:29.0521745Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-24T00:13:29.0522771Z [cluster2] ✓ Created operator service account and role
2021-07-24T00:13:29.0523700Z [cluster2] ✓ Created lighthouse service account and role
2021-07-24T00:13:29.0524881Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-24T00:13:29.0525812Z [cluster2] ✓ Deployed the operator successfully
2021-07-24T00:13:29.0526881Z [cluster2] • Creating SA for cluster ...
2021-07-24T00:13:29.0527619Z [cluster2] ✓ Creating SA for cluster
2021-07-24T00:13:29.0528378Z [cluster2] • Deploying Submariner ...
2021-07-24T00:13:29.0529135Z [cluster2] ✓ Deploying Submariner
2021-07-24T00:13:29.0529914Z [cluster2] ✓ Submariner is up and running
2021-07-24T00:13:29.0555757Z [submariner-operator]$ [cluster2] wait 6379
2021-07-24T00:13:29.0578610Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-24T00:13:29.0591020Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-24T00:13:29.0671518Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-24T00:13:29.0775638Z [submariner-operator]$ [cluster2] with_retries
2021-07-24T00:13:29.0816301Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:13:29.0900765Z [submariner-operator]$ [cluster2] wait 6421
2021-07-24T00:13:29.0909111Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:29.0924016Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:29.0939377Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:13:29.0980972Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:29.1006181Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:13:29.6105468Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:29.6128409Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:13:30.2616903Z • Showing Connections ...
2021-07-24T00:13:30.2753319Z ✗ Showing Connections
2021-07-24T00:13:30.2758084Z ✗ There are no gateways detected
2021-07-24T00:13:30.6913783Z • Showing Connections ...
2021-07-24T00:13:30.8308241Z ✗ Showing Connections
2021-07-24T00:13:30.8309483Z ✗ There are no gateways detected
2021-07-24T00:13:30.8353655Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:13:30.8372902Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:13:37.0381001Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:13:37.0422599Z [submariner-operator]$ [cluster2] wait 6448
2021-07-24T00:13:37.0440059Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:37.0487801Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:37.0520921Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:13:37.0535960Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:37.0573239Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:13:37.2258258Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:37.2283466Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:13:37.3448721Z • Showing Connections ...
2021-07-24T00:13:37.3509937Z ✗ Showing Connections
2021-07-24T00:13:37.3512303Z ✗ There are no gateways detected
2021-07-24T00:13:37.3750652Z • Showing Connections ...
2021-07-24T00:13:37.3888186Z ✗ Showing Connections
2021-07-24T00:13:37.3893009Z ✗ There are no gateways detected
2021-07-24T00:13:37.3920748Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:13:37.3936529Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:13:43.3963068Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:13:43.4010713Z [submariner-operator]$ [cluster2] wait 6476
2021-07-24T00:13:43.4027302Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:43.4041748Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:43.4104077Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:13:43.4173142Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:43.4190325Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:13:44.7654764Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:44.7675674Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:13:45.2378249Z • Showing Connections ...
2021-07-24T00:13:45.8602916Z ✗ Showing Connections
2021-07-24T00:13:45.8603980Z ✗ There are no gateways detected
2021-07-24T00:13:45.8785686Z • Showing Connections ...
2021-07-24T00:13:45.8804684Z ✗ Showing Connections
2021-07-24T00:13:45.8806722Z ✗ There are no gateways detected
2021-07-24T00:13:45.8831353Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:13:45.8845066Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:13:51.8873089Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:13:51.8920795Z [submariner-operator]$ [cluster2] wait 6502
2021-07-24T00:13:51.8938673Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:51.9007402Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:51.9080335Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:13:51.9147868Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:51.9182300Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:13:52.1108579Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:52.1123691Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:13:52.3093290Z • Showing Connections ...
2021-07-24T00:13:52.3258805Z ✗ Showing Connections
2021-07-24T00:13:52.3259573Z ✗ There are no gateways detected
2021-07-24T00:13:52.3771602Z • Showing Connections ...
2021-07-24T00:13:52.3844623Z ✗ Showing Connections
2021-07-24T00:13:52.3849648Z ✗ There are no gateways detected
2021-07-24T00:13:52.3876822Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:13:52.3887803Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:13:58.3914551Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:13:58.3971499Z [submariner-operator]$ [cluster2] wait 6528
2021-07-24T00:13:58.4010999Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:58.4036336Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:13:58.4139065Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:13:58.4195866Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:58.4211817Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:13:58.6416008Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:13:58.6430965Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:13:58.8528587Z • Showing Connections ...
2021-07-24T00:13:58.8764496Z ✗ Showing Connections
2021-07-24T00:13:58.8765743Z ✗ No connections found
2021-07-24T00:13:58.9728640Z • Showing Connections ...
2021-07-24T00:13:59.0269099Z ✗ Showing Connections
2021-07-24T00:13:59.0270385Z ✗ There are no gateways detected
2021-07-24T00:13:59.0292662Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:13:59.0306716Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:14:05.0330920Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:14:05.0366599Z [submariner-operator]$ [cluster2] wait 6556
2021-07-24T00:14:05.0375326Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:05.0387726Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:05.0418141Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:14:05.0435150Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:05.0457513Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:14:05.2619265Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:05.2636429Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:14:05.5244893Z • Showing Connections ...
2021-07-24T00:14:05.5746754Z ✗ Showing Connections
2021-07-24T00:14:05.5747518Z ✗ There are no gateways detected
2021-07-24T00:14:05.5793140Z • Showing Connections ...
2021-07-24T00:14:05.5855570Z ✗ Showing Connections
2021-07-24T00:14:05.5856271Z ✗ No connections found
2021-07-24T00:14:05.5881313Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:14:05.5895786Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:14:11.5930920Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:14:11.5971008Z [submariner-operator]$ [cluster2] wait 6583
2021-07-24T00:14:11.5978191Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:11.5993831Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:11.6004346Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:14:11.6021413Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:11.6034629Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:14:11.6630255Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:11.6647704Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:14:11.7079964Z • Showing Connections ...
2021-07-24T00:14:11.7105160Z ✗ Showing Connections
2021-07-24T00:14:11.7105854Z ✗ No connections found
2021-07-24T00:14:11.7208772Z • Showing Connections ...
2021-07-24T00:14:11.7230081Z ✗ Showing Connections
2021-07-24T00:14:11.7230736Z ✗ No connections found
2021-07-24T00:14:11.7254189Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:14:11.7267167Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:14:17.7295516Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:14:17.7335843Z [submariner-operator]$ [cluster2] wait 6609
2021-07-24T00:14:17.7337403Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:17.7347254Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:17.7359375Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:14:17.7371320Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:17.7387499Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:14:17.8048363Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:17.8063771Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:14:17.8454403Z • Showing Connections ...
2021-07-24T00:14:17.8480080Z ✗ Showing Connections
2021-07-24T00:14:17.8480767Z ✗ No connections found
2021-07-24T00:14:17.8583300Z • Showing Connections ...
2021-07-24T00:14:17.8606400Z ✗ Showing Connections
2021-07-24T00:14:17.8607065Z ✗ No connections found
2021-07-24T00:14:17.8630415Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:14:17.8641596Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:14:23.8692808Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:14:23.8735612Z [submariner-operator]$ [cluster2] wait 6635
2021-07-24T00:14:23.8741229Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:23.8756864Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:14:23.8767578Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:14:23.8784438Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:23.8797987Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:14:23.9565971Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:14:23.9599467Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:14:24.0029564Z • Showing Connections ...
2021-07-24T00:14:24.0064380Z ✓ Showing Connections
2021-07-24T00:14:24.0166347Z • Showing Connections ...
2021-07-24T00:14:24.0189161Z ✓ Showing Connections
2021-07-24T00:14:24.0211255Z cluster2-worker cluster2 172.18.0.6 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 181.518µs
2021-07-24T00:14:24.0212483Z cluster1-worker cluster1 172.18.0.5 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 221.372µs
2021-07-24T00:14:24.0229884Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:14:24.0246767Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:14:24.0265451Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-24T00:14:24.0293939Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-24T00:14:24.0329847Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-24T00:14:24.0349061Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-24T00:14:24.0367948Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-24T00:14:24.0383572Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-24T00:14:24.0397108Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-24T00:14:24.0410474Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-24T00:14:24.3397818Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-24T00:14:24.3498380Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-24T00:14:24.8746452Z latest: Pulling from submariner/nettest
2021-07-24T00:14:24.8773353Z df20fa9351a1: Pulling fs layer
2021-07-24T00:14:24.8789547Z 741138c6c583: Pulling fs layer
2021-07-24T00:14:24.8791211Z d34ea735672c: Pulling fs layer
2021-07-24T00:14:24.8791749Z c91acd455ec9: Pulling fs layer
2021-07-24T00:14:24.8792260Z c91acd455ec9: Waiting
2021-07-24T00:14:24.9550912Z df20fa9351a1: Verifying Checksum
2021-07-24T00:14:25.0092841Z c91acd455ec9: Verifying Checksum
2021-07-24T00:14:25.0093603Z c91acd455ec9: Download complete
2021-07-24T00:14:25.0172256Z 741138c6c583: Verifying Checksum
2021-07-24T00:14:25.0174172Z 741138c6c583: Download complete
2021-07-24T00:14:25.1187864Z d34ea735672c: Verifying Checksum
2021-07-24T00:14:25.1189133Z d34ea735672c: Download complete
2021-07-24T00:14:25.4934334Z df20fa9351a1: Pull complete
2021-07-24T00:14:25.6537040Z 741138c6c583: Pull complete
2021-07-24T00:14:26.1422313Z d34ea735672c: Pull complete
2021-07-24T00:14:26.3048026Z c91acd455ec9: Pull complete
2021-07-24T00:14:26.3104200Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-24T00:14:26.3121298Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-24T00:14:26.3183515Z quay.io/submariner/nettest:latest
2021-07-24T00:14:26.3249063Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-24T00:14:26.6358988Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-24T00:14:26.9338148Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-24T00:14:27.2386498Z The push refers to repository [localhost:5000/nettest]
2021-07-24T00:14:27.2709548Z 7497bfb0ae54: Preparing
2021-07-24T00:14:27.2710156Z 17de069c349e: Preparing
2021-07-24T00:14:27.2710648Z b85398c91342: Preparing
2021-07-24T00:14:27.2711110Z 50644c29ef5a: Preparing
2021-07-24T00:14:27.7057191Z b85398c91342: Pushed
2021-07-24T00:14:27.8503966Z 7497bfb0ae54: Pushed
2021-07-24T00:14:27.8754506Z 50644c29ef5a: Pushed
2021-07-24T00:14:28.8007152Z 17de069c349e: Pushed
2021-07-24T00:14:28.8190445Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-24T00:14:28.8265235Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:28.8282474Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:28.8295424Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-24T00:14:28.8312144Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-24T00:14:28.8430141Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:28.8435300Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:28.8436925Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:29.3504107Z deployment.apps/netshoot created
2021-07-24T00:14:29.3604592Z Waiting for netshoot pods to be ready.
2021-07-24T00:14:29.3619415Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-24T00:14:29.3641507Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-24T00:14:29.3665836Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-24T00:14:29.7145694Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-24T00:14:31.9873474Z deployment "netshoot" successfully rolled out
2021-07-24T00:14:31.9931719Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:31.9945393Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:31.9959064Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:31.9972182Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-24T00:14:31.9990886Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-24T00:14:32.0011508Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-24T00:14:32.0032470Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:32.0043315Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:32.0058492Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:32.6657407Z deployment.apps/nginx-demo created
2021-07-24T00:14:32.6825457Z service/nginx-demo created
2021-07-24T00:14:32.7867962Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-24T00:14:32.7922527Z Waiting for nginx-demo pods to be ready.
2021-07-24T00:14:32.7935709Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:14:32.7950625Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:14:32.7965931Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:14:33.4227606Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-24T00:14:39.5668523Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-24T00:14:39.6708102Z deployment "nginx-demo" successfully rolled out
2021-07-24T00:14:39.6786901Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-24T00:14:39.6859342Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-24T00:14:39.6898364Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-24T00:14:39.6950355Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-24T00:14:39.7001821Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-24T00:14:40.1444382Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-24T00:14:40.1462402Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-24T00:14:40.1477181Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-24T00:14:40.1496289Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-24T00:14:40.1510833Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-24T00:14:40.1526685Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-24T00:14:40.1556582Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:14:40.1579459Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-24T00:14:40.1587705Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:14:40.1603843Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:14:40.4658620Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-svjs5 100.1.115.139
2021-07-24T00:14:40.4673498Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-svjs5 100.1.115.139
2021-07-24T00:14:40.4687574Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:14:40.4716044Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-svjs5 100.1.115.139
2021-07-24T00:14:40.4724604Z [submariner-operator]$ [cluster2] wait 6790
2021-07-24T00:14:40.4735787Z [submariner-operator]$ [cluster2] test_connection
2021-07-24T00:14:40.4739744Z Attempting connectivity between clusters - netshoot-57677568b8-svjs5 --> 100.1.115.139
2021-07-24T00:14:40.4792353Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-24T00:14:40.4812987Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-24T00:14:40.4833284Z [submariner-operator]$ [cluster2] date +%s
2021-07-24T00:14:40.4868919Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-svjs5 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.115.139
2021-07-24T00:14:40.4882232Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-svjs5 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.115.139
2021-07-24T00:14:40.4896318Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-svjs5 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.115.139
2021-07-24T00:14:40.9563417Z Connection test was successful!
2021-07-24T00:14:40.9584981Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:14:40.9599127Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:40.9611846Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:40.9628897Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:40.9644367Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:40.9689910Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:14:41.2640635Z deployment.apps "netshoot" deleted
2021-07-24T00:14:41.2770704Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.2793791Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.2807112Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.2830011Z [submariner-operator]$ [cluster1] remove_resource
2021-07-24T00:14:41.2876393Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.2921848Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.2933140Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:14:41.5904418Z deployment.apps "nginx-demo" deleted
2021-07-24T00:14:41.6440625Z service "nginx-demo" deleted
2021-07-24T00:14:41.7324568Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-24T00:14:41.8019446Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-24T00:14:41.8032418Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-24T00:14:41.8104730Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-24T00:14:41.8128545Z [submariner-operator]$ [cluster2] grep -q function
2021-07-24T00:14:41.8194799Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:14:41.8227987Z Successfully remade target file 'deploy'.
2021-07-24T00:14:41.8259405Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-24T00:14:41.8313217Z Successfully remade target file 'deploy-latest'.
2021-07-24T00:14:41.8314088Z File 'clusters' does not exist.
2021-07-24T00:14:41.8314737Z Must remake target 'clusters'.
2021-07-24T00:14:41.8316427Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:14:42.0332000Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-24T00:14:42.0401794Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-24T00:14:42.0417716Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:14:42.0445192Z [submariner-operator]$ script_name=utils
2021-07-24T00:14:42.0455557Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:14:42.0485528Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-24T00:14:42.0573979Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:14:42.0592110Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:14:42.0601891Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:14:42.0623650Z [submariner-operator]$ broker=cluster1
2021-07-24T00:14:42.0636728Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-24T00:14:42.0650265Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-24T00:14:42.0682871Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-24T00:14:42.0704653Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-24T00:14:42.0722222Z [submariner-operator]$ declare -gA cluster_subm
2021-07-24T00:14:42.0752543Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-24T00:14:42.0764097Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-24T00:14:42.0818822Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-24T00:14:42.0829156Z [submariner-operator]$ declare -gA cluster_cni
2021-07-24T00:14:42.0860414Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-24T00:14:42.0885507Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-24T00:14:42.0897345Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:14:42.0918362Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:14:42.0948400Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:14:42.0958250Z [submariner-operator]$ exec_name=clusters.sh
2021-07-24T00:14:42.1003089Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-24T00:14:42.1014060Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-24T00:14:42.1069032Z [submariner-operator]$ cat <<EOM
2021-07-24T00:14:42.1073399Z Cluster settings::
2021-07-24T00:14:42.1074273Z broker - ${broker@Q}
2021-07-24T00:14:42.1074933Z clusters - ${clusters[*]@Q}
2021-07-24T00:14:42.1075768Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-24T00:14:42.1076655Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-24T00:14:42.1077604Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-24T00:14:42.1078333Z EOM
2021-07-24T00:14:42.1109423Z [submariner-operator]$ typeset -p cluster_cni
2021-07-24T00:14:42.1121997Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:14:42.1188052Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-24T00:14:42.1205358Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:14:42.1256511Z [submariner-operator]$ typeset -p cluster_subm
2021-07-24T00:14:42.1306478Z [submariner-operator]$ cut -f 2- -d=
2021-07-24T00:14:42.1399785Z Cluster settings::
2021-07-24T00:14:42.1400626Z broker - 'cluster1'
2021-07-24T00:14:42.1401268Z clusters - 'cluster1' 'cluster2'
2021-07-24T00:14:42.1402115Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-24T00:14:42.1403404Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-24T00:14:42.1404868Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-24T00:14:42.1514329Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-24T00:14:42.1615920Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-24T00:14:42.1680951Z [submariner-operator]$ run_local_registry
2021-07-24T00:14:42.1737132Z [submariner-operator]$ run_local_registry
2021-07-24T00:14:42.1786099Z [submariner-operator]$ registry_running
2021-07-24T00:14:42.1801021Z [submariner-operator]$ registry_running
2021-07-24T00:14:42.1846739Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-24T00:14:42.1897734Z [submariner-operator]$ grep kind-registry
2021-07-24T00:14:42.5534320Z 511bb83a5fb1 registry:2 "/entrypoint.sh /etc…" 7 minutes ago Up 7 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-24T00:14:42.5589690Z [submariner-operator]$ return 0
2021-07-24T00:14:42.5593923Z Local registry kind-registry already running.
2021-07-24T00:14:42.5606338Z [submariner-operator]$ declare_cidrs
2021-07-24T00:14:42.5618989Z [submariner-operator]$ declare_cidrs
2021-07-24T00:14:42.5630638Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-24T00:14:42.5641385Z [submariner-operator]$ i=1
2021-07-24T00:14:42.5653244Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:14:42.5669189Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:14:42.5690176Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-24T00:14:42.5704438Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-24T00:14:42.5720298Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-24T00:14:42.5735728Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:14:42.5746991Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:14:42.5765132Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-24T00:14:42.5777531Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-24T00:14:42.5789531Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-24T00:14:42.5805311Z [submariner-operator]$ [cluster2] wait 7001
2021-07-24T00:14:42.5812709Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5825067Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5840738Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5859496Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5878383Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:14:42.5899032Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:14:42.5918409Z [submariner-operator]$ [cluster1] pids[cluster1]=7010
2021-07-24T00:14:42.5925070Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:14:42.5942297Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5952809Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:14:42.5969672Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-24T00:14:42.5992337Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:14:42.6094818Z [submariner-operator]$ [cluster2] pids[cluster2]=7013
2021-07-24T00:14:42.6130248Z [submariner-operator]$ [cluster2] wait 7013
2021-07-24T00:14:42.6144372Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:14:49.7963899Z [submariner-operator]$ [cluster2] with_retries
2021-07-24T00:14:49.7965471Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:14:49.7966681Z [submariner-operator]$ [cluster2] wait 7026
2021-07-24T00:14:49.7967934Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-24T00:14:49.7969665Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-24T00:14:49.7971735Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7974294Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7977823Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-24T00:14:49.7978879Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-24T00:14:49.7979868Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-24T00:14:49.7981134Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-24T00:14:49.7982196Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-24T00:14:49.7983158Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-24T00:14:49.7984178Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-24T00:14:49.7985773Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-24T00:14:49.7987478Z [submariner-operator]$ [cluster2] head -n 1
2021-07-24T00:14:49.7989377Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7991758Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7994136Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7996626Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.7999284Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.8001643Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-24T00:14:49.8003147Z [submariner-operator]$ [cluster2] return
2021-07-24T00:14:49.8004018Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:14:49.8032855Z [submariner-operator]$ [cluster2] wait 7010
2021-07-24T00:14:49.9243386Z [submariner-operator]$ [cluster1] with_retries
2021-07-24T00:14:49.9244448Z [submariner-operator]$ [cluster1] iteration=1
2021-07-24T00:14:49.9245422Z [submariner-operator]$ [cluster1] wait 7041
2021-07-24T00:14:49.9246415Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-24T00:14:49.9247495Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-24T00:14:49.9249324Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9251478Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9253212Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-24T00:14:49.9254266Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-24T00:14:49.9255649Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-24T00:14:49.9256822Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-24T00:14:49.9257891Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-24T00:14:49.9258865Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-24T00:14:49.9259882Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-24T00:14:49.9261505Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-24T00:14:49.9262959Z [submariner-operator]$ [cluster1] head -n 1
2021-07-24T00:14:49.9264818Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9267206Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9269558Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9272133Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9274924Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9277387Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-24T00:14:49.9278876Z [submariner-operator]$ [cluster1] return
2021-07-24T00:14:49.9279817Z [submariner-operator]$ [cluster1] return 0
2021-07-24T00:14:49.9419185Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-24T00:14:49.9443918Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-24T00:14:49.9460875Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-24T00:14:49.9462013Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-24T00:14:49.9462602Z
2021-07-24T00:14:49.9463632Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-24T00:14:49.9464299Z
2021-07-24T00:14:49.9465058Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-24T00:14:49.9465552Z
2021-07-24T00:14:49.9466255Z To clean everthing up, just run: make clean-clusters
2021-07-24T00:14:49.9466919Z EOM
2021-07-24T00:14:49.9479910Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-24T00:14:49.9480490Z
2021-07-24T00:14:49.9481610Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-24T00:14:49.9482399Z
2021-07-24T00:14:49.9483735Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-24T00:14:49.9484223Z
2021-07-24T00:14:49.9484969Z To clean everthing up, just run: make clean-clusters
2021-07-24T00:14:49.9501474Z Successfully remade target file 'clusters'.
2021-07-24T00:14:49.9502365Z File 'preload-images' does not exist.
2021-07-24T00:14:49.9503115Z File 'images' does not exist.
2021-07-24T00:14:49.9522503Z File 'package/.image.submariner-operator' does not exist.
2021-07-24T00:14:49.9695238Z find: 'bin/submariner-operator': No such file or directory
2021-07-24T00:14:50.3170567Z File 'bin/submariner-operator' does not exist.
2021-07-24T00:14:50.3175618Z File 'generate-embeddedyamls' does not exist.
2021-07-24T00:14:50.3176594Z File 'generate' does not exist.
2021-07-24T00:14:50.3177340Z Must remake target 'generate'.
2021-07-24T00:14:50.3200328Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-24T00:14:53.7873423Z Successfully remade target file 'generate'.
2021-07-24T00:14:53.7998239Z Must remake target 'generate-embeddedyamls'.
2021-07-24T00:14:53.7999374Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-24T00:14:53.8000398Z Must remake target 'bin/submariner-operator'.
2021-07-24T00:14:53.8001124Z /opt/shipyard/scripts/compile.sh \
2021-07-24T00:14:53.8002266Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829" \
2021-07-24T00:14:53.8003356Z bin/submariner-operator main.go
2021-07-24T00:14:53.8455345Z [submariner-operator]$ mkdir -p bin
2021-07-24T00:14:53.8475439Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829')
2021-07-24T00:14:53.8485480Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829
2021-07-24T00:14:53.8497752Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829 -o bin/submariner-operator main.go
2021-07-24T00:15:11.2743031Z [submariner-operator]$ upx bin/submariner-operator
2021-07-24T00:15:17.2511215Z Ultimate Packer for eXecutables
2021-07-24T00:15:17.2512511Z Copyright (C) 1996 - 2020
2021-07-24T00:15:17.2513169Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-24T00:15:17.2513624Z
2021-07-24T00:15:17.2514087Z File size Ratio Format Name
2021-07-24T00:15:17.2514838Z -------------------- ------ ----------- -----------
2021-07-24T00:15:17.2515714Z 34463744 -> 9933196 28.82% linux/amd64 submariner-operator
2021-07-24T00:15:17.2516266Z
2021-07-24T00:15:17.2516769Z Packed 1 file.
2021-07-24T00:15:17.2527621Z Successfully remade target file 'bin/submariner-operator'.
2021-07-24T00:15:17.2529224Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-24T00:15:17.2530846Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-24T00:15:17.2532304Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-24T00:15:17.2533404Z File 'FORCE_IMAGE' does not exist.
2021-07-24T00:15:17.2534126Z Must remake target 'FORCE_IMAGE'.
2021-07-24T00:15:17.2535323Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-24T00:15:17.2536387Z Must remake target 'package/.image.submariner-operator'.
2021-07-24T00:15:17.2538245Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-24T00:15:17.3084258Z flags:WARN flag short name (h) already defined
2021-07-24T00:15:17.3642036Z [submariner-operator]$ set -e
2021-07-24T00:15:17.3656752Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:17.3671523Z [submariner-operator]$ cache_flag=
2021-07-24T00:15:17.3685798Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:17.3704357Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:17.6640091Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:18.1698340Z devel: Pulling from submariner/submariner-operator
2021-07-24T00:15:18.1698999Z be073bd856b4: Pulling fs layer
2021-07-24T00:15:18.2633065Z be073bd856b4: Verifying Checksum
2021-07-24T00:15:18.2633661Z be073bd856b4: Download complete
2021-07-24T00:15:18.5039784Z be073bd856b4: Pull complete
2021-07-24T00:15:18.5077184Z Digest: sha256:9d1e801112c979f511d54b6ddc2b3ab3b1f06244ba897a566461f0f8316e0604
2021-07-24T00:15:18.5098565Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:18.5137301Z quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:18.5176918Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-24T00:15:18.5178246Z [submariner-operator]$ cut -f2 -d 
2021-07-24T00:15:18.5189825Z [submariner-operator]$ grep -v scratch
2021-07-24T00:15:18.5222436Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-24T00:15:18.5260144Z 
2021-07-24T00:15:19.4545947Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-24T00:15:20.3433693Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-24T00:15:20.3524867Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-24T00:15:21.2382502Z buildx_builder
2021-07-24T00:15:21.2451819Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-24T00:15:22.1672529Z #1 [internal] booting buildkit
2021-07-24T00:15:22.1673887Z #1 sha256:52c9a44fe230466257432a24e191f825deec9161e2dbf6cdfc535696baa0779b
2021-07-24T00:15:22.3169424Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-24T00:15:25.9168641Z #1 pulling image moby/buildkit:buildx-stable-1 3.7s done
2021-07-24T00:15:26.0700471Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-24T00:15:26.8176658Z #1 creating container buildx_buildkit_buildx_builder0 0.8s done
2021-07-24T00:15:26.8177316Z #1 DONE 4.6s
2021-07-24T00:15:27.0772416Z
2021-07-24T00:15:27.0775259Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-24T00:15:27.0776946Z #2 sha256:b77ba70d66c85de2f6385d9c17ef1ec3bde06a5343d15a57904699871a881f39
2021-07-24T00:15:27.0778211Z #2 transferring dockerfile: 230B done
2021-07-24T00:15:27.0778837Z #2 DONE 0.0s
2021-07-24T00:15:27.0779184Z
2021-07-24T00:15:27.0779667Z #3 [internal] load .dockerignore
2021-07-24T00:15:27.0780647Z #3 sha256:68e2039126a3172b8b10fa2f2f452560737b558ee1839a6a49f877181d25deeb
2021-07-24T00:15:27.0781633Z #3 transferring context: 2B done
2021-07-24T00:15:27.0782185Z #3 DONE 0.0s
2021-07-24T00:15:27.2277485Z
2021-07-24T00:15:27.2278691Z #4 [internal] load build context
2021-07-24T00:15:27.2280082Z #4 sha256:8ba3604a3da09a94740cfc30f4c115d83544f7aeb3a7fff556bc6977660603dc
2021-07-24T00:15:27.2281181Z #4 DONE 0.0s
2021-07-24T00:15:27.2281557Z
2021-07-24T00:15:27.2283019Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:27.2284723Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-24T00:15:27.6333805Z #6 DONE 0.6s
2021-07-24T00:15:27.7400657Z
2021-07-24T00:15:27.7401864Z #4 [internal] load build context
2021-07-24T00:15:27.7403187Z #4 sha256:8ba3604a3da09a94740cfc30f4c115d83544f7aeb3a7fff556bc6977660603dc
2021-07-24T00:15:27.9506456Z #4 transferring context: 9.94MB 0.3s done
2021-07-24T00:15:27.9507234Z #4 DONE 0.3s
2021-07-24T00:15:27.9507610Z
2021-07-24T00:15:27.9509014Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-24T00:15:27.9510138Z #5 sha256:6e173ab17b8311986894225652938b64e640404ccf0b09672631419f296e8985
2021-07-24T00:15:28.1007697Z #5 CACHED
2021-07-24T00:15:28.1008207Z
2021-07-24T00:15:28.1009299Z #7 exporting to oci image format
2021-07-24T00:15:28.1010511Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-24T00:15:28.1011572Z #7 exporting layers done
2021-07-24T00:15:28.1015206Z #7 exporting manifest sha256:48112e796c8b0ea3a006a3cc3d126791674b8488dd8d28a1b515e6d06b352be9 done
2021-07-24T00:15:28.1017280Z #7 exporting config sha256:2c1868d0daafbfe83810cd61b3db32e91931ac5c29577271ec167c57891c1d09 done
2021-07-24T00:15:28.2511810Z #7 ...
2021-07-24T00:15:28.2512220Z
2021-07-24T00:15:28.2513454Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-24T00:15:28.2514614Z #5 sha256:6e173ab17b8311986894225652938b64e640404ccf0b09672631419f296e8985
2021-07-24T00:15:28.2515875Z #5 sha256:be073bd856b4588c315d89d54c4eb17bd45f8963419938a6b542f25a32c47c70 0B / 9.62MB 0.2s
2021-07-24T00:15:28.2516801Z #5 CACHED
2021-07-24T00:15:28.4015941Z
2021-07-24T00:15:28.4020709Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-24T00:15:28.4027804Z #5 sha256:6e173ab17b8311986894225652938b64e640404ccf0b09672631419f296e8985
2021-07-24T00:15:28.4053523Z #5 sha256:be073bd856b4588c315d89d54c4eb17bd45f8963419938a6b542f25a32c47c70 9.62MB / 9.62MB 0.3s done
2021-07-24T00:15:28.4055026Z #5 CACHED
2021-07-24T00:15:28.4055276Z
2021-07-24T00:15:28.4055676Z #7 exporting to oci image format
2021-07-24T00:15:28.4056676Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-24T00:15:28.4057600Z #7 sending tarball
2021-07-24T00:15:28.5872754Z #7 sending tarball 0.3s done
2021-07-24T00:15:28.5873352Z #7 DONE 0.6s
2021-07-24T00:15:28.5873817Z
2021-07-24T00:15:28.5874251Z #9 exporting cache
2021-07-24T00:15:28.5884389Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-24T00:15:28.5885541Z #9 preparing build cache for export done
2021-07-24T00:15:28.5888860Z #9 DONE 0.0s
2021-07-24T00:15:28.5893308Z
2021-07-24T00:15:28.5894149Z #8 importing to docker
2021-07-24T00:15:28.5895986Z #8 sha256:98bdbba088fd3079ad82264914da21982add9d14a752890031173f3a4f267176
2021-07-24T00:15:28.5896917Z #8 DONE 0.0s
2021-07-24T00:15:28.5991431Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-24T00:15:28.9080886Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-24T00:15:28.9082089Z File 'build' does not exist.
2021-07-24T00:15:28.9083111Z File 'bin/subctl-devel-43b9829-linux-amd64' does not exist.
2021-07-24T00:15:28.9319252Z Must remake target 'bin/subctl-devel-43b9829-linux-amd64'.
2021-07-24T00:15:28.9320385Z mkdir -p bin
2021-07-24T00:15:28.9351215Z target=bin/subctl-devel-43b9829-linux-amd64; \
2021-07-24T00:15:28.9352018Z target=${target%.exe}; \
2021-07-24T00:15:28.9352808Z components=($(echo ${target//-/ })); \
2021-07-24T00:15:28.9353478Z GOOS=${components[-2]}; \
2021-07-24T00:15:28.9354117Z GOARCH=${components[-1]}; \
2021-07-24T00:15:28.9354741Z export GOARCH GOOS; \
2021-07-24T00:15:28.9355297Z /opt/shipyard/scripts/compile.sh \
2021-07-24T00:15:28.9356521Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829 \
2021-07-24T00:15:28.9358680Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-24T00:15:28.9360572Z --noupx bin/subctl-devel-43b9829-linux-amd64 ./pkg/subctl/main.go
2021-07-24T00:15:29.0043208Z [submariner-operator]$ mkdir -p bin
2021-07-24T00:15:29.0062560Z Building 'bin/subctl-devel-43b9829-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829 \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-24T00:15:29.0079599Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-24T00:15:29.0097182Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-43b9829 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-43b9829-linux-amd64 ./pkg/subctl/main.go
2021-07-24T00:15:32.7377642Z Successfully remade target file 'bin/subctl-devel-43b9829-linux-amd64'.
2021-07-24T00:15:32.7379122Z Prerequisite 'bin/subctl-devel-43b9829-linux-amd64' is newer than target 'bin/subctl'.
2021-07-24T00:15:32.7380187Z Must remake target 'bin/subctl'.
2021-07-24T00:15:32.7381070Z ln -sf subctl-devel-43b9829-linux-amd64 bin/subctl
2021-07-24T00:15:32.7425575Z Successfully remade target file 'bin/subctl'.
2021-07-24T00:15:32.7426428Z Must remake target 'build'.
2021-07-24T00:15:32.7427283Z Successfully remade target file 'build'.
2021-07-24T00:15:32.7428040Z Must remake target 'images'.
2021-07-24T00:15:32.7428937Z Successfully remade target file 'images'.
2021-07-24T00:15:32.7429770Z Must remake target 'preload-images'.
2021-07-24T00:15:32.7434268Z set -e;\
2021-07-24T00:15:32.7435002Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-24T00:15:32.7435797Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-24T00:15:32.7437291Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-24T00:15:32.7438637Z import_image quay.io/submariner/${image};\
2021-07-24T00:15:32.7439345Z done
2021-07-24T00:15:32.7481805Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-24T00:15:32.7491153Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-24T00:15:32.7508714Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-24T00:15:33.0329306Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-24T00:15:33.3115725Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-24T00:15:33.3279076Z fd8f5c504639: Preparing
2021-07-24T00:15:33.9459406Z fd8f5c504639: Pushed
2021-07-24T00:15:33.9692541Z local: digest: sha256:9d1e801112c979f511d54b6ddc2b3ab3b1f06244ba897a566461f0f8316e0604 size: 528
2021-07-24T00:15:33.9703690Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-24T00:15:33.9705549Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-24T00:15:33.9728556Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-24T00:15:34.2603794Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-24T00:15:34.2633094Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-24T00:15:34.7342991Z devel: Pulling from submariner/submariner-gateway
2021-07-24T00:15:34.7349336Z 17dc2ff37005: Pulling fs layer
2021-07-24T00:15:34.7349915Z a717f630b591: Pulling fs layer
2021-07-24T00:15:34.7350536Z dd71758fb1cb: Pulling fs layer
2021-07-24T00:15:34.7351055Z 4716eab9dbee: Pulling fs layer
2021-07-24T00:15:34.7356431Z 4716eab9dbee: Waiting
2021-07-24T00:15:34.7664723Z a717f630b591: Verifying Checksum
2021-07-24T00:15:34.7665376Z a717f630b591: Download complete
2021-07-24T00:15:34.9734258Z 4716eab9dbee: Verifying Checksum
2021-07-24T00:15:34.9735092Z 4716eab9dbee: Download complete
2021-07-24T00:15:35.0115008Z dd71758fb1cb: Verifying Checksum
2021-07-24T00:15:35.0115649Z dd71758fb1cb: Download complete
2021-07-24T00:15:35.2809397Z 17dc2ff37005: Verifying Checksum
2021-07-24T00:15:35.2810035Z 17dc2ff37005: Download complete
2021-07-24T00:15:38.4726543Z 17dc2ff37005: Pull complete
2021-07-24T00:15:39.4580427Z a717f630b591: Pull complete
2021-07-24T00:15:40.7528866Z dd71758fb1cb: Pull complete
2021-07-24T00:15:40.9980581Z 4716eab9dbee: Pull complete
2021-07-24T00:15:41.0015439Z Digest: sha256:5717397cd66d1c24de5c8a254b00a5666868d23a79300eb5573e2c7afdae19a9
2021-07-24T00:15:41.0045987Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-24T00:15:41.0047230Z quay.io/submariner/submariner-gateway:devel
2021-07-24T00:15:41.0076464Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-24T00:15:41.3155451Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-24T00:15:41.6024863Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-24T00:15:41.8907106Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-24T00:15:41.8968779Z 676ab2d1517a: Preparing
2021-07-24T00:15:41.8969484Z 6d1af7484677: Preparing
2021-07-24T00:15:41.8969996Z 0432220b9aee: Preparing
2021-07-24T00:15:41.8970459Z 4a8f833868b9: Preparing
2021-07-24T00:15:42.9715795Z 0432220b9aee: Pushed
2021-07-24T00:15:43.7300735Z 676ab2d1517a: Pushed
2021-07-24T00:15:46.4719131Z 6d1af7484677: Pushed
2021-07-24T00:15:54.5379154Z 4a8f833868b9: Pushed
2021-07-24T00:15:54.5638416Z local: digest: sha256:5717397cd66d1c24de5c8a254b00a5666868d23a79300eb5573e2c7afdae19a9 size: 1159
2021-07-24T00:15:54.5678186Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-24T00:15:54.5689374Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-24T00:15:54.5699215Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-24T00:15:54.8543250Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-24T00:15:54.8573851Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-24T00:15:55.2947204Z devel: Pulling from submariner/submariner-route-agent
2021-07-24T00:15:55.2948013Z 17dc2ff37005: Already exists
2021-07-24T00:15:55.2966109Z a717f630b591: Already exists
2021-07-24T00:15:55.2991111Z 9a23ad724b82: Pulling fs layer
2021-07-24T00:15:55.2991726Z dc768fed2420: Pulling fs layer
2021-07-24T00:15:55.2992281Z da3d5c886ecf: Pulling fs layer
2021-07-24T00:15:55.2992803Z 061e8a49d6f8: Pulling fs layer
2021-07-24T00:15:55.2993290Z 061e8a49d6f8: Waiting
2021-07-24T00:15:55.3423312Z da3d5c886ecf: Verifying Checksum
2021-07-24T00:15:55.3424180Z da3d5c886ecf: Download complete
2021-07-24T00:15:55.4483154Z dc768fed2420: Verifying Checksum
2021-07-24T00:15:55.4483801Z dc768fed2420: Download complete
2021-07-24T00:15:55.4565744Z 061e8a49d6f8: Verifying Checksum
2021-07-24T00:15:55.4566350Z 061e8a49d6f8: Download complete
2021-07-24T00:15:55.5306226Z 9a23ad724b82: Verifying Checksum
2021-07-24T00:15:55.5306868Z 9a23ad724b82: Download complete
2021-07-24T00:15:57.3184018Z 9a23ad724b82: Pull complete
2021-07-24T00:15:57.5361212Z dc768fed2420: Pull complete
2021-07-24T00:15:57.6178443Z da3d5c886ecf: Pull complete
2021-07-24T00:15:57.6982299Z 061e8a49d6f8: Pull complete
2021-07-24T00:15:57.7025465Z Digest: sha256:31285ba72798992853abe4851f40537bffe72b95e157df967252e3f2edebe89b
2021-07-24T00:15:57.7044229Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-24T00:15:57.7078852Z quay.io/submariner/submariner-route-agent:devel
2021-07-24T00:15:57.7096983Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-24T00:15:57.9909362Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-24T00:15:58.2680789Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-24T00:15:58.5554566Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-24T00:15:58.5557397Z 84dad629248e: Preparing
2021-07-24T00:15:58.5558008Z 3c9e98f3c90e: Preparing
2021-07-24T00:15:58.5558865Z fe3ead68d68f: Preparing
2021-07-24T00:15:58.5559551Z 76892dab4f49: Preparing
2021-07-24T00:15:58.5560067Z 0432220b9aee: Preparing
2021-07-24T00:15:58.5560861Z 4a8f833868b9: Preparing
2021-07-24T00:15:58.5562140Z 4a8f833868b9: Waiting
2021-07-24T00:15:58.8504431Z 3c9e98f3c90e: Pushed
2021-07-24T00:15:58.9811381Z 0432220b9aee: Mounted from submariner-gateway
2021-07-24T00:15:59.2503914Z 84dad629248e: Pushed
2021-07-24T00:15:59.3311719Z 4a8f833868b9: Mounted from submariner-gateway
2021-07-24T00:15:59.3799275Z fe3ead68d68f: Pushed
2021-07-24T00:16:03.4838011Z 76892dab4f49: Pushed
2021-07-24T00:16:03.5030482Z local: digest: sha256:31285ba72798992853abe4851f40537bffe72b95e157df967252e3f2edebe89b size: 1575
2021-07-24T00:16:03.5071477Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-24T00:16:03.5087067Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-24T00:16:03.5095278Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-24T00:16:03.7795895Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-24T00:16:03.7823203Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-24T00:16:04.3222507Z devel: Pulling from submariner/lighthouse-agent
2021-07-24T00:16:04.3223232Z ecd69139dc76: Pulling fs layer
2021-07-24T00:16:04.3223983Z 8261c1767de3: Pulling fs layer
2021-07-24T00:16:04.3722762Z ecd69139dc76: Verifying Checksum
2021-07-24T00:16:04.3723547Z ecd69139dc76: Download complete
2021-07-24T00:16:04.4744431Z ecd69139dc76: Pull complete
2021-07-24T00:16:04.5226613Z 8261c1767de3: Verifying Checksum
2021-07-24T00:16:04.5233630Z 8261c1767de3: Download complete
2021-07-24T00:16:04.7123260Z 8261c1767de3: Pull complete
2021-07-24T00:16:04.7172636Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-24T00:16:04.7194812Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-24T00:16:04.7215428Z quay.io/submariner/lighthouse-agent:devel
2021-07-24T00:16:04.7297681Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-24T00:16:05.0139117Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-24T00:16:05.3041599Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-24T00:16:05.6261447Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-24T00:16:05.6316901Z 83c79e393e11: Preparing
2021-07-24T00:16:05.6317450Z 0026d2f62bbf: Preparing
2021-07-24T00:16:05.6824371Z 0026d2f62bbf: Pushed
2021-07-24T00:16:06.1692660Z 83c79e393e11: Pushed
2021-07-24T00:16:06.1864167Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-24T00:16:06.1900552Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-24T00:16:06.1921988Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-24T00:16:06.1958816Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-24T00:16:06.4930923Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-24T00:16:06.4965318Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-24T00:16:06.9922617Z devel: Pulling from submariner/lighthouse-coredns
2021-07-24T00:16:06.9923386Z 088e56360f76: Pulling fs layer
2021-07-24T00:16:06.9923901Z 18aed70882d2: Pulling fs layer
2021-07-24T00:16:07.0621759Z 088e56360f76: Verifying Checksum
2021-07-24T00:16:07.0622394Z 088e56360f76: Download complete
2021-07-24T00:16:07.1704576Z 18aed70882d2: Verifying Checksum
2021-07-24T00:16:07.1705296Z 18aed70882d2: Download complete
2021-07-24T00:16:07.2603766Z 088e56360f76: Pull complete
2021-07-24T00:16:07.6065060Z 18aed70882d2: Pull complete
2021-07-24T00:16:07.6102878Z Digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6
2021-07-24T00:16:07.6121218Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-24T00:16:07.6150945Z quay.io/submariner/lighthouse-coredns:devel
2021-07-24T00:16:07.6177694Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-24T00:16:07.8991040Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-24T00:16:08.1980639Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-24T00:16:08.4678561Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-24T00:16:08.4732120Z 7fca351e51be: Preparing
2021-07-24T00:16:08.4732767Z 4fa0ece06e25: Preparing
2021-07-24T00:16:08.5368114Z 4fa0ece06e25: Pushed
2021-07-24T00:16:09.2824130Z 7fca351e51be: Pushed
2021-07-24T00:16:09.3046674Z local: digest: sha256:92280c8723eb4400aeadedcb1885052b0d8344fc4c3efeee4cc91d10c5d29dd6 size: 739
2021-07-24T00:16:09.3077915Z Successfully remade target file 'preload-images'.
2021-07-24T00:16:09.3078965Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-24T00:16:09.3080004Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-24T00:16:09.3081323Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-24T00:16:09.3082107Z Must remake target 'deploy'.
2021-07-24T00:16:09.3086231Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:16:09.4089906Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-24T00:16:09.4155006Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-24T00:16:09.4167117Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:16:09.4277828Z [submariner-operator]$ script_name=utils
2021-07-24T00:16:09.4278822Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:16:09.4279967Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-24T00:16:09.4281312Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:16:09.4282697Z [submariner-operator]$ script_name=deploy_funcs
2021-07-24T00:16:09.4290963Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:16:09.4344932Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-24T00:16:09.4362218Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:16:09.4384285Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:16:09.4399622Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:16:09.4461411Z [submariner-operator]$ broker=cluster1
2021-07-24T00:16:09.4473617Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-24T00:16:09.4485365Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-24T00:16:09.4647826Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-24T00:16:09.4699181Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-24T00:16:09.4773924Z [submariner-operator]$ declare -gA cluster_subm
2021-07-24T00:16:09.4826087Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-24T00:16:09.4837505Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-24T00:16:09.4846928Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-24T00:16:09.4853784Z [submariner-operator]$ declare -gA cluster_cni
2021-07-24T00:16:09.4866854Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-24T00:16:09.4878703Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-24T00:16:09.4888081Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:16:09.4906047Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:16:09.4913693Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:16:09.4926327Z [submariner-operator]$ exec_name=deploy.sh
2021-07-24T00:16:09.4951753Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-24T00:16:09.4963006Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-24T00:16:09.4996258Z [submariner-operator]$ declare_cidrs
2021-07-24T00:16:09.5010646Z [submariner-operator]$ declare_cidrs
2021-07-24T00:16:09.5025210Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-24T00:16:09.5037717Z [submariner-operator]$ i=1
2021-07-24T00:16:09.5052388Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:16:09.5066311Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:16:09.5082727Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-24T00:16:09.5097077Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-24T00:16:09.5112968Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-24T00:16:09.5128296Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:16:09.5144605Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:16:09.5160824Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-24T00:16:09.5172058Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-24T00:16:09.5189620Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-24T00:16:09.5198827Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-24T00:16:09.5212755Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-24T00:16:09.5226530Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-24T00:16:09.5245800Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-24T00:16:09.5261020Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-24T00:16:09.5280569Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-24T00:16:09.5312859Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-24T00:16:09.6300325Z Installing subctl version devel
2021-07-24T00:16:09.6305403Z OS detected: linux
2021-07-24T00:16:09.6308085Z Architecture detected: amd64
2021-07-24T00:16:09.6314135Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-24T00:16:09.6315288Z
2021-07-24T00:16:09.6315715Z Downloading...
2021-07-24T00:16:10.9926258Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-24T00:16:11.0411906Z This provides subctl version: devel
2021-07-24T00:16:11.0453754Z
2021-07-24T00:16:11.0455356Z please update your path (and consider adding it to ~/.profile):
2021-07-24T00:16:11.0456033Z export PATH=$PATH:/go/bin
2021-07-24T00:16:11.0456461Z
2021-07-24T00:16:11.0572210Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-24T00:16:11.0588890Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-24T00:16:11.0595028Z Will deploy submariner using operator
2021-07-24T00:16:11.0608867Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-24T00:16:11.0637090Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:16:11.0653740Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-24T00:16:11.0669031Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-24T00:16:11.0693553Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-24T00:16:11.0708454Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-24T00:16:11.0727562Z 
2021-07-24T00:16:11.0746117Z [submariner-operator]$ [cluster2] subctl version
2021-07-24T00:16:11.1001489Z subctl version: devel-43b9829
2021-07-24T00:16:11.1033631Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-24T00:16:11.1053713Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-24T00:16:11.1067966Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-24T00:16:11.1086721Z [submariner-operator]$ [cluster2] grep -q function
2021-07-24T00:16:11.1122933Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:16:11.1139025Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-24T00:16:11.1154416Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-24T00:16:11.1168424Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-24T00:16:11.1205475Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-24T00:16:11.1219302Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-24T00:16:11.1234391Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:16:11.1259522Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:16:11.1282247Z [submariner-operator]$ [cluster1] pids[cluster1]=8655
2021-07-24T00:16:11.1313321Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:16:11.1329513Z [submariner-operator]$ [cluster2] pids[cluster2]=8657
2021-07-24T00:16:11.1333199Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:16:11.1347877Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-24T00:16:11.1357299Z [submariner-operator]$ [cluster2] wait 8657
2021-07-24T00:16:11.1368040Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-24T00:16:11.1387252Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:16:11.1394696Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:16:11.5798739Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-24T00:16:11.5799895Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-24T00:16:11.5801029Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-24T00:16:11.5802444Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.5804105Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.5805935Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.5807435Z [cluster2] node/cluster2-worker not labeled
2021-07-24T00:16:11.5836914Z [submariner-operator]$ [cluster2] wait 8655
2021-07-24T00:16:11.6221844Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-24T00:16:11.6223222Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-24T00:16:11.6224454Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-24T00:16:11.6225872Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.6227533Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.6229337Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-24T00:16:11.6230794Z [cluster1] node/cluster1-worker not labeled
2021-07-24T00:16:11.6244264Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-24T00:16:11.6260352Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-24T00:16:11.6279618Z [submariner-operator]$ [cluster1] setup_broker
2021-07-24T00:16:11.6290820Z [submariner-operator]$ [cluster1] setup_broker
2021-07-24T00:16:11.6299916Z Installing broker...
2021-07-24T00:16:11.6315792Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-24T00:16:11.6340376Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-24T00:16:11.6359726Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-24T00:16:11.6375518Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-24T00:16:11.6753329Z • Setting up broker RBAC ...
2021-07-24T00:16:11.7204260Z ✓ Setting up broker RBAC
2021-07-24T00:16:11.7205122Z • Deploying the Submariner operator ...
2021-07-24T00:16:17.9035120Z ✓ Deploying the Submariner operator
2021-07-24T00:16:17.9036002Z ✓ Created operator service account and role
2021-07-24T00:16:17.9036909Z ✓ Created Lighthouse service accounts and roles
2021-07-24T00:16:17.9037662Z • Deploying the broker ...
2021-07-24T00:16:18.9778944Z ✓ Deploying the broker
2021-07-24T00:16:18.9779680Z ✓ The broker has been deployed
2021-07-24T00:16:18.9780454Z • Creating broker-info.subm file ...
2021-07-24T00:16:19.0030213Z ✓ Creating broker-info.subm file
2021-07-24T00:16:19.0031406Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-24T00_16_18Z
2021-07-24T00:16:19.0032747Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-24T00:16:19.0087915Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-24T00:16:19.0103421Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-24T00:16:19.0130265Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-24T00:16:19.0169457Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-24T00:16:19.0187547Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-24T00:16:19.0349403Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-24T00:16:19.0366451Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-24T00:16:19.0381937Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:16:19.0410042Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:16:19.0436056Z [submariner-operator]$ [cluster1] pids[cluster1]=8719
2021-07-24T00:16:19.0467855Z [submariner-operator]$ [cluster2] pids[cluster2]=8721
2021-07-24T00:16:19.0480565Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:16:19.0507498Z [submariner-operator]$ [cluster2] wait 8721
2021-07-24T00:16:19.0520528Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-24T00:16:19.0534934Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:16:19.0551133Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:16:19.0572502Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-24T00:16:19.0633423Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:16:38.8776623Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-24T00:16:38.8777841Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-24T00:16:38.8779119Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-24T00:16:38.8780398Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-24T00:16:38.8783683Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-24T00:16:38.8786773Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-24T00:16:38.8787729Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-24T00:16:38.8788392Z [cluster2] - cluster2-worker
2021-07-24T00:16:38.8789058Z [cluster2] • Discovering network details ...
2021-07-24T00:16:38.8789725Z [cluster2] Network plugin: weave-net
2021-07-24T00:16:38.8790418Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-24T00:16:38.8790887Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-24T00:16:38.8791520Z [cluster2] ✓ Discovering network details
2021-07-24T00:16:38.8792222Z [cluster2] • Discovering multi cluster details ...
2021-07-24T00:16:38.8792972Z [cluster2] • Validating Globalnet configurations ...
2021-07-24T00:16:38.8793727Z [cluster2] ✓ Validating Globalnet configurations
2021-07-24T00:16:38.8794464Z [cluster2] ✓ Discovering multi cluster details
2021-07-24T00:16:38.8795171Z [cluster2] • Deploying the Submariner operator ...
2021-07-24T00:16:38.8795890Z [cluster2] ✓ Deploying the Submariner operator
2021-07-24T00:16:38.8796612Z [cluster2] ✓ Created operator service account and role
2021-07-24T00:16:38.8797384Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-24T00:16:38.8798066Z [cluster2] • Creating SA for cluster ...
2021-07-24T00:16:38.8798671Z [cluster2] ✓ Creating SA for cluster
2021-07-24T00:16:38.8799292Z [cluster2] • Deploying Submariner ...
2021-07-24T00:16:38.8799895Z [cluster2] ✓ Deploying Submariner
2021-07-24T00:16:38.8800519Z [cluster2] ✓ Submariner is up and running
2021-07-24T00:16:38.8832869Z [submariner-operator]$ [cluster2] wait 8719
2021-07-24T00:16:43.6450332Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-24T00:16:43.6451469Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-24T00:16:43.6452785Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-24T00:16:43.6454031Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-24T00:16:43.6457533Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-24T00:16:43.6460912Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-24T00:16:43.6462015Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-24T00:16:43.6462755Z [cluster1] - cluster1-worker
2021-07-24T00:16:43.6463522Z [cluster1] • Discovering network details ...
2021-07-24T00:16:43.6464514Z [cluster1] Network plugin: weave-net
2021-07-24T00:16:43.6465100Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-24T00:16:43.6465636Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-24T00:16:43.6466368Z [cluster1] ✓ Discovering network details
2021-07-24T00:16:43.6467170Z [cluster1] • Discovering multi cluster details ...
2021-07-24T00:16:43.6468321Z [cluster1] • Validating Globalnet configurations ...
2021-07-24T00:16:43.6469205Z [cluster1] ✓ Validating Globalnet configurations
2021-07-24T00:16:43.6470032Z [cluster1] ✓ Discovering multi cluster details
2021-07-24T00:16:43.6470955Z [cluster1] • Deploying the Submariner operator ...
2021-07-24T00:16:43.6471780Z [cluster1] ✓ Deploying the Submariner operator
2021-07-24T00:16:43.6472652Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-24T00:16:43.6473461Z [cluster1] • Creating SA for cluster ...
2021-07-24T00:16:43.6474138Z [cluster1] ✓ Creating SA for cluster
2021-07-24T00:16:43.6474857Z [cluster1] • Deploying Submariner ...
2021-07-24T00:16:43.6475622Z [cluster1] ✓ Deploying Submariner
2021-07-24T00:16:43.6476471Z [cluster1] ✓ Submariner is up and running
2021-07-24T00:16:43.6502428Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-24T00:16:43.6530269Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-24T00:16:43.6572455Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-24T00:16:43.6594654Z [submariner-operator]$ [cluster2] with_retries
2021-07-24T00:16:43.6659026Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:16:43.6770877Z [submariner-operator]$ [cluster2] wait 8763
2021-07-24T00:16:43.6790705Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:43.6819784Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:43.6852858Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:16:43.6897085Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:43.7011340Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:16:44.1062019Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:44.1084931Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:16:44.5117118Z • Showing Connections ...
2021-07-24T00:16:44.5550633Z ✗ Showing Connections
2021-07-24T00:16:44.5551991Z ✗ There are no gateways detected
2021-07-24T00:16:44.5755567Z • Showing Connections ...
2021-07-24T00:16:44.5855342Z ✗ Showing Connections
2021-07-24T00:16:44.5856594Z ✗ There are no gateways detected
2021-07-24T00:16:44.5880012Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:16:44.5895271Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:16:50.5934926Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:16:50.5981512Z [submariner-operator]$ [cluster2] wait 8790
2021-07-24T00:16:50.5987360Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:50.6002235Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:50.6070897Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:16:50.6081285Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:50.6113251Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:16:51.7924532Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:51.7937330Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:16:52.1712224Z • Showing Connections ...
2021-07-24T00:16:52.2338694Z ✗ Showing Connections
2021-07-24T00:16:52.2344578Z ✗ There are no gateways detected
2021-07-24T00:16:52.2897038Z • Showing Connections ...
2021-07-24T00:16:52.3035994Z ✗ Showing Connections
2021-07-24T00:16:52.3037438Z ✗ There are no gateways detected
2021-07-24T00:16:52.3038969Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:16:52.3040868Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:16:58.3049063Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:16:58.3175572Z [submariner-operator]$ [cluster2] wait 8816
2021-07-24T00:16:58.3372971Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:58.3424122Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:16:58.3434498Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:16:58.3462141Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:58.3567836Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:16:58.7869183Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:16:58.7905453Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:16:59.0192848Z • Showing Connections ...
2021-07-24T00:16:59.0282939Z ✗ Showing Connections
2021-07-24T00:16:59.0283766Z ✗ There are no gateways detected
2021-07-24T00:16:59.0563036Z • Showing Connections ...
2021-07-24T00:16:59.1249375Z ✗ Showing Connections
2021-07-24T00:16:59.1250587Z ✗ There are no gateways detected
2021-07-24T00:16:59.1273689Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:16:59.1288932Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:17:05.1323519Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:17:05.1361072Z [submariner-operator]$ [cluster2] wait 8842
2021-07-24T00:17:05.1374273Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:05.1407452Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:05.1540300Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:17:05.1722261Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:05.1751200Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:17:05.6260806Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:05.6275672Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:17:05.8276982Z • Showing Connections ...
2021-07-24T00:17:05.8348762Z ✗ Showing Connections
2021-07-24T00:17:05.8349510Z ✗ There are no gateways detected
2021-07-24T00:17:05.8434113Z • Showing Connections ...
2021-07-24T00:17:05.8464745Z ✗ Showing Connections
2021-07-24T00:17:05.8465485Z ✗ There are no gateways detected
2021-07-24T00:17:05.8492174Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:17:05.8510441Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:17:11.8544100Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:17:11.8598280Z [submariner-operator]$ [cluster2] wait 8869
2021-07-24T00:17:11.8610743Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:11.8658169Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:11.8693576Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:17:11.8712710Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:11.8799145Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:17:12.1032879Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:12.1052965Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:17:12.7887212Z • Showing Connections ...
2021-07-24T00:17:12.8338768Z ✗ Showing Connections
2021-07-24T00:17:12.8339428Z ✗ No connections found
2021-07-24T00:17:12.8709881Z • Showing Connections ...
2021-07-24T00:17:12.8895517Z ✗ Showing Connections
2021-07-24T00:17:12.8896655Z ✗ No connections found
2021-07-24T00:17:12.8924164Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-24T00:17:12.8938625Z [submariner-operator]$ [cluster2] sleep 6
2021-07-24T00:17:18.8969008Z [submariner-operator]$ [cluster2] return 1
2021-07-24T00:17:18.9010110Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:18.9015646Z [submariner-operator]$ [cluster2] wait 8896
2021-07-24T00:17:18.9024718Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-24T00:17:18.9038417Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-24T00:17:18.9050947Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:18.9068607Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-24T00:17:18.9966045Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-24T00:17:18.9983415Z [submariner-operator]$ [cluster2] grep connected
2021-07-24T00:17:19.0457047Z • Showing Connections ...
2021-07-24T00:17:19.0543318Z ✓ Showing Connections
2021-07-24T00:17:19.0651136Z • Showing Connections ...
2021-07-24T00:17:19.0692076Z ✓ Showing Connections
2021-07-24T00:17:19.0718067Z cluster2-worker cluster2 172.18.0.6 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 198.02µs
2021-07-24T00:17:19.0719275Z cluster1-worker cluster1 172.18.0.5 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 0s
2021-07-24T00:17:19.0732395Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:19.0751204Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:19.0765233Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-24T00:17:19.0778890Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-24T00:17:19.0793568Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-24T00:17:19.0808486Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-24T00:17:19.0821563Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-24T00:17:19.0833941Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-24T00:17:19.0849350Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-24T00:17:19.0869532Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-24T00:17:19.4113648Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-24T00:17:19.4176948Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-24T00:17:19.9228734Z devel: Pulling from submariner/nettest
2021-07-24T00:17:19.9229969Z 5843afab3874: Already exists
2021-07-24T00:17:19.9266060Z 2f9ee08e07bc: Pulling fs layer
2021-07-24T00:17:19.9279502Z 35de94ac9c6f: Pulling fs layer
2021-07-24T00:17:19.9285780Z a339bcd1def5: Pulling fs layer
2021-07-24T00:17:19.9821456Z 2f9ee08e07bc: Verifying Checksum
2021-07-24T00:17:19.9822715Z 2f9ee08e07bc: Download complete
2021-07-24T00:17:20.0096153Z a339bcd1def5: Verifying Checksum
2021-07-24T00:17:20.0098347Z a339bcd1def5: Download complete
2021-07-24T00:17:20.0294136Z 35de94ac9c6f: Verifying Checksum
2021-07-24T00:17:20.0295312Z 35de94ac9c6f: Download complete
2021-07-24T00:17:20.0893041Z 2f9ee08e07bc: Pull complete
2021-07-24T00:17:20.4176230Z 35de94ac9c6f: Pull complete
2021-07-24T00:17:20.5060343Z a339bcd1def5: Pull complete
2021-07-24T00:17:20.5124150Z Digest: sha256:00f8f803d538fcd48a221fa475b63aaaae80cc3b0770dd58b059a1e13e02cafd
2021-07-24T00:17:20.5148431Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-24T00:17:20.5217221Z quay.io/submariner/nettest:devel
2021-07-24T00:17:20.5299199Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-24T00:17:20.8746173Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-24T00:17:21.1813870Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-24T00:17:21.4875750Z The push refers to repository [localhost:5000/nettest]
2021-07-24T00:17:21.4919750Z 759c12f589e4: Preparing
2021-07-24T00:17:21.4920318Z c302bf42e436: Preparing
2021-07-24T00:17:21.4920786Z 0b74185e1b24: Preparing
2021-07-24T00:17:21.4921233Z 72e830a4dff5: Preparing
2021-07-24T00:17:22.1567904Z 759c12f589e4: Pushed
2021-07-24T00:17:22.1568903Z 0b74185e1b24: Pushed
2021-07-24T00:17:22.1569661Z 72e830a4dff5: Pushed
2021-07-24T00:17:22.8861345Z c302bf42e436: Pushed
2021-07-24T00:17:22.9037962Z local: digest: sha256:00f8f803d538fcd48a221fa475b63aaaae80cc3b0770dd58b059a1e13e02cafd size: 1155
2021-07-24T00:17:22.9117610Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:22.9129882Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:22.9144216Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-24T00:17:22.9162022Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-24T00:17:22.9199305Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:22.9216047Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:22.9232036Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:23.4256718Z deployment.apps/netshoot created
2021-07-24T00:17:23.4374082Z Waiting for netshoot pods to be ready.
2021-07-24T00:17:23.4396310Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-24T00:17:23.4467095Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-24T00:17:23.4481598Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-24T00:17:23.8116738Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-24T00:17:25.0280712Z deployment "netshoot" successfully rolled out
2021-07-24T00:17:25.0334971Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.0346970Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.0360946Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.0380413Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-24T00:17:25.0399054Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-24T00:17:25.0417017Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-24T00:17:25.0442632Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.0459757Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.0476532Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:25.5623293Z deployment.apps/nginx-demo created
2021-07-24T00:17:25.6113474Z service/nginx-demo created
2021-07-24T00:17:25.7089360Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-24T00:17:25.7167400Z Waiting for nginx-demo pods to be ready.
2021-07-24T00:17:25.7203614Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:17:25.7240332Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:17:25.7256755Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-24T00:17:26.2994556Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-24T00:17:27.2438242Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-24T00:17:27.4524193Z deployment "nginx-demo" successfully rolled out
2021-07-24T00:17:27.4575373Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-24T00:17:27.4593512Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-24T00:17:27.4615494Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-24T00:17:27.4638652Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-24T00:17:27.4656133Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-24T00:17:27.7879097Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-24T00:17:27.7901556Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-24T00:17:27.7916079Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-24T00:17:27.7928034Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-24T00:17:27.7941508Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-24T00:17:27.7957432Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-24T00:17:27.7975382Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:17:27.7992587Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-24T00:17:27.7996866Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:17:27.8014145Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-24T00:17:28.1394084Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-j479q 100.1.157.24
2021-07-24T00:17:28.1410886Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-j479q 100.1.157.24
2021-07-24T00:17:28.1428885Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:17:28.1458410Z [submariner-operator]$ [cluster2] wait 9045
2021-07-24T00:17:28.1464127Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-j479q 100.1.157.24
2021-07-24T00:17:28.1475954Z [submariner-operator]$ [cluster2] test_connection
2021-07-24T00:17:28.1481871Z Attempting connectivity between clusters - netshoot-57677568b8-j479q --> 100.1.157.24
2021-07-24T00:17:28.1493068Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-24T00:17:28.1506823Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-24T00:17:28.1533627Z [submariner-operator]$ [cluster2] date +%s
2021-07-24T00:17:28.1571281Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-j479q -- curl --output /dev/null -m 30 --silent --head --fail 100.1.157.24
2021-07-24T00:17:28.1585109Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-j479q -- curl --output /dev/null -m 30 --silent --head --fail 100.1.157.24
2021-07-24T00:17:28.1600744Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-j479q -- curl --output /dev/null -m 30 --silent --head --fail 100.1.157.24
2021-07-24T00:17:28.5897875Z Connection test was successful!
2021-07-24T00:17:28.5913139Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:28.5929160Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:28.5946327Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:28.5963734Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:28.5980194Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:28.5997752Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-24T00:17:28.9040240Z deployment.apps "netshoot" deleted
2021-07-24T00:17:28.9198575Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:28.9212475Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:28.9230910Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:28.9243205Z [submariner-operator]$ [cluster1] remove_resource
2021-07-24T00:17:28.9262784Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:28.9277373Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:28.9294352Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-24T00:17:29.2212006Z deployment.apps "nginx-demo" deleted
2021-07-24T00:17:29.3158089Z service "nginx-demo" deleted
2021-07-24T00:17:29.3369432Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-24T00:17:29.4202363Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-24T00:17:29.4220187Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-24T00:17:29.4236613Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-24T00:17:29.4258271Z [submariner-operator]$ [cluster2] grep -q function
2021-07-24T00:17:29.4322108Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:29.4330921Z Successfully remade target file 'deploy'.
2021-07-24T00:17:29.4331740Z File 'e2e' does not exist.
2021-07-24T00:17:29.4332391Z Must remake target 'e2e'.
2021-07-24T00:17:29.4333045Z scripts/kind-e2e/e2e.sh
2021-07-24T00:17:29.4431454Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-24T00:17:29.4454106Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:17:29.4491003Z [submariner-operator]$ script_name=utils
2021-07-24T00:17:29.4505452Z [submariner-operator]$ exec_name=e2e.sh
2021-07-24T00:17:29.4568427Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-24T00:17:29.4589788Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:17:29.4617209Z [submariner-operator]$ script_name=deploy_funcs
2021-07-24T00:17:29.4634111Z [submariner-operator]$ exec_name=e2e.sh
2021-07-24T00:17:29.4681298Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-24T00:17:29.4698015Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:17:29.4709690Z [submariner-operator]$ script_name=deploy_operator
2021-07-24T00:17:29.4723575Z [submariner-operator]$ exec_name=e2e.sh
2021-07-24T00:17:29.4746250Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-24T00:17:29.4763647Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:17:29.4780440Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:17:29.4795900Z [submariner-operator]$ exec_name=e2e.sh
2021-07-24T00:17:29.4820339Z [submariner-operator]$ broker=cluster1
2021-07-24T00:17:29.4834445Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-24T00:17:29.4850310Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-24T00:17:29.4866993Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-24T00:17:29.4882373Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-24T00:17:29.4899788Z [submariner-operator]$ declare -gA cluster_subm
2021-07-24T00:17:29.4918362Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-24T00:17:29.4933755Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-24T00:17:29.4948728Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-24T00:17:29.4963287Z [submariner-operator]$ declare -gA cluster_cni
2021-07-24T00:17:29.4979360Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-24T00:17:29.4994685Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-24T00:17:29.5009872Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-24T00:17:29.5026331Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-24T00:17:29.5050460Z [submariner-operator]$ script_name=cluster_settings
2021-07-24T00:17:29.5126731Z [submariner-operator]$ exec_name=e2e.sh
2021-07-24T00:17:29.5160812Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-24T00:17:29.5204498Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-24T00:17:29.5363627Z [submariner-operator]$ timeout=2m
2021-07-24T00:17:29.5379434Z [submariner-operator]$ declare_kubeconfig
2021-07-24T00:17:29.5411481Z [submariner-operator]$ declare_kubeconfig
2021-07-24T00:17:29.5450187Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-24T00:17:29.5469146Z [submariner-operator]$ export KUBECONFIG
2021-07-24T00:17:29.5501920Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-24T00:17:29.5522615Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-24T00:17:29.5574100Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-24T00:17:29.5617164Z [submariner-operator]$ create_subm_vars
2021-07-24T00:17:29.5631650Z [submariner-operator]$ create_subm_vars
2021-07-24T00:17:29.5644727Z [submariner-operator]$ deployment_name=submariner
2021-07-24T00:17:29.5661766Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-24T00:17:29.5676651Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-24T00:17:29.5690150Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-24T00:17:29.5703608Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-24T00:17:29.5724005Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-24T00:17:29.5800113Z [submariner-operator]$ declare_cidrs
2021-07-24T00:17:29.5815559Z [submariner-operator]$ declare_cidrs
2021-07-24T00:17:29.5829991Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-24T00:17:29.5845154Z [submariner-operator]$ i=1
2021-07-24T00:17:29.5862641Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:17:29.5878565Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-24T00:17:29.5897027Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-24T00:17:29.5912938Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-24T00:17:29.5929798Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-24T00:17:29.5946260Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:17:29.5964022Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-24T00:17:29.5975728Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-24T00:17:29.5986945Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-24T00:17:29.6001370Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-24T00:17:29.6016277Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-24T00:17:29.6029910Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-24T00:17:29.6044119Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-24T00:17:29.6057890Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-24T00:17:29.6128521Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-24T00:17:29.6145072Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-24T00:17:29.6160977Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-24T00:17:29.6174969Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-24T00:17:29.6188014Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-24T00:17:29.6202917Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-24T00:17:29.6217583Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-24T00:17:29.6232024Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-24T00:17:29.6246385Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-24T00:17:29.6262407Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-24T00:17:29.6278008Z [submariner-operator]$ [cluster1] broker_vars
2021-07-24T00:17:29.6295593Z [submariner-operator]$ [cluster1] broker_vars
2021-07-24T00:17:29.6306295Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-24T00:17:29.6326053Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-24T00:17:29.6340933Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-24T00:17:29.6352527Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-24T00:17:30.1043655Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-24T00:17:30.1067674Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-24T00:17:30.1084037Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-24T00:17:30.1116789Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-24T00:17:30.5523473Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-24T00:17:30.5544437Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-24T00:17:30.5560421Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-24T00:17:30.5575245Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-24T00:17:30.5591500Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-24T00:17:30.9115201Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-24T00:17:30.9130305Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-24T00:17:30.9146795Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-24T00:17:30.9162180Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-24T00:17:30.9922048Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:31.1054678Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:31.1596999Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-24T00:17:31.1598497Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-24T00:17:31.1600116Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-24T00:17:31.1601431Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-24T00:17:31.1602698Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-24T00:17:31.1604249Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-24T00:17:31.3711365Z [submariner-operator]$ [cluster1] return
2021-07-24T00:17:31.3725010Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-24T00:17:31.3745648Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-24T00:17:31.3760352Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-24T00:17:31.7139568Z NAME TYPE DATA AGE
2021-07-24T00:17:31.7141388Z cluster-cluster1-token-hrpmp kubernetes.io/service-account-token 3 4m9s
2021-07-24T00:17:31.7143061Z cluster-cluster2-token-sl7wd kubernetes.io/service-account-token 3 4m3s
2021-07-24T00:17:31.7144571Z default-token-zbvbq kubernetes.io/service-account-token 3 4m25s
2021-07-24T00:17:31.7146282Z submariner-k8s-broker-admin-token-b8hqb kubernetes.io/service-account-token 3 4m25s
2021-07-24T00:17:31.7148299Z submariner-k8s-broker-client-token-mczmh kubernetes.io/service-account-token 3 4m25s
2021-07-24T00:17:31.7206702Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-24T00:17:31.7222225Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-24T00:17:31.7245065Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-24T00:17:32.0857638Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.0871503Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mczmh -n submariner-k8s-broker -o json
2021-07-24T00:17:32.0887026Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.0914383Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-mczmh -n submariner-k8s-broker -o json
2021-07-24T00:17:32.0985508Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-mczmh -n submariner-k8s-broker -o json
2021-07-24T00:17:32.3997142Z {
2021-07-24T00:17:32.3997763Z "apiVersion": "v1",
2021-07-24T00:17:32.3998174Z "data": {
2021-07-24T00:17:32.4625588Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-24T00:17:32.5452244Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-24T00:17:32.6011736Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklqUkhlbkJZWmt4bFdFUjBTV1psWVZCMFIwRlBhMjFqYzNsUlFuUmtVakJYUW14aWRXUkNXRWwxUkdjaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxdFkzcHRhQ0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTURKbE9HRXdZamd0WVdJMFppMDBZems0TFdKbE5UZ3RZV1U1TkdWaE5EbGlOVEk1SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLmU4OER6a29ub002dlNiZlhmdEQxeUxMRkVQQXd3NDJobXItZ0VOLVgwWTV2ZS1YVnlWVEZWTks2SVpFNDFxSlNXZXh0SzJfcjcyb2JfNWVPYzJVSmQ4aFVBalg3cVBSWHVyUEtUNUkwblFxYnVDeGFuYkhhSTJ4NnNwUXBncXA2dXZLZ1REcVQtRlRQVTd0OHNzeEljNHQyMzJMd3ZXUlMzZ25McVU1VzFxRklXLUFOOExRZ3JoanFMamxqazBWYV93dk5EMFF6NUdsTk9yZnFpUGdvTkpSazZPVHVlVE4zNmpVa0c0bExkUlZpY1pZRzAyRUZURk9YckQ3NTNzZmJGTnYwTjdwanFYbVVBMnJTOG92N3N0c0lKSm5IN1VXOVlBd25wYmpqZDZvS3NGT21GaEpJaHRqSC1KY0V2MHBEOFhEY1ViYy10YmtuWUhVSXlpamluQQ=="
2021-07-24T00:17:32.6653940Z },
2021-07-24T00:17:32.6654619Z "kind": "Secret",
2021-07-24T00:17:32.6655042Z "metadata": {
2021-07-24T00:17:32.6655490Z "annotations": {
2021-07-24T00:17:32.6657160Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-24T00:17:32.6658706Z "kubernetes.io/service-account.uid": "02e8a0b8-ab4f-4c98-be58-ae94ea49b529"
2021-07-24T00:17:32.6659553Z },
2021-07-24T00:17:32.6660229Z "creationTimestamp": "2021-07-24T00:13:06Z",
2021-07-24T00:17:32.6660818Z "managedFields": [
2021-07-24T00:17:32.6662486Z {
2021-07-24T00:17:32.6662920Z "apiVersion": "v1",
2021-07-24T00:17:32.6663439Z "fieldsType": "FieldsV1",
2021-07-24T00:17:32.6663943Z "fieldsV1": {
2021-07-24T00:17:32.6664600Z "f:data": {
2021-07-24T00:17:32.6664999Z ".": {},
2021-07-24T00:17:32.6665408Z "f:ca.crt": {},
2021-07-24T00:17:32.6665853Z "f:namespace": {},
2021-07-24T00:17:32.6666306Z "f:token": {}
2021-07-24T00:17:32.6666676Z },
2021-07-24T00:17:32.6667081Z "f:metadata": {
2021-07-24T00:17:32.6667545Z "f:annotations": {
2021-07-24T00:17:32.6667983Z ".": {},
2021-07-24T00:17:32.6668899Z "f:kubernetes.io/service-account.name": {},
2021-07-24T00:17:32.6669940Z "f:kubernetes.io/service-account.uid": {}
2021-07-24T00:17:32.6670526Z }
2021-07-24T00:17:32.6670888Z },
2021-07-24T00:17:32.6671270Z "f:type": {}
2021-07-24T00:17:32.6671633Z },
2021-07-24T00:17:32.6672387Z "manager": "kube-controller-manager",
2021-07-24T00:17:32.6678566Z "operation": "Update",
2021-07-24T00:17:32.6679463Z "time": "2021-07-24T00:13:06Z"
2021-07-24T00:17:32.6679845Z }
2021-07-24T00:17:32.6680192Z ],
2021-07-24T00:17:32.6681202Z "name": "submariner-k8s-broker-client-token-mczmh",
2021-07-24T00:17:32.6682428Z "namespace": "submariner-k8s-broker",
2021-07-24T00:17:32.6683095Z "resourceVersion": "1209",
2021-07-24T00:17:32.6683934Z "uid": "403e5837-4b8c-43ec-ac1c-1e720e0db153"
2021-07-24T00:17:32.6684640Z },
2021-07-24T00:17:32.6685430Z "type": "kubernetes.io/service-account-token"
2021-07-24T00:17:32.6686038Z }
2021-07-24T00:17:32.6686977Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-24T00:17:32.6688127Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-24T00:17:32.6690091Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.6692283Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-24T00:17:32.6694619Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-24T00:17:32.6698402Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.6700881Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mczmh
2021-07-24T00:17:32.6703096Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-mczmh
2021-07-24T00:17:32.6705627Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.6707867Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-24T00:17:32.6709536Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-24T00:17:32.6711863Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.6727439Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-mczmh.cluster1.json
2021-07-24T00:17:32.6729438Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-24T00:17:32.6730594Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-24T00:17:32.6731816Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-24T00:17:32.6732977Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-24T00:17:32.6734229Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-24T00:17:32.6736093Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-24T00:17:32.6737362Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-24T00:17:32.6738472Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-24T00:17:32.6739569Z [submariner-operator]$ [cluster1] pids[cluster1]=9291
2021-07-24T00:17:32.6740642Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-24T00:17:32.6741672Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-24T00:17:32.6742717Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-24T00:17:32.6760534Z [submariner-operator]$ [cluster2] pids[cluster2]=9294
2021-07-24T00:17:32.6767189Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-24T00:17:32.6792162Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-24T00:17:32.6859773Z [submariner-operator]$ [cluster2] wait 9294
2021-07-24T00:17:32.6933620Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-24T00:17:33.4761024Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-24T00:17:33.4766707Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-24T00:17:33.4767965Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-24T00:17:33.4769305Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-24T00:17:33.4771122Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-24T00:17:33.4772613Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-24T00:17:33.4774104Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-24T00:17:33.4775794Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-24T00:17:33.4776840Z [cluster1] NAME CREATED AT
2021-07-24T00:17:33.4777733Z [cluster1] endpoints.submariner.io 2021-07-24T00:13:16Z
2021-07-24T00:17:33.4779235Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:33.4780962Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.4782441Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.4784274Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:33.4787311Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.4789040Z [cluster1] {
2021-07-24T00:17:33.4789762Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:33.4791217Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-24T00:17:33.4792181Z [cluster1] "metadata": {
2021-07-24T00:17:33.4792916Z [cluster1] "annotations": {
2021-07-24T00:17:33.4794606Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:33.4795699Z [cluster1] },
2021-07-24T00:17:33.4796979Z [cluster1] "creationTimestamp": "2021-07-24T00:13:16Z",
2021-07-24T00:17:33.4798141Z [cluster1] "generation": 1,
2021-07-24T00:17:33.4798705Z [cluster1] "managedFields": [
2021-07-24T00:17:33.4799736Z [cluster1] {
2021-07-24T00:17:33.4800876Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:33.4801933Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:33.4803085Z [cluster1] "fieldsV1": {
2021-07-24T00:17:33.4803833Z [cluster1] "f:metadata": {
2021-07-24T00:17:33.4804609Z [cluster1] "f:annotations": {
2021-07-24T00:17:33.4805618Z [cluster1] ".": {},
2021-07-24T00:17:33.4807741Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:33.4809169Z [cluster1] }
2021-07-24T00:17:33.4809836Z [cluster1] },
2021-07-24T00:17:33.4810565Z [cluster1] "f:spec": {
2021-07-24T00:17:33.4811562Z [cluster1] "f:conversion": {
2021-07-24T00:17:33.4812301Z [cluster1] ".": {},
2021-07-24T00:17:33.4813342Z [cluster1] "f:strategy": {}
2021-07-24T00:17:33.4814116Z [cluster1] },
2021-07-24T00:17:33.4815239Z [cluster1] "f:group": {},
2021-07-24T00:17:33.4816040Z [cluster1] "f:names": {
2021-07-24T00:17:33.4817061Z [cluster1] "f:kind": {},
2021-07-24T00:17:33.4817872Z [cluster1] "f:listKind": {},
2021-07-24T00:17:33.4818675Z [cluster1] "f:plural": {},
2021-07-24T00:17:33.4819663Z [cluster1] "f:singular": {}
2021-07-24T00:17:33.4820361Z [cluster1] },
2021-07-24T00:17:33.4821120Z [cluster1] "f:scope": {},
2021-07-24T00:17:33.4821863Z [cluster1] "f:versions": {}
2021-07-24T00:17:33.4822894Z [cluster1] },
2021-07-24T00:17:33.4823678Z [cluster1] "f:status": {
2021-07-24T00:17:33.4824454Z [cluster1] "f:acceptedNames": {
2021-07-24T00:17:33.4825601Z [cluster1] "f:kind": {},
2021-07-24T00:17:33.4826394Z [cluster1] "f:plural": {}
2021-07-24T00:17:33.4827098Z [cluster1] },
2021-07-24T00:17:33.4828001Z [cluster1] "f:conditions": {},
2021-07-24T00:17:33.4828742Z [cluster1] "f:storedVersions": {}
2021-07-24T00:17:33.4829277Z [cluster1] }
2021-07-24T00:17:33.4829726Z [cluster1] },
2021-07-24T00:17:33.4830663Z [cluster1] "manager": "submariner-operator",
2021-07-24T00:17:33.4831357Z [cluster1] "operation": "Update",
2021-07-24T00:17:33.4832196Z [cluster1] "time": "2021-07-24T00:13:22Z"
2021-07-24T00:17:33.4832668Z [cluster1] }
2021-07-24T00:17:33.4833160Z [cluster1] ],
2021-07-24T00:17:33.4833794Z [cluster1] "name": "endpoints.submariner.io",
2021-07-24T00:17:33.4834553Z [cluster1] "resourceVersion": "1385",
2021-07-24T00:17:33.4835529Z [cluster1] "uid": "ef0d24e5-21e3-428f-ad58-e12fb821e855"
2021-07-24T00:17:33.4836189Z [cluster1] },
2021-07-24T00:17:33.4836612Z [cluster1] "spec": {
2021-07-24T00:17:33.4837428Z [cluster1] "conversion": {
2021-07-24T00:17:33.4837973Z [cluster1] "strategy": "None"
2021-07-24T00:17:33.4838436Z [cluster1] },
2021-07-24T00:17:33.4838963Z [cluster1] "group": "submariner.io",
2021-07-24T00:17:33.4839502Z [cluster1] "names": {
2021-07-24T00:17:33.4840238Z [cluster1] "kind": "Endpoint",
2021-07-24T00:17:33.4841156Z [cluster1] "listKind": "EndpointList",
2021-07-24T00:17:33.4842034Z [cluster1] "plural": "endpoints",
2021-07-24T00:17:33.4883773Z [cluster1] "singular": "endpoint"
2021-07-24T00:17:33.4885110Z [cluster1] },
2021-07-24T00:17:33.4885833Z [cluster1] "scope": "Namespaced",
2021-07-24T00:17:33.4886684Z [cluster1] "versions": [
2021-07-24T00:17:33.4888236Z [cluster1] {
2021-07-24T00:17:33.4889020Z [cluster1] "name": "v1",
2021-07-24T00:17:33.4890299Z [cluster1] "schema": {
2021-07-24T00:17:33.4891643Z [cluster1] "openAPIV3Schema": {
2021-07-24T00:17:33.4892942Z [cluster1] "properties": {
2021-07-24T00:17:33.4893752Z [cluster1] "apiVersion": {
2021-07-24T00:17:33.4896829Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:33.4898775Z [cluster1] "type": "string"
2021-07-24T00:17:33.4899276Z [cluster1] },
2021-07-24T00:17:33.4899765Z [cluster1] "kind": {
2021-07-24T00:17:33.4902117Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:33.4904000Z [cluster1] "type": "string"
2021-07-24T00:17:33.4904511Z [cluster1] },
2021-07-24T00:17:33.4905004Z [cluster1] "metadata": {
2021-07-24T00:17:33.4905556Z [cluster1] "type": "object"
2021-07-24T00:17:33.4906042Z [cluster1] },
2021-07-24T00:17:33.4906518Z [cluster1] "spec": {
2021-07-24T00:17:33.4907071Z [cluster1] "properties": {
2021-07-24T00:17:33.4907626Z [cluster1] "backend": {
2021-07-24T00:17:33.4908274Z [cluster1] "type": "string"
2021-07-24T00:17:33.4908785Z [cluster1] },
2021-07-24T00:17:33.4909318Z [cluster1] "backend_config": {
2021-07-24T00:17:33.4910014Z [cluster1] "additionalProperties": {
2021-07-24T00:17:33.4910724Z [cluster1] "type": "string"
2021-07-24T00:17:33.4911263Z [cluster1] },
2021-07-24T00:17:33.4911779Z [cluster1] "type": "object"
2021-07-24T00:17:33.4912299Z [cluster1] },
2021-07-24T00:17:33.4912805Z [cluster1] "cable_name": {
2021-07-24T00:17:33.4913369Z [cluster1] "type": "string"
2021-07-24T00:17:33.4913873Z [cluster1] },
2021-07-24T00:17:33.4914390Z [cluster1] "cluster_id": {
2021-07-24T00:17:33.4914938Z [cluster1] "type": "string"
2021-07-24T00:17:33.4915458Z [cluster1] },
2021-07-24T00:17:33.4916015Z [cluster1] "healthCheckIP": {
2021-07-24T00:17:33.4916620Z [cluster1] "type": "string"
2021-07-24T00:17:33.4917144Z [cluster1] },
2021-07-24T00:17:33.4917639Z [cluster1] "hostname": {
2021-07-24T00:17:33.4918202Z [cluster1] "type": "string"
2021-07-24T00:17:33.4918703Z [cluster1] },
2021-07-24T00:17:33.4919220Z [cluster1] "nat_enabled": {
2021-07-24T00:17:33.4919782Z [cluster1] "type": "boolean"
2021-07-24T00:17:33.4920304Z [cluster1] },
2021-07-24T00:17:33.4920827Z [cluster1] "private_ip": {
2021-07-24T00:17:33.4921380Z [cluster1] "type": "string"
2021-07-24T00:17:33.4921889Z [cluster1] },
2021-07-24T00:17:33.4922383Z [cluster1] "public_ip": {
2021-07-24T00:17:33.4923001Z [cluster1] "type": "string"
2021-07-24T00:17:33.4923508Z [cluster1] },
2021-07-24T00:17:33.4924022Z [cluster1] "subnets": {
2021-07-24T00:17:33.4924537Z [cluster1] "items": {
2021-07-24T00:17:33.4925090Z [cluster1] "type": "string"
2021-07-24T00:17:33.4925619Z [cluster1] },
2021-07-24T00:17:33.4926124Z [cluster1] "type": "array"
2021-07-24T00:17:33.4926644Z [cluster1] }
2021-07-24T00:17:33.4927095Z [cluster1] },
2021-07-24T00:17:33.4927599Z [cluster1] "required": [
2021-07-24T00:17:33.4928131Z [cluster1] "backend",
2021-07-24T00:17:33.4928678Z [cluster1] "cable_name",
2021-07-24T00:17:33.4929225Z [cluster1] "cluster_id",
2021-07-24T00:17:33.5431615Z [cluster1] [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-24T00:17:33.5432971Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-24T00:17:33.5434052Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-24T00:17:33.5435384Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-24T00:17:33.5436911Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-24T00:17:33.5438634Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-24T00:17:33.5440087Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-24T00:17:33.5441671Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-24T00:17:33.5442850Z [cluster2] NAME CREATED AT
2021-07-24T00:17:33.5443758Z [cluster2] endpoints.submariner.io 2021-07-24T00:13:26Z
2021-07-24T00:17:33.5445270Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:33.5447080Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.5448754Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:33.5450428Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.5452057Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-24T00:17:33.5453020Z [cluster2] {
2021-07-24T00:17:33.5453653Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:33.5463642Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-24T00:17:33.5466814Z [cluster2] "metadata": {
2021-07-24T00:17:33.5467477Z [cluster2] "annotations": {
2021-07-24T00:17:33.5468841Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:33.5469617Z [cluster2] },
2021-07-24T00:17:33.5470486Z [cluster2] "creationTimestamp": "2021-07-24T00:13:26Z",
2021-07-24T00:17:33.5471119Z [cluster2] "generation": 1,
2021-07-24T00:17:33.5471686Z [cluster2] "managedFields": [
2021-07-24T00:17:33.5472181Z [cluster2] {
2021-07-24T00:17:33.5472849Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:33.5473615Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:33.5474200Z [cluster2] "fieldsV1": {
2021-07-24T00:17:33.5474717Z [cluster2] "f:metadata": {
2021-07-24T00:17:33.5475277Z [cluster2] "f:annotations": {
2021-07-24T00:17:33.5475805Z [cluster2] ".": {},
2021-07-24T00:17:33.5476977Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:33.5477771Z [cluster2] }
2021-07-24T00:17:33.5478200Z [cluster2] },
2021-07-24T00:17:33.5478672Z [cluster2] "f:spec": {
2021-07-24T00:17:33.5479192Z [cluster2] "f:conversion": {
2021-07-24T00:17:33.5479707Z [cluster2] ".": {},
2021-07-24T00:17:33.5480199Z [cluster2] "f:strategy": {}
2021-07-24T00:17:33.5480691Z [cluster2] },
2021-07-24T00:17:33.5481167Z [cluster2] "f:group": {},
2021-07-24T00:17:33.5481675Z [cluster2] "f:names": {
2021-07-24T00:17:33.5482174Z [cluster2] "f:kind": {},
2021-07-24T00:17:33.5482686Z [cluster2] "f:listKind": {},
2021-07-24T00:17:33.5483224Z [cluster2] "f:plural": {},
2021-07-24T00:17:33.5483748Z [cluster2] "f:singular": {}
2021-07-24T00:17:33.5484236Z [cluster2] },
2021-07-24T00:17:33.5484700Z [cluster2] "f:scope": {},
2021-07-24T00:17:33.5485223Z [cluster2] "f:versions": {}
2021-07-24T00:17:33.5485731Z [cluster2] },
2021-07-24T00:17:33.5486208Z [cluster2] "f:status": {
2021-07-24T00:17:33.5486779Z [cluster2] "f:acceptedNames": {
2021-07-24T00:17:33.5487331Z [cluster2] "f:kind": {},
2021-07-24T00:17:33.5487946Z [cluster2] "f:plural": {}
2021-07-24T00:17:33.5488418Z [cluster2] },
2021-07-24T00:17:33.5488933Z [cluster2] "f:conditions": {},
2021-07-24T00:17:33.5489529Z [cluster2] "f:storedVersions": {}
2021-07-24T00:17:33.5490072Z [cluster2] }
2021-07-24T00:17:33.5490494Z [cluster2] },
2021-07-24T00:17:33.5491346Z [cluster2] "manager": "submariner-operator",
2021-07-24T00:17:33.5492039Z [cluster2] "operation": "Update",
2021-07-24T00:17:33.5492784Z [cluster2] "time": "2021-07-24T00:13:34Z"
2021-07-24T00:17:33.5493261Z [cluster2] }
2021-07-24T00:17:33.5493666Z [cluster2] ],
2021-07-24T00:17:33.5494318Z [cluster2] "name": "endpoints.submariner.io",
2021-07-24T00:17:33.5495348Z [cluster2] "resourceVersion": "1353",
2021-07-24T00:17:33.5496339Z [cluster2] "uid": "70519ed6-4e2b-46ab-8cf5-07dccce1e28e"
2021-07-24T00:17:33.5496974Z [cluster2] },
2021-07-24T00:17:33.5497415Z [cluster2] "spec": {
2021-07-24T00:17:33.5497893Z [cluster2] "conversion": {
2021-07-24T00:17:33.5498433Z [cluster2] "strategy": "None"
2021-07-24T00:17:33.5498897Z [cluster2] },
2021-07-24T00:17:33.5499423Z [cluster2] "group": "submariner.io",
2021-07-24T00:17:33.5499977Z [cluster2] "names": {
2021-07-24T00:17:33.5500473Z [cluster2] "kind": "Endpoint",
2021-07-24T00:17:33.5501082Z [cluster2] "listKind": "EndpointList",
2021-07-24T00:17:33.5501695Z [cluster2] "plural": "endpoints",
2021-07-24T00:17:33.5502294Z [cluster2] "singular": "endpoint"
2021-07-24T00:17:33.5502785Z [cluster2] },
2021-07-24T00:17:33.5503294Z [cluster2] "scope": "Namespaced",
2021-07-24T00:17:33.5503829Z [cluster2] "versions": [
2021-07-24T00:17:33.5504288Z [cluster2] {
2021-07-24T00:17:33.5504730Z [cluster2] "name": "v1",
2021-07-24T00:17:33.5505217Z [cluster2] "schema": {
2021-07-24T00:17:33.5505784Z [cluster2] "openAPIV3Schema": {
2021-07-24T00:17:33.5506408Z [cluster2] "properties": {
2021-07-24T00:17:33.5506984Z [cluster2] "apiVersion": {
2021-07-24T00:17:33.5509530Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:33.5511460Z [cluster2] "type": "string"
2021-07-24T00:17:33.5511972Z [cluster2] },
2021-07-24T00:17:33.5512441Z [cluster2] "kind": {
2021-07-24T00:17:33.5514908Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:33.5516792Z [cluster2] "type": "string"
2021-07-24T00:17:33.5517289Z [cluster2] },
2021-07-24T00:17:33.5517797Z [cluster2] "metadata": {
2021-07-24T00:17:33.5518340Z [cluster2] "type": "object"
2021-07-24T00:17:33.5518849Z [cluster2] },
2021-07-24T00:17:33.5519312Z [cluster2] "spec": {
2021-07-24T00:17:33.5519860Z [cluster2] "properties": {
2021-07-24T00:17:33.5520413Z [cluster2] "backend": {
2021-07-24T00:17:33.5521060Z [cluster2] "type": "string"
2021-07-24T00:17:33.5521583Z [cluster2] },
2021-07-24T00:17:33.5522103Z [cluster2] "backend_config": {
2021-07-24T00:17:33.5522807Z [cluster2] "additionalProperties": {
2021-07-24T00:17:33.5523499Z [cluster2] "type": "string"
2021-07-24T00:17:33.5524036Z [cluster2] },
2021-07-24T00:17:33.5524548Z [cluster2] "type": "object"
2021-07-24T00:17:33.5525068Z [cluster2] },
2021-07-24T00:17:33.5525581Z [cluster2] "cable_name": {
2021-07-24T00:17:33.5526125Z [cluster2] "type": "string"
2021-07-24T00:17:33.5526638Z [cluster2] },
2021-07-24T00:17:33.5527137Z [cluster2] "cluster_id": {
2021-07-24T00:17:33.5527706Z [cluster2] "type": "string"
2021-07-24T00:17:33.5528205Z [cluster2] },
2021-07-24T00:17:33.5528762Z [cluster2] "healthCheckIP": {
2021-07-24T00:17:33.5529431Z [cluster2] "type": "string"
2021-07-24T00:17:33.5530111Z [cluster2] },
2021-07-24T00:17:33.5530878Z [cluster2] "hostname": {
2021-07-24T00:17:33.5531521Z [cluster2] "type": "string"
2021-07-24T00:17:33.5532067Z [cluster2] },
2021-07-24T00:17:33.5532635Z [cluster2] "nat_enabled": {
2021-07-24T00:17:33.5533274Z [cluster2] "type": "boolean"
2021-07-24T00:17:33.5533901Z [cluster2] },
2021-07-24T00:17:33.5534939Z [cluster2] "private_ip": {
2021-07-24T00:17:33.5535538Z [cluster2] "type": "string"
2021-07-24T00:17:33.5536129Z [cluster2] },
2021-07-24T00:17:33.5536697Z [cluster2] "public_ip": {
2021-07-24T00:17:33.5537416Z [cluster2] "type": "string"
2021-07-24T00:17:33.5537961Z [cluster2] },
2021-07-24T00:17:33.5538541Z [cluster2] "subnets": {
2021-07-24T00:17:33.5539101Z [cluster2] "items": {
2021-07-24T00:17:33.5710007Z [cluster2] "type": "string"
2021-07-24T00:17:33.5710691Z [cluster2] },
2021-07-24T00:17:33.5711207Z [cluster2] "type": "array"
2021-07-24T00:17:33.5711734Z [cluster2] }
2021-07-24T00:17:33.5712183Z [cluster2] },
2021-07-24T00:17:33.5712685Z [cluster2] "required": [
2021-07-24T00:17:33.5713527Z [cluster2] "backend",
2021-07-24T00:17:33.5714122Z [cluster2] "cable_name",
2021-07-24T00:17:33.5714663Z [cluster2] "cluster_id",
2021-07-24T00:17:34.2376670Z [cluster2] "hostname",
2021-07-24T00:17:34.2377402Z [cluster1] "nat_enabled",
2021-07-24T00:17:34.2377941Z [cluster1] "private_ip",
2021-07-24T00:17:34.2378460Z [cluster1] "public_ip",
2021-07-24T00:17:34.2378952Z [cluster1] "subnets"
2021-07-24T00:17:34.2379414Z [cluster1] ],
2021-07-24T00:17:34.2380117Z [cluster1] "type": "object"
2021-07-24T00:17:34.2380589Z [cluster1] }
2021-07-24T00:17:34.2380992Z [cluster1] },
2021-07-24T00:17:34.2381458Z [cluster1] "required": [
2021-07-24T00:17:34.2381922Z [cluster1] "spec"
2021-07-24T00:17:34.2382354Z [cluster1] ],
2021-07-24T00:17:34.2382814Z [cluster1] "type": "object"
2021-07-24T00:17:34.2383268Z [cluster1] }
2021-07-24T00:17:34.2383843Z [cluster1] },
2021-07-24T00:17:34.2384316Z [cluster1] "served": true,
2021-07-24T00:17:34.2384848Z [cluster1] "storage": true
2021-07-24T00:17:34.2385309Z [cluster1] }
2021-07-24T00:17:34.2385748Z [cluster1] ]
2021-07-24T00:17:34.2386147Z [cluster1] },
2021-07-24T00:17:34.2386585Z [cluster1] "status": {
2021-07-24T00:17:34.2387198Z [cluster1] "acceptedNames": {
2021-07-24T00:17:34.2387782Z [cluster1] "kind": "Endpoint",
2021-07-24T00:17:34.2388374Z [cluster1] "listKind": "EndpointList",
2021-07-24T00:17:34.2389006Z [cluster1] "plural": "endpoints",
2021-07-24T00:17:34.2389593Z [cluster1] "singular": "endpoint"
2021-07-24T00:17:34.2390096Z [cluster1] },
2021-07-24T00:17:34.2390573Z [cluster1] "conditions": [
2021-07-24T00:17:34.2391130Z [cluster1] {
2021-07-24T00:17:34.2392364Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:16Z",
2021-07-24T00:17:34.2393078Z [cluster1] "message": "no conflicts found",
2021-07-24T00:17:34.2393723Z [cluster1] "reason": "NoConflicts",
2021-07-24T00:17:34.2394284Z [cluster1] "status": "True",
2021-07-24T00:17:34.2394875Z [cluster1] "type": "NamesAccepted"
2021-07-24T00:17:34.2395397Z [cluster1] },
2021-07-24T00:17:34.2395823Z [cluster1] {
2021-07-24T00:17:34.2396682Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:16Z",
2021-07-24T00:17:34.2397422Z [cluster1] "message": "the initial names have been accepted",
2021-07-24T00:17:34.2398252Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-24T00:17:34.2398793Z [cluster1] "status": "True",
2021-07-24T00:17:34.2399256Z [cluster1] "type": "Established"
2021-07-24T00:17:34.2399780Z [cluster1] }
2021-07-24T00:17:34.2400128Z [cluster1] ],
2021-07-24T00:17:34.2400534Z [cluster1] "storedVersions": [
2021-07-24T00:17:34.2400958Z [cluster1] "v1"
2021-07-24T00:17:34.2401293Z [cluster1] ]
2021-07-24T00:17:34.2401815Z [cluster1] }
2021-07-24T00:17:34.2402176Z [cluster1] }
2021-07-24T00:17:34.2403256Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-24T00:17:34.2404774Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-24T00:17:34.2406494Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:34.2408054Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:34.2409237Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:34.2410784Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:34.2412563Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:34.2414013Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:34.2416019Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:34.2417670Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-24T00:17:34.2419219Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-24T00:17:34.2421071Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:34.2422935Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-24T00:17:34.2424543Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-24T00:17:34.2426607Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-24T00:17:34.2428390Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-24T00:17:34.2429358Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-24T00:17:34.2430537Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-24T00:17:34.2431891Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-24T00:17:34.2433208Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-24T00:17:34.2434508Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-24T00:17:34.2435940Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-24T00:17:34.2436867Z [cluster1] NAME CREATED AT
2021-07-24T00:17:34.3076678Z [cluster1] clusters.submariner.io 20 "hostname",
2021-07-24T00:17:34.3077534Z [cluster2] "nat_enabled",
2021-07-24T00:17:34.3078259Z [cluster2] "private_ip",
2021-07-24T00:17:34.3078787Z [cluster2] "public_ip",
2021-07-24T00:17:34.3079355Z [cluster2] "subnets"
2021-07-24T00:17:34.3079823Z [cluster2] ],
2021-07-24T00:17:34.3080315Z [cluster2] "type": "object"
2021-07-24T00:17:34.3080785Z [cluster2] }
2021-07-24T00:17:34.3081246Z [cluster2] },
2021-07-24T00:17:34.3081706Z [cluster2] "required": [
2021-07-24T00:17:34.3082181Z [cluster2] "spec"
2021-07-24T00:17:34.3082598Z [cluster2] ],
2021-07-24T00:17:34.3083207Z [cluster2] "type": "object"
2021-07-24T00:17:34.3083658Z [cluster2] }
2021-07-24T00:17:34.3084063Z [cluster2] },
2021-07-24T00:17:34.3084503Z [cluster2] "served": true,
2021-07-24T00:17:34.3085000Z [cluster2] "storage": true
2021-07-24T00:17:34.3085519Z [cluster2] }
2021-07-24T00:17:34.3085906Z [cluster2] ]
2021-07-24T00:17:34.3086279Z [cluster2] },
2021-07-24T00:17:34.3086687Z [cluster2] "status": {
2021-07-24T00:17:34.3087185Z [cluster2] "acceptedNames": {
2021-07-24T00:17:34.3087712Z [cluster2] "kind": "Endpoint",
2021-07-24T00:17:34.3088282Z [cluster2] "listKind": "EndpointList",
2021-07-24T00:17:34.3089130Z [cluster2] "plural": "endpoints",
2021-07-24T00:17:34.3089796Z [cluster2] "singular": "endpoint"
2021-07-24T00:17:34.3090289Z [cluster2] },
2021-07-24T00:17:34.3090763Z [cluster2] "conditions": [
2021-07-24T00:17:34.3091230Z [cluster2] {
2021-07-24T00:17:34.3092521Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:26Z",
2021-07-24T00:17:34.3093235Z [cluster2] "message": "no conflicts found",
2021-07-24T00:17:34.3093875Z [cluster2] "reason": "NoConflicts",
2021-07-24T00:17:34.3094889Z [cluster2] "status": "True",
2021-07-24T00:17:34.3095481Z [cluster2] "type": "NamesAccepted"
2021-07-24T00:17:34.3096025Z [cluster2] },
2021-07-24T00:17:34.3096438Z [cluster2] {
2021-07-24T00:17:34.3097602Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:26Z",
2021-07-24T00:17:34.3098333Z [cluster2] "message": "the initial names have been accepted",
2021-07-24T00:17:34.3099169Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-24T00:17:34.3099794Z [cluster2] "status": "True",
2021-07-24T00:17:34.3100329Z [cluster2] "type": "Established"
2021-07-24T00:17:34.3100791Z [cluster2] }
2021-07-24T00:17:34.3101186Z [cluster2] ],
2021-07-24T00:17:34.3101667Z [cluster2] "storedVersions": [
2021-07-24T00:17:34.3102140Z [cluster2] "v1"
2021-07-24T00:17:34.3102535Z [cluster2] ]
2021-07-24T00:17:34.3102900Z [cluster2] }
2021-07-24T00:17:34.3103353Z [cluster2] }
2021-07-24T00:17:34.3104415Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-24T00:17:34.3105930Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-24T00:17:34.3107646Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:34.3109254Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:34.3110460Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:34.3111993Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:34.3114238Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:34.3115470Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:34.3117137Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:34.3118656Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-24T00:17:34.3119978Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-24T00:17:34.3121667Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:34.3123581Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-24T00:17:34.3125304Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-24T00:17:34.3127319Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-24T00:17:34.3129001Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-24T00:17:34.3130140Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-24T00:17:34.3131413Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-24T00:17:34.3132873Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-24T00:17:34.3134392Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-24T00:17:34.3136110Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-24T00:17:34.3137639Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-24T00:17:34.3138650Z [cluster2] NAME CREATED AT
2021-07-24T00:17:34.6062700Z [cluster2] clusters.submariner.io 2021-07-24T00:13:16Z
2021-07-24T00:17:34.6064503Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:34.6066239Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-24T00:17:34.6067964Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:34.6069601Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-24T00:17:34.6071404Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-24T00:17:34.6072337Z [cluster1] {
2021-07-24T00:17:34.6072998Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:34.6073888Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-24T00:17:34.6074579Z [cluster1] "metadata": {
2021-07-24T00:17:34.6075111Z [cluster1] "annotations": {
2021-07-24T00:17:34.6076208Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:34.6076979Z [cluster1] },
2021-07-24T00:17:34.6077743Z [cluster1] "creationTimestamp": "2021-07-24T00:13:16Z",
2021-07-24T00:17:34.6078397Z [cluster1] "generation": 1,
2021-07-24T00:17:34.6078960Z [cluster1] "managedFields": [
2021-07-24T00:17:34.6079473Z [cluster1] {
2021-07-24T00:17:34.6080137Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:34.6080898Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:34.6081488Z [cluster1] "fieldsV1": {
2021-07-24T00:17:34.6082005Z [cluster1] "f:metadata": {
2021-07-24T00:17:34.6082575Z [cluster1] "f:annotations": {
2021-07-24T00:17:34.6083093Z [cluster1] ".": {},
2021-07-24T00:17:34.6084102Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:34.6084872Z [cluster1] }
2021-07-24T00:17:34.6085320Z [cluster1] },
2021-07-24T00:17:34.6085777Z [cluster1] "f:spec": {
2021-07-24T00:17:34.6086316Z [cluster1] "f:conversion": {
2021-07-24T00:17:34.6086968Z [cluster1] ".": {},
2021-07-24T00:17:34.6087466Z [cluster1] "f:strategy": {}
2021-07-24T00:17:34.6087972Z [cluster1] },
2021-07-24T00:17:34.6088446Z [cluster1] "f:group": {},
2021-07-24T00:17:34.6088954Z [cluster1] "f:names": {
2021-07-24T00:17:34.6089446Z [cluster1] "f:kind": {},
2021-07-24T00:17:34.6089976Z [cluster1] "f:listKind": {},
2021-07-24T00:17:34.6090509Z [cluster1] "f:plural": {},
2021-07-24T00:17:34.6091157Z [cluster1] "f:singular": {}
2021-07-24T00:17:34.6091655Z [cluster1] },
2021-07-24T00:17:34.6092156Z [cluster1] "f:scope": {},
2021-07-24T00:17:34.6092687Z [cluster1] "f:versions": {}
2021-07-24T00:17:34.6093161Z [cluster1] },
2021-07-24T00:17:34.6093641Z [cluster1] "f:status": {
2021-07-24T00:17:34.6094202Z [cluster1] "f:acceptedNames": {
2021-07-24T00:17:34.6095168Z [cluster1] "f:kind": {},
2021-07-24T00:17:34.6095678Z [cluster1] "f:plural": {}
2021-07-24T00:17:34.6096161Z [cluster1] },
2021-07-24T00:17:34.6096764Z [cluster1] "f:conditions": {},
2021-07-24T00:17:34.6097376Z [cluster1] "f:storedVersions": {}
2021-07-24T00:17:34.6097917Z [cluster1] }
2021-07-24T00:17:34.6098339Z [cluster1] },
2021-07-24T00:17:34.6099200Z [cluster1] "manager": "submariner-operator",
2021-07-24T00:17:34.6099903Z [cluster1] "operation": "Update",
2021-07-24T00:17:34.6100651Z [cluster1] "time": "2021-07-24T00:13:20Z"
2021-07-24T00:17:34.6101115Z [cluster1] }
2021-07-24T00:17:34.6101540Z [cluster1] ],
2021-07-24T00:17:34.6102149Z [cluster1] "name": "clusters.submariner.io",
2021-07-24T00:17:34.6102891Z [cluster1] "resourceVersion": "1363",
2021-07-24T00:17:34.6103793Z [cluster1] "uid": "c26eeb01-5201-4908-a471-956df975b36c"
2021-07-24T00:17:34.6104495Z [cluster1] },
2021-07-24T00:17:34.6104931Z [cluster1] "spec": {
2021-07-24T00:17:34.6105663Z [cluster1] "conversion": {
2021-07-24T00:17:34.6106383Z [cluster1] "strategy": "None"
2021-07-24T00:17:34.6106991Z [cluster1] },
2021-07-24T00:17:34.6107649Z [cluster1] "group": "submariner.io",
2021-07-24T00:17:34.6108630Z [cluster1] "names": {
2021-07-24T00:17:34.6109302Z [cluster1] "kind": "Cluster",
2021-07-24T00:17:34.6135188Z [cluster1] "listKind": "ClusterList",
2021-07-24T00:17:34.6135953Z [cluster1] "plural": "clusters",
2021-07-24T00:17:34.6136534Z [cluster1] "singular": "cluster"
2021-07-24T00:17:34.6137037Z [cluster1] },
2021-07-24T00:17:34.6137552Z [cluster1] "scope": "Namespaced",
2021-07-24T00:17:34.6138087Z [cluster1] "versions": [
2021-07-24T00:17:34.6138557Z [cluster1] {
2021-07-24T00:17:34.6139016Z [cluster1] "name": "v1",
2021-07-24T00:17:34.6139508Z [cluster1] "schema": {
2021-07-24T00:17:34.6140076Z [cluster1] "openAPIV3Schema": {
2021-07-24T00:17:34.6140780Z [cluster1] "properties": {
2021-07-24T00:17:34.6141349Z [cluster1] "apiVersion": {
2021-07-24T00:17:34.6144022Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:34.6146173Z [cluster1] "type": "string"
2021-07-24T00:17:34.6146688Z [cluster1] },
2021-07-24T00:17:34.6147153Z [cluster1] "kind": {
2021-07-24T00:17:34.6149604Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:34.6151492Z [cluster1] "type": "string"
2021-07-24T00:17:34.6152192Z [cluster1] },
2021-07-24T00:17:34.6152707Z [cluster1] "metadata": {
2021-07-24T00:17:34.6153254Z [cluster1] "type": "object"
2021-07-24T00:17:34.6153766Z [cluster1] },
2021-07-24T00:17:34.6154233Z [cluster1] "spec": {
2021-07-24T00:17:34.6154784Z [cluster1] "properties": {
2021-07-24T00:17:34.6155360Z [cluster1] "cluster_cidr": {
2021-07-24T00:17:34.6155917Z [cluster1] "items": {
2021-07-24T00:17:34.6156480Z [cluster1] "type": "string"
2021-07-24T00:17:34.6156999Z [cluster1] },
2021-07-24T00:17:34.6157524Z [cluster1] "type": "array"
2021-07-24T00:17:34.6158028Z [cluster1] },
2021-07-24T00:17:34.6158553Z [cluster1] "cluster_id": {
2021-07-24T00:17:34.6159109Z [cluster1] "type": "string"
2021-07-24T00:17:34.6159631Z [cluster1] },
2021-07-24T00:17:34.6160146Z [cluster1] "color_codes": {
2021-07-24T00:17:34.6160676Z [cluster1] "items": {
2021-07-24T00:17:34.6161225Z [cluster1] "type": "string"
2021-07-24T00:17:34.6161739Z [cluster1] },
2021-07-24T00:17:34.6162348Z [cluster1] "type": "array"
2021-07-24T00:17:34.6162851Z [cluster1] },
2021-07-24T00:17:34.6163368Z [cluster1] "global_cidr": {
2021-07-24T00:17:34.6163892Z [cluster1] "items": {
2021-07-24T00:17:34.6164453Z [cluster1] "type": "string"
2021-07-24T00:17:34.6164981Z [cluster1] },
2021-07-24T00:17:34.6165486Z [cluster1] "type": "array"
2021-07-24T00:17:34.6165999Z [cluster1] },
2021-07-24T00:17:34.6166510Z [cluster1] "service_cidr": {
2021-07-24T00:17:34.6167066Z [cluster1] "items": {
2021-07-24T00:17:34.6167603Z [cluster1] "type": "string"
2021-07-24T00:17:34.6168129Z [cluster1] },
2021-07-24T00:17:34.6168652Z [cluster1] "type": "array"
2021-07-24T00:17:34.6169155Z [cluster1] }
2021-07-24T00:17:34.6169622Z [cluster1] },
2021-07-24T00:17:34.6170117Z [cluster1] "required": [
2021-07-24T00:17:34.6170685Z [cluster1] "cluster_cidr",
2021-07-24T00:17:34.6171233Z [cluster1] "cluster_id",
2021-07-24T00:17:34.6171849Z [cluster1] "color_codes",
2021-07-24T00:17:34.6172391Z [cluster1] "global_cidr",
2021-07-24T00:17:34.6172952Z [cluster1] "service_cidr"
2021-07-24T00:17:34.6173465Z [cluster1] ],
2021-07-24T00:17:34.6173963Z [cluster1] "type": "object"
2021-07-24T00:17:34.6174634Z [cluster1] }
2021-07-24T00:17:34.6175078Z [cluster1] },
2021-07-24T00:17:34.6175663Z [cluster1] "required": [
2021-07-24T00:17:34.6176166Z [cluster1] "spec"
2021-07-24T00:17:34.6176632Z [cluster1] ],
2021-07-24T00:17:34.6177196Z [cluster1] "type": "object"
2021-07-24T00:17:34.6177698Z [cluster1] }
2021-07-24T00:17:34.6178120Z [cluster1] },
2021-07-24T00:17:34.6178610Z [cluster1] "served": true,
2021-07-24T00:17:34.6179147Z [cluster1] "storage": true
2021-07-24T00:17:34.6179612Z [cluster1] }
2021-07-24T00:17:34.6180040Z [cluster1] ]
2021-07-24T00:17:34.6180442Z [cluster1] },
2021-07-24T00:17:34.6180879Z [cluster1] "status": {
2021-07-24T00:17:34.6181404Z [cluster1] "acceptedNames": {
2021-07-24T00:17:34.6181985Z [cluster1] "kind": "Cluster",
2021-07-24T00:17:34.6182567Z [cluster1] "listKind": "ClusterList",
2021-07-24T00:17:34.6183177Z [cluster1] "plural": "clusters",
2021-07-24T00:17:34.6183748Z [cluster1] "singular": "cluster"
2021-07-24T00:17:34.6184247Z [cluster1] },
2021-07-24T00:17:34.6184707Z [cluster1] "conditions": [
2021-07-24T00:17:34.6185188Z [cluster1] {
2021-07-24T00:17:34.6186090Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:16Z",
2021-07-24T00:17:34.6186806Z [cluster1] "message": "no conflicts found",
2021-07-24T00:17:34.6187448Z [cluster1] "reason": "NoConflicts",
2021-07-24T00:17:34.6188009Z [cluster1] "status": "True",
2021-07-24T00:17:34.6188708Z [cluster1] "type": "NamesAccepted"
2021-07-24T00:17:34.7352502Z [cluste21-07-24T00:13:26Z
2021-07-24T00:17:34.7354504Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:34.7356735Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-24T00:17:34.7358732Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:34.7360492Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-24T00:17:34.7362226Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-24T00:17:34.7364374Z [cluster2] {
2021-07-24T00:17:34.7365188Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:34.7366323Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-24T00:17:34.7367144Z [cluster2] "metadata": {
2021-07-24T00:17:34.7367794Z [cluster2] "annotations": {
2021-07-24T00:17:34.7369037Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:34.7369927Z [cluster2] },
2021-07-24T00:17:34.7370858Z [cluster2] "creationTimestamp": "2021-07-24T00:13:26Z",
2021-07-24T00:17:34.7371716Z [cluster2] "generation": 1,
2021-07-24T00:17:34.7372417Z [cluster2] "managedFields": [
2021-07-24T00:17:34.7373047Z [cluster2] {
2021-07-24T00:17:34.7373813Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:34.7374895Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:34.7375607Z [cluster2] "fieldsV1": {
2021-07-24T00:17:34.7376264Z [cluster2] "f:metadata": {
2021-07-24T00:17:34.7376948Z [cluster2] "f:annotations": {
2021-07-24T00:17:34.7377588Z [cluster2] ".": {},
2021-07-24T00:17:34.7378760Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:34.7379762Z [cluster2] }
2021-07-24T00:17:34.7380293Z [cluster2] },
2021-07-24T00:17:34.7380849Z [cluster2] "f:spec": {
2021-07-24T00:17:34.7381448Z [cluster2] "f:conversion": {
2021-07-24T00:17:34.7383350Z [cluster2] ".": {},
2021-07-24T00:17:34.7383962Z [cluster2] "f:strategy": {}
2021-07-24T00:17:34.7385188Z [cluster2] },
2021-07-24T00:17:34.7386727Z [cluster2] "f:group": {},
2021-07-24T00:17:34.7388185Z [cluster2] "f:names": {
2021-07-24T00:17:34.7390276Z [cluster2] "f:kind": {},
2021-07-24T00:17:34.7394728Z [cluster2] "f:listKind": {},
2021-07-24T00:17:34.7395536Z [cluster2] "f:plural": {},
2021-07-24T00:17:34.7396319Z [cluster2] "f:singular": {}
2021-07-24T00:17:34.7396929Z [cluster2] },
2021-07-24T00:17:34.7397539Z [cluster2] "f:scope": {},
2021-07-24T00:17:34.7398511Z [cluster2] "f:versions": {}
2021-07-24T00:17:34.7404696Z [cluster2] },
2021-07-24T00:17:34.7405417Z [cluster2] "f:status": {
2021-07-24T00:17:34.7406126Z [cluster2] "f:acceptedNames": {
2021-07-24T00:17:34.7406832Z [cluster2] "f:kind": {},
2021-07-24T00:17:34.7407488Z [cluster2] "f:plural": {}
2021-07-24T00:17:34.7408107Z [cluster2] },
2021-07-24T00:17:34.7408752Z [cluster2] "f:conditions": {},
2021-07-24T00:17:34.7409482Z [cluster2] "f:storedVersions": {}
2021-07-24T00:17:34.7410158Z [cluster2] }
2021-07-24T00:17:34.7410704Z [cluster2] },
2021-07-24T00:17:34.7412958Z [cluster2] "manager": "submariner-operator",
2021-07-24T00:17:34.7415665Z [cluster2] "operation": "Update",
2021-07-24T00:17:34.7418011Z [cluster2] "time": "2021-07-24T00:13:34Z"
2021-07-24T00:17:34.7421004Z [cluster2] }
2021-07-24T00:17:34.7421612Z [cluster2] ],
2021-07-24T00:17:34.7422375Z [cluster2] "name": "clusters.submariner.io",
2021-07-24T00:17:34.7425751Z [cluster2] "resourceVersion": "1352",
2021-07-24T00:17:34.7427100Z [cluster2] "uid": "a5e1b2a9-f4f1-42f4-b908-b2e71dc8482f"
2021-07-24T00:17:34.7427911Z [cluster2] },
2021-07-24T00:17:34.7428493Z [cluster2] "spec": {
2021-07-24T00:17:34.7429109Z [cluster2] "conversion": {
2021-07-24T00:17:34.7429765Z [cluster2] "strategy": "None"
2021-07-24T00:17:34.7430377Z [cluster2] },
2021-07-24T00:17:34.7435612Z [cluster2] "group": "submariner.io",
2021-07-24T00:17:34.7436327Z [cluster2] "names": {
2021-07-24T00:17:34.7436941Z [cluster2] "kind": "Cluster",
2021-07-24T00:17:34.7437652Z [cluster2] "listKind": "ClusterList",
2021-07-24T00:17:34.7438400Z [cluster2] "plural": "clusters",
2021-07-24T00:17:34.7439184Z [cluster2] "singular": "cluster"
2021-07-24T00:17:34.7439903Z [cluster2] },
2021-07-24T00:17:34.7440493Z [cluster2] "scope": "Namespaced",
2021-07-24T00:17:34.7441382Z [cluster2] "versions": [
2021-07-24T00:17:34.7442166Z [cluster2] {
2021-07-24T00:17:34.7448109Z [cluster2] "name": "v1",
2021-07-24T00:17:34.7448758Z [cluster2] "schema": {
2021-07-24T00:17:34.7449497Z [cluster2] "openAPIV3Schema": {
2021-07-24T00:17:34.7450230Z [cluster2] "properties": {
2021-07-24T00:17:34.7450939Z [cluster2] "apiVersion": {
2021-07-24T00:17:34.7453795Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:34.7456742Z [cluster2] "type": "string"
2021-07-24T00:17:34.7457273Z [cluster2] },
2021-07-24T00:17:34.7457749Z [cluster2] "kind": {
2021-07-24T00:17:34.7460517Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:34.7462406Z [cluster2] "type": "string"
2021-07-24T00:17:34.7462909Z [cluster2] },
2021-07-24T00:17:34.7463426Z [cluster2] "metadata": {
2021-07-24T00:17:34.7463972Z [cluster2] "type": "object"
2021-07-24T00:17:34.7464491Z [cluster2] },
2021-07-24T00:17:34.7465001Z [cluster2] "spec": {
2021-07-24T00:17:34.7465557Z [cluster2] "properties": {
2021-07-24T00:17:34.7466153Z [cluster2] "cluster_cidr": {
2021-07-24T00:17:34.7466698Z [cluster2] "items": {
2021-07-24T00:17:34.7467313Z [cluster2] "type": "string"
2021-07-24T00:17:34.7467837Z [cluster2] },
2021-07-24T00:17:34.7468363Z [cluster2] "type": "array"
2021-07-24T00:17:34.7468870Z [cluster2] },
2021-07-24T00:17:34.7469396Z [cluster2] "cluster_id": {
2021-07-24T00:17:34.7469953Z [cluster2] "type": "string"
2021-07-24T00:17:34.7470607Z [cluster2] },
2021-07-24T00:17:34.7471231Z [cluster2] "color_codes": {
2021-07-24T00:17:34.7471768Z [cluster2] "items": {
2021-07-24T00:17:34.7472325Z [cluster2] "type": "string"
2021-07-24T00:17:34.7472847Z [cluster2] },
2021-07-24T00:17:34.7473383Z [cluster2] "type": "array"
2021-07-24T00:17:34.7473888Z [cluster2] },
2021-07-24T00:17:34.7474412Z [cluster2] "global_cidr": {
2021-07-24T00:17:34.7474960Z [cluster2] "items": {
2021-07-24T00:17:34.7475500Z [cluster2] "type": "string"
2021-07-24T00:17:34.7476038Z [cluster2] },
2021-07-24T00:17:34.7476553Z [cluster2] "type": "array"
2021-07-24T00:17:34.7477078Z [cluster2] },
2021-07-24T00:17:34.7477600Z [cluster2] "service_cidr": {
2021-07-24T00:17:34.7478159Z [cluster2] "items": {
2021-07-24T00:17:34.7478702Z [cluster2] "type": "string"
2021-07-24T00:17:34.7479236Z [cluster2] },
2021-07-24T00:17:34.7479766Z [cluster2] "type": "array"
2021-07-24T00:17:34.7480271Z [cluster2] }
2021-07-24T00:17:34.7480744Z [cluster2] },
2021-07-24T00:17:34.7481244Z [cluster2] "required": [
2021-07-24T00:17:34.7481814Z [cluster2] "cluster_cidr",
2021-07-24T00:17:34.7482366Z [cluster2] "cluster_id",
2021-07-24T00:17:34.7482927Z [cluster2] "color_codes",
2021-07-24T00:17:34.7483473Z [cluster2] "global_cidr",
2021-07-24T00:17:34.7484043Z [cluster2] "service_cidr"
2021-07-24T00:17:34.7484561Z [cluster2] ],
2021-07-24T00:17:34.7485071Z [cluster2] "type": "object"
2021-07-24T00:17:34.7485583Z [cluster2] }
2021-07-24T00:17:34.7486076Z [cluster2] },
2021-07-24T00:17:34.7486585Z [cluster2] "required": [
2021-07-24T00:17:34.7487089Z [cluster2] "spec"
2021-07-24T00:17:34.7487593Z [cluster2] ],
2021-07-24T00:17:34.7488082Z [cluster2] "type": "object"
2021-07-24T00:17:34.7488584Z [cluster2] }
2021-07-24T00:17:34.7489012Z [cluster2] },
2021-07-24T00:17:34.7489506Z [cluster2] "served": true,
2021-07-24T00:17:34.7490053Z [cluster2] "storage": true
2021-07-24T00:17:34.7490523Z [cluster2] }
2021-07-24T00:17:34.7490954Z [cluster2] ]
2021-07-24T00:17:34.7491360Z [cluster2] },
2021-07-24T00:17:34.7491810Z [cluster2] "status": {
2021-07-24T00:17:34.7492337Z [cluster2] "acceptedNames": {
2021-07-24T00:17:34.7492914Z [cluster2] "kind": "Cluster",
2021-07-24T00:17:34.7493499Z [cluster2] "listKind": "ClusterList",
2021-07-24T00:17:34.7494114Z [cluster2] "plural": "clusters",
2021-07-24T00:17:34.7516631Z [cluster2] "singular": "cluster"
2021-07-24T00:17:34.7517252Z [cluster2] },
2021-07-24T00:17:34.7517727Z [cluster2] "conditions": [
2021-07-24T00:17:34.7518347Z [cluster2] {
2021-07-24T00:17:34.7519240Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:26Z",
2021-07-24T00:17:34.7519912Z [cluster2] "message": "no conflicts found",
2021-07-24T00:17:34.7520717Z [cluster2] "reason": "NoConflicts",
2021-07-24T00:17:34.7521439Z [cluster2] "status": "True",
2021-07-24T00:17:34.7522043Z [cluster2] "type": "NamesAccepted"
2021-07-24T00:17:35.6132648Z [cluster1] },
2021-07-24T00:17:35.6133140Z [cluster1] {
2021-07-24T00:17:35.6134387Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:16Z",
2021-07-24T00:17:35.6135331Z [cluster1] "message": "the initial names have been accepted",
2021-07-24T00:17:35.6136162Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-24T00:17:35.6136853Z [cluster1] "status": "True",
2021-07-24T00:17:35.6137413Z [cluster1] "type": "Established"
2021-07-24T00:17:35.6137928Z [cluster1] }
2021-07-24T00:17:35.6138339Z [cluster1] ],
2021-07-24T00:17:35.6138863Z [cluster1] "storedVersions": [
2021-07-24T00:17:35.6139376Z [cluster1] "v1"
2021-07-24T00:17:35.6139807Z [cluster1] ]
2021-07-24T00:17:35.6140231Z [cluster1] }
2021-07-24T00:17:35.6140624Z [cluster1] }
2021-07-24T00:17:35.6141781Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-24T00:17:35.6143497Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-24T00:17:35.6145204Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:35.6146722Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:35.6147927Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:35.6149455Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:35.6151214Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:35.6152546Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:35.6154192Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:35.6155830Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-24T00:17:35.6157158Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-24T00:17:35.6159153Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:35.6160863Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-24T00:17:35.6162327Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-24T00:17:35.6164160Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-24T00:17:35.6165661Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-24T00:17:35.6166601Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-24T00:17:35.6168093Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-24T00:17:35.6169759Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-24T00:17:35.6171344Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-24T00:17:35.6172835Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-24T00:17:35.6174663Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-24T00:17:35.6175712Z [cluster1] NAME CREATED AT
2021-07-24T00:17:35.6176661Z [cluster1] submariners.submariner.io 2021-07-24T00:13:06Z
2021-07-24T00:17:35.6178231Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:35.6180128Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-24T00:17:35.6181876Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:35.6183724Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-24T00:17:35.6185429Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-24T00:17:35.6186420Z [cluster1] {
2021-07-24T00:17:35.6187060Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:35.6188070Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-24T00:17:35.6188858Z [cluster1] "metadata": {
2021-07-24T00:17:35.6189391Z [cluster1] "annotations": {
2021-07-24T00:17:35.6190417Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:35.6191188Z [cluster1] },
2021-07-24T00:17:35.6192034Z [cluster1] "creationTimestamp": "2021-07-24T00:13:06Z",
2021-07-24T00:17:35.6192639Z [cluster1] "generation": 2,
2021-07-24T00:17:35.6193162Z [cluster1] "managedFields": [
2021-07-24T00:17:35.6193638Z [cluster1] {
2021-07-24T00:17:35.6194242Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:35.6194966Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:35.6195521Z [cluster1] "fieldsV1": {
2021-07-24T00:17:35.6196006Z [cluster1] "f:metadata": {
2021-07-24T00:17:35.6196817Z [cluster1] "f:annotations": {
2021-07-24T00:17:35.6197339Z [cluster1] ".": {},
2021-07-24T00:17:35.6198645Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:35.6199365Z [cluster1] }
2021-07-24T00:17:35.6199785Z [cluster1] },
2021-07-24T00:17:35.6285376Z [cluster1] "f:spec": {
2021-07-24T00:17:35.6285966Z [cluster1] "f:conversion": {
2021-07-24T00:17:35.6286500Z [cluster1] ".": {},
2021-07-24T00:17:35.6287003Z [cluster1] "f:strategy": {}
2021-07-24T00:17:35.6287502Z [cluster1] },
2021-07-24T00:17:35.6287989Z [cluster1] "f:group": {},
2021-07-24T00:17:35.6288665Z [cluster1] "f:names": {
2021-07-24T00:17:35.6289178Z [cluster1] "f:kind": {},
2021-07-24T00:17:35.6289695Z [cluster1] "f:listKind": {},
2021-07-24T00:17:35.6290243Z [cluster1] "f:plural": {},
2021-07-24T00:17:35.6290770Z [cluster1] "f:singular": {}
2021-07-24T00:17:35.6291268Z [cluster1] },
2021-07-24T00:17:35.6291742Z [cluster1] "f:scope": {},
2021-07-24T00:17:35.6292272Z [cluster1] "f:versions": {}
2021-07-24T00:17:35.6292760Z [cluster1] },
2021-07-24T00:17:35.6293237Z [cluster1] "f:status": {
2021-07-24T00:17:35.6293819Z [cluster1] "f:acceptedNames": {
2021-07-24T00:17:35.6294375Z [cluster1] "f:kind": {},
2021-07-24T00:17:35.6295369Z [cluster1] "f:plural": {}
2021-07-24T00:17:35.6295853Z [cluster1] },
2021-07-24T00:17:35.6296376Z [cluster1] "f:conditions": {},
2021-07-24T00:17:35.6296979Z [cluster1] "f:storedVersions": {}
2021-07-24T00:17:35.6297527Z [cluster1] }
2021-07-24T00:17:35.6297953Z [cluster1] },
2021-07-24T00:17:35.6298459Z [cluster1] "manager": "subctl",
2021-07-24T00:17:35.6299034Z [cluster1] "operation": "Update",
2021-07-24T00:17:35.6300117Z [cluster1] "time": "2021-07-24T00:13:17Z"
2021-07-24T00:17:35.6300736Z [cluster1] }
2021-07-24T00:17:35.6301151Z [cluster1] ],
2021-07-24T00:17:35.6301830Z [cluster1] "name": "submariners.submariner.io",
2021-07-24T00:17:35.6302603Z [cluster1] "resourceVersion": "2085",
2021-07-24T00:17:35.6303628Z [cluster1] "uid": "f36f9541-0597-442b-8535-ab459efe9f92"
2021-07-24T00:17:35.6304155Z [cluster1] },
2021-07-24T00:17:35.6304570Z [cluster1] "spec": {
2021-07-24T00:17:35.6305023Z [cluster1] "conversion": {
2021-07-24T00:17:35.6305530Z [cluster1] "strategy": "None"
2021-07-24T00:17:35.6305968Z [cluster1] },
2021-07-24T00:17:35.6306465Z [cluster1] "group": "submariner.io",
2021-07-24T00:17:35.6306975Z [cluster1] "names": {
2021-07-24T00:17:35.6307452Z [cluster1] "kind": "Submariner",
2021-07-24T00:17:35.6308267Z [cluster1] "listKind": "SubmarinerList",
2021-07-24T00:17:35.6308918Z [cluster1] "plural": "submariners",
2021-07-24T00:17:35.6309545Z [cluster1] "singular": "submariner"
2021-07-24T00:17:35.6310050Z [cluster1] },
2021-07-24T00:17:35.6310561Z [cluster1] "scope": "Namespaced",
2021-07-24T00:17:35.6311101Z [cluster1] "versions": [
2021-07-24T00:17:35.6311566Z [cluster1] {
2021-07-24T00:17:35.6312045Z [cluster1] "name": "v1alpha1",
2021-07-24T00:17:35.6312564Z [cluster1] "schema": {
2021-07-24T00:17:35.6313151Z [cluster1] "openAPIV3Schema": {
2021-07-24T00:17:35.6313968Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-24T00:17:35.6314754Z [cluster1] "properties": {
2021-07-24T00:17:35.6315327Z [cluster1] "apiVersion": {
2021-07-24T00:17:35.6317770Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:35.6319757Z [cluster1] "type": "string"
2021-07-24T00:17:35.6320220Z [cluster1] },
2021-07-24T00:17:35.6320672Z [cluster1] "kind": {
2021-07-24T00:17:35.6322904Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:35.6324856Z [cluster1] "type": "string"
2021-07-24T00:17:35.6325366Z [cluster1] },
2021-07-24T00:17:35.6325862Z [cluster1] "metadata": {
2021-07-24T00:17:35.6326426Z [cluster1] "type": "object"
2021-07-24T00:17:35.6326971Z [cluster1] },
2021-07-24T00:17:35.6327455Z [cluster1] "spec": {
2021-07-24T00:17:35.6328282Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-24T00:17:35.6329140Z [cluster1] "properties": {
2021-07-24T00:17:35.6329707Z [cluster1] "broker": {
2021-07-24T00:17:35.6330250Z [cluster1] "type": "string"
2021-07-24T00:17:35.6330777Z [cluster1] },
2021-07-24T00:17:35.6331382Z [cluster1] "brokerK8sApiServer": {
2021-07-24T00:17:35.6332056Z [cluster1] "type": "string"
2021-07-24T00:17:35.6332680Z [cluster1] },
2021-07-24T00:17:35.6333373Z [cluster1] "brokerK8sApiServerToken": {
2021-07-24T00:17:35.6334057Z [cluster1] "type": "string"
2021-07-24T00:17:35.6366882Z [cluster1] },
2021-07-24T00:17:35.6367527Z [cluster1] "brokerK8sCA": {
2021-07-24T00:17:35.6369180Z [cluster1] "type": "string"
2021-07-24T00:17:35.6369714Z [cluster1] },
2021-07-24T00:17:35.6370411Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-24T00:17:35.6371171Z [cluster1] "type": "string"
2021-07-24T00:17:35.6371696Z [cluster1] },
2021-07-24T00:17:35.6372223Z [cluster1] "cableDriver": {
2021-07-24T00:17:35.6372816Z [cluster1] "type": "string"
2021-07-24T00:17:35.6373334Z [cluster1] },
2021-07-24T00:17:35.6373893Z [cluster1] "ceIPSecDebug": {
2021-07-24T00:17:35.6374794Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6375332Z [cluster1] },
2021-07-24T00:17:35.6375985Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-24T00:17:35.6376723Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6377256Z [cluster1] },
2021-07-24T00:17:35.6377825Z [cluster1] "ceIPSecIKEPort": {
2021-07-24T00:17:35.6378467Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6378987Z [cluster1] },
2021-07-24T00:17:35.6379576Z [cluster1] "ceIPSecNATTPort": {
2021-07-24T00:17:35.6380543Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6381170Z [cluster1] },
2021-07-24T00:17:35.6381676Z [cluster1] "ceIPSecPSK": {
2021-07-24T00:17:35.6382433Z [cluster1] "type": "string"
2021-07-24T00:17:35.6382957Z [cluster1] },
2021-07-24T00:17:35.6384076Z [cluster1] "ceIPSecPreferredServer": {
2021-07-24T00:17:35.6388474Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6389018Z [cluster1] },
2021-07-24T00:17:35.6389563Z [cluster1] "clusterCIDR": {
2021-07-24T00:17:35.6390144Z [cluster1] "type": "string"
2021-07-24T00:17:35.6390866Z [cluster1] },
2021-07-24T00:17:35.6391596Z [cluster1] "clusterID": {
2021-07-24T00:17:35.6392185Z [cluster1] "type": "string"
2021-07-24T00:17:35.6392715Z [cluster1] },
2021-07-24T00:17:35.6393610Z [cluster1] "colorCodes": {
2021-07-24T00:17:35.6394378Z [cluster1] "type": "string"
2021-07-24T00:17:35.6394902Z [cluster1] },
2021-07-24T00:17:35.6395563Z [cluster1] "connectionHealthCheck": {
2021-07-24T00:17:35.6396278Z [cluster1] "properties": {
2021-07-24T00:17:35.6398372Z [cluster1] "enabled": {
2021-07-24T00:17:35.6399123Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6399657Z [cluster1] },
2021-07-24T00:17:35.6400254Z [cluster1] "intervalSeconds": {
2021-07-24T00:17:35.6401245Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-24T00:17:35.6402219Z [cluster1] "format": "int64",
2021-07-24T00:17:35.6402816Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6403370Z [cluster1] },
2021-07-24T00:17:35.6404222Z [cluster1] "maxPacketLossCount": {
2021-07-24T00:17:35.6405550Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-24T00:17:35.6406512Z [cluster1] "format": "int64",
2021-07-24T00:17:35.6407099Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6407827Z [cluster1] }
2021-07-24T00:17:35.6408317Z [cluster1] },
2021-07-24T00:17:35.6408835Z [cluster1] "type": "object"
2021-07-24T00:17:35.6409366Z [cluster1] },
2021-07-24T00:17:35.6409983Z [cluster1] "coreDNSCustomConfig": {
2021-07-24T00:17:35.6410691Z [cluster1] "properties": {
2021-07-24T00:17:35.6411315Z [cluster1] "configMapName": {
2021-07-24T00:17:35.6412059Z [cluster1] "type": "string"
2021-07-24T00:17:35.6412751Z [cluster1] },
2021-07-24T00:17:35.6413274Z [cluster1] "namespace": {
2021-07-24T00:17:35.6413859Z [cluster1] "type": "string"
2021-07-24T00:17:35.6414387Z [cluster1] }
2021-07-24T00:17:35.6427198Z [cluster1] },
2021-07-24T00:17:35.6427704Z [cluster1] "type": "object"
2021-07-24T00:17:35.6428702Z [cluster1] },
2021-07-24T00:17:35.6429603Z [cluster1] "customDomains": {
2021-07-24T00:17:35.6430493Z [cluster1] "items": {
2021-07-24T00:17:35.6431016Z [cluster1] "type": "string"
2021-07-24T00:17:35.6431699Z [cluster1] },
2021-07-24T00:17:35.6432196Z [cluster1] "type": "array",
2021-07-24T00:17:35.6433618Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-24T00:17:35.6434412Z [cluster1] },
2021-07-24T00:17:35.6435053Z [cluster1] "debug": {
2021-07-24T00:17:35.6435615Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6436148Z [cluster1] },
2021-07-24T00:17:35.6436671Z [cluster1] "globalCIDR": {
2021-07-24T00:17:35.6438122Z [cluster1] "type": "string"
2021-07-24T00:17:35.6438662Z [cluster1] },
2021-07-24T00:17:35.6439476Z [cluster1] "imageOverrides": {
2021-07-24T00:17:35.6440159Z [cluster1] "additionalProperties": {
2021-07-24T00:17:35.6441018Z [cluster1] "type": "string"
2021-07-24T00:17:35.6441502Z [cluster1] },
2021-07-24T00:17:35.6442184Z [cluster1] "type": "object"
2021-07-24T00:17:35.6442799Z [cluster1] },
2021-07-24T00:17:35.6443370Z [cluster1] "loadBalancerEnabled": {
2021-07-24T00:17:35.6444015Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6444501Z [cluster1] },
2021-07-24T00:17:35.6444994Z [cluster1] "namespace": {
2021-07-24T00:17:35.6445526Z [cluster1] "type": "string"
2021-07-24T00:17:35.6446011Z [cluster1] },
2021-07-24T00:17:35.6446493Z [cluster1] "natEnabled": {
2021-07-24T00:17:35.6447049Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6447545Z [cluster1] },
2021-07-24T00:17:35.6448027Z [cluster1] "repository": {
2021-07-24T00:17:35.6448564Z [cluster1] "type": "string"
2021-07-24T00:17:35.6449038Z [cluster1] },
2021-07-24T00:17:35.6449542Z [cluster1] "serviceCIDR": {
2021-07-24T00:17:35.6450082Z [cluster1] "type": "string"
2021-07-24T00:17:35.6450561Z [cluster1] },
2021-07-24T00:17:35.6451195Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-24T00:17:35.6451893Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6452553Z [cluster1] },
2021-07-24T00:17:35.6453023Z [cluster1] "version": {
2021-07-24T00:17:35.6453546Z [cluster1] "type": "string"
2021-07-24T00:17:35.6454012Z [cluster1] }
2021-07-24T00:17:35.6454960Z [cluster1] },
2021-07-24T00:17:35.6455583Z [cluster1] "required": [
2021-07-24T00:17:35.6456108Z [cluster1] "broker",
2021-07-24T00:17:35.6456696Z [cluster1] "brokerK8sApiServer",
2021-07-24T00:17:35.6457462Z [cluster1] "brokerK8sApiServerToken",
2021-07-24T00:17:35.6458259Z [cluster1] "brokerK8sCA",
2021-07-24T00:17:35.6458956Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-24T00:17:35.6459683Z [cluster1] "ceIPSecDebug",
2021-07-24T00:17:35.6460253Z [cluster1] "ceIPSecPSK",
2021-07-24T00:17:35.6460814Z [cluster1] "clusterCIDR",
2021-07-24T00:17:35.6461345Z [cluster1] "clusterID",
2021-07-24T00:17:35.6461968Z [cluster1] "debug",
2021-07-24T00:17:35.6462622Z [cluster1] "namespace",
2021-07-24T00:17:35.6463338Z [cluster1] "natEnabled",
2021-07-24T00:17:35.6463898Z [cluster1] "serviceCIDR"
2021-07-24T00:17:35.6464383Z [cluster1] ],
2021-07-24T00:17:35.6464866Z [cluster1] "type": "object"
2021-07-24T00:17:35.6465329Z [cluster1] },
2021-07-24T00:17:35.6465784Z [cluster1] "status": {
2021-07-24T00:17:35.6466560Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-24T00:17:35.6467374Z [cluster1] "properties": {
2021-07-24T00:17:35.6468133Z [cluster1] "clusterCIDR": {
2021-07-24T00:17:35.6468716Z [cluster1] "type": "string"
2021-07-24T00:17:35.6469312Z [cluster1] },
2021-07-24T00:17:35.6469821Z [cluster1] "clusterID": {
2021-07-24T00:17:35.6470390Z [cluster1] "type": "string"
2021-07-24T00:17:35.6470890Z [cluster1] },
2021-07-24T00:17:35.6471422Z [cluster1] "colorCodes": {
2021-07-24T00:17:35.6471992Z [cluster1] "type": "string"
2021-07-24T00:17:35.6472512Z [cluster1] },
2021-07-24T00:17:35.6473089Z [cluster1] "deploymentInfo": {
2021-07-24T00:17:35.6474288Z [cluster1] "properties": {
2021-07-24T00:17:35.6475311Z [cluster1] "cloudProvider": {
2021-07-24T00:17:35.6475930Z [cluster1] "type": "string"
2021-07-24T00:17:35.6484728Z [cluster1] },
2021-07-24T00:17:35.6485515Z [cluster1] "kubernetesType": {
2021-07-24T00:17:35.6486328Z [cluster1] "type": "string"
2021-07-24T00:17:35.6487102Z [cluster1] },
2021-07-24T00:17:35.6488119Z [cluster1] "kubernetesTypeVersion": {
2021-07-24T00:17:35.6488860Z [cluster1] "type": "string"
2021-07-24T00:17:35.6489389Z [cluster1] },
2021-07-24T00:17:35.6490010Z [cluster1] "kubernetesVersion": {
2021-07-24T00:17:35.6490671Z [cluster1] "type": "string"
2021-07-24T00:17:35.6491206Z [cluster1] }
2021-07-24T00:17:35.6491676Z [cluster1] },
2021-07-24T00:17:35.6492214Z [cluster1] "type": "object"
2021-07-24T00:17:35.6492738Z [cluster1] },
2021-07-24T00:17:35.6493395Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-24T00:17:35.6494134Z [cluster1] "properties": {
2021-07-24T00:17:35.6495137Z [cluster1] "lastResourceVersion": {
2021-07-24T00:17:35.6495852Z [cluster1] "type": "string"
2021-07-24T00:17:35.6496375Z [cluster1] },
2021-07-24T00:17:35.6497107Z [cluster1] "mismatchedContainerImages": {
2021-07-24T00:17:35.6500027Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6500938Z [cluster1] },
2021-07-24T00:17:35.6501654Z [cluster1] "nonReadyContainerStates": {
2021-07-24T00:17:35.6502367Z [cluster1] "items": {
2021-07-24T00:17:35.6503967Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.6505822Z [cluster1] "properties": {
2021-07-24T00:17:35.6506424Z [cluster1] "running": {
2021-07-24T00:17:35.6507171Z [cluster1] "description": "Details about a running container",
2021-07-24T00:17:35.6507951Z [cluster1] "properties": {
2021-07-24T00:17:35.6508568Z [cluster1] "startedAt": {
2021-07-24T00:17:35.6510001Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.6511873Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6512543Z [cluster1] "type": "string"
2021-07-24T00:17:35.6513113Z [cluster1] }
2021-07-24T00:17:35.6513611Z [cluster1] },
2021-07-24T00:17:35.6514173Z [cluster1] "type": "object"
2021-07-24T00:17:35.6514950Z [cluster1] },
2021-07-24T00:17:35.6515519Z [cluster1] "terminated": {
2021-07-24T00:17:35.6516489Z [cluster1] "description": "Details about a terminated container",
2021-07-24T00:17:35.6517287Z [cluster1] "properties": {
2021-07-24T00:17:35.6517935Z [cluster1] "containerID": {
2021-07-24T00:17:35.6519144Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.6520013Z [cluster1] "type": "string"
2021-07-24T00:17:35.6520568Z [cluster1] },
2021-07-24T00:17:35.6521139Z [cluster1] "exitCode": {
2021-07-24T00:17:35.6521978Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.6522805Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6523426Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6523997Z [cluster1] },
2021-07-24T00:17:35.6524672Z [cluster1] "finishedAt": {
2021-07-24T00:17:35.6525496Z [cluster1] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.6526551Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6527343Z [cluster1] "type": "string"
2021-07-24T00:17:35.6527849Z [cluster1] },
2021-07-24T00:17:35.6528372Z [cluster1] "message": {
2021-07-24T00:17:35.6529163Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.6529947Z [cluster1] "type": "string"
2021-07-24T00:17:35.6530478Z [cluster1] },
2021-07-24T00:17:35.6530975Z [cluster1] "reason": {
2021-07-24T00:17:35.6531743Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.6532791Z [cluster1] "type": "string"
2021-07-24T00:17:35.6533402Z [cluster1] },
2021-07-24T00:17:35.6533908Z [cluster1] "signal": {
2021-07-24T00:17:35.6534800Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.6535562Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6536132Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6536826Z [cluster1] },
2021-07-24T00:17:35.6537361Z [cluster1] "startedAt": {
2021-07-24T00:17:35.6538150Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.6539242Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6539842Z [cluster1] "type": "string"
2021-07-24T00:17:35.6540354Z [cluster1] }
2021-07-24T00:17:35.6540840Z [cluster1] },
2021-07-24T00:17:35.6541346Z [cluster1] "required": [
2021-07-24T00:17:35.6541911Z [cluster1] "exitCode"
2021-07-24T00:17:35.6542419Z [cluster1] ],
2021-07-24T00:17:35.6542945Z [cluster1] "type": "object"
2021-07-24T00:17:35.6543854Z [cluster1] },
2021-07-24T00:17:35.6544385Z [cluster1] "waiting": {
2021-07-24T00:17:35.6545133Z [cluster1] "description": "Details about a waiting container",
2021-07-24T00:17:35.6545887Z [cluster1] "properties": {
2021-07-24T00:17:35.6546592Z [cluster1] "message": {
2021-07-24T00:17:35.6547418Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.6548257Z [cluster1] "type": "string"
2021-07-24T00:17:35.6548813Z [cluster1] },
2021-07-24T00:17:35.6549345Z [cluster1] "reason": {
2021-07-24T00:17:35.6550133Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.6550909Z [cluster1] "type": "string"
2021-07-24T00:17:35.6551466Z [cluster1] }
2021-07-24T00:17:35.6551983Z [cluster1] },
2021-07-24T00:17:35.6552528Z [cluster1] "type": "object"
2021-07-24T00:17:35.6553085Z [cluster1] }
2021-07-24T00:17:35.6553574Z [cluster1] },
2021-07-24T00:17:35.6554119Z [cluster1] "type": "object"
2021-07-24T00:17:35.6554647Z [cluster1] },
2021-07-24T00:17:35.6555244Z [cluster1] "type": "array"
2021-07-24T00:17:35.6555772Z [cluster1] },
2021-07-24T00:17:35.6556492Z [cluster1] "status": {
2021-07-24T00:17:35.6557381Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.6558644Z [cluster1] "properties": {
2021-07-24T00:17:35.6559620Z [cluster1] "collisionCount": {
2021-07-24T00:17:35.6560939Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.6562234Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6562800Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6563309Z [cluster1] },
2021-07-24T00:17:35.6563829Z [cluster1] "conditions": {
2021-07-24T00:17:35.6565082Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.6565923Z [cluster1] "items": {
2021-07-24T00:17:35.6566798Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.6567883Z [cluster1] "properties": {
2021-07-24T00:17:35.6568558Z [cluster1] "lastTransitionTime": {
2021-07-24T00:17:35.6569454Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.6571287Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6572191Z [cluster1] "type": "string"
2021-07-24T00:17:35.6572753Z [cluster1] },
2021-07-24T00:17:35.6573315Z [cluster1] "message": {
2021-07-24T00:17:35.6574209Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.6575370Z [cluster1] "type": "string"
2021-07-24T00:17:35.6575948Z [cluster1] },
2021-07-24T00:17:35.6576479Z [cluster1] "reason": {
2021-07-24T00:17:35.6577788Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.6578608Z [cluster1] "type": "string"
2021-07-24T00:17:35.6579155Z [cluster1] },
2021-07-24T00:17:35.6579696Z [cluster1] "status": {
2021-07-24T00:17:35.6580493Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.6581402Z [cluster1] "type": "string"
2021-07-24T00:17:35.6581964Z [cluster1] },
2021-07-24T00:17:35.6582490Z [cluster1] "type": {
2021-07-24T00:17:35.6583224Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.6583966Z [cluster1] "type": "string"
2021-07-24T00:17:35.6584534Z [cluster1] }
2021-07-24T00:17:35.6585035Z [cluster1] },
2021-07-24T00:17:35.6585680Z [cluster1] "required": [
2021-07-24T00:17:35.6586215Z [cluster1] "status",
2021-07-24T00:17:35.6586719Z [cluster1] "type"
2021-07-24T00:17:35.6587208Z [cluster1] ],
2021-07-24T00:17:35.6587709Z [cluster1] "type": "object"
2021-07-24T00:17:35.6588388Z [cluster1] },
2021-07-24T00:17:35.6588897Z [cluster1] "type": "array"
2021-07-24T00:17:35.6589398Z [cluster1] },
2021-07-24T00:17:35.6590037Z [cluster1] "currentNumberScheduled": {
2021-07-24T00:17:35.6591852Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6593690Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6594302Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6594853Z [cluster1] },
2021-07-24T00:17:35.6595662Z [cluster1] "desiredNumberScheduled": {
2021-07-24T00:17:35.6597495Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6599117Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6599739Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6600289Z [cluster1] },
2021-07-24T00:17:35.6600886Z [cluster1] "numberAvailable": {
2021-07-24T00:17:35.6602172Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.6603376Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6603977Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6612007Z [cluster1] },
2021-07-24T00:17:35.6612668Z [cluster1] "numberMisscheduled": {
2021-07-24T00:17:35.6614136Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6616111Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6616731Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6617389Z [cluster1] },
2021-07-24T00:17:35.6617914Z [cluster1] "numberReady": {
2021-07-24T00:17:35.6618859Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.6619755Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6620317Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6620821Z [cluster1] },
2021-07-24T00:17:35.6621397Z [cluster1] "numberUnavailable": {
2021-07-24T00:17:35.6633652Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.6634962Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6635577Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6636224Z [cluster1] },
2021-07-24T00:17:35.6636868Z [cluster1] "observedGeneration": {
2021-07-24T00:17:35.6637833Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.6638717Z [cluster1] "format": "int64",
2021-07-24T00:17:35.6639320Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6639861Z [cluster1] },
2021-07-24T00:17:35.6640713Z [cluster1] "updatedNumberScheduled": {
2021-07-24T00:17:35.6641686Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.6642509Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6643110Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6643651Z [cluster1] }
2021-07-24T00:17:35.6644151Z [cluster1] },
2021-07-24T00:17:35.6644675Z [cluster1] "required": [
2021-07-24T00:17:35.6645418Z [cluster1] "currentNumberScheduled",
2021-07-24T00:17:35.6646290Z [cluster1] "desiredNumberScheduled",
2021-07-24T00:17:35.6647111Z [cluster1] "numberMisscheduled",
2021-07-24T00:17:35.6647816Z [cluster1] "numberReady"
2021-07-24T00:17:35.6648363Z [cluster1] ],
2021-07-24T00:17:35.6648903Z [cluster1] "type": "object"
2021-07-24T00:17:35.6649422Z [cluster1] }
2021-07-24T00:17:35.6649900Z [cluster1] },
2021-07-24T00:17:35.6650481Z [cluster1] "required": [
2021-07-24T00:17:35.6651241Z [cluster1] "mismatchedContainerImages"
2021-07-24T00:17:35.6651949Z [cluster1] ],
2021-07-24T00:17:35.6652574Z [cluster1] "type": "object"
2021-07-24T00:17:35.6653242Z [cluster1] },
2021-07-24T00:17:35.6653848Z [cluster1] "gateways": {
2021-07-24T00:17:35.6654353Z [cluster1] "items": {
2021-07-24T00:17:35.6655066Z [cluster1] "properties": {
2021-07-24T00:17:35.6655636Z [cluster1] "connections": {
2021-07-24T00:17:35.6656162Z [cluster1] "items": {
2021-07-24T00:17:35.6656714Z [cluster1] "properties": {
2021-07-24T00:17:35.6657289Z [cluster1] "endpoint": {
2021-07-24T00:17:35.6657858Z [cluster1] "properties": {
2021-07-24T00:17:35.6658433Z [cluster1] "backend": {
2021-07-24T00:17:35.6658980Z [cluster1] "type": "string"
2021-07-24T00:17:35.6659511Z [cluster1] },
2021-07-24T00:17:35.6660041Z [cluster1] "backend_config": {
2021-07-24T00:17:35.6660735Z [cluster1] "additionalProperties": {
2021-07-24T00:17:35.6661426Z [cluster1] "type": "string"
2021-07-24T00:17:35.6661942Z [cluster1] },
2021-07-24T00:17:35.6662472Z [cluster1] "type": "object"
2021-07-24T00:17:35.6662990Z [cluster1] },
2021-07-24T00:17:35.6663576Z [cluster1] "cable_name": {
2021-07-24T00:17:35.6664143Z [cluster1] "type": "string"
2021-07-24T00:17:35.6664656Z [cluster1] },
2021-07-24T00:17:35.6665174Z [cluster1] "cluster_id": {
2021-07-24T00:17:35.6665722Z [cluster1] "type": "string"
2021-07-24T00:17:35.6666823Z [cluster1] },
2021-07-24T00:17:35.6667394Z [cluster1] "healthCheckIP": {
2021-07-24T00:17:35.6668209Z [cluster1] "type": "string"
2021-07-24T00:17:35.6668783Z [cluster1] },
2021-07-24T00:17:35.6669372Z [cluster1] "hostname": {
2021-07-24T00:17:35.6669985Z [cluster1] "type": "string"
2021-07-24T00:17:35.6670801Z [cluster1] },
2021-07-24T00:17:35.6671365Z [cluster1] "nat_enabled": {
2021-07-24T00:17:35.6671995Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6673125Z [cluster1] },
2021-07-24T00:17:35.6679268Z [cluster1] "private_ip": {
2021-07-24T00:17:35.6682232Z [cluster1] "type": "string"
2021-07-24T00:17:35.6683195Z [cluster1] },
2021-07-24T00:17:35.6683999Z [cluster1] "public_ip": {
2021-07-24T00:17:35.6684770Z [cluster1] "type": "string"
2021-07-24T00:17:35.6685344Z [cluster1] },
2021-07-24T00:17:35.6685895Z [cluster1] "subnets": {
2021-07-24T00:17:35.6686472Z [cluster1] "items": {
2021-07-24T00:17:35.6687054Z [cluster1] "type": "string"
2021-07-24T00:17:35.6687629Z [cluster1] },
2021-07-24T00:17:35.6688385Z [cluster1] "type": "array"
2021-07-24T00:17:35.6688933Z [cluster1] }
2021-07-24T00:17:35.6689453Z [cluster1] },
2021-07-24T00:17:35.6689997Z [cluster1] "required": [
2021-07-24T00:17:35.6690589Z [cluster1] "backend",
2021-07-24T00:17:35.6691170Z [cluster1] "cable_name",
2021-07-24T00:17:35.6691774Z [cluster1] "cluster_id",
2021-07-24T00:17:35.6692572Z [cluster1] "hostname",
2021-07-24T00:17:35.6693159Z [cluster1] "nat_enabled",
2021-07-24T00:17:35.6693911Z [cluster1] "private_ip",
2021-07-24T00:17:35.6695091Z [cluster1] "public_ip",
2021-07-24T00:17:35.6695694Z [cluster1] "subnets"
2021-07-24T00:17:35.6696236Z [cluster1] ],
2021-07-24T00:17:35.6696796Z [cluster1] "type": "object"
2021-07-24T00:17:35.6697357Z [cluster1] },
2021-07-24T00:17:35.6697918Z [cluster1] "latencyRTT": {
2021-07-24T00:17:35.6698991Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-24T00:17:35.6700060Z [cluster1] "properties": {
2021-07-24T00:17:35.6700671Z [cluster1] "average": {
2021-07-24T00:17:35.6701282Z [cluster1] "type": "string"
2021-07-24T00:17:35.6701834Z [cluster1] },
2021-07-24T00:17:35.6702370Z [cluster1] "last": {
2021-07-24T00:17:35.6703277Z [cluster1] "type": "string"
2021-07-24T00:17:35.6703847Z [cluster1] },
2021-07-24T00:17:35.6704360Z [cluster1] "max": {
2021-07-24T00:17:35.6705467Z [cluster1] "type": "string"
2021-07-24T00:17:35.6706373Z [cluster1] },
2021-07-24T00:17:35.6707050Z [cluster1] "min": {
2021-07-24T00:17:35.6707632Z [cluster1] "type": "string"
2021-07-24T00:17:35.6708181Z [cluster1] },
2021-07-24T00:17:35.6708738Z [cluster1] "stdDev": {
2021-07-24T00:17:35.6709337Z [cluster1] "type": "string"
2021-07-24T00:17:35.6709885Z [cluster1] }
2021-07-24T00:17:35.6710401Z [cluster1] },
2021-07-24T00:17:35.6710950Z [cluster1] "type": "object"
2021-07-24T00:17:35.6711505Z [cluster1] },
2021-07-24T00:17:35.6712025Z [cluster1] "status": {
2021-07-24T00:17:35.6712610Z [cluster1] "type": "string"
2021-07-24T00:17:35.6713167Z [cluster1] },
2021-07-24T00:17:35.6713932Z [cluster1] "statusMessage": {
2021-07-24T00:17:35.6714582Z [cluster1] "type": "string"
2021-07-24T00:17:35.6715123Z [cluster1] },
2021-07-24T00:17:35.6715668Z [cluster1] "usingIP": {
2021-07-24T00:17:35.6716603Z [cluster1] "type": "string"
2021-07-24T00:17:35.6717340Z [cluster1] },
2021-07-24T00:17:35.6718142Z [cluster1] "usingNAT": {
2021-07-24T00:17:35.6718895Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6719476Z [cluster1] }
2021-07-24T00:17:35.6720803Z [cluster1] },
2021-07-24T00:17:35.6721365Z [cluster1] "required": [
2021-07-24T00:17:35.6721951Z [cluster1] "endpoint",
2021-07-24T00:17:35.6722533Z [cluster1] "status",
2021-07-24T00:17:35.6723158Z [cluster1] "statusMessage"
2021-07-24T00:17:35.6723734Z [cluster1] ],
2021-07-24T00:17:35.6724492Z [cluster1] "type": "object"
2021-07-24T00:17:35.6725027Z [cluster1] },
2021-07-24T00:17:35.6725566Z [cluster1] "type": "array"
2021-07-24T00:17:35.6726082Z [cluster1] },
2021-07-24T00:17:35.6726715Z [cluster1] "haStatus": {
2021-07-24T00:17:35.6727336Z [cluster1] "type": "string"
2021-07-24T00:17:35.6727872Z [cluster1] },
2021-07-24T00:17:35.6728447Z [cluster1] "localEndpoint": {
2021-07-24T00:17:35.6729085Z [cluster1] "properties": {
2021-07-24T00:17:35.6729682Z [cluster1] "backend": {
2021-07-24T00:17:35.6730251Z [cluster1] "type": "string"
2021-07-24T00:17:35.6730806Z [cluster1] },
2021-07-24T00:17:35.6731368Z [cluster1] "backend_config": {
2021-07-24T00:17:35.6732086Z [cluster1] "additionalProperties": {
2021-07-24T00:17:35.6732811Z [cluster1] "type": "string"
2021-07-24T00:17:35.6733355Z [cluster1] },
2021-07-24T00:17:35.6733916Z [cluster1] "type": "object"
2021-07-24T00:17:35.6734966Z [cluster1] },
2021-07-24T00:17:35.6735515Z [cluster1] "cable_name": {
2021-07-24T00:17:35.6736108Z [cluster1] "type": "string"
2021-07-24T00:17:35.6736639Z [cluster1] },
2021-07-24T00:17:35.6737184Z [cluster1] "cluster_id": {
2021-07-24T00:17:35.6737761Z [cluster1] "type": "string"
2021-07-24T00:17:35.6738319Z [cluster1] },
2021-07-24T00:17:35.6738899Z [cluster1] "healthCheckIP": {
2021-07-24T00:17:35.6739532Z [cluster1] "type": "string"
2021-07-24T00:17:35.6740087Z [cluster1] },
2021-07-24T00:17:35.6741030Z [cluster1] "hostname": {
2021-07-24T00:17:35.6741903Z [cluster1] "type": "string"
2021-07-24T00:17:35.6742601Z [cluster1] },
2021-07-24T00:17:35.6743154Z [cluster1] "nat_enabled": {
2021-07-24T00:17:35.6743753Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6744314Z [cluster1] },
2021-07-24T00:17:35.6744874Z [cluster1] "private_ip": {
2021-07-24T00:17:35.6745758Z [cluster1] "type": "string"
2021-07-24T00:17:35.6746311Z [cluster1] },
2021-07-24T00:17:35.6746840Z [cluster1] "public_ip": {
2021-07-24T00:17:35.6747432Z [cluster1] "type": "string"
2021-07-24T00:17:35.6747972Z [cluster1] },
2021-07-24T00:17:35.6748507Z [cluster1] "subnets": {
2021-07-24T00:17:35.6749069Z [cluster1] "items": {
2021-07-24T00:17:35.6749635Z [cluster1] "type": "string"
2021-07-24T00:17:35.6750269Z [cluster1] },
2021-07-24T00:17:35.6750801Z [cluster1] "type": "array"
2021-07-24T00:17:35.6751343Z [cluster1] }
2021-07-24T00:17:35.6751832Z [cluster1] },
2021-07-24T00:17:35.6752377Z [cluster1] "required": [
2021-07-24T00:17:35.6752963Z [cluster1] "backend",
2021-07-24T00:17:35.6753524Z [cluster1] "cable_name",
2021-07-24T00:17:35.6754100Z [cluster1] "cluster_id",
2021-07-24T00:17:35.6754662Z [cluster1] "hostname",
2021-07-24T00:17:35.6755245Z [cluster1] "nat_enabled",
2021-07-24T00:17:35.6755830Z [cluster1] "private_ip",
2021-07-24T00:17:35.6756405Z [cluster1] "public_ip",
2021-07-24T00:17:35.6756972Z [cluster1] "subnets"
2021-07-24T00:17:35.6757488Z [cluster1] ],
2021-07-24T00:17:35.6758034Z [cluster1] "type": "object"
2021-07-24T00:17:35.6758562Z [cluster1] },
2021-07-24T00:17:35.6759240Z [cluster1] "statusFailure": {
2021-07-24T00:17:35.6759806Z [cluster1] "type": "string"
2021-07-24T00:17:35.6760297Z [cluster1] },
2021-07-24T00:17:35.6760789Z [cluster1] "version": {
2021-07-24T00:17:35.6761309Z [cluster1] "type": "string"
2021-07-24T00:17:35.6761803Z [cluster1] }
2021-07-24T00:17:35.6762238Z [cluster1] },
2021-07-24T00:17:35.6762777Z [cluster1] "required": [
2021-07-24T00:17:35.6763324Z [cluster1] "connections",
2021-07-24T00:17:35.6763870Z [cluster1] "haStatus",
2021-07-24T00:17:35.6764438Z [cluster1] "localEndpoint",
2021-07-24T00:17:35.6765318Z [cluster1] "statusFailure",
2021-07-24T00:17:35.6765883Z [cluster1] "version"
2021-07-24T00:17:35.6766352Z [cluster1] ],
2021-07-24T00:17:35.6766851Z [cluster1] "type": "object"
2021-07-24T00:17:35.6767323Z [cluster1] },
2021-07-24T00:17:35.6767807Z [cluster1] "type": "array"
2021-07-24T00:17:35.6768267Z [cluster1] },
2021-07-24T00:17:35.6768759Z [cluster1] "globalCIDR": {
2021-07-24T00:17:35.6769301Z [cluster1] "type": "string"
2021-07-24T00:17:35.6769768Z [cluster1] },
2021-07-24T00:17:35.6770422Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-24T00:17:35.6771122Z [cluster1] "properties": {
2021-07-24T00:17:35.6771953Z [cluster1] "lastResourceVersion": {
2021-07-24T00:17:35.6772637Z [cluster1] "type": "string"
2021-07-24T00:17:35.6773221Z [cluster1] },
2021-07-24T00:17:35.6773947Z [cluster1] "mismatchedContainerImages": {
2021-07-24T00:17:35.6774901Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6775439Z [cluster1] },
2021-07-24T00:17:35.6776124Z [cluster1] "nonReadyContainerStates": {
2021-07-24T00:17:35.6776852Z [cluster1] "items": {
2021-07-24T00:17:35.6778161Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.6779545Z [cluster1] "properties": {
2021-07-24T00:17:35.6780135Z [cluster1] "running": {
2021-07-24T00:17:35.6780873Z [cluster1] "description": "Details about a running container",
2021-07-24T00:17:35.6781637Z [cluster1] "properties": {
2021-07-24T00:17:35.6782255Z [cluster1] "startedAt": {
2021-07-24T00:17:35.6783564Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.6784605Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6785255Z [cluster1] "type": "string"
2021-07-24T00:17:35.6785808Z [cluster1] }
2021-07-24T00:17:35.6786326Z [cluster1] },
2021-07-24T00:17:35.6786887Z [cluster1] "type": "object"
2021-07-24T00:17:35.6787425Z [cluster1] },
2021-07-24T00:17:35.6788074Z [cluster1] "terminated": {
2021-07-24T00:17:35.6788846Z [cluster1] "description": "Details about a terminated container",
2021-07-24T00:17:35.6789639Z [cluster1] "properties": {
2021-07-24T00:17:35.6790281Z [cluster1] "containerID": {
2021-07-24T00:17:35.6791448Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.6792317Z [cluster1] "type": "string"
2021-07-24T00:17:35.6792865Z [cluster1] },
2021-07-24T00:17:35.6793430Z [cluster1] "exitCode": {
2021-07-24T00:17:35.6794251Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.6795075Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6795690Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6796244Z [cluster1] },
2021-07-24T00:17:35.6796813Z [cluster1] "finishedAt": {
2021-07-24T00:17:35.6797677Z [cluster1] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.6798729Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6799377Z [cluster1] "type": "string"
2021-07-24T00:17:35.6800036Z [cluster1] },
2021-07-24T00:17:35.6800548Z [cluster1] "message": {
2021-07-24T00:17:35.6801318Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.6802102Z [cluster1] "type": "string"
2021-07-24T00:17:35.6802625Z [cluster1] },
2021-07-24T00:17:35.6803114Z [cluster1] "reason": {
2021-07-24T00:17:35.6804049Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.6804873Z [cluster1] "type": "string"
2021-07-24T00:17:35.6805429Z [cluster1] },
2021-07-24T00:17:35.6805966Z [cluster1] "signal": {
2021-07-24T00:17:35.6806756Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.6807569Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6808175Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6808741Z [cluster1] },
2021-07-24T00:17:35.6809290Z [cluster1] "startedAt": {
2021-07-24T00:17:35.6810203Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.6811319Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6811942Z [cluster1] "type": "string"
2021-07-24T00:17:35.6812504Z [cluster1] }
2021-07-24T00:17:35.6813004Z [cluster1] },
2021-07-24T00:17:35.6813555Z [cluster1] "required": [
2021-07-24T00:17:35.6814161Z [cluster1] "exitCode"
2021-07-24T00:17:35.6814921Z [cluster1] ],
2021-07-24T00:17:35.6815486Z [cluster1] "type": "object"
2021-07-24T00:17:35.6816035Z [cluster1] },
2021-07-24T00:17:35.6816572Z [cluster1] "waiting": {
2021-07-24T00:17:35.6817289Z [cluster1] "description": "Details about a waiting container",
2021-07-24T00:17:35.6818059Z [cluster1] "properties": {
2021-07-24T00:17:35.6818671Z [cluster1] "message": {
2021-07-24T00:17:35.6819562Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.6820394Z [cluster1] "type": "string"
2021-07-24T00:17:35.6820939Z [cluster1] },
2021-07-24T00:17:35.6821480Z [cluster1] "reason": {
2021-07-24T00:17:35.6822253Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.6823036Z [cluster1] "type": "string"
2021-07-24T00:17:35.6823596Z [cluster1] }
2021-07-24T00:17:35.6825498Z [cluster1] },
2021-07-24T00:17:35.6826071Z [cluster1] "type": "object"
2021-07-24T00:17:35.6826612Z [cluster1] }
2021-07-24T00:17:35.6827160Z [cluster1] },
2021-07-24T00:17:35.6827716Z [cluster1] "type": "object"
2021-07-24T00:17:35.6828249Z [cluster1] },
2021-07-24T00:17:35.6828784Z [cluster1] "type": "array"
2021-07-24T00:17:35.6829300Z [cluster1] },
2021-07-24T00:17:35.6830374Z [cluster1] "status": {
2021-07-24T00:17:35.6831234Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.6832139Z [cluster1] "properties": {
2021-07-24T00:17:35.6832800Z [cluster1] "collisionCount": {
2021-07-24T00:17:35.6834739Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.6836415Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6837019Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6837584Z [cluster1] },
2021-07-24T00:17:35.6838136Z [cluster1] "conditions": {
2021-07-24T00:17:35.6839513Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.6840646Z [cluster1] "items": {
2021-07-24T00:17:35.6841595Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.6842574Z [cluster1] "properties": {
2021-07-24T00:17:35.6843285Z [cluster1] "lastTransitionTime": {
2021-07-24T00:17:35.6844240Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.6845397Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6846026Z [cluster1] "type": "string"
2021-07-24T00:17:35.6846664Z [cluster1] },
2021-07-24T00:17:35.6847220Z [cluster1] "message": {
2021-07-24T00:17:35.6848094Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.6848987Z [cluster1] "type": "string"
2021-07-24T00:17:35.6849537Z [cluster1] },
2021-07-24T00:17:35.6850085Z [cluster1] "reason": {
2021-07-24T00:17:35.6851134Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.6851941Z [cluster1] "type": "string"
2021-07-24T00:17:35.6852503Z [cluster1] },
2021-07-24T00:17:35.6853026Z [cluster1] "status": {
2021-07-24T00:17:35.6853826Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.6854921Z [cluster1] "type": "string"
2021-07-24T00:17:35.6855485Z [cluster1] },
2021-07-24T00:17:35.6856251Z [cluster1] "type": {
2021-07-24T00:17:35.6856973Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.6857727Z [cluster1] "type": "string"
2021-07-24T00:17:35.6858282Z [cluster1] }
2021-07-24T00:17:35.6858794Z [cluster1] },
2021-07-24T00:17:35.6859332Z [cluster1] "required": [
2021-07-24T00:17:35.6860589Z [cluster1] "status",
2021-07-24T00:17:35.6861464Z [cluster1] "type"
2021-07-24T00:17:35.6861983Z [cluster1] ],
2021-07-24T00:17:35.6862543Z [cluster1] "type": "object"
2021-07-24T00:17:35.6863646Z [cluster1] },
2021-07-24T00:17:35.6864206Z [cluster1] "type": "array"
2021-07-24T00:17:35.6864734Z [cluster1] },
2021-07-24T00:17:35.6865427Z [cluster1] "currentNumberScheduled": {
2021-07-24T00:17:35.6867128Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6868477Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6869425Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6870137Z [cluster1] },
2021-07-24T00:17:35.6870844Z [cluster1] "desiredNumberScheduled": {
2021-07-24T00:17:35.6872609Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6874128Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6874747Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6875303Z [cluster1] },
2021-07-24T00:17:35.6875882Z [cluster1] "numberAvailable": {
2021-07-24T00:17:35.6877355Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.6878568Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6879183Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6879723Z [cluster1] },
2021-07-24T00:17:35.6880365Z [cluster1] "numberMisscheduled": {
2021-07-24T00:17:35.6881815Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.6883145Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6883757Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6884305Z [cluster1] },
2021-07-24T00:17:35.6884877Z [cluster1] "numberReady": {
2021-07-24T00:17:35.6885884Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.6887270Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6888209Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6888759Z [cluster1] },
2021-07-24T00:17:35.6889377Z [cluster1] "numberUnavailable": {
2021-07-24T00:17:35.6890665Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.6891855Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6892455Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6892999Z [cluster1] },
2021-07-24T00:17:35.6893642Z [cluster1] "observedGeneration": {
2021-07-24T00:17:35.6894712Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.6895669Z [cluster1] "format": "int64",
2021-07-24T00:17:35.6896283Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6896825Z [cluster1] },
2021-07-24T00:17:35.6897527Z [cluster1] "updatedNumberScheduled": {
2021-07-24T00:17:35.6898689Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.6899448Z [cluster1] "format": "int32",
2021-07-24T00:17:35.6900004Z [cluster1] "type": "integer"
2021-07-24T00:17:35.6900504Z [cluster1] }
2021-07-24T00:17:35.6900959Z [cluster1] },
2021-07-24T00:17:35.6901434Z [cluster1] "required": [
2021-07-24T00:17:35.6902117Z [cluster1] "currentNumberScheduled",
2021-07-24T00:17:35.6902939Z [cluster1] "desiredNumberScheduled",
2021-07-24T00:17:35.6903695Z [cluster1] "numberMisscheduled",
2021-07-24T00:17:35.6904349Z [cluster1] "numberReady"
2021-07-24T00:17:35.6904849Z [cluster1] ],
2021-07-24T00:17:35.6905350Z [cluster1] "type": "object"
2021-07-24T00:17:35.6905836Z [cluster1] }
2021-07-24T00:17:35.6906285Z [cluster1] },
2021-07-24T00:17:35.6906753Z [cluster1] "required": [
2021-07-24T00:17:35.6907454Z [cluster1] "mismatchedContainerImages"
2021-07-24T00:17:35.6908300Z [cluster1] ],
2021-07-24T00:17:35.6908791Z [cluster1] "type": "object"
2021-07-24T00:17:35.6909280Z [cluster1] },
2021-07-24T00:17:35.6909834Z [cluster1] "loadBalancerStatus": {
2021-07-24T00:17:35.6910471Z [cluster1] "properties": {
2021-07-24T00:17:35.6910989Z [cluster1] "status": {
2021-07-24T00:17:35.6912486Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-24T00:17:35.6914006Z [cluster1] "properties": {
2021-07-24T00:17:35.6914607Z [cluster1] "ingress": {
2021-07-24T00:17:35.6916141Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-24T00:17:35.6917254Z [cluster1] "items": {
2021-07-24T00:17:35.6919027Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-24T00:17:35.6920304Z [cluster1] "properties": {
2021-07-24T00:17:35.6920908Z [cluster1] "hostname": {
2021-07-24T00:17:35.6922285Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-24T00:17:35.6923297Z [cluster1] "type": "string"
2021-07-24T00:17:35.6923861Z [cluster1] },
2021-07-24T00:17:35.6924390Z [cluster1] "ip": {
2021-07-24T00:17:35.6926103Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-24T00:17:35.6927177Z [cluster1] "type": "string"
2021-07-24T00:17:35.6927743Z [cluster1] }
2021-07-24T00:17:35.6928255Z [cluster1] },
2021-07-24T00:17:35.6928806Z [cluster1] "type": "object"
2021-07-24T00:17:35.6929571Z [cluster1] },
2021-07-24T00:17:35.6930116Z [cluster1] "type": "array"
2021-07-24T00:17:35.6930661Z [cluster1] }
2021-07-24T00:17:35.6931146Z [cluster1] },
2021-07-24T00:17:35.6931687Z [cluster1] "type": "object"
2021-07-24T00:17:35.6932225Z [cluster1] }
2021-07-24T00:17:35.6932992Z [cluster1] },
2021-07-24T00:17:35.6933768Z [cluster1] "type": "object"
2021-07-24T00:17:35.6934937Z [cluster1] },
2021-07-24T00:17:35.6935492Z [cluster1] "natEnabled": {
2021-07-24T00:17:35.6936064Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6936591Z [cluster1] },
2021-07-24T00:17:35.6937132Z [cluster1] "networkPlugin": {
2021-07-24T00:17:35.6937745Z [cluster1] "type": "string"
2021-07-24T00:17:35.6938273Z [cluster1] },
2021-07-24T00:17:35.6938982Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-24T00:17:35.6939767Z [cluster1] "properties": {
2021-07-24T00:17:35.6940645Z [cluster1] "lastResourceVersion": {
2021-07-24T00:17:35.6941449Z [cluster1] "type": "string"
2021-07-24T00:17:35.6942046Z [cluster1] },
2021-07-24T00:17:35.6942726Z [cluster1] "mismatchedContainerImages": {
2021-07-24T00:17:35.6943462Z [cluster1] "type": "boolean"
2021-07-24T00:17:35.6943949Z [cluster1] },
2021-07-24T00:17:35.6944591Z [cluster1] "nonReadyContainerStates": {
2021-07-24T00:17:35.6945256Z [cluster1] "items": {
2021-07-24T00:17:35.6946497Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.6984797Z [cluster1] "properties": {
2021-07-24T00:17:35.6985514Z [cluster1] "running": {
2021-07-24T00:17:35.6986263Z [cluster1] "description": "Details about a running container",
2021-07-24T00:17:35.6987042Z [cluster1] "properties": {
2021-07-24T00:17:35.6987657Z [cluster1] "startedAt": {
2021-07-24T00:17:35.6988906Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.6990118Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.6990767Z [cluster1] "type": "string"
2021-07-24T00:17:35.6991694Z [cluster1] }
2021-07-24T00:17:35.6992484Z [cluster1] },
2021-07-24T00:17:35.6993220Z [cluster1] "type": "object"
2021-07-24T00:17:35.6993943Z [cluster1] },
2021-07-24T00:17:35.6994520Z [cluster1] "terminated": {
2021-07-24T00:17:35.6995295Z [cluster1] "description": "Details about a terminated container",
2021-07-24T00:17:35.6996359Z [cluster1] "properties": {
2021-07-24T00:17:35.6997012Z [cluster1] "containerID": {
2021-07-24T00:17:35.6998220Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.6999079Z [cluster1] "type": "string"
2021-07-24T00:17:35.6999628Z [cluster1] },
2021-07-24T00:17:35.7000197Z [cluster1] "exitCode": {
2021-07-24T00:17:35.7001035Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.7002264Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7003118Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7003914Z [cluster1] },
2021-07-24T00:17:35.7004496Z [cluster1] "finishedAt": {
2021-07-24T00:17:35.7005418Z [cluster1] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.7006730Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.7007386Z [cluster1] "type": "string"
2021-07-24T00:17:35.7007937Z [cluster1] },
2021-07-24T00:17:35.7008489Z [cluster1] "message": {
2021-07-24T00:17:35.7009340Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.7010199Z [cluster1] "type": "string"
2021-07-24T00:17:35.7010765Z [cluster1] },
2021-07-24T00:17:35.7011296Z [cluster1] "reason": {
2021-07-24T00:17:35.7012122Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.7012941Z [cluster1] "type": "string"
2021-07-24T00:17:35.7013501Z [cluster1] },
2021-07-24T00:17:35.7014046Z [cluster1] "signal": {
2021-07-24T00:17:35.7015167Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.7015978Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7016593Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7017164Z [cluster1] },
2021-07-24T00:17:35.7017717Z [cluster1] "startedAt": {
2021-07-24T00:17:35.7018586Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.7019752Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.7020388Z [cluster1] "type": "string"
2021-07-24T00:17:35.7020957Z [cluster1] }
2021-07-24T00:17:35.7021454Z [cluster1] },
2021-07-24T00:17:35.7022012Z [cluster1] "required": [
2021-07-24T00:17:35.7022618Z [cluster1] "exitCode"
2021-07-24T00:17:35.7023162Z [cluster1] ],
2021-07-24T00:17:35.7023723Z [cluster1] "type": "object"
2021-07-24T00:17:35.7024267Z [cluster1] },
2021-07-24T00:17:35.7024807Z [cluster1] "waiting": {
2021-07-24T00:17:35.7025538Z [cluster1] "description": "Details about a waiting container",
2021-07-24T00:17:35.7026394Z [cluster1] "properties": {
2021-07-24T00:17:35.7027145Z [cluster1] "message": {
2021-07-24T00:17:35.7028319Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.7029164Z [cluster1] "type": "string"
2021-07-24T00:17:35.7029714Z [cluster1] },
2021-07-24T00:17:35.7030259Z [cluster1] "reason": {
2021-07-24T00:17:35.7031043Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.7031817Z [cluster1] "type": "string"
2021-07-24T00:17:35.7032414Z [cluster1] }
2021-07-24T00:17:35.7032909Z [cluster1] },
2021-07-24T00:17:35.7033476Z [cluster1] "type": "object"
2021-07-24T00:17:35.7034014Z [cluster1] }
2021-07-24T00:17:35.7034516Z [cluster1] },
2021-07-24T00:17:35.7035069Z [cluster1] "type": "object"
2021-07-24T00:17:35.7035598Z [cluster1] },
2021-07-24T00:17:35.7036137Z [cluster1] "type": "array"
2021-07-24T00:17:35.7036653Z [cluster1] },
2021-07-24T00:17:35.7037240Z [cluster1] "status": {
2021-07-24T00:17:35.7038093Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.7039480Z [cluster1] "properties": {
2021-07-24T00:17:35.7040317Z [cluster1] "collisionCount": {
2021-07-24T00:17:35.7041759Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.7044671Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7045462Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7046032Z [cluster1] },
2021-07-24T00:17:35.7046569Z [cluster1] "conditions": {
2021-07-24T00:17:35.7049454Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.7050651Z [cluster1] "items": {
2021-07-24T00:17:35.7051924Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.7053351Z [cluster1] "properties": {
2021-07-24T00:17:35.7054236Z [cluster1] "lastTransitionTime": {
2021-07-24T00:17:35.7056423Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.7057842Z [cluster1] "format": "date-time",
2021-07-24T00:17:35.7059625Z [cluster1] "type": "string"
2021-07-24T00:17:35.7060504Z [cluster1] },
2021-07-24T00:17:35.7061058Z [cluster1] "message": {
2021-07-24T00:17:35.7061952Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.7063061Z [cluster1] "type": "string"
2021-07-24T00:17:35.7063627Z [cluster1] },
2021-07-24T00:17:35.7064161Z [cluster1] "reason": {
2021-07-24T00:17:35.7065494Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.7066308Z [cluster1] "type": "string"
2021-07-24T00:17:35.7066865Z [cluster1] },
2021-07-24T00:17:35.7067411Z [cluster1] "status": {
2021-07-24T00:17:35.7068698Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.7069692Z [cluster1] "type": "string"
2021-07-24T00:17:35.7070260Z [cluster1] },
2021-07-24T00:17:35.7070897Z [cluster1] "type": {
2021-07-24T00:17:35.7071625Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.7072358Z [cluster1] "type": "string"
2021-07-24T00:17:35.7073298Z [cluster1] }
2021-07-24T00:17:35.7073819Z [cluster1] },
2021-07-24T00:17:35.7074365Z [cluster1] "required": [
2021-07-24T00:17:35.7074945Z [cluster1] "status",
2021-07-24T00:17:35.7075493Z [cluster1] "type"
2021-07-24T00:17:35.7076035Z [cluster1] ],
2021-07-24T00:17:35.7077030Z [cluster1] "type": "object"
2021-07-24T00:17:35.7077761Z [cluster1] },
2021-07-24T00:17:35.7078312Z [cluster1] "type": "array"
2021-07-24T00:17:35.7078843Z [cluster1] },
2021-07-24T00:17:35.7079539Z [cluster1] "currentNumberScheduled": {
2021-07-24T00:17:35.7081050Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.7084137Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7084766Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7085318Z [cluster1] },
2021-07-24T00:17:35.7086014Z [cluster1] "desiredNumberScheduled": {
2021-07-24T00:17:35.7087711Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.7089154Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7089768Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7090310Z [cluster1] },
2021-07-24T00:17:35.7090915Z [cluster1] "numberAvailable": {
2021-07-24T00:17:35.7092192Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.7093409Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7094020Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7094650Z [cluster1] },
2021-07-24T00:17:35.7095285Z [cluster1] "numberMisscheduled": {
2021-07-24T00:17:35.7096721Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.7098131Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7098735Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7099272Z [cluster1] },
2021-07-24T00:17:35.7099849Z [cluster1] "numberReady": {
2021-07-24T00:17:35.7100845Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.7101820Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7102415Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7102977Z [cluster1] },
2021-07-24T00:17:35.7103603Z [cluster1] "numberUnavailable": {
2021-07-24T00:17:35.7104877Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.7106079Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7106664Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7107217Z [cluster1] },
2021-07-24T00:17:35.7107857Z [cluster1] "observedGeneration": {
2021-07-24T00:17:35.7108816Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.7109693Z [cluster1] "format": "int64",
2021-07-24T00:17:35.7110282Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7110838Z [cluster1] },
2021-07-24T00:17:35.7111532Z [cluster1] "updatedNumberScheduled": {
2021-07-24T00:17:35.7112583Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.7113408Z [cluster1] "format": "int32",
2021-07-24T00:17:35.7113995Z [cluster1] "type": "integer"
2021-07-24T00:17:35.7114555Z [cluster1] }
2021-07-24T00:17:35.7115035Z [cluster1] },
2021-07-24T00:17:35.7115801Z [cluster1] "required": [
2021-07-24T00:17:35.7116554Z [cluster1] "currentNumberScheduled",
2021-07-24T00:17:35.7117426Z [cluster1] "desiredNumberScheduled",
2021-07-24T00:17:35.7118626Z [cluster1] "numberMisscheduled",
2021-07-24T00:17:35.7119501Z [cluster1] "numberReady"
2021-07-24T00:17:35.7120069Z [cluster1] ],
2021-07-24T00:17:35.7120599Z [cluster1] "type": "object"
2021-07-24T00:17:35.7121131Z [cluster1] }
2021-07-24T00:17:35.7121610Z [cluster1] },
2021-07-24T00:17:35.7122119Z [cluster1] "required": [
2021-07-24T00:17:35.7122959Z [cluster1] "mismatchedContainerImages"
2021-07-24T00:17:35.7123926Z [cluster1] ],
2021-07-24T00:17:35.7124458Z [cluster1] "type": "object"
2021-07-24T00:17:35.7124962Z [cluster1] },
2021-07-24T00:17:35.7125505Z [cluster1] "serviceCIDR": {
2021-07-24T00:17:35.7126091Z [cluster1] "type": "string"
2021-07-24T00:17:35.7126794Z [cluster1] }
2021-07-24T00:17:35.7127366Z [cluster1] },
2021-07-24T00:17:35.7127828Z [cluster1] "required": [
2021-07-24T00:17:35.7128355Z [cluster1] "clusterID",
2021-07-24T00:17:35.7129085Z [cluster1] "natEnabled"
2021-07-24T00:17:35.7129601Z [cluster1] ],
2021-07-24T00:17:35.7130424Z [cluster1] "type": "object"
2021-07-24T00:17:35.7131101Z [cluster1] }
2021-07-24T00:17:35.7131541Z [cluster1] },
2021-07-24T00:17:35.7132044Z [cluster1] "type": "object"
2021-07-24T00:17:35.7132560Z [cluster1] }
2021-07-24T00:17:35.7132995Z [cluster1] },
2021-07-24T00:17:35.7133727Z [cluster1] "served": true,
2021-07-24T00:17:35.7134710Z [cluster1] "storage": true,
2021-07-24T00:17:35.7135433Z [cluster1] "subresources": {
2021-07-24T00:17:35.7135980Z [cluster1] "status": {}
2021-07-24T00:17:35.7136594Z [cluster1] }
2021-07-24T00:17:35.7137159Z [cluster1] }
2021-07-24T00:17:35.7137717Z [cluster1] ]
2021-07-24T00:17:35.7138135Z [cluster1] },
2021-07-24T00:17:35.7138731Z [cluster1] "status": {
2021-07-24T00:17:35.7139606Z [cluster1] "acceptedNames": {
2021-07-24T00:17:35.7140218Z [cluster1] "kind": "Submariner",
2021-07-24T00:17:35.7140846Z [cluster1] "listKind": "SubmarinerList",
2021-07-24T00:17:35.7141509Z [cluster1] "plural": "submariners",
2021-07-24T00:17:35.7142143Z [cluster1] "singular": "submariner"
2021-07-24T00:17:35.7154964Z [cluster1] },
2021-07-24T00:17:35.7155477Z [cluster1] "conditions": [
2021-07-24T00:17:35.7156392Z [cluster1] {
2021-07-24T00:17:35.7157384Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:06Z",
2021-07-24T00:17:35.7661111Z [cluster1] "message": "nr2] },
2021-07-24T00:17:35.7661646Z [cluster2] {
2021-07-24T00:17:35.7662892Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:26Z",
2021-07-24T00:17:35.7663812Z [cluster2] "message": "the initial names have been accepted",
2021-07-24T00:17:35.7664650Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-24T00:17:35.7665370Z [cluster2] "status": "True",
2021-07-24T00:17:35.7666141Z [cluster2] "type": "Established"
2021-07-24T00:17:35.7666819Z [cluster2] }
2021-07-24T00:17:35.7667231Z [cluster2] ],
2021-07-24T00:17:35.7667858Z [cluster2] "storedVersions": [
2021-07-24T00:17:35.7670622Z [cluster2] "v1"
2021-07-24T00:17:35.7671068Z [cluster2] ]
2021-07-24T00:17:35.7671833Z [cluster2] }
2021-07-24T00:17:35.7672253Z [cluster2] }
2021-07-24T00:17:35.7673646Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-24T00:17:35.7675263Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-24T00:17:35.7677078Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:35.7678828Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:35.7680499Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:35.7682104Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:35.7683620Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:35.7688124Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:35.7689980Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:35.7691619Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-24T00:17:35.7692938Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-24T00:17:35.7695759Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:35.7698064Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-24T00:17:35.7699661Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-24T00:17:35.7701631Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-24T00:17:35.7703307Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-24T00:17:35.7704321Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-24T00:17:35.7712524Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-24T00:17:35.7714563Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-24T00:17:35.7716500Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-24T00:17:35.7718057Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-24T00:17:35.7719728Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-24T00:17:35.7722365Z [cluster2] NAME CREATED AT
2021-07-24T00:17:35.7723375Z [cluster2] submariners.submariner.io 2021-07-24T00:13:16Z
2021-07-24T00:17:35.7724925Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:35.7727080Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-24T00:17:35.7728676Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-24T00:17:35.7730362Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-24T00:17:35.7732216Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:35.7733286Z [cluster2] {
2021-07-24T00:17:35.7733944Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:35.7735110Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-24T00:17:35.7735818Z [cluster2] "metadata": {
2021-07-24T00:17:35.7736330Z [cluster2] "annotations": {
2021-07-24T00:17:35.7745276Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-24T00:17:35.7746104Z [cluster2] },
2021-07-24T00:17:35.7747021Z [cluster2] "creationTimestamp": "2021-07-24T00:13:16Z",
2021-07-24T00:17:35.7748740Z [cluster2] "generation": 2,
2021-07-24T00:17:35.7749304Z [cluster2] "managedFields": [
2021-07-24T00:17:35.7749816Z [cluster2] {
2021-07-24T00:17:35.7750463Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-24T00:17:35.7751231Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:35.7751805Z [cluster2] "fieldsV1": {
2021-07-24T00:17:35.7752339Z [cluster2] "f:metadata": {
2021-07-24T00:17:35.7753041Z [cluster2] "f:annotations": {
2021-07-24T00:17:35.7753566Z [cluster2] ".": {},
2021-07-24T00:17:35.7754628Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-24T00:17:35.7755420Z [cluster2] }
2021-07-24T00:17:35.7755869Z [cluster2] },
2021-07-24T00:17:35.7756433Z [cluster2] "f:spec": {
2021-07-24T00:17:35.7757307Z [cluster2] "f:conversion": {
2021-07-24T00:17:35.7758182Z [cluster2] ".": {},
2021-07-24T00:17:35.7758706Z [cluster2] "f:strategy": {}
2021-07-24T00:17:35.7759274Z [cluster2] },
2021-07-24T00:17:35.7759720Z [cluster2] "f:group": {},
2021-07-24T00:17:35.7760402Z [cluster2] "f:names": {
2021-07-24T00:17:35.7760872Z [cluster2] "f:kind": {},
2021-07-24T00:17:35.7761375Z [cluster2] "f:listKind": {},
2021-07-24T00:17:35.7761874Z [cluster2] "f:plural": {},
2021-07-24T00:17:35.7762384Z [cluster2] "f:singular": {}
2021-07-24T00:17:35.7762834Z [cluster2] },
2021-07-24T00:17:35.7763286Z [cluster2] "f:scope": {},
2021-07-24T00:17:35.7763769Z [cluster2] "f:versions": {}
2021-07-24T00:17:35.7764228Z [cluster2] },
2021-07-24T00:17:35.7764661Z [cluster2] "f:status": {
2021-07-24T00:17:35.7765196Z [cluster2] "f:acceptedNames": {
2021-07-24T00:17:35.7765718Z [cluster2] "f:kind": {},
2021-07-24T00:17:35.7766205Z [cluster2] "f:plural": {}
2021-07-24T00:17:35.7766661Z [cluster2] },
2021-07-24T00:17:35.7767127Z [cluster2] "f:conditions": {},
2021-07-24T00:17:35.7767708Z [cluster2] "f:storedVersions": {}
2021-07-24T00:17:35.7768200Z [cluster2] }
2021-07-24T00:17:35.7768781Z [cluster2] },
2021-07-24T00:17:35.7769274Z [cluster2] "manager": "subctl",
2021-07-24T00:17:35.7771076Z [cluster2] "operation": "Update",
2021-07-24T00:17:35.7771907Z [cluster2] "time": "2021-07-24T00:16:19Z"
2021-07-24T00:17:35.7772531Z [cluster2] }
2021-07-24T00:17:35.7772952Z [cluster2] ],
2021-07-24T00:17:35.7773627Z [cluster2] "name": "submariners.submariner.io",
2021-07-24T00:17:35.7774581Z [cluster2] "resourceVersion": "1982",
2021-07-24T00:17:35.7775574Z [cluster2] "uid": "d635a3d3-72d9-41ca-b8fb-2d7d0e0d12e0"
2021-07-24T00:17:35.7776231Z [cluster2] },
2021-07-24T00:17:35.7776660Z [cluster2] "spec": {
2021-07-24T00:17:35.7777162Z [cluster2] "conversion": {
2021-07-24T00:17:35.7777700Z [cluster2] "strategy": "None"
2021-07-24T00:17:35.7778199Z [cluster2] },
2021-07-24T00:17:35.7780598Z [cluster2] "group": "submariner.io",
2021-07-24T00:17:35.7781163Z [cluster2] "names": {
2021-07-24T00:17:35.7781683Z [cluster2] "kind": "Submariner",
2021-07-24T00:17:35.7782332Z [cluster2] "listKind": "SubmarinerList",
2021-07-24T00:17:35.7782999Z [cluster2] "plural": "submariners",
2021-07-24T00:17:35.7783610Z [cluster2] "singular": "submariner"
2021-07-24T00:17:35.7784130Z [cluster2] },
2021-07-24T00:17:35.7785078Z [cluster2] "scope": "Namespaced",
2021-07-24T00:17:35.7786417Z [cluster2] "versions": [
2021-07-24T00:17:35.7786877Z [cluster2] {
2021-07-24T00:17:35.7787372Z [cluster2] "name": "v1alpha1",
2021-07-24T00:17:35.7787900Z [cluster2] "schema": {
2021-07-24T00:17:35.7788487Z [cluster2] "openAPIV3Schema": {
2021-07-24T00:17:35.7789510Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-24T00:17:35.7790448Z [cluster2] "properties": {
2021-07-24T00:17:35.7791035Z [cluster2] "apiVersion": {
2021-07-24T00:17:35.7793575Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-24T00:17:35.7795505Z [cluster2] "type": "string"
2021-07-24T00:17:35.7796023Z [cluster2] },
2021-07-24T00:17:35.7796497Z [cluster2] "kind": {
2021-07-24T00:17:35.7798852Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-24T00:17:35.7800967Z [cluster2] "type": "string"
2021-07-24T00:17:35.7801474Z [cluster2] },
2021-07-24T00:17:35.7801990Z [cluster2] "metadata": {
2021-07-24T00:17:35.7802572Z [cluster2] "type": "object"
2021-07-24T00:17:35.7803086Z [cluster2] },
2021-07-24T00:17:35.7803556Z [cluster2] "spec": {
2021-07-24T00:17:35.7804374Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-24T00:17:35.7809451Z [cluster2] "properties": {
2021-07-24T00:17:35.7810016Z [cluster2] "broker": {
2021-07-24T00:17:35.7810809Z [cluster2] "type": "string"
2021-07-24T00:17:35.7811327Z [cluster2] },
2021-07-24T00:17:35.7811957Z [cluster2] "brokerK8sApiServer": {
2021-07-24T00:17:35.7812619Z [cluster2] "type": "string"
2021-07-24T00:17:35.7813147Z [cluster2] },
2021-07-24T00:17:35.7813944Z [cluster2] "brokerK8sApiServerToken": {
2021-07-24T00:17:35.7814828Z [cluster2] "type": "string"
2021-07-24T00:17:35.7815350Z [cluster2] },
2021-07-24T00:17:35.7815881Z [cluster2] "brokerK8sCA": {
2021-07-24T00:17:35.7817188Z [cluster2] "type": "string"
2021-07-24T00:17:35.7817936Z [cluster2] },
2021-07-24T00:17:35.7818806Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-24T00:17:35.7819557Z [cluster2] "type": "string"
2021-07-24T00:17:35.7820082Z [cluster2] },
2021-07-24T00:17:35.7820626Z [cluster2] "cableDriver": {
2021-07-24T00:17:35.7821385Z [cluster2] "type": "string"
2021-07-24T00:17:35.7821923Z [cluster2] },
2021-07-24T00:17:35.7822470Z [cluster2] "ceIPSecDebug": {
2021-07-24T00:17:35.7823091Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7823609Z [cluster2] },
2021-07-24T00:17:35.7824283Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-24T00:17:35.7825003Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7825635Z [cluster2] },
2021-07-24T00:17:35.7826218Z [cluster2] "ceIPSecIKEPort": {
2021-07-24T00:17:35.7826847Z [cluster2] "type": "integer"
2021-07-24T00:17:35.7827380Z [cluster2] },
2021-07-24T00:17:35.7827953Z [cluster2] "ceIPSecNATTPort": {
2021-07-24T00:17:35.7828608Z [cluster2] "type": "integer"
2021-07-24T00:17:35.7829125Z [cluster2] },
2021-07-24T00:17:35.7830180Z [cluster2] "ceIPSecPSK": {
2021-07-24T00:17:35.7830953Z [cluster2] "type": "string"
2021-07-24T00:17:35.7831814Z [cluster2] },
2021-07-24T00:17:35.7833730Z [cluster2] "ceIPSecPreferredServer": {
2021-07-24T00:17:35.7835369Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7836376Z [cluster2] },
2021-07-24T00:17:35.7837163Z [cluster2] "clusterCIDR": {
2021-07-24T00:17:35.7837929Z [cluster2] "type": "string"
2021-07-24T00:17:35.7838451Z [cluster2] },
2021-07-24T00:17:35.7838984Z [cluster2] "clusterID": {
2021-07-24T00:17:35.7839571Z [cluster2] "type": "string"
2021-07-24T00:17:35.7840079Z [cluster2] },
2021-07-24T00:17:35.7842950Z [cluster2] "colorCodes": {
2021-07-24T00:17:35.7843533Z [cluster2] "type": "string"
2021-07-24T00:17:35.7844060Z [cluster2] },
2021-07-24T00:17:35.7844711Z [cluster2] "connectionHealthCheck": {
2021-07-24T00:17:35.7845451Z [cluster2] "properties": {
2021-07-24T00:17:35.7846261Z [cluster2] "enabled": {
2021-07-24T00:17:35.7846852Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7847397Z [cluster2] },
2021-07-24T00:17:35.7848107Z [cluster2] "intervalSeconds": {
2021-07-24T00:17:35.7849837Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-24T00:17:35.7850626Z [cluster2] "format": "int64",
2021-07-24T00:17:35.7851395Z [cluster2] "type": "integer"
2021-07-24T00:17:35.7851935Z [cluster2] },
2021-07-24T00:17:35.7852576Z [cluster2] "maxPacketLossCount": {
2021-07-24T00:17:35.7853635Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-24T00:17:35.7854986Z [cluster2] "format": "int64",
2021-07-24T00:17:35.7855609Z [cluster2] "type": "integer"
2021-07-24T00:17:35.7856145Z [cluster2] }
2021-07-24T00:17:35.7856630Z [cluster2] },
2021-07-24T00:17:35.7860218Z [cluster2] "type": "object"
2021-07-24T00:17:35.7860930Z [cluster2] },
2021-07-24T00:17:35.7861904Z [cluster2] "coreDNSCustomConfig": {
2021-07-24T00:17:35.7862604Z [cluster2] "properties": {
2021-07-24T00:17:35.7864011Z [cluster2] "configMapName": {
2021-07-24T00:17:35.7864637Z [cluster2] "type": "string"
2021-07-24T00:17:35.7865178Z [cluster2] },
2021-07-24T00:17:35.7866050Z [cluster2] "namespace": {
2021-07-24T00:17:35.7866658Z [cluster2] "type": "string"
2021-07-24T00:17:35.7867200Z [cluster2] }
2021-07-24T00:17:35.7867674Z [cluster2] },
2021-07-24T00:17:35.7868209Z [cluster2] "type": "object"
2021-07-24T00:17:35.7868722Z [cluster2] },
2021-07-24T00:17:35.7869283Z [cluster2] "customDomains": {
2021-07-24T00:17:35.7869856Z [cluster2] "items": {
2021-07-24T00:17:35.7870417Z [cluster2] "type": "string"
2021-07-24T00:17:35.7870949Z [cluster2] },
2021-07-24T00:17:35.7871465Z [cluster2] "type": "array",
2021-07-24T00:17:35.7876846Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-24T00:17:35.7877540Z [cluster2] },
2021-07-24T00:17:35.7878046Z [cluster2] "debug": {
2021-07-24T00:17:35.7878594Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7879130Z [cluster2] },
2021-07-24T00:17:35.7879651Z [cluster2] "globalCIDR": {
2021-07-24T00:17:35.7880246Z [cluster2] "type": "string"
2021-07-24T00:17:35.7881578Z [cluster2] },
2021-07-24T00:17:35.7882318Z [cluster2] "imageOverrides": {
2021-07-24T00:17:35.7883261Z [cluster2] "additionalProperties": {
2021-07-24T00:17:35.7884138Z [cluster2] "type": "string"
2021-07-24T00:17:35.7884674Z [cluster2] },
2021-07-24T00:17:35.7885201Z [cluster2] "type": "object"
2021-07-24T00:17:35.7885858Z [cluster2] },
2021-07-24T00:17:35.7886482Z [cluster2] "loadBalancerEnabled": {
2021-07-24T00:17:35.7887181Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7887717Z [cluster2] },
2021-07-24T00:17:35.7888235Z [cluster2] "namespace": {
2021-07-24T00:17:35.7888820Z [cluster2] "type": "string"
2021-07-24T00:17:35.7889335Z [cluster2] },
2021-07-24T00:17:35.7889876Z [cluster2] "natEnabled": {
2021-07-24T00:17:35.7890455Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7890990Z [cluster2] },
2021-07-24T00:17:35.7891529Z [cluster2] "repository": {
2021-07-24T00:17:35.7892101Z [cluster2] "type": "string"
2021-07-24T00:17:35.7892626Z [cluster2] },
2021-07-24T00:17:35.7893163Z [cluster2] "serviceCIDR": {
2021-07-24T00:17:35.7893762Z [cluster2] "type": "string"
2021-07-24T00:17:35.7894273Z [cluster2] },
2021-07-24T00:17:35.7895080Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-24T00:17:35.7895824Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7896439Z [cluster2] },
2021-07-24T00:17:35.7896949Z [cluster2] "version": {
2021-07-24T00:17:35.7897495Z [cluster2] "type": "string"
2021-07-24T00:17:35.7898021Z [cluster2] }
2021-07-24T00:17:35.7898472Z [cluster2] },
2021-07-24T00:17:35.7898994Z [cluster2] "required": [
2021-07-24T00:17:35.7899527Z [cluster2] "broker",
2021-07-24T00:17:35.7900178Z [cluster2] "brokerK8sApiServer",
2021-07-24T00:17:35.7900985Z [cluster2] "brokerK8sApiServerToken",
2021-07-24T00:17:35.7901743Z [cluster2] "brokerK8sCA",
2021-07-24T00:17:35.7902541Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-24T00:17:35.7923846Z [cluster2] "ceIPSecDebug",
2021-07-24T00:17:35.7924759Z [cluster2] "ceIPSecPSK",
2021-07-24T00:17:35.7925546Z [cluster2] "clusterCIDR",
2021-07-24T00:17:35.7926143Z [cluster2] "clusterID",
2021-07-24T00:17:35.7926678Z [cluster2] "debug",
2021-07-24T00:17:35.7927243Z [cluster2] "namespace",
2021-07-24T00:17:35.7928231Z [cluster2] "natEnabled",
2021-07-24T00:17:35.7929005Z [cluster2] "serviceCIDR"
2021-07-24T00:17:35.7929543Z [cluster2] ],
2021-07-24T00:17:35.7930053Z [cluster2] "type": "object"
2021-07-24T00:17:35.7930892Z [cluster2] },
2021-07-24T00:17:35.7931586Z [cluster2] "status": {
2021-07-24T00:17:35.7932603Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-24T00:17:35.7933485Z [cluster2] "properties": {
2021-07-24T00:17:35.7934093Z [cluster2] "clusterCIDR": {
2021-07-24T00:17:35.7934983Z [cluster2] "type": "string"
2021-07-24T00:17:35.7935828Z [cluster2] },
2021-07-24T00:17:35.7936380Z [cluster2] "clusterID": {
2021-07-24T00:17:35.7936943Z [cluster2] "type": "string"
2021-07-24T00:17:35.7937472Z [cluster2] },
2021-07-24T00:17:35.7938148Z [cluster2] "colorCodes": {
2021-07-24T00:17:35.7938733Z [cluster2] "type": "string"
2021-07-24T00:17:35.7939242Z [cluster2] },
2021-07-24T00:17:35.7939822Z [cluster2] "deploymentInfo": {
2021-07-24T00:17:35.7940468Z [cluster2] "properties": {
2021-07-24T00:17:35.7941089Z [cluster2] "cloudProvider": {
2021-07-24T00:17:35.7942257Z [cluster2] "type": "string"
2021-07-24T00:17:35.7942807Z [cluster2] },
2021-07-24T00:17:35.7943637Z [cluster2] "kubernetesType": {
2021-07-24T00:17:35.7944281Z [cluster2] "type": "string"
2021-07-24T00:17:35.7944822Z [cluster2] },
2021-07-24T00:17:35.7945766Z [cluster2] "kubernetesTypeVersion": {
2021-07-24T00:17:35.7946445Z [cluster2] "type": "string"
2021-07-24T00:17:35.7947051Z [cluster2] },
2021-07-24T00:17:35.7947616Z [cluster2] "kubernetesVersion": {
2021-07-24T00:17:35.7948548Z [cluster2] "type": "string"
2021-07-24T00:17:35.7949034Z [cluster2] }
2021-07-24T00:17:35.7949661Z [cluster2] },
2021-07-24T00:17:35.7950253Z [cluster2] "type": "object"
2021-07-24T00:17:35.7950778Z [cluster2] },
2021-07-24T00:17:35.7951456Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-24T00:17:35.7952186Z [cluster2] "properties": {
2021-07-24T00:17:35.7953185Z [cluster2] "lastResourceVersion": {
2021-07-24T00:17:35.7953876Z [cluster2] "type": "string"
2021-07-24T00:17:35.7954417Z [cluster2] },
2021-07-24T00:17:35.7955132Z [cluster2] "mismatchedContainerImages": {
2021-07-24T00:17:35.7956121Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.7956672Z [cluster2] },
2021-07-24T00:17:35.7957485Z [cluster2] "nonReadyContainerStates": {
2021-07-24T00:17:35.7958218Z [cluster2] "items": {
2021-07-24T00:17:35.7959739Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.7969238Z [cluster2] "properties": {
2021-07-24T00:17:35.7969884Z [cluster2] "running": {
2021-07-24T00:17:35.7970710Z [cluster2] "description": "Details about a running container",
2021-07-24T00:17:35.7971435Z [cluster2] "properties": {
2021-07-24T00:17:35.7972371Z [cluster2] "startedAt": {
2021-07-24T00:17:35.7973643Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.8020780Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8021467Z [cluster2] "type": "string"
2021-07-24T00:17:35.8022044Z [cluster2] }
2021-07-24T00:17:35.8022564Z [cluster2] },
2021-07-24T00:17:35.8023131Z [cluster2] "type": "object"
2021-07-24T00:17:35.8023697Z [cluster2] },
2021-07-24T00:17:35.8024256Z [cluster2] "terminated": {
2021-07-24T00:17:35.8025055Z [cluster2] "description": "Details about a terminated container",
2021-07-24T00:17:35.8025926Z [cluster2] "properties": {
2021-07-24T00:17:35.8026580Z [cluster2] "containerID": {
2021-07-24T00:17:35.8027910Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.8028930Z [cluster2] "type": "string"
2021-07-24T00:17:35.8029507Z [cluster2] },
2021-07-24T00:17:35.8030070Z [cluster2] "exitCode": {
2021-07-24T00:17:35.8030917Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.8031759Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8032371Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8032941Z [cluster2] },
2021-07-24T00:17:35.8033521Z [cluster2] "finishedAt": {
2021-07-24T00:17:35.8034323Z [cluster2] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.8035393Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8036029Z [cluster2] "type": "string"
2021-07-24T00:17:35.8036606Z [cluster2] },
2021-07-24T00:17:35.8037154Z [cluster2] "message": {
2021-07-24T00:17:35.8038016Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.8038879Z [cluster2] "type": "string"
2021-07-24T00:17:35.8039425Z [cluster2] },
2021-07-24T00:17:35.8039979Z [cluster2] "reason": {
2021-07-24T00:17:35.8040800Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.8041647Z [cluster2] "type": "string"
2021-07-24T00:17:35.8042294Z [cluster2] },
2021-07-24T00:17:35.8042829Z [cluster2] "signal": {
2021-07-24T00:17:35.8043749Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.8044494Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8045174Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8045721Z [cluster2] },
2021-07-24T00:17:35.8046340Z [cluster2] "startedAt": {
2021-07-24T00:17:35.8047151Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.8048391Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8049038Z [cluster2] "type": "string"
2021-07-24T00:17:35.8049592Z [cluster2] }
2021-07-24T00:17:35.8050112Z [cluster2] },
2021-07-24T00:17:35.8050673Z [cluster2] "required": [
2021-07-24T00:17:35.8051348Z [cluster2] "exitCode"
2021-07-24T00:17:35.8051911Z [cluster2] ],
2021-07-24T00:17:35.8052461Z [cluster2] "type": "object"
2021-07-24T00:17:35.8053019Z [cluster2] },
2021-07-24T00:17:35.8072068Z [cluster2] "waiting": {
2021-07-24T00:17:35.8072839Z [cluster2] "description": "Details about a waiting container",
2021-07-24T00:17:35.8073622Z [cluster2] "properties": {
2021-07-24T00:17:35.8074230Z [cluster2] "message": {
2021-07-24T00:17:35.8075071Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.8075913Z [cluster2] "type": "string"
2021-07-24T00:17:35.8076482Z [cluster2] },
2021-07-24T00:17:35.8077141Z [cluster2] "reason": {
2021-07-24T00:17:35.8077908Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.8078701Z [cluster2] "type": "string"
2021-07-24T00:17:35.8079373Z [cluster2] }
2021-07-24T00:17:35.8080055Z [cluster2] },
2021-07-24T00:17:35.8080622Z [cluster2] "type": "object"
2021-07-24T00:17:35.8081174Z [cluster2] }
2021-07-24T00:17:35.8081674Z [cluster2] },
2021-07-24T00:17:35.8082205Z [cluster2] "type": "object"
2021-07-24T00:17:35.8082901Z [cluster2] },
2021-07-24T00:17:35.8083502Z [cluster2] "type": "array"
2021-07-24T00:17:35.8084036Z [cluster2] },
2021-07-24T00:17:35.8084536Z [cluster2] "status": {
2021-07-24T00:17:35.8085407Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.8086314Z [cluster2] "properties": {
2021-07-24T00:17:35.8086958Z [cluster2] "collisionCount": {
2021-07-24T00:17:35.8088407Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.8089799Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8090398Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8090966Z [cluster2] },
2021-07-24T00:17:35.8091513Z [cluster2] "conditions": {
2021-07-24T00:17:35.8092908Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.8093943Z [cluster2] "items": {
2021-07-24T00:17:35.8095039Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.8096029Z [cluster2] "properties": {
2021-07-24T00:17:35.8096735Z [cluster2] "lastTransitionTime": {
2021-07-24T00:17:35.8097700Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.8098866Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8099504Z [cluster2] "type": "string"
2021-07-24T00:17:35.8113532Z [cluster2] },
2021-07-24T00:17:35.8114294Z [cluster2] "message": {
2021-07-24T00:17:35.8115207Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.8116129Z [cluster2] "type": "string"
2021-07-24T00:17:35.8116685Z [cluster2] },
2021-07-24T00:17:35.8117242Z [cluster2] "reason": {
2021-07-24T00:17:35.8118450Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.8119258Z [cluster2] "type": "string"
2021-07-24T00:17:35.8119838Z [cluster2] },
2021-07-24T00:17:35.8120369Z [cluster2] "status": {
2021-07-24T00:17:35.8121185Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.8122283Z [cluster2] "type": "string"
2021-07-24T00:17:35.8122857Z [cluster2] },
2021-07-24T00:17:35.8123401Z [cluster2] "type": {
2021-07-24T00:17:35.8140519Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.8141365Z [cluster2] "type": "string"
2021-07-24T00:17:35.8141944Z [cluster2] }
2021-07-24T00:17:35.8142470Z [cluster2] },
2021-07-24T00:17:35.8143096Z [cluster2] "required": [
2021-07-24T00:17:35.8143727Z [cluster2] "status",
2021-07-24T00:17:35.8144253Z [cluster2] "type"
2021-07-24T00:17:35.8144849Z [cluster2] ],
2021-07-24T00:17:35.8145371Z [cluster2] "type": "object"
2021-07-24T00:17:35.8145881Z [cluster2] },
2021-07-24T00:17:35.8146394Z [cluster2] "type": "array"
2021-07-24T00:17:35.8147056Z [cluster2] },
2021-07-24T00:17:35.8147894Z [cluster2] "currentNumberScheduled": {
2021-07-24T00:17:35.8149435Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8150786Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8151412Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8151987Z [cluster2] },
2021-07-24T00:17:35.8152676Z [cluster2] "desiredNumberScheduled": {
2021-07-24T00:17:35.8154268Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8155975Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8156846Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8157415Z [cluster2] },
2021-07-24T00:17:35.8158011Z [cluster2] "numberAvailable": {
2021-07-24T00:17:35.8159302Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8160524Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8161125Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8161691Z [cluster2] },
2021-07-24T00:17:35.8162314Z [cluster2] "numberMisscheduled": {
2021-07-24T00:17:35.8163841Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8165202Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8165800Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8166364Z [cluster2] },
2021-07-24T00:17:35.8166924Z [cluster2] "numberReady": {
2021-07-24T00:17:35.8167946Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.8168922Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8169521Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8170080Z [cluster2] },
2021-07-24T00:17:35.8170694Z [cluster2] "numberUnavailable": {
2021-07-24T00:17:35.8171983Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8173312Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8173908Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8174573Z [cluster2] },
2021-07-24T00:17:35.8175206Z [cluster2] "observedGeneration": {
2021-07-24T00:17:35.8176189Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.8177051Z [cluster2] "format": "int64",
2021-07-24T00:17:35.8177657Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8178216Z [cluster2] },
2021-07-24T00:17:35.8178902Z [cluster2] "updatedNumberScheduled": {
2021-07-24T00:17:35.8179893Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.8180699Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8181308Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8181871Z [cluster2] }
2021-07-24T00:17:35.8182353Z [cluster2] },
2021-07-24T00:17:35.8183897Z [cluster2] "required": [
2021-07-24T00:17:35.8184625Z [cluster2] "currentNumberScheduled",
2021-07-24T00:17:35.8185522Z [cluster2] "desiredNumberScheduled",
2021-07-24T00:17:35.8186350Z [cluster2] "numberMisscheduled",
2021-07-24T00:17:35.8187059Z [cluster2] "numberReady"
2021-07-24T00:17:35.8188053Z [cluster2] ],
2021-07-24T00:17:35.8188603Z [cluster2] "type": "object"
2021-07-24T00:17:35.8189145Z [cluster2] }
2021-07-24T00:17:35.8189721Z [cluster2] },
2021-07-24T00:17:35.8190777Z [cluster2] "required": [
2021-07-24T00:17:35.8191705Z [cluster2] "mismatchedContainerImages"
2021-07-24T00:17:35.8192440Z [cluster2] ],
2021-07-24T00:17:35.8192964Z [cluster2] "type": "object"
2021-07-24T00:17:35.8195690Z [cluster2] },
2021-07-24T00:17:35.8196546Z [cluster2] "gateways": {
2021-07-24T00:17:35.8197095Z [cluster2] "items": {
2021-07-24T00:17:35.8197674Z [cluster2] "properties": {
2021-07-24T00:17:35.8198280Z [cluster2] "connections": {
2021-07-24T00:17:35.8198864Z [cluster2] "items": {
2021-07-24T00:17:35.8199437Z [cluster2] "properties": {
2021-07-24T00:17:35.8200058Z [cluster2] "endpoint": {
2021-07-24T00:17:35.8200686Z [cluster2] "properties": {
2021-07-24T00:17:35.8201584Z [cluster2] "backend": {
2021-07-24T00:17:35.8202360Z [cluster2] "type": "string"
2021-07-24T00:17:35.8203100Z [cluster2] },
2021-07-24T00:17:35.8203690Z [cluster2] "backend_config": {
2021-07-24T00:17:35.8204433Z [cluster2] "additionalProperties": {
2021-07-24T00:17:35.8205196Z [cluster2] "type": "string"
2021-07-24T00:17:35.8205777Z [cluster2] },
2021-07-24T00:17:35.8206523Z [cluster2] "type": "object"
2021-07-24T00:17:35.8207102Z [cluster2] },
2021-07-24T00:17:35.8207648Z [cluster2] "cable_name": {
2021-07-24T00:17:35.8208655Z [cluster2] "type": "string"
2021-07-24T00:17:35.8209205Z [cluster2] },
2021-07-24T00:17:35.8209719Z [cluster2] "cluster_id": {
2021-07-24T00:17:35.8210293Z [cluster2] "type": "string"
2021-07-24T00:17:35.8211114Z [cluster2] },
2021-07-24T00:17:35.8211690Z [cluster2] "healthCheckIP": {
2021-07-24T00:17:35.8212561Z [cluster2] "type": "string"
2021-07-24T00:17:35.8213461Z [cluster2] },
2021-07-24T00:17:35.8214134Z [cluster2] "hostname": {
2021-07-24T00:17:35.8214863Z [cluster2] "type": "string"
2021-07-24T00:17:35.8215825Z [cluster2] },
2021-07-24T00:17:35.8216385Z [cluster2] "nat_enabled": {
2021-07-24T00:17:35.8217186Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8217732Z [cluster2] },
2021-07-24T00:17:35.8218253Z [cluster2] "private_ip": {
2021-07-24T00:17:35.8219010Z [cluster2] "type": "string"
2021-07-24T00:17:35.8219530Z [cluster2] },
2021-07-24T00:17:35.8220059Z [cluster2] "public_ip": {
2021-07-24T00:17:35.8228205Z [cluster2] "type": "string"
2021-07-24T00:17:35.8228799Z [cluster2] },
2021-07-24T00:17:35.8229378Z [cluster2] "subnets": {
2021-07-24T00:17:35.8229945Z [cluster2] "items": {
2021-07-24T00:17:35.8230550Z [cluster2] "type": "string"
2021-07-24T00:17:35.8231121Z [cluster2] },
2021-07-24T00:17:35.8231695Z [cluster2] "type": "array"
2021-07-24T00:17:35.8232253Z [cluster2] }
2021-07-24T00:17:35.8232924Z [cluster2] },
2021-07-24T00:17:35.8233493Z [cluster2] "required": [
2021-07-24T00:17:35.8234406Z [cluster2] "backend",
2021-07-24T00:17:35.8235014Z [cluster2] "cable_name",
2021-07-24T00:17:35.8235603Z [cluster2] "cluster_id",
2021-07-24T00:17:35.8236211Z [cluster2] "hostname",
2021-07-24T00:17:35.8236821Z [cluster2] "nat_enabled",
2021-07-24T00:17:35.8237426Z [cluster2] "private_ip",
2021-07-24T00:17:35.8238040Z [cluster2] "public_ip",
2021-07-24T00:17:35.8238799Z [cluster2] "subnets"
2021-07-24T00:17:35.8239358Z [cluster2] ],
2021-07-24T00:17:35.8239912Z [cluster2] "type": "object"
2021-07-24T00:17:35.8240477Z [cluster2] },
2021-07-24T00:17:35.8241055Z [cluster2] "latencyRTT": {
2021-07-24T00:17:35.8242115Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-24T00:17:35.8243193Z [cluster2] "properties": {
2021-07-24T00:17:35.8243807Z [cluster2] "average": {
2021-07-24T00:17:35.8244420Z [cluster2] "type": "string"
2021-07-24T00:17:35.8245197Z [cluster2] },
2021-07-24T00:17:35.8245808Z [cluster2] "last": {
2021-07-24T00:17:35.8246707Z [cluster2] "type": "string"
2021-07-24T00:17:35.8247274Z [cluster2] },
2021-07-24T00:17:35.8247813Z [cluster2] "max": {
2021-07-24T00:17:35.8248705Z [cluster2] "type": "string"
2021-07-24T00:17:35.8249436Z [cluster2] },
2021-07-24T00:17:35.8249985Z [cluster2] "min": {
2021-07-24T00:17:35.8250552Z [cluster2] "type": "string"
2021-07-24T00:17:35.8251143Z [cluster2] },
2021-07-24T00:17:35.8251690Z [cluster2] "stdDev": {
2021-07-24T00:17:35.8252289Z [cluster2] "type": "string"
2021-07-24T00:17:35.8252852Z [cluster2] }
2021-07-24T00:17:35.8253356Z [cluster2] },
2021-07-24T00:17:35.8253917Z [cluster2] "type": "object"
2021-07-24T00:17:35.8254553Z [cluster2] },
2021-07-24T00:17:35.8255194Z [cluster2] "status": {
2021-07-24T00:17:35.8256037Z [cluster2] "type": "string"
2021-07-24T00:17:35.8256602Z [cluster2] },
2021-07-24T00:17:35.8257532Z [cluster2] "statusMessage": {
2021-07-24T00:17:35.8258172Z [cluster2] "type": "string"
2021-07-24T00:17:35.8258730Z [cluster2] },
2021-07-24T00:17:35.8259267Z [cluster2] "usingIP": {
2021-07-24T00:17:35.8259877Z [cluster2] "type": "string"
2021-07-24T00:17:35.8260419Z [cluster2] },
2021-07-24T00:17:35.8260984Z [cluster2] "usingNAT": {
2021-07-24T00:17:35.8261600Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8262148Z [cluster2] }
2021-07-24T00:17:35.8262670Z [cluster2] },
2021-07-24T00:17:35.8263968Z [cluster2] "required": [
2021-07-24T00:17:35.8264806Z [cluster2] "endpoint",
2021-07-24T00:17:35.8265380Z [cluster2] "status",
2021-07-24T00:17:35.8266006Z [cluster2] "statusMessage"
2021-07-24T00:17:35.8266882Z [cluster2] ],
2021-07-24T00:17:35.8268308Z [cluster2] "type": "object"
2021-07-24T00:17:35.8269041Z [cluster2] },
2021-07-24T00:17:35.8269569Z [cluster2] "type": "array"
2021-07-24T00:17:35.8270107Z [cluster2] },
2021-07-24T00:17:35.8270740Z [cluster2] "haStatus": {
2021-07-24T00:17:35.8271332Z [cluster2] "type": "string"
2021-07-24T00:17:35.8271884Z [cluster2] },
2021-07-24T00:17:35.8272455Z [cluster2] "localEndpoint": {
2021-07-24T00:17:35.8273105Z [cluster2] "properties": {
2021-07-24T00:17:35.8273698Z [cluster2] "backend": {
2021-07-24T00:17:35.8274577Z [cluster2] "type": "string"
2021-07-24T00:17:35.8275138Z [cluster2] },
2021-07-24T00:17:35.8276217Z [cluster2] "backend_config": {
2021-07-24T00:17:35.8277130Z [cluster2] "additionalProperties": {
2021-07-24T00:17:35.8277854Z [cluster2] "type": "string"
2021-07-24T00:17:35.8278418Z [cluster2] },
2021-07-24T00:17:35.8279163Z [cluster2] "type": "object"
2021-07-24T00:17:35.8279729Z [cluster2] },
2021-07-24T00:17:35.8280265Z [cluster2] "cable_name": {
2021-07-24T00:17:35.8280949Z [cluster2] "type": "string"
2021-07-24T00:17:35.8281881Z [cluster2] },
2021-07-24T00:17:35.8282580Z [cluster2] "cluster_id": {
2021-07-24T00:17:35.8283181Z [cluster2] "type": "string"
2021-07-24T00:17:35.8283724Z [cluster2] },
2021-07-24T00:17:35.8284329Z [cluster2] "healthCheckIP": {
2021-07-24T00:17:35.8284967Z [cluster2] "type": "string"
2021-07-24T00:17:35.8285524Z [cluster2] },
2021-07-24T00:17:35.8286074Z [cluster2] "hostname": {
2021-07-24T00:17:35.8286657Z [cluster2] "type": "string"
2021-07-24T00:17:35.8287209Z [cluster2] },
2021-07-24T00:17:35.8287750Z [cluster2] "nat_enabled": {
2021-07-24T00:17:35.8288361Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8288909Z [cluster2] },
2021-07-24T00:17:35.8289641Z [cluster2] "private_ip": {
2021-07-24T00:17:35.8290258Z [cluster2] "type": "string"
2021-07-24T00:17:35.8290799Z [cluster2] },
2021-07-24T00:17:35.8291342Z [cluster2] "public_ip": {
2021-07-24T00:17:35.8291922Z [cluster2] "type": "string"
2021-07-24T00:17:35.8292479Z [cluster2] },
2021-07-24T00:17:35.8293010Z [cluster2] "subnets": {
2021-07-24T00:17:35.8293572Z [cluster2] "items": {
2021-07-24T00:17:35.8294301Z [cluster2] "type": "string"
2021-07-24T00:17:35.8295084Z [cluster2] },
2021-07-24T00:17:35.8295649Z [cluster2] "type": "array"
2021-07-24T00:17:35.8296188Z [cluster2] }
2021-07-24T00:17:35.8296693Z [cluster2] },
2021-07-24T00:17:35.8297229Z [cluster2] "required": [
2021-07-24T00:17:35.8297816Z [cluster2] "backend",
2021-07-24T00:17:35.8298401Z [cluster2] "cable_name",
2021-07-24T00:17:35.8298975Z [cluster2] "cluster_id",
2021-07-24T00:17:35.8299562Z [cluster2] "hostname",
2021-07-24T00:17:35.8300145Z [cluster2] "nat_enabled",
2021-07-24T00:17:35.8300747Z [cluster2] "private_ip",
2021-07-24T00:17:35.8301321Z [cluster2] "public_ip",
2021-07-24T00:17:35.8301896Z [cluster2] "subnets"
2021-07-24T00:17:35.8302429Z [cluster2] ],
2021-07-24T00:17:35.8302997Z [cluster2] "type": "object"
2021-07-24T00:17:35.8303619Z [cluster2] },
2021-07-24T00:17:35.8304190Z [cluster2] "statusFailure": {
2021-07-24T00:17:35.8304821Z [cluster2] "type": "string"
2021-07-24T00:17:35.8305349Z [cluster2] },
2021-07-24T00:17:35.8305889Z [cluster2] "version": {
2021-07-24T00:17:35.8306464Z [cluster2] "type": "string"
2021-07-24T00:17:35.8306998Z [cluster2] }
2021-07-24T00:17:35.8307492Z [cluster2] },
2021-07-24T00:17:35.8308009Z [cluster2] "required": [
2021-07-24T00:17:35.8308611Z [cluster2] "connections",
2021-07-24T00:17:35.8309202Z [cluster2] "haStatus",
2021-07-24T00:17:35.8309823Z [cluster2] "localEndpoint",
2021-07-24T00:17:35.8310468Z [cluster2] "statusFailure",
2021-07-24T00:17:35.8311370Z [cluster2] "version"
2021-07-24T00:17:35.8312069Z [cluster2] ],
2021-07-24T00:17:35.8312752Z [cluster2] "type": "object"
2021-07-24T00:17:35.8313441Z [cluster2] },
2021-07-24T00:17:35.8314112Z [cluster2] "type": "array"
2021-07-24T00:17:35.8314798Z [cluster2] },
2021-07-24T00:17:35.8315337Z [cluster2] "globalCIDR": {
2021-07-24T00:17:35.8315927Z [cluster2] "type": "string"
2021-07-24T00:17:35.8316460Z [cluster2] },
2021-07-24T00:17:35.8317157Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-24T00:17:35.8317931Z [cluster2] "properties": {
2021-07-24T00:17:35.8318625Z [cluster2] "lastResourceVersion": {
2021-07-24T00:17:35.8319396Z [cluster2] "type": "string"
2021-07-24T00:17:35.8319926Z [cluster2] },
2021-07-24T00:17:35.8320867Z [cluster2] "mismatchedContainerImages": {
2021-07-24T00:17:35.8321665Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8322194Z [cluster2] },
2021-07-24T00:17:35.8322896Z [cluster2] "nonReadyContainerStates": {
2021-07-24T00:17:35.8323615Z [cluster2] "items": {
2021-07-24T00:17:35.8324952Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.8326315Z [cluster2] "properties": {
2021-07-24T00:17:35.8326914Z [cluster2] "running": {
2021-07-24T00:17:35.8327650Z [cluster2] "description": "Details about a running container",
2021-07-24T00:17:35.8328418Z [cluster2] "properties": {
2021-07-24T00:17:35.8331411Z [cluster2] "startedAt": {
2021-07-24T00:17:35.8332722Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.8333924Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8334888Z [cluster2] "type": "string"
2021-07-24T00:17:35.8335456Z [cluster2] }
2021-07-24T00:17:35.8335983Z [cluster2] },
2021-07-24T00:17:35.8336783Z [cluster2] "type": "object"
2021-07-24T00:17:35.8337509Z [cluster2] },
2021-07-24T00:17:35.8338359Z [cluster2] "terminated": {
2021-07-24T00:17:35.8339909Z [cluster2] "description": "Details about a terminated container",
2021-07-24T00:17:35.8340896Z [cluster2] "properties": {
2021-07-24T00:17:35.8341689Z [cluster2] "containerID": {
2021-07-24T00:17:35.8343251Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.8344262Z [cluster2] "type": "string"
2021-07-24T00:17:35.8344840Z [cluster2] },
2021-07-24T00:17:35.8345588Z [cluster2] "exitCode": {
2021-07-24T00:17:35.8347247Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.8348248Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8349040Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8349623Z [cluster2] },
2021-07-24T00:17:35.8350372Z [cluster2] "finishedAt": {
2021-07-24T00:17:35.8351391Z [cluster2] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.8352538Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8353178Z [cluster2] "type": "string"
2021-07-24T00:17:35.8353750Z [cluster2] },
2021-07-24T00:17:35.8354305Z [cluster2] "message": {
2021-07-24T00:17:35.8355166Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.8356247Z [cluster2] "type": "string"
2021-07-24T00:17:35.8356805Z [cluster2] },
2021-07-24T00:17:35.8357354Z [cluster2] "reason": {
2021-07-24T00:17:35.8358171Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.8359012Z [cluster2] "type": "string"
2021-07-24T00:17:35.8359577Z [cluster2] },
2021-07-24T00:17:35.8360863Z [cluster2] "signal": {
2021-07-24T00:17:35.8361838Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.8362659Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8363292Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8363872Z [cluster2] },
2021-07-24T00:17:35.8364426Z [cluster2] "startedAt": {
2021-07-24T00:17:35.8365298Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.8366465Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8367126Z [cluster2] "type": "string"
2021-07-24T00:17:35.8367683Z [cluster2] }
2021-07-24T00:17:35.8368204Z [cluster2] },
2021-07-24T00:17:35.8368775Z [cluster2] "required": [
2021-07-24T00:17:35.8369370Z [cluster2] "exitCode"
2021-07-24T00:17:35.8369938Z [cluster2] ],
2021-07-24T00:17:35.8370493Z [cluster2] "type": "object"
2021-07-24T00:17:35.8371053Z [cluster2] },
2021-07-24T00:17:35.8371587Z [cluster2] "waiting": {
2021-07-24T00:17:35.8372633Z [cluster2] "description": "Details about a waiting container",
2021-07-24T00:17:35.8373415Z [cluster2] "properties": {
2021-07-24T00:17:35.8374015Z [cluster2] "message": {
2021-07-24T00:17:35.8375839Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.8376694Z [cluster2] "type": "string"
2021-07-24T00:17:35.8377258Z [cluster2] },
2021-07-24T00:17:35.8377807Z [cluster2] "reason": {
2021-07-24T00:17:35.8378572Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.8379369Z [cluster2] "type": "string"
2021-07-24T00:17:35.8379926Z [cluster2] }
2021-07-24T00:17:35.8380444Z [cluster2] },
2021-07-24T00:17:35.8381011Z [cluster2] "type": "object"
2021-07-24T00:17:35.8381553Z [cluster2] }
2021-07-24T00:17:35.8382054Z [cluster2] },
2021-07-24T00:17:35.8382580Z [cluster2] "type": "object"
2021-07-24T00:17:35.8383314Z [cluster2] },
2021-07-24T00:17:35.8383838Z [cluster2] "type": "array"
2021-07-24T00:17:35.8384442Z [cluster2] },
2021-07-24T00:17:35.8384937Z [cluster2] "status": {
2021-07-24T00:17:35.8385813Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.8386719Z [cluster2] "properties": {
2021-07-24T00:17:35.8387359Z [cluster2] "collisionCount": {
2021-07-24T00:17:35.8388797Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.8390179Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8390779Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8391338Z [cluster2] },
2021-07-24T00:17:35.8391878Z [cluster2] "conditions": {
2021-07-24T00:17:35.8393952Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.8395043Z [cluster2] "items": {
2021-07-24T00:17:35.8395998Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.8396978Z [cluster2] "properties": {
2021-07-24T00:17:35.8397670Z [cluster2] "lastTransitionTime": {
2021-07-24T00:17:35.8398636Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.8399786Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8401947Z [cluster2] "type": "string"
2021-07-24T00:17:35.8402576Z [cluster2] },
2021-07-24T00:17:35.8403315Z [cluster2] "message": {
2021-07-24T00:17:35.8404644Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.8405534Z [cluster2] "type": "string"
2021-07-24T00:17:35.8406103Z [cluster2] },
2021-07-24T00:17:35.8406650Z [cluster2] "reason": {
2021-07-24T00:17:35.8407762Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.8408575Z [cluster2] "type": "string"
2021-07-24T00:17:35.8409123Z [cluster2] },
2021-07-24T00:17:35.8409668Z [cluster2] "status": {
2021-07-24T00:17:35.8410459Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.8411284Z [cluster2] "type": "string"
2021-07-24T00:17:35.8411941Z [cluster2] },
2021-07-24T00:17:35.8412999Z [cluster2] "type": {
2021-07-24T00:17:35.8414310Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.8416511Z [cluster2] "type": "string"
2021-07-24T00:17:35.8417089Z [cluster2] }
2021-07-24T00:17:35.8417603Z [cluster2] },
2021-07-24T00:17:35.8418148Z [cluster2] "required": [
2021-07-24T00:17:35.8418733Z [cluster2] "status",
2021-07-24T00:17:35.8419283Z [cluster2] "type"
2021-07-24T00:17:35.8419822Z [cluster2] ],
2021-07-24T00:17:35.8420370Z [cluster2] "type": "object"
2021-07-24T00:17:35.8420926Z [cluster2] },
2021-07-24T00:17:35.8421477Z [cluster2] "type": "array"
2021-07-24T00:17:35.8422000Z [cluster2] },
2021-07-24T00:17:35.8422704Z [cluster2] "currentNumberScheduled": {
2021-07-24T00:17:35.8424410Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8425773Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8426395Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8426934Z [cluster2] },
2021-07-24T00:17:35.8428049Z [cluster2] "desiredNumberScheduled": {
2021-07-24T00:17:35.8429755Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8431196Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8431804Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8432345Z [cluster2] },
2021-07-24T00:17:35.8432957Z [cluster2] "numberAvailable": {
2021-07-24T00:17:35.8434224Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8435652Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8436265Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8436815Z [cluster2] },
2021-07-24T00:17:35.8437460Z [cluster2] "numberMisscheduled": {
2021-07-24T00:17:35.8438890Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8440313Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8440923Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8441464Z [cluster2] },
2021-07-24T00:17:35.8442039Z [cluster2] "numberReady": {
2021-07-24T00:17:35.8443034Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.8444017Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8444622Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8445164Z [cluster2] },
2021-07-24T00:17:35.8445797Z [cluster2] "numberUnavailable": {
2021-07-24T00:17:35.8447060Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8448263Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8448866Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8449403Z [cluster2] },
2021-07-24T00:17:35.8450044Z [cluster2] "observedGeneration": {
2021-07-24T00:17:35.8451004Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.8451877Z [cluster2] "format": "int64",
2021-07-24T00:17:35.8452468Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8453022Z [cluster2] },
2021-07-24T00:17:35.8453774Z [cluster2] "updatedNumberScheduled": {
2021-07-24T00:17:35.8454977Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.8455800Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8456390Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8456951Z [cluster2] }
2021-07-24T00:17:35.8457436Z [cluster2] },
2021-07-24T00:17:35.8457974Z [cluster2] "required": [
2021-07-24T00:17:35.8458709Z [cluster2] "currentNumberScheduled",
2021-07-24T00:17:35.8459586Z [cluster2] "desiredNumberScheduled",
2021-07-24T00:17:35.8460427Z [cluster2] "numberMisscheduled",
2021-07-24T00:17:35.8461117Z [cluster2] "numberReady"
2021-07-24T00:17:35.8461681Z [cluster2] ],
2021-07-24T00:17:35.8462204Z [cluster2] "type": "object"
2021-07-24T00:17:35.8462743Z [cluster2] }
2021-07-24T00:17:35.8463226Z [cluster2] },
2021-07-24T00:17:35.8464552Z [cluster2] "required": [
2021-07-24T00:17:35.8465583Z [cluster2] "mismatchedContainerImages"
2021-07-24T00:17:35.8466289Z [cluster2] ],
2021-07-24T00:17:35.8466818Z [cluster2] "type": "object"
2021-07-24T00:17:35.8467332Z [cluster2] },
2021-07-24T00:17:35.8467949Z [cluster2] "loadBalancerStatus": {
2021-07-24T00:17:35.8468637Z [cluster2] "properties": {
2021-07-24T00:17:35.8469195Z [cluster2] "status": {
2021-07-24T00:17:35.8470520Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-24T00:17:35.8471456Z [cluster2] "properties": {
2021-07-24T00:17:35.8472051Z [cluster2] "ingress": {
2021-07-24T00:17:35.8473532Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-24T00:17:35.8474658Z [cluster2] "items": {
2021-07-24T00:17:35.8476247Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-24T00:17:35.8477498Z [cluster2] "properties": {
2021-07-24T00:17:35.8478117Z [cluster2] "hostname": {
2021-07-24T00:17:35.8479805Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-24T00:17:35.8480757Z [cluster2] "type": "string"
2021-07-24T00:17:35.8481275Z [cluster2] },
2021-07-24T00:17:35.8481839Z [cluster2] "ip": {
2021-07-24T00:17:35.8483128Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-24T00:17:35.8484108Z [cluster2] "type": "string"
2021-07-24T00:17:35.8484619Z [cluster2] }
2021-07-24T00:17:35.8485099Z [cluster2] },
2021-07-24T00:17:35.8485615Z [cluster2] "type": "object"
2021-07-24T00:17:35.8486131Z [cluster2] },
2021-07-24T00:17:35.8486628Z [cluster2] "type": "array"
2021-07-24T00:17:35.8487134Z [cluster2] }
2021-07-24T00:17:35.8487593Z [cluster2] },
2021-07-24T00:17:35.8488081Z [cluster2] "type": "object"
2021-07-24T00:17:35.8488756Z [cluster2] }
2021-07-24T00:17:35.8489577Z [cluster2] },
2021-07-24T00:17:35.8490302Z [cluster2] "type": "object"
2021-07-24T00:17:35.8490814Z [cluster2] },
2021-07-24T00:17:35.8497572Z [cluster2] "natEnabled": {
2021-07-24T00:17:35.8498607Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8499145Z [cluster2] },
2021-07-24T00:17:35.8499714Z [cluster2] "networkPlugin": {
2021-07-24T00:17:35.8500490Z [cluster2] "type": "string"
2021-07-24T00:17:35.8501119Z [cluster2] },
2021-07-24T00:17:35.8501824Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-24T00:17:35.8502649Z [cluster2] "properties": {
2021-07-24T00:17:35.8503335Z [cluster2] "lastResourceVersion": {
2021-07-24T00:17:35.8504036Z [cluster2] "type": "string"
2021-07-24T00:17:35.8504573Z [cluster2] },
2021-07-24T00:17:35.8505288Z [cluster2] "mismatchedContainerImages": {
2021-07-24T00:17:35.8506085Z [cluster2] "type": "boolean"
2021-07-24T00:17:35.8506853Z [cluster2] },
2021-07-24T00:17:35.8507560Z [cluster2] "nonReadyContainerStates": {
2021-07-24T00:17:35.8508277Z [cluster2] "items": {
2021-07-24T00:17:35.8509893Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-24T00:17:35.8512364Z [cluster2] "properties": {
2021-07-24T00:17:35.8512952Z [cluster2] "running": {
2021-07-24T00:17:35.8513699Z [cluster2] "description": "Details about a running container",
2021-07-24T00:17:35.8514465Z [cluster2] "properties": {
2021-07-24T00:17:35.8515086Z [cluster2] "startedAt": {
2021-07-24T00:17:35.8516490Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-24T00:17:35.8517815Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8518470Z [cluster2] "type": "string"
2021-07-24T00:17:35.8519021Z [cluster2] }
2021-07-24T00:17:35.8519541Z [cluster2] },
2021-07-24T00:17:35.8520291Z [cluster2] "type": "object"
2021-07-24T00:17:35.8520868Z [cluster2] },
2021-07-24T00:17:35.8521439Z [cluster2] "terminated": {
2021-07-24T00:17:35.8522210Z [cluster2] "description": "Details about a terminated container",
2021-07-24T00:17:35.8523016Z [cluster2] "properties": {
2021-07-24T00:17:35.8523649Z [cluster2] "containerID": {
2021-07-24T00:17:35.8524845Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-24T00:17:35.8525700Z [cluster2] "type": "string"
2021-07-24T00:17:35.8526341Z [cluster2] },
2021-07-24T00:17:35.8526908Z [cluster2] "exitCode": {
2021-07-24T00:17:35.8527731Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-24T00:17:35.8528568Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8529236Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8529791Z [cluster2] },
2021-07-24T00:17:35.8530366Z [cluster2] "finishedAt": {
2021-07-24T00:17:35.8531167Z [cluster2] "description": "Time at which the container last terminated",
2021-07-24T00:17:35.8532235Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8532865Z [cluster2] "type": "string"
2021-07-24T00:17:35.8533427Z [cluster2] },
2021-07-24T00:17:35.8533983Z [cluster2] "message": {
2021-07-24T00:17:35.8535027Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-24T00:17:35.8535889Z [cluster2] "type": "string"
2021-07-24T00:17:35.8536436Z [cluster2] },
2021-07-24T00:17:35.8536982Z [cluster2] "reason": {
2021-07-24T00:17:35.8537815Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-24T00:17:35.8538637Z [cluster2] "type": "string"
2021-07-24T00:17:35.8539203Z [cluster2] },
2021-07-24T00:17:35.8539820Z [cluster2] "signal": {
2021-07-24T00:17:35.8540622Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-24T00:17:35.8541440Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8542046Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8542613Z [cluster2] },
2021-07-24T00:17:35.8543275Z [cluster2] "startedAt": {
2021-07-24T00:17:35.8544079Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-24T00:17:35.8545120Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8545720Z [cluster2] "type": "string"
2021-07-24T00:17:35.8546248Z [cluster2] }
2021-07-24T00:17:35.8546712Z [cluster2] },
2021-07-24T00:17:35.8547231Z [cluster2] "required": [
2021-07-24T00:17:35.8548183Z [cluster2] "exitCode"
2021-07-24T00:17:35.8548864Z [cluster2] ],
2021-07-24T00:17:35.8549415Z [cluster2] "type": "object"
2021-07-24T00:17:35.8549979Z [cluster2] },
2021-07-24T00:17:35.8550517Z [cluster2] "waiting": {
2021-07-24T00:17:35.8551241Z [cluster2] "description": "Details about a waiting container",
2021-07-24T00:17:35.8552013Z [cluster2] "properties": {
2021-07-24T00:17:35.8552611Z [cluster2] "message": {
2021-07-24T00:17:35.8553446Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-24T00:17:35.8554707Z [cluster2] "type": "string"
2021-07-24T00:17:35.8555429Z [cluster2] },
2021-07-24T00:17:35.8555977Z [cluster2] "reason": {
2021-07-24T00:17:35.8556742Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-24T00:17:35.8557529Z [cluster2] "type": "string"
2021-07-24T00:17:35.8558098Z [cluster2] }
2021-07-24T00:17:35.8558763Z [cluster2] },
2021-07-24T00:17:35.8559341Z [cluster2] "type": "object"
2021-07-24T00:17:35.8559883Z [cluster2] }
2021-07-24T00:17:35.8560388Z [cluster2] },
2021-07-24T00:17:35.8560926Z [cluster2] "type": "object"
2021-07-24T00:17:35.8561470Z [cluster2] },
2021-07-24T00:17:35.8561986Z [cluster2] "type": "array"
2021-07-24T00:17:35.8562598Z [cluster2] },
2021-07-24T00:17:35.8563118Z [cluster2] "status": {
2021-07-24T00:17:35.8563967Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-24T00:17:35.8564863Z [cluster2] "properties": {
2021-07-24T00:17:35.8565802Z [cluster2] "collisionCount": {
2021-07-24T00:17:35.8567243Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-24T00:17:35.8568633Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8569235Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8569799Z [cluster2] },
2021-07-24T00:17:35.8570337Z [cluster2] "conditions": {
2021-07-24T00:17:35.8572458Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-24T00:17:35.8573396Z [cluster2] "items": {
2021-07-24T00:17:35.8574546Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-24T00:17:35.8575528Z [cluster2] "properties": {
2021-07-24T00:17:35.8576421Z [cluster2] "lastTransitionTime": {
2021-07-24T00:17:35.8577397Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-24T00:17:35.8578573Z [cluster2] "format": "date-time",
2021-07-24T00:17:35.8579207Z [cluster2] "type": "string"
2021-07-24T00:17:35.8579774Z [cluster2] },
2021-07-24T00:17:35.8580313Z [cluster2] "message": {
2021-07-24T00:17:35.8581213Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-24T00:17:35.8582106Z [cluster2] "type": "string"
2021-07-24T00:17:35.8582771Z [cluster2] },
2021-07-24T00:17:35.8583472Z [cluster2] "reason": {
2021-07-24T00:17:35.8584510Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-24T00:17:35.8585386Z [cluster2] "type": "string"
2021-07-24T00:17:35.8585894Z [cluster2] },
2021-07-24T00:17:35.8586397Z [cluster2] "status": {
2021-07-24T00:17:35.8587328Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-24T00:17:35.8588540Z [cluster2] "type": "string"
2021-07-24T00:17:35.8589212Z [cluster2] },
2021-07-24T00:17:35.8589738Z [cluster2] "type": {
2021-07-24T00:17:35.8590469Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-24T00:17:35.8591213Z [cluster2] "type": "string"
2021-07-24T00:17:35.8591780Z [cluster2] }
2021-07-24T00:17:35.8592514Z [cluster2] },
2021-07-24T00:17:35.8593075Z [cluster2] "required": [
2021-07-24T00:17:35.8593652Z [cluster2] "status",
2021-07-24T00:17:35.8594197Z [cluster2] "type"
2021-07-24T00:17:35.8594735Z [cluster2] ],
2021-07-24T00:17:35.8595281Z [cluster2] "type": "object"
2021-07-24T00:17:35.8595835Z [cluster2] },
2021-07-24T00:17:35.8596374Z [cluster2] "type": "array"
2021-07-24T00:17:35.8596915Z [cluster2] },
2021-07-24T00:17:35.8598325Z [cluster2] "currentNumberScheduled": {
2021-07-24T00:17:35.8599951Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8601300Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8601906Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8602739Z [cluster2] },
2021-07-24T00:17:35.8603608Z [cluster2] "desiredNumberScheduled": {
2021-07-24T00:17:35.8605666Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8607099Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8607695Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8608252Z [cluster2] },
2021-07-24T00:17:35.8609038Z [cluster2] "numberAvailable": {
2021-07-24T00:17:35.8610326Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8611546Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8612134Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8613093Z [cluster2] },
2021-07-24T00:17:35.8613909Z [cluster2] "numberMisscheduled": {
2021-07-24T00:17:35.8615596Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-24T00:17:35.8616945Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8617538Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8618094Z [cluster2] },
2021-07-24T00:17:35.8618664Z [cluster2] "numberReady": {
2021-07-24T00:17:35.8619846Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-24T00:17:35.8620838Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8621421Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8621973Z [cluster2] },
2021-07-24T00:17:35.8622595Z [cluster2] "numberUnavailable": {
2021-07-24T00:17:35.8623858Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-24T00:17:35.8625051Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8625636Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8626265Z [cluster2] },
2021-07-24T00:17:35.8627148Z [cluster2] "observedGeneration": {
2021-07-24T00:17:35.8628125Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-24T00:17:35.8629011Z [cluster2] "format": "int64",
2021-07-24T00:17:35.8629794Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8630357Z [cluster2] },
2021-07-24T00:17:35.8631046Z [cluster2] "updatedNumberScheduled": {
2021-07-24T00:17:35.8632028Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-24T00:17:35.8632856Z [cluster2] "format": "int32",
2021-07-24T00:17:35.8633446Z [cluster2] "type": "integer"
2021-07-24T00:17:35.8634000Z [cluster2] }
2021-07-24T00:17:35.8634475Z [cluster2] },
2021-07-24T00:17:35.8635275Z [cluster2] "required": [
2021-07-24T00:17:35.8636012Z [cluster2] "currentNumberScheduled",
2021-07-24T00:17:35.8636902Z [cluster2] "desiredNumberScheduled",
2021-07-24T00:17:35.8638216Z [cluster2] "numberMisscheduled",
2021-07-24T00:17:35.8638920Z [cluster2] "numberReady"
2021-07-24T00:17:35.8639493Z [cluster2] ],
2021-07-24T00:17:35.8640020Z [cluster2] "type": "object"
2021-07-24T00:17:35.8640557Z [cluster2] }
2021-07-24T00:17:35.8641022Z [cluster2] },
2021-07-24T00:17:35.8641552Z [cluster2] "required": [
2021-07-24T00:17:35.8642405Z [cluster2] "mismatchedContainerImages"
2021-07-24T00:17:35.8671074Z [cluster2] ],
2021-07-24T00:17:35.8671640Z [cluster2] "type": "object"
2021-07-24T00:17:35.8672155Z [cluster2] },
2021-07-24T00:17:35.8672702Z [cluster2] "serviceCIDR": {
2021-07-24T00:17:35.8673285Z [cluster2] "type": "string"
2021-07-24T00:17:35.8673815Z [cluster2] }
2021-07-24T00:17:35.8674267Z [cluster2] },
2021-07-24T00:17:35.8674782Z [cluster2] "required": [
2021-07-24T00:17:35.8675345Z [cluster2] "clusterID",
2021-07-24T00:17:35.8675914Z [cluster2] "natEnabled"
2021-07-24T00:17:35.8676434Z [cluster2] ],
2021-07-24T00:17:35.8676943Z [cluster2] "type": "object"
2021-07-24T00:17:35.8677446Z [cluster2] }
2021-07-24T00:17:35.8677881Z [cluster2] },
2021-07-24T00:17:35.8678381Z [cluster2] "type": "object"
2021-07-24T00:17:35.8678857Z [cluster2] }
2021-07-24T00:17:35.8679290Z [cluster2] },
2021-07-24T00:17:35.8679764Z [cluster2] "served": true,
2021-07-24T00:17:35.8680302Z [cluster2] "storage": true,
2021-07-24T00:17:35.8681111Z [cluster2] "subresources": {
2021-07-24T00:17:35.8681637Z [cluster2] "status": {}
2021-07-24T00:17:35.8682101Z [cluster2] }
2021-07-24T00:17:35.8682512Z [cluster2] }
2021-07-24T00:17:35.8682933Z [cluster2] ]
2021-07-24T00:17:35.8683335Z [cluster2] },
2021-07-24T00:17:35.8683775Z [cluster2] "status": {
2021-07-24T00:17:35.8684305Z [cluster2] "acceptedNames": {
2021-07-24T00:17:35.8684902Z [cluster2] "kind": "Submariner",
2021-07-24T00:17:35.8685529Z [cluster2] "listKind": "SubmarinerList",
2021-07-24T00:17:35.8686200Z [cluster2] "plural": "submariners",
2021-07-24T00:17:35.8686822Z [cluster2] "singular": "submariner"
2021-07-24T00:17:35.8687326Z [cluster2] },
2021-07-24T00:17:35.8687802Z [cluster2] "conditions": [
2021-07-24T00:17:35.8688262Z [cluster2] {
2021-07-24T00:17:35.8689255Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:16Z",
2021-07-24T00:17:38.0244557Z [cluster2] "message": "no conflicts found",
2021-07-24T00:17:38.0245264Z [cluster1] "reason": "NoConflicts",
2021-07-24T00:17:38.0245837Z [cluster1] "status": "True",
2021-07-24T00:17:38.0246443Z [cluster1] "type": "NamesAccepted"
2021-07-24T00:17:38.0246986Z [cluster1] },
2021-07-24T00:17:38.0247515Z [cluster1] {
2021-07-24T00:17:38.0248862Z [cluster1] "lastTransitionTime": "2021-07-24T00:13:06Z",
2021-07-24T00:17:38.0249723Z [cluster1] "message": "the initial names have been accepted",
2021-07-24T00:17:38.0250563Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-24T00:17:38.0251269Z [cluster1] "status": "True",
2021-07-24T00:17:38.0251850Z [cluster1] "type": "Established"
2021-07-24T00:17:38.0252350Z [cluster1] }
2021-07-24T00:17:38.0252775Z [cluster1] ],
2021-07-24T00:17:38.0253297Z [cluster1] "storedVersions": [
2021-07-24T00:17:38.0253859Z [cluster1] "v1alpha1"
2021-07-24T00:17:38.0254315Z [cluster1] ]
2021-07-24T00:17:38.0254866Z [cluster1] }
2021-07-24T00:17:38.0255280Z [cluster1] }
2021-07-24T00:17:38.0256473Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-24T00:17:38.0258394Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-24T00:17:38.0260427Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:38.0262244Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:38.0263577Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-24T00:17:38.0265160Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:38.0266933Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:38.0268245Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-24T00:17:38.0269971Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:38.0271677Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-24T00:17:38.0273045Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-24T00:17:38.0274827Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-24T00:17:38.0276406Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-24T00:17:38.0277472Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-24T00:17:38.0278665Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-24T00:17:38.0280106Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-24T00:17:38.0281578Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-24T00:17:38.0282527Z [cluster1] NAME STATUS AGE
2021-07-24T00:17:38.0283358Z [cluster1] submariner-operator Active 4m30s
2021-07-24T00:17:38.0284593Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-24T00:17:38.0286094Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-24T00:17:38.0287710Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-24T00:17:38.0288760Z [cluster1] NAME CREATED AT
2021-07-24T00:17:38.0289668Z [cluster1] submariners.submariner.io 2021-07-24T00:13:06Z
2021-07-24T00:17:38.0290788Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-24T00:17:38.0291888Z [submariner-operator]$ [cluster1] grep submariners
2021-07-24T00:17:38.0292968Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-24T00:17:38.0294241Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-24T00:17:38.0295444Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-24T00:17:38.0296941Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0298696Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0300718Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0301889Z [cluster1] NAME SECRETS AGE
2021-07-24T00:17:38.0302715Z [cluster1] submariner-operator 1 4m31s
2021-07-24T00:17:38.0304099Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0305858Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0307882Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.0309062Z [cluster1] NAME CREATED AT
2021-07-24T00:17:38.0309890Z [cluster1] submariner-operator 2021-07-24T00:13:06Z
2021-07-24T00:17:38.2076709Z [submariner-operator]$ [cluster1] kubectl geto conflicts found",
2021-07-24T00:17:38.2077545Z [cluster2] "reason": "NoConflicts",
2021-07-24T00:17:38.2078140Z [cluster2] "status": "True",
2021-07-24T00:17:38.2078742Z [cluster2] "type": "NamesAccepted"
2021-07-24T00:17:38.2079296Z [cluster2] },
2021-07-24T00:17:38.2079730Z [cluster2] {
2021-07-24T00:17:38.2080542Z [cluster2] "lastTransitionTime": "2021-07-24T00:13:17Z",
2021-07-24T00:17:38.2081350Z [cluster2] "message": "the initial names have been accepted",
2021-07-24T00:17:38.2082171Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-24T00:17:38.2082858Z [cluster2] "status": "True",
2021-07-24T00:17:38.2083422Z [cluster2] "type": "Established"
2021-07-24T00:17:38.2083943Z [cluster2] }
2021-07-24T00:17:38.2084369Z [cluster2] ],
2021-07-24T00:17:38.2084876Z [cluster2] "storedVersions": [
2021-07-24T00:17:38.2085437Z [cluster2] "v1alpha1"
2021-07-24T00:17:38.2085886Z [cluster2] ]
2021-07-24T00:17:38.2086304Z [cluster2] }
2021-07-24T00:17:38.2086698Z [cluster2] }
2021-07-24T00:17:38.2087875Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-24T00:17:38.2089759Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-24T00:17:38.2091703Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:38.2093404Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:38.2095171Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-24T00:17:38.2096892Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:38.2098579Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:38.2099912Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-24T00:17:38.2101727Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:38.2103512Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-24T00:17:38.2104883Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-24T00:17:38.2106658Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-24T00:17:38.2108342Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-24T00:17:38.2109409Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-24T00:17:38.2110696Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-24T00:17:38.2112010Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-24T00:17:38.2113513Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-24T00:17:38.2114477Z [cluster2] NAME STATUS AGE
2021-07-24T00:17:38.2115294Z [cluster2] submariner-operator Active 4m19s
2021-07-24T00:17:38.2116538Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-24T00:17:38.2118094Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-24T00:17:38.2119747Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-24T00:17:38.2120914Z [cluster2] NAME CREATED AT
2021-07-24T00:17:38.2121946Z [cluster2] submariners.submariner.io 2021-07-24T00:13:16Z
2021-07-24T00:17:38.2123060Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-24T00:17:38.2124142Z [submariner-operator]$ [cluster2] grep submariners
2021-07-24T00:17:38.2125241Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-24T00:17:38.2126498Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-24T00:17:38.2127686Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-24T00:17:38.2129171Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2130925Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2132832Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2133993Z [cluster2] NAME SECRETS AGE
2021-07-24T00:17:38.2139642Z [cluster2] submariner-operator 1 4m20s
2021-07-24T00:17:38.2141084Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2143026Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2144957Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-24T00:17:38.2146295Z [cluster2] NAME CREATED AT
2021-07-24T00:17:38.2147142Z [cluster2] submariner-operator 2021-07-24T00:13:17Z
2021-07-24T00:17:39.8736846Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8739203Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8741350Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8742657Z [cluster1] NAME ROLE AGE
2021-07-24T00:17:39.8743660Z [cluster1] submariner-operator Role/submariner-operator 4m32s
2021-07-24T00:17:39.8745263Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8747165Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8749187Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:39.8750577Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-24T00:17:39.8751451Z [cluster1] submariner-operator 1/1 1 1 4m27s
2021-07-24T00:17:39.8752593Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-24T00:17:39.8753613Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-24T00:17:39.8755281Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-24T00:17:39.8757498Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:39.8759594Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:39.8762025Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:39.8764296Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o json
2021-07-24T00:17:39.8766489Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o json
2021-07-24T00:17:39.8769050Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o json
2021-07-24T00:17:39.8770436Z [cluster1] {
2021-07-24T00:17:39.8770913Z [cluster1] "apiVersion": "v1",
2021-07-24T00:17:39.8771444Z [cluster1] "kind": "Pod",
2021-07-24T00:17:39.8771922Z [cluster1] "metadata": {
2021-07-24T00:17:39.8772748Z [cluster1] "creationTimestamp": "2021-07-24T00:16:17Z",
2021-07-24T00:17:39.8773928Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-24T00:17:39.8774901Z [cluster1] "labels": {
2021-07-24T00:17:39.8775717Z [cluster1] "name": "submariner-operator",
2021-07-24T00:17:39.8776639Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-24T00:17:39.8777236Z [cluster1] },
2021-07-24T00:17:39.8777735Z [cluster1] "managedFields": [
2021-07-24T00:17:39.8778250Z [cluster1] {
2021-07-24T00:17:39.8778740Z [cluster1] "apiVersion": "v1",
2021-07-24T00:17:39.8779360Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:39.8780054Z [cluster1] "fieldsV1": {
2021-07-24T00:17:39.8780588Z [cluster1] "f:metadata": {
2021-07-24T00:17:39.8781177Z [cluster1] "f:generateName": {},
2021-07-24T00:17:39.8781769Z [cluster1] "f:labels": {
2021-07-24T00:17:39.8782268Z [cluster1] ".": {},
2021-07-24T00:17:39.8782742Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8783564Z [cluster1] "f:pod-template-hash": {}
2021-07-24T00:17:39.8784137Z [cluster1] },
2021-07-24T00:17:39.8784709Z [cluster1] "f:ownerReferences": {
2021-07-24T00:17:39.8785271Z [cluster1] ".": {},
2021-07-24T00:17:39.8786237Z [cluster1] "k:{\"uid\":\"5ed66a66-a89b-4cd7-b5ca-b5953ec99e05\"}": {
2021-07-24T00:17:39.8786976Z [cluster1] ".": {},
2021-07-24T00:17:39.8787506Z [cluster1] "f:apiVersion": {},
2021-07-24T00:17:39.8788202Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-24T00:17:39.8788871Z [cluster1] "f:controller": {},
2021-07-24T00:17:39.8789419Z [cluster1] "f:kind": {},
2021-07-24T00:17:39.8789920Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8790434Z [cluster1] "f:uid": {}
2021-07-24T00:17:39.8790894Z [cluster1] }
2021-07-24T00:17:39.8791347Z [cluster1] }
2021-07-24T00:17:39.8791795Z [cluster1] },
2021-07-24T00:17:39.8792252Z [cluster1] "f:spec": {
2021-07-24T00:17:39.8792789Z [cluster1] "f:containers": {
2021-07-24T00:17:39.8793689Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-24T00:17:39.8794341Z [cluster1] ".": {},
2021-07-24T00:17:39.8794848Z [cluster1] "f:command": {},
2021-07-24T00:17:39.8795373Z [cluster1] "f:env": {
2021-07-24T00:17:39.8795849Z [cluster1] ".": {},
2021-07-24T00:17:39.8796431Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-24T00:17:39.8797099Z [cluster1] ".": {},
2021-07-24T00:17:39.8797595Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8798129Z [cluster1] "f:value": {}
2021-07-24T00:17:39.8798616Z [cluster1] },
2021-07-24T00:17:39.8799159Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-24T00:17:39.8799694Z [cluster1] ".": {},
2021-07-24T00:17:39.8800197Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8800750Z [cluster1] "f:valueFrom": {
2021-07-24T00:17:39.8801298Z [cluster1] ".": {},
2021-07-24T00:17:39.8801834Z [cluster1] "f:fieldRef": {
2021-07-24T00:17:39.8802365Z [cluster1] ".": {},
2021-07-24T00:17:39.8802931Z [cluster1] "f:apiVersion": {},
2021-07-24T00:17:39.8803533Z [cluster1] "f:fieldPath": {}
2021-07-24T00:17:39.8804080Z [cluster1] }
2021-07-24T00:17:39.8804546Z [cluster1] }
2021-07-24T00:17:39.8805017Z [cluster1] },
2021-07-24T00:17:39.8805769Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-24T00:17:39.8806347Z [cluster1] ".": {},
2021-07-24T00:17:39.8806929Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8807473Z [cluster1] "f:valueFrom": {
2021-07-24T00:17:39.8808014Z [cluster1] ".": {},
2021-07-24T00:17:39.8808540Z [cluster1] "f:fieldRef": {
2021-07-24T00:17:39.8809090Z [cluster1] ".": {},
2021-07-24T00:17:39.8809641Z [cluster1] "f:apiVersion": {},
2021-07-24T00:17:39.8810253Z [cluster1] "f:fieldPath": {}
2021-07-24T00:17:39.8810869Z [cluster1] }
2021-07-24T00:17:39.8811333Z [cluster1] }
2021-07-24T00:17:39.8815899Z [cluster1] }
2021-07-24T00:17:39.8816367Z [cluster1] },
2021-07-24T00:17:39.8816882Z [cluster1] "f:image": {},
2021-07-24T00:17:39.8817483Z [cluster1] "f:imagePullPolicy": {},
2021-07-24T00:17:39.8818092Z [cluster1] "f:name": {},
2021-07-24T00:17:39.8818628Z [cluster1] "f:resources": {},
2021-07-24T00:17:39.8819370Z [cluster1] "f:terminationMessagePath": {},
2021-07-24T00:17:39.8820272Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-24T00:17:39.8820945Z [cluster1] }
2021-07-24T00:17:39.8821398Z [cluster1] },
2021-07-24T00:17:39.8821897Z [cluster1] "f:dnsPolicy": {},
2021-07-24T00:17:39.8822569Z [cluster1] "f:enableServiceLinks": {},
2021-07-24T00:17:39.8823252Z [cluster1] "f:restartPolicy": {},
2021-07-24T00:17:39.8823890Z [cluster1] "f:schedulerName": {},
2021-07-24T00:17:39.8824545Z [cluster1] "f:securityContext": {},
2021-07-24T00:17:39.8825194Z [cluster1] "f:serviceAccount": {},
2021-07-24T00:17:39.8825897Z [cluster1] "f:serviceAccountName": {},
2021-07-24T00:17:39.8826796Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-24T00:17:39.8827714Z [cluster1] }
2021-07-24T00:17:39.8828144Z [cluster1] },
2021-07-24T00:17:39.8829218Z [cluster1] "manager": "kube-controller-manager",
2021-07-24T00:17:39.8829965Z [cluster1] "operation": "Update",
2021-07-24T00:17:39.8869805Z [cluster1] "time": "2021-07-24T00:16:17Z"
2021-07-24T00:17:39.8870307Z [cluster1] },
2021-07-24T00:17:39.8870740Z [cluster1] {
2021-07-24T00:17:39.8871255Z [cluster1] "apiVersion": "v1",
2021-07-24T00:17:39.8871871Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:39.8872461Z [cluster1] "fieldsV1": {
2021-07-24T00:17:39.8872962Z [cluster1] "f:status": {
2021-07-24T00:17:39.8873502Z [cluster1] "f:conditions": {
2021-07-24T00:17:39.8874159Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-24T00:17:39.8874777Z [cluster1] ".": {},
2021-07-24T00:17:39.8875337Z [cluster1] "f:lastProbeTime": {},
2021-07-24T00:17:39.8876052Z [cluster1] "f:lastTransitionTime": {},
2021-07-24T00:17:39.8876697Z [cluster1] "f:status": {},
2021-07-24T00:17:39.8877214Z [cluster1] "f:type": {}
2021-07-24T00:17:39.8877697Z [cluster1] },
2021-07-24T00:17:39.8878248Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-24T00:17:39.8878992Z [cluster1] ".": {},
2021-07-24T00:17:39.8879640Z [cluster1] "f:lastProbeTime": {},
2021-07-24T00:17:39.8880344Z [cluster1] "f:lastTransitionTime": {},
2021-07-24T00:17:39.8880979Z [cluster1] "f:status": {},
2021-07-24T00:17:39.8881508Z [cluster1] "f:type": {}
2021-07-24T00:17:39.8882033Z [cluster1] },
2021-07-24T00:17:39.8882539Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-24T00:17:39.8883061Z [cluster1] ".": {},
2021-07-24T00:17:39.8883612Z [cluster1] "f:lastProbeTime": {},
2021-07-24T00:17:39.8884317Z [cluster1] "f:lastTransitionTime": {},
2021-07-24T00:17:39.8884946Z [cluster1] "f:status": {},
2021-07-24T00:17:39.8885467Z [cluster1] "f:type": {}
2021-07-24T00:17:39.8885935Z [cluster1] }
2021-07-24T00:17:39.8886391Z [cluster1] },
2021-07-24T00:17:39.8886981Z [cluster1] "f:containerStatuses": {},
2021-07-24T00:17:39.8887593Z [cluster1] "f:hostIP": {},
2021-07-24T00:17:39.8888184Z [cluster1] "f:phase": {},
2021-07-24T00:17:39.8888690Z [cluster1] "f:podIP": {},
2021-07-24T00:17:39.8889213Z [cluster1] "f:podIPs": {
2021-07-24T00:17:39.8889698Z [cluster1] ".": {},
2021-07-24T00:17:39.8890199Z [cluster1] "k:{\"ip\":\"10.1.0.6\"}": {
2021-07-24T00:17:39.8890757Z [cluster1] ".": {},
2021-07-24T00:17:39.8891248Z [cluster1] "f:ip": {}
2021-07-24T00:17:39.8891728Z [cluster1] }
2021-07-24T00:17:39.8892165Z [cluster1] },
2021-07-24T00:17:39.8892686Z [cluster1] "f:startTime": {}
2021-07-24T00:17:39.8893170Z [cluster1] }
2021-07-24T00:17:39.8893670Z [cluster1] },
2021-07-24T00:17:39.8894170Z [cluster1] "manager": "kubelet",
2021-07-24T00:17:39.8905987Z [cluster1] "operation": "Update",
2021-07-24T00:17:39.8907102Z [cluster1] "time": "2021-07-24T00:16:19Z"
2021-07-24T00:17:39.8907599Z [cluster1] }
2021-07-24T00:17:39.8908010Z [cluster1] ],
2021-07-24T00:17:39.8909068Z [cluster1] "name": "submariner-operator-5bfdb87494-dd7t7",
2021-07-24T00:17:39.8910274Z [cluster1] "namespace": "submariner-operator",
2021-07-24T00:17:39.8911020Z [cluster1] "ownerReferences": [
2021-07-24T00:17:39.8911563Z [cluster1] {
2021-07-24T00:17:39.8912071Z [cluster1] "apiVersion": "apps/v1",
2021-07-24T00:17:39.8912765Z [cluster1] "blockOwnerDeletion": true,
2021-07-24T00:17:39.8913431Z [cluster1] "controller": true,
2021-07-24T00:17:39.8914021Z [cluster1] "kind": "ReplicaSet",
2021-07-24T00:17:39.8915043Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-24T00:17:39.8916255Z [cluster1] "uid": "5ed66a66-a89b-4cd7-b5ca-b5953ec99e05"
2021-07-24T00:17:39.8916923Z [cluster1] }
2021-07-24T00:17:39.8917353Z [cluster1] ],
2021-07-24T00:17:39.8917899Z [cluster1] "resourceVersion": "2170",
2021-07-24T00:17:39.8918796Z [cluster1] "uid": "fb2638e9-d654-4a41-a379-83535a306c16"
2021-07-24T00:17:39.8919390Z [cluster1] },
2021-07-24T00:17:39.8919811Z [cluster1] "spec": {
2021-07-24T00:17:39.8920423Z [cluster1] "containers": [
2021-07-24T00:17:39.8920891Z [cluster1] {
2021-07-24T00:17:39.8921357Z [cluster1] "command": [
2021-07-24T00:17:39.8922149Z [cluster1] "submariner-operator",
2021-07-24T00:17:39.8923113Z [cluster1] "-alsologtostderr",
2021-07-24T00:17:39.8923803Z [cluster1] "-v=1"
2021-07-24T00:17:39.8924254Z [cluster1] ],
2021-07-24T00:17:39.8924702Z [cluster1] "env": [
2021-07-24T00:17:39.8925164Z [cluster1] {
2021-07-24T00:17:39.8925714Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-24T00:17:39.8926303Z [cluster1] "valueFrom": {
2021-07-24T00:17:39.8926857Z [cluster1] "fieldRef": {
2021-07-24T00:17:39.8927418Z [cluster1] "apiVersion": "v1",
2021-07-24T00:17:39.8928134Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-24T00:17:39.8928769Z [cluster1] }
2021-07-24T00:17:39.8929221Z [cluster1] }
2021-07-24T00:17:39.8929652Z [cluster1] },
2021-07-24T00:17:39.8930093Z [cluster1] {
2021-07-24T00:17:39.8930588Z [cluster1] "name": "POD_NAME",
2021-07-24T00:17:39.8931141Z [cluster1] "valueFrom": {
2021-07-24T00:17:39.8931695Z [cluster1] "fieldRef": {
2021-07-24T00:17:39.8932261Z [cluster1] "apiVersion": "v1",
2021-07-24T00:17:39.8932933Z [cluster1] "fieldPath": "metadata.name"
2021-07-24T00:17:39.8933512Z [cluster1] }
2021-07-24T00:17:39.8933959Z [cluster1] }
2021-07-24T00:17:39.8934391Z [cluster1] },
2021-07-24T00:17:39.8934984Z [cluster1] {
2021-07-24T00:17:39.8935504Z [cluster1] "name": "OPERATOR_NAME",
2021-07-24T00:17:39.8936413Z [cluster1] "value": "submariner-operator"
2021-07-24T00:17:39.8937035Z [cluster1] }
2021-07-24T00:17:39.8937459Z [cluster1] ],
2021-07-24T00:17:39.8938345Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-24T00:17:39.8939219Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-24T00:17:39.8941222Z [cluster1] "name": "submariner-operator",
2021-07-24T00:17:39.8941883Z [cluster1] "resources": {},
2021-07-24T00:17:39.8942965Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-24T00:17:39.8944100Z [cluster1] "terminationMessagePolicy": "File",
2021-07-24T00:17:39.8944873Z [cluster1] "volumeMounts": [
2021-07-24T00:17:39.8945390Z [cluster1] {
2021-07-24T00:17:39.8946113Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-24T00:17:39.8947414Z [cluster1] "name": "submariner-operator-token-c7vst",
2021-07-24T00:17:39.8948262Z [cluster1] "readOnly": true
2021-07-24T00:17:39.8948783Z [cluster1] }
2021-07-24T00:17:39.8949206Z [cluster1] ]
2021-07-24T00:17:39.8949636Z [cluster1] }
2021-07-24T00:17:39.8950042Z [cluster1] ],
2021-07-24T00:17:39.8950598Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-24T00:17:39.8951305Z [cluster1] "enableServiceLinks": true,
2021-07-24T00:17:39.8952248Z [cluster1] "nodeName": "cluster1-worker2",
2021-07-24T00:17:39.8953138Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-24T00:17:39.8953887Z [cluster1] "priority": 0,
2021-07-24T00:17:39.8954469Z [cluster1] "restartPolicy": "Always",
2021-07-24T00:17:39.8955374Z [cluster1] "schedulerName": "default-scheduler",
2021-07-24T00:17:39.8956123Z [cluster1] "securityContext": {},
2021-07-24T00:17:39.8957059Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-24T00:17:39.8958196Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-24T00:17:39.8959320Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-24T00:17:39.8960128Z [cluster1] "tolerations": [
2021-07-24T00:17:39.8960617Z [cluster1] {
2021-07-24T00:17:39.8961126Z [cluster1] "effect": "NoExecute",
2021-07-24T00:17:39.8962032Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-24T00:17:39.8962721Z [cluster1] "operator": "Exists",
2021-07-24T00:17:39.8963366Z [cluster1] "tolerationSeconds": 300
2021-07-24T00:17:39.8963914Z [cluster1] },
2021-07-24T00:17:39.8965121Z [cluster1] {
2021-07-24T00:17:39.8965738Z [cluster1] "effect": "NoExecute",
2021-07-24T00:17:39.8966477Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-24T00:17:39.8967200Z [cluster1] "operator": "Exists",
2021-07-24T00:17:39.8967846Z [cluster1] "tolerationSeconds": 300
2021-07-24T00:17:39.8968412Z [cluster1] }
2021-07-24T00:17:39.8968824Z [cluster1] ],
2021-07-24T00:17:39.8969280Z [cluster1] "volumes": [
2021-07-24T00:17:39.8969725Z [cluster1] {
2021-07-24T00:17:39.8970753Z [cluster1] "name": "submariner-operator-token-c7vst",
2021-07-24T00:17:39.8971562Z [cluster1] "secret": {
2021-07-24T00:17:39.8972106Z [cluster1] "defaultMode": 420,
2021-07-24T00:17:39.8973195Z [cluster1] "secretName": "submariner-operator-token-c7vst"
2021-07-24T00:17:39.9001698Z [cluster1] }
2021-07-24T00:17:39.9002133Z [cluster1] }
2021-07-24T00:17:39.9002562Z [cluster1] ]
2021-07-24T00:17:39.9002968Z [cluster1] },
2021-07-24T00:17:39.9003418Z [cluster1] "status": {
2021-07-24T00:17:39.9003925Z [cluster1] "conditions": [
2021-07-24T00:17:39.9004390Z [cluster1] {
2021-07-24T00:17:39.9004941Z [cluster1] "lastProbeTime": null,
2021-07-24T00:17:39.9006025Z [cluster1] "lastTransitionTime": "2021-07-24T00:16:17Z",
2021-07-24T00:17:39.9006701Z [cluster1] "status": "True",
2021-07-24T00:17:39.9007324Z [cluster1] "type": "Initialized"
2021-07-24T00:17:39.9007847Z [cluster1] },
2021-07-24T00:17:39.9008263Z [cluster1] {
2021-07-24T00:17:39.9008806Z [cluster1] "lastProbeTime": null,
2021-07-24T00:17:39.9009860Z [cluster1] "lastTransitionTime": "2021-07-24T00:16:19Z",
2021-07-24T00:17:39.9010526Z [cluster1] "status": "True",
2021-07-24T00:17:39.9011062Z [cluster1] "type": "Ready"
2021-07-24T00:17:39.9011521Z [cluster1] },
2021-07-24T00:17:39.9011951Z [cluster1] {
2021-07-24T00:17:39.9012476Z [cluster1] "lastProbeTime": null,
2021-07-24T00:17:39.9013387Z [cluster1] "lastTransitionTime": "2021-07-24T00:16:19Z",
2021-07-24T00:17:39.9014038Z [cluster1] "status": "True",
2021-07-24T00:17:39.9014941Z [cluster1] "type": "ContainersReady"
2021-07-24T00:17:39.9015491Z [cluster1] },
2021-07-24T00:17:39.9015914Z [cluster1] {
2021-07-24T00:17:39.9016440Z [cluster1] "lastProbeTime": null,
2021-07-24T00:17:39.9017361Z [cluster1] "lastTransitionTime": "2021-07-24T00:16:17Z",
2021-07-24T00:17:39.9018019Z [cluster1] "status": "True",
2021-07-24T00:17:39.9018600Z [cluster1] "type": "PodScheduled"
2021-07-24T00:17:39.9019134Z [cluster1] }
2021-07-24T00:17:39.9019542Z [cluster1] ],
2021-07-24T00:17:39.9020096Z [cluster1] "containerStatuses": [
2021-07-24T00:17:39.9020632Z [cluster1] {
2021-07-24T00:17:39.9022618Z [cluster1] "containerID": "containerd://c2c4b7f026dad25c95b1efedb4ee600d98519d0e71842c5c6bbb6a0c738c4cb5",
2021-07-24T00:17:39.9025057Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-24T00:17:39.9026699Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:9d1e801112c979f511d54b6ddc2b3ab3b1f06244ba897a566461f0f8316e0604",
2021-07-24T00:17:39.9027988Z [cluster1] "lastState": {},
2021-07-24T00:17:39.9028759Z [cluster1] "name": "submariner-operator",
2021-07-24T00:17:39.9029361Z [cluster1] "ready": true,
2021-07-24T00:17:39.9029868Z [cluster1] "restartCount": 0,
2021-07-24T00:17:39.9030399Z [cluster1] "started": true,
2021-07-24T00:17:39.9030861Z [cluster1] "state": {
2021-07-24T00:17:39.9031325Z [cluster1] "running": {
2021-07-24T00:17:40.0153671Z [cluster1] "startedAt": "20 rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0155537Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0157570Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0158837Z [cluster2] NAME ROLE AGE
2021-07-24T00:17:40.0159844Z [cluster2] submariner-operator Role/submariner-operator 4m21s
2021-07-24T00:17:40.0161426Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0163316Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0165316Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-24T00:17:40.0166799Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-24T00:17:40.0167737Z [cluster2] submariner-operator 1/1 1 1 4m16s
2021-07-24T00:17:40.0168732Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-24T00:17:40.0169885Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-24T00:17:40.0171522Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-24T00:17:40.0173979Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:40.0176391Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:40.0178774Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:40.0181194Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o json
2021-07-24T00:17:40.0183949Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o json
2021-07-24T00:17:40.0186615Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o json
2021-07-24T00:17:40.0188016Z [cluster2] {
2021-07-24T00:17:40.0188472Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:40.0188942Z [cluster2] "kind": "Pod",
2021-07-24T00:17:40.0189398Z [cluster2] "metadata": {
2021-07-24T00:17:40.0190146Z [cluster2] "creationTimestamp": "2021-07-24T00:16:25Z",
2021-07-24T00:17:40.0191243Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-24T00:17:40.0192206Z [cluster2] "labels": {
2021-07-24T00:17:40.0192997Z [cluster2] "name": "submariner-operator",
2021-07-24T00:17:40.0193915Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-24T00:17:40.0194626Z [cluster2] },
2021-07-24T00:17:40.0195120Z [cluster2] "managedFields": [
2021-07-24T00:17:40.0195631Z [cluster2] {
2021-07-24T00:17:40.0196120Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:40.0196733Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:40.0197316Z [cluster2] "fieldsV1": {
2021-07-24T00:17:40.0197832Z [cluster2] "f:metadata": {
2021-07-24T00:17:40.0198410Z [cluster2] "f:generateName": {},
2021-07-24T00:17:40.0198972Z [cluster2] "f:labels": {
2021-07-24T00:17:40.0199462Z [cluster2] ".": {},
2021-07-24T00:17:40.0199933Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0200736Z [cluster2] "f:pod-template-hash": {}
2021-07-24T00:17:40.0201303Z [cluster2] },
2021-07-24T00:17:40.0201878Z [cluster2] "f:ownerReferences": {
2021-07-24T00:17:40.0202441Z [cluster2] ".": {},
2021-07-24T00:17:40.0203377Z [cluster2] "k:{\"uid\":\"f75ef75e-1b52-4bdd-8901-a489d53c583e\"}": {
2021-07-24T00:17:40.0204096Z [cluster2] ".": {},
2021-07-24T00:17:40.0204715Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:40.0205351Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-24T00:17:40.0206181Z [cluster2] "f:controller": {},
2021-07-24T00:17:40.0206728Z [cluster2] "f:kind": {},
2021-07-24T00:17:40.0207225Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0207725Z [cluster2] "f:uid": {}
2021-07-24T00:17:40.0208193Z [cluster2] }
2021-07-24T00:17:40.0208624Z [cluster2] }
2021-07-24T00:17:40.0209073Z [cluster2] },
2021-07-24T00:17:40.0209531Z [cluster2] "f:spec": {
2021-07-24T00:17:40.0210062Z [cluster2] "f:containers": {
2021-07-24T00:17:40.0210951Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-24T00:17:40.0211604Z [cluster2] ".": {},
2021-07-24T00:17:40.0212204Z [cluster2] "f:command": {},
2021-07-24T00:17:40.0212741Z [cluster2] "f:env": {
2021-07-24T00:17:40.0213234Z [cluster2] ".": {},
2021-07-24T00:17:40.0213806Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-24T00:17:40.0214385Z [cluster2] ".": {},
2021-07-24T00:17:40.0243531Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0244094Z [cluster2] "f:value": {}
2021-07-24T00:17:40.0244631Z [cluster2] },
2021-07-24T00:17:40.0245183Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-24T00:17:40.0245729Z [cluster2] ".": {},
2021-07-24T00:17:40.0246240Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0246927Z [cluster2] "f:valueFrom": {
2021-07-24T00:17:40.0247457Z [cluster2] ".": {},
2021-07-24T00:17:40.0248004Z [cluster2] "f:fieldRef": {
2021-07-24T00:17:40.0248598Z [cluster2] ".": {},
2021-07-24T00:17:40.0249163Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:40.0249763Z [cluster2] "f:fieldPath": {}
2021-07-24T00:17:40.0250495Z [cluster2] }
2021-07-24T00:17:40.0250972Z [cluster2] }
2021-07-24T00:17:40.0251431Z [cluster2] },
2021-07-24T00:17:40.0252014Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-24T00:17:40.0252594Z [cluster2] ".": {},
2021-07-24T00:17:40.0253105Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0253742Z [cluster2] "f:valueFrom": {
2021-07-24T00:17:40.0254280Z [cluster2] ".": {},
2021-07-24T00:17:40.0255058Z [cluster2] "f:fieldRef": {
2021-07-24T00:17:40.0255602Z [cluster2] ".": {},
2021-07-24T00:17:40.0256167Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:40.0256769Z [cluster2] "f:fieldPath": {}
2021-07-24T00:17:40.0257315Z [cluster2] }
2021-07-24T00:17:40.0257785Z [cluster2] }
2021-07-24T00:17:40.0258252Z [cluster2] }
2021-07-24T00:17:40.0258705Z [cluster2] },
2021-07-24T00:17:40.0259202Z [cluster2] "f:image": {},
2021-07-24T00:17:40.0259802Z [cluster2] "f:imagePullPolicy": {},
2021-07-24T00:17:40.0260409Z [cluster2] "f:name": {},
2021-07-24T00:17:40.0261042Z [cluster2] "f:resources": {},
2021-07-24T00:17:40.0261705Z [cluster2] "f:terminationMessagePath": {},
2021-07-24T00:17:40.0262763Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-24T00:17:40.0263435Z [cluster2] }
2021-07-24T00:17:40.0264374Z [cluster2] },
2021-07-24T00:17:40.0264834Z [cluster2] "f:dnsPolicy": {},
2021-07-24T00:17:40.0265456Z [cluster2] "f:enableServiceLinks": {},
2021-07-24T00:17:40.0266088Z [cluster2] "f:restartPolicy": {},
2021-07-24T00:17:40.0266675Z [cluster2] "f:schedulerName": {},
2021-07-24T00:17:40.0267395Z [cluster2] "f:securityContext": {},
2021-07-24T00:17:40.0268005Z [cluster2] "f:serviceAccount": {},
2021-07-24T00:17:40.0268657Z [cluster2] "f:serviceAccountName": {},
2021-07-24T00:17:40.0269494Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-24T00:17:40.0270204Z [cluster2] }
2021-07-24T00:17:40.0270601Z [cluster2] },
2021-07-24T00:17:40.0271725Z [cluster2] "manager": "kube-controller-manager",
2021-07-24T00:17:40.0272720Z [cluster2] "operation": "Update",
2021-07-24T00:17:40.0273423Z [cluster2] "time": "2021-07-24T00:16:25Z"
2021-07-24T00:17:40.0273864Z [cluster2] },
2021-07-24T00:17:40.0274250Z [cluster2] {
2021-07-24T00:17:40.0274713Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:40.0275268Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:40.0276015Z [cluster2] "fieldsV1": {
2021-07-24T00:17:40.0276512Z [cluster2] "f:status": {
2021-07-24T00:17:40.0277045Z [cluster2] "f:conditions": {
2021-07-24T00:17:40.0277688Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-24T00:17:40.0278295Z [cluster2] ".": {},
2021-07-24T00:17:40.0278846Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:40.0279552Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:40.0280291Z [cluster2] "f:status": {},
2021-07-24T00:17:40.0280799Z [cluster2] "f:type": {}
2021-07-24T00:17:40.0281281Z [cluster2] },
2021-07-24T00:17:40.0281827Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-24T00:17:40.0282434Z [cluster2] ".": {},
2021-07-24T00:17:40.0282993Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:40.0283694Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:40.0284335Z [cluster2] "f:status": {},
2021-07-24T00:17:40.0284844Z [cluster2] "f:type": {}
2021-07-24T00:17:40.0285324Z [cluster2] },
2021-07-24T00:17:40.0285828Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-24T00:17:40.0286348Z [cluster2] ".": {},
2021-07-24T00:17:40.0286901Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:40.0287604Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:40.0288237Z [cluster2] "f:status": {},
2021-07-24T00:17:40.0288757Z [cluster2] "f:type": {}
2021-07-24T00:17:40.0289242Z [cluster2] }
2021-07-24T00:17:40.0289676Z [cluster2] },
2021-07-24T00:17:40.0290265Z [cluster2] "f:containerStatuses": {},
2021-07-24T00:17:40.0290869Z [cluster2] "f:hostIP": {},
2021-07-24T00:17:40.0291388Z [cluster2] "f:phase": {},
2021-07-24T00:17:40.0291892Z [cluster2] "f:podIP": {},
2021-07-24T00:17:40.0292413Z [cluster2] "f:podIPs": {
2021-07-24T00:17:40.0292899Z [cluster2] ".": {},
2021-07-24T00:17:40.0293403Z [cluster2] "k:{\"ip\":\"10.2.128.5\"}": {
2021-07-24T00:17:40.0293886Z [cluster2] ".": {},
2021-07-24T00:17:40.0294367Z [cluster2] "f:ip": {}
2021-07-24T00:17:40.0335359Z [cluster2] }
2021-07-24T00:17:40.0335824Z [cluster2] },
2021-07-24T00:17:40.0336591Z [cluster2] "f:startTime": {}
2021-07-24T00:17:40.0337089Z [cluster2] }
2021-07-24T00:17:40.0337524Z [cluster2] },
2021-07-24T00:17:40.0338024Z [cluster2] "manager": "kubelet",
2021-07-24T00:17:40.0338623Z [cluster2] "operation": "Update",
2021-07-24T00:17:40.0339587Z [cluster2] "time": "2021-07-24T00:16:27Z"
2021-07-24T00:17:40.0340066Z [cluster2] }
2021-07-24T00:17:40.0340474Z [cluster2] ],
2021-07-24T00:17:40.0341520Z [cluster2] "name": "submariner-operator-5bfdb87494-tgbwc",
2021-07-24T00:17:40.0342747Z [cluster2] "namespace": "submariner-operator",
2021-07-24T00:17:40.0343472Z [cluster2] "ownerReferences": [
2021-07-24T00:17:40.0344095Z [cluster2] {
2021-07-24T00:17:40.0344604Z [cluster2] "apiVersion": "apps/v1",
2021-07-24T00:17:40.0345297Z [cluster2] "blockOwnerDeletion": true,
2021-07-24T00:17:40.0345962Z [cluster2] "controller": true,
2021-07-24T00:17:40.0346554Z [cluster2] "kind": "ReplicaSet",
2021-07-24T00:17:40.0347672Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-24T00:17:40.0348973Z [cluster2] "uid": "f75ef75e-1b52-4bdd-8901-a489d53c583e"
2021-07-24T00:17:40.0349636Z [cluster2] }
2021-07-24T00:17:40.0350047Z [cluster2] ],
2021-07-24T00:17:40.0350590Z [cluster2] "resourceVersion": "2061",
2021-07-24T00:17:40.0351489Z [cluster2] "uid": "98c7d823-7823-4ede-9604-cb0ad582e399"
2021-07-24T00:17:40.0352190Z [cluster2] },
2021-07-24T00:17:40.0352616Z [cluster2] "spec": {
2021-07-24T00:17:40.0353113Z [cluster2] "containers": [
2021-07-24T00:17:40.0353580Z [cluster2] {
2021-07-24T00:17:40.0354044Z [cluster2] "command": [
2021-07-24T00:17:40.0354831Z [cluster2] "submariner-operator",
2021-07-24T00:17:40.0355687Z [cluster2] "-alsologtostderr",
2021-07-24T00:17:40.0356381Z [cluster2] "-v=1"
2021-07-24T00:17:40.0356830Z [cluster2] ],
2021-07-24T00:17:40.0357288Z [cluster2] "env": [
2021-07-24T00:17:40.0357729Z [cluster2] {
2021-07-24T00:17:40.0358276Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-24T00:17:40.0358858Z [cluster2] "valueFrom": {
2021-07-24T00:17:40.0359407Z [cluster2] "fieldRef": {
2021-07-24T00:17:40.0359971Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:40.0360703Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-24T00:17:40.0361338Z [cluster2] }
2021-07-24T00:17:40.0361783Z [cluster2] }
2021-07-24T00:17:40.0362226Z [cluster2] },
2021-07-24T00:17:40.0362647Z [cluster2] {
2021-07-24T00:17:40.0363152Z [cluster2] "name": "POD_NAME",
2021-07-24T00:17:40.0363687Z [cluster2] "valueFrom": {
2021-07-24T00:17:40.0364235Z [cluster2] "fieldRef": {
2021-07-24T00:17:40.0364798Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:40.0365461Z [cluster2] "fieldPath": "metadata.name"
2021-07-24T00:17:40.0366035Z [cluster2] }
2021-07-24T00:17:40.0366482Z [cluster2] }
2021-07-24T00:17:40.0366916Z [cluster2] },
2021-07-24T00:17:40.0367351Z [cluster2] {
2021-07-24T00:17:40.0367882Z [cluster2] "name": "OPERATOR_NAME",
2021-07-24T00:17:40.0368765Z [cluster2] "value": "submariner-operator"
2021-07-24T00:17:40.0369374Z [cluster2] }
2021-07-24T00:17:40.0369796Z [cluster2] ],
2021-07-24T00:17:40.0370748Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-24T00:17:40.0371626Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-24T00:17:40.0372599Z [cluster2] "name": "submariner-operator",
2021-07-24T00:17:40.0373242Z [cluster2] "resources": {},
2021-07-24T00:17:40.0374228Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-24T00:17:40.0376297Z [cluster2] "terminationMessagePolicy": "File",
2021-07-24T00:17:40.0377045Z [cluster2] "volumeMounts": [
2021-07-24T00:17:40.0377567Z [cluster2] {
2021-07-24T00:17:40.0378288Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-24T00:17:40.0379607Z [cluster2] "name": "submariner-operator-token-2d2ll",
2021-07-24T00:17:40.0380448Z [cluster2] "readOnly": true
2021-07-24T00:17:40.0380952Z [cluster2] }
2021-07-24T00:17:40.0381376Z [cluster2] ]
2021-07-24T00:17:40.0381799Z [cluster2] }
2021-07-24T00:17:40.0382204Z [cluster2] ],
2021-07-24T00:17:40.0382796Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-24T00:17:40.0383515Z [cluster2] "enableServiceLinks": true,
2021-07-24T00:17:40.0384423Z [cluster2] "nodeName": "cluster2-worker2",
2021-07-24T00:17:40.0385310Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-24T00:17:40.0386064Z [cluster2] "priority": 0,
2021-07-24T00:17:40.0386647Z [cluster2] "restartPolicy": "Always",
2021-07-24T00:17:40.0387779Z [cluster2] "schedulerName": "default-scheduler",
2021-07-24T00:17:40.0388661Z [cluster2] "securityContext": {},
2021-07-24T00:17:40.0389870Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-24T00:17:40.0391118Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-24T00:17:40.0392249Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-24T00:17:40.0393049Z [cluster2] "tolerations": [
2021-07-24T00:17:40.0393537Z [cluster2] {
2021-07-24T00:17:40.0394039Z [cluster2] "effect": "NoExecute",
2021-07-24T00:17:40.0394924Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-24T00:17:40.0395617Z [cluster2] "operator": "Exists",
2021-07-24T00:17:40.0396253Z [cluster2] "tolerationSeconds": 300
2021-07-24T00:17:40.0396803Z [cluster2] },
2021-07-24T00:17:40.0397230Z [cluster2] {
2021-07-24T00:17:40.0397741Z [cluster2] "effect": "NoExecute",
2021-07-24T00:17:40.0398479Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-24T00:17:40.0399199Z [cluster2] "operator": "Exists",
2021-07-24T00:17:40.0399825Z [cluster2] "tolerationSeconds": 300
2021-07-24T00:17:40.0400378Z [cluster2] }
2021-07-24T00:17:40.0400781Z [cluster2] ],
2021-07-24T00:17:40.0401234Z [cluster2] "volumes": [
2021-07-24T00:17:40.0401674Z [cluster2] {
2021-07-24T00:17:40.0402641Z [cluster2] "name": "submariner-operator-token-2d2ll",
2021-07-24T00:17:40.0403440Z [cluster2] "secret": {
2021-07-24T00:17:40.0403981Z [cluster2] "defaultMode": 420,
2021-07-24T00:17:40.0405052Z [cluster2] "secretName": "submariner-operator-token-2d2ll"
2021-07-24T00:17:40.0405876Z [cluster2] }
2021-07-24T00:17:40.0406301Z [cluster2] }
2021-07-24T00:17:40.0406708Z [cluster2] ]
2021-07-24T00:17:40.0407117Z [cluster2] },
2021-07-24T00:17:40.0407539Z [cluster2] "status": {
2021-07-24T00:17:40.0408037Z [cluster2] "conditions": [
2021-07-24T00:17:40.0408498Z [cluster2] {
2021-07-24T00:17:40.0409034Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:40.0409915Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:25Z",
2021-07-24T00:17:40.0410649Z [cluster2] "status": "True",
2021-07-24T00:17:40.0411214Z [cluster2] "type": "Initialized"
2021-07-24T00:17:40.0411726Z [cluster2] },
2021-07-24T00:17:40.0412139Z [cluster2] {
2021-07-24T00:17:40.0412678Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:40.0413583Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:27Z",
2021-07-24T00:17:40.0414224Z [cluster2] "status": "True",
2021-07-24T00:17:40.0455188Z [cluster2] "type": "Ready"
2021-07-24T00:17:40.0455702Z [cluster2] },
2021-07-24T00:17:40.0456133Z [cluster2] {
2021-07-24T00:17:40.0456661Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:40.0457886Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:27Z",
2021-07-24T00:17:40.0458615Z [cluster2] "status": "True",
2021-07-24T00:17:40.0459236Z [cluster2] "type": "ContainersReady"
2021-07-24T00:17:40.0459791Z [cluster2] },
2021-07-24T00:17:40.0460214Z [cluster2] {
2021-07-24T00:17:40.0460749Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:40.0461658Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:25Z",
2021-07-24T00:17:40.0462315Z [cluster2] "status": "True",
2021-07-24T00:17:40.0462963Z [cluster2] "type": "PodScheduled"
2021-07-24T00:17:40.0463496Z [cluster2] }
2021-07-24T00:17:40.0463905Z [cluster2] ],
2021-07-24T00:17:40.0464615Z [cluster2] "containerStatuses": [
2021-07-24T00:17:40.0465149Z [cluster2] {
2021-07-24T00:17:40.0467101Z [cluster2] "containerID": "containerd://72b3de31cfbe058bb9424f76df22ebd4a0b092b46dc8e693bb43bd419592e82f",
2021-07-24T00:17:40.0469474Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-24T00:17:40.0471116Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:9d1e801112c979f511d54b6ddc2b3ab3b1f06244ba897a566461f0f8316e0604",
2021-07-24T00:17:40.0472482Z [cluster2] "lastState": {},
2021-07-24T00:17:40.0473303Z [cluster2] "name": "submariner-operator",
2021-07-24T00:17:40.0473956Z [cluster2] "ready": true,
2021-07-24T00:17:40.0474502Z [cluster2] "restartCount": 0,
2021-07-24T00:17:40.0475063Z [cluster2] "started": true,
2021-07-24T00:17:40.0475563Z [cluster2] "state": {
2021-07-24T00:17:40.0476060Z [cluster2] "running": {
2021-07-24T00:17:40.7999198Z [cluster2] "startedAt": "21-07-24T00:16:18Z"
2021-07-24T00:17:40.7999877Z [cluster1] }
2021-07-24T00:17:40.8000310Z [cluster1] }
2021-07-24T00:17:40.8000748Z [cluster1] }
2021-07-24T00:17:40.8001159Z [cluster1] ],
2021-07-24T00:17:40.8001727Z [cluster1] "hostIP": "172.18.0.8",
2021-07-24T00:17:40.8002285Z [cluster1] "phase": "Running",
2021-07-24T00:17:40.8002820Z [cluster1] "podIP": "10.1.0.6",
2021-07-24T00:17:40.8003309Z [cluster1] "podIPs": [
2021-07-24T00:17:40.8003767Z [cluster1] {
2021-07-24T00:17:40.8004214Z [cluster1] "ip": "10.1.0.6"
2021-07-24T00:17:40.8004671Z [cluster1] }
2021-07-24T00:17:40.8005095Z [cluster1] ],
2021-07-24T00:17:40.8005612Z [cluster1] "qosClass": "BestEffort",
2021-07-24T00:17:40.8006447Z [cluster1] "startTime": "2021-07-24T00:16:17Z"
2021-07-24T00:17:40.8006944Z [cluster1] }
2021-07-24T00:17:40.8007353Z [cluster1] }
2021-07-24T00:17:40.8009021Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.8010785Z [submariner-operator]$ [cluster1] grep Running
2021-07-24T00:17:40.8012872Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.8024530Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.8026164Z [cluster1] Running
2021-07-24T00:17:40.8027838Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator
2021-07-24T00:17:40.8030136Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator
2021-07-24T00:17:40.8032557Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-dd7t7 --namespace=submariner-operator
2021-07-24T00:17:40.8034144Z [cluster1] I0724 00:16:19.031113 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-24T00:17:40.8034892Z [cluster1] I0724 00:16:19.031214 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-24T00:17:40.8035915Z [cluster1] I0724 00:16:19.031233 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-24T00:17:40.8037065Z [cluster1] I0724 00:16:19.031248 1 main.go:80] cmd "msg"="Submariner operator version: devel-43b9829"
2021-07-24T00:17:40.8037995Z [cluster1] I0724 00:16:19.031413 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-24T00:17:40.8039523Z [cluster1] I0724 00:16:19.640002 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-rrfvj"
2021-07-24T00:17:40.8040960Z [cluster1] I0724 00:16:19.653935 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-24T00:17:40.8041797Z [cluster1] I0724 00:16:20.791346 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-24T00:17:40.8042630Z [cluster1] I0724 00:16:23.180926 1 leader.go:149] leader "msg"="Became the leader."
2021-07-24T00:17:40.8043971Z [cluster1] I0724 00:16:23.785437 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-24T00:17:40.8045051Z [cluster1] I0724 00:16:23.785887 1 main.go:129] cmd "msg"="Registering Components."
2021-07-24T00:17:40.8045900Z [cluster1] I0724 00:16:23.785981 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-24T00:17:40.8046993Z [cluster1] I0724 00:16:27.637039 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8048905Z [cluster1] I0724 00:16:27.637075 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8050165Z [cluster1] I0724 00:16:27.637118 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-24T00:17:40.8055829Z [cluster1] I0724 00:16:27.639055 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-24T00:17:40.8146601Z [cluster1] I0724 00:16:27.639249 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-24T00:17:40.8153621Z [cluster1] I0724 00:16:27.639369 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-24T00:17:40.8158593Z [cluster1] I0724 00:16:27.639468 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-24T00:17:40.8162479Z [cluster1] I0724 00:16:27.639568 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-24T00:17:40.8164705Z [cluster1] I0724 00:16:27.640289 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-24T00:17:40.8166593Z [cluster1] I0724 00:16:27.739907 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8169578Z [cluster1] I0724 00:16:27.742356 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-24T00:17:40.8172466Z [cluster1] I0724 00:16:27.742908 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-24T00:17:40.8176991Z [cluster1] I0724 00:16:27.743492 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-24T00:17:40.8181055Z [cluster1] I0724 00:16:27.741818 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-24T00:17:40.8185430Z [cluster1] I0724 00:16:27.741998 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-24T00:17:40.8188277Z [cluster1] I0724 00:16:27.844528 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-24T00:17:40.8190501Z [cluster1] I0724 00:16:27.844566 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-24T00:17:40.8193050Z [cluster1] I0724 00:16:27.844638 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8195891Z [cluster1] I0724 00:16:27.844759 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8199460Z [cluster1] I0724 00:16:27.846326 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-24T00:17:40.8202683Z [cluster1] I0724 00:16:27.846594 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-24T00:17:40.8205399Z [cluster1] I0724 00:16:27.846746 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8262511Z [cluster1] I0724 00:16:27.846915 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-24T00:17:40.8264830Z [cluster1] I0724 00:16:27.947463 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-24T00:17:40.8266761Z [cluster1] I0724 00:16:27.947638 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-24T00:17:40.8268915Z [cluster1] I0724 00:16:27.947806 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8271236Z [cluster1] I0724 00:16:27.947993 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-24T00:17:40.8273532Z [cluster1] I0724 00:16:27.948192 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8276728Z [cluster1] E0724 00:16:28.227130 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8280323Z [cluster1] E0724 00:16:28.359088 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8283788Z [cluster1] E0724 00:16:28.466515 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8287372Z [cluster1] E0724 00:16:28.565959 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8290839Z [cluster1] E0724 00:16:28.651355 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8294275Z [cluster1] E0724 00:16:28.846862 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8297893Z [cluster1] E0724 00:16:29.058501 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8301319Z [cluster1] E0724 00:16:29.562358 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8304435Z [cluster1] I0724 00:16:30.146272 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8307358Z [cluster1] I0724 00:16:30.213219 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8310162Z [cluster1] I0724 00:16:30.268353 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8313357Z [cluster1] E0724 00:16:30.338960 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8378854Z [cluster1] I0724 00:16:30.669561 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8381483Z [cluster1] I0724 00:16:31.019195 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8384446Z [cluster1] I0724 00:16:31.069753 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8387275Z [cluster1] I0724 00:16:31.188890 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8390072Z [cluster1] I0724 00:16:31.365546 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8392887Z [cluster1] I0724 00:16:31.510500 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8395897Z [cluster1] I0724 00:16:31.511127 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8399124Z [cluster1] E0724 00:16:31.686004 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8402643Z [cluster1] E0724 00:16:34.295033 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8406224Z [cluster1] E0724 00:16:39.533661 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8409124Z [cluster1] I0724 00:16:39.817047 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8411411Z [cluster1] I0724 00:16:39.861715 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8413844Z [cluster1] I0724 00:16:39.861832 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8416250Z [cluster1] I0724 00:16:43.636037 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8418523Z [cluster1] I0724 00:16:43.636049 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8420191Z [cluster1] I0724 00:16:43.780025 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-24T00:17:40.8421988Z [cluster1] I0724 00:16:43.780205 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-24T00:17:40.8423482Z [cluster1] I0724 00:16:43.780286 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8424915Z [cluster1] I0724 00:16:43.780360 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8427440Z [cluster1] I0724 00:16:43.823764 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8429517Z [cluster1] I0724 00:16:43.829095 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-24T00:17:40.8431314Z [cluster1] I0724 00:16:43.829123 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-24T00:17:40.8432807Z [cluster1] I0724 00:16:43.829134 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8434294Z [cluster1] I0724 00:16:43.829144 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8436870Z [cluster1] I0724 00:16:43.867671 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8440189Z [cluster1] I0724 00:16:43.885911 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8443557Z [cluster1] I0724 00:16:44.094802 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8446901Z [cluster1] I0724 00:16:44.491185 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8450167Z [cluster1] I0724 00:16:44.512658 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8454039Z [cluster1] E0724 00:16:44.512922 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-24T00:17:40.8459627Z [cluster1] I0724 00:16:44.513052 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8461373Z [cluster1] I0724 00:16:44.513170 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8462821Z [cluster1] I0724 00:16:44.513247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8465381Z [cluster1] I0724 00:16:44.560193 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8468745Z [cluster1] I0724 00:16:44.627694 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8472062Z [cluster1] I0724 00:16:44.703125 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8475359Z [cluster1] I0724 00:16:44.798876 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8478441Z [cluster1] I0724 00:16:44.830135 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8481405Z [cluster1] I0724 00:16:44.830587 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8516788Z [cluster1] I0724 00:16:44.860592 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-24T00:17:40.8520657Z [cluster1] I0724 00:16:44.972281 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8525197Z [cluster1] E0724 00:16:45.011895 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-24T00:17:40.8529053Z [cluster1] I0724 00:16:45.012361 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8532460Z [cluster1] I0724 00:16:45.254824 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8536419Z [cluster1] I0724 00:16:45.338905 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8539296Z [cluster1] I0724 00:16:45.354085 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8541020Z [cluster1] I0724 00:16:45.354126 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8542437Z [cluster1] I0724 00:16:45.354136 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8545341Z [cluster1] I0724 00:16:45.390734 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8550283Z [cluster1] E0724 00:16:45.390807 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-24T00:17:40.8554491Z [cluster1] I0724 00:16:45.400965 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8557574Z [cluster1] I0724 00:16:45.545936 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8561047Z [cluster1] I0724 00:16:45.601794 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8564864Z [cluster1] E0724 00:16:45.657847 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8567984Z [cluster1] I0724 00:16:45.657893 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8569697Z [cluster1] I0724 00:16:45.657940 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8571121Z [cluster1] I0724 00:16:45.657950 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8573664Z [cluster1] I0724 00:16:45.952093 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8578332Z [cluster1] E0724 00:16:45.960320 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: services \"submariner-lighthouse-agent-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-24T00:17:40.8582385Z [cluster1] I0724 00:16:45.960371 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8651478Z [cluster1] I0724 00:16:45.971650 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8655364Z [cluster1] I0724 00:16:46.084106 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8659088Z [cluster1] I0724 00:16:46.305794 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8663002Z [cluster1] I0724 00:16:46.306264 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8666957Z [cluster1] I0724 00:16:46.378032 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8671105Z [cluster1] I0724 00:16:46.380085 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8674710Z [cluster1] I0724 00:16:46.610708 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8677933Z [cluster1] I0724 00:16:46.767070 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8681220Z [cluster1] I0724 00:16:47.116662 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8684681Z [cluster1] I0724 00:16:47.125018 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8688084Z [cluster1] I0724 00:16:47.137804 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8691531Z [cluster1] I0724 00:16:47.137953 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8694613Z [cluster1] I0724 00:16:47.245333 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8696349Z [cluster1] I0724 00:16:47.245498 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8697773Z [cluster1] I0724 00:16:47.245852 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8700836Z [cluster1] E0724 00:16:47.254384 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8703946Z [cluster1] I0724 00:16:47.254429 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8705659Z [cluster1] I0724 00:16:47.255515 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8707071Z [cluster1] I0724 00:16:47.255623 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8709896Z [cluster1] I0724 00:16:47.314327 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-24T00:17:40.8713525Z [cluster1] I0724 00:16:47.342156 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8717163Z [cluster1] I0724 00:16:47.442806 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8721240Z [cluster1] E0724 00:16:47.443146 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-24T00:17:40.8726011Z [cluster1] E0724 00:16:47.443177 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-24T00:17:40.8729903Z [cluster1] I0724 00:16:47.443214 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8732981Z [cluster1] I0724 00:16:47.605823 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8745273Z [cluster1] I0724 00:16:47.606262 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8749029Z [cluster1] I0724 00:16:47.648631 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8752190Z [cluster1] I0724 00:16:47.856136 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8755981Z [cluster1] I0724 00:16:47.856394 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8759844Z [cluster1] I0724 00:16:48.440484 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8763517Z [cluster1] I0724 00:16:48.478716 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8766897Z [cluster1] I0724 00:16:48.722004 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8770431Z [cluster1] I0724 00:16:48.756864 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8774088Z [cluster1] I0724 00:16:48.816188 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8778339Z [cluster1] I0724 00:16:49.031024 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8782094Z [cluster1] I0724 00:16:49.105715 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8785193Z [cluster1] I0724 00:16:49.196828 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8788690Z [cluster1] I0724 00:16:50.057462 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8792618Z [cluster1] I0724 00:16:50.297685 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8796284Z [cluster1] I0724 00:16:51.377372 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8800852Z [cluster1] I0724 00:16:51.377409 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.8805233Z [cluster1] I0724 00:16:51.378966 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8808490Z [cluster1] I0724 00:16:51.582011 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8813096Z [cluster1] I0724 00:16:51.582059 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.8817275Z [cluster1] I0724 00:16:51.787649 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8820677Z [cluster1] I0724 00:16:51.868067 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8824654Z [cluster1] I0724 00:16:51.997758 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8828406Z [cluster1] E0724 00:16:52.418304 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.8863910Z [cluster1] I0724 00:16:52.609815 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8867885Z [cluster1] I0724 00:16:52.649498 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.8872093Z [cluster1] I0724 00:16:52.673559 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8875916Z [cluster1] I0724 00:16:53.287293 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8879279Z [cluster1] I0724 00:16:53.329591 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8883864Z [cluster1] I0724 00:16:53.329638 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.8887655Z [cluster1] I0724 00:17:09.477348 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8889379Z [cluster1] I0724 00:17:09.477395 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8890921Z [cluster1] I0724 00:17:09.477405 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8893475Z [cluster1] I0724 00:17:09.629581 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8896997Z [cluster1] I0724 00:17:09.662193 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8900340Z [cluster1] I0724 00:17:10.269791 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8903671Z [cluster1] I0724 00:17:10.322771 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8906466Z [cluster1] I0724 00:17:10.360035 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8908169Z [cluster1] I0724 00:17:10.360089 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8909688Z [cluster1] I0724 00:17:10.360100 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8911736Z [cluster1] I0724 00:17:10.378244 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8913426Z [cluster1] I0724 00:17:10.378289 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8914859Z [cluster1] I0724 00:17:10.378299 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8917407Z [cluster1] I0724 00:17:10.521757 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8920701Z [cluster1] I0724 00:17:10.522393 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8924038Z [cluster1] I0724 00:17:10.587767 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8930255Z [cluster1] I0724 00:17:10.588166 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8933698Z [cluster1] I0724 00:17:11.222398 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8937830Z [cluster1] I0724 00:17:11.225835 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8941327Z [cluster1] I0724 00:17:11.482991 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8944694Z [cluster1] I0724 00:17:11.483750 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8948597Z [cluster1] E0724 00:17:11.684749 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8951681Z [cluster1] I0724 00:17:11.692304 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8953405Z [cluster1] I0724 00:17:11.692463 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8954944Z [cluster1] I0724 00:17:11.692475 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8956984Z [cluster1] I0724 00:17:11.692887 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.8958698Z [cluster1] I0724 00:17:11.693000 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.8972346Z [cluster1] I0724 00:17:11.693009 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.8975283Z [cluster1] I0724 00:17:11.758175 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8978623Z [cluster1] I0724 00:17:11.830568 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8981978Z [cluster1] I0724 00:17:11.856898 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8985376Z [cluster1] I0724 00:17:11.893218 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.8988711Z [cluster1] I0724 00:17:12.496142 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8992209Z [cluster1] I0724 00:17:12.690226 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.8995547Z [cluster1] I0724 00:17:12.757898 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.8998909Z [cluster1] I0724 00:17:12.883291 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9002029Z [cluster1] I0724 00:17:12.886430 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9005426Z [cluster1] I0724 00:17:12.984265 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9009371Z [cluster1] I0724 00:17:13.062795 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9013212Z [cluster1] E0724 00:17:13.392221 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.9017089Z [cluster1] I0724 00:17:13.672860 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9020856Z [cluster1] I0724 00:17:13.705004 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9024875Z [cluster1] I0724 00:17:13.742204 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9028684Z [cluster1] I0724 00:17:14.346811 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9031959Z [cluster1] I0724 00:17:14.349702 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9036631Z [cluster1] I0724 00:17:14.349757 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.9082720Z [cluster1] I0724 00:17:16.217875 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9084536Z [cluster1] I0724 00:17:16.217928 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9085995Z [cluster1] I0724 00:17:16.217940 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9088844Z [cluster1] I0724 00:17:16.236985 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9092211Z [cluster1] I0724 00:17:16.250283 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9095777Z [cluster1] I0724 00:17:16.852303 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9099288Z [cluster1] I0724 00:17:16.858755 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9102132Z [cluster1] I0724 00:17:16.889557 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9103950Z [cluster1] I0724 00:17:16.889657 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9105262Z [cluster1] I0724 00:17:16.889674 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9107415Z [cluster1] I0724 00:17:16.921616 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9109141Z [cluster1] I0724 00:17:16.921662 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9110554Z [cluster1] I0724 00:17:16.921673 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9113109Z [cluster1] I0724 00:17:16.928286 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9116522Z [cluster1] I0724 00:17:16.950032 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9119999Z [cluster1] I0724 00:17:16.954192 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9123659Z [cluster1] I0724 00:17:16.981256 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9126773Z [cluster1] I0724 00:17:17.425765 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9130300Z [cluster1] I0724 00:17:17.468988 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9134275Z [cluster1] I0724 00:17:17.504761 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9138135Z [cluster1] I0724 00:17:17.559053 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9141451Z [cluster1] I0724 00:17:17.564819 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9144969Z [cluster1] I0724 00:17:17.591914 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9148224Z [cluster1] I0724 00:17:17.653761 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9151743Z [cluster1] I0724 00:17:18.106299 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9155487Z [cluster1] I0724 00:17:18.111368 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9159512Z [cluster1] I0724 00:17:18.115289 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9163290Z [cluster1] I0724 00:17:18.717410 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9166558Z [cluster1] I0724 00:17:18.719822 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9171228Z [cluster1] I0724 00:17:18.719863 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.9176513Z [cluster1] I0724 00:17:18.724240 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9180033Z [cluster1] I0724 00:17:18.728736 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9183997Z [cluster1] I0724 00:17:18.732458 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9187772Z [cluster1] I0724 00:17:19.352997 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9191629Z [cluster1] I0724 00:17:19.358981 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9195640Z [cluster1] I0724 00:17:19.363496 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9199427Z [cluster1] I0724 00:17:19.965301 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9202745Z [cluster1] I0724 00:17:19.971127 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9207300Z [cluster1] I0724 00:17:19.971174 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.138.170\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:40.9211039Z [cluster1] I0724 00:17:21.251569 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9212831Z [cluster1] I0724 00:17:21.251635 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9214260Z [cluster1] I0724 00:17:21.251645 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9216987Z [cluster1] I0724 00:17:21.262074 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9220344Z [cluster1] I0724 00:17:21.266092 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9223696Z [cluster1] I0724 00:17:21.867646 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9226961Z [cluster1] I0724 00:17:21.878496 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9229765Z [cluster1] I0724 00:17:21.887876 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9231554Z [cluster1] I0724 00:17:21.888062 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9232980Z [cluster1] I0724 00:17:21.888143 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9234992Z [cluster1] I0724 00:17:21.896752 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9237148Z [cluster1] I0724 00:17:21.896800 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9238660Z [cluster1] I0724 00:17:21.896812 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9241984Z [cluster1] I0724 00:17:21.899709 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9245414Z [cluster1] I0724 00:17:21.907622 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9248933Z [cluster1] I0724 00:17:21.908951 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9253892Z [cluster1] I0724 00:17:21.913171 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9257596Z [cluster1] I0724 00:17:22.510452 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9260851Z [cluster1] I0724 00:17:22.515002 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9264146Z [cluster1] I0724 00:17:22.521959 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9267481Z [cluster1] I0724 00:17:22.528619 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9270275Z [cluster1] I0724 00:17:26.331937 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9271999Z [cluster1] I0724 00:17:26.331986 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9273414Z [cluster1] I0724 00:17:26.331997 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9276051Z [cluster1] I0724 00:17:26.341623 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9279397Z [cluster1] I0724 00:17:26.346788 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9282706Z [cluster1] I0724 00:17:26.948475 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9285979Z [cluster1] I0724 00:17:26.954090 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9288771Z [cluster1] I0724 00:17:26.961908 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9290496Z [cluster1] I0724 00:17:26.961960 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9291911Z [cluster1] I0724 00:17:26.962076 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9294618Z [cluster1] I0724 00:17:26.963663 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9296342Z [cluster1] I0724 00:17:26.963705 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9297770Z [cluster1] I0724 00:17:26.963716 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9300471Z [cluster1] I0724 00:17:26.975303 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9305227Z [cluster1] I0724 00:17:26.977869 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9308682Z [cluster1] I0724 00:17:26.979701 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9312102Z [cluster1] I0724 00:17:27.002062 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9315428Z [cluster1] I0724 00:17:27.581989 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9318689Z [cluster1] I0724 00:17:27.590051 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9322131Z [cluster1] I0724 00:17:27.604177 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9325414Z [cluster1] I0724 00:17:27.610959 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9328190Z [cluster1] I0724 00:17:31.347614 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9329936Z [cluster1] I0724 00:17:31.347675 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9331374Z [cluster1] I0724 00:17:31.347685 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9333912Z [cluster1] I0724 00:17:31.360274 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9337546Z [cluster1] I0724 00:17:31.373117 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9340876Z [cluster1] I0724 00:17:31.978023 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9344258Z [cluster1] I0724 00:17:31.991070 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9347042Z [cluster1] I0724 00:17:32.003102 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9348752Z [cluster1] I0724 00:17:32.003280 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9350181Z [cluster1] I0724 00:17:32.003301 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9352198Z [cluster1] I0724 00:17:32.012634 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9353912Z [cluster1] I0724 00:17:32.012790 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9355322Z [cluster1] I0724 00:17:32.012811 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9360755Z [cluster1] I0724 00:17:32.017856 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9364109Z [cluster1] I0724 00:17:32.021951 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9367738Z [cluster1] I0724 00:17:32.026462 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9371068Z [cluster1] I0724 00:17:32.038987 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9375428Z [cluster1] I0724 00:17:32.623384 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9378822Z [cluster1] I0724 00:17:32.632159 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9382138Z [cluster1] I0724 00:17:32.645314 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9385437Z [cluster1] I0724 00:17:32.651988 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9388233Z [cluster1] I0724 00:17:36.373701 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9389937Z [cluster1] I0724 00:17:36.373767 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9391508Z [cluster1] I0724 00:17:36.373779 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9394086Z [cluster1] I0724 00:17:36.382232 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9397411Z [cluster1] I0724 00:17:36.387346 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9400760Z [cluster1] I0724 00:17:36.988902 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9404112Z [cluster1] I0724 00:17:36.995871 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9406909Z [cluster1] I0724 00:17:37.014162 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9408692Z [cluster1] I0724 00:17:37.014400 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9410119Z [cluster1] I0724 00:17:37.014491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9454589Z [cluster1] I0724 00:17:37.014348 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9456353Z [cluster1] I0724 00:17:37.016030 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9457789Z [cluster1] I0724 00:17:37.016103 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-24T00:17:40.9460367Z [cluster1] I0724 00:17:37.025070 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9463833Z [cluster1] I0724 00:17:37.031051 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9467173Z [cluster1] I0724 00:17:37.053223 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9470518Z [cluster1] I0724 00:17:37.059010 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9473946Z [cluster1] I0724 00:17:37.632914 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9477503Z [cluster1] I0724 00:17:37.640031 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9480832Z [cluster1] I0724 00:17:37.660378 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9484151Z [cluster1] I0724 00:17:37.667179 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSe2021-07-24T00:16:26Z"
2021-07-24T00:17:40.9485700Z [cluster2] }
2021-07-24T00:17:40.9486123Z [cluster2] }
2021-07-24T00:17:40.9486556Z [cluster2] }
2021-07-24T00:17:40.9486967Z [cluster2] ],
2021-07-24T00:17:40.9487435Z [cluster2] "hostIP": "172.18.0.7",
2021-07-24T00:17:40.9487951Z [cluster2] "phase": "Running",
2021-07-24T00:17:40.9488478Z [cluster2] "podIP": "10.2.128.5",
2021-07-24T00:17:40.9488968Z [cluster2] "podIPs": [
2021-07-24T00:17:40.9489430Z [cluster2] {
2021-07-24T00:17:40.9489872Z [cluster2] "ip": "10.2.128.5"
2021-07-24T00:17:40.9490322Z [cluster2] }
2021-07-24T00:17:40.9490872Z [cluster2] ],
2021-07-24T00:17:40.9491381Z [cluster2] "qosClass": "BestEffort",
2021-07-24T00:17:40.9492181Z [cluster2] "startTime": "2021-07-24T00:16:25Z"
2021-07-24T00:17:40.9492662Z [cluster2] }
2021-07-24T00:17:40.9493071Z [cluster2] }
2021-07-24T00:17:40.9521684Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.9523676Z [submariner-operator]$ [cluster2] grep Running
2021-07-24T00:17:40.9525530Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.9528255Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-24T00:17:40.9529908Z [cluster2] Running
2021-07-24T00:17:40.9531435Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator
2021-07-24T00:17:40.9533715Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator
2021-07-24T00:17:40.9536263Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-tgbwc --namespace=submariner-operator
2021-07-24T00:17:40.9537776Z [cluster2] I0724 00:16:27.131345 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-24T00:17:40.9538509Z [cluster2] I0724 00:16:27.131394 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-24T00:17:40.9539518Z [cluster2] I0724 00:16:27.131402 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-24T00:17:40.9540672Z [cluster2] I0724 00:16:27.131409 1 main.go:80] cmd "msg"="Submariner operator version: devel-43b9829"
2021-07-24T00:17:40.9541587Z [cluster2] I0724 00:16:27.131729 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-24T00:17:40.9543141Z [cluster2] I0724 00:16:27.924268 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-mk5n9"
2021-07-24T00:17:40.9544397Z [cluster2] I0724 00:16:28.135760 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-24T00:17:40.9545384Z [cluster2] I0724 00:16:29.280541 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-24T00:17:40.9546228Z [cluster2] I0724 00:16:31.662570 1 leader.go:149] leader "msg"="Became the leader."
2021-07-24T00:17:40.9547566Z [cluster2] I0724 00:16:32.266297 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-24T00:17:40.9548646Z [cluster2] I0724 00:16:32.266698 1 main.go:129] cmd "msg"="Registering Components."
2021-07-24T00:17:40.9549492Z [cluster2] I0724 00:16:32.266937 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-24T00:17:40.9550601Z [cluster2] I0724 00:16:36.043315 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9552517Z [cluster2] I0724 00:16:36.043346 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9553760Z [cluster2] I0724 00:16:36.043590 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-24T00:17:40.9555021Z [cluster2] I0724 00:16:36.043905 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-24T00:17:40.9558488Z [cluster2] I0724 00:16:36.044308 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-24T00:17:40.9562449Z [cluster2] I0724 00:16:36.044541 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-24T00:17:40.9568596Z [cluster2] I0724 00:16:36.044764 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-24T00:17:40.9577970Z [cluster2] I0724 00:16:36.044998 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-24T00:17:40.9584796Z [cluster2] I0724 00:16:36.045238 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-24T00:17:40.9589042Z [cluster2] I0724 00:16:36.148190 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-24T00:17:40.9591910Z [cluster2] I0724 00:16:36.148783 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-24T00:17:40.9595554Z [cluster2] I0724 00:16:36.149091 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-24T00:17:40.9599149Z [cluster2] I0724 00:16:36.149310 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-24T00:17:40.9602470Z [cluster2] I0724 00:16:36.149429 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-24T00:17:40.9605506Z [cluster2] I0724 00:16:36.250521 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-24T00:17:40.9607637Z [cluster2] I0724 00:16:36.250646 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-24T00:17:40.9609757Z [cluster2] I0724 00:16:36.250683 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-24T00:17:40.9612128Z [cluster2] I0724 00:16:36.251664 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-24T00:17:40.9629662Z [cluster2] I0724 00:16:36.251792 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-24T00:17:40.9633000Z [cluster2] I0724 00:16:36.252314 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-24T00:17:40.9635083Z [cluster2] I0724 00:16:36.352272 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-24T00:17:40.9636996Z [cluster2] I0724 00:16:36.352375 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-24T00:17:40.9639277Z [cluster2] I0724 00:16:36.352656 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9641769Z [cluster2] I0724 00:16:36.352892 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-24T00:17:40.9644077Z [cluster2] I0724 00:16:36.353242 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9646373Z [cluster2] I0724 00:16:38.466436 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9648663Z [cluster2] I0724 00:16:38.553923 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9650980Z [cluster2] I0724 00:16:38.626267 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9653269Z [cluster2] I0724 00:16:38.626320 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9655697Z [cluster2] I0724 00:16:38.876585 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9657969Z [cluster2] I0724 00:16:38.877114 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9659735Z [cluster2] I0724 00:16:38.924579 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-24T00:17:40.9661544Z [cluster2] I0724 00:16:38.924618 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-24T00:17:40.9663042Z [cluster2] I0724 00:16:38.924631 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9664477Z [cluster2] I0724 00:16:38.924641 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9665875Z [cluster2] I0724 00:16:38.935467 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-24T00:17:40.9667667Z [cluster2] I0724 00:16:38.935495 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-24T00:17:40.9669166Z [cluster2] I0724 00:16:38.935507 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9670588Z [cluster2] I0724 00:16:38.935516 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9673108Z [cluster2] I0724 00:16:38.943719 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9676785Z [cluster2] E0724 00:16:38.943796 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-24T00:17:40.9679886Z [cluster2] I0724 00:16:38.943906 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9681671Z [cluster2] I0724 00:16:38.943941 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9683091Z [cluster2] I0724 00:16:38.943951 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9686303Z [cluster2] E0724 00:16:38.952942 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-24T00:17:40.9690144Z [cluster2] I0724 00:16:38.954293 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9692900Z [cluster2] I0724 00:16:38.958500 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9718805Z [cluster2] I0724 00:16:38.958546 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9720315Z [cluster2] I0724 00:16:38.958556 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9723211Z [cluster2] I0724 00:16:38.972207 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9726560Z [cluster2] I0724 00:16:39.000616 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9729939Z [cluster2] I0724 00:16:39.189337 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9733275Z [cluster2] I0724 00:16:39.602185 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9736731Z [cluster2] I0724 00:16:39.609272 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9739794Z [cluster2] I0724 00:16:39.617624 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9742663Z [cluster2] I0724 00:16:39.620510 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9745713Z [cluster2] I0724 00:16:39.622257 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-24T00:17:40.9749435Z [cluster2] I0724 00:16:39.681829 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9754252Z [cluster2] E0724 00:16:39.684357 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-24T00:17:40.9758348Z [cluster2] I0724 00:16:39.689758 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9762480Z [cluster2] E0724 00:16:39.769836 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-24T00:17:40.9766428Z [cluster2] I0724 00:16:39.770086 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9769908Z [cluster2] I0724 00:16:39.774144 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9773643Z [cluster2] I0724 00:16:39.834749 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9776537Z [cluster2] I0724 00:16:39.863307 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9778408Z [cluster2] I0724 00:16:39.863411 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9779926Z [cluster2] I0724 00:16:39.863441 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9782523Z [cluster2] I0724 00:16:39.921913 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9786237Z [cluster2] I0724 00:16:39.929940 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9790255Z [cluster2] I0724 00:16:39.952991 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9793972Z [cluster2] I0724 00:16:39.962721 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9797498Z [cluster2] I0724 00:16:40.004264 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9801387Z [cluster2] E0724 00:16:40.014711 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9804601Z [cluster2] I0724 00:16:40.015520 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9806435Z [cluster2] I0724 00:16:40.015615 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9807947Z [cluster2] I0724 00:16:40.015673 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9825136Z [cluster2] I0724 00:16:40.040796 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9829126Z [cluster2] I0724 00:16:40.053835 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9832880Z [cluster2] I0724 00:16:40.081037 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9836529Z [cluster2] I0724 00:16:40.543919 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9857027Z [cluster2] I0724 00:16:40.619340 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9860378Z [cluster2] I0724 00:16:40.635026 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9882381Z [cluster2] I0724 00:16:40.666381 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9886631Z [cluster2] E0724 00:16:40.688519 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-24T00:17:40.9891893Z [cluster2] E0724 00:16:40.688720 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-24T00:17:40.9896014Z [cluster2] I0724 00:16:40.688861 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9899428Z [cluster2] I0724 00:16:40.693764 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-24T00:17:40.9902510Z [cluster2] I0724 00:16:40.705434 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9904226Z [cluster2] I0724 00:16:40.705536 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9905665Z [cluster2] I0724 00:16:40.705563 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9908209Z [cluster2] I0724 00:16:40.714790 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9911917Z [cluster2] I0724 00:16:40.723141 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9915812Z [cluster2] I0724 00:16:40.858581 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9928599Z [cluster2] I0724 00:16:40.949537 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9932271Z [cluster2] I0724 00:16:40.950166 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9936277Z [cluster2] E0724 00:16:41.086619 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9944025Z [cluster2] I0724 00:16:41.086663 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:40.9945763Z [cluster2] I0724 00:16:41.086710 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:40.9947209Z [cluster2] I0724 00:16:41.086720 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:40.9950302Z [cluster2] I0724 00:16:41.087312 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9954381Z [cluster2] I0724 00:16:41.087946 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9957928Z [cluster2] I0724 00:16:41.122031 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9961714Z [cluster2] I0724 00:16:41.344150 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9965392Z [cluster2] I0724 00:16:41.735876 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9969016Z [cluster2] I0724 00:16:41.758505 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9972424Z [cluster2] I0724 00:16:41.768709 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9976732Z [cluster2] I0724 00:16:41.810099 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:40.9980260Z [cluster2] I0724 00:16:41.841193 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9983994Z [cluster2] I0724 00:16:41.951966 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:40.9988039Z [cluster2] I0724 00:16:42.012378 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:40.9991816Z [cluster2] I0724 00:16:42.354964 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:40.9996938Z [cluster2] I0724 00:16:42.359019 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0002127Z [cluster2] I0724 00:16:42.359054 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0019998Z [cluster2] I0724 00:16:42.385100 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0023334Z [cluster2] I0724 00:16:42.403761 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0027031Z [cluster2] I0724 00:16:42.631093 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0030307Z [cluster2] I0724 00:16:42.637884 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0034845Z [cluster2] I0724 00:16:42.637924 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0069742Z [cluster2] I0724 00:16:42.666174 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0073394Z [cluster2] I0724 00:16:42.687737 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0077426Z [cluster2] I0724 00:16:42.707133 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0081202Z [cluster2] I0724 00:16:43.310676 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0084953Z [cluster2] I0724 00:16:43.317206 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0088996Z [cluster2] I0724 00:16:43.326328 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0093223Z [cluster2] I0724 00:16:43.959254 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0104450Z [cluster2] I0724 00:16:44.052083 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0109049Z [cluster2] I0724 00:16:44.052139 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0113070Z [cluster2] I0724 00:16:44.412383 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0116463Z [cluster2] I0724 00:16:44.447381 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0120604Z [cluster2] I0724 00:16:44.474070 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0124355Z [cluster2] I0724 00:16:45.084088 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0128106Z [cluster2] I0724 00:16:45.121587 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0159421Z [cluster2] I0724 00:16:45.155886 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0163518Z [cluster2] I0724 00:16:45.780853 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0166816Z [cluster2] I0724 00:16:45.788290 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0171534Z [cluster2] I0724 00:16:45.788346 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0175550Z [cluster2] I0724 00:17:01.762947 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0177279Z [cluster2] I0724 00:17:01.762993 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0178725Z [cluster2] I0724 00:17:01.763004 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0181286Z [cluster2] I0724 00:17:01.816655 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0184644Z [cluster2] I0724 00:17:01.831369 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0187971Z [cluster2] I0724 00:17:02.437234 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0191371Z [cluster2] I0724 00:17:02.460290 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0194171Z [cluster2] I0724 00:17:02.550725 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0196465Z [cluster2] I0724 00:17:02.550752 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0198180Z [cluster2] I0724 00:17:02.550767 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0199592Z [cluster2] I0724 00:17:02.550790 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0201022Z [cluster2] I0724 00:17:02.550791 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0202480Z [cluster2] I0724 00:17:02.550806 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0205036Z [cluster2] I0724 00:17:02.637485 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0208323Z [cluster2] I0724 00:17:02.637873 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0211742Z [cluster2] I0724 00:17:02.649614 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0215250Z [cluster2] I0724 00:17:02.653674 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0218554Z [cluster2] I0724 00:17:03.259025 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0221795Z [cluster2] I0724 00:17:03.276200 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0225089Z [cluster2] I0724 00:17:03.293859 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0228450Z [cluster2] I0724 00:17:03.342158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0231315Z [cluster2] I0724 00:17:07.965278 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0233044Z [cluster2] I0724 00:17:07.965324 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0234477Z [cluster2] I0724 00:17:07.965335 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0266230Z [cluster2] I0724 00:17:08.104277 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0269897Z [cluster2] I0724 00:17:08.129679 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0292656Z [cluster2] I0724 00:17:08.762059 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0296123Z [cluster2] I0724 00:17:09.434211 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0299327Z [cluster2] I0724 00:17:09.505977 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0302017Z [cluster2] I0724 00:17:09.701958 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0303922Z [cluster2] I0724 00:17:09.702002 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0305417Z [cluster2] I0724 00:17:09.702097 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0307324Z [cluster2] I0724 00:17:09.724193 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0309122Z [cluster2] I0724 00:17:09.740067 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0310560Z [cluster2] I0724 00:17:09.740101 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0313434Z [cluster2] I0724 00:17:09.899059 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0317067Z [cluster2] I0724 00:17:09.916164 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0320354Z [cluster2] I0724 00:17:09.949085 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0323874Z [cluster2] I0724 00:17:09.991662 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0327590Z [cluster2] I0724 00:17:09.992026 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0331288Z [cluster2] I0724 00:17:10.085197 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0334797Z [cluster2] I0724 00:17:10.602036 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0338191Z [cluster2] I0724 00:17:10.605069 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0341920Z [cluster2] I0724 00:17:10.665340 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0345556Z [cluster2] I0724 00:17:10.670468 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0349356Z [cluster2] I0724 00:17:10.716012 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0352493Z [cluster2] I0724 00:17:10.729114 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0354207Z [cluster2] I0724 00:17:10.729162 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0355645Z [cluster2] I0724 00:17:10.729271 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0390731Z [cluster2] I0724 00:17:10.806049 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0394337Z [cluster2] I0724 00:17:10.904162 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0397807Z [cluster2] I0724 00:17:10.905183 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0401850Z [cluster2] E0724 00:17:10.930540 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0404973Z [cluster2] I0724 00:17:10.930594 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0406701Z [cluster2] I0724 00:17:10.930643 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0408392Z [cluster2] I0724 00:17:10.930653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0411032Z [cluster2] I0724 00:17:10.981209 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0445961Z [cluster2] I0724 00:17:10.981657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0449637Z [cluster2] I0724 00:17:11.158052 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0453244Z [cluster2] I0724 00:17:11.320228 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0457745Z [cluster2] I0724 00:17:11.329972 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0462344Z [cluster2] I0724 00:17:11.330072 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0466360Z [cluster2] I0724 00:17:11.340697 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0469759Z [cluster2] I0724 00:17:11.480326 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0473726Z [cluster2] I0724 00:17:11.496390 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0477439Z [cluster2] I0724 00:17:11.590466 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0480738Z [cluster2] I0724 00:17:11.603811 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0483516Z [cluster2] I0724 00:17:11.621555 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0485239Z [cluster2] I0724 00:17:11.621729 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0486672Z [cluster2] I0724 00:17:11.621867 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0489232Z [cluster2] I0724 00:17:11.641633 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0492833Z [cluster2] I0724 00:17:11.650593 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0496311Z [cluster2] I0724 00:17:11.762845 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0527163Z [cluster2] I0724 00:17:11.780236 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0531025Z [cluster2] I0724 00:17:12.103111 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0535087Z [cluster2] I0724 00:17:12.119782 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-24T00:17:41.0539155Z [cluster2] I0724 00:17:12.131069 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0542831Z [cluster2] I0724 00:17:12.258754 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0546119Z [cluster2] I0724 00:17:12.275437 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0549903Z [cluster2] I0724 00:17:12.734194 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0566273Z [cluster2] I0724 00:17:12.738677 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0571065Z [cluster2] I0724 00:17:12.738833 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.176.226\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-24T00:17:41.0574993Z [cluster2] I0724 00:17:15.548352 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0576845Z [cluster2] I0724 00:17:15.548697 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0578272Z [cluster2] I0724 00:17:15.548762 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0580979Z [cluster2] I0724 00:17:15.714692 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0584508Z [cluster2] I0724 00:17:15.723980 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0587976Z [cluster2] I0724 00:17:16.328431 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0591259Z [cluster2] I0724 00:17:16.341032 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0594064Z [cluster2] I0724 00:17:16.382355 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0595798Z [cluster2] I0724 00:17:16.382564 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0597346Z [cluster2] I0724 00:17:16.382643 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0599382Z [cluster2] I0724 00:17:16.393844 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0601098Z [cluster2] I0724 00:17:16.394064 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0604661Z [cluster2] I0724 00:17:16.394143 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0607344Z [cluster2] I0724 00:17:16.407158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0610641Z [cluster2] I0724 00:17:16.422884 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0613987Z [cluster2] I0724 00:17:16.430351 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0617648Z [cluster2] I0724 00:17:16.460484 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0620977Z [cluster2] I0724 00:17:17.032054 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0624285Z [cluster2] I0724 00:17:17.039908 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0627610Z [cluster2] I0724 00:17:17.069563 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0631039Z [cluster2] I0724 00:17:17.128087 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0633842Z [cluster2] I0724 00:17:20.731624 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0635565Z [cluster2] I0724 00:17:20.731690 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0637012Z [cluster2] I0724 00:17:20.731707 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0639553Z [cluster2] I0724 00:17:20.761500 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0642904Z [cluster2] I0724 00:17:20.767546 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0646769Z [cluster2] I0724 00:17:21.369958 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0650178Z [cluster2] I0724 00:17:21.377385 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0652978Z [cluster2] I0724 00:17:21.390774 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0670934Z [cluster2] I0724 00:17:21.390929 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0672404Z [cluster2] I0724 00:17:21.390948 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0674631Z [cluster2] I0724 00:17:21.394912 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-24T00:17:41.0676361Z [cluster2] I0724 00:17:21.395083 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-24T00:17:41.0677818Z [cluster2] I0724 00:17:21.395104 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-24T00:17:41.0680383Z [cluster2] I0724 00:17:21.408473 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0683756Z [cluster2] I0724 00:17:21.413124 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0687122Z [cluster2] I0724 00:17:21.434336 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0690647Z [cluster2] I0724 00:17:21.439336 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-24T00:17:41.0693978Z [cluster2] I0724 00:17:22.021425 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.0697650Z [cluster2] I0724 00:17:22.035729 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.0700969Z [cluster2] I0724 00:17:22.049326 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-24T00:17:41.8506838Z [cluster2] I0724 00:17:22.080005 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-24T00:17:41.8509172Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-24T00:17:41.8510585Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-24T00:17:41.8512028Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-24T00:17:41.8513586Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-24T00:17:41.8514865Z [submariner-operator]$ [cluster2] grep submariner
2021-07-24T00:17:41.8516329Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-24T00:17:41.8517386Z [cluster2] submariner 63s
2021-07-24T00:17:41.8518465Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-24T00:17:41.8520071Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:41.8521774Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:41.8523640Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:41.8525298Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-24T00:17:41.8526104Z [cluster2] {
2021-07-24T00:17:41.8526717Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:41.8527389Z [cluster2] "kind": "Submariner",
2021-07-24T00:17:41.8527927Z [cluster2] "metadata": {
2021-07-24T00:17:41.8528730Z [cluster2] "creationTimestamp": "2021-07-24T00:16:38Z",
2021-07-24T00:17:41.8529380Z [cluster2] "generation": 1,
2021-07-24T00:17:41.8529944Z [cluster2] "managedFields": [
2021-07-24T00:17:41.8530461Z [cluster2] {
2021-07-24T00:17:41.8531081Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:41.8531796Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:41.8532394Z [cluster2] "fieldsV1": {
2021-07-24T00:17:41.8532895Z [cluster2] "f:spec": {
2021-07-24T00:17:41.8533379Z [cluster2] ".": {},
2021-07-24T00:17:41.8533863Z [cluster2] "f:broker": {},
2021-07-24T00:17:41.8534704Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-24T00:17:41.8535660Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-24T00:17:41.8536407Z [cluster2] "f:brokerK8sCA": {},
2021-07-24T00:17:41.8537157Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-24T00:17:41.8537920Z [cluster2] "f:cableDriver": {},
2021-07-24T00:17:41.8538539Z [cluster2] "f:ceIPSecDebug": {},
2021-07-24T00:17:41.8539189Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-24T00:17:41.8539876Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-24T00:17:41.8540516Z [cluster2] "f:ceIPSecPSK": {},
2021-07-24T00:17:41.8541119Z [cluster2] "f:clusterCIDR": {},
2021-07-24T00:17:41.8541688Z [cluster2] "f:clusterID": {},
2021-07-24T00:17:41.8542269Z [cluster2] "f:colorCodes": {},
2021-07-24T00:17:41.8542967Z [cluster2] "f:connectionHealthCheck": {
2021-07-24T00:17:41.8543620Z [cluster2] ".": {},
2021-07-24T00:17:41.8544132Z [cluster2] "f:enabled": {},
2021-07-24T00:17:41.8544739Z [cluster2] "f:intervalSeconds": {},
2021-07-24T00:17:41.8545460Z [cluster2] "f:maxPacketLossCount": {}
2021-07-24T00:17:41.8546047Z [cluster2] },
2021-07-24T00:17:41.8546536Z [cluster2] "f:debug": {},
2021-07-24T00:17:41.8547066Z [cluster2] "f:namespace": {},
2021-07-24T00:17:41.8547637Z [cluster2] "f:natEnabled": {},
2021-07-24T00:17:41.8548285Z [cluster2] "f:repository": {},
2021-07-24T00:17:41.8548886Z [cluster2] "f:serviceCIDR": {},
2021-07-24T00:17:41.8549643Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-24T00:17:41.8550344Z [cluster2] "f:version": {}
2021-07-24T00:17:41.8550833Z [cluster2] }
2021-07-24T00:17:41.8551262Z [cluster2] },
2021-07-24T00:17:41.8551768Z [cluster2] "manager": "subctl",
2021-07-24T00:17:41.8552341Z [cluster2] "operation": "Update",
2021-07-24T00:17:41.8553185Z [cluster2] "time": "2021-07-24T00:16:38Z"
2021-07-24T00:17:41.8553652Z [cluster2] },
2021-07-24T00:17:41.8554087Z [cluster2] {
2021-07-24T00:17:41.8554694Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:41.8555422Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:41.8556020Z [cluster2] "fieldsV1": {
2021-07-24T00:17:41.8556526Z [cluster2] "f:status": {
2021-07-24T00:17:41.8557013Z [cluster2] ".": {},
2021-07-24T00:17:41.8557535Z [cluster2] "f:clusterCIDR": {},
2021-07-24T00:17:41.8558121Z [cluster2] "f:clusterID": {},
2021-07-24T00:17:41.8558690Z [cluster2] "f:colorCodes": {},
2021-07-24T00:17:41.8559313Z [cluster2] "f:deploymentInfo": {},
2021-07-24T00:17:41.8586944Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-24T00:17:41.8593929Z [cluster2] ".": {},
2021-07-24T00:17:41.8594994Z [cluster2] "f:lastResourceVersion": {},
2021-07-24T00:17:41.8596004Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-24T00:17:41.8596944Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-24T00:17:41.8597674Z [cluster2] "f:status": {
2021-07-24T00:17:41.8598180Z [cluster2] ".": {},
2021-07-24T00:17:41.8598845Z [cluster2] "f:currentNumberScheduled": {},
2021-07-24T00:17:41.8599830Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-24T00:17:41.8600820Z [cluster2] "f:numberAvailable": {},
2021-07-24T00:17:41.8601563Z [cluster2] "f:numberMisscheduled": {},
2021-07-24T00:17:41.8602239Z [cluster2] "f:numberReady": {},
2021-07-24T00:17:41.8602934Z [cluster2] "f:observedGeneration": {},
2021-07-24T00:17:41.8603763Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-24T00:17:41.8604497Z [cluster2] }
2021-07-24T00:17:41.8604959Z [cluster2] },
2021-07-24T00:17:41.8605461Z [cluster2] "f:gateways": {},
2021-07-24T00:17:41.8606296Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-24T00:17:41.8606987Z [cluster2] ".": {},
2021-07-24T00:17:41.8607711Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-24T00:17:41.8608401Z [cluster2] },
2021-07-24T00:17:41.8609018Z [cluster2] "f:loadBalancerStatus": {},
2021-07-24T00:17:41.8609684Z [cluster2] "f:natEnabled": {},
2021-07-24T00:17:41.8610286Z [cluster2] "f:networkPlugin": {},
2021-07-24T00:17:41.8611087Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-24T00:17:41.8611787Z [cluster2] ".": {},
2021-07-24T00:17:41.8612494Z [cluster2] "f:lastResourceVersion": {},
2021-07-24T00:17:41.8613358Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-24T00:17:41.8614388Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-24T00:17:41.8615295Z [cluster2] "f:status": {
2021-07-24T00:17:41.8615787Z [cluster2] ".": {},
2021-07-24T00:17:41.8616471Z [cluster2] "f:currentNumberScheduled": {},
2021-07-24T00:17:41.8617344Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-24T00:17:41.8618138Z [cluster2] "f:numberAvailable": {},
2021-07-24T00:17:41.8618853Z [cluster2] "f:numberMisscheduled": {},
2021-07-24T00:17:41.8619539Z [cluster2] "f:numberReady": {},
2021-07-24T00:17:41.8620225Z [cluster2] "f:observedGeneration": {},
2021-07-24T00:17:41.8621037Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-24T00:17:41.8621699Z [cluster2] }
2021-07-24T00:17:41.8622142Z [cluster2] },
2021-07-24T00:17:41.8622678Z [cluster2] "f:serviceCIDR": {}
2021-07-24T00:17:41.8623276Z [cluster2] }
2021-07-24T00:17:41.8623716Z [cluster2] },
2021-07-24T00:17:41.8624876Z [cluster2] "manager": "submariner-operator",
2021-07-24T00:17:41.8625600Z [cluster2] "operation": "Update",
2021-07-24T00:17:41.8626349Z [cluster2] "time": "2021-07-24T00:17:10Z"
2021-07-24T00:17:41.8626835Z [cluster2] }
2021-07-24T00:17:41.8627282Z [cluster2] ],
2021-07-24T00:17:41.8627785Z [cluster2] "name": "submariner",
2021-07-24T00:17:41.8628664Z [cluster2] "namespace": "submariner-operator",
2021-07-24T00:17:41.8629400Z [cluster2] "resourceVersion": "2446",
2021-07-24T00:17:41.8630386Z [cluster2] "uid": "de6c7aea-3190-45d3-b85f-a7f97e64f773"
2021-07-24T00:17:41.8631055Z [cluster2] },
2021-07-24T00:17:41.8631498Z [cluster2] "spec": {
2021-07-24T00:17:41.8631969Z [cluster2] "broker": "k8s",
2021-07-24T00:17:41.8632601Z [cluster2] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-24T00:17:41.8772562Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-24T00:17:41.9382332Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-24T00:17:41.9966082Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-24T00:17:41.9969843Z [cluster2] "cableDriver": "libreswan",
2021-07-24T00:17:41.9970676Z [cluster2] "ceIPSecDebug": false,
2021-07-24T00:17:41.9971748Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-24T00:17:41.9972386Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-24T00:17:41.9974085Z [cluster2] "ceIPSecPSK": "PFVxukY6+x1XwF5kUqpZ6R7z80ejq+Bkn2pwEc7HUdGuli8KoSKWIGFj3TZKcirH",
2021-07-24T00:17:41.9975795Z [cluster2] "clusterCIDR": "",
2021-07-24T00:17:41.9976396Z [cluster2] "clusterID": "cluster2",
2021-07-24T00:17:41.9977005Z [cluster2] "colorCodes": "blue",
2021-07-24T00:17:41.9977683Z [cluster2] "connectionHealthCheck": {
2021-07-24T00:17:41.9978360Z [cluster2] "enabled": true,
2021-07-24T00:17:41.9978943Z [cluster2] "intervalSeconds": 1,
2021-07-24T00:17:41.9979632Z [cluster2] "maxPacketLossCount": 5
2021-07-24T00:17:41.9980192Z [cluster2] },
2021-07-24T00:17:41.9980669Z [cluster2] "debug": false,
2021-07-24T00:17:41.9982000Z [cluster2] "namespace": "submariner-operator",
2021-07-24T00:17:41.9982730Z [cluster2] "natEnabled": false,
2021-07-24T00:17:41.9983348Z [cluster2] "repository": "localhost:5000",
2021-07-24T00:17:41.9983968Z [cluster2] "serviceCIDR": "",
2021-07-24T00:17:41.9984710Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-24T00:17:41.9985416Z [cluster2] "version": "local"
2021-07-24T00:17:41.9985892Z [cluster2] },
2021-07-24T00:17:41.9986322Z [cluster2] "status": {
2021-07-24T00:17:41.9986862Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-24T00:17:41.9987452Z [cluster2] "clusterID": "cluster2",
2021-07-24T00:17:41.9988049Z [cluster2] "colorCodes": "blue",
2021-07-24T00:17:41.9988638Z [cluster2] "deploymentInfo": {},
2021-07-24T00:17:41.9989370Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-24T00:17:41.9990144Z [cluster2] "lastResourceVersion": "2389",
2021-07-24T00:17:41.9991001Z [cluster2] "mismatchedContainerImages": false,
2021-07-24T00:17:41.9991924Z [cluster2] "nonReadyContainerStates": [],
2021-07-24T00:17:41.9992792Z [cluster2] "status": {
2021-07-24T00:17:41.9993463Z [cluster2] "currentNumberScheduled": 1,
2021-07-24T00:17:41.9994289Z [cluster2] "desiredNumberScheduled": 1,
2021-07-24T00:17:41.9995038Z [cluster2] "numberAvailable": 1,
2021-07-24T00:17:41.9995716Z [cluster2] "numberMisscheduled": 0,
2021-07-24T00:17:41.9996520Z [cluster2] "numberReady": 1,
2021-07-24T00:17:41.9997164Z [cluster2] "observedGeneration": 1,
2021-07-24T00:17:41.9997954Z [cluster2] "updatedNumberScheduled": 1
2021-07-24T00:17:41.9998574Z [cluster2] }
2021-07-24T00:17:41.9999007Z [cluster2] },
2021-07-24T00:17:41.9999479Z [cluster2] "gateways": [
2021-07-24T00:17:41.9999933Z [cluster2] {
2021-07-24T00:17:42.0000433Z [cluster2] "connections": [
2021-07-24T00:17:42.0000924Z [cluster2] {
2021-07-24T00:17:42.0001435Z [cluster2] "endpoint": {
2021-07-24T00:17:42.0002013Z [cluster2] "backend": "libreswan",
2021-07-24T00:17:42.0002620Z [cluster2] "backend_config": {
2021-07-24T00:17:42.0003745Z [cluster2] "natt-discovery-port": "4490",
2021-07-24T00:17:42.0005026Z [cluster2] "preferred-server": "false"
2021-07-24T00:17:42.0005644Z [cluster2] },
2021-07-24T00:17:42.0006750Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-24T00:17:42.0007744Z [cluster2] "cluster_id": "cluster1",
2021-07-24T00:17:42.0009055Z [cluster2] "healthCheckIP": "10.1.1t.Namespace"="submariner-operator"
2021-07-24T00:17:42.0010172Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-24T00:17:42.0011174Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-24T00:17:42.0012591Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-24T00:17:42.0013873Z [submariner-operator]$ [cluster1] grep submariner
2021-07-24T00:17:42.0015906Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-24T00:17:42.0018172Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-24T00:17:42.0019510Z [cluster1] submariner 58s
2021-07-24T00:17:42.0020783Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-24T00:17:42.0022870Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:42.0025079Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:42.0027249Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:42.0028955Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-24T00:17:42.0029759Z [cluster1] {
2021-07-24T00:17:42.0030363Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:42.0031063Z [cluster1] "kind": "Submariner",
2021-07-24T00:17:42.0031606Z [cluster1] "metadata": {
2021-07-24T00:17:42.0032430Z [cluster1] "creationTimestamp": "2021-07-24T00:16:43Z",
2021-07-24T00:17:42.0033066Z [cluster1] "generation": 1,
2021-07-24T00:17:42.0033640Z [cluster1] "managedFields": [
2021-07-24T00:17:42.0034136Z [cluster1] {
2021-07-24T00:17:42.0034751Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:42.0035466Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:42.0036070Z [cluster1] "fieldsV1": {
2021-07-24T00:17:42.0036571Z [cluster1] "f:spec": {
2021-07-24T00:17:42.0037051Z [cluster1] ".": {},
2021-07-24T00:17:42.0037533Z [cluster1] "f:broker": {},
2021-07-24T00:17:42.0038178Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-24T00:17:42.0038998Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-24T00:17:42.0039850Z [cluster1] "f:brokerK8sCA": {},
2021-07-24T00:17:42.0040622Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-24T00:17:42.0041374Z [cluster1] "f:cableDriver": {},
2021-07-24T00:17:42.0041996Z [cluster1] "f:ceIPSecDebug": {},
2021-07-24T00:17:42.0042650Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-24T00:17:42.0043332Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-24T00:17:42.0043964Z [cluster1] "f:ceIPSecPSK": {},
2021-07-24T00:17:42.0044571Z [cluster1] "f:clusterCIDR": {},
2021-07-24T00:17:42.0045157Z [cluster1] "f:clusterID": {},
2021-07-24T00:17:42.0045724Z [cluster1] "f:colorCodes": {},
2021-07-24T00:17:42.0046430Z [cluster1] "f:connectionHealthCheck": {
2021-07-24T00:17:42.0047075Z [cluster1] ".": {},
2021-07-24T00:17:42.0047593Z [cluster1] "f:enabled": {},
2021-07-24T00:17:42.0048198Z [cluster1] "f:intervalSeconds": {},
2021-07-24T00:17:42.0048919Z [cluster1] "f:maxPacketLossCount": {}
2021-07-24T00:17:42.0049513Z [cluster1] },
2021-07-24T00:17:42.0049998Z [cluster1] "f:debug": {},
2021-07-24T00:17:42.0050546Z [cluster1] "f:namespace": {},
2021-07-24T00:17:42.0051114Z [cluster1] "f:natEnabled": {},
2021-07-24T00:17:42.0051699Z [cluster1] "f:repository": {},
2021-07-24T00:17:42.0052352Z [cluster1] "f:serviceCIDR": {},
2021-07-24T00:17:42.0053096Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-24T00:17:42.0053799Z [cluster1] "f:version": {}
2021-07-24T00:17:42.0054287Z [cluster1] }
2021-07-24T00:17:42.0054831Z [cluster1] },
2021-07-24T00:17:42.0055341Z [cluster1] "manager": "subctl",
2021-07-24T00:17:42.0055928Z [cluster1] "operation": "Update",
2021-07-24T00:17:42.0056724Z [cluster1] "time": "2021-07-24T00:16:43Z"
2021-07-24T00:17:42.0057204Z [cluster1] },
2021-07-24T00:17:42.0057620Z [cluster1] {
2021-07-24T00:17:42.0058238Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-24T00:17:42.0058951Z [cluster1] "fieldsType": "FieldsV1",
2021-07-24T00:17:42.0059550Z [cluster1] "fieldsV1": {
2021-07-24T00:17:42.0060061Z [cluster1] "f:status": {
2021-07-24T00:17:42.0060550Z [cluster1] ".": {},
2021-07-24T00:17:42.0061069Z [cluster1] "f:clusterCIDR": {},
2021-07-24T00:17:42.0061657Z [cluster1] "f:clusterID": {},
2021-07-24T00:17:42.0062232Z [cluster1] "f:colorCodes": {},
2021-07-24T00:17:42.0062845Z [cluster1] "f:deploymentInfo": {},
2021-07-24T00:17:42.0063604Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-24T00:17:42.0064251Z [cluster1] ".": {},
2021-07-24T00:17:42.0064880Z [cluster1] "f:lastResourceVersion": {},
2021-07-24T00:17:42.0065740Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-24T00:17:42.0066661Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-24T00:17:42.0067364Z [cluster1] "f:status": {
2021-07-24T00:17:42.0067875Z [cluster1] ".": {},
2021-07-24T00:17:42.0068554Z [cluster1] "f:currentNumberScheduled": {},
2021-07-24T00:17:42.0069424Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-24T00:17:42.0070210Z [cluster1] "f:numberAvailable": {},
2021-07-24T00:17:42.0071014Z [cluster1] "f:numberMisscheduled": {},
2021-07-24T00:17:42.0072099Z [cluster1] "f:numberReady": {},
2021-07-24T00:17:42.0072786Z [cluster1] "f:observedGeneration": {},
2021-07-24T00:17:42.0073608Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-24T00:17:42.0074277Z [cluster1] }
2021-07-24T00:17:42.0074719Z [cluster1] },
2021-07-24T00:17:42.0075231Z [cluster1] "f:gateways": {},
2021-07-24T00:17:42.0075960Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-24T00:17:42.0076654Z [cluster1] ".": {},
2021-07-24T00:17:42.0077353Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-24T00:17:42.0078055Z [cluster1] },
2021-07-24T00:17:42.0078648Z [cluster1] "f:loadBalancerStatus": {},
2021-07-24T00:17:42.0079317Z [cluster1] "f:natEnabled": {},
2021-07-24T00:17:42.0079919Z [cluster1] "f:networkPlugin": {},
2021-07-24T00:17:42.0080716Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-24T00:17:42.0081428Z [cluster1] ".": {},
2021-07-24T00:17:42.0082041Z [cluster1] "f:lastResourceVersion": {},
2021-07-24T00:17:42.0082913Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-24T00:17:42.0083826Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-24T00:17:42.0084633Z [cluster1] "f:status": {
2021-07-24T00:17:42.0085120Z [cluster1] ".": {},
2021-07-24T00:17:42.0085798Z [cluster1] "f:currentNumberScheduled": {},
2021-07-24T00:17:42.0086677Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-24T00:17:42.0087449Z [cluster1] "f:numberAvailable": {},
2021-07-24T00:17:42.0088176Z [cluster1] "f:numberMisscheduled": {},
2021-07-24T00:17:42.0088852Z [cluster1] "f:numberReady": {},
2021-07-24T00:17:42.0089547Z [cluster1] "f:observedGeneration": {},
2021-07-24T00:17:42.0090358Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-24T00:17:42.0091021Z [cluster1] }
2021-07-24T00:17:42.0091467Z [cluster1] },
2021-07-24T00:17:42.0091997Z [cluster1] "f:serviceCIDR": {}
2021-07-24T00:17:42.0092519Z [cluster1] }
2021-07-24T00:17:42.0092948Z [cluster1] },
2021-07-24T00:17:42.0093854Z [cluster1] "manager": "submariner-operator",
2021-07-24T00:17:42.0094742Z [cluster1] "operation": "Update",
2021-07-24T00:17:42.0095522Z [cluster1] "time": "2021-07-24T00:17:16Z"
2021-07-24T00:17:42.0095991Z [cluster1] }
2021-07-24T00:17:42.0096419Z [cluster1] ],
2021-07-24T00:17:42.0096911Z [cluster1] "name": "submariner",
2021-07-24T00:17:42.0097791Z [cluster1] "namespace": "submariner-operator",
2021-07-24T00:17:42.0098529Z [cluster1] "resourceVersion": "2719",
2021-07-24T00:17:42.0099451Z [cluster1] "uid": "c4250c18-dc3f-4375-b585-0ff29039a026"
2021-07-24T00:17:42.0100065Z [cluster1] },
2021-07-24T00:17:42.0100489Z [cluster1] "spec": {
2021-07-24T00:17:42.0100974Z [cluster1] "broker": "k8s",
2021-07-24T00:17:42.0101593Z [cluster1] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-24T00:17:42.0281105Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-24T00:17:42.0946323Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-24T00:17:42.1542395Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-24T00:17:42.1543386Z [cluster1] "cableDriver": "libreswan",
2021-07-24T00:17:42.1544064Z [cluster1] "ceIPSecDebug": false,
2021-07-24T00:17:42.1544696Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-24T00:17:42.1545626Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-24T00:17:42.1547315Z [cluster1] "ceIPSecPSK": "PFVxukY6+x1XwF5kUqpZ6R7z80ejq+Bkn2pwEc7HUdGuli8KoSKWIGFj3TZKcirH",
2021-07-24T00:17:42.1548930Z [cluster1] "clusterCIDR": "",
2021-07-24T00:17:42.1549529Z [cluster1] "clusterID": "cluster1",
2021-07-24T00:17:42.1550115Z [cluster1] "colorCodes": "blue",
2021-07-24T00:17:42.1550819Z [cluster1] "connectionHealthCheck": {
2021-07-24T00:17:42.1551481Z [cluster1] "enabled": true,
2021-07-24T00:17:42.1552088Z [cluster1] "intervalSeconds": 1,
2021-07-24T00:17:42.1552765Z [cluster1] "maxPacketLossCount": 5
2021-07-24T00:17:42.1553336Z [cluster1] },
2021-07-24T00:17:42.1553814Z [cluster1] "debug": false,
2021-07-24T00:17:42.1554700Z [cluster1] "namespace": "submariner-operator",
2021-07-24T00:17:42.1555417Z [cluster1] "natEnabled": false,
2021-07-24T00:17:42.1556027Z [cluster1] "repository": "localhost:5000",
2021-07-24T00:17:42.1556646Z [cluster1] "serviceCIDR": "",
2021-07-24T00:17:42.1557367Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-24T00:17:42.1558088Z [cluster1] "version": "local"
2021-07-24T00:17:42.1558557Z [cluster1] },
2021-07-24T00:17:42.1559006Z [cluster1] "status": {
2021-07-24T00:17:42.1559529Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-24T00:17:42.1560136Z [cluster1] "clusterID": "cluster1",
2021-07-24T00:17:42.1560722Z [cluster1] "colorCodes": "blue",
2021-07-24T00:17:42.1561331Z [cluster1] "deploymentInfo": {},
2021-07-24T00:17:42.1562068Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-24T00:17:42.1562850Z [cluster1] "lastResourceVersion": "2511",
2021-07-24T00:17:42.1563716Z [cluster1] "mismatchedContainerImages": false,
2021-07-24T00:17:42.1564613Z [cluster1] "nonReadyContainerStates": [],
2021-07-24T00:17:42.1565296Z [cluster1] "status": {
2021-07-24T00:17:42.1565958Z [cluster1] "currentNumberScheduled": 1,
2021-07-24T00:17:42.1566805Z [cluster1] "desiredNumberScheduled": 1,
2021-07-24T00:17:42.1567547Z [cluster1] "numberAvailable": 1,
2021-07-24T00:17:42.1568243Z [cluster1] "numberMisscheduled": 0,
2021-07-24T00:17:42.1568896Z [cluster1] "numberReady": 1,
2021-07-24T00:17:42.1569663Z [cluster1] "observedGeneration": 1,
2021-07-24T00:17:42.1570460Z [cluster1] "updatedNumberScheduled": 1
2021-07-24T00:17:42.1571084Z [cluster1] }
2021-07-24T00:17:42.1571511Z [cluster1] },
2021-07-24T00:17:42.1571971Z [cluster1] "gateways": [
2021-07-24T00:17:42.1572444Z [cluster1] {
2021-07-24T00:17:42.1572935Z [cluster1] "connections": [
2021-07-24T00:17:42.1573438Z [cluster1] {
2021-07-24T00:17:42.1573923Z [cluster1] "endpoint": {
2021-07-24T00:17:42.1576052Z [cluster1] "backend": "libreswan",
2021-07-24T00:17:42.1576694Z [cluster1] "backend_config": {
2021-07-24T00:17:42.1577686Z [cluster1] "natt-discovery-port": "4490",
2021-07-24T00:17:42.1578794Z [cluster1] "preferred-server": "false"
2021-07-24T00:17:42.1579398Z [cluster1] },
2021-07-24T00:17:42.1580533Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-6",
2021-07-24T00:17:42.1581520Z [cluster1] "cluster_id": "cluster2",
2021-07-24T00:17:42.1582172Z [cluster1] "healthCheckIP": "10.2.0.1",
2021-07-24T00:17:42.1583054Z [cluster1] "hostname": "cluster2-worker",
2021-07-24T00:17:42.1583743Z [cluster1] "nat_enabled": false,
2021-07-24T00:17:42.1584505Z [cluster1] "private_ip": "172.18.0.6",28.0",
2021-07-24T00:17:42.1585500Z [cluster2] "hostname": "cluster1-worker",
2021-07-24T00:17:42.1586187Z [cluster2] "nat_enabled": false,
2021-07-24T00:17:42.1586794Z [cluster2] "private_ip": "172.18.0.5",
2021-07-24T00:17:42.1587352Z [cluster2] "public_ip": "52.190.62.4",
2021-07-24T00:17:42.1587906Z [cluster2] "subnets": [
2021-07-24T00:17:42.1588411Z [cluster2] "100.1.0.0/16",
2021-07-24T00:17:42.1588907Z [cluster2] "10.1.0.0/16"
2021-07-24T00:17:42.1589365Z [cluster2] ]
2021-07-24T00:17:42.1589822Z [cluster2] },
2021-07-24T00:17:42.1590328Z [cluster2] "latencyRTT": {
2021-07-24T00:17:42.1590895Z [cluster2] "average": "0s",
2021-07-24T00:17:42.1591430Z [cluster2] "last": "0s",
2021-07-24T00:17:42.1591917Z [cluster2] "max": "0s",
2021-07-24T00:17:42.1592416Z [cluster2] "min": "0s",
2021-07-24T00:17:42.1592922Z [cluster2] "stdDev": "0s"
2021-07-24T00:17:42.1593412Z [cluster2] },
2021-07-24T00:17:42.1593911Z [cluster2] "status": "error",
2021-07-24T00:17:42.1594753Z [cluster2] "statusMessage": "Failed to successfully ping the remote endpoint IP \"10.1.128.0\"",
2021-07-24T00:17:42.1595565Z [cluster2] "usingIP": "172.18.0.5"
2021-07-24T00:17:42.1596060Z [cluster2] }
2021-07-24T00:17:42.1596503Z [cluster2] ],
2021-07-24T00:17:42.1597003Z [cluster2] "haStatus": "active",
2021-07-24T00:17:42.1597598Z [cluster2] "localEndpoint": {
2021-07-24T00:17:42.1598203Z [cluster2] "backend": "libreswan",
2021-07-24T00:17:42.1598805Z [cluster2] "backend_config": {
2021-07-24T00:17:42.1599649Z [cluster2] "natt-discovery-port": "4490",
2021-07-24T00:17:42.1600586Z [cluster2] "preferred-server": "false"
2021-07-24T00:17:42.1601167Z [cluster2] },
2021-07-24T00:17:42.1602266Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-6",
2021-07-24T00:17:42.1603343Z [cluster2] "cluster_id": "cluster2",
2021-07-24T00:17:42.1603972Z [cluster2] "healthCheckIP": "10.2.0.1",
2021-07-24T00:17:42.1604857Z [cluster2] "hostname": "cluster2-worker",
2021-07-24T00:17:42.1605509Z [cluster2] "nat_enabled": false,
2021-07-24T00:17:42.1606090Z [cluster2] "private_ip": "172.18.0.6",
2021-07-24T00:17:42.1606634Z [cluster2] "public_ip": "52.190.62.4",
2021-07-24T00:17:42.1607177Z [cluster2] "subnets": [
2021-07-24T00:17:42.1607665Z [cluster2] "100.2.0.0/16",
2021-07-24T00:17:42.1608143Z [cluster2] "10.2.0.0/16"
2021-07-24T00:17:42.1608585Z [cluster2] ]
2021-07-24T00:17:42.1609032Z [cluster2] },
2021-07-24T00:17:42.1609560Z [cluster2] "statusFailure": "",
2021-07-24T00:17:42.1610370Z [cluster2] "version": "devel-ee1f452"
2021-07-24T00:17:42.1610925Z [cluster2] }
2021-07-24T00:17:42.1611338Z [cluster2] ],
2021-07-24T00:17:42.1611998Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-24T00:17:42.1612909Z [cluster2] "mismatchedContainerImages": false
2021-07-24T00:17:42.1613602Z [cluster2] },
2021-07-24T00:17:42.1614162Z [cluster2] "loadBalancerStatus": {},
2021-07-24T00:17:42.1615494Z [cluster2] "natEnabled": false,
2021-07-24T00:17:42.1616472Z [cluster2] "networkPlugin": "weave-net",
2021-07-24T00:17:42.1617301Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-24T00:17:42.1618264Z [cluster2] "lastResourceVersion": "2378",
2021-07-24T00:17:42.1619115Z [cluster2] "mismatchedContainerImages": false,
2021-07-24T00:17:42.1620027Z [cluster2] "nonReadyContainerStates": [],
2021-07-24T00:17:42.1621136Z [cluster2] "status": {
2021-07-24T00:17:42.1621822Z [cluster2] "currentNumberScheduled": 3,
2021-07-24T00:17:42.1622657Z [cluster2] "desiredNumberScheduled": 3,
2021-07-24T00:17:42.1623420Z [cluster2] "numberAvailable": 3,
2021-07-24T00:17:42.1624097Z [cluster2] "numberMisscheduled": 0,
2021-07-24T00:17:42.1624750Z [cluster2] "numberReady": 3,
2021-07-24T00:17:42.1625404Z [cluster2] "observedGeneration": 1,
2021-07-24T00:17:42.1627173Z [cluster2] "updatedNumberScheduled": 3
2021-07-24T00:17:42.1627827Z [cluster2] }
2021-07-24T00:17:42.1628242Z [cluster2] },
2021-07-24T00:17:42.1628762Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-24T00:17:42.1629253Z [cluster2] }
2021-07-24T00:17:42.1629665Z [cluster2] }
2021-07-24T00:17:42.1630894Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-24T00:17:42.1632694Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-24T00:17:42.1634375Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-24T00:17:42.1635958Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-24T00:17:42.1637386Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-24T00:17:42.1638865Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-24T00:17:42.1640232Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-24T00:17:42.1641423Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-24T00:17:42.2620377Z [submariner-operator]$ [
2021-07-24T00:17:42.2621054Z [cluster1] "public_ip": "52.190.62.4",
2021-07-24T00:17:42.2621608Z [cluster1] "subnets": [
2021-07-24T00:17:42.2622130Z [cluster1] "100.2.0.0/16",
2021-07-24T00:17:42.2622786Z [cluster1] "10.2.0.0/16"
2021-07-24T00:17:42.2623269Z [cluster1] ]
2021-07-24T00:17:42.2623727Z [cluster1] },
2021-07-24T00:17:42.2624232Z [cluster1] "latencyRTT": {
2021-07-24T00:17:42.2625178Z [cluster1] "average": "332.574µs",
2021-07-24T00:17:42.2625894Z [cluster1] "last": "173.418µs",
2021-07-24T00:17:42.2626418Z [cluster1] "max": "2.060909ms",
2021-07-24T00:17:42.2627204Z [cluster1] "min": "138.914µs",
2021-07-24T00:17:42.2627944Z [cluster1] "stdDev": "400.23µs"
2021-07-24T00:17:42.2628398Z [cluster1] },
2021-07-24T00:17:42.2628901Z [cluster1] "status": "connected",
2021-07-24T00:17:42.2629479Z [cluster1] "statusMessage": "",
2021-07-24T00:17:42.2630030Z [cluster1] "usingIP": "172.18.0.6"
2021-07-24T00:17:42.2630686Z [cluster1] }
2021-07-24T00:17:42.2631112Z [cluster1] ],
2021-07-24T00:17:42.2631632Z [cluster1] "haStatus": "active",
2021-07-24T00:17:42.2632218Z [cluster1] "localEndpoint": {
2021-07-24T00:17:42.2632927Z [cluster1] "backend": "libreswan",
2021-07-24T00:17:42.2633467Z [cluster1] "backend_config": {
2021-07-24T00:17:42.2634264Z [cluster1] "natt-discovery-port": "4490",
2021-07-24T00:17:42.2635554Z [cluster1] "preferred-server": "false"
2021-07-24T00:17:42.2636204Z [cluster1] },
2021-07-24T00:17:42.2637235Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-5",
2021-07-24T00:17:42.2638143Z [cluster1] "cluster_id": "cluster1",
2021-07-24T00:17:42.2638949Z [cluster1] "healthCheckIP": "10.1.128.0",
2021-07-24T00:17:42.2639812Z [cluster1] "hostname": "cluster1-worker",
2021-07-24T00:17:42.2640480Z [cluster1] "nat_enabled": false,
2021-07-24T00:17:42.2641053Z [cluster1] "private_ip": "172.18.0.5",
2021-07-24T00:17:42.2641653Z [cluster1] "public_ip": "52.190.62.4",
2021-07-24T00:17:42.2642172Z [cluster1] "subnets": [
2021-07-24T00:17:42.2642678Z [cluster1] "100.1.0.0/16",
2021-07-24T00:17:42.2643159Z [cluster1] "10.1.0.0/16"
2021-07-24T00:17:42.2643609Z [cluster1] ]
2021-07-24T00:17:42.2644049Z [cluster1] },
2021-07-24T00:17:42.2644567Z [cluster1] "statusFailure": "",
2021-07-24T00:17:42.2645394Z [cluster1] "version": "devel-ee1f452"
2021-07-24T00:17:42.2645941Z [cluster1] }
2021-07-24T00:17:42.2646370Z [cluster1] ],
2021-07-24T00:17:42.2647030Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-24T00:17:42.2647958Z [cluster1] "mismatchedContainerImages": false
2021-07-24T00:17:42.2648632Z [cluster1] },
2021-07-24T00:17:42.2649208Z [cluster1] "loadBalancerStatus": {},
2021-07-24T00:17:42.2649870Z [cluster1] "natEnabled": false,
2021-07-24T00:17:42.2650682Z [cluster1] "networkPlugin": "weave-net",
2021-07-24T00:17:42.2651508Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-24T00:17:42.2652333Z [cluster1] "lastResourceVersion": "2568",
2021-07-24T00:17:42.2653200Z [cluster1] "mismatchedContainerImages": false,
2021-07-24T00:17:42.2654193Z [cluster1] "nonReadyContainerStates": [],
2021-07-24T00:17:42.2655211Z [cluster1] "status": {
2021-07-24T00:17:42.2655878Z [cluster1] "currentNumberScheduled": 3,
2021-07-24T00:17:42.2656728Z [cluster1] "desiredNumberScheduled": 3,
2021-07-24T00:17:42.2657467Z [cluster1] "numberAvailable": 3,
2021-07-24T00:17:42.2658333Z [cluster1] "numberMisscheduled": 0,
2021-07-24T00:17:42.2658991Z [cluster1] "numberReady": 3,
2021-07-24T00:17:42.2659634Z [cluster1] "observedGeneration": 1,
2021-07-24T00:17:42.2660431Z [cluster1] "updatedNumberScheduled": 3
2021-07-24T00:17:42.2661052Z [cluster1] }
2021-07-24T00:17:42.2661476Z [cluster1] },
2021-07-24T00:17:42.2661975Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-24T00:17:42.2662479Z [cluster1] }
2021-07-24T00:17:42.2662888Z [cluster1] }
2021-07-24T00:17:42.2664189Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-24T00:17:42.2665845Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-24T00:17:42.2667627Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-24T00:17:42.2669211Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-24T00:17:42.2670636Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-24T00:17:42.2672120Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-24T00:17:42.2673466Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-24T00:17:42.2674679Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-24T00:17:42.2676019Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-24T00:17:42.2677503Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-24T00:17:42.3783124Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submarinercluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-24T00:17:42.3784890Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-24T00:17:42.3786248Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-24T00:17:42.3787735Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-24T00:17:42.3789290Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-24T00:17:42.3790814Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-24T00:17:42.3792527Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-24T00:17:42.3977820Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-24T00:17:42.4142690Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-24T00:17:42.4144710Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-24T00:17:42.4580151Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVo
2021-07-24T00:17:42.4892586Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-24T00:17:42.4894383Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-24T00:17:42.4896113Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-24T00:17:42.4897821Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-24T00:17:42.5084460Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-24T00:17:42.5247769Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-24T00:17:42.5250486Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-24T00:17:42.9440878Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:43.1120897Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:43.1746123Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1748049Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-24T00:17:43.1750075Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-24T00:17:43.1752132Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1753819Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-24T00:17:43.1755199Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-24T00:17:43.1756748Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1758277Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-24T00:17:43.1759656Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-24T00:17:43.1761217Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1762786Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-24T00:17:43.1764474Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-24T00:17:43.1766077Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1767654Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-24T00:17:43.1769027Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-24T00:17:43.1770535Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1771946Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-24T00:17:43.1773188Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-24T00:17:43.1774707Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1776092Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-24T00:17:43.1777300Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-24T00:17:43.1779260Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1781494Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-24T00:17:43.1782700Z [cluster2] Generated cluster id: cluster2
2021-07-24T00:17:43.1790035Z [submariner-operator]$ [cluster2] vaV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:43.2409107Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-24T00:17:43.2993231Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-24T00:17:43.2995022Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-24T00:17:43.3004010Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-24T00:17:43.3008479Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3010662Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-24T00:17:43.3012433Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-24T00:17:43.3014337Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3019348Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-24T00:17:43.3020756Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-24T00:17:43.3022324Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3023918Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-24T00:17:43.3025532Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-24T00:17:43.3027176Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3028752Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-24T00:17:43.3030113Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-24T00:17:43.3031627Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3033032Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-24T00:17:43.3034272Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-24T00:17:43.3035667Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3037053Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-24T00:17:43.3038248Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-24T00:17:43.3039614Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3041179Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-24T00:17:43.3042205Z [cluster1] Generated cluster id: cluster1
2021-07-24T00:17:43.3043300Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-24T00:17:43.3044579Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-24T00:17:43.3046159Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-24T00:17:44.2406724Z idate_equals .spec.colorCodes blue
2021-07-24T00:17:44.2408171Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-24T00:17:44.2409590Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2411298Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-24T00:17:44.2412606Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-24T00:17:44.2414092Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2415813Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-24T00:17:44.2417380Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-24T00:17:44.2418950Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2420403Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-24T00:17:44.2421707Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-24T00:17:44.2423184Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2424666Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-24T00:17:44.2425821Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-24T00:17:44.2427311Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-24T00:17:44.2428675Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-24T00:17:44.2429756Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:17:44.2430783Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-24T00:17:44.2431978Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-24T00:17:44.2432952Z [submariner-operator]$ [cluster2] wait 9969
2021-07-24T00:17:44.2433967Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-24T00:17:44.2435027Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-24T00:17:44.2436406Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-24T00:17:44.2437311Z [cluster2] 
2021-07-24T00:17:44.2437810Z [cluster2] 
2021-07-24T00:17:44.2439084Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:44.2440617Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-24T00:17:44.2441934Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-24T00:17:44.2443175Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2444402Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-24T00:17:44.2445745Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-24T00:17:44.2447142Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-24T00:17:44.2448599Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:44.2449553Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:44.2450626Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-24T00:17:44.2451813Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-24T00:17:44.2453215Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-24T00:17:44.2454959Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-24T00:17:44.2456427Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-24T00:17:44.2457972Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-24T00:17:44.2459254Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-24T00:17:44.2460424Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-24T00:17:44.2461510Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:17:44.2462467Z [submariner-operator]$ [cluster2] wait 10035
2021-07-24T00:17:44.2463467Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-24T00:17:44.2464526Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-24T00:17:44.2465315Z [cluster2] 
2021-07-24T00:17:44.2466223Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:44.2467327Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-24T00:17:44.2468551Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-24T00:17:44.2469686Z [submariner-operator]$ [cluster2] iteration=1
2021-07-24T00:17:44.2470657Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-24T00:17:44.2471959Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-24T00:17:44.2473551Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-24T00:17:44.4307946Z [submariner-operm[submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-24T00:17:44.4309539Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-24T00:17:44.4311211Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-24T00:17:44.4312834Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-24T00:17:44.4314367Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-24T00:17:44.4315953Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-24T00:17:44.4317390Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-24T00:17:44.4318858Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-24T00:17:44.4320341Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-24T00:17:44.4321739Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-24T00:17:44.4322896Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-24T00:17:44.4324066Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-24T00:17:44.4325242Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-24T00:17:44.4326296Z [submariner-operator]$ [cluster1] iteration=1
2021-07-24T00:17:44.4327331Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-24T00:17:44.4328472Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-24T00:17:44.4329527Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-24T00:17:44.4330558Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-24T00:17:44.4331855Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-24T00:17:44.4332939Z [submariner-operator]$ [cluster1] wait 9992
2021-07-24T00:17:44.4333800Z [cluster1] 
2021-07-24T00:17:44.4334802Z [cluster1] 
2021-07-24T00:17:44.4336131Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-24T00:17:44.4337680Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-24T00:17:44.4339062Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-24T00:17:44.4340508Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-24T00:17:44.4342120Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-24T00:17:44.4343464Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-24T00:17:44.4344994Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-24T00:17:44.4346271Z [submariner-operator]$ [cluster1] return 0
2021-07-24T00:17:44.4347230Z [submariner-operator]$ [cluster1] return 0
2021-07-24T00:17:44.4348291Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-24T00:17:44.4349468Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-24T00:17:44.4350880Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-24T00:17:44.4352479Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-24T00:17:44.4353920Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-24T00:17:44.4355325Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-24T00:17:44.4356602Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-24T00:17:44.4357700Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-24T00:17:44.4358806Z [submariner-operator]$ [cluster1] iteration=1
2021-07-24T00:17:44.4359768Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-24T00:17:44.4360738Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-24T00:17:44.4361470Z [cluster1] 
2021-07-24T00:17:44.4362163Z [submariner-operator]$ [cluster1] wait 10059
2021-07-24T00:17:44.4363032Z [submariner-operator]$ [cluster1] return 0
2021-07-24T00:17:44.4364039Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-24T00:17:44.4365239Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-24T00:17:44.4366243Z [submariner-operator]$ [cluster1] iteration=1
2021-07-24T00:17:44.4367131Z [submariner-operator]$ [cluster1] wait 10094
2021-07-24T00:17:44.4368077Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-24T00:17:44.4369161Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-24T00:17:44.4371084Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-24T00:17:44.4373191Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-24T00:17:46.1250459Z [submariner-operator]$ [cluster1] command kubectl --cator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-24T00:17:46.1252615Z [submariner-operator]$ [cluster2] wait 10076
2021-07-24T00:17:46.1254372Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-24T00:17:46.1256632Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-24T00:17:46.1258454Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-24T00:17:46.1260440Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-24T00:17:46.1261895Z [submariner-operator]$ [cluster2] return 0
2021-07-24T00:17:46.1262932Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-24T00:17:46.1264221Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-24T00:17:46.1265906Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-24T00:17:46.1268870Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-24T00:17:46.1271636Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-24T00:17:46.1273505Z [cluster2] pod/submariner-gateway-hmc2g condition met
2021-07-24T00:17:46.1275098Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-24T00:17:46.1277096Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:46.1279169Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:46.1281424Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-24T00:17:46.1283186Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-hmc2g.cluster2.json
2021-07-24T00:17:46.1284926Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-hmc2g --namespace=submariner-operator -o json
2021-07-24T00:17:46.1286496Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-hmc2g --namespace=submariner-operator -o json
2021-07-24T00:17:46.1288195Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-hmc2g --namespace=submariner-operator -o json
2021-07-24T00:17:46.1290424Z [submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-hmc2g.cluster2.json
2021-07-24T00:17:46.1291493Z [cluster2] {
2021-07-24T00:17:46.1291980Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.1292483Z [cluster2] "kind": "Pod",
2021-07-24T00:17:46.1292973Z [cluster2] "metadata": {
2021-07-24T00:17:46.1293788Z [cluster2] "creationTimestamp": "2021-07-24T00:16:38Z",
2021-07-24T00:17:46.1294882Z [cluster2] "generateName": "submariner-gateway-",
2021-07-24T00:17:46.1295558Z [cluster2] "labels": {
2021-07-24T00:17:46.1296345Z [cluster2] "app": "submariner-gateway",
2021-07-24T00:17:46.1297328Z [cluster2] "controller-revision-hash": "754454f75b",
2021-07-24T00:17:46.1298464Z [cluster2] "gateway.submariner.io/node": "cluster2-worker",
2021-07-24T00:17:46.1299393Z [cluster2] "gateway.submariner.io/status": "active",
2021-07-24T00:17:46.1300500Z [cluster2] "pod-template-generation": "1"
2021-07-24T00:17:46.1301085Z [cluster2] },
2021-07-24T00:17:46.1301542Z [cluster2] "managedFields": [
2021-07-24T00:17:46.1302019Z [cluster2] {
2021-07-24T00:17:46.1302470Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.1303037Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:46.1303564Z [cluster2] "fieldsV1": {
2021-07-24T00:17:46.1304051Z [cluster2] "f:metadata": {
2021-07-24T00:17:46.1304650Z [cluster2] "f:generateName": {},
2021-07-24T00:17:46.1305113Z [cluster2] "f:labels": {
2021-07-24T00:17:46.1305498Z [cluster2] ".": {},
2021-07-24T00:17:46.1305890Z [cluster2] "f:app": {},
2021-07-24T00:17:46.1306829Z [cluster2] "f:controller-revision-hash": {},
2021-07-24T00:17:46.1307904Z [cluster2] "f:pod-template-generation": {}
2021-07-24T00:17:46.1308524Z [cluster2] },
2021-07-24T00:17:46.1309227Z [cluster2] "f:ownerReferences": {
2021-07-24T00:17:46.1309807Z [cluster2] ".": {},
2021-07-24T00:17:46.1310673Z [cluster2] "k:{\"uid\":\"d8226876-82f0-4f43-aab6-48c5a6d3c351\"}": {
2021-07-24T00:17:46.1311331Z [cluster2] ".": {},
2021-07-24T00:17:46.1311873Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:46.1312548Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-24T00:17:46.1313227Z [cluster2] "f:controller": {},
2021-07-24T00:17:46.1313761Z [cluster2] "f:kind": {},
2021-07-24T00:17:46.1314266Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1314759Z [cluster2] "f:uid": {}
2021-07-24T00:17:46.1315232Z [cluster2] }
2021-07-24T00:17:46.1315666Z [cluster2] }
2021-07-24T00:17:46.1316107Z [cluster2] },
2021-07-24T00:17:46.1316559Z [cluster2] "f:spec": {
2021-07-24T00:17:46.1317073Z [cluster2] "f:affinity": {
2021-07-24T00:17:46.1317572Z [cluster2] ".": {},
2021-07-24T00:17:46.1318097Z [cluster2] "f:nodeAffinity": {
2021-07-24T00:17:46.1318634Z [cluster2] ".": {},
2021-07-24T00:17:46.1319868Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-24T00:17:46.1321307Z [cluster2] ".": {},
2021-07-24T00:17:46.1322016Z [cluster2] "f:nodeSelectorTerms": {}
2021-07-24T00:17:46.1322791Z [cluster2] }
2021-07-24T00:17:46.1323239Z [cluster2] },
2021-07-24T00:17:46.1323820Z [cluster2] "f:podAntiAffinity": {
2021-07-24T00:17:46.1324393Z [cluster2] ".": {},
2021-07-24T00:17:46.1325549Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {}
2021-07-24T00:17:46.1326694Z [cluster2] }
2021-07-24T00:17:46.1327131Z [cluster2] },
2021-07-24T00:17:46.1327644Z [cluster2] "f:containers": {
2021-07-24T00:17:46.1328538Z [cluster2] "k:{\"name\":\"submariner-gateway\"}": {
2021-07-24T00:17:46.1329173Z [cluster2] ".": {},
2021-07-24T00:17:46.1329672Z [cluster2] "f:command": {},
2021-07-24T00:17:46.1330200Z [cluster2] "f:env": {
2021-07-24T00:17:46.1330693Z [cluster2] ".": {},
2021-07-24T00:17:46.1331291Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVER\"}": {
2021-07-24T00:17:46.1331891Z [cluster2] ".": {},
2021-07-24T00:17:46.1355446Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1356072Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1356559Z [cluster2] },
2021-07-24T00:17:46.1357214Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVERTOKEN\"}": {
2021-07-24T00:17:46.1357882Z [cluster2] ".": {},
2021-07-24T00:17:46.1358379Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1358904Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1359387Z [cluster2] },
2021-07-24T00:17:46.1360099Z [cluster2] "k:{\"name\":\"BROKER_K8S_CA\"}": {
2021-07-24T00:17:46.1360652Z [cluster2] ".": {},
2021-07-24T00:17:46.1361163Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1361675Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1362175Z [cluster2] },
2021-07-24T00:17:46.1362822Z [cluster2] "k:{\"name\":\"BROKER_K8S_REMOTENAMESPACE\"}": {
2021-07-24T00:17:46.1363465Z [cluster2] ".": {},
2021-07-24T00:17:46.1363982Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1364487Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1364978Z [cluster2] },
2021-07-24T00:17:46.1365530Z [cluster2] "k:{\"name\":\"CE_IPSEC_DEBUG\"}": {
2021-07-24T00:17:46.1366102Z [cluster2] ".": {},
2021-07-24T00:17:46.1366711Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1367179Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1367635Z [cluster2] },
2021-07-24T00:17:46.1368183Z [cluster2] "k:{\"name\":\"CE_IPSEC_FORCEENCAPS\"}": {
2021-07-24T00:17:46.1368939Z [cluster2] ".": {},
2021-07-24T00:17:46.1369533Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1370103Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1370551Z [cluster2] },
2021-07-24T00:17:46.1371272Z [cluster2] "k:{\"name\":\"CE_IPSEC_IKEPORT\"}": {
2021-07-24T00:17:46.1371928Z [cluster2] ".": {},
2021-07-24T00:17:46.1372584Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1373111Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1373592Z [cluster2] },
2021-07-24T00:17:46.1374175Z [cluster2] "k:{\"name\":\"CE_IPSEC_NATTPORT\"}": {
2021-07-24T00:17:46.1374883Z [cluster2] ".": {},
2021-07-24T00:17:46.1375391Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1375906Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1376412Z [cluster2] },
2021-07-24T00:17:46.1377054Z [cluster2] "k:{\"name\":\"CE_IPSEC_PREFERREDSERVER\"}": {
2021-07-24T00:17:46.1377687Z [cluster2] ".": {},
2021-07-24T00:17:46.1378197Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1378715Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1379208Z [cluster2] },
2021-07-24T00:17:46.1379754Z [cluster2] "k:{\"name\":\"CE_IPSEC_PSK\"}": {
2021-07-24T00:17:46.1380314Z [cluster2] ".": {},
2021-07-24T00:17:46.1380819Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1381331Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1381828Z [cluster2] },
2021-07-24T00:17:46.1382353Z [cluster2] "k:{\"name\":\"NODE_NAME\"}": {
2021-07-24T00:17:46.1382896Z [cluster2] ".": {},
2021-07-24T00:17:46.1383387Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1383942Z [cluster2] "f:valueFrom": {
2021-07-24T00:17:46.1384543Z [cluster2] ".": {},
2021-07-24T00:17:46.1385080Z [cluster2] "f:fieldRef": {
2021-07-24T00:17:46.1385630Z [cluster2] ".": {},
2021-07-24T00:17:46.1386181Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:46.1386805Z [cluster2] "f:fieldPath": {}
2021-07-24T00:17:46.1387339Z [cluster2] }
2021-07-24T00:17:46.1387823Z [cluster2] }
2021-07-24T00:17:46.1388284Z [cluster2] },
2021-07-24T00:17:46.1388832Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-24T00:17:46.1389383Z [cluster2] ".": {},
2021-07-24T00:17:46.1389910Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1390475Z [cluster2] "f:valueFrom": {
2021-07-24T00:17:46.1391002Z [cluster2] ".": {},
2021-07-24T00:17:46.1391539Z [cluster2] "f:fieldRef": {
2021-07-24T00:17:46.1392072Z [cluster2] ".": {},
2021-07-24T00:17:46.1392632Z [cluster2] "f:apiVersion": {},
2021-07-24T00:17:46.1393227Z [cluster2] "f:fieldPath": {}
2021-07-24T00:17:46.1393839Z [cluster2] }
2021-07-24T00:17:46.1394453Z [cluster2] }
2021-07-24T00:17:46.1394913Z [cluster2] },
2021-07-24T00:17:46.1395506Z [cluster2] "k:{\"name\":\"SUBMARINER_BROKER\"}": {
2021-07-24T00:17:46.1396094Z [cluster2] ".": {},
2021-07-24T00:17:46.1396604Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1397116Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1397613Z [cluster2] },
2021-07-24T00:17:46.1398242Z [cluster2] "k:{\"name\":\"SUBMARINER_CABLEDRIVER\"}": {
2021-07-24T00:17:46.1398861Z [cluster2] ".": {},
2021-07-24T00:17:46.1399369Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1399887Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1400382Z [cluster2] },
2021-07-24T00:17:46.1400992Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERCIDR\"}": {
2021-07-24T00:17:46.1401615Z [cluster2] ".": {},
2021-07-24T00:17:46.1402111Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1402633Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1403127Z [cluster2] },
2021-07-24T00:17:46.1403726Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERID\"}": {
2021-07-24T00:17:46.1404342Z [cluster2] ".": {},
2021-07-24T00:17:46.1404834Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1405354Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1405931Z [cluster2] },
2021-07-24T00:17:46.1406500Z [cluster2] "k:{\"name\":\"SUBMARINER_COLORCODES\"}": {
2021-07-24T00:17:46.1407077Z [cluster2] ".": {},
2021-07-24T00:17:46.1407531Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1408069Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1408519Z [cluster2] },
2021-07-24T00:17:46.1409063Z [cluster2] "k:{\"name\":\"SUBMARINER_DEBUG\"}": {
2021-07-24T00:17:46.1409598Z [cluster2] ".": {},
2021-07-24T00:17:46.1410068Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1410546Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1411005Z [cluster2] },
2021-07-24T00:17:46.1411751Z [cluster2] "k:{\"name\":\"SUBMARINER_GLOBALCIDR\"}": {
2021-07-24T00:17:46.1412368Z [cluster2] ".": {},
2021-07-24T00:17:46.1412877Z [cluster2] "f:name": {}
2021-07-24T00:17:46.1413355Z [cluster2] },
2021-07-24T00:17:46.1414052Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKENABLED\"}": {
2021-07-24T00:17:46.1458641Z [cluster2] ".": {},
2021-07-24T00:17:46.1459186Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1459708Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1460210Z [cluster2] },
2021-07-24T00:17:46.1460933Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKINTERVAL\"}": {
2021-07-24T00:17:46.1461795Z [cluster2] ".": {},
2021-07-24T00:17:46.1462308Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1462823Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1463319Z [cluster2] },
2021-07-24T00:17:46.1464180Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT\"}": {
2021-07-24T00:17:46.1465045Z [cluster2] ".": {},
2021-07-24T00:17:46.1465555Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1466063Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1466556Z [cluster2] },
2021-07-24T00:17:46.1467157Z [cluster2] "k:{\"name\":\"SUBMARINER_NAMESPACE\"}": {
2021-07-24T00:17:46.1467781Z [cluster2] ".": {},
2021-07-24T00:17:46.1468273Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1468795Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1469289Z [cluster2] },
2021-07-24T00:17:46.1469888Z [cluster2] "k:{\"name\":\"SUBMARINER_NATENABLED\"}": {
2021-07-24T00:17:46.1470510Z [cluster2] ".": {},
2021-07-24T00:17:46.1471003Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1471526Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1472007Z [cluster2] },
2021-07-24T00:17:46.1472735Z [cluster2] "k:{\"name\":\"SUBMARINER_SERVICECIDR\"}": {
2021-07-24T00:17:46.1473353Z [cluster2] ".": {},
2021-07-24T00:17:46.1473869Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1474398Z [cluster2] "f:value": {}
2021-07-24T00:17:46.1474882Z [cluster2] }
2021-07-24T00:17:46.1475344Z [cluster2] },
2021-07-24T00:17:46.1475828Z [cluster2] "f:image": {},
2021-07-24T00:17:46.1476536Z [cluster2] "f:imagePullPolicy": {},
2021-07-24T00:17:46.1477131Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1477649Z [cluster2] "f:ports": {
2021-07-24T00:17:46.1478136Z [cluster2] ".": {},
2021-07-24T00:17:46.1478789Z [cluster2] "k:{\"containerPort\":4490,\"protocol\":\"UDP\"}": {
2021-07-24T00:17:46.1479437Z [cluster2] ".": {},
2021-07-24T00:17:46.1480002Z [cluster2] "f:containerPort": {},
2021-07-24T00:17:46.1480624Z [cluster2] "f:hostPort": {},
2021-07-24T00:17:46.1481157Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1481708Z [cluster2] "f:protocol": {}
2021-07-24T00:17:46.1482215Z [cluster2] },
2021-07-24T00:17:46.1482861Z [cluster2] "k:{\"containerPort\":4500,\"protocol\":\"UDP\"}": {
2021-07-24T00:17:46.1483497Z [cluster2] ".": {},
2021-07-24T00:17:46.1484057Z [cluster2] "f:containerPort": {},
2021-07-24T00:17:46.1484671Z [cluster2] "f:hostPort": {},
2021-07-24T00:17:46.1485200Z [cluster2] "f:name": {},
2021-07-24T00:17:46.1485744Z [cluster2] "f:protocol": {}
2021-07-24T00:17:46.1486308Z [cluster2] }
2021-07-24T00:17:46.1486771Z [cluster2] },
2021-07-24T00:17:46.1487280Z [cluster2] "f:resources": {},
2021-07-24T00:17:46.1487910Z [cluster2] "f:securityContext": {
2021-07-24T00:17:46.1488484Z [cluster2] ".": {},
2021-07-24T00:17:46.1489182Z [cluster2] "f:allowPrivilegeEscalation": {},
2021-07-24T00:17:46.1490002Z [cluster2] "f:capabilities": {
2021-07-24T00:17:46.1490541Z [cluster2] ".": {},
2021-07-24T00:17:46.1491040Z [cluster2] "f:add": {},
2021-07-24T00:17:46.1491538Z [cluster2] "f:drop": {}
2021-07-24T00:17:46.1492121Z [cluster2] },
2021-07-24T00:17:46.1492653Z [cluster2] "f:privileged": {},
2021-07-24T00:17:46.1493398Z [cluster2] "f:readOnlyRootFilesystem": {},
2021-07-24T00:17:46.1494145Z [cluster2] "f:runAsNonRoot": {}
2021-07-24T00:17:46.1495259Z [cluster2] },
2021-07-24T00:17:46.1495938Z [cluster2] "f:terminationMessagePath": {},
2021-07-24T00:17:46.1496827Z [cluster2] "f:terminationMessagePolicy": {},
2021-07-24T00:17:46.1497606Z [cluster2] "f:volumeMounts": {
2021-07-24T00:17:46.1498149Z [cluster2] ".": {},
2021-07-24T00:17:46.1498847Z [cluster2] "k:{\"mountPath\":\"/etc/ipsec.d\"}": {
2021-07-24T00:17:46.1499448Z [cluster2] ".": {},
2021-07-24T00:17:46.1499979Z [cluster2] "f:mountPath": {},
2021-07-24T00:17:46.1500543Z [cluster2] "f:name": {}
2021-07-24T00:17:46.1501023Z [cluster2] },
2021-07-24T00:17:46.1501624Z [cluster2] "k:{\"mountPath\":\"/var/lib/ipsec/nss\"}": {
2021-07-24T00:17:46.1502222Z [cluster2] ".": {},
2021-07-24T00:17:46.1502846Z [cluster2] "f:mountPath": {},
2021-07-24T00:17:46.1503396Z [cluster2] "f:name": {}
2021-07-24T00:17:46.1503892Z [cluster2] }
2021-07-24T00:17:46.1504358Z [cluster2] }
2021-07-24T00:17:46.1504802Z [cluster2] }
2021-07-24T00:17:46.1505251Z [cluster2] },
2021-07-24T00:17:46.1505750Z [cluster2] "f:dnsPolicy": {},
2021-07-24T00:17:46.1506415Z [cluster2] "f:enableServiceLinks": {},
2021-07-24T00:17:46.1507084Z [cluster2] "f:hostNetwork": {},
2021-07-24T00:17:46.1507690Z [cluster2] "f:nodeSelector": {
2021-07-24T00:17:46.1508218Z [cluster2] ".": {},
2021-07-24T00:17:46.1508798Z [cluster2] "f:submariner.io/gateway": {}
2021-07-24T00:17:46.1509365Z [cluster2] },
2021-07-24T00:17:46.1509897Z [cluster2] "f:restartPolicy": {},
2021-07-24T00:17:46.1510542Z [cluster2] "f:schedulerName": {},
2021-07-24T00:17:46.1511183Z [cluster2] "f:securityContext": {},
2021-07-24T00:17:46.1511967Z [cluster2] "f:serviceAccount": {},
2021-07-24T00:17:46.1512699Z [cluster2] "f:serviceAccountName": {},
2021-07-24T00:17:46.1513708Z [cluster2] "f:terminationGracePeriodSeconds": {},
2021-07-24T00:17:46.1514659Z [cluster2] "f:tolerations": {},
2021-07-24T00:17:46.1515395Z [cluster2] "f:volumes": {
2021-07-24T00:17:46.1515937Z [cluster2] ".": {},
2021-07-24T00:17:46.1516551Z [cluster2] "k:{\"name\":\"ipsecd\"}": {
2021-07-24T00:17:46.1517108Z [cluster2] ".": {},
2021-07-24T00:17:46.1517719Z [cluster2] "f:emptyDir": {},
2021-07-24T00:17:46.1518312Z [cluster2] "f:name": {}
2021-07-24T00:17:46.1518964Z [cluster2] },
2021-07-24T00:17:46.1519527Z [cluster2] "k:{\"name\":\"ipsecnss\"}": {
2021-07-24T00:17:46.1520148Z [cluster2] ".": {},
2021-07-24T00:17:46.1520756Z [cluster2] "f:emptyDir": {},
2021-07-24T00:17:46.1521337Z [cluster2] "f:name": {}
2021-07-24T00:17:46.1522007Z [cluster2] }
2021-07-24T00:17:46.1522448Z [cluster2] }
2021-07-24T00:17:46.1522934Z [cluster2] }
2021-07-24T00:17:46.1523364Z [cluster2] },
2021-07-24T00:17:46.1524637Z [cluster2] "manager": "kube-controller-manager",
2021-07-24T00:17:46.1525367Z [cluster2] "operation": "Update",
2021-07-24T00:17:46.1526158Z [cluster2] "time": "2021-07-24T00:16:38Z"
2021-07-24T00:17:46.1526683Z [cluster2] },
2021-07-24T00:17:46.1527102Z [cluster2] {
2021-07-24T00:17:46.1527679Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.1528278Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:46.1529087Z [cluster2] "fieldsV1": {
2021-07-24T00:17:46.1529626Z [cluster2] "f:status": {
2021-07-24T00:17:46.1530242Z [cluster2] "f:conditions": {
2021-07-24T00:17:46.1530945Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-24T00:17:46.1531726Z [cluster2] ".": {},
2021-07-24T00:17:46.1532321Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:46.1533105Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:46.1533826Z [cluster2] "f:status": {},
2021-07-24T00:17:46.1583493Z [cluster2] "f:type": {}
2021-07-24T00:17:46.1584107Z [cluster2] },
2021-07-24T00:17:46.1584673Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-24T00:17:46.1585243Z [cluster2] ".": {},
2021-07-24T00:17:46.1585792Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:46.1586489Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:46.1587118Z [cluster2] "f:status": {},
2021-07-24T00:17:46.1587654Z [cluster2] "f:type": {}
2021-07-24T00:17:46.1588122Z [cluster2] },
2021-07-24T00:17:46.1588640Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-24T00:17:46.1589151Z [cluster2] ".": {},
2021-07-24T00:17:46.1589758Z [cluster2] "f:lastProbeTime": {},
2021-07-24T00:17:46.1590466Z [cluster2] "f:lastTransitionTime": {},
2021-07-24T00:17:46.1591097Z [cluster2] "f:status": {},
2021-07-24T00:17:46.1591625Z [cluster2] "f:type": {}
2021-07-24T00:17:46.1592094Z [cluster2] }
2021-07-24T00:17:46.1592544Z [cluster2] },
2021-07-24T00:17:46.1593123Z [cluster2] "f:containerStatuses": {},
2021-07-24T00:17:46.1593753Z [cluster2] "f:hostIP": {},
2021-07-24T00:17:46.1594346Z [cluster2] "f:phase": {},
2021-07-24T00:17:46.1594865Z [cluster2] "f:podIP": {},
2021-07-24T00:17:46.1595393Z [cluster2] "f:podIPs": {
2021-07-24T00:17:46.1595882Z [cluster2] ".": {},
2021-07-24T00:17:46.1596387Z [cluster2] "k:{\"ip\":\"172.18.0.6\"}": {
2021-07-24T00:17:46.1596877Z [cluster2] ".": {},
2021-07-24T00:17:46.1597363Z [cluster2] "f:ip": {}
2021-07-24T00:17:46.1597822Z [cluster2] }
2021-07-24T00:17:46.1598273Z [cluster2] },
2021-07-24T00:17:46.1598774Z [cluster2] "f:startTime": {}
2021-07-24T00:17:46.1599274Z [cluster2] }
2021-07-24T00:17:46.1599696Z [cluster2] },
2021-07-24T00:17:46.1600211Z [cluster2] "manager": "kubelet",
2021-07-24T00:17:46.1600809Z [cluster2] "operation": "Update",
2021-07-24T00:17:46.1601836Z [cluster2] "time": "2021-07-24T00:17:08Z"
2021-07-24T00:17:46.1602320Z [cluster2] },
2021-07-24T00:17:46.1602736Z [cluster2] {
2021-07-24T00:17:46.1603242Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.1603846Z [cluster2] "fieldsType": "FieldsV1",
2021-07-24T00:17:46.1604436Z [cluster2] "fieldsV1": {
2021-07-24T00:17:46.1604953Z [cluster2] "f:metadata": {
2021-07-24T00:17:46.1605481Z [cluster2] "f:labels": {
2021-07-24T00:17:46.1606149Z [cluster2] "f:gateway.submariner.io/node": {},
2021-07-24T00:17:46.1606991Z [cluster2] "f:gateway.submariner.io/status": {}
2021-07-24T00:17:46.1607641Z [cluster2] }
2021-07-24T00:17:46.1608074Z [cluster2] }
2021-07-24T00:17:46.1608513Z [cluster2] },
2021-07-24T00:17:46.1609302Z [cluster2] "manager": "submariner-gateway",
2021-07-24T00:17:46.1609999Z [cluster2] "operation": "Update",
2021-07-24T00:17:46.1610729Z [cluster2] "time": "2021-07-24T00:17:09Z"
2021-07-24T00:17:46.1611205Z [cluster2] }
2021-07-24T00:17:46.1611612Z [cluster2] ],
2021-07-24T00:17:46.1612437Z [cluster2] "name": "submariner-gateway-hmc2g",
2021-07-24T00:17:46.1613515Z [cluster2] "namespace": "submariner-operator",
2021-07-24T00:17:46.1614268Z [cluster2] "ownerReferences": [
2021-07-24T00:17:46.1614949Z [cluster2] {
2021-07-24T00:17:46.1615458Z [cluster2] "apiVersion": "apps/v1",
2021-07-24T00:17:46.1616152Z [cluster2] "blockOwnerDeletion": true,
2021-07-24T00:17:46.1616812Z [cluster2] "controller": true,
2021-07-24T00:17:46.1617398Z [cluster2] "kind": "DaemonSet",
2021-07-24T00:17:46.1618246Z [cluster2] "name": "submariner-gateway",
2021-07-24T00:17:46.1619213Z [cluster2] "uid": "d8226876-82f0-4f43-aab6-48c5a6d3c351"
2021-07-24T00:17:46.1619795Z [cluster2] }
2021-07-24T00:17:46.1620220Z [cluster2] ],
2021-07-24T00:17:46.1620758Z [cluster2] "resourceVersion": "2415",
2021-07-24T00:17:46.1621614Z [cluster2] "uid": "238f7650-620a-46aa-95f0-d665245c4946"
2021-07-24T00:17:46.1622181Z [cluster2] },
2021-07-24T00:17:46.1622603Z [cluster2] "spec": {
2021-07-24T00:17:46.1623081Z [cluster2] "affinity": {
2021-07-24T00:17:46.1623610Z [cluster2] "nodeAffinity": {
2021-07-24T00:17:46.1624822Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-24T00:17:46.1626076Z [cluster2] "nodeSelectorTerms": [
2021-07-24T00:17:46.1626653Z [cluster2] {
2021-07-24T00:17:46.1627160Z [cluster2] "matchFields": [
2021-07-24T00:17:46.1627776Z [cluster2] {
2021-07-24T00:17:46.1628339Z [cluster2] "key": "metadata.name",
2021-07-24T00:17:46.1628947Z [cluster2] "operator": "In",
2021-07-24T00:17:46.1629497Z [cluster2] "values": [
2021-07-24T00:17:46.1630286Z [cluster2] "cluster2-worker"
2021-07-24T00:17:46.1630868Z [cluster2] ]
2021-07-24T00:17:46.1657596Z [cluster2] }
2021-07-24T00:17:46.1658083Z [cluster2] ]
2021-07-24T00:17:46.1658522Z [cluster2] }
2021-07-24T00:17:46.1658967Z [cluster2] ]
2021-07-24T00:17:46.1659388Z [cluster2] }
2021-07-24T00:17:46.1659816Z [cluster2] },
2021-07-24T00:17:46.1660362Z [cluster2] "podAntiAffinity": {
2021-07-24T00:17:46.1661581Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-24T00:17:46.1662722Z [cluster2] {
2021-07-24T00:17:46.1663252Z [cluster2] "labelSelector": {
2021-07-24T00:17:46.1663862Z [cluster2] "matchLabels": {
2021-07-24T00:17:46.1664927Z [cluster2] "app": "submariner-gateway"
2021-07-24T00:17:46.1665544Z [cluster2] }
2021-07-24T00:17:46.1665986Z [cluster2] },
2021-07-24T00:17:46.1666636Z [cluster2] "topologyKey": "kubernetes.io/hostname"
2021-07-24T00:17:46.1667273Z [cluster2] }
2021-07-24T00:17:46.1667696Z [cluster2] ]
2021-07-24T00:17:46.1668132Z [cluster2] }
2021-07-24T00:17:46.1668539Z [cluster2] },
2021-07-24T00:17:46.1669022Z [cluster2] "containers": [
2021-07-24T00:17:46.1669486Z [cluster2] {
2021-07-24T00:17:46.1669949Z [cluster2] "command": [
2021-07-24T00:17:46.1670491Z [cluster2] "submariner.sh"
2021-07-24T00:17:46.1671001Z [cluster2] ],
2021-07-24T00:17:46.1671438Z [cluster2] "env": [
2021-07-24T00:17:46.1671885Z [cluster2] {
2021-07-24T00:17:46.1672443Z [cluster2] "name": "SUBMARINER_NAMESPACE",
2021-07-24T00:17:46.1673397Z [cluster2] "value": "submariner-operator"
2021-07-24T00:17:46.1674170Z [cluster2] },
2021-07-24T00:17:46.1674603Z [cluster2] {
2021-07-24T00:17:46.1675188Z [cluster2] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-24T00:17:46.1675795Z [cluster2] "value": "10.2.0.0/16"
2021-07-24T00:17:46.1676280Z [cluster2] },
2021-07-24T00:17:46.1676709Z [cluster2] {
2021-07-24T00:17:46.1677295Z [cluster2] "name": "SUBMARINER_SERVICECIDR",
2021-07-24T00:17:46.1677908Z [cluster2] "value": "100.2.0.0/16"
2021-07-24T00:17:46.1678390Z [cluster2] },
2021-07-24T00:17:46.1678818Z [cluster2] {
2021-07-24T00:17:46.1679404Z [cluster2] "name": "SUBMARINER_GLOBALCIDR"
2021-07-24T00:17:46.1680066Z [cluster2] },
2021-07-24T00:17:46.1680458Z [cluster2] {
2021-07-24T00:17:46.1680992Z [cluster2] "name": "SUBMARINER_CLUSTERID",
2021-07-24T00:17:46.1681566Z [cluster2] "value": "cluster2"
2021-07-24T00:17:46.1682040Z [cluster2] },
2021-07-24T00:17:46.1682431Z [cluster2] {
2021-07-24T00:17:46.1682961Z [cluster2] "name": "SUBMARINER_COLORCODES",
2021-07-24T00:17:46.1683521Z [cluster2] "value": "blue"
2021-07-24T00:17:46.1683968Z [cluster2] },
2021-07-24T00:17:46.1684375Z [cluster2] {
2021-07-24T00:17:46.1684943Z [cluster2] "name": "SUBMARINER_DEBUG",
2021-07-24T00:17:46.1685493Z [cluster2] "value": "false"
2021-07-24T00:17:46.1685935Z [cluster2] },
2021-07-24T00:17:46.1686341Z [cluster2] {
2021-07-24T00:17:46.1686861Z [cluster2] "name": "SUBMARINER_NATENABLED",
2021-07-24T00:17:46.1687434Z [cluster2] "value": "false"
2021-07-24T00:17:46.1687880Z [cluster2] },
2021-07-24T00:17:46.1688291Z [cluster2] {
2021-07-24T00:17:46.1688966Z [cluster2] "name": "SUBMARINER_BROKER",
2021-07-24T00:17:46.1689554Z [cluster2] "value": "k8s"
2021-07-24T00:17:46.1690094Z [cluster2] },
2021-07-24T00:17:46.1690519Z [cluster2] {
2021-07-24T00:17:46.1691108Z [cluster2] "name": "SUBMARINER_CABLEDRIVER",
2021-07-24T00:17:46.1691756Z [cluster2] "value": "libreswan"
2021-07-24T00:17:46.1692280Z [cluster2] },
2021-07-24T00:17:46.1692703Z [cluster2] {
2021-07-24T00:17:46.1693262Z [cluster2] "name": "BROKER_K8S_APISERVER",
2021-07-24T00:17:46.1693848Z [cluster2] "value": "172.18.0.9:6443"
2021-07-24T00:17:46.1694333Z [cluster2] },
2021-07-24T00:17:46.1736832Z [cluster2] {
2021-07-24T00:17:46.1737464Z [cluster2] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-24T00:17:46.1889540Z [cluster2] "value": "***"
2021-07-24T00:17:46.1890106Z [cluster2] },
2021-07-24T00:17:46.1890559Z [cluster2] {
2021-07-24T00:17:46.1891244Z [cluster2] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-24T00:17:46.1892332Z [cluster2] "value": "submariner-k8s-broker"
2021-07-24T00:17:46.1892910Z [cluster2] },
2021-07-24T00:17:46.1893341Z [cluster2] {
2021-07-24T00:17:46.1893825Z [cluster2] "name": "BROKER_K8S_CA",
2021-07-24T00:17:46.2731873Z [cluster2] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3lOREF3TURjME5Wb1hEVE14TURjeU1qQXdNRGMwTlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTUJSCnh2U0FZRklFQ0hMa3FUTVN1Vit4cFhseW92M1RWeFIyMVNaSWtGL3pLOVVyS3VnNDMwRUh3R0tBOFA4amlFSXUKUXB1TUZaenlLa3RNeGhGbU1CQmEvSTUrY2RvTmk2OEVIWmZEYlk1TVZTMnBUZTVSY1l4RlZaM3FBdytwVU4wLwpjcFFhaHZ0Uld0RXRGUCtmc2FoYi83bkpmWEczR0RYODd4WVBkMU0rMjk4bEFKajh6R0czV1JxQkhobDQzT253CmFnR1VaenYydG5RNUhmQ3ZPR2h3ZkxJVWw4YWlKUzRCazNQZXZ0dVpmdSs3ZjUvbjExSnBZSWdlUzJRUjAzcVYKTVAyNFgyNlYwc3pJcVFMb3BXOWNqRlNObUNxc0N0dVk2SmZFaFI0ME5PVGdwSU9rbkt6dm9KQ3FyaDNSN2FwRgo5S2hVcjJheExxNjF3WHM1MzJFQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZLNTJPZXVNQ1A3QzUwRWphNW41U3Vqb3NYbG9NQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCTGxqN2pncm85RVZ4clN5UDFsSjJTaDZFSmtTakI5WE5Ka01XK0JKdWpVUTMzdXRiTgpTY0tORWRaUWxMWG5JQnZhM0Ztdm8vZlJlVzRjZ2wrZTlVbWd0UThWSGVoQ1JqVGxSR0FyQ2s1bUNIYUtab3JICjN0a1oxU1QrNEFMMlFnR04zbTBXMFhRT0dFejBlVUFmVWNkbFZzVUxIK1h6dFhzbllqTnFEaW4xUUJqSk5qUEsKWkRlSnhVZFlHTkU2ZU1zdTdkcUJJOVIzYkFkek4raHgwU0EvbndFWjlQNjVWd0xtcHZMY09WZi9ib1ZMRERhQwpoeDZ5cHZpQ0g3dXZXbngwV0hRdjNDQk51dk03Q0xoUk9peGZnTnMzeHhMS0JoVXZEajRubDJkQVk3eUlDUVFwCnNLTG5PMjNTcHBuYmIzeGlMSklNZ3g4ai9RaGxoRFRYRWlTUwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg=="
2021-07-24T00:17:46.3335735Z [cluster2] },
2021-07-24T00:17:46.3336188Z [cluster2] {
2021-07-24T00:17:46.3336683Z [cluster2] "name": "CE_IPSEC_PSK",
2021-07-24T00:17:46.3338186Z [cluster2] "value": "PFVxukY6+x1XwF5kUqpZ6R7z80ejq+Bkn2pwEc7HUdGuli8KoSKWIGFj3TZKcirH"
2021-07-24T00:17:46.3339815Z [cluster2] },
2021-07-24T00:17:46.3340237Z [cluster2] {
2021-07-24T00:17:46.3340735Z [cluster2] "name": "CE_IPSEC_DEBUG",
2021-07-24T00:17:46.3341743Z [cluster2] "value": "false"
2021-07-24T00:17:46.3342214Z [cluster2] },
2021-07-24T00:17:46.3342610Z [cluster2] {
2021-07-24T00:17:46.3343231Z [cluster2] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-24T00:17:46.3343871Z [cluster2] "value": "true"
2021-07-24T00:17:46.3344323Z [cluster2] },
2021-07-24T00:17:46.3344721Z [cluster2] {
2021-07-24T00:17:46.3345341Z [cluster2] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-24T00:17:46.3345987Z [cluster2] "value": "1"
2021-07-24T00:17:46.3346412Z [cluster2] },
2021-07-24T00:17:46.3346823Z [cluster2] {
2021-07-24T00:17:46.3347573Z [cluster2] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-24T00:17:46.3348539Z [cluster2] "value": "5"
2021-07-24T00:17:46.3349002Z [cluster2] },
2021-07-24T00:17:46.3349444Z [cluster2] {
2021-07-24T00:17:46.3349935Z [cluster2] "name": "NODE_NAME",
2021-07-24T00:17:46.3350499Z [cluster2] "valueFrom": {
2021-07-24T00:17:46.3351290Z [cluster2] "fieldRef": {
2021-07-24T00:17:46.3352060Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.3352747Z [cluster2] "fieldPath": "spec.nodeName"
2021-07-24T00:17:46.3353332Z [cluster2] }
2021-07-24T00:17:46.3353787Z [cluster2] }
2021-07-24T00:17:46.3354220Z [cluster2] },
2021-07-24T00:17:46.3354662Z [cluster2] {
2021-07-24T00:17:46.3355165Z [cluster2] "name": "POD_NAME",
2021-07-24T00:17:46.3355723Z [cluster2] "valueFrom": {
2021-07-24T00:17:46.3356261Z [cluster2] "fieldRef": {
2021-07-24T00:17:46.3356838Z [cluster2] "apiVersion": "v1",
2021-07-24T00:17:46.3357487Z [cluster2] "fieldPath": "metadata.name"
2021-07-24T00:17:46.3406807Z [cluster2] }
2021-07-24T00:17:46.3407270Z [cluster2] }
2021-07-24T00:17:46.3407680Z [cluster2] },
2021-07-24T00:17:46.3408096Z [cluster2] {
2021-07-24T00:17:46.3408594Z [cluster2] "name": "CE_IPSEC_IKEPORT",
2021-07-24T00:17:46.3409219Z [cluster2] "value": "500"
2021-07-24T00:17:46.3409652Z [cluster2] },
2021-07-24T00:17:46.3410066Z [cluster2] {
2021-07-24T00:17:46.3410560Z [cluster2] "name": "CE_IPSEC_NATTPORT",
2021-07-24T00:17:46.3411116Z [cluster2] "value": "4500"
2021-07-24T00:17:46.3411564Z [cluster2] },
2021-07-24T00:17:46.3411963Z [cluster2] {
2021-07-24T00:17:46.3412528Z [cluster2] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-24T00:17:46.3413123Z [cluster2] "value": "false"
2021-07-24T00:17:46.3413589Z [cluster2] },
2021-07-24T00:17:46.3413985Z [cluster2] {
2021-07-24T00:17:46.3414871Z [cluster2] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-24T00:17:46.3415529Z [cluster2] "value": "false"
2021-07-24T00:17:46.3415991Z [cluster2] }
2021-07-24T00:17:46.3416455Z [cluster2] ],
2021-07-24T00:17:46.3417896Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-24T00:17:46.3418663Z [cluster2] "imagePullPolicy": "Always",
2021-07-24T00:17:46.3419642Z [cluster2] "name": "submariner-gateway",
2021-07-24T00:17:46.3420230Z [cluster2] "ports": [
2021-07-24T00:17:46.3420654Z [cluster2] {
2021-07-24T00:17:46.3421163Z [cluster2] "containerPort": 4500,
2021-07-24T00:17:46.3421704Z [cluster2] "hostPort": 4500,
2021-07-24T00:17:46.3422434Z [cluster2] "name": "cable-encaps",
2021-07-24T00:17:46.3422994Z [cluster2] "protocol": "UDP"
2021-07-24T00:17:46.3423471Z [cluster2] },
2021-07-24T00:17:46.3423871Z [cluster2] {
2021-07-24T00:17:46.3424381Z [cluster2] "containerPort": 4490,
2021-07-24T00:17:46.3424930Z [cluster2] "hostPort": 4490,
2021-07-24T00:17:46.3425648Z [cluster2] "name": "natt-discovery",
2021-07-24T00:17:46.3426226Z [cluster2] "protocol": "UDP"
2021-07-24T00:17:46.3426683Z [cluster2] }
2021-07-24T00:17:46.3427092Z [cluster2] ],
2021-07-24T00:17:46.3427638Z [cluster2] "resources": {},
2021-07-24T00:17:46.3428130Z [cluster2] "securityContext": {
2021-07-24T00:17:46.3428824Z [cluster2] "allowPrivilegeEscalation": true,
2021-07-24T00:17:46.3429373Z [cluster2] "capabilities": {
2021-07-24T00:17:46.3429756Z [cluster2] "add": [
2021-07-24T00:17:46.3430098Z [cluster2] "net_admin"
2021-07-24T00:17:46.3430444Z [cluster2] ],
2021-07-24T00:17:46.3430764Z [cluster2] "drop": [
2021-07-24T00:17:46.3431107Z [cluster2] "all"
2021-07-24T00:17:46.3431629Z [cluster2] ]
2021-07-24T00:17:46.3432166Z [cluster2] },
2021-07-24T00:17:46.3432642Z [cluster2] "privileged": true,
2021-07-24T00:17:46.3433340Z [cluster2] "readOnlyRootFilesystem": false,
2021-07-24T00:17:46.3434033Z [cluster2] "runAsNonRoot": false
2021-07-24T00:17:46.3434527Z [cluster2] },
2021-07-24T00:17:46.3435418Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-24T00:17:46.3436341Z [cluster2] "terminationMessagePolicy": "File",
2021-07-24T00:17:46.3437329Z [cluster2] "volumeMounts": [
2021-07-24T00:17:46.3437836Z [cluster2] {
2021-07-24T00:17:46.3438392Z [cluster2] "mountPath": "/etc/ipsec.d",
2021-07-24T00:17:46.3438980Z [cluster2] "name": "ipsecd"
2021-07-24T00:17:46.3439479Z [cluster2] },
2021-07-24T00:17:46.3439909Z [cluster2] {
2021-07-24T00:17:46.3440473Z [cluster2] "mountPath": "/var/lib/ipsec/nss",
2021-07-24T00:17:46.3441099Z [cluster2] "name": "ipsecnss"
2021-07-24T00:17:46.3441621Z [cluster2] },
2021-07-24T00:17:46.3442066Z [cluster2] {
2021-07-24T00:17:46.3442806Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-24T00:17:46.3444092Z [cluster2] "name": "submariner-gateway-token-v4pnh",
2021-07-24T00:17:46.3444926Z [cluster2] "readOnly": true
2021-07-24T00:17:46.3445548Z [cluster2] }
2021-07-24T00:17:46.3445943Z [cluster2] ]
2021-07-24T00:17:46.3446343Z [cluster2] }
2021-07-24T00:17:46.3446727Z [cluster2] ],
2021-07-24T00:17:46.3447244Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-24T00:17:46.3447902Z [cluster2] "enableServiceLinks": true,
2021-07-24T00:17:46.3448533Z [cluster2] "hostNetwork": true,
2021-07-24T00:17:46.3449300Z [cluster2] "nodeName": "cluster2-worker",
2021-07-24T00:17:46.3449967Z [cluster2] "nodeSelector": {
2021-07-24T00:17:46.3450570Z [cluster2] "submariner.io/gateway": "true"
2021-07-24T00:17:46.3451078Z [cluster2] },
2021-07-24T00:17:46.3451762Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-24T00:17:46.3452471Z [cluster2] "priority": 0,
2021-07-24T00:17:46.3453017Z [cluster2] "restartPolicy": "Always",
2021-07-24T00:17:46.3453880Z [cluster2] "schedulerName": "default-scheduler",
2021-07-24T00:17:46.3454766Z [cluster2] "securityContext": {},
2021-07-24T00:17:46.3455644Z [cluster2] "serviceAccount": "submariner-gateway",
2021-07-24T00:17:46.3456685Z [cluster2] "serviceAccountName": "submariner-gateway",
2021-07-24T00:17:46.3457641Z [cluster2] "terminationGracePeriodSeconds": 1,
2021-07-24T00:17:46.3458592Z [cluster2] "tolerations": [
2021-07-24T00:17:46.3459086Z [cluster2] {
2021-07-24T00:17:46.3459587Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3460102Z [cluster2] },
2021-07-24T00:17:46.3460516Z [cluster2] {
2021-07-24T00:17:46.3461050Z [cluster2] "effect": "NoExecute",
2021-07-24T00:17:46.3461937Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-24T00:17:46.3462649Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3463156Z [cluster2] },
2021-07-24T00:17:46.3463573Z [cluster2] {
2021-07-24T00:17:46.3464098Z [cluster2] "effect": "NoExecute",
2021-07-24T00:17:46.3464823Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-24T00:17:46.3465545Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3466034Z [cluster2] },
2021-07-24T00:17:46.3466460Z [cluster2] {
2021-07-24T00:17:46.3466974Z [cluster2] "effect": "NoSchedule",
2021-07-24T00:17:46.3467926Z [cluster2] "key": "node.kubernetes.io/disk-pressure",
2021-07-24T00:17:46.3468665Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3469167Z [cluster2] },
2021-07-24T00:17:46.3469580Z [cluster2] {
2021-07-24T00:17:46.3470116Z [cluster2] "effect": "NoSchedule",
2021-07-24T00:17:46.3471093Z [cluster2] "key": "node.kubernetes.io/memory-pressure",
2021-07-24T00:17:46.3471849Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3472444Z [cluster2] },
2021-07-24T00:17:46.3472861Z [cluster2] {
2021-07-24T00:17:46.3473394Z [cluster2] "effect": "NoSchedule",
2021-07-24T00:17:46.3474332Z [cluster2] "key": "node.kubernetes.io/pid-pressure",
2021-07-24T00:17:46.3475081Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3475568Z [cluster2] },
2021-07-24T00:17:46.3475999Z [cluster2] {
2021-07-24T00:17:46.3476520Z [cluster2] "effect": "NoSchedule",
2021-07-24T00:17:46.3477289Z [cluster2] "key": "node.kubernetes.io/unschedulable",
2021-07-24T00:17:46.3478037Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3478523Z [cluster2] },
2021-07-24T00:17:46.3478948Z [cluster2] {
2021-07-24T00:17:46.3479465Z [cluster2] "effect": "NoSchedule",
2021-07-24T00:17:46.3480481Z [cluster2] "key": "node.kubernetes.io/network-unavailable",
2021-07-24T00:17:46.3481280Z [cluster2] "operator": "Exists"
2021-07-24T00:17:46.3481782Z [cluster2] }
2021-07-24T00:17:46.3482191Z [cluster2] ],
2021-07-24T00:17:46.3482651Z [cluster2] "volumes": [
2021-07-24T00:17:46.3483095Z [cluster2] {
2021-07-24T00:17:46.3483586Z [cluster2] "emptyDir": {},
2021-07-24T00:17:46.3484127Z [cluster2] "name": "ipsecd"
2021-07-24T00:17:46.3484592Z [cluster2] },
2021-07-24T00:17:46.3485019Z [cluster2] {
2021-07-24T00:17:46.3485621Z [cluster2] "emptyDir": {},
2021-07-24T00:17:46.3486273Z [cluster2] "name": "ipsecnss"
2021-07-24T00:17:46.3486751Z [cluster2] },
2021-07-24T00:17:46.3487177Z [cluster2] {
2021-07-24T00:17:46.3488224Z [cluster2] "name": "submariner-gateway-token-v4pnh",
2021-07-24T00:17:46.3534873Z [cluster2] "secret": {
2021-07-24T00:17:46.3535392Z [cluster2] "defaultMode": 420,
2021-07-24T00:17:46.3536729Z [cluster2] "secretName": "submariner-gateway-token-v4pnh"
2021-07-24T00:17:46.3537551Z [cluster2] }
2021-07-24T00:17:46.3537971Z [cluster2] }
2021-07-24T00:17:46.3538403Z [cluster2] ]
2021-07-24T00:17:46.3538809Z [cluster2] },
2021-07-24T00:17:46.3539255Z [cluster2] "status": {
2021-07-24T00:17:46.3539851Z [cluster2] "conditions": [
2021-07-24T00:17:46.3540301Z [cluster2] {
2021-07-24T00:17:46.3540791Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:46.3541650Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:39Z",
2021-07-24T00:17:46.3542250Z [cluster2] "status": "True",
2021-07-24T00:17:46.3542782Z [cluster2] "type": "Initialized"
2021-07-24T00:17:46.3543251Z [cluster2] },
2021-07-24T00:17:46.3543654Z [cluster2] {
2021-07-24T00:17:46.3544162Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:46.3544998Z [cluster2] "lastTransitionTime": "2021-07-24T00:17:08Z",
2021-07-24T00:17:46.3545606Z [cluster2] "status": "True",
2021-07-24T00:17:46.3546279Z [cluster2] "type": "Ready"
2021-07-24T00:17:46.3546757Z [cluster2] },
2021-07-24T00:17:46.3547169Z [cluster2] {
2021-07-24T00:17:46.3547704Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:46.3548594Z [cluster2] "lastTransitionTime": "2021-07-24T00:17:08Z",
2021-07-24T00:17:46.3549253Z [cluster2] "status": "True",
2021-07-24T00:17:46.3549962Z [cluster2] "type": "ContainersReady"
2021-07-24T00:17:46.3550486Z [cluster2] },
2021-07-24T00:17:46.3550885Z [cluster2] {
2021-07-24T00:17:46.3551374Z [cluster2] "lastProbeTime": null,
2021-07-24T00:17:46.3552299Z [cluster2] "lastTransitionTime": "2021-07-24T00:16:38Z",
2021-07-24T00:17:46.3553036Z [cluster2] "status": "True",
2021-07-24T00:17:46.3553596Z [cluster2] "type": "PodScheduled"
2021-07-24T00:17:46.3554080Z [cluster2] }
2021-07-24T00:17:46.3554475Z [cluster2] ],
2021-07-24T00:17:46.3554979Z [cluster2] "containerStatuses": [
2021-07-24T00:17:46.3555496Z [cluster2] {
2021-07-24T00:17:46.3557116Z [cluster2] "containerID": "containerd://3b570302a038001439b7bda4b5fe16a16e587f8dd4238f6e85e4d01c19fb7c6b",
2021-07-24T00:17:46.3559170Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-24T00:17:46.3560957Z [cluster2] "imageID": "localhost:5000/submariner-gateway@sha256:5717397cd66d1c24de5c8a254b00a5666868d23a79300eb5573e2c7afdae19a9",
2021-07-24T00:17:46.3562090Z [clus
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment