Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 14, 2021 16:39
Show Gist options
  • Save dfarrell07/166e21ed519f7711c841d7b2fc9ab0eb to your computer and use it in GitHub Desktop.
Save dfarrell07/166e21ed519f7711c841d7b2fc9ab0eb to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail20210714-2
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-14T16:04:44.2441249Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-14T16:04:44.2441315Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-14T16:09:28.1979066Z Current runner version: '2.278.0'
2021-07-14T16:09:28.2005470Z ##[group]Operating System
2021-07-14T16:09:28.2006447Z Ubuntu
2021-07-14T16:09:28.2006905Z 20.04.2
2021-07-14T16:09:28.2007290Z LTS
2021-07-14T16:09:28.2007762Z ##[endgroup]
2021-07-14T16:09:28.2008599Z ##[group]Virtual Environment
2021-07-14T16:09:28.2009239Z Environment: ubuntu-20.04
2021-07-14T16:09:28.2009743Z Version: 20210628.1
2021-07-14T16:09:28.2010723Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210628.1/images/linux/Ubuntu2004-README.md
2021-07-14T16:09:28.2012002Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210628.1
2021-07-14T16:09:28.2012884Z ##[endgroup]
2021-07-14T16:09:28.2014730Z ##[group]GITHUB_TOKEN Permissions
2021-07-14T16:09:28.2015967Z Actions: write
2021-07-14T16:09:28.2016482Z Checks: write
2021-07-14T16:09:28.2017030Z Contents: write
2021-07-14T16:09:28.2017520Z Deployments: write
2021-07-14T16:09:28.2018172Z Discussions: write
2021-07-14T16:09:28.2018711Z Issues: write
2021-07-14T16:09:28.2019223Z Metadata: read
2021-07-14T16:09:28.2019735Z Packages: write
2021-07-14T16:09:28.2020288Z PullRequests: write
2021-07-14T16:09:28.2020868Z RepositoryProjects: write
2021-07-14T16:09:28.2021497Z SecurityEvents: write
2021-07-14T16:09:28.2022015Z Statuses: write
2021-07-14T16:09:28.2022822Z ##[endgroup]
2021-07-14T16:09:28.2025776Z Prepare workflow directory
2021-07-14T16:09:28.2626101Z Prepare all required actions
2021-07-14T16:09:28.2636808Z Getting action download info
2021-07-14T16:09:28.4318061Z Download action repository 'actions/checkout@v2'
2021-07-14T16:09:30.4086997Z Download action repository 'submariner-io/shipyard@devel'
2021-07-14T16:09:30.7260545Z ##[group]Run actions/checkout@v2
2021-07-14T16:09:30.7261197Z with:
2021-07-14T16:09:30.7261791Z repository: submariner-io/submariner-operator
2021-07-14T16:09:30.7262885Z token: ***
2021-07-14T16:09:30.7263316Z ssh-strict: true
2021-07-14T16:09:30.7263858Z persist-credentials: true
2021-07-14T16:09:30.7264399Z clean: true
2021-07-14T16:09:30.7264821Z fetch-depth: 1
2021-07-14T16:09:30.7265254Z lfs: false
2021-07-14T16:09:30.7265678Z submodules: false
2021-07-14T16:09:30.7266130Z ##[endgroup]
2021-07-14T16:09:30.9388791Z Syncing repository: submariner-io/submariner-operator
2021-07-14T16:09:30.9395999Z ##[group]Getting Git version info
2021-07-14T16:09:30.9397273Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-14T16:09:30.9492949Z [command]/usr/bin/git version
2021-07-14T16:09:30.9583311Z git version 2.32.0
2021-07-14T16:09:30.9608994Z ##[endgroup]
2021-07-14T16:09:30.9619149Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-14T16:09:30.9627328Z ##[group]Initializing the repository
2021-07-14T16:09:30.9634202Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-14T16:09:30.9700872Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-14T16:09:30.9701753Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-14T16:09:30.9702540Z hint: of your new repositories, which will suppress this warning, call:
2021-07-14T16:09:30.9703134Z hint:
2021-07-14T16:09:30.9703866Z hint: git config --global init.defaultBranch <name>
2021-07-14T16:09:30.9704411Z hint:
2021-07-14T16:09:30.9705300Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-14T16:09:30.9706286Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-14T16:09:30.9706910Z hint:
2021-07-14T16:09:30.9707670Z hint: git branch -m <name>
2021-07-14T16:09:30.9712193Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-14T16:09:30.9722212Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-14T16:09:30.9770618Z ##[endgroup]
2021-07-14T16:09:30.9771504Z ##[group]Disabling automatic garbage collection
2021-07-14T16:09:30.9778680Z [command]/usr/bin/git config --local gc.auto 0
2021-07-14T16:09:30.9810894Z ##[endgroup]
2021-07-14T16:09:30.9819026Z ##[group]Setting up auth
2021-07-14T16:09:30.9828609Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-14T16:09:30.9859406Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-14T16:09:31.0244480Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-14T16:09:31.0299508Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-14T16:09:31.0630536Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-14T16:09:31.0690483Z ##[endgroup]
2021-07-14T16:09:31.0707059Z ##[group]Fetching the repository
2021-07-14T16:09:31.0710009Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0aa05fdf1a4e6e49325ab6a9dad45eaa6a887e3c:refs/remotes/origin/devel
2021-07-14T16:09:31.2572318Z remote: Enumerating objects: 486, done.
2021-07-14T16:09:31.2573507Z remote: Counting objects: 0% (1/486)
2021-07-14T16:09:31.2575806Z remote: Counting objects: 1% (5/486)
2021-07-14T16:09:31.2576869Z remote: Counting objects: 2% (10/486)
2021-07-14T16:09:31.2577503Z remote: Counting objects: 3% (15/486)
2021-07-14T16:09:31.2578457Z remote: Counting objects: 4% (20/486)
2021-07-14T16:09:31.2579097Z remote: Counting objects: 5% (25/486)
2021-07-14T16:09:31.2579740Z remote: Counting objects: 6% (30/486)
2021-07-14T16:09:31.2580355Z remote: Counting objects: 7% (35/486)
2021-07-14T16:09:31.2581008Z remote: Counting objects: 8% (39/486)
2021-07-14T16:09:31.2581785Z remote: Counting objects: 9% (44/486)
2021-07-14T16:09:31.2582461Z remote: Counting objects: 10% (49/486)
2021-07-14T16:09:31.2583097Z remote: Counting objects: 11% (54/486)
2021-07-14T16:09:31.2583713Z remote: Counting objects: 12% (59/486)
2021-07-14T16:09:31.2584341Z remote: Counting objects: 13% (64/486)
2021-07-14T16:09:31.2585097Z remote: Counting objects: 14% (69/486)
2021-07-14T16:09:31.2585775Z remote: Counting objects: 15% (73/486)
2021-07-14T16:09:31.2586399Z remote: Counting objects: 16% (78/486)
2021-07-14T16:09:31.2587042Z remote: Counting objects: 17% (83/486)
2021-07-14T16:09:31.2587739Z remote: Counting objects: 18% (88/486)
2021-07-14T16:09:31.2588280Z remote: Counting objects: 19% (93/486)
2021-07-14T16:09:31.2588833Z remote: Counting objects: 20% (98/486)
2021-07-14T16:09:31.2589384Z remote: Counting objects: 21% (103/486)
2021-07-14T16:09:31.2589952Z remote: Counting objects: 22% (107/486)
2021-07-14T16:09:31.2590509Z remote: Counting objects: 23% (112/486)
2021-07-14T16:09:31.2591880Z remote: Counting objects: 24% (117/486)
2021-07-14T16:09:31.2592436Z remote: Counting objects: 25% (122/486)
2021-07-14T16:09:31.2593114Z remote: Counting objects: 26% (127/486)
2021-07-14T16:09:31.2593707Z remote: Counting objects: 27% (132/486)
2021-07-14T16:09:31.2594249Z remote: Counting objects: 28% (137/486)
2021-07-14T16:09:31.2594801Z remote: Counting objects: 29% (141/486)
2021-07-14T16:09:31.2595354Z remote: Counting objects: 30% (146/486)
2021-07-14T16:09:31.2596055Z remote: Counting objects: 31% (151/486)
2021-07-14T16:09:31.2596633Z remote: Counting objects: 32% (156/486)
2021-07-14T16:09:31.2597181Z remote: Counting objects: 33% (161/486)
2021-07-14T16:09:31.2597724Z remote: Counting objects: 34% (166/486)
2021-07-14T16:09:31.2598455Z remote: Counting objects: 35% (171/486)
2021-07-14T16:09:31.2599012Z remote: Counting objects: 36% (175/486)
2021-07-14T16:09:31.2599549Z remote: Counting objects: 37% (180/486)
2021-07-14T16:09:31.2600102Z remote: Counting objects: 38% (185/486)
2021-07-14T16:09:31.2600643Z remote: Counting objects: 39% (190/486)
2021-07-14T16:09:31.2601190Z remote: Counting objects: 40% (195/486)
2021-07-14T16:09:31.2601733Z remote: Counting objects: 41% (200/486)
2021-07-14T16:09:31.2602290Z remote: Counting objects: 42% (205/486)
2021-07-14T16:09:31.2602831Z remote: Counting objects: 43% (209/486)
2021-07-14T16:09:31.2603383Z remote: Counting objects: 44% (214/486)
2021-07-14T16:09:31.2603933Z remote: Counting objects: 45% (219/486)
2021-07-14T16:09:31.2604604Z remote: Counting objects: 46% (224/486)
2021-07-14T16:09:31.2605165Z remote: Counting objects: 47% (229/486)
2021-07-14T16:09:31.2605751Z remote: Counting objects: 48% (234/486)
2021-07-14T16:09:31.2606302Z remote: Counting objects: 49% (239/486)
2021-07-14T16:09:31.2606963Z remote: Counting objects: 50% (243/486)
2021-07-14T16:09:31.2607641Z remote: Counting objects: 51% (248/486)
2021-07-14T16:09:31.2608357Z remote: Counting objects: 52% (253/486)
2021-07-14T16:09:31.2609042Z remote: Counting objects: 53% (258/486)
2021-07-14T16:09:31.2609639Z remote: Counting objects: 54% (263/486)
2021-07-14T16:09:31.2610178Z remote: Counting objects: 55% (268/486)
2021-07-14T16:09:31.2612511Z remote: Counting objects: 56% (273/486)
2021-07-14T16:09:31.2613082Z remote: Counting objects: 57% (278/486)
2021-07-14T16:09:31.2613638Z remote: Counting objects: 58% (282/486)
2021-07-14T16:09:31.2614186Z remote: Counting objects: 59% (287/486)
2021-07-14T16:09:31.2614749Z remote: Counting objects: 60% (292/486)
2021-07-14T16:09:31.2615315Z remote: Counting objects: 61% (297/486)
2021-07-14T16:09:31.2615856Z remote: Counting objects: 62% (302/486)
2021-07-14T16:09:31.2616472Z remote: Counting objects: 63% (307/486)
2021-07-14T16:09:31.2617221Z remote: Counting objects: 64% (312/486)
2021-07-14T16:09:31.2617775Z remote: Counting objects: 65% (316/486)
2021-07-14T16:09:31.2618502Z remote: Counting objects: 66% (321/486)
2021-07-14T16:09:31.2619094Z remote: Counting objects: 67% (326/486)
2021-07-14T16:09:31.2619648Z remote: Counting objects: 68% (331/486)
2021-07-14T16:09:31.2620188Z remote: Counting objects: 69% (336/486)
2021-07-14T16:09:31.2620751Z remote: Counting objects: 70% (341/486)
2021-07-14T16:09:31.2621294Z remote: Counting objects: 71% (346/486)
2021-07-14T16:09:31.2621850Z remote: Counting objects: 72% (350/486)
2021-07-14T16:09:31.2622390Z remote: Counting objects: 73% (355/486)
2021-07-14T16:09:31.2622954Z remote: Counting objects: 74% (360/486)
2021-07-14T16:09:31.2623510Z remote: Counting objects: 75% (365/486)
2021-07-14T16:09:31.2624055Z remote: Counting objects: 76% (370/486)
2021-07-14T16:09:31.2624729Z remote: Counting objects: 77% (375/486)
2021-07-14T16:09:31.2625286Z remote: Counting objects: 78% (380/486)
2021-07-14T16:09:31.2625889Z remote: Counting objects: 79% (384/486)
2021-07-14T16:09:31.2626425Z remote: Counting objects: 80% (389/486)
2021-07-14T16:09:31.2626984Z remote: Counting objects: 81% (394/486)
2021-07-14T16:09:31.2627524Z remote: Counting objects: 82% (399/486)
2021-07-14T16:09:31.2628085Z remote: Counting objects: 83% (404/486)
2021-07-14T16:09:31.2628642Z remote: Counting objects: 84% (409/486)
2021-07-14T16:09:31.2629182Z remote: Counting objects: 85% (414/486)
2021-07-14T16:09:31.2629877Z remote: Counting objects: 86% (418/486)
2021-07-14T16:09:31.2630552Z remote: Counting objects: 87% (423/486)
2021-07-14T16:09:31.2631154Z remote: Counting objects: 88% (428/486)
2021-07-14T16:09:31.2631695Z remote: Counting objects: 89% (433/486)
2021-07-14T16:09:31.2632250Z remote: Counting objects: 90% (438/486)
2021-07-14T16:09:31.2632794Z remote: Counting objects: 91% (443/486)
2021-07-14T16:09:31.2633349Z remote: Counting objects: 92% (448/486)
2021-07-14T16:09:31.2633900Z remote: Counting objects: 93% (452/486)
2021-07-14T16:09:31.2634433Z remote: Counting objects: 94% (457/486)
2021-07-14T16:09:31.2634984Z remote: Counting objects: 95% (462/486)
2021-07-14T16:09:31.2635536Z remote: Counting objects: 96% (467/486)
2021-07-14T16:09:31.2636090Z remote: Counting objects: 97% (472/486)
2021-07-14T16:09:31.2636626Z remote: Counting objects: 98% (477/486)
2021-07-14T16:09:31.2637177Z remote: Counting objects: 99% (482/486)
2021-07-14T16:09:31.2637714Z remote: Counting objects: 100% (486/486)
2021-07-14T16:09:31.2638418Z remote: Counting objects: 100% (486/486), done.
2021-07-14T16:09:31.2639061Z remote: Compressing objects: 0% (1/347)
2021-07-14T16:09:31.2639642Z remote: Compressing objects: 1% (4/347)
2021-07-14T16:09:31.2640605Z remote: Compressing objects: 2% (7/347)
2021-07-14T16:09:31.2641296Z remote: Compressing objects: 3% (11/347)
2021-07-14T16:09:31.2642002Z remote: Compressing objects: 4% (14/347)
2021-07-14T16:09:31.2642705Z remote: Compressing objects: 5% (18/347)
2021-07-14T16:09:31.2643393Z remote: Compressing objects: 6% (21/347)
2021-07-14T16:09:31.2644226Z remote: Compressing objects: 7% (25/347)
2021-07-14T16:09:31.2644936Z remote: Compressing objects: 8% (28/347)
2021-07-14T16:09:31.2645677Z remote: Compressing objects: 9% (32/347)
2021-07-14T16:09:31.2646378Z remote: Compressing objects: 10% (35/347)
2021-07-14T16:09:31.2647073Z remote: Compressing objects: 11% (39/347)
2021-07-14T16:09:31.2647962Z remote: Compressing objects: 12% (42/347)
2021-07-14T16:09:31.2648667Z remote: Compressing objects: 13% (46/347)
2021-07-14T16:09:31.2649379Z remote: Compressing objects: 14% (49/347)
2021-07-14T16:09:31.2650083Z remote: Compressing objects: 15% (53/347)
2021-07-14T16:09:31.2650765Z remote: Compressing objects: 16% (56/347)
2021-07-14T16:09:31.2651466Z remote: Compressing objects: 17% (59/347)
2021-07-14T16:09:31.2652155Z remote: Compressing objects: 18% (63/347)
2021-07-14T16:09:31.2652870Z remote: Compressing objects: 19% (66/347)
2021-07-14T16:09:31.2653577Z remote: Compressing objects: 20% (70/347)
2021-07-14T16:09:31.2654265Z remote: Compressing objects: 21% (73/347)
2021-07-14T16:09:31.2654968Z remote: Compressing objects: 22% (77/347)
2021-07-14T16:09:31.2655780Z remote: Compressing objects: 23% (80/347)
2021-07-14T16:09:31.2656481Z remote: Compressing objects: 24% (84/347)
2021-07-14T16:09:31.2657188Z remote: Compressing objects: 25% (87/347)
2021-07-14T16:09:31.2657875Z remote: Compressing objects: 26% (91/347)
2021-07-14T16:09:31.2658571Z remote: Compressing objects: 27% (94/347)
2021-07-14T16:09:31.2659522Z remote: Compressing objects: 28% (98/347)
2021-07-14T16:09:31.2660217Z remote: Compressing objects: 29% (101/347)
2021-07-14T16:09:31.2660955Z remote: Compressing objects: 30% (105/347)
2021-07-14T16:09:31.2661656Z remote: Compressing objects: 31% (108/347)
2021-07-14T16:09:31.2662367Z remote: Compressing objects: 32% (112/347)
2021-07-14T16:09:31.2663078Z remote: Compressing objects: 33% (115/347)
2021-07-14T16:09:31.2663775Z remote: Compressing objects: 34% (118/347)
2021-07-14T16:09:31.2664495Z remote: Compressing objects: 35% (122/347)
2021-07-14T16:09:31.2669702Z remote: Compressing objects: 36% (125/347)
2021-07-14T16:09:31.2672561Z remote: Compressing objects: 37% (129/347)
2021-07-14T16:09:31.2680691Z remote: Compressing objects: 38% (132/347)
2021-07-14T16:09:31.2685423Z remote: Compressing objects: 39% (136/347)
2021-07-14T16:09:31.2699751Z remote: Compressing objects: 40% (139/347)
2021-07-14T16:09:31.3714875Z remote: Compressing objects: 41% (143/347)
2021-07-14T16:09:31.3719468Z remote: Compressing objects: 42% (146/347)
2021-07-14T16:09:31.3722902Z remote: Compressing objects: 43% (150/347)
2021-07-14T16:09:31.3724192Z remote: Compressing objects: 44% (153/347)
2021-07-14T16:09:31.3727068Z remote: Compressing objects: 45% (157/347)
2021-07-14T16:09:31.3728441Z remote: Compressing objects: 46% (160/347)
2021-07-14T16:09:31.3730489Z remote: Compressing objects: 47% (164/347)
2021-07-14T16:09:31.3732666Z remote: Compressing objects: 48% (167/347)
2021-07-14T16:09:31.3733798Z remote: Compressing objects: 49% (171/347)
2021-07-14T16:09:31.3736002Z remote: Compressing objects: 50% (174/347)
2021-07-14T16:09:31.3738088Z remote: Compressing objects: 51% (177/347)
2021-07-14T16:09:31.3740236Z remote: Compressing objects: 52% (181/347)
2021-07-14T16:09:31.3742613Z remote: Compressing objects: 53% (184/347)
2021-07-14T16:09:31.3743756Z remote: Compressing objects: 54% (188/347)
2021-07-14T16:09:31.3745768Z remote: Compressing objects: 55% (191/347)
2021-07-14T16:09:31.3747405Z remote: Compressing objects: 56% (195/347)
2021-07-14T16:09:31.3748875Z remote: Compressing objects: 57% (198/347)
2021-07-14T16:09:31.3750737Z remote: Compressing objects: 58% (202/347)
2021-07-14T16:09:31.3752195Z remote: Compressing objects: 59% (205/347)
2021-07-14T16:09:31.3753736Z remote: Compressing objects: 60% (209/347)
2021-07-14T16:09:31.3755064Z remote: Compressing objects: 61% (212/347)
2021-07-14T16:09:31.3756394Z remote: Compressing objects: 62% (216/347)
2021-07-14T16:09:31.3757711Z remote: Compressing objects: 63% (219/347)
2021-07-14T16:09:31.3758804Z remote: Compressing objects: 64% (223/347)
2021-07-14T16:09:31.3759890Z remote: Compressing objects: 65% (226/347)
2021-07-14T16:09:31.3761087Z remote: Compressing objects: 66% (230/347)
2021-07-14T16:09:31.3762115Z remote: Compressing objects: 67% (233/347)
2021-07-14T16:09:31.3763886Z remote: Compressing objects: 68% (236/347)
2021-07-14T16:09:31.3765614Z remote: Compressing objects: 69% (240/347)
2021-07-14T16:09:31.3766526Z remote: Compressing objects: 70% (243/347)
2021-07-14T16:09:31.3767376Z remote: Compressing objects: 71% (247/347)
2021-07-14T16:09:31.3768685Z remote: Compressing objects: 72% (250/347)
2021-07-14T16:09:31.3769812Z remote: Compressing objects: 73% (254/347)
2021-07-14T16:09:31.3770569Z remote: Compressing objects: 74% (257/347)
2021-07-14T16:09:31.3771383Z remote: Compressing objects: 75% (261/347)
2021-07-14T16:09:31.3772107Z remote: Compressing objects: 76% (264/347)
2021-07-14T16:09:31.3772804Z remote: Compressing objects: 77% (268/347)
2021-07-14T16:09:31.3773574Z remote: Compressing objects: 78% (271/347)
2021-07-14T16:09:31.3774305Z remote: Compressing objects: 79% (275/347)
2021-07-14T16:09:31.3775017Z remote: Compressing objects: 80% (278/347)
2021-07-14T16:09:31.3775769Z remote: Compressing objects: 81% (282/347)
2021-07-14T16:09:31.3776470Z remote: Compressing objects: 82% (285/347)
2021-07-14T16:09:31.3777251Z remote: Compressing objects: 83% (289/347)
2021-07-14T16:09:31.3777992Z remote: Compressing objects: 84% (292/347)
2021-07-14T16:09:31.3778705Z remote: Compressing objects: 85% (295/347)
2021-07-14T16:09:31.3779407Z remote: Compressing objects: 86% (299/347)
2021-07-14T16:09:31.3780481Z remote: Compressing objects: 87% (302/347)
2021-07-14T16:09:31.3781195Z remote: Compressing objects: 88% (306/347)
2021-07-14T16:09:31.3781898Z remote: Compressing objects: 89% (309/347)
2021-07-14T16:09:31.3782695Z remote: Compressing objects: 90% (313/347)
2021-07-14T16:09:31.3783383Z remote: Compressing objects: 91% (316/347)
2021-07-14T16:09:31.3784090Z remote: Compressing objects: 92% (320/347)
2021-07-14T16:09:31.3784825Z remote: Compressing objects: 93% (323/347)
2021-07-14T16:09:31.3785530Z remote: Compressing objects: 94% (327/347)
2021-07-14T16:09:31.3786317Z remote: Compressing objects: 95% (330/347)
2021-07-14T16:09:31.3787053Z remote: Compressing objects: 96% (334/347)
2021-07-14T16:09:31.3787751Z remote: Compressing objects: 97% (337/347)
2021-07-14T16:09:31.3788460Z remote: Compressing objects: 98% (341/347)
2021-07-14T16:09:31.3789180Z remote: Compressing objects: 99% (344/347)
2021-07-14T16:09:31.3789979Z remote: Compressing objects: 100% (347/347)
2021-07-14T16:09:31.3790717Z remote: Compressing objects: 100% (347/347), done.
2021-07-14T16:09:31.3791399Z Receiving objects: 0% (1/486)
2021-07-14T16:09:31.3792014Z Receiving objects: 1% (5/486)
2021-07-14T16:09:31.3792614Z Receiving objects: 2% (10/486)
2021-07-14T16:09:31.3793249Z Receiving objects: 3% (15/486)
2021-07-14T16:09:31.3793903Z Receiving objects: 4% (20/486)
2021-07-14T16:09:31.3794499Z Receiving objects: 5% (25/486)
2021-07-14T16:09:31.3795128Z Receiving objects: 6% (30/486)
2021-07-14T16:09:31.3795723Z Receiving objects: 7% (35/486)
2021-07-14T16:09:31.3796552Z Receiving objects: 8% (39/486)
2021-07-14T16:09:31.3797219Z Receiving objects: 9% (44/486)
2021-07-14T16:09:31.3797832Z Receiving objects: 10% (49/486)
2021-07-14T16:09:31.3798458Z Receiving objects: 11% (54/486)
2021-07-14T16:09:31.3799098Z Receiving objects: 12% (59/486)
2021-07-14T16:09:31.3799720Z Receiving objects: 13% (64/486)
2021-07-14T16:09:31.3800432Z Receiving objects: 14% (69/486)
2021-07-14T16:09:31.3801058Z Receiving objects: 15% (73/486)
2021-07-14T16:09:31.3801721Z Receiving objects: 16% (78/486)
2021-07-14T16:09:31.3802323Z Receiving objects: 17% (83/486)
2021-07-14T16:09:31.3803043Z Receiving objects: 18% (88/486)
2021-07-14T16:09:31.3803665Z Receiving objects: 19% (93/486)
2021-07-14T16:09:31.3804263Z Receiving objects: 20% (98/486)
2021-07-14T16:09:31.3804909Z Receiving objects: 21% (103/486)
2021-07-14T16:09:31.3805542Z Receiving objects: 22% (107/486)
2021-07-14T16:09:31.3806170Z Receiving objects: 23% (112/486)
2021-07-14T16:09:31.3806956Z Receiving objects: 24% (117/486)
2021-07-14T16:09:31.3807574Z Receiving objects: 25% (122/486)
2021-07-14T16:09:31.3810115Z Receiving objects: 26% (127/486)
2021-07-14T16:09:31.3810817Z Receiving objects: 27% (132/486)
2021-07-14T16:09:31.3811620Z Receiving objects: 28% (137/486)
2021-07-14T16:09:31.3812245Z Receiving objects: 29% (141/486)
2021-07-14T16:09:31.3812975Z Receiving objects: 30% (146/486)
2021-07-14T16:09:31.3813488Z Receiving objects: 31% (151/486)
2021-07-14T16:09:31.3813982Z Receiving objects: 32% (156/486)
2021-07-14T16:09:31.3814530Z Receiving objects: 33% (161/486)
2021-07-14T16:09:31.3815154Z Receiving objects: 34% (166/486)
2021-07-14T16:09:31.3815786Z Receiving objects: 35% (171/486)
2021-07-14T16:09:31.3816406Z Receiving objects: 36% (175/486)
2021-07-14T16:09:31.3817008Z Receiving objects: 37% (180/486)
2021-07-14T16:09:31.3817619Z Receiving objects: 38% (185/486)
2021-07-14T16:09:31.3818236Z Receiving objects: 39% (190/486)
2021-07-14T16:09:31.3818853Z Receiving objects: 40% (195/486)
2021-07-14T16:09:31.3819559Z Receiving objects: 41% (200/486)
2021-07-14T16:09:31.3820170Z Receiving objects: 42% (205/486)
2021-07-14T16:09:31.3820788Z Receiving objects: 43% (209/486)
2021-07-14T16:09:31.3821400Z Receiving objects: 44% (214/486)
2021-07-14T16:09:31.3822023Z Receiving objects: 45% (219/486)
2021-07-14T16:09:31.3822919Z Receiving objects: 46% (224/486)
2021-07-14T16:09:31.3823531Z Receiving objects: 47% (229/486)
2021-07-14T16:09:31.3824152Z Receiving objects: 48% (234/486)
2021-07-14T16:09:31.3824756Z Receiving objects: 49% (239/486)
2021-07-14T16:09:31.3825371Z Receiving objects: 50% (243/486)
2021-07-14T16:09:31.3825986Z Receiving objects: 51% (248/486)
2021-07-14T16:09:31.3826579Z Receiving objects: 52% (253/486)
2021-07-14T16:09:31.3827208Z Receiving objects: 53% (258/486)
2021-07-14T16:09:31.3827805Z Receiving objects: 54% (263/486)
2021-07-14T16:09:31.3828427Z Receiving objects: 55% (268/486)
2021-07-14T16:09:31.3829042Z Receiving objects: 56% (273/486)
2021-07-14T16:09:31.3829724Z Receiving objects: 57% (278/486)
2021-07-14T16:09:31.3830353Z Receiving objects: 58% (282/486)
2021-07-14T16:09:31.3830949Z Receiving objects: 59% (287/486)
2021-07-14T16:09:31.3831568Z Receiving objects: 60% (292/486)
2021-07-14T16:09:31.3832182Z Receiving objects: 61% (297/486)
2021-07-14T16:09:31.3832809Z Receiving objects: 62% (302/486)
2021-07-14T16:09:31.3833519Z Receiving objects: 63% (307/486)
2021-07-14T16:09:31.3834112Z Receiving objects: 64% (312/486)
2021-07-14T16:09:31.3834727Z Receiving objects: 65% (316/486)
2021-07-14T16:09:31.3835347Z Receiving objects: 66% (321/486)
2021-07-14T16:09:31.3835942Z Receiving objects: 67% (326/486)
2021-07-14T16:09:31.3836559Z Receiving objects: 68% (331/486)
2021-07-14T16:09:31.3837164Z Receiving objects: 69% (336/486)
2021-07-14T16:09:31.3837786Z Receiving objects: 70% (341/486)
2021-07-14T16:09:31.3838425Z Receiving objects: 71% (346/486)
2021-07-14T16:09:31.3839029Z Receiving objects: 72% (350/486)
2021-07-14T16:09:31.3839915Z Receiving objects: 73% (355/486)
2021-07-14T16:09:31.3840552Z Receiving objects: 74% (360/486)
2021-07-14T16:09:31.3841178Z Receiving objects: 75% (365/486)
2021-07-14T16:09:31.3841789Z Receiving objects: 76% (370/486)
2021-07-14T16:09:31.3842386Z Receiving objects: 77% (375/486)
2021-07-14T16:09:31.3843014Z Receiving objects: 78% (380/486)
2021-07-14T16:09:31.3843703Z Receiving objects: 79% (384/486)
2021-07-14T16:09:31.3844330Z Receiving objects: 80% (389/486)
2021-07-14T16:09:31.3844961Z Receiving objects: 81% (394/486)
2021-07-14T16:09:31.3845566Z Receiving objects: 82% (399/486)
2021-07-14T16:09:31.3846186Z Receiving objects: 83% (404/486)
2021-07-14T16:09:31.3846789Z Receiving objects: 84% (409/486)
2021-07-14T16:09:31.3847403Z Receiving objects: 85% (414/486)
2021-07-14T16:09:31.3848160Z Receiving objects: 86% (418/486)
2021-07-14T16:09:31.3848771Z Receiving objects: 87% (423/486)
2021-07-14T16:09:31.3849394Z Receiving objects: 88% (428/486)
2021-07-14T16:09:31.3850074Z Receiving objects: 89% (433/486)
2021-07-14T16:09:31.3850704Z Receiving objects: 90% (438/486)
2021-07-14T16:09:31.3851321Z Receiving objects: 91% (443/486)
2021-07-14T16:09:31.3851920Z Receiving objects: 92% (448/486)
2021-07-14T16:09:31.3852562Z Receiving objects: 93% (452/486)
2021-07-14T16:09:31.3853162Z Receiving objects: 94% (457/486)
2021-07-14T16:09:31.3853847Z Receiving objects: 95% (462/486)
2021-07-14T16:09:31.3855473Z remote: Total 486 (delta 156), reused 304 (delta 93), pack-reused 0
2021-07-14T16:09:31.3856207Z Receiving objects: 96% (467/486)
2021-07-14T16:09:31.3856831Z Receiving objects: 97% (472/486)
2021-07-14T16:09:31.3857433Z Receiving objects: 98% (477/486)
2021-07-14T16:09:31.3858060Z Receiving objects: 99% (482/486)
2021-07-14T16:09:31.3858691Z Receiving objects: 100% (486/486)
2021-07-14T16:09:31.3859370Z Receiving objects: 100% (486/486), 347.46 KiB | 13.90 MiB/s, done.
2021-07-14T16:09:31.3860048Z Resolving deltas: 0% (0/156)
2021-07-14T16:09:31.3860650Z Resolving deltas: 1% (2/156)
2021-07-14T16:09:31.3861362Z Resolving deltas: 2% (4/156)
2021-07-14T16:09:31.3861980Z Resolving deltas: 3% (5/156)
2021-07-14T16:09:31.3862577Z Resolving deltas: 4% (7/156)
2021-07-14T16:09:31.3863200Z Resolving deltas: 5% (8/156)
2021-07-14T16:09:31.3863816Z Resolving deltas: 6% (10/156)
2021-07-14T16:09:31.3864417Z Resolving deltas: 7% (11/156)
2021-07-14T16:09:31.3865342Z Resolving deltas: 8% (13/156)
2021-07-14T16:09:31.3865945Z Resolving deltas: 9% (15/156)
2021-07-14T16:09:31.3866561Z Resolving deltas: 10% (16/156)
2021-07-14T16:09:31.3867154Z Resolving deltas: 11% (18/156)
2021-07-14T16:09:31.3867763Z Resolving deltas: 12% (19/156)
2021-07-14T16:09:31.3868370Z Resolving deltas: 13% (21/156)
2021-07-14T16:09:31.3868961Z Resolving deltas: 14% (22/156)
2021-07-14T16:09:31.3869576Z Resolving deltas: 15% (24/156)
2021-07-14T16:09:31.3870165Z Resolving deltas: 16% (25/156)
2021-07-14T16:09:31.3870772Z Resolving deltas: 17% (27/156)
2021-07-14T16:09:31.3871446Z Resolving deltas: 18% (29/156)
2021-07-14T16:09:31.3872049Z Resolving deltas: 19% (30/156)
2021-07-14T16:09:31.3872653Z Resolving deltas: 20% (32/156)
2021-07-14T16:09:31.3873242Z Resolving deltas: 21% (33/156)
2021-07-14T16:09:31.3873846Z Resolving deltas: 22% (35/156)
2021-07-14T16:09:31.3874443Z Resolving deltas: 23% (36/156)
2021-07-14T16:09:31.3875145Z Resolving deltas: 24% (38/156)
2021-07-14T16:09:31.3875752Z Resolving deltas: 25% (39/156)
2021-07-14T16:09:31.3876352Z Resolving deltas: 26% (41/156)
2021-07-14T16:09:31.3877008Z Resolving deltas: 27% (43/156)
2021-07-14T16:09:31.3877611Z Resolving deltas: 28% (44/156)
2021-07-14T16:09:31.3878220Z Resolving deltas: 29% (46/156)
2021-07-14T16:09:31.3878816Z Resolving deltas: 30% (47/156)
2021-07-14T16:09:31.3879403Z Resolving deltas: 31% (49/156)
2021-07-14T16:09:31.3880007Z Resolving deltas: 32% (50/156)
2021-07-14T16:09:31.3880607Z Resolving deltas: 33% (52/156)
2021-07-14T16:09:31.3881201Z Resolving deltas: 34% (54/156)
2021-07-14T16:09:31.3882043Z Resolving deltas: 35% (55/156)
2021-07-14T16:09:31.3882656Z Resolving deltas: 36% (57/156)
2021-07-14T16:09:31.3883257Z Resolving deltas: 37% (58/156)
2021-07-14T16:09:31.3883864Z Resolving deltas: 38% (60/156)
2021-07-14T16:09:31.3884452Z Resolving deltas: 39% (61/156)
2021-07-14T16:09:31.3885048Z Resolving deltas: 40% (63/156)
2021-07-14T16:09:31.3885889Z Resolving deltas: 41% (64/156)
2021-07-14T16:09:31.3886495Z Resolving deltas: 42% (66/156)
2021-07-14T16:09:31.3887092Z Resolving deltas: 43% (68/156)
2021-07-14T16:09:31.3887696Z Resolving deltas: 44% (69/156)
2021-07-14T16:09:31.3888512Z Resolving deltas: 45% (71/156)
2021-07-14T16:09:31.3889105Z Resolving deltas: 46% (72/156)
2021-07-14T16:09:31.3889717Z Resolving deltas: 47% (74/156)
2021-07-14T16:09:31.3890318Z Resolving deltas: 48% (75/156)
2021-07-14T16:09:31.3890915Z Resolving deltas: 49% (77/156)
2021-07-14T16:09:31.3891517Z Resolving deltas: 50% (78/156)
2021-07-14T16:09:31.3892101Z Resolving deltas: 51% (80/156)
2021-07-14T16:09:31.3892707Z Resolving deltas: 52% (82/156)
2021-07-14T16:09:31.3893316Z Resolving deltas: 53% (83/156)
2021-07-14T16:09:31.3893939Z Resolving deltas: 54% (85/156)
2021-07-14T16:09:31.3894552Z Resolving deltas: 55% (86/156)
2021-07-14T16:09:31.3895149Z Resolving deltas: 56% (88/156)
2021-07-14T16:09:31.3895766Z Resolving deltas: 57% (89/156)
2021-07-14T16:09:31.3896389Z Resolving deltas: 58% (91/156)
2021-07-14T16:09:31.3896981Z Resolving deltas: 59% (93/156)
2021-07-14T16:09:31.3897584Z Resolving deltas: 60% (94/156)
2021-07-14T16:09:31.3898170Z Resolving deltas: 61% (96/156)
2021-07-14T16:09:31.3898771Z Resolving deltas: 62% (97/156)
2021-07-14T16:09:31.3899373Z Resolving deltas: 63% (99/156)
2021-07-14T16:09:31.3899957Z Resolving deltas: 64% (100/156)
2021-07-14T16:09:31.3900559Z Resolving deltas: 65% (102/156)
2021-07-14T16:09:31.3901147Z Resolving deltas: 66% (104/156)
2021-07-14T16:09:31.3901746Z Resolving deltas: 67% (105/156)
2021-07-14T16:09:31.3902353Z Resolving deltas: 68% (107/156)
2021-07-14T16:09:31.3902959Z Resolving deltas: 69% (108/156)
2021-07-14T16:09:31.3903575Z Resolving deltas: 70% (110/156)
2021-07-14T16:09:31.3904166Z Resolving deltas: 71% (111/156)
2021-07-14T16:09:31.3904776Z Resolving deltas: 72% (113/156)
2021-07-14T16:09:31.3905382Z Resolving deltas: 73% (114/156)
2021-07-14T16:09:31.3905971Z Resolving deltas: 74% (116/156)
2021-07-14T16:09:31.3906789Z Resolving deltas: 75% (117/156)
2021-07-14T16:09:31.3907377Z Resolving deltas: 76% (119/156)
2021-07-14T16:09:31.3907981Z Resolving deltas: 77% (121/156)
2021-07-14T16:09:31.3908593Z Resolving deltas: 78% (122/156)
2021-07-14T16:09:31.3909188Z Resolving deltas: 79% (124/156)
2021-07-14T16:09:31.3909792Z Resolving deltas: 80% (125/156)
2021-07-14T16:09:31.3910382Z Resolving deltas: 81% (127/156)
2021-07-14T16:09:31.3910984Z Resolving deltas: 82% (128/156)
2021-07-14T16:09:31.3911610Z Resolving deltas: 83% (130/156)
2021-07-14T16:09:31.3912212Z Resolving deltas: 84% (132/156)
2021-07-14T16:09:31.3912827Z Resolving deltas: 85% (133/156)
2021-07-14T16:09:31.3913416Z Resolving deltas: 86% (135/156)
2021-07-14T16:09:31.3914022Z Resolving deltas: 87% (136/156)
2021-07-14T16:09:31.3914632Z Resolving deltas: 88% (138/156)
2021-07-14T16:09:31.3915225Z Resolving deltas: 89% (139/156)
2021-07-14T16:09:31.3915824Z Resolving deltas: 90% (141/156)
2021-07-14T16:09:31.3916417Z Resolving deltas: 91% (142/156)
2021-07-14T16:09:31.3917030Z Resolving deltas: 92% (144/156)
2021-07-14T16:09:31.3917637Z Resolving deltas: 93% (146/156)
2021-07-14T16:09:31.3918226Z Resolving deltas: 94% (147/156)
2021-07-14T16:09:31.3918898Z Resolving deltas: 95% (149/156)
2021-07-14T16:09:31.3919482Z Resolving deltas: 96% (150/156)
2021-07-14T16:09:31.3920095Z Resolving deltas: 97% (152/156)
2021-07-14T16:09:31.3920699Z Resolving deltas: 98% (153/156)
2021-07-14T16:09:31.3921283Z Resolving deltas: 99% (155/156)
2021-07-14T16:09:31.3921889Z Resolving deltas: 100% (156/156)
2021-07-14T16:09:31.3922512Z Resolving deltas: 100% (156/156), done.
2021-07-14T16:09:31.3924400Z From https://github.com/submariner-io/submariner-operator
2021-07-14T16:09:31.3925779Z * [new ref] 0aa05fdf1a4e6e49325ab6a9dad45eaa6a887e3c -> origin/devel
2021-07-14T16:09:31.3927129Z ##[endgroup]
2021-07-14T16:09:31.3928202Z ##[group]Determining the checkout info
2021-07-14T16:09:31.3929205Z ##[endgroup]
2021-07-14T16:09:31.3939287Z ##[group]Checking out the ref
2021-07-14T16:09:31.4013003Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-14T16:09:31.4014544Z Switched to a new branch 'devel'
2021-07-14T16:09:31.4015682Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-14T16:09:31.4017025Z ##[endgroup]
2021-07-14T16:09:31.4017968Z [command]/usr/bin/git log -1 --format='%H'
2021-07-14T16:09:31.4019119Z '0aa05fdf1a4e6e49325ab6a9dad45eaa6a887e3c'
2021-07-14T16:09:31.4184228Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-14T16:09:31.4184929Z ##[endgroup]
2021-07-14T16:09:31.4379632Z ##[group]Reclaiming free space
2021-07-14T16:09:44.3913929Z Filesystem Size Used Avail Use% Mounted on
2021-07-14T16:09:44.3916836Z /dev/root 84G 41G 43G 49% /
2021-07-14T16:09:44.3920804Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-14T16:09:44.3921437Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-14T16:09:44.3921931Z tmpfs 696M 1.1M 695M 1% /run
2021-07-14T16:09:44.3922375Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-14T16:09:44.3922896Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-14T16:09:44.3923406Z /dev/loop0 56M 56M 0 100% /snap/core18/2074
2021-07-14T16:09:44.3923930Z /dev/loop1 68M 68M 0 100% /snap/lxd/20326
2021-07-14T16:09:44.3924452Z /dev/loop2 56M 56M 0 100% /snap/core18/2066
2021-07-14T16:09:44.3925049Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-14T16:09:44.3925560Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-14T16:09:44.3926123Z /dev/sda15 105M 7.9M 97M 8% /boot/efi
2021-07-14T16:09:44.3926522Z /dev/sdb1 14G 4.1G 9.0G 32% /mnt
2021-07-14T16:09:44.3927672Z ##[endgroup]
2021-07-14T16:09:44.4092995Z ##[group]Disable swap
2021-07-14T16:09:44.4388574Z ##[endgroup]
2021-07-14T16:09:44.4525390Z ##[group]Report available RAM
2021-07-14T16:09:44.4550705Z total used free shared buff/cache available
2021-07-14T16:09:44.4551481Z Mem: 6.8Gi 472Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-14T16:09:44.4551970Z Swap: 0B 0B 0B
2021-07-14T16:09:44.4552458Z ##[endgroup]
2021-07-14T16:09:44.4720482Z Downloading Makefile.dapper
2021-07-14T16:09:44.4984562Z Downloading dapper
2021-07-14T16:09:44.6110907Z .dapper.tmp version v0.5.6
2021-07-14T16:09:44.6145165Z Downloading Dockerfile.dapper
2021-07-14T16:09:44.6369022Z docker network create -d bridge kind
2021-07-14T16:09:44.9502645Z 60f8e3d8c27c37c8527936fa4f5ef1206e56e2e774001979eb291b5c64473ba2
2021-07-14T16:09:44.9523091Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-14T16:09:45.1657267Z Sending build context to Docker daemon 7.514MB
2021-07-14T16:09:45.1658232Z
2021-07-14T16:09:45.1730210Z Step 1/8 : ARG BASE_BRANCH
2021-07-14T16:09:45.1741949Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-14T16:09:45.4719352Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-14T16:09:45.4720604Z b1495d80d526: Pulling fs layer
2021-07-14T16:09:45.4721324Z ddb139a01732: Pulling fs layer
2021-07-14T16:09:45.4725483Z 39df7eb7380d: Pulling fs layer
2021-07-14T16:09:45.4725966Z c0fe454e56fd: Pulling fs layer
2021-07-14T16:09:45.4726520Z fb7cbb68a468: Pulling fs layer
2021-07-14T16:09:45.4727045Z ad9bf639bb4f: Pulling fs layer
2021-07-14T16:09:45.4727512Z 80c3983fcf2e: Pulling fs layer
2021-07-14T16:09:45.4728258Z 1458a8fea605: Pulling fs layer
2021-07-14T16:09:45.4728749Z c0fe454e56fd: Waiting
2021-07-14T16:09:45.4729228Z fb7cbb68a468: Waiting
2021-07-14T16:09:45.4729678Z ad9bf639bb4f: Waiting
2021-07-14T16:09:45.4730143Z 80c3983fcf2e: Waiting
2021-07-14T16:09:45.4730556Z 1458a8fea605: Waiting
2021-07-14T16:09:46.0819097Z b1495d80d526: Verifying Checksum
2021-07-14T16:09:46.0819854Z b1495d80d526: Download complete
2021-07-14T16:09:46.0994625Z 39df7eb7380d: Verifying Checksum
2021-07-14T16:09:46.0999205Z 39df7eb7380d: Download complete
2021-07-14T16:09:46.1701227Z c0fe454e56fd: Verifying Checksum
2021-07-14T16:09:46.1701917Z c0fe454e56fd: Download complete
2021-07-14T16:09:46.2021513Z fb7cbb68a468: Verifying Checksum
2021-07-14T16:09:46.2022478Z fb7cbb68a468: Download complete
2021-07-14T16:09:46.2795412Z 80c3983fcf2e: Verifying Checksum
2021-07-14T16:09:46.2796187Z 80c3983fcf2e: Download complete
2021-07-14T16:09:46.2858737Z ad9bf639bb4f: Verifying Checksum
2021-07-14T16:09:46.2859514Z ad9bf639bb4f: Download complete
2021-07-14T16:09:46.3819639Z 1458a8fea605: Download complete
2021-07-14T16:09:48.2979390Z ddb139a01732: Verifying Checksum
2021-07-14T16:09:48.2983735Z ddb139a01732: Download complete
2021-07-14T16:09:49.2856490Z b1495d80d526: Pull complete
2021-07-14T16:09:59.8448987Z ddb139a01732: Pull complete
2021-07-14T16:10:01.1361044Z 39df7eb7380d: Pull complete
2021-07-14T16:10:01.2050357Z c0fe454e56fd: Pull complete
2021-07-14T16:10:01.2696335Z fb7cbb68a468: Pull complete
2021-07-14T16:10:01.4281079Z ad9bf639bb4f: Pull complete
2021-07-14T16:10:01.4915706Z 80c3983fcf2e: Pull complete
2021-07-14T16:10:01.5822671Z 1458a8fea605: Pull complete
2021-07-14T16:10:01.5856797Z Digest: sha256:ffd2825bc97b24a1d03e4d53de76a58fbd5ce44cb795c9b1f571a035a65c3d38
2021-07-14T16:10:01.5880510Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-14T16:10:01.5890322Z ---> 655a9f35d3cf
2021-07-14T16:10:01.5890753Z Step 3/8 : ARG PROJECT
2021-07-14T16:10:01.6045128Z ---> Running in fbb879c461c3
2021-07-14T16:10:02.5083894Z Removing intermediate container fbb879c461c3
2021-07-14T16:10:02.5085130Z ---> f95552396645
2021-07-14T16:10:02.5086621Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-14T16:10:02.5248526Z ---> Running in 28a6fb9f8100
2021-07-14T16:10:03.4573007Z Removing intermediate container 28a6fb9f8100
2021-07-14T16:10:03.4574543Z ---> eb826bd6309c
2021-07-14T16:10:03.4575114Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-14T16:10:03.4790146Z ---> Running in 0a37cd5737b6
2021-07-14T16:10:04.3685084Z Removing intermediate container 0a37cd5737b6
2021-07-14T16:10:04.3803195Z ---> 771ac3c05f36
2021-07-14T16:10:04.3851503Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-14T16:10:04.4010448Z ---> Running in 498623bbf4e6
2021-07-14T16:10:05.2955562Z Removing intermediate container 498623bbf4e6
2021-07-14T16:10:05.2956797Z ---> 142ced4b9805
2021-07-14T16:10:05.2957393Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-14T16:10:05.3173066Z ---> Running in f3cb50f87a3e
2021-07-14T16:10:06.2250528Z Removing intermediate container f3cb50f87a3e
2021-07-14T16:10:06.2251739Z ---> cf93545fa7a6
2021-07-14T16:10:06.2252100Z Step 8/8 : CMD ["sh"]
2021-07-14T16:10:06.2420462Z ---> Running in bbb3977f6d0c
2021-07-14T16:10:07.1076771Z Removing intermediate container bbb3977f6d0c
2021-07-14T16:10:07.1077966Z ---> bff7ec8aa1c9
2021-07-14T16:10:07.1193845Z Successfully built bff7ec8aa1c9
2021-07-14T16:10:07.1253499Z Successfully tagged submariner-operator:devel
2021-07-14T16:10:07.6045718Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-14T16:10:07.6058125Z [submariner-operator]$ mkdir -p bin dist output
2021-07-14T16:10:07.6086324Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-14T16:10:07.6086923Z GNU Make 4.3
2021-07-14T16:10:07.6088474Z Built for x86_64-redhat-linux-gnu
2021-07-14T16:10:07.6089360Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-14T16:10:07.6092172Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-14T16:10:07.6093255Z This is free software: you are free to change and redistribute it.
2021-07-14T16:10:07.6094052Z There is NO WARRANTY, to the extent permitted by law.
2021-07-14T16:10:07.6094679Z Reading makefiles...
2021-07-14T16:10:07.7192925Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-14T16:10:07.7193907Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-14T16:10:07.9213924Z Updating makefiles....
2021-07-14T16:10:07.9220789Z Updating goal targets....
2021-07-14T16:10:07.9221913Z File 'upgrade-e2e' does not exist.
2021-07-14T16:10:07.9226919Z File 'deploy-latest' does not exist.
2021-07-14T16:10:07.9227598Z Must remake target 'deploy-latest'.
2021-07-14T16:10:07.9228533Z curl -L get.submariner.io | VERSION=latest bash
2021-07-14T16:10:07.9322199Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-14T16:10:07.9322904Z Dload Upload Total Spent Left Speed
2021-07-14T16:10:07.9323246Z
2021-07-14T16:10:07.9851703Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-14T16:10:07.9852398Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-14T16:10:08.1128866Z
2021-07-14T16:10:08.1130252Z 100 4155 0 4155 0 0 22829 0 --:--:-- --:--:-- --:--:-- 22829
2021-07-14T16:10:08.2258035Z Installing subctl version latest
2021-07-14T16:10:08.2259782Z OS detected: linux
2021-07-14T16:10:08.2260872Z Architecture detected: amd64
2021-07-14T16:10:08.2262742Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-14T16:10:08.2263596Z
2021-07-14T16:10:08.2264050Z Downloading...
2021-07-14T16:10:09.2782777Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-14T16:10:09.3129192Z This provides subctl version: v0.9.1
2021-07-14T16:10:09.3149471Z
2021-07-14T16:10:09.3150273Z please update your path (and consider adding it to ~/.profile):
2021-07-14T16:10:09.3150872Z export PATH=$PATH:/root/.local/bin
2021-07-14T16:10:09.3151260Z
2021-07-14T16:10:09.3229669Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-14T16:10:09.3261193Z GNU Make 4.3
2021-07-14T16:10:09.3262006Z Built for x86_64-redhat-linux-gnu
2021-07-14T16:10:09.3262711Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-14T16:10:09.3263442Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-14T16:10:09.3264210Z This is free software: you are free to change and redistribute it.
2021-07-14T16:10:09.3264877Z There is NO WARRANTY, to the extent permitted by law.
2021-07-14T16:10:09.3268868Z Reading makefiles...
2021-07-14T16:10:09.3269841Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-14T16:10:09.4366711Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-14T16:10:09.4367755Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-14T16:10:09.6407541Z Updating makefiles....
2021-07-14T16:10:09.6417155Z Updating goal targets....
2021-07-14T16:10:09.6418238Z File 'clusters' does not exist.
2021-07-14T16:10:09.6418858Z Must remake target 'clusters'.
2021-07-14T16:10:09.6420027Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:10:09.6450605Z Downloading shflags 1.0.3
2021-07-14T16:10:09.6507714Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-14T16:10:09.6508403Z Dload Upload Total Spent Left Speed
2021-07-14T16:10:09.6508742Z
2021-07-14T16:10:09.6686452Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-14T16:10:09.6687238Z 100 31091 100 31091 0 0 1686k 0 --:--:-- --:--:-- --:--:-- 1686k
2021-07-14T16:10:09.7293526Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-14T16:10:09.7317505Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-14T16:10:09.7328984Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:10:09.7340429Z [submariner-operator]$ script_name=utils
2021-07-14T16:10:09.7351078Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:10:09.7369313Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-14T16:10:09.7380549Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:10:09.7391840Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:10:09.7402208Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:10:09.7420520Z [submariner-operator]$ broker=cluster1
2021-07-14T16:10:09.7430680Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-14T16:10:09.7442131Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-14T16:10:09.7455923Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-14T16:10:09.7466796Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-14T16:10:09.7477412Z [submariner-operator]$ declare -gA cluster_subm
2021-07-14T16:10:09.7489620Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-14T16:10:09.7498621Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-14T16:10:09.7510041Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-14T16:10:09.7521446Z [submariner-operator]$ declare -gA cluster_cni
2021-07-14T16:10:09.7532906Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-14T16:10:09.7544357Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-14T16:10:09.7557477Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:10:09.7566435Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:10:09.7577215Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:10:09.7586727Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:10:09.7605192Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-14T16:10:09.7617133Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-14T16:10:09.7644305Z [submariner-operator]$ cat <<EOM
2021-07-14T16:10:09.7645584Z Cluster settings::
2021-07-14T16:10:09.7646135Z broker - ${broker@Q}
2021-07-14T16:10:09.7646658Z clusters - ${clusters[*]@Q}
2021-07-14T16:10:09.7647279Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-14T16:10:09.7648287Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-14T16:10:09.7649135Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-14T16:10:09.7649696Z EOM
2021-07-14T16:10:09.7667530Z [submariner-operator]$ typeset -p cluster_cni
2021-07-14T16:10:09.7681993Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:10:09.7710902Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-14T16:10:09.7725916Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:10:09.7756463Z [submariner-operator]$ typeset -p cluster_subm
2021-07-14T16:10:09.7771178Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:10:09.7792650Z Cluster settings::
2021-07-14T16:10:09.7793329Z broker - 'cluster1'
2021-07-14T16:10:09.7793889Z clusters - 'cluster1' 'cluster2'
2021-07-14T16:10:09.7794546Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-14T16:10:09.7795717Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-14T16:10:09.7796852Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-14T16:10:09.7808823Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-14T16:10:09.7827397Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-14T16:10:09.7850395Z [submariner-operator]$ run_local_registry
2021-07-14T16:10:09.7859230Z [submariner-operator]$ run_local_registry
2021-07-14T16:10:09.7871081Z [submariner-operator]$ registry_running
2021-07-14T16:10:09.7879400Z [submariner-operator]$ registry_running
2021-07-14T16:10:09.7891921Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-14T16:10:09.7903234Z [submariner-operator]$ grep kind-registry
2021-07-14T16:10:10.0298174Z [submariner-operator]$ return 0
2021-07-14T16:10:10.0307398Z Deploying local registry kind-registry to serve images centrally.
2021-07-14T16:10:10.0314825Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-14T16:10:10.0325954Z [submariner-operator]$ selinuxenabled
2021-07-14T16:10:10.0348217Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-14T16:10:10.2812480Z Unable to find image 'registry:2' locally
2021-07-14T16:10:10.4429573Z 2: Pulling from library/registry
2021-07-14T16:10:10.5121362Z ddad3d7c1e96: Already exists
2021-07-14T16:10:10.5220518Z 6eda6749503f: Pulling fs layer
2021-07-14T16:10:10.5220997Z 363ab70c2143: Pulling fs layer
2021-07-14T16:10:10.5221414Z 5b94580856e6: Pulling fs layer
2021-07-14T16:10:10.5221883Z 12008541203a: Pulling fs layer
2021-07-14T16:10:10.5222457Z 12008541203a: Waiting
2021-07-14T16:10:10.5848507Z 6eda6749503f: Verifying Checksum
2021-07-14T16:10:10.5849323Z 6eda6749503f: Download complete
2021-07-14T16:10:10.5856044Z 5b94580856e6: Verifying Checksum
2021-07-14T16:10:10.5856711Z 5b94580856e6: Download complete
2021-07-14T16:10:10.6455997Z 363ab70c2143: Verifying Checksum
2021-07-14T16:10:10.6456553Z 363ab70c2143: Download complete
2021-07-14T16:10:10.6749811Z 12008541203a: Verifying Checksum
2021-07-14T16:10:10.6750316Z 12008541203a: Download complete
2021-07-14T16:10:10.9348673Z 6eda6749503f: Pull complete
2021-07-14T16:10:11.2358808Z 363ab70c2143: Pull complete
2021-07-14T16:10:11.3094774Z 5b94580856e6: Pull complete
2021-07-14T16:10:11.3794275Z 12008541203a: Pull complete
2021-07-14T16:10:11.3840831Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-14T16:10:11.3846109Z Status: Downloaded newer image for registry:2
2021-07-14T16:10:11.4080987Z d412f4a16271320a85fb6376cdbb35457fa6f423981f154b6a4f5c2a443fee9f
2021-07-14T16:10:11.7209911Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-14T16:10:12.0814320Z [submariner-operator]$ declare_cidrs
2021-07-14T16:10:12.0822765Z [submariner-operator]$ declare_cidrs
2021-07-14T16:10:12.0831044Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-14T16:10:12.0839564Z [submariner-operator]$ i=1
2021-07-14T16:10:12.0848611Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:10:12.0858633Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:10:12.0866984Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-14T16:10:12.0876108Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-14T16:10:12.0884838Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-14T16:10:12.0893448Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:10:12.0899072Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:10:12.0911991Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-14T16:10:12.0923105Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-14T16:10:12.0934951Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-14T16:10:12.0953049Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-14T16:10:12.0954007Z [submariner-operator]$ [cluster2] wait 290
2021-07-14T16:10:12.0963490Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-14T16:10:12.0975038Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-14T16:10:12.0984315Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-14T16:10:12.0997102Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:10:12.1013940Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:10:12.1030843Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:10:12.1034779Z [submariner-operator]$ [cluster1] pids[cluster1]=299
2021-07-14T16:10:12.1041766Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-14T16:10:12.1054560Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:10:12.1060780Z [submariner-operator]$ [cluster2] pids[cluster2]=303
2021-07-14T16:10:12.1082524Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:10:12.1087716Z [submariner-operator]$ [cluster2] wait 303
2021-07-14T16:10:12.1099556Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-14T16:10:12.1111468Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:12:00.9498750Z [submariner-operator]$ [cluster1] with_retries
2021-07-14T16:12:00.9500226Z [submariner-operator]$ [cluster1] iteration=1
2021-07-14T16:12:00.9501832Z [submariner-operator]$ [cluster1] wait 318
2021-07-14T16:12:00.9502944Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-14T16:12:00.9504187Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-14T16:12:00.9505948Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:00.9507966Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:00.9509456Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-14T16:12:00.9511881Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-14T16:12:00.9512503Z [cluster1] No kind clusters found.
2021-07-14T16:12:00.9512992Z [cluster1] Creating KIND cluster...
2021-07-14T16:12:00.9513784Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-14T16:12:00.9514695Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-14T16:12:00.9515579Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-14T16:12:00.9516390Z [submariner-operator]$ [cluster1] nodes=
2021-07-14T16:12:00.9517225Z [cluster1] - role: control-plane
2021-07-14T16:12:00.9517962Z [submariner-operator]$ [cluster1] nodes=
2021-07-14T16:12:00.9518639Z [cluster1] - role: control-plane
2021-07-14T16:12:00.9519247Z [cluster1] - role: worker
2021-07-14T16:12:00.9519912Z [submariner-operator]$ [cluster1] nodes=
2021-07-14T16:12:00.9520599Z [cluster1] - role: control-plane
2021-07-14T16:12:00.9521288Z [cluster1] - role: worker
2021-07-14T16:12:00.9521834Z [cluster1] - role: worker
2021-07-14T16:12:00.9522332Z [cluster1] 
2021-07-14T16:12:00.9522804Z [cluster1] 
2021-07-14T16:12:00.9523491Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-14T16:12:00.9524787Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-14T16:12:00.9526064Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-14T16:12:00.9526972Z [submariner-operator]$ [cluster1] kind version
2021-07-14T16:12:00.9527601Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-14T16:12:00.9528895Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-14T16:12:00.9529946Z [cluster1] ---
2021-07-14T16:12:00.9530343Z [cluster1] kind: Cluster
2021-07-14T16:12:00.9531012Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-14T16:12:00.9531549Z [cluster1] networking:
2021-07-14T16:12:00.9532040Z [cluster1] disableDefaultCNI: true
2021-07-14T16:12:00.9532564Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-14T16:12:00.9533036Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-14T16:12:00.9533636Z [cluster1] containerdConfigPatches:
2021-07-14T16:12:00.9534397Z [cluster1] - |-
2021-07-14T16:12:00.9535135Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-14T16:12:00.9536181Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-14T16:12:00.9536863Z [cluster1] kubeadmConfigPatches:
2021-07-14T16:12:00.9537445Z [cluster1] - |
2021-07-14T16:12:00.9537961Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-14T16:12:00.9538593Z [cluster1] kind: ClusterConfiguration
2021-07-14T16:12:00.9539169Z [cluster1] metadata:
2021-07-14T16:12:00.9539594Z [cluster1] name: config
2021-07-14T16:12:00.9540112Z [cluster1] networking:
2021-07-14T16:12:00.9540562Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-14T16:12:00.9541036Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-14T16:12:00.9541572Z [cluster1] dnsDomain: cluster1.local
2021-07-14T16:12:00.9542031Z [cluster1] nodes:
2021-07-14T16:12:00.9542619Z [cluster1] - role: control-plane
2021-07-14T16:12:00.9543188Z [cluster1] - role: worker
2021-07-14T16:12:00.9543842Z [cluster1] - role: worker
2021-07-14T16:12:00.9545065Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-14T16:12:00.9546106Z [cluster1] Creating cluster "cluster1" ...
2021-07-14T16:12:00.9547924Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-14T16:12:00.9548826Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-14T16:12:00.9549564Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-14T16:12:00.9550185Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-14T16:12:00.9550841Z [cluster1] • Writing configuration 📜 ...
2021-07-14T16:12:00.9551498Z [cluster1] ✓ Writing configuration 📜
2021-07-14T16:12:00.9552201Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-14T16:12:00.9552885Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-14T16:12:00.9553589Z [cluster1] • Installing StorageClass 💾 ...
2021-07-14T16:12:00.9554307Z [cluster1] ✓ Installing StorageClass 💾
2021-07-14T16:12:00.9554966Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-14T16:12:00.9555603Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-14T16:12:00.9556295Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-14T16:12:00.9556872Z [cluster1] You can now use your cluster with:
2021-07-14T16:12:00.9557296Z [cluster1]
2021-07-14T16:12:00.9557972Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-14T16:12:00.9558485Z [cluster1]
2021-07-14T16:12:00.9559026Z [cluster1] Thanks for using kind! 😊
2021-07-14T16:12:00.9559757Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-14T16:12:00.9560622Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-14T16:12:00.9561974Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-14T16:12:00.9563228Z [submariner-operator]$ [cluster1] head -n 1
2021-07-14T16:12:12.8310950Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: h[submariner-operator]$ [cluster2] with_retries
2021-07-14T16:12:12.8312214Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:12:12.8313054Z [submariner-operator]$ [cluster2] wait 324
2021-07-14T16:12:12.8313889Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-14T16:12:12.8314844Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-14T16:12:12.8316503Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:12.8318323Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:12.8319875Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-14T16:12:12.8320760Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-14T16:12:12.8321387Z [cluster2] No kind clusters found.
2021-07-14T16:12:12.8321885Z [cluster2] Creating KIND cluster...
2021-07-14T16:12:12.8322681Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-14T16:12:12.8323596Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-14T16:12:12.8324562Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-14T16:12:12.8325367Z [submariner-operator]$ [cluster2] nodes=
2021-07-14T16:12:12.8326084Z [cluster2] - role: control-plane
2021-07-14T16:12:12.8326810Z [submariner-operator]$ [cluster2] nodes=
2021-07-14T16:12:12.8327489Z [cluster2] - role: control-plane
2021-07-14T16:12:12.8328581Z [cluster2] - role: worker
2021-07-14T16:12:12.8329254Z [submariner-operator]$ [cluster2] nodes=
2021-07-14T16:12:12.8329947Z [cluster2] - role: control-plane
2021-07-14T16:12:12.8330515Z [cluster2] - role: worker
2021-07-14T16:12:12.8331060Z [cluster2] - role: worker
2021-07-14T16:12:12.8331737Z [cluster2] 
2021-07-14T16:12:12.8332211Z [cluster2] 
2021-07-14T16:12:12.8333041Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-14T16:12:12.8334197Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-14T16:12:12.8335412Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-14T16:12:12.8336313Z [submariner-operator]$ [cluster2] kind version
2021-07-14T16:12:12.8336910Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-14T16:12:12.8337986Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-14T16:12:12.8338842Z [cluster2] ---
2021-07-14T16:12:12.8339225Z [cluster2] kind: Cluster
2021-07-14T16:12:12.8339879Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-14T16:12:12.8340395Z [cluster2] networking:
2021-07-14T16:12:12.8340903Z [cluster2] disableDefaultCNI: true
2021-07-14T16:12:12.8341430Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-14T16:12:12.8341915Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-14T16:12:12.8342515Z [cluster2] containerdConfigPatches:
2021-07-14T16:12:12.8343133Z [cluster2] - |-
2021-07-14T16:12:12.8343847Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-14T16:12:12.8344907Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-14T16:12:12.8345584Z [cluster2] kubeadmConfigPatches:
2021-07-14T16:12:12.8346171Z [cluster2] - |
2021-07-14T16:12:12.8346672Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-14T16:12:12.8347289Z [cluster2] kind: ClusterConfiguration
2021-07-14T16:12:12.8347801Z [cluster2] metadata:
2021-07-14T16:12:12.8348202Z [cluster2] name: config
2021-07-14T16:12:12.8348625Z [cluster2] networking:
2021-07-14T16:12:12.8349061Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-14T16:12:12.8349547Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-14T16:12:12.8350091Z [cluster2] dnsDomain: cluster2.local
2021-07-14T16:12:12.8350542Z [cluster2] nodes:
2021-07-14T16:12:12.8352014Z [cluster2] - role: control-plane
2021-07-14T16:12:12.8352606Z [cluster2] - role: worker
2021-07-14T16:12:12.8353137Z [cluster2] - role: worker
2021-07-14T16:12:12.8354367Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-14T16:12:12.8355577Z [cluster2] Creating cluster "cluster2" ...
2021-07-14T16:12:12.8356513Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-14T16:12:12.8357338Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-14T16:12:12.8358118Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-14T16:12:12.8359092Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-14T16:12:12.8359774Z [cluster2] • Writing configuration 📜 ...
2021-07-14T16:12:12.8360430Z [cluster2] ✓ Writing configuration 📜
2021-07-14T16:12:12.8361167Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-14T16:12:12.8361857Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-14T16:12:12.8362562Z [cluster2] • Installing StorageClass 💾 ...
2021-07-14T16:12:12.8363269Z [cluster2] ✓ Installing StorageClass 💾
2021-07-14T16:12:12.8363926Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-14T16:12:12.8364555Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-14T16:12:12.8365247Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-14T16:12:12.8365854Z [cluster2] You can now use your cluster with:
2021-07-14T16:12:12.8366279Z [cluster2]
2021-07-14T16:12:12.8366939Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-14T16:12:12.8367448Z [cluster2]
2021-07-14T16:12:12.8368176Z [cluster2] Thanks for using kind! 😊
2021-07-14T16:12:12.8368935Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-14T16:12:12.8369810Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-14T16:12:12.8371171Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-14T16:12:12.8372553Z [submariner-operator]$ [cluster2] head -n 1
2021-07-14T16:12:37.6696058Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6698179Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6700133Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6711095Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6713406Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6715376Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:12:37.6716731Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-14T16:12:37.6717614Z [submariner-operator]$ [cluster1] wait 1511
2021-07-14T16:12:37.6718518Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-14T16:12:37.6719406Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-14T16:12:37.6720221Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-14T16:12:37.6721088Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-14T16:12:37.6721959Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-14T16:12:37.6722825Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-14T16:12:37.6723444Z [cluster1] Applying weave network...
2021-07-14T16:12:37.6724672Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-14T16:12:37.6726617Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-14T16:12:37.6729736Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-14T16:12:37.6731052Z [cluster1] serviceaccount/weave-net created
2021-07-14T16:12:37.6732116Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:37.6733576Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:37.6734954Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:37.6736148Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:37.6737174Z [cluster1] daemonset.apps/weave-net created
2021-07-14T16:12:37.6737921Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-14T16:12:37.6739040Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:37.6740419Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:37.6741928Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:37.6743050Z [cluster1] pod/weave-net-hgfmw condition met
2021-07-14T16:12:37.6743803Z [cluster1] pod/weave-net-tdv22 condition met
2021-07-14T16:12:37.6744552Z [cluster1] pod/weave-net-x5vf4 condition met
2021-07-14T16:12:37.6745481Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-14T16:12:37.6746533Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:37.6747765Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:37.6749124Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:37.6750212Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-14T16:12:37.6751160Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-14T16:12:37.6759062Z [cluster1] deployment "coredns" successfully rolled out
2021-07-14T16:12:37.6760175Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:12:44.3093720Z ttps:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3095682Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3097640Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3099622Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3101727Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3103682Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:12:44.3104897Z [submariner-operator]$ [cluster2] wait 1651
2021-07-14T16:12:44.3105791Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-14T16:12:44.3106766Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-14T16:12:44.3107811Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-14T16:12:44.3108952Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-14T16:12:44.3109851Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-14T16:12:44.3110741Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-14T16:12:44.3111598Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-14T16:12:44.3112245Z [cluster2] Applying weave network...
2021-07-14T16:12:44.3113450Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-14T16:12:44.3115081Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-14T16:12:44.3116816Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-14T16:12:44.3118060Z [cluster2] serviceaccount/weave-net created
2021-07-14T16:12:44.3119129Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:44.3120581Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:44.3121919Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:44.3123101Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-14T16:12:44.3124130Z [cluster2] daemonset.apps/weave-net created
2021-07-14T16:12:44.3124880Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-14T16:12:44.3126133Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:44.3127514Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:44.3156104Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-14T16:12:44.3157473Z [cluster2] pod/weave-net-dcff5 condition met
2021-07-14T16:12:44.3158230Z [cluster2] pod/weave-net-lnpkw condition met
2021-07-14T16:12:44.3158986Z [cluster2] pod/weave-net-tfr9q condition met
2021-07-14T16:12:44.3159771Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-14T16:12:44.3160804Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:44.3162061Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:44.3163401Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-14T16:12:44.3164495Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-14T16:12:44.3165429Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-14T16:12:44.3166237Z [cluster2] deployment "coredns" successfully rolled out
2021-07-14T16:12:44.3167054Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:12:44.3189435Z [submariner-operator]$ [cluster2] wait 299
2021-07-14T16:12:44.3190332Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-14T16:12:44.3191249Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-14T16:12:44.3201574Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-14T16:12:44.3202386Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-14T16:12:44.3202861Z
2021-07-14T16:12:44.3203675Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-14T16:12:44.3204239Z
2021-07-14T16:12:44.3205000Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-14T16:12:44.3205413Z
2021-07-14T16:12:44.3206134Z To clean everthing up, just run: make clean-clusters
2021-07-14T16:12:44.3206973Z EOM
2021-07-14T16:12:44.3225063Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-14T16:12:44.3225576Z
2021-07-14T16:12:44.3226611Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-14T16:12:44.3228788Z
2021-07-14T16:12:44.3229512Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-14T16:12:44.3229933Z
2021-07-14T16:12:44.3230511Z To clean everthing up, just run: make clean-clusters
2021-07-14T16:12:44.3231274Z Successfully remade target file 'clusters'.
2021-07-14T16:12:44.3231921Z File 'bin/subctl' does not exist.
2021-07-14T16:12:44.3232731Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-14T16:12:44.3246080Z File 'generate-embeddedyamls' does not exist.
2021-07-14T16:12:44.3247101Z File 'generate' does not exist.
2021-07-14T16:12:44.3249690Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-14T16:12:44.3250694Z File 'vendor/modules.txt' does not exist.
2021-07-14T16:12:44.3251392Z Must remake target 'vendor/modules.txt'.
2021-07-14T16:12:44.3251939Z go mod download
2021-07-14T16:13:31.0795764Z go mod vendor
2021-07-14T16:13:33.0616546Z go mod tidy
2021-07-14T16:13:33.7331679Z Successfully remade target file 'vendor/modules.txt'.
2021-07-14T16:13:33.7332796Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-14T16:13:33.7334288Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-14T16:13:33.7375079Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-14T16:13:52.4729129Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-14T16:13:52.4730212Z Must remake target 'generate'.
2021-07-14T16:13:52.4751837Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-14T16:14:03.8688732Z Successfully remade target file 'generate'.
2021-07-14T16:14:03.8689793Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-14T16:14:03.8697257Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-14T16:14:03.8703224Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-14T16:14:03.8704807Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-14T16:14:06.0342935Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-14T16:14:06.0348078Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-14T16:14:06.0349117Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-14T16:14:06.0350906Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-14T16:14:07.3331624Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-14T16:14:07.3447711Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-14T16:14:07.3448904Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-14T16:14:07.9863862Z Generating yamls.go
2021-07-14T16:14:07.9869129Z deploy/crds/submariner.io_brokers.yaml
2021-07-14T16:14:07.9872736Z deploy/crds/submariner.io_submariners.yaml
2021-07-14T16:14:07.9902010Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-14T16:14:07.9904843Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-14T16:14:07.9908258Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-14T16:14:07.9914427Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-14T16:14:07.9920366Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-14T16:14:07.9927337Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-14T16:14:07.9936701Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-14T16:14:07.9943433Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-14T16:14:07.9952892Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-14T16:14:07.9961397Z config/broker/broker-admin/service_account.yaml
2021-07-14T16:14:07.9964672Z config/broker/broker-admin/role.yaml
2021-07-14T16:14:07.9967325Z config/broker/broker-admin/role_binding.yaml
2021-07-14T16:14:08.9700175Z [submariner-operator]$ mkdir -p bin
2021-07-14T16:14:08.9701207Z config/broker/broker-client/service_account.yaml
2021-07-14T16:14:08.9704083Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-14T16:14:08.9705894Z config/broker/broker-client/role.yaml
2021-07-14T16:14:08.9706790Z config/broker/broker-client/role_binding.yaml
2021-07-14T16:14:08.9707623Z config/rbac/submariner-operator/service_account.yaml
2021-07-14T16:14:08.9708437Z config/rbac/submariner-operator/role.yaml
2021-07-14T16:14:08.9709624Z config/rbac/submariner-operator/role_binding.yaml
2021-07-14T16:14:08.9710809Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-14T16:14:08.9711709Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-14T16:14:08.9712590Z config/rbac/submariner-gateway/service_account.yaml
2021-07-14T16:14:08.9713397Z config/rbac/submariner-gateway/role.yaml
2021-07-14T16:14:08.9714180Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-14T16:14:08.9715019Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-14T16:14:08.9715866Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-14T16:14:08.9716790Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-14T16:14:08.9717676Z config/rbac/submariner-route-agent/role.yaml
2021-07-14T16:14:08.9718549Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-14T16:14:08.9719460Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-14T16:14:08.9720393Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-14T16:14:08.9721337Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-14T16:14:08.9722165Z config/rbac/submariner-globalnet/role.yaml
2021-07-14T16:14:08.9723004Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-14T16:14:08.9723850Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-14T16:14:08.9724745Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-14T16:14:08.9725632Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-14T16:14:08.9726425Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-14T16:14:08.9727249Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-14T16:14:08.9728625Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-14T16:14:08.9729497Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-14T16:14:08.9730356Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-14T16:14:08.9731103Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-14T16:14:08.9731778Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-14T16:14:08.9732464Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-14T16:14:08.9733372Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-14T16:14:08.9734331Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-14T16:14:08.9735417Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-14T16:14:08.9736593Z Must remake target 'generate-embeddedyamls'.
2021-07-14T16:14:08.9737610Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-14T16:14:08.9738570Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-14T16:14:08.9739229Z mkdir -p bin
2021-07-14T16:14:08.9739862Z target=bin/subctl-latest-linux-amd64; \
2021-07-14T16:14:08.9740418Z target=${target%.exe}; \
2021-07-14T16:14:08.9740972Z components=($(echo ${target//-/ })); \
2021-07-14T16:14:08.9741533Z GOOS=${components[-2]}; \
2021-07-14T16:14:08.9742077Z GOARCH=${components[-1]}; \
2021-07-14T16:14:08.9742486Z export GOARCH GOOS; \
2021-07-14T16:14:08.9742959Z /opt/shipyard/scripts/compile.sh \
2021-07-14T16:14:08.9743907Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-14T16:14:08.9745553Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-14T16:14:08.9747016Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-14T16:14:08.9749200Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-14T16:14:08.9752953Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-14T16:15:55.8882756Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-14T16:15:55.8884190Z Must remake target 'bin/subctl'.
2021-07-14T16:15:55.8885886Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-14T16:15:55.8921186Z Successfully remade target file 'bin/subctl'.
2021-07-14T16:15:55.8922073Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-14T16:15:55.8922906Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-14T16:15:55.8923581Z Must remake target 'deploy'.
2021-07-14T16:15:55.8925282Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:15:55.9824141Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-14T16:15:55.9853441Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-14T16:15:55.9872616Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:15:55.9886843Z [submariner-operator]$ script_name=utils
2021-07-14T16:15:55.9898097Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:15:55.9926711Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-14T16:15:55.9940812Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:15:55.9948071Z [submariner-operator]$ script_name=deploy_funcs
2021-07-14T16:15:55.9959956Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:15:55.9982081Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-14T16:15:55.9999337Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:15:56.0118228Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:15:56.0126714Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:15:56.0152801Z [submariner-operator]$ broker=cluster1
2021-07-14T16:15:56.0165679Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-14T16:15:56.0179764Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-14T16:15:56.0210818Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-14T16:15:56.0219823Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-14T16:15:56.0232330Z [submariner-operator]$ declare -gA cluster_subm
2021-07-14T16:15:56.0246078Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-14T16:15:56.0270783Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-14T16:15:56.0282375Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-14T16:15:56.0335927Z [submariner-operator]$ declare -gA cluster_cni
2021-07-14T16:15:56.0347267Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-14T16:15:56.0355902Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-14T16:15:56.0366365Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:15:56.0391215Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:15:56.0420205Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:15:56.0429985Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:15:56.0460628Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-14T16:15:56.0484668Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-14T16:15:56.0540534Z [submariner-operator]$ declare_cidrs
2021-07-14T16:15:56.0589605Z [submariner-operator]$ declare_cidrs
2021-07-14T16:15:56.0619739Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-14T16:15:56.0630070Z [submariner-operator]$ i=1
2021-07-14T16:15:56.0642453Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:15:56.0663456Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:15:56.0684388Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-14T16:15:56.0697445Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-14T16:15:56.0708250Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-14T16:15:56.0719100Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:15:56.0730435Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:15:56.0743827Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-14T16:15:56.0754812Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-14T16:15:56.0765052Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-14T16:15:56.0774924Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-14T16:15:56.0784678Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-14T16:15:56.0796469Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-14T16:15:56.0811044Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-14T16:15:56.0821097Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-14T16:15:56.0839077Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-14T16:15:56.0878501Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-14T16:15:56.2647604Z Installing subctl version latest
2021-07-14T16:15:56.2648908Z OS detected: linux
2021-07-14T16:15:56.2653364Z Architecture detected: amd64
2021-07-14T16:15:56.2659715Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-14T16:15:56.2663888Z
2021-07-14T16:15:56.2668156Z Downloading...
2021-07-14T16:15:57.1849505Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-14T16:15:57.2213506Z This provides subctl version: v0.9.1
2021-07-14T16:15:57.2241382Z
2021-07-14T16:15:57.2244174Z please update your path (and consider adding it to ~/.profile):
2021-07-14T16:15:57.2244785Z export PATH=$PATH:/go/bin
2021-07-14T16:15:57.2245151Z
2021-07-14T16:15:57.2354272Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-14T16:15:57.2363865Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-14T16:15:57.2369908Z Will deploy submariner using operator
2021-07-14T16:15:57.2381599Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-14T16:15:57.2398250Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:15:57.2412960Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-14T16:15:57.2425608Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-14T16:15:57.2445338Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-14T16:15:57.2459027Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-14T16:15:57.2472895Z 
2021-07-14T16:15:57.2487007Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-14T16:15:57.3786259Z subctl version: v0.9.1
2021-07-14T16:15:57.3815815Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-14T16:15:57.3829653Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-14T16:15:57.3843379Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-14T16:15:57.3860363Z [submariner-operator]$ [cluster2] grep -q function
2021-07-14T16:15:57.3886102Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:15:57.3900776Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-14T16:15:57.3922963Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-14T16:15:57.3935776Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-14T16:15:57.3968418Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-14T16:15:57.3982626Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-14T16:15:57.4014703Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:15:57.4050677Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:15:57.4085411Z [submariner-operator]$ [cluster1] pids[cluster1]=6318
2021-07-14T16:15:57.4103567Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:15:57.4118922Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:15:57.4124006Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-14T16:15:57.4130779Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-14T16:15:57.4148409Z [submariner-operator]$ [cluster2] pids[cluster2]=6321
2021-07-14T16:15:57.4149489Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:15:57.4182651Z [submariner-operator]$ [cluster2] wait 6321
2021-07-14T16:15:57.4201879Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:15:57.7890773Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-14T16:15:57.7891744Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-14T16:15:57.7892636Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-14T16:15:57.7893813Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7895503Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7897038Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7898160Z [cluster2] node/cluster2-worker labeled
2021-07-14T16:15:57.7911319Z [submariner-operator]$ [cluster2] wait 6318
2021-07-14T16:15:57.7912232Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-14T16:15:57.7913137Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-14T16:15:57.7914045Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-14T16:15:57.7915225Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7916611Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7918144Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:15:57.7919257Z [cluster1] node/cluster1-worker labeled
2021-07-14T16:15:57.7940403Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-14T16:15:57.7955692Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-14T16:15:57.7994662Z [submariner-operator]$ [cluster1] setup_broker
2021-07-14T16:15:57.8011340Z [submariner-operator]$ [cluster1] setup_broker
2021-07-14T16:15:57.8015634Z Installing broker...
2021-07-14T16:15:57.8029051Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-14T16:15:57.8049347Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-14T16:15:57.8061364Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:15:57.8529313Z • Setting up broker RBAC ...
2021-07-14T16:15:57.9680653Z ✓ Setting up broker RBAC
2021-07-14T16:15:57.9681424Z • Deploying the Submariner operator ...
2021-07-14T16:16:08.3846822Z ✓ Deploying the Submariner operator
2021-07-14T16:16:08.3847491Z ✓ Created operator CRDs
2021-07-14T16:16:08.3848342Z ✓ Created operator namespace: submariner-operator
2021-07-14T16:16:08.3849123Z ✓ Created operator service account and role
2021-07-14T16:16:08.3849817Z ✓ Created lighthouse service account and role
2021-07-14T16:16:08.3850705Z ✓ Created Lighthouse service accounts and roles
2021-07-14T16:16:08.3851445Z ✓ Deployed the operator successfully
2021-07-14T16:16:08.3852060Z • Deploying the broker ...
2021-07-14T16:16:08.4322158Z ✓ Deploying the broker
2021-07-14T16:16:08.4322878Z ✓ The broker has been deployed
2021-07-14T16:16:08.4323522Z • Creating broker-info.subm file ...
2021-07-14T16:16:08.4391610Z ✓ Creating broker-info.subm file
2021-07-14T16:16:08.4392632Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-14T16:16:08.4442585Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-14T16:16:08.4458240Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-14T16:16:08.4471536Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-14T16:16:08.4484974Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-14T16:16:08.4496678Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-14T16:16:08.4539345Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-14T16:16:08.4560467Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-14T16:16:08.4573159Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:16:08.4590202Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:16:08.4610614Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:16:08.4615505Z [submariner-operator]$ [cluster1] pids[cluster1]=6381
2021-07-14T16:16:08.4621178Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-14T16:16:08.4644835Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:16:08.4651956Z [submariner-operator]$ [cluster2] pids[cluster2]=6386
2021-07-14T16:16:08.4667417Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:16:08.4678332Z [submariner-operator]$ [cluster2] wait 6386
2021-07-14T16:16:08.4686206Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-14T16:16:08.4708726Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:16:14.3686000Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-14T16:16:14.3687365Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-14T16:16:14.3689887Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-14T16:16:14.3692321Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-14T16:16:14.3694924Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-14T16:16:14.3696141Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-14T16:16:14.3696833Z [cluster1] - cluster1-worker
2021-07-14T16:16:14.3697534Z [cluster1] • Discovering network details ...
2021-07-14T16:16:14.3698096Z [cluster1] Discovered network details:
2021-07-14T16:16:14.3698780Z [cluster1] Network plugin: weave-net
2021-07-14T16:16:14.3699384Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-14T16:16:14.3699862Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-14T16:16:14.3700608Z [cluster1] ✓ Discovering network details
2021-07-14T16:16:14.3701321Z [cluster1] • Discovering multi cluster details ...
2021-07-14T16:16:14.3702108Z [cluster1] • Validating Globalnet configurations ...
2021-07-14T16:16:14.3702891Z [cluster1] ✓ Validating Globalnet configurations
2021-07-14T16:16:14.3703637Z [cluster1] ✓ Discovering multi cluster details
2021-07-14T16:16:14.3704392Z [cluster1] • Deploying the Submariner operator ...
2021-07-14T16:16:14.3705146Z [cluster1] ✓ Deploying the Submariner operator
2021-07-14T16:16:14.3705928Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-14T16:16:14.3706632Z [cluster1] • Creating SA for cluster ...
2021-07-14T16:16:14.3707281Z [cluster1] ✓ Creating SA for cluster
2021-07-14T16:16:14.3707902Z [cluster1] • Deploying Submariner ...
2021-07-14T16:16:14.3708574Z [cluster1] ✓ Deploying Submariner
2021-07-14T16:16:14.3709210Z [cluster1] ✓ Submariner is up and running
2021-07-14T16:16:19.6330430Z [submariner-operator]$ [cluster2] wait 6381
2021-07-14T16:16:19.6331418Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-14T16:16:19.6332631Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-14T16:16:19.6333638Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-14T16:16:19.6336211Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-14T16:16:19.6338931Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-14T16:16:19.6340267Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-14T16:16:19.6341009Z [cluster2] - cluster2-worker
2021-07-14T16:16:19.6341765Z [cluster2] • Discovering network details ...
2021-07-14T16:16:19.6342392Z [cluster2] Discovered network details:
2021-07-14T16:16:19.6343154Z [cluster2] Network plugin: weave-net
2021-07-14T16:16:19.6343691Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-14T16:16:19.6344251Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-14T16:16:19.6345020Z [cluster2] ✓ Discovering network details
2021-07-14T16:16:19.6345772Z [cluster2] • Discovering multi cluster details ...
2021-07-14T16:16:19.6346639Z [cluster2] • Validating Globalnet configurations ...
2021-07-14T16:16:19.6347458Z [cluster2] ✓ Validating Globalnet configurations
2021-07-14T16:16:19.6348279Z [cluster2] ✓ Discovering multi cluster details
2021-07-14T16:16:19.6349038Z [cluster2] • Deploying the Submariner operator ...
2021-07-14T16:16:19.6349893Z [cluster2] ✓ Deploying the Submariner operator
2021-07-14T16:16:19.6350609Z [cluster2] ✓ Created operator CRDs
2021-07-14T16:16:19.6351475Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-14T16:16:19.6352391Z [cluster2] ✓ Created operator service account and role
2021-07-14T16:16:19.6353197Z [cluster2] ✓ Created lighthouse service account and role
2021-07-14T16:16:19.6354092Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-14T16:16:19.6354923Z [cluster2] ✓ Deployed the operator successfully
2021-07-14T16:16:19.6355827Z [cluster2] • Creating SA for cluster ...
2021-07-14T16:16:19.6356491Z [cluster2] ✓ Creating SA for cluster
2021-07-14T16:16:19.6357212Z [cluster2] • Deploying Submariner ...
2021-07-14T16:16:19.6357885Z [cluster2] ✓ Deploying Submariner
2021-07-14T16:16:19.6358649Z [cluster2] ✓ Submariner is up and running
2021-07-14T16:16:19.6375702Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-14T16:16:19.6398164Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-14T16:16:19.6423920Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-14T16:16:19.6504116Z [submariner-operator]$ [cluster2] with_retries
2021-07-14T16:16:19.6560799Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:16:19.6641709Z [submariner-operator]$ [cluster2] wait 6423
2021-07-14T16:16:19.6664438Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:19.6765647Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:19.6789372Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:19.6861295Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:19.6905140Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:19.8218631Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:19.8246927Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:19.9646467Z • ...
2021-07-14T16:16:20.0984002Z • ...
2021-07-14T16:16:20.1015364Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:20.1030665Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:26.1981918Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:26.2038087Z [submariner-operator]$ [cluster2] wait 6450
2021-07-14T16:16:26.2059349Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:26.2072696Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:26.2118862Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:26.2156232Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:26.2190621Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:26.3615601Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:26.3653615Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:26.4826152Z • ...
2021-07-14T16:16:26.4994326Z • ...
2021-07-14T16:16:26.5022190Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:26.5038276Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:32.5068682Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:32.5173182Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:32.5182949Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:32.5202848Z [submariner-operator]$ [cluster2] wait 6478
2021-07-14T16:16:32.5287701Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:32.5338263Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:32.5375193Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:33.4380241Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:33.4404976Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:33.5614745Z • ...
2021-07-14T16:16:34.0090621Z • ...
2021-07-14T16:16:34.0138196Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:34.0158812Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:40.4979598Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:40.4980662Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:40.4990872Z [submariner-operator]$ [cluster2] wait 6506
2021-07-14T16:16:40.4991921Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:40.4993231Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:40.4994261Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:40.4995327Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:40.4996532Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:40.4997790Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:40.4998830Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:40.4999602Z • ...
2021-07-14T16:16:40.5000148Z • ...
2021-07-14T16:16:40.5001447Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:46.4620481Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:46.4664515Z [submariner-operator]$ [cluster2] wait 6532
2021-07-14T16:16:46.4675073Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:46.4689730Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:46.4704803Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:46.4724947Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:46.4738913Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:46.7658818Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:46.7689839Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:46.9317503Z • ...
2021-07-14T16:16:46.9377238Z • ...
2021-07-14T16:16:46.9449009Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:46.9502331Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:52.9537327Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:52.9612133Z [submariner-operator]$ [cluster2] wait 6560
2021-07-14T16:16:52.9637323Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:52.9680357Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:52.9714390Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:52.9729014Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:52.9745765Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:53.2327070Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:53.2344640Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:53.3696708Z • ...
2021-07-14T16:16:53.4370625Z • ...
2021-07-14T16:16:53.4413053Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:53.4425013Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:16:59.4450988Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:16:59.4490906Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:59.4491776Z [submariner-operator]$ [cluster2] wait 6588
2021-07-14T16:16:59.4497998Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:16:59.4509146Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:16:59.4514404Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:59.4528819Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:16:59.5238996Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:16:59.5262887Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:16:59.5845505Z • ...
2021-07-14T16:16:59.6030386Z • ...
2021-07-14T16:16:59.6058527Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:16:59.6075418Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:17:05.6102185Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:17:05.6149698Z [submariner-operator]$ [cluster2] wait 6615
2021-07-14T16:17:05.6156728Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:17:05.6171379Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:17:05.6184085Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:17:05.6196792Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:17:05.6213155Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:17:05.6844774Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:17:05.6863619Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:17:05.7364493Z • ...
2021-07-14T16:17:05.7468519Z • ...
2021-07-14T16:17:05.7526677Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:17:05.7537429Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:17:11.7565703Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:17:11.7603541Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:17:11.7610339Z [submariner-operator]$ [cluster2] wait 6641
2021-07-14T16:17:11.7614075Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:17:11.7623083Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:17:11.7635943Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:17:11.7649378Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:17:11.8422742Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:17:11.8439155Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:17:11.8830321Z • ...
2021-07-14T16:17:11.8926062Z • ...
2021-07-14T16:17:11.8977023Z cluster2-worker cluster2 172.18.0.7 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 264.505µs
2021-07-14T16:17:11.8978095Z cluster1-worker cluster1 172.18.0.4 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 226.404µs
2021-07-14T16:17:11.9017570Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:17:11.9030634Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:17:11.9050300Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-14T16:17:11.9075798Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-14T16:17:11.9092206Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-14T16:17:11.9104458Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-14T16:17:11.9116746Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-14T16:17:11.9133161Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-14T16:17:11.9147038Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-14T16:17:11.9159610Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-14T16:17:12.1743931Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-14T16:17:12.1795203Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-14T16:17:12.6359457Z latest: Pulling from submariner/nettest
2021-07-14T16:17:12.6385747Z df20fa9351a1: Pulling fs layer
2021-07-14T16:17:12.6387349Z 741138c6c583: Pulling fs layer
2021-07-14T16:17:12.6398259Z d34ea735672c: Pulling fs layer
2021-07-14T16:17:12.6398747Z c91acd455ec9: Pulling fs layer
2021-07-14T16:17:12.7118539Z 741138c6c583: Verifying Checksum
2021-07-14T16:17:12.7119297Z 741138c6c583: Download complete
2021-07-14T16:17:12.7682781Z c91acd455ec9: Verifying Checksum
2021-07-14T16:17:12.7716306Z df20fa9351a1: Verifying Checksum
2021-07-14T16:17:12.7716918Z df20fa9351a1: Download complete
2021-07-14T16:17:12.7717420Z c91acd455ec9: Download complete
2021-07-14T16:17:12.8044224Z d34ea735672c: Verifying Checksum
2021-07-14T16:17:12.8044761Z d34ea735672c: Download complete
2021-07-14T16:17:13.1527136Z df20fa9351a1: Pull complete
2021-07-14T16:17:13.2386817Z 741138c6c583: Pull complete
2021-07-14T16:17:13.7400448Z d34ea735672c: Pull complete
2021-07-14T16:17:13.8260883Z c91acd455ec9: Pull complete
2021-07-14T16:17:13.8301971Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-14T16:17:13.8324861Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-14T16:17:13.8381001Z quay.io/submariner/nettest:latest
2021-07-14T16:17:13.8394863Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-14T16:17:14.1188263Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-14T16:17:14.3843607Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-14T16:17:14.6405813Z The push refers to repository [localhost:5000/nettest]
2021-07-14T16:17:14.6661875Z 7497bfb0ae54: Preparing
2021-07-14T16:17:14.6662754Z 17de069c349e: Preparing
2021-07-14T16:17:14.6663306Z b85398c91342: Preparing
2021-07-14T16:17:14.6663808Z 50644c29ef5a: Preparing
2021-07-14T16:17:15.2849434Z 7497bfb0ae54: Pushed
2021-07-14T16:17:15.2849871Z b85398c91342: Pushed
2021-07-14T16:17:15.2954544Z 50644c29ef5a: Pushed
2021-07-14T16:17:16.1199585Z 17de069c349e: Pushed
2021-07-14T16:17:16.1388088Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-14T16:17:16.1461581Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:16.1471609Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:16.1482721Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-14T16:17:16.1503902Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-14T16:17:16.1524901Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:16.1538793Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:16.1551902Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:16.6013214Z deployment.apps/netshoot created
2021-07-14T16:17:16.6075523Z Waiting for netshoot pods to be ready.
2021-07-14T16:17:16.6089829Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-14T16:17:16.6148719Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-14T16:17:16.6177366Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-14T16:17:16.9292308Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-14T16:17:18.1385099Z deployment "netshoot" successfully rolled out
2021-07-14T16:17:18.1436473Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.1460873Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.1473415Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.1486739Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-14T16:17:18.1502796Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-14T16:17:18.1518116Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-14T16:17:18.1537690Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.1549774Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.1562535Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:18.7298267Z deployment.apps/nginx-demo created
2021-07-14T16:17:18.7865922Z service/nginx-demo created
2021-07-14T16:17:18.9219186Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-14T16:17:18.9278635Z Waiting for nginx-demo pods to be ready.
2021-07-14T16:17:18.9298135Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:17:18.9330521Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:17:18.9373918Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:17:19.4238034Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-14T16:17:23.7238720Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-14T16:17:24.7815680Z deployment "nginx-demo" successfully rolled out
2021-07-14T16:17:24.7952466Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-14T16:17:24.7975331Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-14T16:17:24.8036474Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-14T16:17:24.8103462Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-14T16:17:24.8125534Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-14T16:17:25.1272456Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-14T16:17:25.1295212Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-14T16:17:25.1321402Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-14T16:17:25.1347800Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-14T16:17:25.1362181Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-14T16:17:25.1379436Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-14T16:17:25.1399597Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:17:25.1415275Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-14T16:17:25.1427858Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:17:25.1456225Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:17:25.4462956Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-b8f7z 100.1.181.46
2021-07-14T16:17:25.4477045Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-b8f7z 100.1.181.46
2021-07-14T16:17:25.4492735Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:17:25.4521232Z [submariner-operator]$ [cluster2] wait 6796
2021-07-14T16:17:25.4525682Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-b8f7z 100.1.181.46
2021-07-14T16:17:25.4545970Z [submariner-operator]$ [cluster2] test_connection
2021-07-14T16:17:25.4551385Z Attempting connectivity between clusters - netshoot-57677568b8-b8f7z --> 100.1.181.46
2021-07-14T16:17:25.4560726Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-14T16:17:25.4574170Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-14T16:17:25.4590654Z [submariner-operator]$ [cluster2] date +%s
2021-07-14T16:17:25.4624345Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-b8f7z -- curl --output /dev/null -m 30 --silent --head --fail 100.1.181.46
2021-07-14T16:17:25.4639689Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-b8f7z -- curl --output /dev/null -m 30 --silent --head --fail 100.1.181.46
2021-07-14T16:17:25.4696725Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-b8f7z -- curl --output /dev/null -m 30 --silent --head --fail 100.1.181.46
2021-07-14T16:17:25.8879341Z Connection test was successful!
2021-07-14T16:17:25.8899525Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:17:25.8937002Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:25.8967553Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:25.8988293Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:25.9003885Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:25.9023331Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:17:26.1817736Z deployment.apps "netshoot" deleted
2021-07-14T16:17:26.1895828Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.1910794Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.1926050Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.1939311Z [submariner-operator]$ [cluster1] remove_resource
2021-07-14T16:17:26.1954923Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.1971377Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.1994276Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:17:26.4565822Z deployment.apps "nginx-demo" deleted
2021-07-14T16:17:26.5235559Z service "nginx-demo" deleted
2021-07-14T16:17:26.6550856Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-14T16:17:26.6749649Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-14T16:17:26.6788627Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-14T16:17:26.6813918Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-14T16:17:26.6842365Z [submariner-operator]$ [cluster2] grep -q function
2021-07-14T16:17:26.6918801Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:17:26.6924893Z Successfully remade target file 'deploy'.
2021-07-14T16:17:26.6935835Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-14T16:17:26.6981479Z Successfully remade target file 'deploy-latest'.
2021-07-14T16:17:26.6983717Z File 'clusters' does not exist.
2021-07-14T16:17:26.6984322Z Must remake target 'clusters'.
2021-07-14T16:17:26.6985507Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:17:26.8682240Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-14T16:17:26.8736736Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-14T16:17:26.8752525Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:17:26.8761418Z [submariner-operator]$ script_name=utils
2021-07-14T16:17:26.8793423Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:17:26.8825448Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-14T16:17:26.8839478Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:17:26.8859366Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:17:26.8878964Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:17:26.8899353Z [submariner-operator]$ broker=cluster1
2021-07-14T16:17:26.8925535Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-14T16:17:26.8937351Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-14T16:17:26.8947350Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-14T16:17:26.8962648Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-14T16:17:26.8977820Z [submariner-operator]$ declare -gA cluster_subm
2021-07-14T16:17:26.8996529Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-14T16:17:26.9005223Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-14T16:17:26.9020622Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-14T16:17:26.9039664Z [submariner-operator]$ declare -gA cluster_cni
2021-07-14T16:17:26.9049820Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-14T16:17:26.9062828Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-14T16:17:26.9077178Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:17:26.9097371Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:17:26.9106383Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:17:26.9116528Z [submariner-operator]$ exec_name=clusters.sh
2021-07-14T16:17:26.9156084Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-14T16:17:26.9164813Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-14T16:17:26.9191930Z [submariner-operator]$ cat <<EOM
2021-07-14T16:17:26.9193839Z Cluster settings::
2021-07-14T16:17:26.9194421Z broker - ${broker@Q}
2021-07-14T16:17:26.9194947Z clusters - ${clusters[*]@Q}
2021-07-14T16:17:26.9195589Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-14T16:17:26.9196310Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-14T16:17:26.9197102Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-14T16:17:26.9201575Z EOM
2021-07-14T16:17:26.9221586Z [submariner-operator]$ typeset -p cluster_cni
2021-07-14T16:17:26.9236527Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:17:26.9293895Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-14T16:17:26.9307337Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:17:26.9336920Z [submariner-operator]$ typeset -p cluster_subm
2021-07-14T16:17:26.9354334Z [submariner-operator]$ cut -f 2- -d=
2021-07-14T16:17:26.9384839Z Cluster settings::
2021-07-14T16:17:26.9385509Z broker - 'cluster1'
2021-07-14T16:17:26.9386085Z clusters - 'cluster1' 'cluster2'
2021-07-14T16:17:26.9386749Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-14T16:17:26.9388200Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-14T16:17:26.9389509Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-14T16:17:26.9436466Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-14T16:17:26.9466562Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-14T16:17:26.9506368Z [submariner-operator]$ run_local_registry
2021-07-14T16:17:26.9509659Z [submariner-operator]$ run_local_registry
2021-07-14T16:17:26.9517054Z [submariner-operator]$ registry_running
2021-07-14T16:17:26.9524869Z [submariner-operator]$ registry_running
2021-07-14T16:17:26.9540678Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-14T16:17:26.9556890Z [submariner-operator]$ grep kind-registry
2021-07-14T16:17:27.2850534Z d412f4a16271 registry:2 "/entrypoint.sh /etc…" 7 minutes ago Up 7 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-14T16:17:27.2860725Z [submariner-operator]$ return 0
2021-07-14T16:17:27.2865067Z Local registry kind-registry already running.
2021-07-14T16:17:27.2876195Z [submariner-operator]$ declare_cidrs
2021-07-14T16:17:27.2887123Z [submariner-operator]$ declare_cidrs
2021-07-14T16:17:27.2927155Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-14T16:17:27.2928850Z [submariner-operator]$ i=1
2021-07-14T16:17:27.2929715Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:17:27.2930680Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:17:27.2939658Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-14T16:17:27.2950911Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-14T16:17:27.2962855Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-14T16:17:27.2974744Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:17:27.2988697Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:17:27.3002717Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-14T16:17:27.3018028Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-14T16:17:27.3031527Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-14T16:17:27.3046603Z [submariner-operator]$ [cluster2] wait 7007
2021-07-14T16:17:27.3075577Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3090592Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3106255Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3112696Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3122315Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:17:27.3138346Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:17:27.3155505Z [submariner-operator]$ [cluster1] pids[cluster1]=7016
2021-07-14T16:17:27.3166622Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:17:27.3177323Z [submariner-operator]$ [cluster2] pids[cluster2]=7019
2021-07-14T16:17:27.3191331Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3213734Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:17:27.3223352Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:17:27.3235790Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-14T16:17:27.3270888Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:17:27.3337416Z [submariner-operator]$ [cluster2] wait 7019
2021-07-14T16:17:33.7776394Z [submariner-operator]$ [cluster1] with_retries
2021-07-14T16:17:33.7777299Z [submariner-operator]$ [cluster1] iteration=1
2021-07-14T16:17:33.7778159Z [submariner-operator]$ [cluster1] wait 7036
2021-07-14T16:17:33.7779007Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-14T16:17:33.7779884Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-14T16:17:33.7781305Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7783086Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7784353Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-14T16:17:33.7785229Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-14T16:17:33.7785952Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-14T16:17:33.7786923Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-14T16:17:33.7787809Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-14T16:17:33.7788623Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-14T16:17:33.7789464Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-14T16:17:33.7790821Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-14T16:17:33.7792056Z [submariner-operator]$ [cluster1] head -n 1
2021-07-14T16:17:33.7793503Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7795445Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7797656Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7799660Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7801769Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7803718Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-14T16:17:33.7804968Z [submariner-operator]$ [cluster1] return
2021-07-14T16:17:33.7805759Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:17:33.9967322Z [submariner-operator]$ [cluster2] with_retries
2021-07-14T16:17:33.9970455Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:17:33.9971499Z [submariner-operator]$ [cluster2] wait 7040
2021-07-14T16:17:33.9973267Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-14T16:17:33.9974176Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-14T16:17:33.9975742Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9977569Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9979103Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-14T16:17:33.9979971Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-14T16:17:33.9980709Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-14T16:17:33.9981663Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-14T16:17:33.9982555Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-14T16:17:33.9983350Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-14T16:17:33.9984212Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-14T16:17:33.9985696Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-14T16:17:33.9986937Z [submariner-operator]$ [cluster2] head -n 1
2021-07-14T16:17:33.9988414Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.8:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9990363Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9992322Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9994411Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9996513Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9998450Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-14T16:17:33.9999679Z [submariner-operator]$ [cluster2] return
2021-07-14T16:17:34.0000462Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:17:34.0005759Z [submariner-operator]$ [cluster2] wait 7016
2021-07-14T16:17:34.0021645Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-14T16:17:34.0030645Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-14T16:17:34.0046766Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-14T16:17:34.0047705Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-14T16:17:34.0048704Z
2021-07-14T16:17:34.0049727Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-14T16:17:34.0050301Z
2021-07-14T16:17:34.0051092Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-14T16:17:34.0051608Z
2021-07-14T16:17:34.0052245Z To clean everthing up, just run: make clean-clusters
2021-07-14T16:17:34.0055207Z EOM
2021-07-14T16:17:34.0077734Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-14T16:17:34.0078347Z
2021-07-14T16:17:34.0079464Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-14T16:17:34.0079996Z
2021-07-14T16:17:34.0080819Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-14T16:17:34.0081330Z
2021-07-14T16:17:34.0081953Z To clean everthing up, just run: make clean-clusters
2021-07-14T16:17:34.0089605Z Successfully remade target file 'clusters'.
2021-07-14T16:17:34.0090371Z File 'preload-images' does not exist.
2021-07-14T16:17:34.0092062Z File 'images' does not exist.
2021-07-14T16:17:34.0093628Z File 'package/.image.submariner-operator' does not exist.
2021-07-14T16:17:34.0152492Z find: 'bin/submariner-operator': No such file or directory
2021-07-14T16:17:34.3055007Z File 'bin/submariner-operator' does not exist.
2021-07-14T16:17:34.3059864Z File 'generate-embeddedyamls' does not exist.
2021-07-14T16:17:34.3060803Z File 'generate' does not exist.
2021-07-14T16:17:34.3063919Z Must remake target 'generate'.
2021-07-14T16:17:34.3086924Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-14T16:17:37.6477465Z Successfully remade target file 'generate'.
2021-07-14T16:17:37.6593201Z Must remake target 'generate-embeddedyamls'.
2021-07-14T16:17:37.6594265Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-14T16:17:37.6595179Z Must remake target 'bin/submariner-operator'.
2021-07-14T16:17:37.6595768Z /opt/shipyard/scripts/compile.sh \
2021-07-14T16:17:37.6596845Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd" \
2021-07-14T16:17:37.6597826Z bin/submariner-operator main.go
2021-07-14T16:17:37.7034454Z [submariner-operator]$ mkdir -p bin
2021-07-14T16:17:37.7048380Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd')
2021-07-14T16:17:37.7060901Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd
2021-07-14T16:17:37.7105791Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd -o bin/submariner-operator main.go
2021-07-14T16:17:53.3965942Z [submariner-operator]$ upx bin/submariner-operator
2021-07-14T16:17:58.7694711Z Ultimate Packer for eXecutables
2021-07-14T16:17:58.7696122Z Copyright (C) 1996 - 2020
2021-07-14T16:17:58.7697020Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-14T16:17:58.7697575Z
2021-07-14T16:17:58.7698057Z File size Ratio Format Name
2021-07-14T16:17:58.7698846Z -------------------- ------ ----------- -----------
2021-07-14T16:17:58.7699723Z 34459648 -> 9933024 28.83% linux/amd64 submariner-operator
2021-07-14T16:17:58.7700215Z
2021-07-14T16:17:58.7700626Z Packed 1 file.
2021-07-14T16:17:58.7708160Z Successfully remade target file 'bin/submariner-operator'.
2021-07-14T16:17:58.7710213Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-14T16:17:58.7712189Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-14T16:17:58.7713697Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-14T16:17:58.7714784Z File 'FORCE_IMAGE' does not exist.
2021-07-14T16:17:58.7715667Z Must remake target 'FORCE_IMAGE'.
2021-07-14T16:17:58.7716480Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-14T16:17:58.7717519Z Must remake target 'package/.image.submariner-operator'.
2021-07-14T16:17:58.7719175Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-14T16:17:58.8310464Z flags:WARN flag short name (h) already defined
2021-07-14T16:17:59.5135351Z [submariner-operator]$ set -e
2021-07-14T16:17:59.5136915Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-14T16:17:59.5138129Z [submariner-operator]$ cache_flag=
2021-07-14T16:17:59.5139525Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-14T16:17:59.5141126Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-14T16:17:59.5142887Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-14T16:17:59.6978898Z devel: Pulling from submariner/submariner-operator
2021-07-14T16:17:59.6979787Z a88cb85007c0: Pulling fs layer
2021-07-14T16:17:59.8363790Z a88cb85007c0: Verifying Checksum
2021-07-14T16:17:59.8364331Z a88cb85007c0: Download complete
2021-07-14T16:18:00.0542342Z a88cb85007c0: Pull complete
2021-07-14T16:18:00.0577056Z Digest: sha256:2ce83eb8311f1e46b6bb05dfea2f41f88e2193cce581c56fae9f10cde31e799c
2021-07-14T16:18:00.0601042Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-14T16:18:00.0650361Z quay.io/submariner/submariner-operator:devel
2021-07-14T16:18:00.0666438Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-14T16:18:00.0682642Z [submariner-operator]$ cut -f2 -d 
2021-07-14T16:18:00.0694090Z [submariner-operator]$ grep -v scratch
2021-07-14T16:18:00.0714421Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-14T16:18:00.0727120Z 
2021-07-14T16:18:00.8415227Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-14T16:18:01.6427774Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-14T16:18:01.6519020Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-14T16:18:02.4018101Z buildx_builder
2021-07-14T16:18:02.4096368Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-14T16:18:03.1855711Z #1 [internal] booting buildkit
2021-07-14T16:18:03.1859831Z #1 sha256:595a1e387bd12c717014d7ba25165b75e1fd2e79ad254f0f7610f454cf966245
2021-07-14T16:18:03.3366924Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-14T16:18:06.4499931Z #1 pulling image moby/buildkit:buildx-stable-1 3.3s done
2021-07-14T16:18:06.6001454Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-14T16:18:07.0505571Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-14T16:18:07.0506118Z #1 DONE 3.8s
2021-07-14T16:18:07.1592885Z
2021-07-14T16:18:07.1596554Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-14T16:18:07.1598073Z #2 sha256:00938f7ff23ab7e5a9d79ef653b8e45d566bf2ae8700038dd3217c5b3fec92c0
2021-07-14T16:18:07.1599323Z #2 transferring dockerfile: 230B done
2021-07-14T16:18:07.1599753Z #2 DONE 0.0s
2021-07-14T16:18:07.1600066Z
2021-07-14T16:18:07.1600557Z #3 [internal] load .dockerignore
2021-07-14T16:18:07.1607393Z #3 sha256:52cb1c544067b5a76c895b0ac0539ce0ddcdc9b54fa32729138e5f2fa3570f78
2021-07-14T16:18:07.1608884Z #3 transferring context: 2B done
2021-07-14T16:18:07.1609298Z #3 DONE 0.0s
2021-07-14T16:18:07.1609615Z
2021-07-14T16:18:07.1609980Z #6 [internal] load build context
2021-07-14T16:18:07.1610805Z #6 sha256:35429d87e7a1bc71ed4ea4f5928992478bed77c7a25e7c231a47d01a5020b1ba
2021-07-14T16:18:07.1611538Z #6 DONE 0.0s
2021-07-14T16:18:07.1611752Z
2021-07-14T16:18:07.1612760Z #5 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-14T16:18:07.1614135Z #5 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-14T16:18:07.4618161Z #5 DONE 0.2s
2021-07-14T16:18:07.4618480Z
2021-07-14T16:18:07.4618862Z #6 [internal] load build context
2021-07-14T16:18:07.4619680Z #6 sha256:35429d87e7a1bc71ed4ea4f5928992478bed77c7a25e7c231a47d01a5020b1ba
2021-07-14T16:18:07.7365148Z #6 transferring context: 9.94MB 0.3s done
2021-07-14T16:18:07.7365873Z #6 DONE 0.3s
2021-07-14T16:18:07.7366108Z
2021-07-14T16:18:07.7368825Z #4 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-14T16:18:07.7370131Z #4 sha256:7068a47bc00df93489562e67ee6b8f5668dff91a3c0b21de039c1aa7d9e03dee
2021-07-14T16:18:07.7370887Z #4 CACHED
2021-07-14T16:18:07.7371106Z
2021-07-14T16:18:07.7371460Z #7 exporting to oci image format
2021-07-14T16:18:07.7372343Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-14T16:18:07.7373193Z #7 exporting layers done
2021-07-14T16:18:07.7374169Z #7 exporting manifest sha256:8bc186f73087124e01ef9e27b6cca6fcd4cd02a403e015548eeb2c1e66b85ee5 done
2021-07-14T16:18:07.7375692Z #7 exporting config sha256:3c57be2b06cdbd7655fb2ff2113a585614ffc65a2c0358b38ee3ac9da58d0b22 done
2021-07-14T16:18:07.8866933Z #7 ...
2021-07-14T16:18:07.8885542Z
2021-07-14T16:18:07.8900655Z #4 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-14T16:18:07.8901735Z #4 sha256:7068a47bc00df93489562e67ee6b8f5668dff91a3c0b21de039c1aa7d9e03dee
2021-07-14T16:18:07.8903083Z #4 sha256:a88cb85007c05d42dd6858219debc965648c38f0a8bd3947b197b8b228b9881e 9.62MB / 9.62MB 0.1s done
2021-07-14T16:18:07.8903888Z #4 CACHED
2021-07-14T16:18:07.8904179Z
2021-07-14T16:18:07.8904553Z #7 exporting to oci image format
2021-07-14T16:18:07.8905523Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-14T16:18:07.8906362Z #7 sending tarball
2021-07-14T16:18:08.0344956Z #7 sending tarball 0.3s done
2021-07-14T16:18:08.0345398Z #7 DONE 0.4s
2021-07-14T16:18:08.0345623Z
2021-07-14T16:18:08.0345951Z #9 exporting cache
2021-07-14T16:18:08.0346776Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-14T16:18:08.0351356Z #9 preparing build cache for export done
2021-07-14T16:18:08.0351797Z #9 DONE 0.0s
2021-07-14T16:18:08.0352014Z
2021-07-14T16:18:08.0352338Z #8 importing to docker
2021-07-14T16:18:08.0353127Z #8 sha256:1ffd1f7ddd331600898cb668816112a53d3481b27810e01f4b0f8cdbe2dd3273
2021-07-14T16:18:08.0353959Z #8 DONE 0.0s
2021-07-14T16:18:08.0493366Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-14T16:18:08.3127174Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-14T16:18:08.3128664Z File 'build' does not exist.
2021-07-14T16:18:08.3129518Z File 'bin/subctl-devel-0aa05fd-linux-amd64' does not exist.
2021-07-14T16:18:08.3391576Z Must remake target 'bin/subctl-devel-0aa05fd-linux-amd64'.
2021-07-14T16:18:08.3395272Z mkdir -p bin
2021-07-14T16:18:08.3417556Z target=bin/subctl-devel-0aa05fd-linux-amd64; \
2021-07-14T16:18:08.3418224Z target=${target%.exe}; \
2021-07-14T16:18:08.3418819Z components=($(echo ${target//-/ })); \
2021-07-14T16:18:08.3419384Z GOOS=${components[-2]}; \
2021-07-14T16:18:08.3419909Z GOARCH=${components[-1]}; \
2021-07-14T16:18:08.3420497Z export GOARCH GOOS; \
2021-07-14T16:18:08.3420953Z /opt/shipyard/scripts/compile.sh \
2021-07-14T16:18:08.3421968Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd \
2021-07-14T16:18:08.3423646Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-14T16:18:08.3425221Z --noupx bin/subctl-devel-0aa05fd-linux-amd64 ./pkg/subctl/main.go
2021-07-14T16:18:08.3935630Z [submariner-operator]$ mkdir -p bin
2021-07-14T16:18:08.3949311Z Building 'bin/subctl-devel-0aa05fd-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-14T16:18:08.3965627Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-14T16:18:08.3981777Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0aa05fd -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0aa05fd-linux-amd64 ./pkg/subctl/main.go
2021-07-14T16:18:11.8938545Z Successfully remade target file 'bin/subctl-devel-0aa05fd-linux-amd64'.
2021-07-14T16:18:11.8940372Z Prerequisite 'bin/subctl-devel-0aa05fd-linux-amd64' is newer than target 'bin/subctl'.
2021-07-14T16:18:11.8941490Z Must remake target 'bin/subctl'.
2021-07-14T16:18:11.8942547Z ln -sf subctl-devel-0aa05fd-linux-amd64 bin/subctl
2021-07-14T16:18:11.8992130Z Successfully remade target file 'bin/subctl'.
2021-07-14T16:18:11.8999534Z Must remake target 'build'.
2021-07-14T16:18:11.9000219Z Successfully remade target file 'build'.
2021-07-14T16:18:11.9005455Z Must remake target 'images'.
2021-07-14T16:18:11.9006122Z Successfully remade target file 'images'.
2021-07-14T16:18:11.9010955Z Must remake target 'preload-images'.
2021-07-14T16:18:11.9016421Z set -e;\
2021-07-14T16:18:11.9016871Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-14T16:18:11.9017411Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-14T16:18:11.9018672Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-14T16:18:11.9019716Z import_image quay.io/submariner/${image};\
2021-07-14T16:18:11.9020148Z done
2021-07-14T16:18:11.9065225Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-14T16:18:12.5159441Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-14T16:18:12.5160555Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-14T16:18:12.5163408Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-14T16:18:12.5164355Z cf690902a912: Preparing
2021-07-14T16:18:12.5165408Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-14T16:18:12.9522686Z cf690902a912: Pushed
2021-07-14T16:18:12.9713200Z local: digest: sha256:2ce83eb8311f1e46b6bb05dfea2f41f88e2193cce581c56fae9f10cde31e799c size: 528
2021-07-14T16:18:12.9754013Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-14T16:18:12.9763654Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-14T16:18:12.9791763Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-14T16:18:13.2260455Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-14T16:18:13.2291305Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-14T16:18:13.6739311Z devel: Pulling from submariner/submariner-gateway
2021-07-14T16:18:13.6739996Z 8c741e919b67: Pulling fs layer
2021-07-14T16:18:13.6740454Z 13495efbbac4: Pulling fs layer
2021-07-14T16:18:13.6740896Z 6df6df193f2d: Pulling fs layer
2021-07-14T16:18:13.6741320Z 3b217330aa55: Pulling fs layer
2021-07-14T16:18:13.6741716Z 3b217330aa55: Waiting
2021-07-14T16:18:13.7320001Z 13495efbbac4: Verifying Checksum
2021-07-14T16:18:13.7320729Z 13495efbbac4: Download complete
2021-07-14T16:18:13.9771084Z 3b217330aa55: Verifying Checksum
2021-07-14T16:18:13.9776093Z 3b217330aa55: Download complete
2021-07-14T16:18:14.0002144Z 6df6df193f2d: Verifying Checksum
2021-07-14T16:18:14.0003160Z 6df6df193f2d: Download complete
2021-07-14T16:18:14.2471991Z 8c741e919b67: Verifying Checksum
2021-07-14T16:18:14.2472581Z 8c741e919b67: Download complete
2021-07-14T16:18:17.1507275Z 8c741e919b67: Pull complete
2021-07-14T16:18:18.0374036Z 13495efbbac4: Pull complete
2021-07-14T16:18:19.1874686Z 6df6df193f2d: Pull complete
2021-07-14T16:18:19.4118453Z 3b217330aa55: Pull complete
2021-07-14T16:18:19.4152838Z Digest: sha256:67bee40f890b7ca824aa42255493ddd1bce8c8edd72e05104b21ae1591a7c36f
2021-07-14T16:18:19.4179884Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-14T16:18:19.4184836Z quay.io/submariner/submariner-gateway:devel
2021-07-14T16:18:19.4218483Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-14T16:18:19.7295580Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-14T16:18:19.9926287Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-14T16:18:20.2394200Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-14T16:18:20.2459382Z dcbba7cfd803: Preparing
2021-07-14T16:18:20.2459919Z 3c7f2d60eacb: Preparing
2021-07-14T16:18:20.2460339Z 00c5f6897675: Preparing
2021-07-14T16:18:20.2460729Z b3b62c837788: Preparing
2021-07-14T16:18:20.9112542Z 00c5f6897675: Pushed
2021-07-14T16:18:21.3637363Z dcbba7cfd803: Pushed
2021-07-14T16:18:24.5586915Z 3c7f2d60eacb: Pushed
2021-07-14T16:18:31.5647341Z b3b62c837788: Pushed
2021-07-14T16:18:31.5857126Z local: digest: sha256:67bee40f890b7ca824aa42255493ddd1bce8c8edd72e05104b21ae1591a7c36f size: 1159
2021-07-14T16:18:31.5910073Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-14T16:18:31.5920391Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-14T16:18:31.5933259Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-14T16:18:31.8465479Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-14T16:18:31.8494884Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-14T16:18:32.2824513Z devel: Pulling from submariner/submariner-route-agent
2021-07-14T16:18:32.2825174Z 8c741e919b67: Already exists
2021-07-14T16:18:32.2842147Z 13495efbbac4: Already exists
2021-07-14T16:18:32.2862620Z 70cc6422093d: Pulling fs layer
2021-07-14T16:18:32.2863209Z f9e83e814052: Pulling fs layer
2021-07-14T16:18:32.2863711Z e2ee057959e8: Pulling fs layer
2021-07-14T16:18:32.2864149Z b3c60f4f5849: Pulling fs layer
2021-07-14T16:18:32.2867671Z b3c60f4f5849: Waiting
2021-07-14T16:18:32.3315570Z e2ee057959e8: Verifying Checksum
2021-07-14T16:18:32.3316111Z e2ee057959e8: Download complete
2021-07-14T16:18:32.4148195Z f9e83e814052: Verifying Checksum
2021-07-14T16:18:32.4149020Z f9e83e814052: Download complete
2021-07-14T16:18:32.4264124Z b3c60f4f5849: Verifying Checksum
2021-07-14T16:18:32.4265675Z b3c60f4f5849: Download complete
2021-07-14T16:18:32.5807180Z 70cc6422093d: Verifying Checksum
2021-07-14T16:18:32.5808375Z 70cc6422093d: Download complete
2021-07-14T16:18:34.0382732Z 70cc6422093d: Pull complete
2021-07-14T16:18:34.2351312Z f9e83e814052: Pull complete
2021-07-14T16:18:34.3254348Z e2ee057959e8: Pull complete
2021-07-14T16:18:34.4024755Z b3c60f4f5849: Pull complete
2021-07-14T16:18:34.4060210Z Digest: sha256:d0c86931be5ff19c8d59cf354097e79bf65a9cff3e31a2a1712f98dd422dd973
2021-07-14T16:18:34.4095367Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-14T16:18:34.4131848Z quay.io/submariner/submariner-route-agent:devel
2021-07-14T16:18:34.4142958Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-14T16:18:34.6962723Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-14T16:18:34.9604363Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-14T16:18:35.2016361Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-14T16:18:35.2071500Z 89a5c7326fcc: Preparing
2021-07-14T16:18:35.2079608Z 3375eae71e7d: Preparing
2021-07-14T16:18:35.2080103Z 0c3dfa69aaa4: Preparing
2021-07-14T16:18:35.2080813Z 6931e591f8e2: Preparing
2021-07-14T16:18:35.2081194Z 00c5f6897675: Preparing
2021-07-14T16:18:35.2081594Z b3b62c837788: Preparing
2021-07-14T16:18:35.2095255Z b3b62c837788: Waiting
2021-07-14T16:18:35.3186662Z 00c5f6897675: Mounted from submariner-gateway
2021-07-14T16:18:35.8700093Z 89a5c7326fcc: Pushed
2021-07-14T16:18:35.9070814Z 3375eae71e7d: Pushed
2021-07-14T16:18:35.9103594Z b3b62c837788: Mounted from submariner-gateway
2021-07-14T16:18:35.9210443Z 0c3dfa69aaa4: Pushed
2021-07-14T16:18:39.6119443Z 6931e591f8e2: Pushed
2021-07-14T16:18:39.6410676Z local: digest: sha256:d0c86931be5ff19c8d59cf354097e79bf65a9cff3e31a2a1712f98dd422dd973 size: 1575
2021-07-14T16:18:39.6466003Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-14T16:18:39.6479338Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-14T16:18:39.6496893Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-14T16:18:39.9433828Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-14T16:18:39.9465207Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-14T16:18:40.3923676Z devel: Pulling from submariner/lighthouse-agent
2021-07-14T16:18:40.3924284Z ca509a0cdd89: Pulling fs layer
2021-07-14T16:18:40.3924756Z dddf2ca8b98c: Pulling fs layer
2021-07-14T16:18:40.4804070Z ca509a0cdd89: Verifying Checksum
2021-07-14T16:18:40.4804656Z ca509a0cdd89: Download complete
2021-07-14T16:18:40.5740358Z ca509a0cdd89: Pull complete
2021-07-14T16:18:40.5775554Z dddf2ca8b98c: Verifying Checksum
2021-07-14T16:18:40.5776150Z dddf2ca8b98c: Download complete
2021-07-14T16:18:40.7439310Z dddf2ca8b98c: Pull complete
2021-07-14T16:18:40.7475473Z Digest: sha256:4d894e10e93eba384672b94991f00105495df21e2f4abb230cf970689fe15360
2021-07-14T16:18:40.7494394Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-14T16:18:40.7526729Z quay.io/submariner/lighthouse-agent:devel
2021-07-14T16:18:40.7534755Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-14T16:18:41.0016220Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-14T16:18:41.2523952Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-14T16:18:41.5035791Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-14T16:18:41.5081612Z 90a87b1068d0: Preparing
2021-07-14T16:18:41.5082148Z c1ea72191433: Preparing
2021-07-14T16:18:41.5588678Z c1ea72191433: Pushed
2021-07-14T16:18:41.9996349Z 90a87b1068d0: Pushed
2021-07-14T16:18:42.0188692Z local: digest: sha256:4d894e10e93eba384672b94991f00105495df21e2f4abb230cf970689fe15360 size: 735
2021-07-14T16:18:42.0232959Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-14T16:18:42.0237679Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-14T16:18:42.0247195Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-14T16:18:42.2701066Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-14T16:18:42.2729109Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-14T16:18:42.7306638Z devel: Pulling from submariner/lighthouse-coredns
2021-07-14T16:18:42.7307275Z 088e56360f76: Pulling fs layer
2021-07-14T16:18:42.7307708Z 18aed70882d2: Pulling fs layer
2021-07-14T16:18:42.7958698Z 088e56360f76: Download complete
2021-07-14T16:18:42.8870349Z 18aed70882d2: Download complete
2021-07-14T16:18:42.9166849Z 088e56360f76: Pull complete
2021-07-14T16:18:43.1468191Z 18aed70882d2: Pull complete
2021-07-14T16:18:43.1831960Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-14T16:18:43.1854562Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-14T16:18:43.1889702Z quay.io/submariner/lighthouse-coredns:devel
2021-07-14T16:18:43.1897273Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-14T16:18:43.4547442Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-14T16:18:43.7146947Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-14T16:18:43.9711565Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-14T16:18:43.9806743Z 7fca351e51be: Preparing
2021-07-14T16:18:43.9807268Z 4fa0ece06e25: Preparing
2021-07-14T16:18:44.0512501Z 4fa0ece06e25: Pushed
2021-07-14T16:18:44.7066601Z 7fca351e51be: Pushed
2021-07-14T16:18:44.7351590Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-14T16:18:44.7388759Z Successfully remade target file 'preload-images'.
2021-07-14T16:18:44.7389793Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-14T16:18:44.7390777Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-14T16:18:44.7391724Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-14T16:18:44.7392419Z Must remake target 'deploy'.
2021-07-14T16:18:44.7393667Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:18:44.8471633Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-14T16:18:44.8502514Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-14T16:18:44.8515454Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:18:44.8526594Z [submariner-operator]$ script_name=utils
2021-07-14T16:18:44.8539274Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:18:44.8568649Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-14T16:18:44.8579627Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:18:44.8589532Z [submariner-operator]$ script_name=deploy_funcs
2021-07-14T16:18:44.8601412Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:18:44.8620574Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-14T16:18:44.8634384Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:18:44.8647099Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:18:44.8661022Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:18:44.8681973Z [submariner-operator]$ broker=cluster1
2021-07-14T16:18:44.8707316Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-14T16:18:44.8734759Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-14T16:18:44.8748645Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-14T16:18:44.8760900Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-14T16:18:44.8774752Z [submariner-operator]$ declare -gA cluster_subm
2021-07-14T16:18:44.8785210Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-14T16:18:44.8796900Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-14T16:18:44.8810913Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-14T16:18:44.8826084Z [submariner-operator]$ declare -gA cluster_cni
2021-07-14T16:18:44.8838085Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-14T16:18:44.8850826Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-14T16:18:44.8862472Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:18:44.8875337Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:18:44.8887747Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:18:44.8901782Z [submariner-operator]$ exec_name=deploy.sh
2021-07-14T16:18:44.8924943Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-14T16:18:44.8938347Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-14T16:18:44.8966680Z [submariner-operator]$ declare_cidrs
2021-07-14T16:18:44.8980799Z [submariner-operator]$ declare_cidrs
2021-07-14T16:18:44.8993191Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-14T16:18:44.9007287Z [submariner-operator]$ i=1
2021-07-14T16:18:44.9021583Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:18:44.9036288Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:18:44.9052325Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-14T16:18:44.9062512Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-14T16:18:44.9077036Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-14T16:18:44.9091490Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:18:44.9105603Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:18:44.9122112Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-14T16:18:44.9136448Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-14T16:18:44.9150428Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-14T16:18:44.9163758Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-14T16:18:44.9177681Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-14T16:18:44.9196644Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-14T16:18:44.9216842Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-14T16:18:44.9231283Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-14T16:18:44.9251468Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-14T16:18:44.9281317Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-14T16:18:45.0474257Z Installing subctl version devel
2021-07-14T16:18:45.0474775Z OS detected: linux
2021-07-14T16:18:45.0475275Z Architecture detected: amd64
2021-07-14T16:18:45.0482347Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-14T16:18:45.0483281Z
2021-07-14T16:18:45.0483664Z Downloading...
2021-07-14T16:18:46.3350434Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-14T16:18:46.3565832Z This provides subctl version: devel
2021-07-14T16:18:46.3582035Z
2021-07-14T16:18:46.3584991Z please update your path (and consider adding it to ~/.profile):
2021-07-14T16:18:46.3585620Z export PATH=$PATH:/go/bin
2021-07-14T16:18:46.3585965Z
2021-07-14T16:18:46.3690948Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-14T16:18:46.3703348Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-14T16:18:46.3710615Z Will deploy submariner using operator
2021-07-14T16:18:46.3724425Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-14T16:18:46.3746635Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:18:46.3838421Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-14T16:18:46.3854930Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-14T16:18:46.3887515Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-14T16:18:46.3906830Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-14T16:18:46.3922415Z 
2021-07-14T16:18:46.3941354Z [submariner-operator]$ [cluster2] subctl version
2021-07-14T16:18:47.0236605Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-14T16:18:47.0237474Z subctl version: devel-0aa05fd
2021-07-14T16:18:47.0245139Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-14T16:18:47.0247021Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-14T16:18:47.0248735Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-14T16:18:47.0250561Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-14T16:18:47.0251443Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-14T16:18:47.0253057Z [submariner-operator]$ [cluster2] grep -q function
2021-07-14T16:18:47.0254211Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0255975Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:18:47.0257109Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0259112Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-14T16:18:47.0260483Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0261882Z [cluster2] node/cluster2-worker not labeled
2021-07-14T16:18:47.0262845Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-14T16:18:47.0263883Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-14T16:18:47.0264910Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-14T16:18:47.0266220Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0268115Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0269791Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-14T16:18:47.0271770Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-14T16:18:47.0272648Z [cluster1] node/cluster1-worker not labeled
2021-07-14T16:18:47.0275460Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-14T16:18:47.0276078Z Installing broker...
2021-07-14T16:18:47.0278429Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-14T16:18:47.0279822Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-14T16:18:47.0281674Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:18:47.0283175Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:18:47.0285196Z [submariner-operator]$ [cluster1] pids[cluster1]=8649
2021-07-14T16:18:47.0286762Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:18:47.0288817Z [submariner-operator]$ [cluster2] pids[cluster2]=8652
2021-07-14T16:18:47.0289779Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-14T16:18:47.0290596Z [submariner-operator]$ [cluster2] wait 8652
2021-07-14T16:18:47.0291498Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:18:47.0292743Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:18:47.0293657Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-14T16:18:47.0294622Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:18:47.0295601Z [submariner-operator]$ [cluster2] wait 8649
2021-07-14T16:18:47.0296573Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-14T16:18:47.0297585Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-14T16:18:47.0298495Z [submariner-operator]$ [cluster1] setup_broker
2021-07-14T16:18:47.0299322Z [submariner-operator]$ [cluster1] setup_broker
2021-07-14T16:18:47.0300341Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-14T16:18:47.0301551Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-14T16:18:47.0302848Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-14T16:18:47.0304628Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-14T16:18:47.0305916Z • Setting up broker RBAC ...
2021-07-14T16:18:47.0310099Z ✓ Setting up broker RBAC
2021-07-14T16:18:47.0310736Z • Deploying the Submariner operator ...
2021-07-14T16:18:53.1536234Z ✓ Deploying the Submariner operator
2021-07-14T16:18:53.1537142Z ✓ Created operator service account and role
2021-07-14T16:18:53.1541535Z ✓ Created Lighthouse service accounts and roles
2021-07-14T16:18:53.1542225Z • Deploying the broker ...
2021-07-14T16:18:54.1984493Z ✓ Deploying the broker
2021-07-14T16:18:54.1985153Z ✓ The broker has been deployed
2021-07-14T16:18:54.1985785Z • Creating broker-info.subm file ...
2021-07-14T16:18:54.2119311Z ✓ Creating broker-info.subm file
2021-07-14T16:18:54.2123896Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-14T16_18_54Z
2021-07-14T16:18:54.2133239Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-14T16:18:54.2189582Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-14T16:18:54.2201393Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-14T16:18:54.2217117Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-14T16:18:54.2235428Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-14T16:18:54.2258971Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-14T16:18:54.2311840Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-14T16:18:54.2338724Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-14T16:18:54.2360271Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:18:54.2384998Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:18:54.2412686Z [submariner-operator]$ [cluster1] pids[cluster1]=8713
2021-07-14T16:18:54.2442101Z [submariner-operator]$ [cluster2] pids[cluster2]=8715
2021-07-14T16:18:54.2461880Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:18:54.2495044Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:18:54.2511701Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-14T16:18:54.2516807Z [submariner-operator]$ [cluster2] wait 8715
2021-07-14T16:18:54.2524235Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-14T16:18:54.2663463Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:18:54.2681551Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:19:14.0353672Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-14T16:19:14.0355102Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-14T16:19:14.0356473Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-14T16:19:14.0357751Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-14T16:19:14.0360733Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-14T16:19:14.0363615Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-14T16:19:14.0364779Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-14T16:19:14.0366382Z [cluster2] - cluster2-worker
2021-07-14T16:19:14.0367128Z [cluster2] • Discovering network details ...
2021-07-14T16:19:14.0367937Z [cluster2] Network plugin: weave-net
2021-07-14T16:19:14.0368444Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-14T16:19:14.0368927Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-14T16:19:14.0369579Z [cluster2] ✓ Discovering network details
2021-07-14T16:19:14.0370326Z [cluster2] • Discovering multi cluster details ...
2021-07-14T16:19:14.0371112Z [cluster2] • Validating Globalnet configurations ...
2021-07-14T16:19:14.0371899Z [cluster2] ✓ Validating Globalnet configurations
2021-07-14T16:19:14.0372644Z [cluster2] ✓ Discovering multi cluster details
2021-07-14T16:19:14.0373377Z [cluster2] • Deploying the Submariner operator ...
2021-07-14T16:19:14.0374141Z [cluster2] ✓ Deploying the Submariner operator
2021-07-14T16:19:14.0374900Z [cluster2] ✓ Created operator service account and role
2021-07-14T16:19:14.0375734Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-14T16:19:14.0376480Z [cluster2] • Creating SA for cluster ...
2021-07-14T16:19:14.0377133Z [cluster2] ✓ Creating SA for cluster
2021-07-14T16:19:14.0377766Z [cluster2] • Deploying Submariner ...
2021-07-14T16:19:14.0378469Z [cluster2] ✓ Deploying Submariner
2021-07-14T16:19:14.0379147Z [cluster2] ✓ Submariner is up and running
2021-07-14T16:19:14.0399696Z [submariner-operator]$ [cluster2] wait 8713
2021-07-14T16:19:18.8005264Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-14T16:19:18.8006208Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-14T16:19:18.8007279Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-14T16:19:18.8008482Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-14T16:19:18.8011048Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-14T16:19:18.8013720Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-14T16:19:18.8014719Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-14T16:19:18.8015408Z [cluster1] - cluster1-worker
2021-07-14T16:19:18.8016089Z [cluster1] • Discovering network details ...
2021-07-14T16:19:18.8016786Z [cluster1] Network plugin: weave-net
2021-07-14T16:19:18.8017300Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-14T16:19:18.8017808Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-14T16:19:18.8018453Z [cluster1] ✓ Discovering network details
2021-07-14T16:19:18.8019465Z [cluster1] • Discovering multi cluster details ...
2021-07-14T16:19:18.8020247Z [cluster1] • Validating Globalnet configurations ...
2021-07-14T16:19:18.8021031Z [cluster1] ✓ Validating Globalnet configurations
2021-07-14T16:19:18.8021773Z [cluster1] ✓ Discovering multi cluster details
2021-07-14T16:19:18.8022506Z [cluster1] • Deploying the Submariner operator ...
2021-07-14T16:19:18.8023258Z [cluster1] ✓ Deploying the Submariner operator
2021-07-14T16:19:18.8024036Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-14T16:19:18.8024751Z [cluster1] • Creating SA for cluster ...
2021-07-14T16:19:18.8025357Z [cluster1] ✓ Creating SA for cluster
2021-07-14T16:19:18.8025989Z [cluster1] • Deploying Submariner ...
2021-07-14T16:19:18.8026620Z [cluster1] ✓ Deploying Submariner
2021-07-14T16:19:18.8027266Z [cluster1] ✓ Submariner is up and running
2021-07-14T16:19:18.8034424Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-14T16:19:18.8051108Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-14T16:19:18.8067003Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-14T16:19:18.8078419Z [submariner-operator]$ [cluster2] with_retries
2021-07-14T16:19:18.8090551Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:19:18.8139185Z [submariner-operator]$ [cluster2] wait 8757
2021-07-14T16:19:18.8140085Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:18.8156810Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:18.8169888Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:19:18.8181011Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:18.8195546Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:19:18.9139490Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:18.9152867Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:19:19.0634635Z • ...
2021-07-14T16:19:19.0846079Z • ...
2021-07-14T16:19:19.0874095Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:19:19.0885196Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:19:25.0930599Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:19:25.0973658Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:25.1017142Z [submariner-operator]$ [cluster2] wait 8783
2021-07-14T16:19:25.1023468Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:25.1033247Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:19:25.1045478Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:25.1065838Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:19:25.4078994Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:25.4102877Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:19:25.5959357Z • ...
2021-07-14T16:19:25.6835511Z • ...
2021-07-14T16:19:25.6862038Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:19:25.6875523Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:19:31.6900638Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:19:31.6957211Z [submariner-operator]$ [cluster2] wait 8810
2021-07-14T16:19:31.6965673Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:31.7019837Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:31.7085544Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:19:31.7107575Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:31.7247715Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:19:32.4555668Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:32.4576454Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:19:32.6120334Z • ...
2021-07-14T16:19:32.8015992Z • ...
2021-07-14T16:19:32.8041184Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:19:32.8056088Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:19:38.8082829Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:19:38.8122765Z [submariner-operator]$ [cluster2] wait 8837
2021-07-14T16:19:38.8156962Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:38.8173185Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:39.5351139Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:19:39.5351877Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-14T16:19:39.5352819Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:39.5353892Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:19:39.5355193Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:39.5356084Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:19:39.5356730Z • ...
2021-07-14T16:19:39.5357108Z • ...
2021-07-14T16:19:39.5357738Z [submariner-operator]$ [cluster2] sleep 6
2021-07-14T16:19:45.3857610Z [submariner-operator]$ [cluster2] return 1
2021-07-14T16:19:45.3895182Z [submariner-operator]$ [cluster2] wait 8864
2021-07-14T16:19:45.3909307Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:45.3938111Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-14T16:19:45.3953506Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-14T16:19:45.3963653Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:45.4061418Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-14T16:19:45.4577881Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-14T16:19:45.4591029Z [submariner-operator]$ [cluster2] grep connected
2021-07-14T16:19:45.5111302Z • ...
2021-07-14T16:19:45.5259747Z • ...
2021-07-14T16:19:45.5284577Z cluster2-worker cluster2 172.18.0.7 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 0s
2021-07-14T16:19:45.5285606Z cluster1-worker cluster1 172.18.0.4 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 4.191379ms
2021-07-14T16:19:45.5305317Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:19:45.5322565Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:19:45.5348778Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-14T16:19:45.5363656Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-14T16:19:45.5379754Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-14T16:19:45.5394077Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-14T16:19:45.5406336Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-14T16:19:45.5419945Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-14T16:19:45.5431869Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-14T16:19:45.5446879Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-14T16:19:45.8207065Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-14T16:19:45.8259323Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-14T16:19:46.3036878Z devel: Pulling from submariner/nettest
2021-07-14T16:19:46.3037690Z 5843afab3874: Pulling fs layer
2021-07-14T16:19:46.3038124Z c4e538a54bac: Pulling fs layer
2021-07-14T16:19:46.3038560Z 9a7003ef0c64: Pulling fs layer
2021-07-14T16:19:46.3038975Z 13169dc98b5b: Pulling fs layer
2021-07-14T16:19:46.3039365Z 13169dc98b5b: Waiting
2021-07-14T16:19:46.3401725Z c4e538a54bac: Verifying Checksum
2021-07-14T16:19:46.3405620Z c4e538a54bac: Download complete
2021-07-14T16:19:46.4119347Z 9a7003ef0c64: Verifying Checksum
2021-07-14T16:19:46.4125453Z 9a7003ef0c64: Download complete
2021-07-14T16:19:46.4139724Z 13169dc98b5b: Verifying Checksum
2021-07-14T16:19:46.4140236Z 13169dc98b5b: Download complete
2021-07-14T16:19:46.4465727Z 5843afab3874: Verifying Checksum
2021-07-14T16:19:46.4466243Z 5843afab3874: Download complete
2021-07-14T16:19:46.6315474Z 5843afab3874: Pull complete
2021-07-14T16:19:46.7502603Z c4e538a54bac: Pull complete
2021-07-14T16:19:47.1392454Z 9a7003ef0c64: Pull complete
2021-07-14T16:19:47.2472654Z 13169dc98b5b: Pull complete
2021-07-14T16:19:47.2504726Z Digest: sha256:543b18d6e99bf290e0ad8994eb10b8160b9ceec0c6ab5017a5c6fc06c757906e
2021-07-14T16:19:47.2520642Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-14T16:19:47.2591447Z quay.io/submariner/nettest:devel
2021-07-14T16:19:47.2596229Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-14T16:19:47.5362869Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-14T16:19:47.8056339Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-14T16:19:48.0626758Z The push refers to repository [localhost:5000/nettest]
2021-07-14T16:19:48.0815331Z 7409cf092f1a: Preparing
2021-07-14T16:19:48.0815790Z cf25153378a9: Preparing
2021-07-14T16:19:48.0816218Z 1fbb10e45b76: Preparing
2021-07-14T16:19:48.0816725Z 72e830a4dff5: Preparing
2021-07-14T16:19:48.3425370Z 1fbb10e45b76: Pushed
2021-07-14T16:19:48.4146445Z 7409cf092f1a: Pushed
2021-07-14T16:19:48.6321217Z 72e830a4dff5: Pushed
2021-07-14T16:19:49.3052190Z cf25153378a9: Pushed
2021-07-14T16:19:49.3319950Z local: digest: sha256:543b18d6e99bf290e0ad8994eb10b8160b9ceec0c6ab5017a5c6fc06c757906e size: 1155
2021-07-14T16:19:49.3391577Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:49.3402960Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:49.3415908Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-14T16:19:49.3433183Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-14T16:19:49.3453846Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:49.3467393Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:49.3484664Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:49.8452104Z deployment.apps/netshoot created
2021-07-14T16:19:49.8517932Z Waiting for netshoot pods to be ready.
2021-07-14T16:19:49.8535033Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-14T16:19:49.8552341Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-14T16:19:49.8583529Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-14T16:19:50.1616788Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-14T16:19:51.9741007Z deployment "netshoot" successfully rolled out
2021-07-14T16:19:51.9795205Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:51.9807321Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:51.9823551Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:51.9836245Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-14T16:19:51.9852749Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-14T16:19:51.9873927Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-14T16:19:51.9895071Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:51.9906234Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:51.9922553Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:52.5089696Z deployment.apps/nginx-demo created
2021-07-14T16:19:52.5401262Z service/nginx-demo created
2021-07-14T16:19:52.6741953Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-14T16:19:52.6807991Z Waiting for nginx-demo pods to be ready.
2021-07-14T16:19:52.6823693Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:19:52.6839020Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:19:52.6856596Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-14T16:19:53.2601395Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-14T16:19:54.2042713Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-14T16:19:54.3176273Z deployment "nginx-demo" successfully rolled out
2021-07-14T16:19:54.3240104Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-14T16:19:54.3280831Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-14T16:19:54.3313859Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-14T16:19:54.3323939Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-14T16:19:54.3340204Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-14T16:19:54.6258528Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-14T16:19:54.6279250Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-14T16:19:54.6293141Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-14T16:19:54.6308392Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-14T16:19:54.6322468Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-14T16:19:54.6335593Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-14T16:19:54.6386226Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:19:54.6404822Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:19:54.6418274Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-14T16:19:54.6434070Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-14T16:19:54.9237986Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-28hzz 100.1.6.200
2021-07-14T16:19:54.9251471Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-28hzz 100.1.6.200
2021-07-14T16:19:54.9266993Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:19:54.9294752Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-28hzz 100.1.6.200
2021-07-14T16:19:54.9299723Z [submariner-operator]$ [cluster2] wait 9017
2021-07-14T16:19:54.9307458Z [submariner-operator]$ [cluster2] test_connection
2021-07-14T16:19:54.9313964Z Attempting connectivity between clusters - netshoot-57677568b8-28hzz --> 100.1.6.200
2021-07-14T16:19:54.9327430Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-14T16:19:54.9338206Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-14T16:19:54.9356779Z [submariner-operator]$ [cluster2] date +%s
2021-07-14T16:19:54.9387997Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-28hzz -- curl --output /dev/null -m 30 --silent --head --fail 100.1.6.200
2021-07-14T16:19:54.9402719Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-28hzz -- curl --output /dev/null -m 30 --silent --head --fail 100.1.6.200
2021-07-14T16:19:54.9416345Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-28hzz -- curl --output /dev/null -m 30 --silent --head --fail 100.1.6.200
2021-07-14T16:19:55.3197203Z Connection test was successful!
2021-07-14T16:19:55.3213188Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:19:55.3233647Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:55.3252497Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:55.3277434Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:55.3286420Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:55.3312060Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-14T16:19:55.6889383Z deployment.apps "netshoot" deleted
2021-07-14T16:19:55.7056531Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5417055Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5418176Z deployment.apps "nginx-demo" deleted
2021-07-14T16:19:56.5419232Z service "nginx-demo" deleted
2021-07-14T16:19:56.5420269Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-14T16:19:56.5421313Z Successfully remade target file 'deploy'.
2021-07-14T16:19:56.5422046Z File 'e2e' does not exist.
2021-07-14T16:19:56.5422680Z Must remake target 'e2e'.
2021-07-14T16:19:56.5423422Z scripts/kind-e2e/e2e.sh
2021-07-14T16:19:56.5425017Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5426329Z [submariner-operator]$ [cluster1] remove_resource
2021-07-14T16:19:56.5427664Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5429164Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5431988Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-14T16:19:56.5433189Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-14T16:19:56.5434109Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-14T16:19:56.5435014Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-14T16:19:56.5436075Z [submariner-operator]$ [cluster2] grep -q function
2021-07-14T16:19:56.5436910Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:19:56.5437795Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-14T16:19:56.5438716Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:19:56.5439566Z [submariner-operator]$ script_name=utils
2021-07-14T16:19:56.5440338Z [submariner-operator]$ exec_name=e2e.sh
2021-07-14T16:19:56.5441254Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-14T16:19:56.5442203Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:19:56.5443080Z [submariner-operator]$ script_name=deploy_funcs
2021-07-14T16:19:56.5443867Z [submariner-operator]$ exec_name=e2e.sh
2021-07-14T16:19:56.5444787Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-14T16:19:56.5445760Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:19:56.5446654Z [submariner-operator]$ script_name=deploy_operator
2021-07-14T16:19:56.5447478Z [submariner-operator]$ exec_name=e2e.sh
2021-07-14T16:19:56.5448565Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-14T16:19:56.5449548Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:19:56.5450437Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:19:56.5451270Z [submariner-operator]$ exec_name=e2e.sh
2021-07-14T16:19:56.5452050Z [submariner-operator]$ broker=cluster1
2021-07-14T16:19:56.5452857Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-14T16:19:56.5453813Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-14T16:19:56.5454840Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-14T16:19:56.5455917Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-14T16:19:56.5456881Z [submariner-operator]$ declare -gA cluster_subm
2021-07-14T16:19:56.5457740Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-14T16:19:56.5458592Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-14T16:19:56.5459460Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-14T16:19:56.5460306Z [submariner-operator]$ declare -gA cluster_cni
2021-07-14T16:19:56.5461251Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-14T16:19:56.5462132Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-14T16:19:56.5463366Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-14T16:19:56.5464581Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-14T16:19:56.5465470Z [submariner-operator]$ script_name=cluster_settings
2021-07-14T16:19:56.5466307Z [submariner-operator]$ exec_name=e2e.sh
2021-07-14T16:19:56.5467276Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-14T16:19:56.5468368Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-14T16:19:56.5469267Z [submariner-operator]$ timeout=2m
2021-07-14T16:19:56.5470035Z [submariner-operator]$ declare_kubeconfig
2021-07-14T16:19:56.5470865Z [submariner-operator]$ declare_kubeconfig
2021-07-14T16:19:56.5471764Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-14T16:19:56.5472647Z [submariner-operator]$ export KUBECONFIG
2021-07-14T16:19:56.5473705Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-14T16:19:56.5475091Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-14T16:19:56.5476720Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-14T16:19:56.5477837Z [submariner-operator]$ create_subm_vars
2021-07-14T16:19:56.5478603Z [submariner-operator]$ create_subm_vars
2021-07-14T16:19:56.5479418Z [submariner-operator]$ deployment_name=submariner
2021-07-14T16:19:56.5480445Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-14T16:19:56.5481557Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-14T16:19:56.5482711Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-14T16:19:56.5483891Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-14T16:19:56.5485032Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-14T16:19:56.5485977Z [submariner-operator]$ declare_cidrs
2021-07-14T16:19:56.5486731Z [submariner-operator]$ declare_cidrs
2021-07-14T16:19:56.5487667Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-14T16:19:56.5512502Z [submariner-operator]$ i=1
2021-07-14T16:19:56.5513357Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:19:56.5514315Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-14T16:19:56.5515271Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-14T16:19:56.5516231Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-14T16:19:56.5517081Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-14T16:19:56.5517952Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:19:56.5518882Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-14T16:19:56.5519842Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-14T16:19:56.5520810Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-14T16:19:56.5521657Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-14T16:19:56.5522494Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-14T16:19:56.5523450Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-14T16:19:56.5524584Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-14T16:19:56.5525487Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-14T16:19:56.5526379Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-14T16:19:56.5527246Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-14T16:19:56.5528207Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-14T16:19:56.5529084Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-14T16:19:56.5529964Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-14T16:19:56.5530854Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-14T16:19:56.5531814Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-14T16:19:56.5532940Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-14T16:19:56.5534034Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-14T16:19:56.5535032Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-14T16:19:56.5535987Z [submariner-operator]$ [cluster1] broker_vars
2021-07-14T16:19:56.5536794Z [submariner-operator]$ [cluster1] broker_vars
2021-07-14T16:19:56.5538194Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-14T16:19:56.5539911Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-14T16:19:56.5541653Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-14T16:19:56.5543411Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-14T16:19:56.5545508Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-14T16:19:56.5547900Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-14T16:19:56.5550374Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-14T16:19:56.5552958Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-14T16:19:57.0093908Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-14T16:19:57.0120781Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-14T16:19:57.0151742Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-14T16:19:57.0167692Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-14T16:19:57.0196674Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-14T16:19:57.4400921Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-14T16:19:57.4416764Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-14T16:19:57.4428940Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-14T16:19:57.4439964Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-14T16:19:57.5030361Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:19:57.5883808Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:19:57.6311216Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-14T16:19:57.6312395Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-14T16:19:57.6313970Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-14T16:19:57.6315018Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-14T16:19:57.6316087Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-14T16:19:57.6317394Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-14T16:19:57.8192593Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-14T16:19:57.8202356Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-14T16:19:57.8226171Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-14T16:19:57.8240522Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-14T16:19:58.0964159Z [submariner-operator]$ [cluster1] return
2021-07-14T16:19:58.0981259Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-14T16:19:58.0996565Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-14T16:19:58.1012975Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-14T16:19:58.4201007Z NAME TYPE DATA AGE
2021-07-14T16:19:58.4209166Z cluster-cluster1-token-7zr8t kubernetes.io/service-account-token 3 3m44s
2021-07-14T16:19:58.4215838Z cluster-cluster2-token-gccg9 kubernetes.io/service-account-token 3 3m39s
2021-07-14T16:19:58.4224863Z default-token-hczsb kubernetes.io/service-account-token 3 4m1s
2021-07-14T16:19:58.4231164Z submariner-k8s-broker-admin-token-99pln kubernetes.io/service-account-token 3 4m1s
2021-07-14T16:19:58.4288495Z submariner-k8s-broker-client-token-4ct6d kubernetes.io/service-account-token 3 4m1s
2021-07-14T16:19:58.4389976Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-14T16:19:58.4401472Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-14T16:19:58.4412913Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-14T16:19:58.7211211Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:58.7224245Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-4ct6d -n submariner-k8s-broker -o json
2021-07-14T16:19:58.7240998Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:58.7260484Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-4ct6d -n submariner-k8s-broker -o json
2021-07-14T16:19:58.7277032Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-4ct6d -n submariner-k8s-broker -o json
2021-07-14T16:19:58.9788989Z {
2021-07-14T16:19:58.9789532Z "apiVersion": "v1",
2021-07-14T16:19:58.9789879Z "data": {
2021-07-14T16:19:59.0261906Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-14T16:19:59.0704509Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-14T16:19:59.1131984Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklucEpSV2RaUkhSUVRtOTNSR3RhUkd4MFMzQlNiVXRwZWtFM1oxODJlVVJ2VkcwNFRsQlRUMXBCVlRRaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkwMFkzUTJaQ0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pT1RRMk1UQXpOelF0T1RNMU5DMDBOR0U0TFdFeE4yVXROVFpsT1RBNFpqY3dZbVV4SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLllsbG5GbER6ZW1kTG1ULWZybjZUd0RyS2pONmtvQnNYbnVUZ1dLeXMxa251LUxLWWhDcGllU1JvM0VOcEVDQmZMT0NRaDRtdlkydGpBQ25vaTIxUU9vVFpSSVBzVzRBM3pNMVFmMDdyVWdLbUY4bFdzb2xMRkE2VDNXUVkyd2M0b1poeFNwMUJyN01aRXMwaFdweWJuUFlyRVh4bG5hM0l2U0F1cjRQNmRMRXp3Mk8xQ0RtMkplUmo3aWpKaE1CV21iWXZLYWUxZHBsejdMS3IzTldjbkNiQkowTEZEU0hDUkNCWl9DaGthMkF4R2YyVG1wdURCNWZ5WGMwRi1MQmsyYkhhNzl1dWFPdGFfcXRKbjBFVFJkS0M2Wm1sbmRzZzZSZ2FER1htTDQ1aTF1QTJ1ZlF1S3RJZ3o1eGtSWElndWRMTEZLNnB3ZVZCSVNheXRuSGlLdw=="
2021-07-14T16:19:59.1583340Z },
2021-07-14T16:19:59.1583725Z "kind": "Secret",
2021-07-14T16:19:59.1584080Z "metadata": {
2021-07-14T16:19:59.1584470Z "annotations": {
2021-07-14T16:19:59.1586132Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-14T16:19:59.1587344Z "kubernetes.io/service-account.uid": "94610374-9354-44a8-a17e-56e908f70be1"
2021-07-14T16:19:59.1587940Z },
2021-07-14T16:19:59.1588517Z "creationTimestamp": "2021-07-14T16:15:57Z",
2021-07-14T16:19:59.1589023Z "managedFields": [
2021-07-14T16:19:59.1589374Z {
2021-07-14T16:19:59.1589731Z "apiVersion": "v1",
2021-07-14T16:19:59.1590157Z "fieldsType": "FieldsV1",
2021-07-14T16:19:59.1590574Z "fieldsV1": {
2021-07-14T16:19:59.1590916Z "f:data": {
2021-07-14T16:19:59.1591246Z ".": {},
2021-07-14T16:19:59.1591583Z "f:ca.crt": {},
2021-07-14T16:19:59.1591971Z "f:namespace": {},
2021-07-14T16:19:59.1592341Z "f:token": {}
2021-07-14T16:19:59.1592670Z },
2021-07-14T16:19:59.1597736Z "f:metadata": {
2021-07-14T16:19:59.1598249Z "f:annotations": {
2021-07-14T16:19:59.1598627Z ".": {},
2021-07-14T16:19:59.1599852Z "f:kubernetes.io/service-account.name": {},
2021-07-14T16:19:59.1600749Z "f:kubernetes.io/service-account.uid": {}
2021-07-14T16:19:59.1601239Z }
2021-07-14T16:19:59.1601546Z },
2021-07-14T16:19:59.1601862Z "f:type": {}
2021-07-14T16:19:59.1602181Z },
2021-07-14T16:19:59.1602795Z "manager": "kube-controller-manager",
2021-07-14T16:19:59.1603351Z "operation": "Update",
2021-07-14T16:19:59.1603894Z "time": "2021-07-14T16:15:57Z"
2021-07-14T16:19:59.1604793Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-14T16:19:59.1605765Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-14T16:19:59.1607350Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:59.1611023Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-14T16:19:59.1612404Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-14T16:19:59.1614170Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:59.1616156Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-4ct6d
2021-07-14T16:19:59.1618183Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-4ct6d
2021-07-14T16:19:59.1620243Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:59.1622065Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-14T16:19:59.1623459Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-14T16:19:59.1625358Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:59.1627624Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-4ct6d.cluster1.json
2021-07-14T16:19:59.1628776Z }
2021-07-14T16:19:59.1629054Z ],
2021-07-14T16:19:59.1629894Z "name": "submariner-k8s-broker-client-token-4ct6d",
2021-07-14T16:19:59.1630881Z "namespace": "submariner-k8s-broker",
2021-07-14T16:19:59.1631444Z "resourceVersion": "1160",
2021-07-14T16:19:59.1632138Z "uid": "4b37148a-bbf0-423f-8674-19fb1025d1ef"
2021-07-14T16:19:59.1632567Z },
2021-07-14T16:19:59.1633208Z "type": "kubernetes.io/service-account-token"
2021-07-14T16:19:59.1633698Z }
2021-07-14T16:19:59.1810169Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-14T16:19:59.1822460Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-14T16:19:59.1836499Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-14T16:19:59.1888782Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-14T16:19:59.1939112Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-14T16:19:59.1954405Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-14T16:19:59.1967364Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-14T16:19:59.1986767Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-14T16:19:59.2011048Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-14T16:19:59.2014167Z [submariner-operator]$ [cluster1] pids[cluster1]=9279
2021-07-14T16:19:59.2031075Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-14T16:19:59.2039427Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-14T16:19:59.2050638Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-14T16:19:59.2057073Z [submariner-operator]$ [cluster2] pids[cluster2]=9282
2021-07-14T16:19:59.2073717Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-14T16:19:59.2079698Z [submariner-operator]$ [cluster2] wait 9282
2021-07-14T16:19:59.2098118Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-14T16:19:59.9110731Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-14T16:19:59.9111717Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-14T16:19:59.9112613Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-14T16:19:59.9113714Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-14T16:19:59.9115001Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-14T16:19:59.9116234Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-14T16:19:59.9117416Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-14T16:19:59.9118734Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-14T16:19:59.9119601Z [cluster2] NAME CREATED AT
2021-07-14T16:19:59.9120612Z [cluster2] endpoints.submariner.io 2021-07-14T16:16:18Z
2021-07-14T16:19:59.9121851Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:19:59.9123224Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9124610Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:19:59.9125984Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9127308Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9128391Z [cluster2] {
2021-07-14T16:19:59.9128929Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:19:59.9129666Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-14T16:19:59.9130245Z [cluster2] "metadata": {
2021-07-14T16:19:59.9130696Z [cluster2] "annotations": {
2021-07-14T16:19:59.9131552Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:19:59.9132314Z [cluster2] },
2021-07-14T16:19:59.9132966Z [cluster2] "creationTimestamp": "2021-07-14T16:16:18Z",
2021-07-14T16:19:59.9133512Z [cluster2] "generation": 1,
2021-07-14T16:19:59.9134002Z [cluster2] "managedFields": [
2021-07-14T16:19:59.9134423Z [cluster2] {
2021-07-14T16:19:59.9134990Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:19:59.9135615Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:19:59.9136108Z [cluster2] "fieldsV1": {
2021-07-14T16:19:59.9136550Z [cluster2] "f:metadata": {
2021-07-14T16:19:59.9137026Z [cluster2] "f:annotations": {
2021-07-14T16:19:59.9137461Z [cluster2] ".": {},
2021-07-14T16:19:59.9138298Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:19:59.9138957Z [cluster2] }
2021-07-14T16:19:59.9139323Z [cluster2] },
2021-07-14T16:19:59.9139730Z [cluster2] "f:spec": {
2021-07-14T16:19:59.9140174Z [cluster2] "f:conversion": {
2021-07-14T16:19:59.9140620Z [cluster2] ".": {},
2021-07-14T16:19:59.9141043Z [cluster2] "f:strategy": {}
2021-07-14T16:19:59.9141466Z [cluster2] },
2021-07-14T16:19:59.9142004Z [cluster2] "f:group": {},
2021-07-14T16:19:59.9142446Z [cluster2] "f:names": {
2021-07-14T16:19:59.9142867Z [cluster2] "f:kind": {},
2021-07-14T16:19:59.9143322Z [cluster2] "f:listKind": {},
2021-07-14T16:19:59.9143791Z [cluster2] "f:plural": {},
2021-07-14T16:19:59.9144242Z [cluster2] "f:singular": {}
2021-07-14T16:19:59.9144673Z [cluster2] },
2021-07-14T16:19:59.9145141Z [cluster2] "f:scope": {},
2021-07-14T16:19:59.9145662Z [cluster2] "f:versions": {}
2021-07-14T16:19:59.9146074Z [cluster2] },
2021-07-14T16:19:59.9146483Z [cluster2] "f:status": {
2021-07-14T16:19:59.9146960Z [cluster2] "f:acceptedNames": {
2021-07-14T16:19:59.9147451Z [cluster2] "f:kind": {},
2021-07-14T16:19:59.9148107Z [cluster2] "f:plural": {}
2021-07-14T16:19:59.9148511Z [cluster2] },
2021-07-14T16:19:59.9148954Z [cluster2] "f:conditions": {},
2021-07-14T16:19:59.9149461Z [cluster2] "f:storedVersions": {}
2021-07-14T16:19:59.9149927Z [cluster2] }
2021-07-14T16:19:59.9150290Z [cluster2] },
2021-07-14T16:19:59.9151014Z [cluster2] "manager": "submariner-operator",
2021-07-14T16:19:59.9151725Z [cluster2] "operation": "Update",
2021-07-14T16:19:59.9152365Z [cluster2] "time": "2021-07-14T16:16:25Z"
2021-07-14T16:19:59.9152764Z [cluster2] }
2021-07-14T16:19:59.9153130Z [cluster2] ],
2021-07-14T16:19:59.9153765Z [cluster2] "name": "endpoints.submariner.io",
2021-07-14T16:19:59.9154381Z [cluster2] "resourceVersion": "1324",
2021-07-14T16:19:59.9155200Z [cluster2] "uid": "a5225ca1-99af-4bd2-9160-d0af48fe28d2"
2021-07-14T16:19:59.9155718Z [cluster2] },
2021-07-14T16:19:59.9156094Z [cluster2] "spec": {
2021-07-14T16:19:59.9156514Z [cluster2] "conversion": {
2021-07-14T16:19:59.9156981Z [cluster2] "strategy": "None"
2021-07-14T16:19:59.9157387Z [cluster2] },
2021-07-14T16:19:59.9157833Z [cluster2] "group": "submariner.io",
2021-07-14T16:19:59.9158284Z [cluster2] "names": {
2021-07-14T16:19:59.9158717Z [cluster2] "kind": "Endpoint",
2021-07-14T16:19:59.9159218Z [cluster2] "listKind": "EndpointList",
2021-07-14T16:19:59.9159746Z [cluster2] "plural": "endpoints",
2021-07-14T16:19:59.9160260Z [cluster2] "singular": "endpoint"
2021-07-14T16:19:59.9190046Z [cluster2] },
2021-07-14T16:19:59.9190547Z [cluster2] "scope": "Namespaced",
2021-07-14T16:19:59.9191006Z [cluster2] "versions": [
2021-07-14T16:19:59.9191414Z [cluster2] {
2021-07-14T16:19:59.9191808Z [cluster2] "name": "v1",
2021-07-14T16:19:59.9192226Z [cluster2] "schema": {
2021-07-14T16:19:59.9192725Z [cluster2] "openAPIV3Schema": {
2021-07-14T16:19:59.9193242Z [cluster2] "properties": {
2021-07-14T16:19:59.9193738Z [cluster2] "apiVersion": {
2021-07-14T16:19:59.9196059Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:19:59.9197685Z [cluster2] "type": "string"
2021-07-14T16:19:59.9198130Z [cluster2] },
2021-07-14T16:19:59.9198525Z [cluster2] "kind": {
2021-07-14T16:19:59.9200613Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:19:59.9202194Z [cluster2] "type": "string"
2021-07-14T16:19:59.9202619Z [cluster2] },
2021-07-14T16:19:59.9203060Z [cluster2] "metadata": {
2021-07-14T16:19:59.9203523Z [cluster2] "type": "object"
2021-07-14T16:19:59.9203949Z [cluster2] },
2021-07-14T16:19:59.9204345Z [cluster2] "spec": {
2021-07-14T16:19:59.9204823Z [cluster2] "properties": {
2021-07-14T16:19:59.9205310Z [cluster2] "backend": {
2021-07-14T16:19:59.9205774Z [cluster2] "type": "string"
2021-07-14T16:19:59.9206218Z [cluster2] },
2021-07-14T16:19:59.9206662Z [cluster2] "backend_config": {
2021-07-14T16:19:59.9207261Z [cluster2] "additionalProperties": {
2021-07-14T16:19:59.9208489Z [cluster2] "type": "string"
2021-07-14T16:19:59.9208945Z [cluster2] },
2021-07-14T16:19:59.9209495Z [cluster2] "type": "object"
2021-07-14T16:19:59.9209926Z [cluster2] },
2021-07-14T16:19:59.9210371Z [cluster2] "cable_name": {
2021-07-14T16:19:59.9210842Z [cluster2] "type": "string"
2021-07-14T16:19:59.9211285Z [cluster2] },
2021-07-14T16:19:59.9211715Z [cluster2] "cluster_id": {
2021-07-14T16:19:59.9212197Z [cluster2] "type": "string"
2021-07-14T16:19:59.9212756Z [cluster2] },
2021-07-14T16:19:59.9213234Z [cluster2] "healthCheckIP": {
2021-07-14T16:19:59.9213759Z [cluster2] "type": "string"
2021-07-14T16:19:59.9214187Z [cluster2] },
2021-07-14T16:19:59.9214633Z [cluster2] "hostname": {
2021-07-14T16:19:59.9215102Z [cluster2] "type": "string"
2021-07-14T16:19:59.9215545Z [cluster2] },
2021-07-14T16:19:59.9215976Z [cluster2] "nat_enabled": {
2021-07-14T16:19:59.9216468Z [cluster2] "type": "boolean"
2021-07-14T16:19:59.9216975Z [cluster2] },
2021-07-14T16:19:59.9217425Z [cluster2] "private_ip": {
2021-07-14T16:19:59.9217910Z [cluster2] "type": "string"
2021-07-14T16:19:59.9218340Z [cluster2] },
2021-07-14T16:19:59.9218781Z [cluster2] "public_ip": {
2021-07-14T16:19:59.9219247Z [cluster2] "type": "string"
2021-07-14T16:19:59.9219689Z [cluster2] },
2021-07-14T16:19:59.9220112Z [cluster2] "subnets": {
2021-07-14T16:19:59.9220567Z [cluster2] "items": {
2021-07-14T16:19:59.9221031Z [cluster2] "type": "string"
2021-07-14T16:19:59.9221477Z [cluster2] },
2021-07-14T16:19:59.9221919Z [cluster2] "type": "array"
2021-07-14T16:19:59.9222415Z [cluster2] }
2021-07-14T16:19:59.9222818Z [cluster2] },
2021-07-14T16:19:59.9223244Z [cluster2] "required": [
2021-07-14T16:19:59.9223712Z [cluster2] "backend",
2021-07-14T16:19:59.9224162Z [cluster2] "cable_name",
2021-07-14T16:19:59.9224631Z [cluster2] "cluster_id",
2021-07-14T16:19:59.9276054Z [cluster2] [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-14T16:19:59.9277243Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-14T16:19:59.9278151Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-14T16:19:59.9279260Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-14T16:19:59.9280521Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-14T16:19:59.9281769Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-14T16:19:59.9282977Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-14T16:19:59.9284286Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-14T16:19:59.9285227Z [cluster1] NAME CREATED AT
2021-07-14T16:19:59.9285975Z [cluster1] endpoints.submariner.io 2021-07-14T16:16:08Z
2021-07-14T16:19:59.9287384Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:19:59.9289404Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9290656Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9292032Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-14T16:19:59.9293508Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:19:59.9294387Z [cluster1] {
2021-07-14T16:19:59.9294916Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:19:59.9295659Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-14T16:19:59.9296229Z [cluster1] "metadata": {
2021-07-14T16:19:59.9296676Z [cluster1] "annotations": {
2021-07-14T16:19:59.9297521Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:19:59.9298169Z [cluster1] },
2021-07-14T16:19:59.9298831Z [cluster1] "creationTimestamp": "2021-07-14T16:16:08Z",
2021-07-14T16:19:59.9299370Z [cluster1] "generation": 1,
2021-07-14T16:19:59.9299856Z [cluster1] "managedFields": [
2021-07-14T16:19:59.9300291Z [cluster1] {
2021-07-14T16:19:59.9300854Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:19:59.9301483Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:19:59.9301984Z [cluster1] "fieldsV1": {
2021-07-14T16:19:59.9302426Z [cluster1] "f:metadata": {
2021-07-14T16:19:59.9302910Z [cluster1] "f:annotations": {
2021-07-14T16:19:59.9303357Z [cluster1] ".": {},
2021-07-14T16:19:59.9304185Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:19:59.9304846Z [cluster1] }
2021-07-14T16:19:59.9305216Z [cluster1] },
2021-07-14T16:19:59.9305624Z [cluster1] "f:spec": {
2021-07-14T16:19:59.9306111Z [cluster1] "f:conversion": {
2021-07-14T16:19:59.9306559Z [cluster1] ".": {},
2021-07-14T16:19:59.9306983Z [cluster1] "f:strategy": {}
2021-07-14T16:19:59.9307410Z [cluster1] },
2021-07-14T16:19:59.9307931Z [cluster1] "f:group": {},
2021-07-14T16:19:59.9308380Z [cluster1] "f:names": {
2021-07-14T16:19:59.9308819Z [cluster1] "f:kind": {},
2021-07-14T16:19:59.9309261Z [cluster1] "f:listKind": {},
2021-07-14T16:19:59.9309725Z [cluster1] "f:plural": {},
2021-07-14T16:19:59.9310177Z [cluster1] "f:singular": {}
2021-07-14T16:19:59.9310603Z [cluster1] },
2021-07-14T16:19:59.9311009Z [cluster1] "f:scope": {},
2021-07-14T16:19:59.9311465Z [cluster1] "f:versions": {}
2021-07-14T16:19:59.9311881Z [cluster1] },
2021-07-14T16:19:59.9312296Z [cluster1] "f:status": {
2021-07-14T16:19:59.9312775Z [cluster1] "f:acceptedNames": {
2021-07-14T16:19:59.9313266Z [cluster1] "f:kind": {},
2021-07-14T16:19:59.9313710Z [cluster1] "f:plural": {}
2021-07-14T16:19:59.9314114Z [cluster1] },
2021-07-14T16:19:59.9314554Z [cluster1] "f:conditions": {},
2021-07-14T16:19:59.9315065Z [cluster1] "f:storedVersions": {}
2021-07-14T16:19:59.9315530Z [cluster1] }
2021-07-14T16:19:59.9315895Z [cluster1] },
2021-07-14T16:19:59.9316601Z [cluster1] "manager": "submariner-operator",
2021-07-14T16:19:59.9317262Z [cluster1] "operation": "Update",
2021-07-14T16:19:59.9317899Z [cluster1] "time": "2021-07-14T16:16:14Z"
2021-07-14T16:19:59.9318308Z [cluster1] }
2021-07-14T16:19:59.9318660Z [cluster1] ],
2021-07-14T16:19:59.9319200Z [cluster1] "name": "endpoints.submariner.io",
2021-07-14T16:19:59.9319811Z [cluster1] "resourceVersion": "1346",
2021-07-14T16:19:59.9320651Z [cluster1] "uid": "a630edaf-53e8-4bdb-a4f1-55f7f7d2a75f"
2021-07-14T16:19:59.9321212Z [cluster1] },
2021-07-14T16:19:59.9321593Z [cluster1] "spec": {
2021-07-14T16:19:59.9322018Z [cluster1] "conversion": {
2021-07-14T16:19:59.9322464Z [cluster1] "strategy": "None"
2021-07-14T16:19:59.9322877Z [cluster1] },
2021-07-14T16:19:59.9323308Z [cluster1] "group": "submariner.io",
2021-07-14T16:19:59.9323771Z [cluster1] "names": {
2021-07-14T16:19:59.9324192Z [cluster1] "kind": "Endpoint",
2021-07-14T16:19:59.9324706Z [cluster1] "listKind": "EndpointList",
2021-07-14T16:19:59.9325235Z [cluster1] "plural": "endpoints",
2021-07-14T16:19:59.9325727Z [cluster1] "singular": "endpoint"
2021-07-14T16:19:59.9326156Z [cluster1] },
2021-07-14T16:19:59.9326578Z [cluster1] "scope": "Namespaced",
2021-07-14T16:19:59.9327043Z [cluster1] "versions": [
2021-07-14T16:19:59.9327434Z [cluster1] {
2021-07-14T16:19:59.9375269Z [cluster1] "name": "v1",
2021-07-14T16:19:59.9375910Z [cluster1] "schema": {
2021-07-14T16:19:59.9376580Z [cluster1] "openAPIV3Schema": {
2021-07-14T16:19:59.9377104Z [cluster1] "properties": {
2021-07-14T16:19:59.9377601Z [cluster1] "apiVersion": {
2021-07-14T16:19:59.9380878Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:19:59.9382490Z [cluster1] "type": "string"
2021-07-14T16:19:59.9382930Z [cluster1] },
2021-07-14T16:19:59.9383348Z [cluster1] "kind": {
2021-07-14T16:19:59.9385512Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:19:59.9390194Z [cluster1] "type": "string"
2021-07-14T16:19:59.9390641Z [cluster1] },
2021-07-14T16:19:59.9391065Z [cluster1] "metadata": {
2021-07-14T16:19:59.9391556Z [cluster1] "type": "object"
2021-07-14T16:19:59.9391972Z [cluster1] },
2021-07-14T16:19:59.9392386Z [cluster1] "spec": {
2021-07-14T16:19:59.9392847Z [cluster1] "properties": {
2021-07-14T16:19:59.9393329Z [cluster1] "backend": {
2021-07-14T16:19:59.9393794Z [cluster1] "type": "string"
2021-07-14T16:19:59.9394239Z [cluster1] },
2021-07-14T16:19:59.9394697Z [cluster1] "backend_config": {
2021-07-14T16:19:59.9395283Z [cluster1] "additionalProperties": {
2021-07-14T16:19:59.9395876Z [cluster1] "type": "string"
2021-07-14T16:19:59.9396309Z [cluster1] },
2021-07-14T16:19:59.9396902Z [cluster1] "type": "object"
2021-07-14T16:19:59.9397330Z [cluster1] },
2021-07-14T16:19:59.9397772Z [cluster1] "cable_name": {
2021-07-14T16:19:59.9398252Z [cluster1] "type": "string"
2021-07-14T16:19:59.9398677Z [cluster1] },
2021-07-14T16:19:59.9399113Z [cluster1] "cluster_id": {
2021-07-14T16:19:59.9399590Z [cluster1] "type": "string"
2021-07-14T16:19:59.9400028Z [cluster1] },
2021-07-14T16:19:59.9400494Z [cluster1] "healthCheckIP": {
2021-07-14T16:19:59.9401021Z [cluster1] "type": "string"
2021-07-14T16:19:59.9401450Z [cluster1] },
2021-07-14T16:19:59.9402051Z [cluster1] "hostname": {
2021-07-14T16:19:59.9402537Z [cluster1] "type": "string"
2021-07-14T16:19:59.9402963Z [cluster1] },
2021-07-14T16:19:59.9403407Z [cluster1] "nat_enabled": {
2021-07-14T16:19:59.9403898Z [cluster1] "type": "boolean"
2021-07-14T16:19:59.9404346Z [cluster1] },
2021-07-14T16:19:59.9404779Z [cluster1] "private_ip": {
2021-07-14T16:19:59.9405262Z [cluster1] "type": "string"
2021-07-14T16:19:59.9405694Z [cluster1] },
2021-07-14T16:19:59.9406123Z [cluster1] "public_ip": {
2021-07-14T16:19:59.9406602Z [cluster1] "type": "string"
2021-07-14T16:19:59.9407027Z [cluster1] },
2021-07-14T16:19:59.9407465Z [cluster1] "subnets": {
2021-07-14T16:19:59.9408860Z [cluster1] "items": {
2021-07-14T16:19:59.9409339Z [cluster1] "type": "string"
2021-07-14T16:19:59.9409776Z [cluster1] },
2021-07-14T16:19:59.9410228Z [cluster1] "type": "array"
2021-07-14T16:19:59.9411531Z [cluster1] }
2021-07-14T16:19:59.9412053Z [cluster1] },
2021-07-14T16:19:59.9412502Z [cluster1] "required": [
2021-07-14T16:19:59.9412958Z [cluster1] "backend",
2021-07-14T16:19:59.9413420Z [cluster1] "cable_name",
2021-07-14T16:19:59.9413875Z [cluster1] "cluster_id",
2021-07-14T16:20:00.4358521Z [cluster1] "hostname",
2021-07-14T16:20:00.4359161Z [cluster2] "nat_enabled",
2021-07-14T16:20:00.4359665Z [cluster2] "private_ip",
2021-07-14T16:20:00.4360150Z [cluster2] "public_ip",
2021-07-14T16:20:00.4360601Z [cluster2] "subnets"
2021-07-14T16:20:00.4361035Z [cluster2] ],
2021-07-14T16:20:00.4361469Z [cluster2] "type": "object"
2021-07-14T16:20:00.4362011Z [cluster2] }
2021-07-14T16:20:00.4362387Z [cluster2] },
2021-07-14T16:20:00.4362820Z [cluster2] "required": [
2021-07-14T16:20:00.4363252Z [cluster2] "spec"
2021-07-14T16:20:00.4363659Z [cluster2] ],
2021-07-14T16:20:00.4364088Z [cluster2] "type": "object"
2021-07-14T16:20:00.4364493Z [cluster2] }
2021-07-14T16:20:00.4365162Z [cluster2] },
2021-07-14T16:20:00.4365569Z [cluster2] "served": true,
2021-07-14T16:20:00.4366031Z [cluster2] "storage": true
2021-07-14T16:20:00.4366428Z [cluster2] }
2021-07-14T16:20:00.4366793Z [cluster2] ]
2021-07-14T16:20:00.4367141Z [cluster2] },
2021-07-14T16:20:00.4367530Z [cluster2] "status": {
2021-07-14T16:20:00.4368791Z [cluster2] "acceptedNames": {
2021-07-14T16:20:00.4369304Z [cluster2] "kind": "Endpoint",
2021-07-14T16:20:00.4369818Z [cluster2] "listKind": "EndpointList",
2021-07-14T16:20:00.4370358Z [cluster2] "plural": "endpoints",
2021-07-14T16:20:00.4370872Z [cluster2] "singular": "endpoint"
2021-07-14T16:20:00.4371291Z [cluster2] },
2021-07-14T16:20:00.4371706Z [cluster2] "conditions": [
2021-07-14T16:20:00.4372111Z [cluster2] {
2021-07-14T16:20:00.4373257Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:18Z",
2021-07-14T16:20:00.4373875Z [cluster2] "message": "no conflicts found",
2021-07-14T16:20:00.4374522Z [cluster2] "reason": "NoConflicts",
2021-07-14T16:20:00.4374996Z [cluster2] "status": "True",
2021-07-14T16:20:00.4375501Z [cluster2] "type": "NamesAccepted"
2021-07-14T16:20:00.4375943Z [cluster2] },
2021-07-14T16:20:00.4376319Z [cluster2] {
2021-07-14T16:20:00.4377016Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:18Z",
2021-07-14T16:20:00.4377684Z [cluster2] "message": "the initial names have been accepted",
2021-07-14T16:20:00.4378386Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-14T16:20:00.4378953Z [cluster2] "status": "True",
2021-07-14T16:20:00.4379432Z [cluster2] "type": "Established"
2021-07-14T16:20:00.4379857Z [cluster2] }
2021-07-14T16:20:00.4380219Z [cluster2] ],
2021-07-14T16:20:00.4380652Z [cluster2] "storedVersions": [
2021-07-14T16:20:00.4381102Z [cluster2] "v1"
2021-07-14T16:20:00.4381458Z [cluster2] ]
2021-07-14T16:20:00.4381814Z [cluster2] }
2021-07-14T16:20:00.4382154Z [cluster2] }
2021-07-14T16:20:00.4383118Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-14T16:20:00.4384479Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-14T16:20:00.4386221Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:20:00.4387633Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:00.4388709Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:00.4390086Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:20:00.4391463Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:00.4392566Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:00.4393959Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:20:00.4395321Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-14T16:20:00.4396444Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-14T16:20:00.4397871Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:20:00.4399366Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-14T16:20:00.4400702Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-14T16:20:00.4402344Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-14T16:20:00.4403862Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-14T16:20:00.4404744Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-14T16:20:00.4405829Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-14T16:20:00.4407061Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-14T16:20:00.4408527Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-14T16:20:00.4409704Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-14T16:20:00.4410990Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-14T16:20:00.4411838Z [cluster2] NAME CREATED AT
2021-07-14T16:20:00.5284719Z [cluster2] clusters.submariner.io 20 "hostname",
2021-07-14T16:20:00.5287147Z [cluster1] "nat_enabled",
2021-07-14T16:20:00.5287641Z [cluster1] "private_ip",
2021-07-14T16:20:00.5288245Z [cluster1] "public_ip",
2021-07-14T16:20:00.5288695Z [cluster1] "subnets"
2021-07-14T16:20:00.5289123Z [cluster1] ],
2021-07-14T16:20:00.5289565Z [cluster1] "type": "object"
2021-07-14T16:20:00.5289994Z [cluster1] }
2021-07-14T16:20:00.5290376Z [cluster1] },
2021-07-14T16:20:00.5290809Z [cluster1] "required": [
2021-07-14T16:20:00.5291235Z [cluster1] "spec"
2021-07-14T16:20:00.5291633Z [cluster1] ],
2021-07-14T16:20:00.5292046Z [cluster1] "type": "object"
2021-07-14T16:20:00.5292467Z [cluster1] }
2021-07-14T16:20:00.5292843Z [cluster1] },
2021-07-14T16:20:00.5293244Z [cluster1] "served": true,
2021-07-14T16:20:00.5293814Z [cluster1] "storage": true
2021-07-14T16:20:00.5294209Z [cluster1] }
2021-07-14T16:20:00.5294572Z [cluster1] ]
2021-07-14T16:20:00.5294915Z [cluster1] },
2021-07-14T16:20:00.5295300Z [cluster1] "status": {
2021-07-14T16:20:00.5295753Z [cluster1] "acceptedNames": {
2021-07-14T16:20:00.5296431Z [cluster1] "kind": "Endpoint",
2021-07-14T16:20:00.5296934Z [cluster1] "listKind": "EndpointList",
2021-07-14T16:20:00.5297469Z [cluster1] "plural": "endpoints",
2021-07-14T16:20:00.5298031Z [cluster1] "singular": "endpoint"
2021-07-14T16:20:00.5298466Z [cluster1] },
2021-07-14T16:20:00.5298868Z [cluster1] "conditions": [
2021-07-14T16:20:00.5299266Z [cluster1] {
2021-07-14T16:20:00.5300364Z [cluster1] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:00.5300982Z [cluster1] "message": "no conflicts found",
2021-07-14T16:20:00.5301529Z [cluster1] "reason": "NoConflicts",
2021-07-14T16:20:00.5302003Z [cluster1] "status": "True",
2021-07-14T16:20:00.5302514Z [cluster1] "type": "NamesAccepted"
2021-07-14T16:20:00.5302957Z [cluster1] },
2021-07-14T16:20:00.5303325Z [cluster1] {
2021-07-14T16:20:00.5303997Z [cluster1] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:00.5304675Z [cluster1] "message": "the initial names have been accepted",
2021-07-14T16:20:00.5305367Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-14T16:20:00.5305931Z [cluster1] "status": "True",
2021-07-14T16:20:00.5306418Z [cluster1] "type": "Established"
2021-07-14T16:20:00.5306844Z [cluster1] }
2021-07-14T16:20:00.5307204Z [cluster1] ],
2021-07-14T16:20:00.5307755Z [cluster1] "storedVersions": [
2021-07-14T16:20:00.5308285Z [cluster1] "v1"
2021-07-14T16:20:00.5308646Z [cluster1] ]
2021-07-14T16:20:00.5309009Z [cluster1] }
2021-07-14T16:20:00.5309353Z [cluster1] }
2021-07-14T16:20:00.5310346Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-14T16:20:00.5311725Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-14T16:20:00.5313271Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:20:00.5314649Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:00.5315727Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:00.5317114Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:20:00.5318479Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:00.5319587Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:00.5321126Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:20:00.5322501Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-14T16:20:00.5323629Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-14T16:20:00.5325055Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:20:00.5326596Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-14T16:20:00.5328125Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-14T16:20:00.5329794Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-14T16:20:00.5331191Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-14T16:20:00.5332069Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-14T16:20:00.5333135Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-14T16:20:00.5334475Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-14T16:20:00.5335694Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-14T16:20:00.5336874Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-14T16:20:00.5338262Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-14T16:20:00.5339111Z [cluster1] NAME CREATED AT
2021-07-14T16:20:00.7621340Z [cluster1] clusters.submariner.io 2021-07-14T16:16:18Z
2021-07-14T16:20:00.7622774Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:00.7624252Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-14T16:20:00.7625532Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-14T16:20:00.7627101Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:00.7628614Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-14T16:20:00.7629534Z [cluster2] {
2021-07-14T16:20:00.7630114Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:00.7631013Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-14T16:20:00.7631701Z [cluster2] "metadata": {
2021-07-14T16:20:00.7632175Z [cluster2] "annotations": {
2021-07-14T16:20:00.7633346Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:20:00.7634033Z [cluster2] },
2021-07-14T16:20:00.7634764Z [cluster2] "creationTimestamp": "2021-07-14T16:16:18Z",
2021-07-14T16:20:00.7635384Z [cluster2] "generation": 1,
2021-07-14T16:20:00.7635946Z [cluster2] "managedFields": [
2021-07-14T16:20:00.7636405Z [cluster2] {
2021-07-14T16:20:00.7637047Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:00.7637718Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:00.7638304Z [cluster2] "fieldsV1": {
2021-07-14T16:20:00.7638832Z [cluster2] "f:metadata": {
2021-07-14T16:20:00.7639334Z [cluster2] "f:annotations": {
2021-07-14T16:20:00.7818163Z [cluster2] ".": {},
2021-07-14T16:20:00.7819653Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:20:00.7820418Z [cluster2] }
2021-07-14T16:20:00.7820803Z [cluster2] },
2021-07-14T16:20:00.7821192Z [cluster2] "f:spec": {
2021-07-14T16:20:00.7821648Z [cluster2] "f:conversion": {
2021-07-14T16:20:00.7822088Z [cluster2] ".": {},
2021-07-14T16:20:00.7822505Z [cluster2] "f:strategy": {}
2021-07-14T16:20:00.7822934Z [cluster2] },
2021-07-14T16:20:00.7823343Z [cluster2] "f:group": {},
2021-07-14T16:20:00.7823789Z [cluster2] "f:names": {
2021-07-14T16:20:00.7824209Z [cluster2] "f:kind": {},
2021-07-14T16:20:00.7824665Z [cluster2] "f:listKind": {},
2021-07-14T16:20:00.7825116Z [cluster2] "f:plural": {},
2021-07-14T16:20:00.7825570Z [cluster2] "f:singular": {}
2021-07-14T16:20:00.7825978Z [cluster2] },
2021-07-14T16:20:00.7826399Z [cluster2] "f:scope": {},
2021-07-14T16:20:00.7826851Z [cluster2] "f:versions": {}
2021-07-14T16:20:00.7827257Z [cluster2] },
2021-07-14T16:20:00.7827664Z [cluster2] "f:status": {
2021-07-14T16:20:00.7828140Z [cluster2] "f:acceptedNames": {
2021-07-14T16:20:00.7828624Z [cluster2] "f:kind": {},
2021-07-14T16:20:00.7829344Z [cluster2] "f:plural": {}
2021-07-14T16:20:00.7829761Z [cluster2] },
2021-07-14T16:20:00.7830184Z [cluster2] "f:conditions": {},
2021-07-14T16:20:00.7830704Z [cluster2] "f:storedVersions": {}
2021-07-14T16:20:00.7831161Z [cluster2] }
2021-07-14T16:20:00.7831521Z [cluster2] },
2021-07-14T16:20:00.7832247Z [cluster2] "manager": "submariner-operator",
2021-07-14T16:20:00.7832832Z [cluster2] "operation": "Update",
2021-07-14T16:20:00.7833472Z [cluster2] "time": "2021-07-14T16:16:25Z"
2021-07-14T16:20:00.7833866Z [cluster2] }
2021-07-14T16:20:00.7834227Z [cluster2] ],
2021-07-14T16:20:00.7834739Z [cluster2] "name": "clusters.submariner.io",
2021-07-14T16:20:00.7835348Z [cluster2] "resourceVersion": "1322",
2021-07-14T16:20:00.7836135Z [cluster2] "uid": "9982eecd-714f-4dbc-83d0-868487b2f80c"
2021-07-14T16:20:00.7836674Z [cluster2] },
2021-07-14T16:20:00.7837046Z [cluster2] "spec": {
2021-07-14T16:20:00.7837454Z [cluster2] "conversion": {
2021-07-14T16:20:00.7837914Z [cluster2] "strategy": "None"
2021-07-14T16:20:00.7838307Z [cluster2] },
2021-07-14T16:20:00.7838752Z [cluster2] "group": "submariner.io",
2021-07-14T16:20:00.7839198Z [cluster2] "names": {
2021-07-14T16:20:00.7839626Z [cluster2] "kind": "Cluster",
2021-07-14T16:20:00.7840209Z [cluster2] "listKind": "ClusterList",
2021-07-14T16:20:00.7840896Z [cluster2] "plural": "clusters",
2021-07-14T16:20:00.7841367Z [cluster2] "singular": "cluster"
2021-07-14T16:20:00.7841790Z [cluster2] },
2021-07-14T16:20:00.7842205Z [cluster2] "scope": "Namespaced",
2021-07-14T16:20:00.7842671Z [cluster2] "versions": [
2021-07-14T16:20:00.7843066Z [cluster2] {
2021-07-14T16:20:00.7843443Z [cluster2] "name": "v1",
2021-07-14T16:20:00.7843862Z [cluster2] "schema": {
2021-07-14T16:20:00.7844343Z [cluster2] "openAPIV3Schema": {
2021-07-14T16:20:00.7844873Z [cluster2] "properties": {
2021-07-14T16:20:00.7845358Z [cluster2] "apiVersion": {
2021-07-14T16:20:00.7847495Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:20:00.7900447Z [cluster2] "type": "string"
2021-07-14T16:20:00.7900927Z [cluster2] },
2021-07-14T16:20:00.7901344Z [cluster2] "kind": {
2021-07-14T16:20:00.7903683Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:20:00.7905263Z [cluster2] "type": "string"
2021-07-14T16:20:00.7905701Z [cluster2] },
2021-07-14T16:20:00.7906176Z [cluster2] "metadata": {
2021-07-14T16:20:00.7906658Z [cluster2] "type": "object"
2021-07-14T16:20:00.7907086Z [cluster2] },
2021-07-14T16:20:00.7907480Z [cluster2] "spec": {
2021-07-14T16:20:00.7907947Z [cluster2] "properties": {
2021-07-14T16:20:00.7908432Z [cluster2] "cluster_cidr": {
2021-07-14T16:20:00.7909164Z [cluster2] "items": {
2021-07-14T16:20:00.7909631Z [cluster2] "type": "string"
2021-07-14T16:20:00.7910081Z [cluster2] },
2021-07-14T16:20:00.7910649Z [cluster2] "type": "array"
2021-07-14T16:20:00.7911088Z [cluster2] },
2021-07-14T16:20:00.7911534Z [cluster2] "cluster_id": {
2021-07-14T16:20:00.7912005Z [cluster2] "type": "string"
2021-07-14T16:20:00.7912460Z [cluster2] },
2021-07-14T16:20:00.7912885Z [cluster2] "color_codes": {
2021-07-14T16:20:00.7913383Z [cluster2] "items": {
2021-07-14T16:20:00.7913843Z [cluster2] "type": "string"
2021-07-14T16:20:00.7914325Z [cluster2] },
2021-07-14T16:20:00.7914765Z [cluster2] "type": "array"
2021-07-14T16:20:00.7915214Z [cluster2] },
2021-07-14T16:20:00.7915656Z [cluster2] "global_cidr": {
2021-07-14T16:20:00.7916104Z [cluster2] "items": {
2021-07-14T16:20:00.7916678Z [cluster2] "type": "string"
2021-07-14T16:20:00.7917113Z [cluster2] },
2021-07-14T16:20:00.7917656Z [cluster2] "type": "array"
2021-07-14T16:20:00.7918142Z [cluster2] },
2021-07-14T16:20:00.7918598Z [cluster2] "service_cidr": {
2021-07-14T16:20:00.7919070Z [cluster2] "items": {
2021-07-14T16:20:00.7919527Z [cluster2] "type": "string"
2021-07-14T16:20:00.7920059Z [cluster2] },
2021-07-14T16:20:00.7920486Z [cluster2] "type": "array"
2021-07-14T16:20:00.7920924Z [cluster2] }
2021-07-14T16:20:00.7921307Z [cluster2] },
2021-07-14T16:20:00.7921752Z [cluster2] "required": [
2021-07-14T16:20:00.7922218Z [cluster2] "cluster_cidr",
2021-07-14T16:20:00.7922697Z [cluster2] "cluster_id",
2021-07-14T16:20:00.7923152Z [cluster2] "color_codes",
2021-07-14T16:20:00.7923612Z [cluster2] "global_cidr",
2021-07-14T16:20:00.7924144Z [cluster2] "service_cidr"
2021-07-14T16:20:00.7924579Z [cluster2] ],
2021-07-14T16:20:00.7925004Z [cluster2] "type": "object"
2021-07-14T16:20:00.7925434Z [cluster2] }
2021-07-14T16:20:00.7925815Z [cluster2] },
2021-07-14T16:20:00.7926225Z [cluster2] "required": [
2021-07-14T16:20:00.7926660Z [cluster2] "spec"
2021-07-14T16:20:00.7927040Z [cluster2] ],
2021-07-14T16:20:00.7927465Z [cluster2] "type": "object"
2021-07-14T16:20:00.7946273Z [cluster2] }
2021-07-14T16:20:00.7946760Z [cluster2] },
2021-07-14T16:20:00.7947169Z [cluster2] "served": true,
2021-07-14T16:20:00.7947619Z [cluster2] "storage": true
2021-07-14T16:20:00.7948015Z [cluster2] }
2021-07-14T16:20:00.7948371Z [cluster2] ]
2021-07-14T16:20:00.7948713Z [cluster2] },
2021-07-14T16:20:00.7949087Z [cluster2] "status": {
2021-07-14T16:20:00.7949548Z [cluster2] "acceptedNames": {
2021-07-14T16:20:00.7950020Z [cluster2] "kind": "Cluster",
2021-07-14T16:20:00.7950713Z [cluster2] "listKind": "ClusterList",
2021-07-14T16:20:00.7951371Z [cluster2] "plural": "clusters",
2021-07-14T16:20:00.7951862Z [cluster2] "singular": "cluster"
2021-07-14T16:20:00.7952264Z [cluster2] },
2021-07-14T16:20:00.7952700Z [cluster2] "conditions": [
2021-07-14T16:20:00.7953095Z [cluster2] {
2021-07-14T16:20:00.7954182Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:18Z",
2021-07-14T16:20:00.7954788Z [cluster2] "message": "no conflicts found",
2021-07-14T16:20:00.7955325Z [cluster2] "reason": "NoConflicts",
2021-07-14T16:20:00.7955807Z [cluster2] "status": "True",
2021-07-14T16:20:00.7956288Z [cluster2] "type": "NamesAccepted"
2021-07-14T16:20:00.9333009Z [cluste21-07-14T16:16:08Z
2021-07-14T16:20:00.9334199Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:00.9335789Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-14T16:20:00.9336987Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-14T16:20:00.9338327Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:00.9340056Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-14T16:20:00.9341062Z [cluster1] {
2021-07-14T16:20:00.9341655Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:00.9342452Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-14T16:20:00.9343036Z [cluster1] "metadata": {
2021-07-14T16:20:00.9343470Z [cluster1] "annotations": {
2021-07-14T16:20:00.9344357Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:20:00.9344974Z [cluster1] },
2021-07-14T16:20:00.9345638Z [cluster1] "creationTimestamp": "2021-07-14T16:16:08Z",
2021-07-14T16:20:00.9346173Z [cluster1] "generation": 1,
2021-07-14T16:20:00.9346656Z [cluster1] "managedFields": [
2021-07-14T16:20:00.9347095Z [cluster1] {
2021-07-14T16:20:00.9347635Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:00.9348279Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:00.9348751Z [cluster1] "fieldsV1": {
2021-07-14T16:20:00.9349205Z [cluster1] "f:metadata": {
2021-07-14T16:20:00.9349762Z [cluster1] "f:annotations": {
2021-07-14T16:20:00.9350212Z [cluster1] ".": {},
2021-07-14T16:20:00.9351051Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:20:00.9351787Z [cluster1] }
2021-07-14T16:20:00.9352170Z [cluster1] },
2021-07-14T16:20:00.9352557Z [cluster1] "f:spec": {
2021-07-14T16:20:00.9353018Z [cluster1] "f:conversion": {
2021-07-14T16:20:00.9353449Z [cluster1] ".": {},
2021-07-14T16:20:00.9353894Z [cluster1] "f:strategy": {}
2021-07-14T16:20:00.9354305Z [cluster1] },
2021-07-14T16:20:00.9354716Z [cluster1] "f:group": {},
2021-07-14T16:20:00.9355131Z [cluster1] "f:names": {
2021-07-14T16:20:00.9355555Z [cluster1] "f:kind": {},
2021-07-14T16:20:00.9356005Z [cluster1] "f:listKind": {},
2021-07-14T16:20:00.9356470Z [cluster1] "f:plural": {},
2021-07-14T16:20:00.9356930Z [cluster1] "f:singular": {}
2021-07-14T16:20:00.9357333Z [cluster1] },
2021-07-14T16:20:00.9357739Z [cluster1] "f:scope": {},
2021-07-14T16:20:00.9358171Z [cluster1] "f:versions": {}
2021-07-14T16:20:00.9358713Z [cluster1] },
2021-07-14T16:20:00.9359115Z [cluster1] "f:status": {
2021-07-14T16:20:00.9359605Z [cluster1] "f:acceptedNames": {
2021-07-14T16:20:00.9360079Z [cluster1] "f:kind": {},
2021-07-14T16:20:00.9360526Z [cluster1] "f:plural": {}
2021-07-14T16:20:00.9360942Z [cluster1] },
2021-07-14T16:20:00.9361364Z [cluster1] "f:conditions": {},
2021-07-14T16:20:00.9361892Z [cluster1] "f:storedVersions": {}
2021-07-14T16:20:00.9362338Z [cluster1] }
2021-07-14T16:20:00.9362708Z [cluster1] },
2021-07-14T16:20:00.9363416Z [cluster1] "manager": "submariner-operator",
2021-07-14T16:20:00.9364006Z [cluster1] "operation": "Update",
2021-07-14T16:20:00.9364618Z [cluster1] "time": "2021-07-14T16:16:14Z"
2021-07-14T16:20:00.9365020Z [cluster1] }
2021-07-14T16:20:00.9365369Z [cluster1] ],
2021-07-14T16:20:00.9365893Z [cluster1] "name": "clusters.submariner.io",
2021-07-14T16:20:00.9366497Z [cluster1] "resourceVersion": "1345",
2021-07-14T16:20:00.9367236Z [cluster1] "uid": "0c7b2f59-a096-4861-b431-26a2919b907e"
2021-07-14T16:20:00.9367728Z [cluster1] },
2021-07-14T16:20:00.9368285Z [cluster1] "spec": {
2021-07-14T16:20:00.9368710Z [cluster1] "conversion": {
2021-07-14T16:20:00.9369278Z [cluster1] "strategy": "None"
2021-07-14T16:20:00.9369684Z [cluster1] },
2021-07-14T16:20:00.9370117Z [cluster1] "group": "submariner.io",
2021-07-14T16:20:00.9370580Z [cluster1] "names": {
2021-07-14T16:20:00.9370991Z [cluster1] "kind": "Cluster",
2021-07-14T16:20:00.9371488Z [cluster1] "listKind": "ClusterList",
2021-07-14T16:20:00.9371994Z [cluster1] "plural": "clusters",
2021-07-14T16:20:00.9372486Z [cluster1] "singular": "cluster"
2021-07-14T16:20:00.9372902Z [cluster1] },
2021-07-14T16:20:00.9373321Z [cluster1] "scope": "Namespaced",
2021-07-14T16:20:00.9373777Z [cluster1] "versions": [
2021-07-14T16:20:00.9374155Z [cluster1] {
2021-07-14T16:20:00.9374541Z [cluster1] "name": "v1",
2021-07-14T16:20:00.9374939Z [cluster1] "schema": {
2021-07-14T16:20:00.9375426Z [cluster1] "openAPIV3Schema": {
2021-07-14T16:20:00.9375945Z [cluster1] "properties": {
2021-07-14T16:20:00.9376436Z [cluster1] "apiVersion": {
2021-07-14T16:20:00.9378505Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:20:00.9380128Z [cluster1] "type": "string"
2021-07-14T16:20:00.9380560Z [cluster1] },
2021-07-14T16:20:00.9380995Z [cluster1] "kind": {
2021-07-14T16:20:00.9382953Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:20:00.9384511Z [cluster1] "type": "string"
2021-07-14T16:20:00.9384924Z [cluster1] },
2021-07-14T16:20:00.9385352Z [cluster1] "metadata": {
2021-07-14T16:20:00.9385821Z [cluster1] "type": "object"
2021-07-14T16:20:00.9386331Z [cluster1] },
2021-07-14T16:20:00.9386744Z [cluster1] "spec": {
2021-07-14T16:20:00.9387202Z [cluster1] "properties": {
2021-07-14T16:20:00.9387694Z [cluster1] "cluster_cidr": {
2021-07-14T16:20:00.9388145Z [cluster1] "items": {
2021-07-14T16:20:00.9388613Z [cluster1] "type": "string"
2021-07-14T16:20:00.9389059Z [cluster1] },
2021-07-14T16:20:00.9389490Z [cluster1] "type": "array"
2021-07-14T16:20:00.9389922Z [cluster1] },
2021-07-14T16:20:00.9390343Z [cluster1] "cluster_id": {
2021-07-14T16:20:00.9390821Z [cluster1] "type": "string"
2021-07-14T16:20:00.9391256Z [cluster1] },
2021-07-14T16:20:00.9391696Z [cluster1] "color_codes": {
2021-07-14T16:20:00.9392149Z [cluster1] "items": {
2021-07-14T16:20:00.9392615Z [cluster1] "type": "string"
2021-07-14T16:20:00.9393057Z [cluster1] },
2021-07-14T16:20:00.9393480Z [cluster1] "type": "array"
2021-07-14T16:20:00.9393910Z [cluster1] },
2021-07-14T16:20:00.9394385Z [cluster1] "global_cidr": {
2021-07-14T16:20:00.9394838Z [cluster1] "items": {
2021-07-14T16:20:00.9395292Z [cluster1] "type": "string"
2021-07-14T16:20:00.9395734Z [cluster1] },
2021-07-14T16:20:00.9396158Z [cluster1] "type": "array"
2021-07-14T16:20:00.9396588Z [cluster1] },
2021-07-14T16:20:00.9397028Z [cluster1] "service_cidr": {
2021-07-14T16:20:00.9397473Z [cluster1] "items": {
2021-07-14T16:20:00.9397938Z [cluster1] "type": "string"
2021-07-14T16:20:00.9398371Z [cluster1] },
2021-07-14T16:20:00.9398812Z [cluster1] "type": "array"
2021-07-14T16:20:00.9399229Z [cluster1] }
2021-07-14T16:20:00.9399617Z [cluster1] },
2021-07-14T16:20:00.9400038Z [cluster1] "required": [
2021-07-14T16:20:00.9400511Z [cluster1] "cluster_cidr",
2021-07-14T16:20:00.9400976Z [cluster1] "cluster_id",
2021-07-14T16:20:00.9401424Z [cluster1] "color_codes",
2021-07-14T16:20:00.9401890Z [cluster1] "global_cidr",
2021-07-14T16:20:00.9402346Z [cluster1] "service_cidr"
2021-07-14T16:20:00.9402776Z [cluster1] ],
2021-07-14T16:20:00.9403200Z [cluster1] "type": "object"
2021-07-14T16:20:00.9403620Z [cluster1] }
2021-07-14T16:20:00.9403990Z [cluster1] },
2021-07-14T16:20:00.9404411Z [cluster1] "required": [
2021-07-14T16:20:00.9404845Z [cluster1] "spec"
2021-07-14T16:20:00.9405256Z [cluster1] ],
2021-07-14T16:20:00.9405678Z [cluster1] "type": "object"
2021-07-14T16:20:00.9406076Z [cluster1] }
2021-07-14T16:20:00.9406451Z [cluster1] },
2021-07-14T16:20:00.9406855Z [cluster1] "served": true,
2021-07-14T16:20:00.9407304Z [cluster1] "storage": true
2021-07-14T16:20:00.9437349Z [cluster1] }
2021-07-14T16:20:00.9437957Z [cluster1] ]
2021-07-14T16:20:00.9438304Z [cluster1] },
2021-07-14T16:20:00.9438688Z [cluster1] "status": {
2021-07-14T16:20:00.9439139Z [cluster1] "acceptedNames": {
2021-07-14T16:20:00.9439626Z [cluster1] "kind": "Cluster",
2021-07-14T16:20:00.9440125Z [cluster1] "listKind": "ClusterList",
2021-07-14T16:20:00.9440625Z [cluster1] "plural": "clusters",
2021-07-14T16:20:00.9441150Z [cluster1] "singular": "cluster"
2021-07-14T16:20:00.9441554Z [cluster1] },
2021-07-14T16:20:00.9441957Z [cluster1] "conditions": [
2021-07-14T16:20:00.9442349Z [cluster1] {
2021-07-14T16:20:00.9443386Z [cluster1] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:00.9443995Z [cluster1] "message": "no conflicts found",
2021-07-14T16:20:00.9444527Z [cluster1] "reason": "NoConflicts",
2021-07-14T16:20:00.9445173Z [cluster1] "status": "True",
2021-07-14T16:20:00.9445672Z [cluster1] "type": "NamesAccepted"
2021-07-14T16:20:01.7280669Z [cluster2] },
2021-07-14T16:20:01.7281094Z [cluster2] {
2021-07-14T16:20:01.7282335Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:18Z",
2021-07-14T16:20:01.7283024Z [cluster2] "message": "the initial names have been accepted",
2021-07-14T16:20:01.7283704Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-14T16:20:01.7284487Z [cluster2] "status": "True",
2021-07-14T16:20:01.7284946Z [cluster2] "type": "Established"
2021-07-14T16:20:01.7285378Z [cluster2] }
2021-07-14T16:20:01.7285737Z [cluster2] ],
2021-07-14T16:20:01.7286167Z [cluster2] "storedVersions": [
2021-07-14T16:20:01.7286608Z [cluster2] "v1"
2021-07-14T16:20:01.7286958Z [cluster2] ]
2021-07-14T16:20:01.7287311Z [cluster2] }
2021-07-14T16:20:01.7287653Z [cluster2] }
2021-07-14T16:20:01.7288799Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-14T16:20:01.7290115Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-14T16:20:01.7291608Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:01.7361141Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:01.7362296Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:01.7363664Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:01.7365159Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:01.7366265Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:01.7367733Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:01.7369206Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-14T16:20:01.7370301Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-14T16:20:01.7371758Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:01.7373270Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-14T16:20:01.7374564Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-14T16:20:01.7376178Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-14T16:20:01.7377517Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-14T16:20:01.7378572Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-14T16:20:01.7379735Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-14T16:20:01.7381107Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-14T16:20:01.7382411Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-14T16:20:01.7383629Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-14T16:20:01.7384998Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-14T16:20:01.7385873Z [cluster2] NAME CREATED AT
2021-07-14T16:20:01.7386634Z [cluster2] submariners.submariner.io 2021-07-14T16:16:08Z
2021-07-14T16:20:01.7387915Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:01.7389344Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-14T16:20:01.7390610Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-14T16:20:01.7392007Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:01.7393549Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-14T16:20:01.7394356Z [cluster2] {
2021-07-14T16:20:01.7394971Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:01.7395711Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-14T16:20:01.7396280Z [cluster2] "metadata": {
2021-07-14T16:20:01.7396725Z [cluster2] "annotations": {
2021-07-14T16:20:01.7397566Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:20:01.7398193Z [cluster2] },
2021-07-14T16:20:01.7398837Z [cluster2] "creationTimestamp": "2021-07-14T16:16:08Z",
2021-07-14T16:20:01.7399386Z [cluster2] "generation": 2,
2021-07-14T16:20:01.7399874Z [cluster2] "managedFields": [
2021-07-14T16:20:01.7400297Z [cluster2] {
2021-07-14T16:20:01.7400850Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:01.7401474Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:01.7401964Z [cluster2] "fieldsV1": {
2021-07-14T16:20:01.7402397Z [cluster2] "f:metadata": {
2021-07-14T16:20:01.7402879Z [cluster2] "f:annotations": {
2021-07-14T16:20:01.7403314Z [cluster2] ".": {},
2021-07-14T16:20:01.7404144Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:20:01.7404797Z [cluster2] }
2021-07-14T16:20:01.7405174Z [cluster2] },
2021-07-14T16:20:01.7406034Z [cluster2] "f:spec": {
2021-07-14T16:20:01.7406485Z [cluster2] "f:conversion": {
2021-07-14T16:20:01.7406932Z [cluster2] ".": {},
2021-07-14T16:20:01.7407353Z [cluster2] "f:strategy": {}
2021-07-14T16:20:01.7417608Z [cluster2] },
2021-07-14T16:20:01.7418162Z [cluster2] "f:group": {},
2021-07-14T16:20:01.7418741Z [cluster2] "f:names": {
2021-07-14T16:20:01.7419178Z [cluster2] "f:kind": {},
2021-07-14T16:20:01.7419736Z [cluster2] "f:listKind": {},
2021-07-14T16:20:01.7420212Z [cluster2] "f:plural": {},
2021-07-14T16:20:01.7420662Z [cluster2] "f:singular": {}
2021-07-14T16:20:01.7421094Z [cluster2] },
2021-07-14T16:20:01.7421492Z [cluster2] "f:scope": {},
2021-07-14T16:20:01.7421938Z [cluster2] "f:versions": {}
2021-07-14T16:20:01.7422524Z [cluster2] },
2021-07-14T16:20:01.7422938Z [cluster2] "f:status": {
2021-07-14T16:20:01.7423415Z [cluster2] "f:acceptedNames": {
2021-07-14T16:20:01.7423901Z [cluster2] "f:kind": {},
2021-07-14T16:20:01.7424350Z [cluster2] "f:plural": {}
2021-07-14T16:20:01.7424752Z [cluster2] },
2021-07-14T16:20:01.7425220Z [cluster2] "f:conditions": {},
2021-07-14T16:20:01.7425729Z [cluster2] "f:storedVersions": {}
2021-07-14T16:20:01.7426192Z [cluster2] }
2021-07-14T16:20:01.7426550Z [cluster2] },
2021-07-14T16:20:01.7426976Z [cluster2] "manager": "subctl",
2021-07-14T16:20:01.7427454Z [cluster2] "operation": "Update",
2021-07-14T16:20:01.7428390Z [cluster2] "time": "2021-07-14T16:18:54Z"
2021-07-14T16:20:01.7428790Z [cluster2] }
2021-07-14T16:20:01.7429150Z [cluster2] ],
2021-07-14T16:20:01.7429710Z [cluster2] "name": "submariners.submariner.io",
2021-07-14T16:20:01.7430336Z [cluster2] "resourceVersion": "1902",
2021-07-14T16:20:01.7431127Z [cluster2] "uid": "fd6204f8-222b-40e9-868e-41f6f35ee6c7"
2021-07-14T16:20:01.7431634Z [cluster2] },
2021-07-14T16:20:01.7432005Z [cluster2] "spec": {
2021-07-14T16:20:01.7432416Z [cluster2] "conversion": {
2021-07-14T16:20:01.7432978Z [cluster2] "strategy": "None"
2021-07-14T16:20:01.7433371Z [cluster2] },
2021-07-14T16:20:01.7433814Z [cluster2] "group": "submariner.io",
2021-07-14T16:20:01.7434259Z [cluster2] "names": {
2021-07-14T16:20:01.7434708Z [cluster2] "kind": "Submariner",
2021-07-14T16:20:01.7435230Z [cluster2] "listKind": "SubmarinerList",
2021-07-14T16:20:01.7435781Z [cluster2] "plural": "submariners",
2021-07-14T16:20:01.7436307Z [cluster2] "singular": "submariner"
2021-07-14T16:20:01.7436729Z [cluster2] },
2021-07-14T16:20:01.7477225Z [cluster2] "scope": "Namespaced",
2021-07-14T16:20:01.7477697Z [cluster2] "versions": [
2021-07-14T16:20:01.7478098Z [cluster2] {
2021-07-14T16:20:01.7478508Z [cluster2] "name": "v1alpha1",
2021-07-14T16:20:01.7478949Z [cluster2] "schema": {
2021-07-14T16:20:01.7479435Z [cluster2] "openAPIV3Schema": {
2021-07-14T16:20:01.7480155Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-14T16:20:01.7480809Z [cluster2] "properties": {
2021-07-14T16:20:01.7481307Z [cluster2] "apiVersion": {
2021-07-14T16:20:01.7483585Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:20:01.7485174Z [cluster2] "type": "string"
2021-07-14T16:20:01.7485608Z [cluster2] },
2021-07-14T16:20:01.7486022Z [cluster2] "kind": {
2021-07-14T16:20:01.7488228Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:20:01.7489802Z [cluster2] "type": "string"
2021-07-14T16:20:01.7490233Z [cluster2] },
2021-07-14T16:20:01.7490649Z [cluster2] "metadata": {
2021-07-14T16:20:01.7491297Z [cluster2] "type": "object"
2021-07-14T16:20:01.7491714Z [cluster2] },
2021-07-14T16:20:01.7492125Z [cluster2] "spec": {
2021-07-14T16:20:01.7492803Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-14T16:20:01.7493520Z [cluster2] "properties": {
2021-07-14T16:20:01.7493994Z [cluster2] "broker": {
2021-07-14T16:20:01.7494454Z [cluster2] "type": "string"
2021-07-14T16:20:01.7494897Z [cluster2] },
2021-07-14T16:20:01.7495409Z [cluster2] "brokerK8sApiServer": {
2021-07-14T16:20:01.7495977Z [cluster2] "type": "string"
2021-07-14T16:20:01.7496401Z [cluster2] },
2021-07-14T16:20:01.7496978Z [cluster2] "brokerK8sApiServerToken": {
2021-07-14T16:20:01.7497597Z [cluster2] "type": "string"
2021-07-14T16:20:01.7498018Z [cluster2] },
2021-07-14T16:20:01.7498473Z [cluster2] "brokerK8sCA": {
2021-07-14T16:20:01.7498955Z [cluster2] "type": "string"
2021-07-14T16:20:01.7499390Z [cluster2] },
2021-07-14T16:20:01.7500038Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-14T16:20:01.7523358Z [cluster2] "type": "string"
2021-07-14T16:20:01.7523798Z [cluster2] },
2021-07-14T16:20:01.7524264Z [cluster2] "cableDriver": {
2021-07-14T16:20:01.7524769Z [cluster2] "type": "string"
2021-07-14T16:20:01.7525234Z [cluster2] },
2021-07-14T16:20:01.7525708Z [cluster2] "ceIPSecDebug": {
2021-07-14T16:20:01.7526214Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7526658Z [cluster2] },
2021-07-14T16:20:01.7527201Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-14T16:20:01.7527926Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7528369Z [cluster2] },
2021-07-14T16:20:01.7528853Z [cluster2] "ceIPSecIKEPort": {
2021-07-14T16:20:01.7529396Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7529827Z [cluster2] },
2021-07-14T16:20:01.7530318Z [cluster2] "ceIPSecNATTPort": {
2021-07-14T16:20:01.7530855Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7531340Z [cluster2] },
2021-07-14T16:20:01.7531781Z [cluster2] "ceIPSecPSK": {
2021-07-14T16:20:01.7532282Z [cluster2] "type": "string"
2021-07-14T16:20:01.7532711Z [cluster2] },
2021-07-14T16:20:01.7533285Z [cluster2] "ceIPSecPreferredServer": {
2021-07-14T16:20:01.7533922Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7534353Z [cluster2] },
2021-07-14T16:20:01.7534815Z [cluster2] "clusterCIDR": {
2021-07-14T16:20:01.7535299Z [cluster2] "type": "string"
2021-07-14T16:20:01.7535740Z [cluster2] },
2021-07-14T16:20:01.7536168Z [cluster2] "clusterID": {
2021-07-14T16:20:01.7536799Z [cluster2] "type": "string"
2021-07-14T16:20:01.7537237Z [cluster2] },
2021-07-14T16:20:01.7537678Z [cluster2] "colorCodes": {
2021-07-14T16:20:01.7538269Z [cluster2] "type": "string"
2021-07-14T16:20:01.7538697Z [cluster2] },
2021-07-14T16:20:01.7539254Z [cluster2] "connectionHealthCheck": {
2021-07-14T16:20:01.7539859Z [cluster2] "properties": {
2021-07-14T16:20:01.7540356Z [cluster2] "enabled": {
2021-07-14T16:20:01.7540850Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7541308Z [cluster2] },
2021-07-14T16:20:01.7541808Z [cluster2] "intervalSeconds": {
2021-07-14T16:20:01.7542510Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-14T16:20:01.7543170Z [cluster2] "format": "int64",
2021-07-14T16:20:01.7543662Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7544123Z [cluster2] },
2021-07-14T16:20:01.7544642Z [cluster2] "maxPacketLossCount": {
2021-07-14T16:20:01.7545603Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-14T16:20:01.7546408Z [cluster2] "format": "int64",
2021-07-14T16:20:01.7546907Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7547371Z [cluster2] }
2021-07-14T16:20:01.7547772Z [cluster2] },
2021-07-14T16:20:01.7548222Z [cluster2] "type": "object"
2021-07-14T16:20:01.7548668Z [cluster2] },
2021-07-14T16:20:01.7549183Z [cluster2] "coreDNSCustomConfig": {
2021-07-14T16:20:01.7549766Z [cluster2] "properties": {
2021-07-14T16:20:01.7550290Z [cluster2] "configMapName": {
2021-07-14T16:20:01.7550829Z [cluster2] "type": "string"
2021-07-14T16:20:01.7551271Z [cluster2] },
2021-07-14T16:20:01.7551731Z [cluster2] "namespace": {
2021-07-14T16:20:01.7552229Z [cluster2] "type": "string"
2021-07-14T16:20:01.7552666Z [cluster2] }
2021-07-14T16:20:01.7553074Z [cluster2] },
2021-07-14T16:20:01.7553506Z [cluster2] "type": "object"
2021-07-14T16:20:01.7553949Z [cluster2] },
2021-07-14T16:20:01.7554405Z [cluster2] "customDomains": {
2021-07-14T16:20:01.7554900Z [cluster2] "items": {
2021-07-14T16:20:01.7555358Z [cluster2] "type": "string"
2021-07-14T16:20:01.7555797Z [cluster2] },
2021-07-14T16:20:01.7556237Z [cluster2] "type": "array",
2021-07-14T16:20:01.7557235Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-14T16:20:01.7557801Z [cluster2] },
2021-07-14T16:20:01.7558283Z [cluster2] "debug": {
2021-07-14T16:20:01.7558763Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7559193Z [cluster2] },
2021-07-14T16:20:01.7559646Z [cluster2] "globalCIDR": {
2021-07-14T16:20:01.7560117Z [cluster2] "type": "string"
2021-07-14T16:20:01.7560558Z [cluster2] },
2021-07-14T16:20:01.7561042Z [cluster2] "imageOverrides": {
2021-07-14T16:20:01.7561653Z [cluster2] "additionalProperties": {
2021-07-14T16:20:01.7562249Z [cluster2] "type": "string"
2021-07-14T16:20:01.7562682Z [cluster2] },
2021-07-14T16:20:01.7563121Z [cluster2] "type": "object"
2021-07-14T16:20:01.7563546Z [cluster2] },
2021-07-14T16:20:01.7564067Z [cluster2] "loadBalancerEnabled": {
2021-07-14T16:20:01.7564648Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7565082Z [cluster2] },
2021-07-14T16:20:01.7565534Z [cluster2] "namespace": {
2021-07-14T16:20:01.7566011Z [cluster2] "type": "string"
2021-07-14T16:20:01.7566506Z [cluster2] },
2021-07-14T16:20:01.7566946Z [cluster2] "natEnabled": {
2021-07-14T16:20:01.7567445Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7592501Z [cluster2] },
2021-07-14T16:20:01.7593024Z [cluster2] "repository": {
2021-07-14T16:20:01.7593539Z [cluster2] "type": "string"
2021-07-14T16:20:01.7593968Z [cluster2] },
2021-07-14T16:20:01.7594434Z [cluster2] "serviceCIDR": {
2021-07-14T16:20:01.7594927Z [cluster2] "type": "string"
2021-07-14T16:20:01.7595365Z [cluster2] },
2021-07-14T16:20:01.7595923Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-14T16:20:01.7596549Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7596987Z [cluster2] },
2021-07-14T16:20:01.7597409Z [cluster2] "version": {
2021-07-14T16:20:01.7597883Z [cluster2] "type": "string"
2021-07-14T16:20:01.7598429Z [cluster2] }
2021-07-14T16:20:01.7598891Z [cluster2] },
2021-07-14T16:20:01.7599316Z [cluster2] "required": [
2021-07-14T16:20:01.7599781Z [cluster2] "broker",
2021-07-14T16:20:01.7600306Z [cluster2] "brokerK8sApiServer",
2021-07-14T16:20:01.7600981Z [cluster2] "brokerK8sApiServerToken",
2021-07-14T16:20:01.7601585Z [cluster2] "brokerK8sCA",
2021-07-14T16:20:01.7602216Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-14T16:20:01.7602862Z [cluster2] "ceIPSecDebug",
2021-07-14T16:20:01.7603363Z [cluster2] "ceIPSecPSK",
2021-07-14T16:20:01.7603868Z [cluster2] "clusterCIDR",
2021-07-14T16:20:01.7604342Z [cluster2] "clusterID",
2021-07-14T16:20:01.7604798Z [cluster2] "debug",
2021-07-14T16:20:01.7605418Z [cluster2] "namespace",
2021-07-14T16:20:01.7605909Z [cluster2] "natEnabled",
2021-07-14T16:20:01.7606393Z [cluster2] "serviceCIDR"
2021-07-14T16:20:01.7606834Z [cluster2] ],
2021-07-14T16:20:01.7607273Z [cluster2] "type": "object"
2021-07-14T16:20:01.7607684Z [cluster2] },
2021-07-14T16:20:01.7608392Z [cluster2] "status": {
2021-07-14T16:20:01.7609216Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-14T16:20:01.7609951Z [cluster2] "properties": {
2021-07-14T16:20:01.7610448Z [cluster2] "clusterCIDR": {
2021-07-14T16:20:01.7610952Z [cluster2] "type": "string"
2021-07-14T16:20:01.7611397Z [cluster2] },
2021-07-14T16:20:01.7611914Z [cluster2] "clusterID": {
2021-07-14T16:20:01.7612407Z [cluster2] "type": "string"
2021-07-14T16:20:01.7612833Z [cluster2] },
2021-07-14T16:20:01.7613286Z [cluster2] "colorCodes": {
2021-07-14T16:20:01.7613767Z [cluster2] "type": "string"
2021-07-14T16:20:01.7614296Z [cluster2] },
2021-07-14T16:20:01.7614876Z [cluster2] "deploymentInfo": {
2021-07-14T16:20:01.7615424Z [cluster2] "properties": {
2021-07-14T16:20:01.7615959Z [cluster2] "cloudProvider": {
2021-07-14T16:20:01.7616468Z [cluster2] "type": "string"
2021-07-14T16:20:01.7616920Z [cluster2] },
2021-07-14T16:20:01.7617407Z [cluster2] "kubernetesType": {
2021-07-14T16:20:01.7617942Z [cluster2] "type": "string"
2021-07-14T16:20:01.7618375Z [cluster2] },
2021-07-14T16:20:01.7618945Z [cluster2] "kubernetesTypeVersion": {
2021-07-14T16:20:01.7619552Z [cluster2] "type": "string"
2021-07-14T16:20:01.7619999Z [cluster2] },
2021-07-14T16:20:01.7620528Z [cluster2] "kubernetesVersion": {
2021-07-14T16:20:01.7621081Z [cluster2] "type": "string"
2021-07-14T16:20:01.7621530Z [cluster2] }
2021-07-14T16:20:01.7621922Z [cluster2] },
2021-07-14T16:20:01.7622374Z [cluster2] "type": "object"
2021-07-14T16:20:01.7622803Z [cluster2] },
2021-07-14T16:20:01.7623367Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-14T16:20:01.7623992Z [cluster2] "properties": {
2021-07-14T16:20:01.7624569Z [cluster2] "lastResourceVersion": {
2021-07-14T16:20:01.7625180Z [cluster2] "type": "string"
2021-07-14T16:20:01.7625620Z [cluster2] },
2021-07-14T16:20:01.7626233Z [cluster2] "mismatchedContainerImages": {
2021-07-14T16:20:01.7626882Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7627341Z [cluster2] },
2021-07-14T16:20:01.7627987Z [cluster2] "nonReadyContainerStates": {
2021-07-14T16:20:01.7628638Z [cluster2] "items": {
2021-07-14T16:20:01.7629845Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:01.7630962Z [cluster2] "properties": {
2021-07-14T16:20:01.7631483Z [cluster2] "running": {
2021-07-14T16:20:01.7632144Z [cluster2] "description": "Details about a running container",
2021-07-14T16:20:01.7632780Z [cluster2] "properties": {
2021-07-14T16:20:01.7633324Z [cluster2] "startedAt": {
2021-07-14T16:20:01.7634480Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:01.7635351Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.7635893Z [cluster2] "type": "string"
2021-07-14T16:20:01.7636357Z [cluster2] }
2021-07-14T16:20:01.7636870Z [cluster2] },
2021-07-14T16:20:01.7637349Z [cluster2] "type": "object"
2021-07-14T16:20:01.7637802Z [cluster2] },
2021-07-14T16:20:01.7638275Z [cluster2] "terminated": {
2021-07-14T16:20:01.7638931Z [cluster2] "description": "Details about a terminated container",
2021-07-14T16:20:01.7639591Z [cluster2] "properties": {
2021-07-14T16:20:01.7640126Z [cluster2] "containerID": {
2021-07-14T16:20:01.7641174Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:01.7641893Z [cluster2] "type": "string"
2021-07-14T16:20:01.7642363Z [cluster2] },
2021-07-14T16:20:01.7642854Z [cluster2] "exitCode": {
2021-07-14T16:20:01.7643567Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:01.7644238Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7644757Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7645228Z [cluster2] },
2021-07-14T16:20:01.7645720Z [cluster2] "finishedAt": {
2021-07-14T16:20:01.7646409Z [cluster2] "description": "Time at which the container last terminated",
2021-07-14T16:20:01.7647272Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.7689112Z [cluster2] "type": "string"
2021-07-14T16:20:01.7689941Z [cluster2] },
2021-07-14T16:20:01.7690422Z [cluster2] "message": {
2021-07-14T16:20:01.7691149Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:01.7691856Z [cluster2] "type": "string"
2021-07-14T16:20:01.7692333Z [cluster2] },
2021-07-14T16:20:01.7692795Z [cluster2] "reason": {
2021-07-14T16:20:01.7693499Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:01.7694183Z [cluster2] "type": "string"
2021-07-14T16:20:01.7694660Z [cluster2] },
2021-07-14T16:20:01.7695116Z [cluster2] "signal": {
2021-07-14T16:20:01.7695777Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-14T16:20:01.7696460Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7697050Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7697534Z [cluster2] },
2021-07-14T16:20:01.7698021Z [cluster2] "startedAt": {
2021-07-14T16:20:01.7698737Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:01.7699929Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.7700459Z [cluster2] "type": "string"
2021-07-14T16:20:01.7700933Z [cluster2] }
2021-07-14T16:20:01.7701377Z [cluster2] },
2021-07-14T16:20:01.7701836Z [cluster2] "required": [
2021-07-14T16:20:01.7702356Z [cluster2] "exitCode"
2021-07-14T16:20:01.7702807Z [cluster2] ],
2021-07-14T16:20:01.7703279Z [cluster2] "type": "object"
2021-07-14T16:20:01.7703731Z [cluster2] },
2021-07-14T16:20:01.7704198Z [cluster2] "waiting": {
2021-07-14T16:20:01.7704823Z [cluster2] "description": "Details about a waiting container",
2021-07-14T16:20:01.7705450Z [cluster2] "properties": {
2021-07-14T16:20:01.7705970Z [cluster2] "message": {
2021-07-14T16:20:01.7706655Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:01.7707354Z [cluster2] "type": "string"
2021-07-14T16:20:01.7707817Z [cluster2] },
2021-07-14T16:20:01.7708283Z [cluster2] "reason": {
2021-07-14T16:20:01.7709016Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:01.7709675Z [cluster2] "type": "string"
2021-07-14T16:20:01.7710150Z [cluster2] }
2021-07-14T16:20:01.7710575Z [cluster2] },
2021-07-14T16:20:01.7711088Z [cluster2] "type": "object"
2021-07-14T16:20:01.7711560Z [cluster2] }
2021-07-14T16:20:01.7711985Z [cluster2] },
2021-07-14T16:20:01.7712450Z [cluster2] "type": "object"
2021-07-14T16:20:01.7712900Z [cluster2] },
2021-07-14T16:20:01.7713356Z [cluster2] "type": "array"
2021-07-14T16:20:01.7713791Z [cluster2] },
2021-07-14T16:20:01.7714225Z [cluster2] "status": {
2021-07-14T16:20:01.7714956Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:01.7715692Z [cluster2] "properties": {
2021-07-14T16:20:01.7716296Z [cluster2] "collisionCount": {
2021-07-14T16:20:01.7717495Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:01.7718655Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7719176Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7719655Z [cluster2] },
2021-07-14T16:20:01.7720121Z [cluster2] "conditions": {
2021-07-14T16:20:01.7721350Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:01.7722134Z [cluster2] "items": {
2021-07-14T16:20:01.7722929Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:01.7723731Z [cluster2] "properties": {
2021-07-14T16:20:01.7724332Z [cluster2] "lastTransitionTime": {
2021-07-14T16:20:01.7725178Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:01.7726121Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.7726664Z [cluster2] "type": "string"
2021-07-14T16:20:01.7727132Z [cluster2] },
2021-07-14T16:20:01.7727603Z [cluster2] "message": {
2021-07-14T16:20:01.7728452Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:01.7729286Z [cluster2] "type": "string"
2021-07-14T16:20:01.7729767Z [cluster2] },
2021-07-14T16:20:01.7730218Z [cluster2] "reason": {
2021-07-14T16:20:01.7731129Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:01.7731785Z [cluster2] "type": "string"
2021-07-14T16:20:01.7732266Z [cluster2] },
2021-07-14T16:20:01.7732725Z [cluster2] "status": {
2021-07-14T16:20:01.7733392Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:01.7734074Z [cluster2] "type": "string"
2021-07-14T16:20:01.7734541Z [cluster2] },
2021-07-14T16:20:01.7734995Z [cluster2] "type": {
2021-07-14T16:20:01.7735612Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:01.7736227Z [cluster2] "type": "string"
2021-07-14T16:20:01.7736773Z [cluster2] }
2021-07-14T16:20:01.7737199Z [cluster2] },
2021-07-14T16:20:01.7737673Z [cluster2] "required": [
2021-07-14T16:20:01.7738155Z [cluster2] "status",
2021-07-14T16:20:01.7738636Z [cluster2] "type"
2021-07-14T16:20:01.7739079Z [cluster2] ],
2021-07-14T16:20:01.7739541Z [cluster2] "type": "object"
2021-07-14T16:20:01.7740009Z [cluster2] },
2021-07-14T16:20:01.7740461Z [cluster2] "type": "array"
2021-07-14T16:20:01.7782740Z [cluster2] },
2021-07-14T16:20:01.7783337Z [cluster2] "currentNumberScheduled": {
2021-07-14T16:20:01.7784618Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.7785756Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7786267Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7786758Z [cluster2] },
2021-07-14T16:20:01.7787343Z [cluster2] "desiredNumberScheduled": {
2021-07-14T16:20:01.7788660Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.7789864Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7790390Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7791060Z [cluster2] },
2021-07-14T16:20:01.7791584Z [cluster2] "numberAvailable": {
2021-07-14T16:20:01.7792657Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.7793710Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7794232Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7794694Z [cluster2] },
2021-07-14T16:20:01.7795225Z [cluster2] "numberMisscheduled": {
2021-07-14T16:20:01.7796420Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.7797534Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7798050Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7798511Z [cluster2] },
2021-07-14T16:20:01.7798990Z [cluster2] "numberReady": {
2021-07-14T16:20:01.7800036Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:01.7800860Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7801376Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7801979Z [cluster2] },
2021-07-14T16:20:01.7802507Z [cluster2] "numberUnavailable": {
2021-07-14T16:20:01.7803574Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.7804595Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7805100Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7805553Z [cluster2] },
2021-07-14T16:20:01.7806093Z [cluster2] "observedGeneration": {
2021-07-14T16:20:01.7806999Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:01.7807729Z [cluster2] "format": "int64",
2021-07-14T16:20:01.7808315Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7808787Z [cluster2] },
2021-07-14T16:20:01.7809371Z [cluster2] "updatedNumberScheduled": {
2021-07-14T16:20:01.7810293Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:01.7810981Z [cluster2] "format": "int32",
2021-07-14T16:20:01.7811475Z [cluster2] "type": "integer"
2021-07-14T16:20:01.7811941Z [cluster2] }
2021-07-14T16:20:01.7812427Z [cluster2] },
2021-07-14T16:20:01.7812874Z [cluster2] "required": [
2021-07-14T16:20:01.7813497Z [cluster2] "currentNumberScheduled",
2021-07-14T16:20:01.7814212Z [cluster2] "desiredNumberScheduled",
2021-07-14T16:20:01.7814893Z [cluster2] "numberMisscheduled",
2021-07-14T16:20:01.7815471Z [cluster2] "numberReady"
2021-07-14T16:20:01.7815938Z [cluster2] ],
2021-07-14T16:20:01.7816395Z [cluster2] "type": "object"
2021-07-14T16:20:01.7816830Z [cluster2] }
2021-07-14T16:20:01.7817238Z [cluster2] },
2021-07-14T16:20:01.7817672Z [cluster2] "required": [
2021-07-14T16:20:01.7818312Z [cluster2] "mismatchedContainerImages"
2021-07-14T16:20:01.7818890Z [cluster2] ],
2021-07-14T16:20:01.7819340Z [cluster2] "type": "object"
2021-07-14T16:20:01.7819769Z [cluster2] },
2021-07-14T16:20:01.7820205Z [cluster2] "gateways": {
2021-07-14T16:20:01.7820732Z [cluster2] "items": {
2021-07-14T16:20:01.7821203Z [cluster2] "properties": {
2021-07-14T16:20:01.7821727Z [cluster2] "connections": {
2021-07-14T16:20:01.7822211Z [cluster2] "items": {
2021-07-14T16:20:01.7822713Z [cluster2] "properties": {
2021-07-14T16:20:01.7823224Z [cluster2] "endpoint": {
2021-07-14T16:20:01.7823752Z [cluster2] "properties": {
2021-07-14T16:20:01.7824275Z [cluster2] "backend": {
2021-07-14T16:20:01.7824772Z [cluster2] "type": "string"
2021-07-14T16:20:01.7825292Z [cluster2] },
2021-07-14T16:20:01.7825773Z [cluster2] "backend_config": {
2021-07-14T16:20:01.7826409Z [cluster2] "additionalProperties": {
2021-07-14T16:20:01.7827024Z [cluster2] "type": "string"
2021-07-14T16:20:01.7827507Z [cluster2] },
2021-07-14T16:20:01.7827997Z [cluster2] "type": "object"
2021-07-14T16:20:01.7828463Z [cluster2] },
2021-07-14T16:20:01.7828937Z [cluster2] "cable_name": {
2021-07-14T16:20:01.7829442Z [cluster2] "type": "string"
2021-07-14T16:20:01.7829916Z [cluster2] },
2021-07-14T16:20:01.7830393Z [cluster2] "cluster_id": {
2021-07-14T16:20:01.7830897Z [cluster2] "type": "string"
2021-07-14T16:20:01.7831436Z [cluster2] },
2021-07-14T16:20:01.7831944Z [cluster2] "healthCheckIP": {
2021-07-14T16:20:01.7883100Z [cluster2] "type": "string"
2021-07-14T16:20:01.7883601Z [cluster2] },
2021-07-14T16:20:01.7884082Z [cluster2] "hostname": {
2021-07-14T16:20:01.7884619Z [cluster2] "type": "string"
2021-07-14T16:20:01.7885085Z [cluster2] },
2021-07-14T16:20:01.7885573Z [cluster2] "nat_enabled": {
2021-07-14T16:20:01.7886098Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7886578Z [cluster2] },
2021-07-14T16:20:01.7887066Z [cluster2] "private_ip": {
2021-07-14T16:20:01.7887576Z [cluster2] "type": "string"
2021-07-14T16:20:01.7888264Z [cluster2] },
2021-07-14T16:20:01.7888953Z [cluster2] "public_ip": {
2021-07-14T16:20:01.7889465Z [cluster2] "type": "string"
2021-07-14T16:20:01.7889930Z [cluster2] },
2021-07-14T16:20:01.7890398Z [cluster2] "subnets": {
2021-07-14T16:20:01.7890889Z [cluster2] "items": {
2021-07-14T16:20:01.7891389Z [cluster2] "type": "string"
2021-07-14T16:20:01.7891874Z [cluster2] },
2021-07-14T16:20:01.7892566Z [cluster2] "type": "array"
2021-07-14T16:20:01.7893066Z [cluster2] }
2021-07-14T16:20:01.7893611Z [cluster2] },
2021-07-14T16:20:01.7894080Z [cluster2] "required": [
2021-07-14T16:20:01.7894586Z [cluster2] "backend",
2021-07-14T16:20:01.7895077Z [cluster2] "cable_name",
2021-07-14T16:20:01.7895581Z [cluster2] "cluster_id",
2021-07-14T16:20:01.7896070Z [cluster2] "hostname",
2021-07-14T16:20:01.7896577Z [cluster2] "nat_enabled",
2021-07-14T16:20:01.7897091Z [cluster2] "private_ip",
2021-07-14T16:20:01.7897588Z [cluster2] "public_ip",
2021-07-14T16:20:01.7898079Z [cluster2] "subnets"
2021-07-14T16:20:01.7898537Z [cluster2] ],
2021-07-14T16:20:01.7899014Z [cluster2] "type": "object"
2021-07-14T16:20:01.7899565Z [cluster2] },
2021-07-14T16:20:01.7900055Z [cluster2] "latencyRTT": {
2021-07-14T16:20:01.7900967Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-14T16:20:01.7901859Z [cluster2] "properties": {
2021-07-14T16:20:01.7902381Z [cluster2] "average": {
2021-07-14T16:20:01.7902878Z [cluster2] "type": "string"
2021-07-14T16:20:01.7903354Z [cluster2] },
2021-07-14T16:20:01.7904082Z [cluster2] "last": {
2021-07-14T16:20:01.7904574Z [cluster2] "type": "string"
2021-07-14T16:20:01.7905052Z [cluster2] },
2021-07-14T16:20:01.7905485Z [cluster2] "max": {
2021-07-14T16:20:01.7906011Z [cluster2] "type": "string"
2021-07-14T16:20:01.7906493Z [cluster2] },
2021-07-14T16:20:01.7906993Z [cluster2] "min": {
2021-07-14T16:20:01.7907486Z [cluster2] "type": "string"
2021-07-14T16:20:01.7907951Z [cluster2] },
2021-07-14T16:20:01.7908418Z [cluster2] "stdDev": {
2021-07-14T16:20:01.7908913Z [cluster2] "type": "string"
2021-07-14T16:20:01.7909400Z [cluster2] }
2021-07-14T16:20:01.7909841Z [cluster2] },
2021-07-14T16:20:01.7910306Z [cluster2] "type": "object"
2021-07-14T16:20:01.7910779Z [cluster2] },
2021-07-14T16:20:01.7911221Z [cluster2] "status": {
2021-07-14T16:20:01.7911719Z [cluster2] "type": "string"
2021-07-14T16:20:01.7912177Z [cluster2] },
2021-07-14T16:20:01.7912681Z [cluster2] "statusMessage": {
2021-07-14T16:20:01.7913220Z [cluster2] "type": "string"
2021-07-14T16:20:01.7913673Z [cluster2] },
2021-07-14T16:20:01.7914141Z [cluster2] "usingIP": {
2021-07-14T16:20:01.7914633Z [cluster2] "type": "string"
2021-07-14T16:20:01.7915099Z [cluster2] },
2021-07-14T16:20:01.7915649Z [cluster2] "usingNAT": {
2021-07-14T16:20:01.7916171Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7916647Z [cluster2] }
2021-07-14T16:20:01.7917064Z [cluster2] },
2021-07-14T16:20:01.7917596Z [cluster2] "required": [
2021-07-14T16:20:01.7918090Z [cluster2] "endpoint",
2021-07-14T16:20:01.7918572Z [cluster2] "status",
2021-07-14T16:20:01.7919076Z [cluster2] "statusMessage"
2021-07-14T16:20:01.7919565Z [cluster2] ],
2021-07-14T16:20:01.7920109Z [cluster2] "type": "object"
2021-07-14T16:20:01.7920556Z [cluster2] },
2021-07-14T16:20:01.7921010Z [cluster2] "type": "array"
2021-07-14T16:20:01.7921447Z [cluster2] },
2021-07-14T16:20:01.7921900Z [cluster2] "haStatus": {
2021-07-14T16:20:01.7922389Z [cluster2] "type": "string"
2021-07-14T16:20:01.7922845Z [cluster2] },
2021-07-14T16:20:01.7923334Z [cluster2] "localEndpoint": {
2021-07-14T16:20:01.7923869Z [cluster2] "properties": {
2021-07-14T16:20:01.7924377Z [cluster2] "backend": {
2021-07-14T16:20:01.7924932Z [cluster2] "type": "string"
2021-07-14T16:20:01.7925428Z [cluster2] },
2021-07-14T16:20:01.7925898Z [cluster2] "backend_config": {
2021-07-14T16:20:01.7926510Z [cluster2] "additionalProperties": {
2021-07-14T16:20:01.7927122Z [cluster2] "type": "string"
2021-07-14T16:20:01.7927578Z [cluster2] },
2021-07-14T16:20:01.7960703Z [cluster2] "type": "object"
2021-07-14T16:20:01.7961178Z [cluster2] },
2021-07-14T16:20:01.7961649Z [cluster2] "cable_name": {
2021-07-14T16:20:01.7962170Z [cluster2] "type": "string"
2021-07-14T16:20:01.7962647Z [cluster2] },
2021-07-14T16:20:01.7963109Z [cluster2] "cluster_id": {
2021-07-14T16:20:01.7963594Z [cluster2] "type": "string"
2021-07-14T16:20:01.7964071Z [cluster2] },
2021-07-14T16:20:01.7964563Z [cluster2] "healthCheckIP": {
2021-07-14T16:20:01.7965107Z [cluster2] "type": "string"
2021-07-14T16:20:01.7965561Z [cluster2] },
2021-07-14T16:20:01.7966021Z [cluster2] "hostname": {
2021-07-14T16:20:01.7966532Z [cluster2] "type": "string"
2021-07-14T16:20:01.7966984Z [cluster2] },
2021-07-14T16:20:01.7967450Z [cluster2] "nat_enabled": {
2021-07-14T16:20:01.7968163Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7968851Z [cluster2] },
2021-07-14T16:20:01.7969410Z [cluster2] "private_ip": {
2021-07-14T16:20:01.7969926Z [cluster2] "type": "string"
2021-07-14T16:20:01.7970396Z [cluster2] },
2021-07-14T16:20:01.7970957Z [cluster2] "public_ip": {
2021-07-14T16:20:01.7971461Z [cluster2] "type": "string"
2021-07-14T16:20:01.7971922Z [cluster2] },
2021-07-14T16:20:01.7972379Z [cluster2] "subnets": {
2021-07-14T16:20:01.7972845Z [cluster2] "items": {
2021-07-14T16:20:01.7973342Z [cluster2] "type": "string"
2021-07-14T16:20:01.7973823Z [cluster2] },
2021-07-14T16:20:01.7974278Z [cluster2] "type": "array"
2021-07-14T16:20:01.7974743Z [cluster2] }
2021-07-14T16:20:01.7975159Z [cluster2] },
2021-07-14T16:20:01.7975625Z [cluster2] "required": [
2021-07-14T16:20:01.7976182Z [cluster2] "backend",
2021-07-14T16:20:01.7976668Z [cluster2] "cable_name",
2021-07-14T16:20:01.7977158Z [cluster2] "cluster_id",
2021-07-14T16:20:01.7977639Z [cluster2] "hostname",
2021-07-14T16:20:01.7978138Z [cluster2] "nat_enabled",
2021-07-14T16:20:01.7978631Z [cluster2] "private_ip",
2021-07-14T16:20:01.7979122Z [cluster2] "public_ip",
2021-07-14T16:20:01.7979599Z [cluster2] "subnets"
2021-07-14T16:20:01.7980050Z [cluster2] ],
2021-07-14T16:20:01.7980513Z [cluster2] "type": "object"
2021-07-14T16:20:01.7980964Z [cluster2] },
2021-07-14T16:20:01.7981455Z [cluster2] "statusFailure": {
2021-07-14T16:20:01.7981972Z [cluster2] "type": "string"
2021-07-14T16:20:01.7982427Z [cluster2] },
2021-07-14T16:20:01.7982865Z [cluster2] "version": {
2021-07-14T16:20:01.7983349Z [cluster2] "type": "string"
2021-07-14T16:20:01.7983797Z [cluster2] }
2021-07-14T16:20:01.7984197Z [cluster2] },
2021-07-14T16:20:01.7984700Z [cluster2] "required": [
2021-07-14T16:20:01.7985192Z [cluster2] "connections",
2021-07-14T16:20:01.7985686Z [cluster2] "haStatus",
2021-07-14T16:20:01.7986319Z [cluster2] "localEndpoint",
2021-07-14T16:20:01.7986875Z [cluster2] "statusFailure",
2021-07-14T16:20:01.7987386Z [cluster2] "version"
2021-07-14T16:20:01.7987809Z [cluster2] ],
2021-07-14T16:20:01.7988340Z [cluster2] "type": "object"
2021-07-14T16:20:01.7988777Z [cluster2] },
2021-07-14T16:20:01.7989221Z [cluster2] "type": "array"
2021-07-14T16:20:01.7989641Z [cluster2] },
2021-07-14T16:20:01.7990094Z [cluster2] "globalCIDR": {
2021-07-14T16:20:01.7990577Z [cluster2] "type": "string"
2021-07-14T16:20:01.7991020Z [cluster2] },
2021-07-14T16:20:01.7991613Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-14T16:20:01.7992252Z [cluster2] "properties": {
2021-07-14T16:20:01.7992846Z [cluster2] "lastResourceVersion": {
2021-07-14T16:20:01.7993416Z [cluster2] "type": "string"
2021-07-14T16:20:01.7993863Z [cluster2] },
2021-07-14T16:20:01.7994461Z [cluster2] "mismatchedContainerImages": {
2021-07-14T16:20:01.7995121Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.7995576Z [cluster2] },
2021-07-14T16:20:01.7996143Z [cluster2] "nonReadyContainerStates": {
2021-07-14T16:20:01.7996968Z [cluster2] "items": {
2021-07-14T16:20:01.7998128Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:01.7999275Z [cluster2] "properties": {
2021-07-14T16:20:01.7999776Z [cluster2] "running": {
2021-07-14T16:20:01.8000402Z [cluster2] "description": "Details about a running container",
2021-07-14T16:20:01.8001047Z [cluster2] "properties": {
2021-07-14T16:20:01.8001562Z [cluster2] "startedAt": {
2021-07-14T16:20:01.8002917Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:01.8003790Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8004333Z [cluster2] "type": "string"
2021-07-14T16:20:01.8004809Z [cluster2] }
2021-07-14T16:20:01.8005240Z [cluster2] },
2021-07-14T16:20:01.8005725Z [cluster2] "type": "object"
2021-07-14T16:20:01.8006177Z [cluster2] },
2021-07-14T16:20:01.8006656Z [cluster2] "terminated": {
2021-07-14T16:20:01.8007310Z [cluster2] "description": "Details about a terminated container",
2021-07-14T16:20:01.8008110Z [cluster2] "properties": {
2021-07-14T16:20:01.8008658Z [cluster2] "containerID": {
2021-07-14T16:20:01.8009636Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:01.8010461Z [cluster2] "type": "string"
2021-07-14T16:20:01.8010931Z [cluster2] },
2021-07-14T16:20:01.8011409Z [cluster2] "exitCode": {
2021-07-14T16:20:01.8012119Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:01.8012799Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8013324Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8013796Z [cluster2] },
2021-07-14T16:20:01.8014284Z [cluster2] "finishedAt": {
2021-07-14T16:20:01.8014974Z [cluster2] "description": "Time at which the container last terminated",
2021-07-14T16:20:01.8015841Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8016379Z [cluster2] "type": "string"
2021-07-14T16:20:01.8016842Z [cluster2] },
2021-07-14T16:20:01.8017392Z [cluster2] "message": {
2021-07-14T16:20:01.8018106Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:01.8018812Z [cluster2] "type": "string"
2021-07-14T16:20:01.8019287Z [cluster2] },
2021-07-14T16:20:01.8019740Z [cluster2] "reason": {
2021-07-14T16:20:01.8020438Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:01.8021125Z [cluster2] "type": "string"
2021-07-14T16:20:01.8021594Z [cluster2] },
2021-07-14T16:20:01.8022060Z [cluster2] "signal": {
2021-07-14T16:20:01.8022720Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-14T16:20:01.8023391Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8023903Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8024386Z [cluster2] },
2021-07-14T16:20:01.8024864Z [cluster2] "startedAt": {
2021-07-14T16:20:01.8025618Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:01.8026555Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8027088Z [cluster2] "type": "string"
2021-07-14T16:20:01.8027567Z [cluster2] }
2021-07-14T16:20:01.8027999Z [cluster2] },
2021-07-14T16:20:01.8028537Z [cluster2] "required": [
2021-07-14T16:20:01.8029056Z [cluster2] "exitCode"
2021-07-14T16:20:01.8029514Z [cluster2] ],
2021-07-14T16:20:01.8029993Z [cluster2] "type": "object"
2021-07-14T16:20:01.8030447Z [cluster2] },
2021-07-14T16:20:01.8030907Z [cluster2] "waiting": {
2021-07-14T16:20:01.8031546Z [cluster2] "description": "Details about a waiting container",
2021-07-14T16:20:01.8032180Z [cluster2] "properties": {
2021-07-14T16:20:01.8032699Z [cluster2] "message": {
2021-07-14T16:20:01.8033395Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:01.8034100Z [cluster2] "type": "string"
2021-07-14T16:20:01.8034561Z [cluster2] },
2021-07-14T16:20:01.8035019Z [cluster2] "reason": {
2021-07-14T16:20:01.8035683Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:01.8036387Z [cluster2] "type": "string"
2021-07-14T16:20:01.8036853Z [cluster2] }
2021-07-14T16:20:01.8037274Z [cluster2] },
2021-07-14T16:20:01.8037749Z [cluster2] "type": "object"
2021-07-14T16:20:01.8038217Z [cluster2] }
2021-07-14T16:20:01.8038624Z [cluster2] },
2021-07-14T16:20:01.8039089Z [cluster2] "type": "object"
2021-07-14T16:20:01.8076062Z [cluster2] },
2021-07-14T16:20:01.8076546Z [cluster2] "type": "array"
2021-07-14T16:20:01.8077016Z [cluster2] },
2021-07-14T16:20:01.8077454Z [cluster2] "status": {
2021-07-14T16:20:01.8078186Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:01.8078966Z [cluster2] "properties": {
2021-07-14T16:20:01.8079526Z [cluster2] "collisionCount": {
2021-07-14T16:20:01.8080721Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:01.8081872Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8082385Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8082844Z [cluster2] },
2021-07-14T16:20:01.8083325Z [cluster2] "conditions": {
2021-07-14T16:20:01.8084878Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:01.8085975Z [cluster2] "items": {
2021-07-14T16:20:01.8086763Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:01.8087576Z [cluster2] "properties": {
2021-07-14T16:20:01.8088339Z [cluster2] "lastTransitionTime": {
2021-07-14T16:20:01.8089142Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:01.8090127Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8090660Z [cluster2] "type": "string"
2021-07-14T16:20:01.8091139Z [cluster2] },
2021-07-14T16:20:01.8091736Z [cluster2] "message": {
2021-07-14T16:20:01.8092473Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:01.8093291Z [cluster2] "type": "string"
2021-07-14T16:20:01.8093872Z [cluster2] },
2021-07-14T16:20:01.8094334Z [cluster2] "reason": {
2021-07-14T16:20:01.8095241Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:01.8095903Z [cluster2] "type": "string"
2021-07-14T16:20:01.8096384Z [cluster2] },
2021-07-14T16:20:01.8096833Z [cluster2] "status": {
2021-07-14T16:20:01.8097521Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:01.8098208Z [cluster2] "type": "string"
2021-07-14T16:20:01.8098670Z [cluster2] },
2021-07-14T16:20:01.8099125Z [cluster2] "type": {
2021-07-14T16:20:01.8099731Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:01.8100359Z [cluster2] "type": "string"
2021-07-14T16:20:01.8100816Z [cluster2] }
2021-07-14T16:20:01.8101259Z [cluster2] },
2021-07-14T16:20:01.8101732Z [cluster2] "required": [
2021-07-14T16:20:01.8102216Z [cluster2] "status",
2021-07-14T16:20:01.8102689Z [cluster2] "type"
2021-07-14T16:20:01.8103127Z [cluster2] ],
2021-07-14T16:20:01.8103602Z [cluster2] "type": "object"
2021-07-14T16:20:01.8104055Z [cluster2] },
2021-07-14T16:20:01.8104515Z [cluster2] "type": "array"
2021-07-14T16:20:01.8105056Z [cluster2] },
2021-07-14T16:20:01.8105634Z [cluster2] "currentNumberScheduled": {
2021-07-14T16:20:01.8106909Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8108027Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8108686Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8109163Z [cluster2] },
2021-07-14T16:20:01.8109735Z [cluster2] "desiredNumberScheduled": {
2021-07-14T16:20:01.8111075Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8112241Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8112755Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8113228Z [cluster2] },
2021-07-14T16:20:01.8113803Z [cluster2] "numberAvailable": {
2021-07-14T16:20:01.8114880Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.8115894Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8116412Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8116881Z [cluster2] },
2021-07-14T16:20:01.8117399Z [cluster2] "numberMisscheduled": {
2021-07-14T16:20:01.8118623Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8119735Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8120248Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8120718Z [cluster2] },
2021-07-14T16:20:01.8121181Z [cluster2] "numberReady": {
2021-07-14T16:20:01.8122038Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:01.8122841Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8123344Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8123817Z [cluster2] },
2021-07-14T16:20:01.8124322Z [cluster2] "numberUnavailable": {
2021-07-14T16:20:01.8125421Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.8126478Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8126993Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8127465Z [cluster2] },
2021-07-14T16:20:01.8128915Z [cluster2] "observedGeneration": {
2021-07-14T16:20:01.8130012Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:01.8130737Z [cluster2] "format": "int64",
2021-07-14T16:20:01.8131247Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8131703Z [cluster2] },
2021-07-14T16:20:01.8132286Z [cluster2] "updatedNumberScheduled": {
2021-07-14T16:20:01.8133118Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:01.8133793Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8134304Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8134763Z [cluster2] }
2021-07-14T16:20:01.8135308Z [cluster2] },
2021-07-14T16:20:01.8135769Z [cluster2] "required": [
2021-07-14T16:20:01.8136375Z [cluster2] "currentNumberScheduled",
2021-07-14T16:20:01.8137107Z [cluster2] "desiredNumberScheduled",
2021-07-14T16:20:01.8137823Z [cluster2] "numberMisscheduled",
2021-07-14T16:20:01.8138408Z [cluster2] "numberReady"
2021-07-14T16:20:01.8138939Z [cluster2] ],
2021-07-14T16:20:01.8139400Z [cluster2] "type": "object"
2021-07-14T16:20:01.8139845Z [cluster2] }
2021-07-14T16:20:01.8140254Z [cluster2] },
2021-07-14T16:20:01.8140699Z [cluster2] "required": [
2021-07-14T16:20:01.8141327Z [cluster2] "mismatchedContainerImages"
2021-07-14T16:20:01.8142208Z [cluster2] ],
2021-07-14T16:20:01.8142649Z [cluster2] "type": "object"
2021-07-14T16:20:01.8143094Z [cluster2] },
2021-07-14T16:20:01.8143602Z [cluster2] "loadBalancerStatus": {
2021-07-14T16:20:01.8144177Z [cluster2] "properties": {
2021-07-14T16:20:01.8144668Z [cluster2] "status": {
2021-07-14T16:20:01.8145887Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-14T16:20:01.8147273Z [cluster2] "properties": {
2021-07-14T16:20:01.8147788Z [cluster2] "ingress": {
2021-07-14T16:20:01.8149395Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-14T16:20:01.8150787Z [cluster2] "items": {
2021-07-14T16:20:01.8152632Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-14T16:20:01.8153708Z [cluster2] "properties": {
2021-07-14T16:20:01.8154222Z [cluster2] "hostname": {
2021-07-14T16:20:01.8155402Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-14T16:20:01.8156286Z [cluster2] "type": "string"
2021-07-14T16:20:01.8156757Z [cluster2] },
2021-07-14T16:20:01.8157205Z [cluster2] "ip": {
2021-07-14T16:20:01.8158511Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-14T16:20:01.8159705Z [cluster2] "type": "string"
2021-07-14T16:20:01.8160292Z [cluster2] }
2021-07-14T16:20:01.8160741Z [cluster2] },
2021-07-14T16:20:01.8161459Z [cluster2] "type": "object"
2021-07-14T16:20:01.8162049Z [cluster2] },
2021-07-14T16:20:01.8162632Z [cluster2] "type": "array"
2021-07-14T16:20:01.8163315Z [cluster2] }
2021-07-14T16:20:01.8163767Z [cluster2] },
2021-07-14T16:20:01.8164216Z [cluster2] "type": "object"
2021-07-14T16:20:01.8164669Z [cluster2] }
2021-07-14T16:20:01.8165073Z [cluster2] },
2021-07-14T16:20:01.8165510Z [cluster2] "type": "object"
2021-07-14T16:20:01.8165951Z [cluster2] },
2021-07-14T16:20:01.8166391Z [cluster2] "natEnabled": {
2021-07-14T16:20:01.8166896Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.8167330Z [cluster2] },
2021-07-14T16:20:01.8168215Z [cluster2] "networkPlugin": {
2021-07-14T16:20:01.8168729Z [cluster2] "type": "string"
2021-07-14T16:20:01.8169171Z [cluster2] },
2021-07-14T16:20:01.8169777Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-14T16:20:01.8170423Z [cluster2] "properties": {
2021-07-14T16:20:01.8171017Z [cluster2] "lastResourceVersion": {
2021-07-14T16:20:01.8171605Z [cluster2] "type": "string"
2021-07-14T16:20:01.8172054Z [cluster2] },
2021-07-14T16:20:01.8172656Z [cluster2] "mismatchedContainerImages": {
2021-07-14T16:20:01.8173313Z [cluster2] "type": "boolean"
2021-07-14T16:20:01.8173772Z [cluster2] },
2021-07-14T16:20:01.8174336Z [cluster2] "nonReadyContainerStates": {
2021-07-14T16:20:01.8174938Z [cluster2] "items": {
2021-07-14T16:20:01.8176139Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:01.8177266Z [cluster2] "properties": {
2021-07-14T16:20:01.8177774Z [cluster2] "running": {
2021-07-14T16:20:01.8178381Z [cluster2] "description": "Details about a running container",
2021-07-14T16:20:01.8179027Z [cluster2] "properties": {
2021-07-14T16:20:01.8179533Z [cluster2] "startedAt": {
2021-07-14T16:20:01.8180535Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:01.8181415Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8181941Z [cluster2] "type": "string"
2021-07-14T16:20:01.8182413Z [cluster2] }
2021-07-14T16:20:01.8182838Z [cluster2] },
2021-07-14T16:20:01.8183387Z [cluster2] "type": "object"
2021-07-14T16:20:01.8183843Z [cluster2] },
2021-07-14T16:20:01.8184320Z [cluster2] "terminated": {
2021-07-14T16:20:01.8184980Z [cluster2] "description": "Details about a terminated container",
2021-07-14T16:20:01.8185627Z [cluster2] "properties": {
2021-07-14T16:20:01.8186167Z [cluster2] "containerID": {
2021-07-14T16:20:01.8187139Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:01.8187853Z [cluster2] "type": "string"
2021-07-14T16:20:01.8188593Z [cluster2] },
2021-07-14T16:20:01.8189224Z [cluster2] "exitCode": {
2021-07-14T16:20:01.8189932Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:01.8190615Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8191137Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8191610Z [cluster2] },
2021-07-14T16:20:01.8192094Z [cluster2] "finishedAt": {
2021-07-14T16:20:01.8192784Z [cluster2] "description": "Time at which the container last terminated",
2021-07-14T16:20:01.8193684Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8194224Z [cluster2] "type": "string"
2021-07-14T16:20:01.8194686Z [cluster2] },
2021-07-14T16:20:01.8195152Z [cluster2] "message": {
2021-07-14T16:20:01.8195938Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:01.8196648Z [cluster2] "type": "string"
2021-07-14T16:20:01.8197120Z [cluster2] },
2021-07-14T16:20:01.8197570Z [cluster2] "reason": {
2021-07-14T16:20:01.8198273Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:01.8198970Z [cluster2] "type": "string"
2021-07-14T16:20:01.8199425Z [cluster2] },
2021-07-14T16:20:01.8199884Z [cluster2] "signal": {
2021-07-14T16:20:01.8200548Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-14T16:20:01.8201225Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8201730Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8202214Z [cluster2] },
2021-07-14T16:20:01.8202746Z [cluster2] "startedAt": {
2021-07-14T16:20:01.8213346Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:01.8214617Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8215176Z [cluster2] "type": "string"
2021-07-14T16:20:01.8215651Z [cluster2] }
2021-07-14T16:20:01.8216089Z [cluster2] },
2021-07-14T16:20:01.8216551Z [cluster2] "required": [
2021-07-14T16:20:01.8217511Z [cluster2] "exitCode"
2021-07-14T16:20:01.8218040Z [cluster2] ],
2021-07-14T16:20:01.8218521Z [cluster2] "type": "object"
2021-07-14T16:20:01.8218976Z [cluster2] },
2021-07-14T16:20:01.8219437Z [cluster2] "waiting": {
2021-07-14T16:20:01.8220069Z [cluster2] "description": "Details about a waiting container",
2021-07-14T16:20:01.8220701Z [cluster2] "properties": {
2021-07-14T16:20:01.8221222Z [cluster2] "message": {
2021-07-14T16:20:01.8221919Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:01.8222623Z [cluster2] "type": "string"
2021-07-14T16:20:01.8223097Z [cluster2] },
2021-07-14T16:20:01.8223545Z [cluster2] "reason": {
2021-07-14T16:20:01.8224213Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:01.8225032Z [cluster2] "type": "string"
2021-07-14T16:20:01.8225544Z [cluster2] }
2021-07-14T16:20:01.8225974Z [cluster2] },
2021-07-14T16:20:01.8226447Z [cluster2] "type": "object"
2021-07-14T16:20:01.8226913Z [cluster2] }
2021-07-14T16:20:01.8227330Z [cluster2] },
2021-07-14T16:20:01.8227793Z [cluster2] "type": "object"
2021-07-14T16:20:01.8228235Z [cluster2] },
2021-07-14T16:20:01.8228688Z [cluster2] "type": "array"
2021-07-14T16:20:01.8229118Z [cluster2] },
2021-07-14T16:20:01.8229557Z [cluster2] "status": {
2021-07-14T16:20:01.8230299Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:01.8231037Z [cluster2] "properties": {
2021-07-14T16:20:01.8232048Z [cluster2] "collisionCount": {
2021-07-14T16:20:01.8233340Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:01.8234493Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8235003Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8235461Z [cluster2] },
2021-07-14T16:20:01.8235927Z [cluster2] "conditions": {
2021-07-14T16:20:01.8237044Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:01.8237812Z [cluster2] "items": {
2021-07-14T16:20:01.8238813Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:01.8239619Z [cluster2] "properties": {
2021-07-14T16:20:01.8240214Z [cluster2] "lastTransitionTime": {
2021-07-14T16:20:01.8241018Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:01.8241992Z [cluster2] "format": "date-time",
2021-07-14T16:20:01.8242937Z [cluster2] "type": "string"
2021-07-14T16:20:01.8243401Z [cluster2] },
2021-07-14T16:20:01.8243869Z [cluster2] "message": {
2021-07-14T16:20:01.8244614Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:01.8245369Z [cluster2] "type": "string"
2021-07-14T16:20:01.8245831Z [cluster2] },
2021-07-14T16:20:01.8246380Z [cluster2] "reason": {
2021-07-14T16:20:01.8247323Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:01.8248398Z [cluster2] "type": "string"
2021-07-14T16:20:01.8248881Z [cluster2] },
2021-07-14T16:20:01.8249338Z [cluster2] "status": {
2021-07-14T16:20:01.8250021Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:01.8250702Z [cluster2] "type": "string"
2021-07-14T16:20:01.8251163Z [cluster2] },
2021-07-14T16:20:01.8251627Z [cluster2] "type": {
2021-07-14T16:20:01.8252232Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:01.8252859Z [cluster2] "type": "string"
2021-07-14T16:20:01.8253332Z [cluster2] }
2021-07-14T16:20:01.8253857Z [cluster2] },
2021-07-14T16:20:01.8254329Z [cluster2] "required": [
2021-07-14T16:20:01.8254811Z [cluster2] "status",
2021-07-14T16:20:01.8255283Z [cluster2] "type"
2021-07-14T16:20:01.8255723Z [cluster2] ],
2021-07-14T16:20:01.8256201Z [cluster2] "type": "object"
2021-07-14T16:20:01.8256711Z [cluster2] },
2021-07-14T16:20:01.8257158Z [cluster2] "type": "array"
2021-07-14T16:20:01.8257616Z [cluster2] },
2021-07-14T16:20:01.8258371Z [cluster2] "currentNumberScheduled": {
2021-07-14T16:20:01.8259661Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8260786Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8261298Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8261772Z [cluster2] },
2021-07-14T16:20:01.8262343Z [cluster2] "desiredNumberScheduled": {
2021-07-14T16:20:01.8263668Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8264854Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8265350Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8265820Z [cluster2] },
2021-07-14T16:20:01.8266312Z [cluster2] "numberAvailable": {
2021-07-14T16:20:01.8267471Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.8268509Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8269003Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8269474Z [cluster2] },
2021-07-14T16:20:01.8269993Z [cluster2] "numberMisscheduled": {
2021-07-14T16:20:01.8271188Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.8272686Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8273190Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8273663Z [cluster2] },
2021-07-14T16:20:01.8274129Z [cluster2] "numberReady": {
2021-07-14T16:20:01.8274985Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:01.8275860Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8276372Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8276837Z [cluster2] },
2021-07-14T16:20:01.8277355Z [cluster2] "numberUnavailable": {
2021-07-14T16:20:01.8278431Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.8279425Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8279930Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8280400Z [cluster2] },
2021-07-14T16:20:01.8280932Z [cluster2] "observedGeneration": {
2021-07-14T16:20:01.8281749Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:01.8282958Z [cluster2] "format": "int64",
2021-07-14T16:20:01.8283477Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8283948Z [cluster2] },
2021-07-14T16:20:01.8284520Z [cluster2] "updatedNumberScheduled": {
2021-07-14T16:20:01.8285348Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:01.8286027Z [cluster2] "format": "int32",
2021-07-14T16:20:01.8286537Z [cluster2] "type": "integer"
2021-07-14T16:20:01.8286995Z [cluster2] }
2021-07-14T16:20:01.8287415Z [cluster2] },
2021-07-14T16:20:01.8288116Z [cluster2] "required": [
2021-07-14T16:20:01.8288728Z [cluster2] "currentNumberScheduled",
2021-07-14T16:20:01.8289457Z [cluster2] "desiredNumberScheduled",
2021-07-14T16:20:01.8290132Z [cluster2] "numberMisscheduled",
2021-07-14T16:20:01.8290712Z [cluster2] "numberReady"
2021-07-14T16:20:01.8291172Z [cluster2] ],
2021-07-14T16:20:01.8291630Z [cluster2] "type": "object"
2021-07-14T16:20:01.8292083Z [cluster2] }
2021-07-14T16:20:01.8292477Z [cluster2] },
2021-07-14T16:20:01.8292922Z [cluster2] "required": [
2021-07-14T16:20:01.8293886Z [cluster2] "mismatchedContainerImages"
2021-07-14T16:20:01.8294483Z [cluster2] ],
2021-07-14T16:20:01.8294924Z [cluster2] "type": "object"
2021-07-14T16:20:01.8295490Z [cluster2] },
2021-07-14T16:20:01.8295938Z [cluster2] "serviceCIDR": {
2021-07-14T16:20:01.8296434Z [cluster2] "type": "string"
2021-07-14T16:20:01.8296952Z [cluster2] }
2021-07-14T16:20:01.8297330Z [cluster2] },
2021-07-14T16:20:01.8297760Z [cluster2] "required": [
2021-07-14T16:20:01.8298222Z [cluster2] "clusterID",
2021-07-14T16:20:01.8298703Z [cluster2] "natEnabled"
2021-07-14T16:20:01.8299126Z [cluster2] ],
2021-07-14T16:20:01.8299567Z [cluster2] "type": "object"
2021-07-14T16:20:01.8299976Z [cluster2] }
2021-07-14T16:20:01.8300362Z [cluster2] },
2021-07-14T16:20:01.8300786Z [cluster2] "type": "object"
2021-07-14T16:20:01.8301186Z [cluster2] }
2021-07-14T16:20:01.8301562Z [cluster2] },
2021-07-14T16:20:01.8301966Z [cluster2] "served": true,
2021-07-14T16:20:01.8302423Z [cluster2] "storage": true,
2021-07-14T16:20:01.8302889Z [cluster2] "subresources": {
2021-07-14T16:20:01.8303346Z [cluster2] "status": {}
2021-07-14T16:20:01.8303729Z [cluster2] }
2021-07-14T16:20:01.8304097Z [cluster2] }
2021-07-14T16:20:01.8304442Z [cluster2] ]
2021-07-14T16:20:01.8304794Z [cluster2] },
2021-07-14T16:20:01.8305160Z [cluster2] "status": {
2021-07-14T16:20:01.8305618Z [cluster2] "acceptedNames": {
2021-07-14T16:20:01.8306123Z [cluster2] "kind": "Submariner",
2021-07-14T16:20:01.8306644Z [cluster2] "listKind": "SubmarinerList",
2021-07-14T16:20:01.8307194Z [cluster2] "plural": "submariners",
2021-07-14T16:20:01.8307694Z [cluster2] "singular": "submariner"
2021-07-14T16:20:01.8308123Z [cluster2] },
2021-07-14T16:20:01.8308516Z [cluster2] "conditions": [
2021-07-14T16:20:01.8309151Z [cluster2] {
2021-07-14T16:20:01.8309968Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:01.9418172Z [cluster2] "message": "nr1] },
2021-07-14T16:20:01.9418640Z [cluster1] {
2021-07-14T16:20:01.9419860Z [cluster1] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:01.9420560Z [cluster1] "message": "the initial names have been accepted",
2021-07-14T16:20:01.9421251Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-14T16:20:01.9422105Z [cluster1] "status": "True",
2021-07-14T16:20:01.9422583Z [cluster1] "type": "Established"
2021-07-14T16:20:01.9423119Z [cluster1] }
2021-07-14T16:20:01.9423483Z [cluster1] ],
2021-07-14T16:20:01.9423910Z [cluster1] "storedVersions": [
2021-07-14T16:20:01.9424359Z [cluster1] "v1"
2021-07-14T16:20:01.9424709Z [cluster1] ]
2021-07-14T16:20:01.9425064Z [cluster1] }
2021-07-14T16:20:01.9425401Z [cluster1] }
2021-07-14T16:20:01.9426399Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-14T16:20:01.9427718Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-14T16:20:01.9429220Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:01.9430586Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:01.9431668Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:01.9433017Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:01.9434343Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:01.9435447Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:01.9436803Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:01.9438287Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-14T16:20:01.9439397Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-14T16:20:01.9440786Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:01.9442266Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-14T16:20:01.9443575Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-14T16:20:01.9445197Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-14T16:20:01.9446533Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-14T16:20:01.9447361Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-14T16:20:01.9449428Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-14T16:20:01.9450818Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-14T16:20:01.9452130Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-14T16:20:01.9453356Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-14T16:20:01.9454729Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-14T16:20:01.9455608Z [cluster1] NAME CREATED AT
2021-07-14T16:20:01.9456369Z [cluster1] submariners.submariner.io 2021-07-14T16:15:57Z
2021-07-14T16:20:01.9457787Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:01.9459225Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-14T16:20:01.9460586Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-14T16:20:01.9461967Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-14T16:20:01.9463527Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:01.9464414Z [cluster1] {
2021-07-14T16:20:01.9465105Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:01.9465850Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-14T16:20:01.9466511Z [cluster1] "metadata": {
2021-07-14T16:20:01.9466966Z [cluster1] "annotations": {
2021-07-14T16:20:01.9467826Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-14T16:20:01.9468468Z [cluster1] },
2021-07-14T16:20:01.9469098Z [cluster1] "creationTimestamp": "2021-07-14T16:15:57Z",
2021-07-14T16:20:01.9469689Z [cluster1] "generation": 2,
2021-07-14T16:20:01.9470168Z [cluster1] "managedFields": [
2021-07-14T16:20:01.9470630Z [cluster1] {
2021-07-14T16:20:01.9471190Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-14T16:20:01.9471817Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:01.9472314Z [cluster1] "fieldsV1": {
2021-07-14T16:20:01.9472750Z [cluster1] "f:metadata": {
2021-07-14T16:20:01.9473350Z [cluster1] "f:annotations": {
2021-07-14T16:20:01.9473790Z [cluster1] ".": {},
2021-07-14T16:20:01.9474637Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-14T16:20:01.9475279Z [cluster1] }
2021-07-14T16:20:01.9475664Z [cluster1] },
2021-07-14T16:20:01.9543867Z [cluster1] "f:spec": {
2021-07-14T16:20:01.9563411Z [cluster1] "f:conversion": {
2021-07-14T16:20:01.9566963Z [cluster1] ".": {},
2021-07-14T16:20:01.9567694Z [cluster1] "f:strategy": {}
2021-07-14T16:20:01.9568426Z [cluster1] },
2021-07-14T16:20:01.9569018Z [cluster1] "f:group": {},
2021-07-14T16:20:01.9569653Z [cluster1] "f:names": {
2021-07-14T16:20:01.9570243Z [cluster1] "f:kind": {},
2021-07-14T16:20:01.9570926Z [cluster1] "f:listKind": {},
2021-07-14T16:20:01.9571644Z [cluster1] "f:plural": {},
2021-07-14T16:20:01.9572269Z [cluster1] "f:singular": {}
2021-07-14T16:20:01.9572888Z [cluster1] },
2021-07-14T16:20:01.9580945Z [cluster1] "f:scope": {},
2021-07-14T16:20:01.9581746Z [cluster1] "f:versions": {}
2021-07-14T16:20:01.9582424Z [cluster1] },
2021-07-14T16:20:01.9583021Z [cluster1] "f:status": {
2021-07-14T16:20:01.9583715Z [cluster1] "f:acceptedNames": {
2021-07-14T16:20:01.9593901Z [cluster1] "f:kind": {},
2021-07-14T16:20:01.9594351Z [cluster1] "f:plural": {}
2021-07-14T16:20:01.9594771Z [cluster1] },
2021-07-14T16:20:01.9595192Z [cluster1] "f:conditions": {},
2021-07-14T16:20:01.9595727Z [cluster1] "f:storedVersions": {}
2021-07-14T16:20:01.9596190Z [cluster1] }
2021-07-14T16:20:01.9596546Z [cluster1] },
2021-07-14T16:20:01.9596972Z [cluster1] "manager": "subctl",
2021-07-14T16:20:01.9597446Z [cluster1] "operation": "Update",
2021-07-14T16:20:01.9598544Z [cluster1] "time": "2021-07-14T16:16:08Z"
2021-07-14T16:20:01.9598946Z [cluster1] }
2021-07-14T16:20:01.9599309Z [cluster1] ],
2021-07-14T16:20:01.9599973Z [cluster1] "name": "submariners.submariner.io",
2021-07-14T16:20:01.9600623Z [cluster1] "resourceVersion": "1994",
2021-07-14T16:20:01.9601406Z [cluster1] "uid": "058a31ea-a718-4f74-9bb2-04994aeb24d4"
2021-07-14T16:20:01.9601920Z [cluster1] },
2021-07-14T16:20:01.9602292Z [cluster1] "spec": {
2021-07-14T16:20:01.9602708Z [cluster1] "conversion": {
2021-07-14T16:20:01.9603169Z [cluster1] "strategy": "None"
2021-07-14T16:20:01.9603803Z [cluster1] },
2021-07-14T16:20:01.9604259Z [cluster1] "group": "submariner.io",
2021-07-14T16:20:01.9604711Z [cluster1] "names": {
2021-07-14T16:20:01.9605155Z [cluster1] "kind": "Submariner",
2021-07-14T16:20:01.9605675Z [cluster1] "listKind": "SubmarinerList",
2021-07-14T16:20:01.9606224Z [cluster1] "plural": "submariners",
2021-07-14T16:20:01.9606729Z [cluster1] "singular": "submariner"
2021-07-14T16:20:01.9607172Z [cluster1] },
2021-07-14T16:20:01.9607592Z [cluster1] "scope": "Namespaced",
2021-07-14T16:20:01.9609792Z [cluster1] "versions": [
2021-07-14T16:20:01.9610190Z [cluster1] {
2021-07-14T16:20:01.9610599Z [cluster1] "name": "v1alpha1",
2021-07-14T16:20:01.9611048Z [cluster1] "schema": {
2021-07-14T16:20:01.9611524Z [cluster1] "openAPIV3Schema": {
2021-07-14T16:20:01.9612231Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-14T16:20:01.9612889Z [cluster1] "properties": {
2021-07-14T16:20:01.9613390Z [cluster1] "apiVersion": {
2021-07-14T16:20:01.9615531Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-14T16:20:01.9617241Z [cluster1] "type": "string"
2021-07-14T16:20:01.9617673Z [cluster1] },
2021-07-14T16:20:01.9618073Z [cluster1] "kind": {
2021-07-14T16:20:01.9620050Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-14T16:20:01.9621616Z [cluster1] "type": "string"
2021-07-14T16:20:01.9622037Z [cluster1] },
2021-07-14T16:20:01.9622464Z [cluster1] "metadata": {
2021-07-14T16:20:01.9623076Z [cluster1] "type": "object"
2021-07-14T16:20:01.9623576Z [cluster1] },
2021-07-14T16:20:01.9623983Z [cluster1] "spec": {
2021-07-14T16:20:01.9624656Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-14T16:20:01.9625373Z [cluster1] "properties": {
2021-07-14T16:20:01.9625839Z [cluster1] "broker": {
2021-07-14T16:20:01.9626309Z [cluster1] "type": "string"
2021-07-14T16:20:01.9626751Z [cluster1] },
2021-07-14T16:20:01.9627254Z [cluster1] "brokerK8sApiServer": {
2021-07-14T16:20:01.9627816Z [cluster1] "type": "string"
2021-07-14T16:20:01.9628245Z [cluster1] },
2021-07-14T16:20:01.9628815Z [cluster1] "brokerK8sApiServerToken": {
2021-07-14T16:20:01.9629425Z [cluster1] "type": "string"
2021-07-14T16:20:01.9629956Z [cluster1] },
2021-07-14T16:20:01.9630412Z [cluster1] "brokerK8sCA": {
2021-07-14T16:20:01.9630899Z [cluster1] "type": "string"
2021-07-14T16:20:01.9631338Z [cluster1] },
2021-07-14T16:20:01.9632006Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-14T16:20:01.9632643Z [cluster1] "type": "string"
2021-07-14T16:20:01.9633067Z [cluster1] },
2021-07-14T16:20:01.9633522Z [cluster1] "cableDriver": {
2021-07-14T16:20:01.9634005Z [cluster1] "type": "string"
2021-07-14T16:20:01.9634440Z [cluster1] },
2021-07-14T16:20:01.9634912Z [cluster1] "ceIPSecDebug": {
2021-07-14T16:20:01.9635424Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9635868Z [cluster1] },
2021-07-14T16:20:01.9636411Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-14T16:20:01.9637023Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9637459Z [cluster1] },
2021-07-14T16:20:01.9637945Z [cluster1] "ceIPSecIKEPort": {
2021-07-14T16:20:01.9638579Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9639026Z [cluster1] },
2021-07-14T16:20:01.9643510Z [cluster1] "ceIPSecNATTPort": {
2021-07-14T16:20:01.9644054Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9644657Z [cluster1] },
2021-07-14T16:20:01.9645103Z [cluster1] "ceIPSecPSK": {
2021-07-14T16:20:01.9645603Z [cluster1] "type": "string"
2021-07-14T16:20:01.9646028Z [cluster1] },
2021-07-14T16:20:01.9646604Z [cluster1] "ceIPSecPreferredServer": {
2021-07-14T16:20:01.9647235Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9647666Z [cluster1] },
2021-07-14T16:20:01.9648312Z [cluster1] "clusterCIDR": {
2021-07-14T16:20:01.9648803Z [cluster1] "type": "string"
2021-07-14T16:20:01.9649241Z [cluster1] },
2021-07-14T16:20:01.9649752Z [cluster1] "clusterID": {
2021-07-14T16:20:01.9650239Z [cluster1] "type": "string"
2021-07-14T16:20:01.9650667Z [cluster1] },
2021-07-14T16:20:01.9651117Z [cluster1] "colorCodes": {
2021-07-14T16:20:01.9651606Z [cluster1] "type": "string"
2021-07-14T16:20:01.9652030Z [cluster1] },
2021-07-14T16:20:01.9654388Z [cluster1] "connectionHealthCheck": {
2021-07-14T16:20:01.9655076Z [cluster1] "properties": {
2021-07-14T16:20:01.9657024Z [cluster1] "enabled": {
2021-07-14T16:20:01.9657515Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9657976Z [cluster1] },
2021-07-14T16:20:01.9658458Z [cluster1] "intervalSeconds": {
2021-07-14T16:20:01.9659178Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-14T16:20:01.9659842Z [cluster1] "format": "int64",
2021-07-14T16:20:01.9660327Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9660784Z [cluster1] },
2021-07-14T16:20:01.9661299Z [cluster1] "maxPacketLossCount": {
2021-07-14T16:20:01.9662338Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-14T16:20:01.9663132Z [cluster1] "format": "int64",
2021-07-14T16:20:01.9663704Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9664167Z [cluster1] }
2021-07-14T16:20:01.9664575Z [cluster1] },
2021-07-14T16:20:01.9665022Z [cluster1] "type": "object"
2021-07-14T16:20:01.9665447Z [cluster1] },
2021-07-14T16:20:01.9665981Z [cluster1] "coreDNSCustomConfig": {
2021-07-14T16:20:01.9666570Z [cluster1] "properties": {
2021-07-14T16:20:01.9667100Z [cluster1] "configMapName": {
2021-07-14T16:20:01.9667622Z [cluster1] "type": "string"
2021-07-14T16:20:01.9668066Z [cluster1] },
2021-07-14T16:20:01.9668521Z [cluster1] "namespace": {
2021-07-14T16:20:01.9669002Z [cluster1] "type": "string"
2021-07-14T16:20:01.9669447Z [cluster1] }
2021-07-14T16:20:01.9669924Z [cluster1] },
2021-07-14T16:20:01.9670360Z [cluster1] "type": "object"
2021-07-14T16:20:01.9670795Z [cluster1] },
2021-07-14T16:20:01.9671252Z [cluster1] "customDomains": {
2021-07-14T16:20:01.9671743Z [cluster1] "items": {
2021-07-14T16:20:01.9672201Z [cluster1] "type": "string"
2021-07-14T16:20:01.9672642Z [cluster1] },
2021-07-14T16:20:01.9673074Z [cluster1] "type": "array",
2021-07-14T16:20:01.9674156Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-14T16:20:01.9674721Z [cluster1] },
2021-07-14T16:20:01.9675128Z [cluster1] "debug": {
2021-07-14T16:20:01.9675604Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9676039Z [cluster1] },
2021-07-14T16:20:01.9692195Z [cluster1] "globalCIDR": {
2021-07-14T16:20:01.9692695Z [cluster1] "type": "string"
2021-07-14T16:20:01.9693145Z [cluster1] },
2021-07-14T16:20:01.9693633Z [cluster1] "imageOverrides": {
2021-07-14T16:20:01.9694270Z [cluster1] "additionalProperties": {
2021-07-14T16:20:01.9695097Z [cluster1] "type": "string"
2021-07-14T16:20:01.9695532Z [cluster1] },
2021-07-14T16:20:01.9695990Z [cluster1] "type": "object"
2021-07-14T16:20:01.9696422Z [cluster1] },
2021-07-14T16:20:01.9696958Z [cluster1] "loadBalancerEnabled": {
2021-07-14T16:20:01.9697530Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9697981Z [cluster1] },
2021-07-14T16:20:01.9698429Z [cluster1] "namespace": {
2021-07-14T16:20:01.9698900Z [cluster1] "type": "string"
2021-07-14T16:20:01.9699337Z [cluster1] },
2021-07-14T16:20:01.9699911Z [cluster1] "natEnabled": {
2021-07-14T16:20:01.9700430Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9700868Z [cluster1] },
2021-07-14T16:20:01.9701318Z [cluster1] "repository": {
2021-07-14T16:20:01.9701801Z [cluster1] "type": "string"
2021-07-14T16:20:01.9702243Z [cluster1] },
2021-07-14T16:20:01.9702709Z [cluster1] "serviceCIDR": {
2021-07-14T16:20:01.9703198Z [cluster1] "type": "string"
2021-07-14T16:20:01.9703969Z [cluster1] },
2021-07-14T16:20:01.9704722Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-14T16:20:01.9705485Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9705933Z [cluster1] },
2021-07-14T16:20:01.9706370Z [cluster1] "version": {
2021-07-14T16:20:01.9706835Z [cluster1] "type": "string"
2021-07-14T16:20:01.9707271Z [cluster1] }
2021-07-14T16:20:01.9707674Z [cluster1] },
2021-07-14T16:20:01.9708094Z [cluster1] "required": [
2021-07-14T16:20:01.9708650Z [cluster1] "broker",
2021-07-14T16:20:01.9709457Z [cluster1] "brokerK8sApiServer",
2021-07-14T16:20:01.9710135Z [cluster1] "brokerK8sApiServerToken",
2021-07-14T16:20:01.9710742Z [cluster1] "brokerK8sCA",
2021-07-14T16:20:01.9711364Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-14T16:20:01.9712005Z [cluster1] "ceIPSecDebug",
2021-07-14T16:20:01.9712757Z [cluster1] "ceIPSecPSK",
2021-07-14T16:20:01.9713401Z [cluster1] "clusterCIDR",
2021-07-14T16:20:01.9721357Z [cluster1] "clusterID",
2021-07-14T16:20:01.9721838Z [cluster1] "debug",
2021-07-14T16:20:01.9722291Z [cluster1] "namespace",
2021-07-14T16:20:01.9722799Z [cluster1] "natEnabled",
2021-07-14T16:20:01.9723290Z [cluster1] "serviceCIDR"
2021-07-14T16:20:01.9723743Z [cluster1] ],
2021-07-14T16:20:01.9724170Z [cluster1] "type": "object"
2021-07-14T16:20:01.9724602Z [cluster1] },
2021-07-14T16:20:01.9725343Z [cluster1] "status": {
2021-07-14T16:20:01.9726188Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-14T16:20:01.9727237Z [cluster1] "properties": {
2021-07-14T16:20:01.9728539Z [cluster1] "clusterCIDR": {
2021-07-14T16:20:01.9729190Z [cluster1] "type": "string"
2021-07-14T16:20:01.9729744Z [cluster1] },
2021-07-14T16:20:01.9730214Z [cluster1] "clusterID": {
2021-07-14T16:20:01.9730835Z [cluster1] "type": "string"
2021-07-14T16:20:01.9731421Z [cluster1] },
2021-07-14T16:20:01.9731876Z [cluster1] "colorCodes": {
2021-07-14T16:20:01.9732491Z [cluster1] "type": "string"
2021-07-14T16:20:01.9733119Z [cluster1] },
2021-07-14T16:20:01.9733900Z [cluster1] "deploymentInfo": {
2021-07-14T16:20:01.9734594Z [cluster1] "properties": {
2021-07-14T16:20:01.9735397Z [cluster1] "cloudProvider": {
2021-07-14T16:20:01.9736123Z [cluster1] "type": "string"
2021-07-14T16:20:01.9736595Z [cluster1] },
2021-07-14T16:20:01.9746059Z [cluster1] "kubernetesType": {
2021-07-14T16:20:01.9746831Z [cluster1] "type": "string"
2021-07-14T16:20:01.9747464Z [cluster1] },
2021-07-14T16:20:01.9748231Z [cluster1] "kubernetesTypeVersion": {
2021-07-14T16:20:01.9749029Z [cluster1] "type": "string"
2021-07-14T16:20:01.9749503Z [cluster1] },
2021-07-14T16:20:01.9750225Z [cluster1] "kubernetesVersion": {
2021-07-14T16:20:01.9750979Z [cluster1] "type": "string"
2021-07-14T16:20:01.9751623Z [cluster1] }
2021-07-14T16:20:01.9752197Z [cluster1] },
2021-07-14T16:20:01.9752664Z [cluster1] "type": "object"
2021-07-14T16:20:01.9753453Z [cluster1] },
2021-07-14T16:20:01.9754218Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-14T16:20:01.9755513Z [cluster1] "properties": {
2021-07-14T16:20:01.9756754Z [cluster1] "lastResourceVersion": {
2021-07-14T16:20:01.9757538Z [cluster1] "type": "string"
2021-07-14T16:20:01.9758131Z [cluster1] },
2021-07-14T16:20:01.9758864Z [cluster1] "mismatchedContainerImages": {
2021-07-14T16:20:01.9759639Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9760230Z [cluster1] },
2021-07-14T16:20:01.9761165Z [cluster1] "nonReadyContainerStates": {
2021-07-14T16:20:01.9762011Z [cluster1] "items": {
2021-07-14T16:20:01.9763609Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:01.9764885Z [cluster1] "properties": {
2021-07-14T16:20:01.9765530Z [cluster1] "running": {
2021-07-14T16:20:01.9766304Z [cluster1] "description": "Details about a running container",
2021-07-14T16:20:01.9767069Z [cluster1] "properties": {
2021-07-14T16:20:01.9767717Z [cluster1] "startedAt": {
2021-07-14T16:20:01.9777165Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:01.9778231Z [cluster1] "format": "date-time",
2021-07-14T16:20:01.9778783Z [cluster1] "type": "string"
2021-07-14T16:20:01.9779249Z [cluster1] }
2021-07-14T16:20:01.9779896Z [cluster1] },
2021-07-14T16:20:01.9780368Z [cluster1] "type": "object"
2021-07-14T16:20:01.9780865Z [cluster1] },
2021-07-14T16:20:01.9781343Z [cluster1] "terminated": {
2021-07-14T16:20:01.9781995Z [cluster1] "description": "Details about a terminated container",
2021-07-14T16:20:01.9782669Z [cluster1] "properties": {
2021-07-14T16:20:01.9783202Z [cluster1] "containerID": {
2021-07-14T16:20:01.9784561Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:01.9785479Z [cluster1] "type": "string"
2021-07-14T16:20:01.9785957Z [cluster1] },
2021-07-14T16:20:01.9786443Z [cluster1] "exitCode": {
2021-07-14T16:20:01.9787142Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:01.9787940Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9788467Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9788941Z [cluster1] },
2021-07-14T16:20:01.9789436Z [cluster1] "finishedAt": {
2021-07-14T16:20:01.9790112Z [cluster1] "description": "Time at which the container last terminated",
2021-07-14T16:20:01.9791031Z [cluster1] "format": "date-time",
2021-07-14T16:20:01.9791570Z [cluster1] "type": "string"
2021-07-14T16:20:01.9792034Z [cluster1] },
2021-07-14T16:20:01.9792500Z [cluster1] "message": {
2021-07-14T16:20:01.9793203Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:01.9793924Z [cluster1] "type": "string"
2021-07-14T16:20:01.9794399Z [cluster1] },
2021-07-14T16:20:01.9794850Z [cluster1] "reason": {
2021-07-14T16:20:01.9796410Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:01.9797105Z [cluster1] "type": "string"
2021-07-14T16:20:01.9797915Z [cluster1] },
2021-07-14T16:20:01.9798397Z [cluster1] "signal": {
2021-07-14T16:20:01.9799207Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-14T16:20:01.9799892Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9800490Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9800986Z [cluster1] },
2021-07-14T16:20:01.9801462Z [cluster1] "startedAt": {
2021-07-14T16:20:01.9802199Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:01.9803217Z [cluster1] "format": "date-time",
2021-07-14T16:20:01.9803756Z [cluster1] "type": "string"
2021-07-14T16:20:01.9804249Z [cluster1] }
2021-07-14T16:20:01.9804684Z [cluster1] },
2021-07-14T16:20:01.9805167Z [cluster1] "required": [
2021-07-14T16:20:01.9805686Z [cluster1] "exitCode"
2021-07-14T16:20:01.9806143Z [cluster1] ],
2021-07-14T16:20:01.9806621Z [cluster1] "type": "object"
2021-07-14T16:20:01.9807078Z [cluster1] },
2021-07-14T16:20:01.9807534Z [cluster1] "waiting": {
2021-07-14T16:20:01.9808399Z [cluster1] "description": "Details about a waiting container",
2021-07-14T16:20:01.9809047Z [cluster1] "properties": {
2021-07-14T16:20:01.9809566Z [cluster1] "message": {
2021-07-14T16:20:01.9810269Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:01.9810968Z [cluster1] "type": "string"
2021-07-14T16:20:01.9822887Z [cluster1] },
2021-07-14T16:20:01.9823511Z [cluster1] "reason": {
2021-07-14T16:20:01.9824188Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:01.9824860Z [cluster1] "type": "string"
2021-07-14T16:20:01.9825337Z [cluster1] }
2021-07-14T16:20:01.9825767Z [cluster1] },
2021-07-14T16:20:01.9826253Z [cluster1] "type": "object"
2021-07-14T16:20:01.9826714Z [cluster1] }
2021-07-14T16:20:01.9827140Z [cluster1] },
2021-07-14T16:20:01.9827822Z [cluster1] "type": "object"
2021-07-14T16:20:01.9828267Z [cluster1] },
2021-07-14T16:20:01.9828722Z [cluster1] "type": "array"
2021-07-14T16:20:01.9829164Z [cluster1] },
2021-07-14T16:20:01.9829598Z [cluster1] "status": {
2021-07-14T16:20:01.9830320Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:01.9831071Z [cluster1] "properties": {
2021-07-14T16:20:01.9831775Z [cluster1] "collisionCount": {
2021-07-14T16:20:01.9832980Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:01.9834147Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9835490Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9836115Z [cluster1] },
2021-07-14T16:20:01.9836590Z [cluster1] "conditions": {
2021-07-14T16:20:01.9838104Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:01.9839040Z [cluster1] "items": {
2021-07-14T16:20:01.9839849Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:01.9840875Z [cluster1] "properties": {
2021-07-14T16:20:01.9841609Z [cluster1] "lastTransitionTime": {
2021-07-14T16:20:01.9842531Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:01.9843531Z [cluster1] "format": "date-time",
2021-07-14T16:20:01.9844078Z [cluster1] "type": "string"
2021-07-14T16:20:01.9844907Z [cluster1] },
2021-07-14T16:20:01.9845637Z [cluster1] "message": {
2021-07-14T16:20:01.9846962Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:01.9848174Z [cluster1] "type": "string"
2021-07-14T16:20:01.9848808Z [cluster1] },
2021-07-14T16:20:01.9849414Z [cluster1] "reason": {
2021-07-14T16:20:01.9850550Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:01.9851791Z [cluster1] "type": "string"
2021-07-14T16:20:01.9852287Z [cluster1] },
2021-07-14T16:20:01.9852753Z [cluster1] "status": {
2021-07-14T16:20:01.9853613Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:01.9854574Z [cluster1] "type": "string"
2021-07-14T16:20:01.9855432Z [cluster1] },
2021-07-14T16:20:01.9856040Z [cluster1] "type": {
2021-07-14T16:20:01.9856655Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:01.9857289Z [cluster1] "type": "string"
2021-07-14T16:20:01.9858169Z [cluster1] }
2021-07-14T16:20:01.9858599Z [cluster1] },
2021-07-14T16:20:01.9859073Z [cluster1] "required": [
2021-07-14T16:20:01.9859557Z [cluster1] "status",
2021-07-14T16:20:01.9860029Z [cluster1] "type"
2021-07-14T16:20:01.9860472Z [cluster1] ],
2021-07-14T16:20:01.9860961Z [cluster1] "type": "object"
2021-07-14T16:20:01.9861426Z [cluster1] },
2021-07-14T16:20:01.9862373Z [cluster1] "type": "array"
2021-07-14T16:20:01.9862838Z [cluster1] },
2021-07-14T16:20:01.9863406Z [cluster1] "currentNumberScheduled": {
2021-07-14T16:20:01.9865516Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.9867026Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9867635Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9868291Z [cluster1] },
2021-07-14T16:20:01.9868878Z [cluster1] "desiredNumberScheduled": {
2021-07-14T16:20:01.9870221Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.9872237Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9872897Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9873357Z [cluster1] },
2021-07-14T16:20:01.9873875Z [cluster1] "numberAvailable": {
2021-07-14T16:20:01.9875269Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.9876312Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9876827Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9877481Z [cluster1] },
2021-07-14T16:20:01.9878027Z [cluster1] "numberMisscheduled": {
2021-07-14T16:20:01.9879208Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:01.9880325Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9880844Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9881565Z [cluster1] },
2021-07-14T16:20:01.9882186Z [cluster1] "numberReady": {
2021-07-14T16:20:01.9883123Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:01.9883960Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9884460Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9884929Z [cluster1] },
2021-07-14T16:20:01.9886327Z [cluster1] "numberUnavailable": {
2021-07-14T16:20:01.9887409Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:01.9888615Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9889114Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9889586Z [cluster1] },
2021-07-14T16:20:01.9890133Z [cluster1] "observedGeneration": {
2021-07-14T16:20:01.9890948Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:01.9891775Z [cluster1] "format": "int64",
2021-07-14T16:20:01.9892273Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9892740Z [cluster1] },
2021-07-14T16:20:01.9893324Z [cluster1] "updatedNumberScheduled": {
2021-07-14T16:20:01.9894145Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:01.9894835Z [cluster1] "format": "int32",
2021-07-14T16:20:01.9895336Z [cluster1] "type": "integer"
2021-07-14T16:20:01.9895809Z [cluster1] }
2021-07-14T16:20:01.9896216Z [cluster1] },
2021-07-14T16:20:01.9896678Z [cluster1] "required": [
2021-07-14T16:20:01.9897294Z [cluster1] "currentNumberScheduled",
2021-07-14T16:20:01.9898014Z [cluster1] "desiredNumberScheduled",
2021-07-14T16:20:01.9898702Z [cluster1] "numberMisscheduled",
2021-07-14T16:20:01.9899274Z [cluster1] "numberReady"
2021-07-14T16:20:01.9899972Z [cluster1] ],
2021-07-14T16:20:01.9900414Z [cluster1] "type": "object"
2021-07-14T16:20:01.9900868Z [cluster1] }
2021-07-14T16:20:01.9901280Z [cluster1] },
2021-07-14T16:20:01.9901713Z [cluster1] "required": [
2021-07-14T16:20:01.9902358Z [cluster1] "mismatchedContainerImages"
2021-07-14T16:20:01.9902947Z [cluster1] ],
2021-07-14T16:20:01.9903401Z [cluster1] "type": "object"
2021-07-14T16:20:01.9904393Z [cluster1] },
2021-07-14T16:20:01.9905081Z [cluster1] "gateways": {
2021-07-14T16:20:01.9905839Z [cluster1] "items": {
2021-07-14T16:20:01.9906348Z [cluster1] "properties": {
2021-07-14T16:20:01.9906881Z [cluster1] "connections": {
2021-07-14T16:20:01.9907364Z [cluster1] "items": {
2021-07-14T16:20:01.9907866Z [cluster1] "properties": {
2021-07-14T16:20:01.9908383Z [cluster1] "endpoint": {
2021-07-14T16:20:01.9908910Z [cluster1] "properties": {
2021-07-14T16:20:01.9909424Z [cluster1] "backend": {
2021-07-14T16:20:01.9909934Z [cluster1] "type": "string"
2021-07-14T16:20:01.9910419Z [cluster1] },
2021-07-14T16:20:01.9910902Z [cluster1] "backend_config": {
2021-07-14T16:20:01.9911537Z [cluster1] "additionalProperties": {
2021-07-14T16:20:01.9912153Z [cluster1] "type": "string"
2021-07-14T16:20:01.9912640Z [cluster1] },
2021-07-14T16:20:01.9913241Z [cluster1] "type": "object"
2021-07-14T16:20:01.9913705Z [cluster1] },
2021-07-14T16:20:01.9914184Z [cluster1] "cable_name": {
2021-07-14T16:20:01.9914689Z [cluster1] "type": "string"
2021-07-14T16:20:01.9915170Z [cluster1] },
2021-07-14T16:20:01.9915704Z [cluster1] "cluster_id": {
2021-07-14T16:20:01.9916228Z [cluster1] "type": "string"
2021-07-14T16:20:01.9916709Z [cluster1] },
2021-07-14T16:20:01.9917218Z [cluster1] "healthCheckIP": {
2021-07-14T16:20:01.9917783Z [cluster1] "type": "string"
2021-07-14T16:20:01.9918246Z [cluster1] },
2021-07-14T16:20:01.9918724Z [cluster1] "hostname": {
2021-07-14T16:20:01.9919245Z [cluster1] "type": "string"
2021-07-14T16:20:01.9919709Z [cluster1] },
2021-07-14T16:20:01.9920197Z [cluster1] "nat_enabled": {
2021-07-14T16:20:01.9920716Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9921200Z [cluster1] },
2021-07-14T16:20:01.9921660Z [cluster1] "private_ip": {
2021-07-14T16:20:01.9922187Z [cluster1] "type": "string"
2021-07-14T16:20:01.9922671Z [cluster1] },
2021-07-14T16:20:01.9923186Z [cluster1] "public_ip": {
2021-07-14T16:20:01.9923712Z [cluster1] "type": "string"
2021-07-14T16:20:01.9924174Z [cluster1] },
2021-07-14T16:20:01.9924645Z [cluster1] "subnets": {
2021-07-14T16:20:01.9925136Z [cluster1] "items": {
2021-07-14T16:20:01.9925935Z [cluster1] "type": "string"
2021-07-14T16:20:01.9926421Z [cluster1] },
2021-07-14T16:20:01.9926892Z [cluster1] "type": "array"
2021-07-14T16:20:01.9927371Z [cluster1] }
2021-07-14T16:20:01.9928304Z [cluster1] },
2021-07-14T16:20:01.9928791Z [cluster1] "required": [
2021-07-14T16:20:01.9929305Z [cluster1] "backend",
2021-07-14T16:20:01.9929786Z [cluster1] "cable_name",
2021-07-14T16:20:01.9930289Z [cluster1] "cluster_id",
2021-07-14T16:20:01.9930874Z [cluster1] "hostname",
2021-07-14T16:20:01.9931382Z [cluster1] "nat_enabled",
2021-07-14T16:20:01.9933214Z [cluster1] "private_ip",
2021-07-14T16:20:01.9933880Z [cluster1] "public_ip",
2021-07-14T16:20:01.9934385Z [cluster1] "subnets"
2021-07-14T16:20:01.9934835Z [cluster1] ],
2021-07-14T16:20:01.9935312Z [cluster1] "type": "object"
2021-07-14T16:20:01.9935770Z [cluster1] },
2021-07-14T16:20:01.9936438Z [cluster1] "latencyRTT": {
2021-07-14T16:20:01.9937359Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-14T16:20:01.9938243Z [cluster1] "properties": {
2021-07-14T16:20:01.9938773Z [cluster1] "average": {
2021-07-14T16:20:01.9939273Z [cluster1] "type": "string"
2021-07-14T16:20:01.9939756Z [cluster1] },
2021-07-14T16:20:01.9940209Z [cluster1] "last": {
2021-07-14T16:20:01.9940698Z [cluster1] "type": "string"
2021-07-14T16:20:01.9941182Z [cluster1] },
2021-07-14T16:20:01.9954232Z [cluster1] "max": {
2021-07-14T16:20:01.9954873Z [cluster1] "type": "string"
2021-07-14T16:20:01.9955352Z [cluster1] },
2021-07-14T16:20:01.9955996Z [cluster1] "min": {
2021-07-14T16:20:01.9956505Z [cluster1] "type": "string"
2021-07-14T16:20:01.9956976Z [cluster1] },
2021-07-14T16:20:01.9957452Z [cluster1] "stdDev": {
2021-07-14T16:20:01.9957948Z [cluster1] "type": "string"
2021-07-14T16:20:01.9958625Z [cluster1] }
2021-07-14T16:20:01.9959060Z [cluster1] },
2021-07-14T16:20:01.9959821Z [cluster1] "type": "object"
2021-07-14T16:20:01.9960312Z [cluster1] },
2021-07-14T16:20:01.9960754Z [cluster1] "status": {
2021-07-14T16:20:01.9961256Z [cluster1] "type": "string"
2021-07-14T16:20:01.9961715Z [cluster1] },
2021-07-14T16:20:01.9962571Z [cluster1] "statusMessage": {
2021-07-14T16:20:01.9963114Z [cluster1] "type": "string"
2021-07-14T16:20:01.9963943Z [cluster1] },
2021-07-14T16:20:01.9964756Z [cluster1] "usingIP": {
2021-07-14T16:20:01.9965558Z [cluster1] "type": "string"
2021-07-14T16:20:01.9966047Z [cluster1] },
2021-07-14T16:20:01.9966658Z [cluster1] "usingNAT": {
2021-07-14T16:20:01.9967189Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9967670Z [cluster1] }
2021-07-14T16:20:01.9968189Z [cluster1] },
2021-07-14T16:20:01.9968664Z [cluster1] "required": [
2021-07-14T16:20:01.9969170Z [cluster1] "endpoint",
2021-07-14T16:20:01.9969672Z [cluster1] "status",
2021-07-14T16:20:01.9970182Z [cluster1] "statusMessage"
2021-07-14T16:20:01.9970992Z [cluster1] ],
2021-07-14T16:20:01.9971620Z [cluster1] "type": "object"
2021-07-14T16:20:01.9972089Z [cluster1] },
2021-07-14T16:20:01.9972553Z [cluster1] "type": "array"
2021-07-14T16:20:01.9973159Z [cluster1] },
2021-07-14T16:20:01.9973623Z [cluster1] "haStatus": {
2021-07-14T16:20:01.9974122Z [cluster1] "type": "string"
2021-07-14T16:20:01.9974584Z [cluster1] },
2021-07-14T16:20:01.9975066Z [cluster1] "localEndpoint": {
2021-07-14T16:20:01.9975617Z [cluster1] "properties": {
2021-07-14T16:20:01.9976125Z [cluster1] "backend": {
2021-07-14T16:20:01.9976715Z [cluster1] "type": "string"
2021-07-14T16:20:01.9977217Z [cluster1] },
2021-07-14T16:20:01.9977685Z [cluster1] "backend_config": {
2021-07-14T16:20:01.9978600Z [cluster1] "additionalProperties": {
2021-07-14T16:20:01.9979204Z [cluster1] "type": "string"
2021-07-14T16:20:01.9979678Z [cluster1] },
2021-07-14T16:20:01.9980152Z [cluster1] "type": "object"
2021-07-14T16:20:01.9980638Z [cluster1] },
2021-07-14T16:20:01.9981105Z [cluster1] "cable_name": {
2021-07-14T16:20:01.9981601Z [cluster1] "type": "string"
2021-07-14T16:20:01.9982065Z [cluster1] },
2021-07-14T16:20:01.9982532Z [cluster1] "cluster_id": {
2021-07-14T16:20:01.9983058Z [cluster1] "type": "string"
2021-07-14T16:20:01.9983906Z [cluster1] },
2021-07-14T16:20:01.9984652Z [cluster1] "healthCheckIP": {
2021-07-14T16:20:01.9985207Z [cluster1] "type": "string"
2021-07-14T16:20:01.9985656Z [cluster1] },
2021-07-14T16:20:01.9986120Z [cluster1] "hostname": {
2021-07-14T16:20:01.9986631Z [cluster1] "type": "string"
2021-07-14T16:20:01.9987084Z [cluster1] },
2021-07-14T16:20:01.9987553Z [cluster1] "nat_enabled": {
2021-07-14T16:20:01.9988052Z [cluster1] "type": "boolean"
2021-07-14T16:20:01.9988528Z [cluster1] },
2021-07-14T16:20:01.9988984Z [cluster1] "private_ip": {
2021-07-14T16:20:01.9989498Z [cluster1] "type": "string"
2021-07-14T16:20:01.9990300Z [cluster1] },
2021-07-14T16:20:01.9990914Z [cluster1] "public_ip": {
2021-07-14T16:20:01.9991418Z [cluster1] "type": "string"
2021-07-14T16:20:01.9991881Z [cluster1] },
2021-07-14T16:20:01.9992341Z [cluster1] "subnets": {
2021-07-14T16:20:01.9992812Z [cluster1] "items": {
2021-07-14T16:20:01.9993306Z [cluster1] "type": "string"
2021-07-14T16:20:01.9993777Z [cluster1] },
2021-07-14T16:20:01.9994229Z [cluster1] "type": "array"
2021-07-14T16:20:01.9994692Z [cluster1] }
2021-07-14T16:20:01.9995808Z [cluster1] },
2021-07-14T16:20:01.9996292Z [cluster1] "required": [
2021-07-14T16:20:01.9996889Z [cluster1] "backend",
2021-07-14T16:20:01.9997814Z [cluster1] "cable_name",
2021-07-14T16:20:01.9998698Z [cluster1] "cluster_id",
2021-07-14T16:20:01.9999335Z [cluster1] "hostname",
2021-07-14T16:20:01.9999840Z [cluster1] "nat_enabled",
2021-07-14T16:20:02.0000692Z [cluster1] "private_ip",
2021-07-14T16:20:02.0001205Z [cluster1] "public_ip",
2021-07-14T16:20:02.0001826Z [cluster1] "subnets"
2021-07-14T16:20:02.0002423Z [cluster1] ],
2021-07-14T16:20:02.0003022Z [cluster1] "type": "object"
2021-07-14T16:20:02.0003490Z [cluster1] },
2021-07-14T16:20:02.0004120Z [cluster1] "statusFailure": {
2021-07-14T16:20:02.0004767Z [cluster1] "type": "string"
2021-07-14T16:20:02.0005352Z [cluster1] },
2021-07-14T16:20:02.0005792Z [cluster1] "version": {
2021-07-14T16:20:02.0006531Z [cluster1] "type": "string"
2021-07-14T16:20:02.0007103Z [cluster1] }
2021-07-14T16:20:02.0007626Z [cluster1] },
2021-07-14T16:20:02.0008343Z [cluster1] "required": [
2021-07-14T16:20:02.0009128Z [cluster1] "connections",
2021-07-14T16:20:02.0009855Z [cluster1] "haStatus",
2021-07-14T16:20:02.0010504Z [cluster1] "localEndpoint",
2021-07-14T16:20:02.0011178Z [cluster1] "statusFailure",
2021-07-14T16:20:02.0011685Z [cluster1] "version"
2021-07-14T16:20:02.0012254Z [cluster1] ],
2021-07-14T16:20:02.0012846Z [cluster1] "type": "object"
2021-07-14T16:20:02.0013289Z [cluster1] },
2021-07-14T16:20:02.0013860Z [cluster1] "type": "array"
2021-07-14T16:20:02.0014409Z [cluster1] },
2021-07-14T16:20:02.0014990Z [cluster1] "globalCIDR": {
2021-07-14T16:20:02.0015490Z [cluster1] "type": "string"
2021-07-14T16:20:02.0016064Z [cluster1] },
2021-07-14T16:20:02.0016762Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-14T16:20:02.0017551Z [cluster1] "properties": {
2021-07-14T16:20:02.0018278Z [cluster1] "lastResourceVersion": {
2021-07-14T16:20:02.0018981Z [cluster1] "type": "string"
2021-07-14T16:20:02.0019443Z [cluster1] },
2021-07-14T16:20:02.0020175Z [cluster1] "mismatchedContainerImages": {
2021-07-14T16:20:02.0020965Z [cluster1] "type": "boolean"
2021-07-14T16:20:02.0021533Z [cluster1] },
2021-07-14T16:20:02.0022243Z [cluster1] "nonReadyContainerStates": {
2021-07-14T16:20:02.0023094Z [cluster1] "items": {
2021-07-14T16:20:02.0024694Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:02.0026343Z [cluster1] "properties": {
2021-07-14T16:20:02.0026982Z [cluster1] "running": {
2021-07-14T16:20:02.0027745Z [cluster1] "description": "Details about a running container",
2021-07-14T16:20:02.0028519Z [cluster1] "properties": {
2021-07-14T16:20:02.0029155Z [cluster1] "startedAt": {
2021-07-14T16:20:02.0030786Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:02.0031964Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0032656Z [cluster1] "type": "string"
2021-07-14T16:20:02.0033524Z [cluster1] }
2021-07-14T16:20:02.0034170Z [cluster1] },
2021-07-14T16:20:02.0034772Z [cluster1] "type": "object"
2021-07-14T16:20:02.0035361Z [cluster1] },
2021-07-14T16:20:02.0035853Z [cluster1] "terminated": {
2021-07-14T16:20:02.0040223Z [cluster1] "description": "Details about a terminated container",
2021-07-14T16:20:02.0041115Z [cluster1] "properties": {
2021-07-14T16:20:02.0041677Z [cluster1] "containerID": {
2021-07-14T16:20:02.0058888Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:02.0059634Z [cluster1] "type": "string"
2021-07-14T16:20:02.0060125Z [cluster1] },
2021-07-14T16:20:02.0060607Z [cluster1] "exitCode": {
2021-07-14T16:20:02.0061319Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:02.0062004Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0062567Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0063067Z [cluster1] },
2021-07-14T16:20:02.0063560Z [cluster1] "finishedAt": {
2021-07-14T16:20:02.0064243Z [cluster1] "description": "Time at which the container last terminated",
2021-07-14T16:20:02.0065298Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0065845Z [cluster1] "type": "string"
2021-07-14T16:20:02.0066367Z [cluster1] },
2021-07-14T16:20:02.0067075Z [cluster1] "message": {
2021-07-14T16:20:02.0067785Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:02.0068503Z [cluster1] "type": "string"
2021-07-14T16:20:02.0068982Z [cluster1] },
2021-07-14T16:20:02.0069428Z [cluster1] "reason": {
2021-07-14T16:20:02.0070134Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:02.0070822Z [cluster1] "type": "string"
2021-07-14T16:20:02.0071677Z [cluster1] },
2021-07-14T16:20:02.0072144Z [cluster1] "signal": {
2021-07-14T16:20:02.0072831Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-14T16:20:02.0073511Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0074025Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0080830Z [cluster1] },
2021-07-14T16:20:02.0081304Z [cluster1] "startedAt": {
2021-07-14T16:20:02.0082034Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:02.0083152Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0083694Z [cluster1] "type": "string"
2021-07-14T16:20:02.0084175Z [cluster1] }
2021-07-14T16:20:02.0084598Z [cluster1] },
2021-07-14T16:20:02.0085073Z [cluster1] "required": [
2021-07-14T16:20:02.0085591Z [cluster1] "exitCode"
2021-07-14T16:20:02.0086050Z [cluster1] ],
2021-07-14T16:20:02.0086534Z [cluster1] "type": "object"
2021-07-14T16:20:02.0086987Z [cluster1] },
2021-07-14T16:20:02.0087447Z [cluster1] "waiting": {
2021-07-14T16:20:02.0088300Z [cluster1] "description": "Details about a waiting container",
2021-07-14T16:20:02.0088953Z [cluster1] "properties": {
2021-07-14T16:20:02.0089481Z [cluster1] "message": {
2021-07-14T16:20:02.0090179Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:02.0090884Z [cluster1] "type": "string"
2021-07-14T16:20:02.0091742Z [cluster1] },
2021-07-14T16:20:02.0092201Z [cluster1] "reason": {
2021-07-14T16:20:02.0093274Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:02.0094097Z [cluster1] "type": "string"
2021-07-14T16:20:02.0094578Z [cluster1] }
2021-07-14T16:20:02.0095004Z [cluster1] },
2021-07-14T16:20:02.0095484Z [cluster1] "type": "object"
2021-07-14T16:20:02.0095947Z [cluster1] }
2021-07-14T16:20:02.0096377Z [cluster1] },
2021-07-14T16:20:02.0096850Z [cluster1] "type": "object"
2021-07-14T16:20:02.0097293Z [cluster1] },
2021-07-14T16:20:02.0097746Z [cluster1] "type": "array"
2021-07-14T16:20:02.0098188Z [cluster1] },
2021-07-14T16:20:02.0098620Z [cluster1] "status": {
2021-07-14T16:20:02.0099348Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:02.0100116Z [cluster1] "properties": {
2021-07-14T16:20:02.0100668Z [cluster1] "collisionCount": {
2021-07-14T16:20:02.0102663Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:02.0104179Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0104708Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0105184Z [cluster1] },
2021-07-14T16:20:02.0105660Z [cluster1] "conditions": {
2021-07-14T16:20:02.0106824Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:02.0107604Z [cluster1] "items": {
2021-07-14T16:20:02.0108702Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:02.0109682Z [cluster1] "properties": {
2021-07-14T16:20:02.0110288Z [cluster1] "lastTransitionTime": {
2021-07-14T16:20:02.0111115Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:02.0112110Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0112646Z [cluster1] "type": "string"
2021-07-14T16:20:02.0113127Z [cluster1] },
2021-07-14T16:20:02.0113611Z [cluster1] "message": {
2021-07-14T16:20:02.0114531Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:02.0115300Z [cluster1] "type": "string"
2021-07-14T16:20:02.0115848Z [cluster1] },
2021-07-14T16:20:02.0116313Z [cluster1] "reason": {
2021-07-14T16:20:02.0117244Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:02.0117910Z [cluster1] "type": "string"
2021-07-14T16:20:02.0118386Z [cluster1] },
2021-07-14T16:20:02.0118841Z [cluster1] "status": {
2021-07-14T16:20:02.0119517Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:02.0120189Z [cluster1] "type": "string"
2021-07-14T16:20:02.0120716Z [cluster1] },
2021-07-14T16:20:02.0121212Z [cluster1] "type": {
2021-07-14T16:20:02.0121912Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:02.0122542Z [cluster1] "type": "string"
2021-07-14T16:20:02.0123003Z [cluster1] }
2021-07-14T16:20:02.0123537Z [cluster1] },
2021-07-14T16:20:02.0124010Z [cluster1] "required": [
2021-07-14T16:20:02.0124491Z [cluster1] "status",
2021-07-14T16:20:02.0124969Z [cluster1] "type"
2021-07-14T16:20:02.0125403Z [cluster1] ],
2021-07-14T16:20:02.0125878Z [cluster1] "type": "object"
2021-07-14T16:20:02.0126340Z [cluster1] },
2021-07-14T16:20:02.0126802Z [cluster1] "type": "array"
2021-07-14T16:20:02.0127266Z [cluster1] },
2021-07-14T16:20:02.0127950Z [cluster1] "currentNumberScheduled": {
2021-07-14T16:20:02.0129221Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0133946Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0134696Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0135177Z [cluster1] },
2021-07-14T16:20:02.0135748Z [cluster1] "desiredNumberScheduled": {
2021-07-14T16:20:02.0137522Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0138972Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0139623Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0140110Z [cluster1] },
2021-07-14T16:20:02.0140886Z [cluster1] "numberAvailable": {
2021-07-14T16:20:02.0142247Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:02.0144374Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0144912Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0145593Z [cluster1] },
2021-07-14T16:20:02.0146315Z [cluster1] "numberMisscheduled": {
2021-07-14T16:20:02.0147921Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0149422Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0150438Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0151235Z [cluster1] },
2021-07-14T16:20:02.0152154Z [cluster1] "numberReady": {
2021-07-14T16:20:02.0153744Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:02.0154868Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0155685Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0156457Z [cluster1] },
2021-07-14T16:20:02.0157284Z [cluster1] "numberUnavailable": {
2021-07-14T16:20:02.0158963Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:02.0160330Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0160847Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0161303Z [cluster1] },
2021-07-14T16:20:02.0161838Z [cluster1] "observedGeneration": {
2021-07-14T16:20:02.0162699Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:02.0163421Z [cluster1] "format": "int64",
2021-07-14T16:20:02.0169429Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0169920Z [cluster1] },
2021-07-14T16:20:02.0170512Z [cluster1] "updatedNumberScheduled": {
2021-07-14T16:20:02.0171345Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:02.0172037Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0172566Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0173027Z [cluster1] }
2021-07-14T16:20:02.0173450Z [cluster1] },
2021-07-14T16:20:02.0174059Z [cluster1] "required": [
2021-07-14T16:20:02.0174688Z [cluster1] "currentNumberScheduled",
2021-07-14T16:20:02.0175415Z [cluster1] "desiredNumberScheduled",
2021-07-14T16:20:02.0176091Z [cluster1] "numberMisscheduled",
2021-07-14T16:20:02.0176682Z [cluster1] "numberReady"
2021-07-14T16:20:02.0177458Z [cluster1] ],
2021-07-14T16:20:02.0178056Z [cluster1] "type": "object"
2021-07-14T16:20:02.0178512Z [cluster1] }
2021-07-14T16:20:02.0179105Z [cluster1] },
2021-07-14T16:20:02.0179553Z [cluster1] "required": [
2021-07-14T16:20:02.0180183Z [cluster1] "mismatchedContainerImages"
2021-07-14T16:20:02.0180928Z [cluster1] ],
2021-07-14T16:20:02.0181376Z [cluster1] "type": "object"
2021-07-14T16:20:02.0181964Z [cluster1] },
2021-07-14T16:20:02.0182609Z [cluster1] "loadBalancerStatus": {
2021-07-14T16:20:02.0184213Z [cluster1] "properties": {
2021-07-14T16:20:02.0184833Z [cluster1] "status": {
2021-07-14T16:20:02.0186055Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-14T16:20:02.0186848Z [cluster1] "properties": {
2021-07-14T16:20:02.0187351Z [cluster1] "ingress": {
2021-07-14T16:20:02.0188621Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-14T16:20:02.0189561Z [cluster1] "items": {
2021-07-14T16:20:02.0191091Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-14T16:20:02.0192457Z [cluster1] "properties": {
2021-07-14T16:20:02.0193100Z [cluster1] "hostname": {
2021-07-14T16:20:02.0194432Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-14T16:20:02.0195713Z [cluster1] "type": "string"
2021-07-14T16:20:02.0196307Z [cluster1] },
2021-07-14T16:20:02.0196765Z [cluster1] "ip": {
2021-07-14T16:20:02.0199054Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-14T16:20:02.0200122Z [cluster1] "type": "string"
2021-07-14T16:20:02.0200719Z [cluster1] }
2021-07-14T16:20:02.0201282Z [cluster1] },
2021-07-14T16:20:02.0202003Z [cluster1] "type": "object"
2021-07-14T16:20:02.0203234Z [cluster1] },
2021-07-14T16:20:02.0203703Z [cluster1] "type": "array"
2021-07-14T16:20:02.0204150Z [cluster1] }
2021-07-14T16:20:02.0204573Z [cluster1] },
2021-07-14T16:20:02.0205299Z [cluster1] "type": "object"
2021-07-14T16:20:02.0206192Z [cluster1] }
2021-07-14T16:20:02.0206613Z [cluster1] },
2021-07-14T16:20:02.0207187Z [cluster1] "type": "object"
2021-07-14T16:20:02.0207637Z [cluster1] },
2021-07-14T16:20:02.0208202Z [cluster1] "natEnabled": {
2021-07-14T16:20:02.0208712Z [cluster1] "type": "boolean"
2021-07-14T16:20:02.0209145Z [cluster1] },
2021-07-14T16:20:02.0209626Z [cluster1] "networkPlugin": {
2021-07-14T16:20:02.0210132Z [cluster1] "type": "string"
2021-07-14T16:20:02.0210578Z [cluster1] },
2021-07-14T16:20:02.0211188Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-14T16:20:02.0211972Z [cluster1] "properties": {
2021-07-14T16:20:02.0212572Z [cluster1] "lastResourceVersion": {
2021-07-14T16:20:02.0213431Z [cluster1] "type": "string"
2021-07-14T16:20:02.0214212Z [cluster1] },
2021-07-14T16:20:02.0214956Z [cluster1] "mismatchedContainerImages": {
2021-07-14T16:20:02.0215885Z [cluster1] "type": "boolean"
2021-07-14T16:20:02.0216475Z [cluster1] },
2021-07-14T16:20:02.0220136Z [cluster1] "nonReadyContainerStates": {
2021-07-14T16:20:02.0220877Z [cluster1] "items": {
2021-07-14T16:20:02.0222004Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-14T16:20:02.0223153Z [cluster1] "properties": {
2021-07-14T16:20:02.0223659Z [cluster1] "running": {
2021-07-14T16:20:02.0224277Z [cluster1] "description": "Details about a running container",
2021-07-14T16:20:02.0224922Z [cluster1] "properties": {
2021-07-14T16:20:02.0225443Z [cluster1] "startedAt": {
2021-07-14T16:20:02.0226515Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-14T16:20:02.0227402Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0228201Z [cluster1] "type": "string"
2021-07-14T16:20:02.0228857Z [cluster1] }
2021-07-14T16:20:02.0229558Z [cluster1] },
2021-07-14T16:20:02.0230425Z [cluster1] "type": "object"
2021-07-14T16:20:02.0230911Z [cluster1] },
2021-07-14T16:20:02.0231391Z [cluster1] "terminated": {
2021-07-14T16:20:02.0232284Z [cluster1] "description": "Details about a terminated container",
2021-07-14T16:20:02.0233064Z [cluster1] "properties": {
2021-07-14T16:20:02.0233620Z [cluster1] "containerID": {
2021-07-14T16:20:02.0234648Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-14T16:20:02.0235362Z [cluster1] "type": "string"
2021-07-14T16:20:02.0235844Z [cluster1] },
2021-07-14T16:20:02.0236309Z [cluster1] "exitCode": {
2021-07-14T16:20:02.0237007Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-14T16:20:02.0237694Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0238220Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0238789Z [cluster1] },
2021-07-14T16:20:02.0239287Z [cluster1] "finishedAt": {
2021-07-14T16:20:02.0239968Z [cluster1] "description": "Time at which the container last terminated",
2021-07-14T16:20:02.0240849Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0241388Z [cluster1] "type": "string"
2021-07-14T16:20:02.0241849Z [cluster1] },
2021-07-14T16:20:02.0242319Z [cluster1] "message": {
2021-07-14T16:20:02.0243079Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-14T16:20:02.0243789Z [cluster1] "type": "string"
2021-07-14T16:20:02.0244270Z [cluster1] },
2021-07-14T16:20:02.0244723Z [cluster1] "reason": {
2021-07-14T16:20:02.0245425Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-14T16:20:02.0246125Z [cluster1] "type": "string"
2021-07-14T16:20:02.0246585Z [cluster1] },
2021-07-14T16:20:02.0247042Z [cluster1] "signal": {
2021-07-14T16:20:02.0247701Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-14T16:20:02.0248581Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0249095Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0249578Z [cluster1] },
2021-07-14T16:20:02.0250149Z [cluster1] "startedAt": {
2021-07-14T16:20:02.0250875Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-14T16:20:02.0251837Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0252367Z [cluster1] "type": "string"
2021-07-14T16:20:02.0252845Z [cluster1] }
2021-07-14T16:20:02.0253283Z [cluster1] },
2021-07-14T16:20:02.0253742Z [cluster1] "required": [
2021-07-14T16:20:02.0254261Z [cluster1] "exitCode"
2021-07-14T16:20:02.0254721Z [cluster1] ],
2021-07-14T16:20:02.0255197Z [cluster1] "type": "object"
2021-07-14T16:20:02.0255654Z [cluster1] },
2021-07-14T16:20:02.0256114Z [cluster1] "waiting": {
2021-07-14T16:20:02.0256746Z [cluster1] "description": "Details about a waiting container",
2021-07-14T16:20:02.0257453Z [cluster1] "properties": {
2021-07-14T16:20:02.0257966Z [cluster1] "message": {
2021-07-14T16:20:02.0258661Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-14T16:20:02.0259371Z [cluster1] "type": "string"
2021-07-14T16:20:02.0259847Z [cluster1] },
2021-07-14T16:20:02.0260295Z [cluster1] "reason": {
2021-07-14T16:20:02.0260956Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-14T16:20:02.0261607Z [cluster1] "type": "string"
2021-07-14T16:20:02.0262086Z [cluster1] }
2021-07-14T16:20:02.0262543Z [cluster1] },
2021-07-14T16:20:02.0263050Z [cluster1] "type": "object"
2021-07-14T16:20:02.0263524Z [cluster1] }
2021-07-14T16:20:02.0263977Z [cluster1] },
2021-07-14T16:20:02.0264442Z [cluster1] "type": "object"
2021-07-14T16:20:02.0264893Z [cluster1] },
2021-07-14T16:20:02.0265349Z [cluster1] "type": "array"
2021-07-14T16:20:02.0265784Z [cluster1] },
2021-07-14T16:20:02.0266222Z [cluster1] "status": {
2021-07-14T16:20:02.0267508Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-14T16:20:02.0268262Z [cluster1] "properties": {
2021-07-14T16:20:02.0269088Z [cluster1] "collisionCount": {
2021-07-14T16:20:02.0270515Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-14T16:20:02.0271663Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0272177Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0272637Z [cluster1] },
2021-07-14T16:20:02.0273113Z [cluster1] "conditions": {
2021-07-14T16:20:02.0274225Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-14T16:20:02.0275006Z [cluster1] "items": {
2021-07-14T16:20:02.0275812Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-14T16:20:02.0276615Z [cluster1] "properties": {
2021-07-14T16:20:02.0277217Z [cluster1] "lastTransitionTime": {
2021-07-14T16:20:02.0278083Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-14T16:20:02.0279111Z [cluster1] "format": "date-time",
2021-07-14T16:20:02.0279659Z [cluster1] "type": "string"
2021-07-14T16:20:02.0280124Z [cluster1] },
2021-07-14T16:20:02.0280597Z [cluster1] "message": {
2021-07-14T16:20:02.0281343Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-14T16:20:02.0282096Z [cluster1] "type": "string"
2021-07-14T16:20:02.0282562Z [cluster1] },
2021-07-14T16:20:02.0283028Z [cluster1] "reason": {
2021-07-14T16:20:02.0283932Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-14T16:20:02.0284587Z [cluster1] "type": "string"
2021-07-14T16:20:02.0285058Z [cluster1] },
2021-07-14T16:20:02.0285509Z [cluster1] "status": {
2021-07-14T16:20:02.0286189Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-14T16:20:02.0286879Z [cluster1] "type": "string"
2021-07-14T16:20:02.0287334Z [cluster1] },
2021-07-14T16:20:02.0288258Z [cluster1] "type": {
2021-07-14T16:20:02.0288872Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-14T16:20:02.0289828Z [cluster1] "type": "string"
2021-07-14T16:20:02.0290304Z [cluster1] }
2021-07-14T16:20:02.0290839Z [cluster1] },
2021-07-14T16:20:02.0291322Z [cluster1] "required": [
2021-07-14T16:20:02.0291805Z [cluster1] "status",
2021-07-14T16:20:02.0292277Z [cluster1] "type"
2021-07-14T16:20:02.0292716Z [cluster1] ],
2021-07-14T16:20:02.0293195Z [cluster1] "type": "object"
2021-07-14T16:20:02.0293661Z [cluster1] },
2021-07-14T16:20:02.0294113Z [cluster1] "type": "array"
2021-07-14T16:20:02.0294571Z [cluster1] },
2021-07-14T16:20:02.0295137Z [cluster1] "currentNumberScheduled": {
2021-07-14T16:20:02.0296405Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0297528Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0298734Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0299448Z [cluster1] },
2021-07-14T16:20:02.0300169Z [cluster1] "desiredNumberScheduled": {
2021-07-14T16:20:02.0301550Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0302758Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0303260Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0303732Z [cluster1] },
2021-07-14T16:20:02.0304230Z [cluster1] "numberAvailable": {
2021-07-14T16:20:02.0305759Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:02.0306811Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0307304Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0307785Z [cluster1] },
2021-07-14T16:20:02.0308315Z [cluster1] "numberMisscheduled": {
2021-07-14T16:20:02.0309522Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-14T16:20:02.0310817Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0311327Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0311798Z [cluster1] },
2021-07-14T16:20:02.0312269Z [cluster1] "numberReady": {
2021-07-14T16:20:02.0313221Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-14T16:20:02.0314040Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0314551Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0315022Z [cluster1] },
2021-07-14T16:20:02.0315535Z [cluster1] "numberUnavailable": {
2021-07-14T16:20:02.0316629Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-14T16:20:02.0317632Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0318138Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0318610Z [cluster1] },
2021-07-14T16:20:02.0319136Z [cluster1] "observedGeneration": {
2021-07-14T16:20:02.0319960Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-14T16:20:02.0320679Z [cluster1] "format": "int64",
2021-07-14T16:20:02.0321265Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0321737Z [cluster1] },
2021-07-14T16:20:02.0322307Z [cluster1] "updatedNumberScheduled": {
2021-07-14T16:20:02.0323134Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-14T16:20:02.0323811Z [cluster1] "format": "int32",
2021-07-14T16:20:02.0324320Z [cluster1] "type": "integer"
2021-07-14T16:20:02.0324776Z [cluster1] }
2021-07-14T16:20:02.0326029Z [cluster1] },
2021-07-14T16:20:02.0326628Z [cluster1] "required": [
2021-07-14T16:20:02.0327356Z [cluster1] "currentNumberScheduled",
2021-07-14T16:20:02.0328343Z [cluster1] "desiredNumberScheduled",
2021-07-14T16:20:02.0329230Z [cluster1] "numberMisscheduled",
2021-07-14T16:20:02.0329959Z [cluster1] "numberReady"
2021-07-14T16:20:02.0330563Z [cluster1] ],
2021-07-14T16:20:02.0331146Z [cluster1] "type": "object"
2021-07-14T16:20:02.0331653Z [cluster1] }
2021-07-14T16:20:02.0332175Z [cluster1] },
2021-07-14T16:20:02.0332751Z [cluster1] "required": [
2021-07-14T16:20:02.0333512Z [cluster1] "mismatchedContainerImages"
2021-07-14T16:20:02.0334244Z [cluster1] ],
2021-07-14T16:20:02.0334691Z [cluster1] "type": "object"
2021-07-14T16:20:02.0335264Z [cluster1] },
2021-07-14T16:20:02.0335844Z [cluster1] "serviceCIDR": {
2021-07-14T16:20:02.0336351Z [cluster1] "type": "string"
2021-07-14T16:20:02.0336927Z [cluster1] }
2021-07-14T16:20:02.0338453Z [cluster1] },
2021-07-14T16:20:02.0339115Z [cluster1] "required": [
2021-07-14T16:20:02.0339724Z [cluster1] "clusterID",
2021-07-14T16:20:02.0340212Z [cluster1] "natEnabled"
2021-07-14T16:20:02.0340768Z [cluster1] ],
2021-07-14T16:20:02.0341345Z [cluster1] "type": "object"
2021-07-14T16:20:02.0341876Z [cluster1] }
2021-07-14T16:20:02.0342280Z [cluster1] },
2021-07-14T16:20:02.0342840Z [cluster1] "type": "object"
2021-07-14T16:20:02.0343246Z [cluster1] }
2021-07-14T16:20:02.0343753Z [cluster1] },
2021-07-14T16:20:02.0344282Z [cluster1] "served": true,
2021-07-14T16:20:02.0344749Z [cluster1] "storage": true,
2021-07-14T16:20:02.0345356Z [cluster1] "subresources": {
2021-07-14T16:20:02.0345950Z [cluster1] "status": {}
2021-07-14T16:20:02.0346336Z [cluster1] }
2021-07-14T16:20:02.0346880Z [cluster1] }
2021-07-14T16:20:02.0347582Z [cluster1] ]
2021-07-14T16:20:02.0348174Z [cluster1] },
2021-07-14T16:20:02.0348546Z [cluster1] "status": {
2021-07-14T16:20:02.0349238Z [cluster1] "acceptedNames": {
2021-07-14T16:20:02.0349950Z [cluster1] "kind": "Submariner",
2021-07-14T16:20:02.0350780Z [cluster1] "listKind": "SubmarinerList",
2021-07-14T16:20:02.0357801Z [cluster1] "plural": "submariners",
2021-07-14T16:20:02.0358562Z [cluster1] "singular": "submariner"
2021-07-14T16:20:02.0359344Z [cluster1] },
2021-07-14T16:20:02.0359747Z [cluster1] "conditions": [
2021-07-14T16:20:02.0360155Z [cluster1] {
2021-07-14T16:20:02.0361088Z [cluster1] "lastTransitionTime": "2021-07-14T16:15:58Z",
2021-07-14T16:20:04.0976972Z [cluster1] "message": "no conflicts found",
2021-07-14T16:20:04.0977570Z [cluster2] "reason": "NoConflicts",
2021-07-14T16:20:04.0978053Z [cluster2] "status": "True",
2021-07-14T16:20:04.0978559Z [cluster2] "type": "NamesAccepted"
2021-07-14T16:20:04.0979002Z [cluster2] },
2021-07-14T16:20:04.0979383Z [cluster2] {
2021-07-14T16:20:04.0980516Z [cluster2] "lastTransitionTime": "2021-07-14T16:16:08Z",
2021-07-14T16:20:04.0981226Z [cluster2] "message": "the initial names have been accepted",
2021-07-14T16:20:04.0981916Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-14T16:20:04.0982477Z [cluster2] "status": "True",
2021-07-14T16:20:04.0982957Z [cluster2] "type": "Established"
2021-07-14T16:20:04.0983496Z [cluster2] }
2021-07-14T16:20:04.0983859Z [cluster2] ],
2021-07-14T16:20:04.0984295Z [cluster2] "storedVersions": [
2021-07-14T16:20:04.0984776Z [cluster2] "v1alpha1"
2021-07-14T16:20:04.0985154Z [cluster2] ]
2021-07-14T16:20:04.0985507Z [cluster2] }
2021-07-14T16:20:04.0985847Z [cluster2] }
2021-07-14T16:20:04.0986842Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-14T16:20:04.0988249Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-14T16:20:04.0989835Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:04.0991257Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:04.0992323Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-14T16:20:04.0993745Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:04.0995611Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:04.0996742Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-14T16:20:04.0998183Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:04.0999591Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-14T16:20:04.1000848Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-14T16:20:04.1002336Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-14T16:20:04.1003657Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-14T16:20:04.1004556Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-14T16:20:04.1005555Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-14T16:20:04.1006684Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-14T16:20:04.1008070Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-14T16:20:04.1008882Z [cluster2] NAME STATUS AGE
2021-07-14T16:20:04.1009590Z [cluster2] submariner-operator Active 3m54s
2021-07-14T16:20:04.1010639Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-14T16:20:04.1012086Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-14T16:20:04.1013436Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-14T16:20:04.1014324Z [cluster2] NAME CREATED AT
2021-07-14T16:20:04.1015090Z [cluster2] submariners.submariner.io 2021-07-14T16:16:08Z
2021-07-14T16:20:04.1016024Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-14T16:20:04.1016940Z [submariner-operator]$ [cluster2] grep submariners
2021-07-14T16:20:04.1017872Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-14T16:20:04.1018946Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-14T16:20:04.1019852Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-14T16:20:04.1021089Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1022675Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1024268Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1025260Z [cluster2] NAME SECRETS AGE
2021-07-14T16:20:04.1025953Z [cluster2] submariner-operator 1 3m55s
2021-07-14T16:20:04.1027112Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1028586Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1030191Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.1031165Z [cluster2] NAME CREATED AT
2021-07-14T16:20:04.1031874Z [cluster2] submariner-operator 2021-07-14T16:16:09Z
2021-07-14T16:20:04.3875194Z [submariner-operator]$ [cluster2] kubectl geto conflicts found",
2021-07-14T16:20:04.3875909Z [cluster1] "reason": "NoConflicts",
2021-07-14T16:20:04.3876396Z [cluster1] "status": "True",
2021-07-14T16:20:04.3876920Z [cluster1] "type": "NamesAccepted"
2021-07-14T16:20:04.3877509Z [cluster1] },
2021-07-14T16:20:04.3878181Z [cluster1] {
2021-07-14T16:20:04.3879033Z [cluster1] "lastTransitionTime": "2021-07-14T16:15:58Z",
2021-07-14T16:20:04.3879717Z [cluster1] "message": "the initial names have been accepted",
2021-07-14T16:20:04.3880393Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-14T16:20:04.3880964Z [cluster1] "status": "True",
2021-07-14T16:20:04.3881428Z [cluster1] "type": "Established"
2021-07-14T16:20:04.3881874Z [cluster1] }
2021-07-14T16:20:04.3882220Z [cluster1] ],
2021-07-14T16:20:04.3882660Z [cluster1] "storedVersions": [
2021-07-14T16:20:04.3883119Z [cluster1] "v1alpha1"
2021-07-14T16:20:04.3883504Z [cluster1] ]
2021-07-14T16:20:04.3883843Z [cluster1] }
2021-07-14T16:20:04.3884197Z [cluster1] }
2021-07-14T16:20:04.3885191Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-14T16:20:04.3886596Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-14T16:20:04.3889121Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:04.3890552Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:04.3891659Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-14T16:20:04.3893076Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:04.3894600Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:04.3895715Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-14T16:20:04.3897134Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:04.3898554Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-14T16:20:04.3908236Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-14T16:20:04.3909741Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-14T16:20:04.3911067Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-14T16:20:04.3911962Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-14T16:20:04.3913140Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-14T16:20:04.3914257Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-14T16:20:04.3915597Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-14T16:20:04.3916408Z [cluster1] NAME STATUS AGE
2021-07-14T16:20:04.3917105Z [cluster1] submariner-operator Active 4m4s
2021-07-14T16:20:04.3918153Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-14T16:20:04.3919394Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-14T16:20:04.3920746Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-14T16:20:04.3921622Z [cluster1] NAME CREATED AT
2021-07-14T16:20:04.3922385Z [cluster1] submariners.submariner.io 2021-07-14T16:15:57Z
2021-07-14T16:20:04.3923324Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-14T16:20:04.3924264Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-14T16:20:04.3925330Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-14T16:20:04.3926345Z [submariner-operator]$ [cluster1] grep submariners
2021-07-14T16:20:04.3927366Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-14T16:20:04.3928794Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3930354Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3931947Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3932946Z [cluster1] NAME SECRETS AGE
2021-07-14T16:20:04.3933625Z [cluster1] submariner-operator 1 4m6s
2021-07-14T16:20:04.3934787Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3936266Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3938345Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-14T16:20:04.3939328Z [cluster1] NAME CREATED AT
2021-07-14T16:20:04.3940033Z [cluster1] submariner-operator 2021-07-14T16:15:58Z
2021-07-14T16:20:05.6118425Z [submariner-operator]$ [cluster1] kubectl get r rolebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6120234Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6122328Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6123368Z [cluster2] NAME ROLE AGE
2021-07-14T16:20:05.6124217Z [cluster2] submariner-operator Role/submariner-operator 3m55s
2021-07-14T16:20:05.6125571Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6127222Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6129144Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.6130409Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-14T16:20:05.6131213Z [cluster2] submariner-operator 1/1 1 1 3m50s
2021-07-14T16:20:05.6132065Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-14T16:20:05.6132932Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-14T16:20:05.6134338Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-14T16:20:05.6136204Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.6138090Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.6140103Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.6142136Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o json
2021-07-14T16:20:05.6144183Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o json
2021-07-14T16:20:05.6146221Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o json
2021-07-14T16:20:05.6147551Z [cluster2] {
2021-07-14T16:20:05.6147980Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:05.6148505Z [cluster2] "kind": "Pod",
2021-07-14T16:20:05.6148926Z [cluster2] "metadata": {
2021-07-14T16:20:05.6149624Z [cluster2] "creationTimestamp": "2021-07-14T16:19:00Z",
2021-07-14T16:20:05.6150606Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-14T16:20:05.6151294Z [cluster2] "labels": {
2021-07-14T16:20:05.6151956Z [cluster2] "name": "submariner-operator",
2021-07-14T16:20:05.6152762Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-14T16:20:05.6153256Z [cluster2] },
2021-07-14T16:20:05.6153682Z [cluster2] "managedFields": [
2021-07-14T16:20:05.6154098Z [cluster2] {
2021-07-14T16:20:05.6154523Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:05.6155021Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:05.6155510Z [cluster2] "fieldsV1": {
2021-07-14T16:20:05.6155950Z [cluster2] "f:metadata": {
2021-07-14T16:20:05.6156442Z [cluster2] "f:generateName": {},
2021-07-14T16:20:05.6156911Z [cluster2] "f:labels": {
2021-07-14T16:20:05.6157338Z [cluster2] ".": {},
2021-07-14T16:20:05.6157747Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6158427Z [cluster2] "f:pod-template-hash": {}
2021-07-14T16:20:05.6159042Z [cluster2] },
2021-07-14T16:20:05.6159513Z [cluster2] "f:ownerReferences": {
2021-07-14T16:20:05.6160009Z [cluster2] ".": {},
2021-07-14T16:20:05.6160783Z [cluster2] "k:{\"uid\":\"f5f70b64-7ad1-4b17-9071-2bb3453cb96a\"}": {
2021-07-14T16:20:05.6161367Z [cluster2] ".": {},
2021-07-14T16:20:05.6161820Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:05.6162413Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-14T16:20:05.6162989Z [cluster2] "f:controller": {},
2021-07-14T16:20:05.6163456Z [cluster2] "f:kind": {},
2021-07-14T16:20:05.6163889Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6164468Z [cluster2] "f:uid": {}
2021-07-14T16:20:05.6164874Z [cluster2] }
2021-07-14T16:20:05.6165258Z [cluster2] }
2021-07-14T16:20:05.6166570Z [cluster2] },
2021-07-14T16:20:05.6167121Z [cluster2] "f:spec": {
2021-07-14T16:20:05.6167577Z [cluster2] "f:containers": {
2021-07-14T16:20:05.6168773Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-14T16:20:05.6169327Z [cluster2] ".": {},
2021-07-14T16:20:05.6169776Z [cluster2] "f:command": {},
2021-07-14T16:20:05.6170217Z [cluster2] "f:env": {
2021-07-14T16:20:05.6170646Z [cluster2] ".": {},
2021-07-14T16:20:05.6171132Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-14T16:20:05.6171632Z [cluster2] ".": {},
2021-07-14T16:20:05.6172053Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6172510Z [cluster2] "f:value": {}
2021-07-14T16:20:05.6172952Z [cluster2] },
2021-07-14T16:20:05.6173434Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-14T16:20:05.6173951Z [cluster2] ".": {},
2021-07-14T16:20:05.6174379Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6175042Z [cluster2] "f:valueFrom": {
2021-07-14T16:20:05.6175499Z [cluster2] ".": {},
2021-07-14T16:20:05.6175960Z [cluster2] "f:fieldRef": {
2021-07-14T16:20:05.6176414Z [cluster2] ".": {},
2021-07-14T16:20:05.6176896Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:05.6177418Z [cluster2] "f:fieldPath": {}
2021-07-14T16:20:05.6177873Z [cluster2] }
2021-07-14T16:20:05.6178281Z [cluster2] }
2021-07-14T16:20:05.6178674Z [cluster2] },
2021-07-14T16:20:05.6179179Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-14T16:20:05.6179672Z [cluster2] ".": {},
2021-07-14T16:20:05.6180167Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6180636Z [cluster2] "f:valueFrom": {
2021-07-14T16:20:05.6181107Z [cluster2] ".": {},
2021-07-14T16:20:05.6181569Z [cluster2] "f:fieldRef": {
2021-07-14T16:20:05.6182022Z [cluster2] ".": {},
2021-07-14T16:20:05.6182581Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:05.6183257Z [cluster2] "f:fieldPath": {}
2021-07-14T16:20:05.6183727Z [cluster2] }
2021-07-14T16:20:05.6184126Z [cluster2] }
2021-07-14T16:20:05.6184529Z [cluster2] }
2021-07-14T16:20:05.6184916Z [cluster2] },
2021-07-14T16:20:05.6185344Z [cluster2] "f:image": {},
2021-07-14T16:20:05.6185883Z [cluster2] "f:imagePullPolicy": {},
2021-07-14T16:20:05.6186386Z [cluster2] "f:name": {},
2021-07-14T16:20:05.6186855Z [cluster2] "f:resources": {},
2021-07-14T16:20:05.6187456Z [cluster2] "f:terminationMessagePath": {},
2021-07-14T16:20:05.6188215Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-14T16:20:05.6188791Z [cluster2] }
2021-07-14T16:20:05.6189183Z [cluster2] },
2021-07-14T16:20:05.6189603Z [cluster2] "f:dnsPolicy": {},
2021-07-14T16:20:05.6190165Z [cluster2] "f:enableServiceLinks": {},
2021-07-14T16:20:05.6190751Z [cluster2] "f:restartPolicy": {},
2021-07-14T16:20:05.6191277Z [cluster2] "f:schedulerName": {},
2021-07-14T16:20:05.6191839Z [cluster2] "f:securityContext": {},
2021-07-14T16:20:05.6192388Z [cluster2] "f:serviceAccount": {},
2021-07-14T16:20:05.6192979Z [cluster2] "f:serviceAccountName": {},
2021-07-14T16:20:05.6193730Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-14T16:20:05.6194367Z [cluster2] }
2021-07-14T16:20:05.6194729Z [cluster2] },
2021-07-14T16:20:05.6195506Z [cluster2] "manager": "kube-controller-manager",
2021-07-14T16:20:05.6196128Z [cluster2] "operation": "Update",
2021-07-14T16:20:05.6196746Z [cluster2] "time": "2021-07-14T16:19:00Z"
2021-07-14T16:20:05.6197160Z [cluster2] },
2021-07-14T16:20:05.6197512Z [cluster2] {
2021-07-14T16:20:05.6197939Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:05.6198443Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:05.6199034Z [cluster2] "fieldsV1": {
2021-07-14T16:20:05.6199463Z [cluster2] "f:status": {
2021-07-14T16:20:05.6199923Z [cluster2] "f:conditions": {
2021-07-14T16:20:05.6200479Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-14T16:20:05.6200983Z [cluster2] ".": {},
2021-07-14T16:20:05.6201465Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:05.6202052Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:05.6202602Z [cluster2] "f:status": {},
2021-07-14T16:20:05.6203041Z [cluster2] "f:type": {}
2021-07-14T16:20:05.6203452Z [cluster2] },
2021-07-14T16:20:05.6203928Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-14T16:20:05.6204409Z [cluster2] ".": {},
2021-07-14T16:20:05.6204887Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:05.6205470Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:05.6206017Z [cluster2] "f:status": {},
2021-07-14T16:20:05.6206451Z [cluster2] "f:type": {}
2021-07-14T16:20:05.6206861Z [cluster2] },
2021-07-14T16:20:05.6207289Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-14T16:20:05.6242814Z [cluster2] ".": {},
2021-07-14T16:20:05.6243549Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:05.6244151Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:05.6244698Z [cluster2] "f:status": {},
2021-07-14T16:20:05.6245137Z [cluster2] "f:type": {}
2021-07-14T16:20:05.6245572Z [cluster2] }
2021-07-14T16:20:05.6245946Z [cluster2] },
2021-07-14T16:20:05.6246444Z [cluster2] "f:containerStatuses": {},
2021-07-14T16:20:05.6246961Z [cluster2] "f:hostIP": {},
2021-07-14T16:20:05.6247409Z [cluster2] "f:phase": {},
2021-07-14T16:20:05.6247996Z [cluster2] "f:podIP": {},
2021-07-14T16:20:05.6248445Z [cluster2] "f:podIPs": {
2021-07-14T16:20:05.6248863Z [cluster2] ".": {},
2021-07-14T16:20:05.6249292Z [cluster2] "k:{\"ip\":\"10.2.128.5\"}": {
2021-07-14T16:20:05.6249722Z [cluster2] ".": {},
2021-07-14T16:20:05.6250121Z [cluster2] "f:ip": {}
2021-07-14T16:20:05.6250525Z [cluster2] }
2021-07-14T16:20:05.6250896Z [cluster2] },
2021-07-14T16:20:05.6251335Z [cluster2] "f:startTime": {}
2021-07-14T16:20:05.6251744Z [cluster2] }
2021-07-14T16:20:05.6252116Z [cluster2] },
2021-07-14T16:20:05.6252573Z [cluster2] "manager": "kubelet",
2021-07-14T16:20:05.6253073Z [cluster2] "operation": "Update",
2021-07-14T16:20:05.6254000Z [cluster2] "time": "2021-07-14T16:19:02Z"
2021-07-14T16:20:05.6254396Z [cluster2] }
2021-07-14T16:20:05.6254753Z [cluster2] ],
2021-07-14T16:20:05.6255619Z [cluster2] "name": "submariner-operator-5bfdb87494-9gp9g",
2021-07-14T16:20:05.6256621Z [cluster2] "namespace": "submariner-operator",
2021-07-14T16:20:05.6257218Z [cluster2] "ownerReferences": [
2021-07-14T16:20:05.6257672Z [cluster2] {
2021-07-14T16:20:05.6258105Z [cluster2] "apiVersion": "apps/v1",
2021-07-14T16:20:05.6258700Z [cluster2] "blockOwnerDeletion": true,
2021-07-14T16:20:05.6259507Z [cluster2] "controller": true,
2021-07-14T16:20:05.6260009Z [cluster2] "kind": "ReplicaSet",
2021-07-14T16:20:05.6260878Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-14T16:20:05.6261824Z [cluster2] "uid": "f5f70b64-7ad1-4b17-9071-2bb3453cb96a"
2021-07-14T16:20:05.6262353Z [cluster2] }
2021-07-14T16:20:05.6262699Z [cluster2] ],
2021-07-14T16:20:05.6263152Z [cluster2] "resourceVersion": "1982",
2021-07-14T16:20:05.6263908Z [cluster2] "uid": "22614a93-620f-4b1a-b14b-ac1b51963ae2"
2021-07-14T16:20:05.6264404Z [cluster2] },
2021-07-14T16:20:05.6264760Z [cluster2] "spec": {
2021-07-14T16:20:05.6265183Z [cluster2] "containers": [
2021-07-14T16:20:05.6265578Z [cluster2] {
2021-07-14T16:20:05.6265970Z [cluster2] "command": [
2021-07-14T16:20:05.6266645Z [cluster2] "submariner-operator",
2021-07-14T16:20:05.6267347Z [cluster2] "-alsologtostderr",
2021-07-14T16:20:05.6267939Z [cluster2] "-v=1"
2021-07-14T16:20:05.6268306Z [cluster2] ],
2021-07-14T16:20:05.6268694Z [cluster2] "env": [
2021-07-14T16:20:05.6269064Z [cluster2] {
2021-07-14T16:20:05.6269528Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-14T16:20:05.6270013Z [cluster2] "valueFrom": {
2021-07-14T16:20:05.6270476Z [cluster2] "fieldRef": {
2021-07-14T16:20:05.6271050Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:05.6271652Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-14T16:20:05.6272186Z [cluster2] }
2021-07-14T16:20:05.6272557Z [cluster2] }
2021-07-14T16:20:05.6272935Z [cluster2] },
2021-07-14T16:20:05.6273294Z [cluster2] {
2021-07-14T16:20:05.6273860Z [cluster2] "name": "POD_NAME",
2021-07-14T16:20:05.6274319Z [cluster2] "valueFrom": {
2021-07-14T16:20:05.6274790Z [cluster2] "fieldRef": {
2021-07-14T16:20:05.6275281Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:05.6275845Z [cluster2] "fieldPath": "metadata.name"
2021-07-14T16:20:05.6276326Z [cluster2] }
2021-07-14T16:20:05.6276716Z [cluster2] }
2021-07-14T16:20:05.6277101Z [cluster2] },
2021-07-14T16:20:05.6277465Z [cluster2] {
2021-07-14T16:20:05.6277922Z [cluster2] "name": "OPERATOR_NAME",
2021-07-14T16:20:05.6278678Z [cluster2] "value": "submariner-operator"
2021-07-14T16:20:05.6279195Z [cluster2] }
2021-07-14T16:20:05.6279555Z [cluster2] ],
2021-07-14T16:20:05.6280301Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-14T16:20:05.6281023Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-14T16:20:05.6281824Z [cluster2] "name": "submariner-operator",
2021-07-14T16:20:05.6282373Z [cluster2] "resources": {},
2021-07-14T16:20:05.6283188Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-14T16:20:05.6284018Z [cluster2] "terminationMessagePolicy": "File",
2021-07-14T16:20:05.6284639Z [cluster2] "volumeMounts": [
2021-07-14T16:20:05.6285073Z [cluster2] {
2021-07-14T16:20:05.6285675Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-14T16:20:05.6286729Z [cluster2] "name": "submariner-operator-token-2l625",
2021-07-14T16:20:05.6287426Z [cluster2] "readOnly": true
2021-07-14T16:20:05.6307595Z [cluster2] }
2021-07-14T16:20:05.6308310Z [cluster2] ]
2021-07-14T16:20:05.6308678Z [cluster2] }
2021-07-14T16:20:05.6309044Z [cluster2] ],
2021-07-14T16:20:05.6309509Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-14T16:20:05.6310116Z [cluster2] "enableServiceLinks": true,
2021-07-14T16:20:05.6311316Z [cluster2] "nodeName": "cluster2-worker2",
2021-07-14T16:20:05.6312058Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-14T16:20:05.6312701Z [cluster2] "priority": 0,
2021-07-14T16:20:05.6313197Z [cluster2] "restartPolicy": "Always",
2021-07-14T16:20:05.6313961Z [cluster2] "schedulerName": "default-scheduler",
2021-07-14T16:20:05.6314581Z [cluster2] "securityContext": {},
2021-07-14T16:20:05.6315379Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-14T16:20:05.6316303Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-14T16:20:05.6317160Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-14T16:20:05.6317826Z [cluster2] "tolerations": [
2021-07-14T16:20:05.6318241Z [cluster2] {
2021-07-14T16:20:05.6318673Z [cluster2] "effect": "NoExecute",
2021-07-14T16:20:05.6319422Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-14T16:20:05.6319998Z [cluster2] "operator": "Exists",
2021-07-14T16:20:05.6320535Z [cluster2] "tolerationSeconds": 300
2021-07-14T16:20:05.6320998Z [cluster2] },
2021-07-14T16:20:05.6321472Z [cluster2] {
2021-07-14T16:20:05.6321925Z [cluster2] "effect": "NoExecute",
2021-07-14T16:20:05.6322526Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-14T16:20:05.6323128Z [cluster2] "operator": "Exists",
2021-07-14T16:20:05.6323648Z [cluster2] "tolerationSeconds": 300
2021-07-14T16:20:05.6324118Z [cluster2] }
2021-07-14T16:20:05.6324464Z [cluster2] ],
2021-07-14T16:20:05.6324857Z [cluster2] "volumes": [
2021-07-14T16:20:05.6325236Z [cluster2] {
2021-07-14T16:20:05.6326060Z [cluster2] "name": "submariner-operator-token-2l625",
2021-07-14T16:20:05.6326721Z [cluster2] "secret": {
2021-07-14T16:20:05.6327180Z [cluster2] "defaultMode": 420,
2021-07-14T16:20:05.6328280Z [cluster2] "secretName": "submariner-operator-token-2l625"
2021-07-14T16:20:05.6328950Z [cluster2] }
2021-07-14T16:20:05.6329322Z [cluster2] }
2021-07-14T16:20:05.6329668Z [cluster2] ]
2021-07-14T16:20:05.6330120Z [cluster2] },
2021-07-14T16:20:05.6330484Z [cluster2] "status": {
2021-07-14T16:20:05.6330914Z [cluster2] "conditions": [
2021-07-14T16:20:05.6331306Z [cluster2] {
2021-07-14T16:20:05.6331767Z [cluster2] "lastProbeTime": null,
2021-07-14T16:20:05.6332542Z [cluster2] "lastTransitionTime": "2021-07-14T16:19:00Z",
2021-07-14T16:20:05.6333096Z [cluster2] "status": "True",
2021-07-14T16:20:05.6333564Z [cluster2] "type": "Initialized"
2021-07-14T16:20:05.6333994Z [cluster2] },
2021-07-14T16:20:05.6334359Z [cluster2] {
2021-07-14T16:20:05.6334805Z [cluster2] "lastProbeTime": null,
2021-07-14T16:20:05.6335563Z [cluster2] "lastTransitionTime": "2021-07-14T16:19:02Z",
2021-07-14T16:20:05.6336101Z [cluster2] "status": "True",
2021-07-14T16:20:05.6336552Z [cluster2] "type": "Ready"
2021-07-14T16:20:05.6336938Z [cluster2] },
2021-07-14T16:20:05.6337405Z [cluster2] {
2021-07-14T16:20:05.6337944Z [cluster2] "lastProbeTime": null,
2021-07-14T16:20:05.6338708Z [cluster2] "lastTransitionTime": "2021-07-14T16:19:02Z",
2021-07-14T16:20:05.6339247Z [cluster2] "status": "True",
2021-07-14T16:20:05.6339953Z [cluster2] "type": "ContainersReady"
2021-07-14T16:20:05.6340425Z [cluster2] },
2021-07-14T16:20:05.6340770Z [cluster2] {
2021-07-14T16:20:05.6341226Z [cluster2] "lastProbeTime": null,
2021-07-14T16:20:05.6341978Z [cluster2] "lastTransitionTime": "2021-07-14T16:19:00Z",
2021-07-14T16:20:05.6342529Z [cluster2] "status": "True",
2021-07-14T16:20:05.6343008Z [cluster2] "type": "PodScheduled"
2021-07-14T16:20:05.6343459Z [cluster2] }
2021-07-14T16:20:05.6343806Z [cluster2] ],
2021-07-14T16:20:05.6344278Z [cluster2] "containerStatuses": [
2021-07-14T16:20:05.6344731Z [cluster2] {
2021-07-14T16:20:05.6346147Z [cluster2] "containerID": "containerd://f6b4d103693630fed0c7208d8627e7e7117c65500a633a42b36ff46c46129b3b",
2021-07-14T16:20:05.6347914Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-14T16:20:05.6349486Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:2ce83eb8311f1e46b6bb05dfea2f41f88e2193cce581c56fae9f10cde31e799c",
2021-07-14T16:20:05.6350668Z [cluster2] "lastState": {},
2021-07-14T16:20:05.6351352Z [cluster2] "name": "submariner-operator",
2021-07-14T16:20:05.6351898Z [cluster2] "ready": true,
2021-07-14T16:20:05.6352381Z [cluster2] "restartCount": 0,
2021-07-14T16:20:05.6352863Z [cluster2] "started": true,
2021-07-14T16:20:05.6353393Z [cluster2] "state": {
2021-07-14T16:20:05.6353801Z [cluster2] "running": {
2021-07-14T16:20:05.7448803Z [cluster2] "startedAt": "olebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7451722Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7453453Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7454646Z [cluster1] NAME ROLE AGE
2021-07-14T16:20:05.7455489Z [cluster1] submariner-operator Role/submariner-operator 4m6s
2021-07-14T16:20:05.7456801Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7458494Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7460172Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-14T16:20:05.7461432Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-14T16:20:05.7462226Z [cluster1] submariner-operator 1/1 1 1 4m2s
2021-07-14T16:20:05.7463074Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-14T16:20:05.7463933Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-14T16:20:05.7465436Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-14T16:20:05.7467291Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.7469160Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.7471164Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:05.7473383Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o json
2021-07-14T16:20:05.7475343Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o json
2021-07-14T16:20:05.7477411Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o json
2021-07-14T16:20:05.7478534Z [cluster1] {
2021-07-14T16:20:05.7478952Z [cluster1] "apiVersion": "v1",
2021-07-14T16:20:05.7479382Z [cluster1] "kind": "Pod",
2021-07-14T16:20:05.7479808Z [cluster1] "metadata": {
2021-07-14T16:20:05.7480502Z [cluster1] "creationTimestamp": "2021-07-14T16:18:53Z",
2021-07-14T16:20:05.7481463Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-14T16:20:05.7482172Z [cluster1] "labels": {
2021-07-14T16:20:05.7482828Z [cluster1] "name": "submariner-operator",
2021-07-14T16:20:05.7483604Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-14T16:20:05.7484083Z [cluster1] },
2021-07-14T16:20:05.7484512Z [cluster1] "managedFields": [
2021-07-14T16:20:05.7484929Z [cluster1] {
2021-07-14T16:20:05.7485355Z [cluster1] "apiVersion": "v1",
2021-07-14T16:20:05.7485859Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:05.7486356Z [cluster1] "fieldsV1": {
2021-07-14T16:20:05.7486820Z [cluster1] "f:metadata": {
2021-07-14T16:20:05.7487302Z [cluster1] "f:generateName": {},
2021-07-14T16:20:05.7488449Z [cluster1] "f:labels": {
2021-07-14T16:20:05.7488861Z [cluster1] ".": {},
2021-07-14T16:20:05.7489287Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7490001Z [cluster1] "f:pod-template-hash": {}
2021-07-14T16:20:05.7490503Z [cluster1] },
2021-07-14T16:20:05.7490983Z [cluster1] "f:ownerReferences": {
2021-07-14T16:20:05.7491477Z [cluster1] ".": {},
2021-07-14T16:20:05.7492220Z [cluster1] "k:{\"uid\":\"c1fe1180-1482-4305-907d-b227bb044168\"}": {
2021-07-14T16:20:05.7492758Z [cluster1] ".": {},
2021-07-14T16:20:05.7493227Z [cluster1] "f:apiVersion": {},
2021-07-14T16:20:05.7493788Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-14T16:20:05.7494380Z [cluster1] "f:controller": {},
2021-07-14T16:20:05.7494836Z [cluster1] "f:kind": {},
2021-07-14T16:20:05.7495271Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7495693Z [cluster1] "f:uid": {}
2021-07-14T16:20:05.7496098Z [cluster1] }
2021-07-14T16:20:05.7496481Z [cluster1] }
2021-07-14T16:20:05.7496847Z [cluster1] },
2021-07-14T16:20:05.7497253Z [cluster1] "f:spec": {
2021-07-14T16:20:05.7497694Z [cluster1] "f:containers": {
2021-07-14T16:20:05.7498464Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-14T16:20:05.7499008Z [cluster1] ".": {},
2021-07-14T16:20:05.7499444Z [cluster1] "f:command": {},
2021-07-14T16:20:05.7499880Z [cluster1] "f:env": {
2021-07-14T16:20:05.7500305Z [cluster1] ".": {},
2021-07-14T16:20:05.7500796Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-14T16:20:05.7501277Z [cluster1] ".": {},
2021-07-14T16:20:05.7501710Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7502148Z [cluster1] "f:value": {}
2021-07-14T16:20:05.7502695Z [cluster1] },
2021-07-14T16:20:05.7503148Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-14T16:20:05.7503616Z [cluster1] ".": {},
2021-07-14T16:20:05.7504036Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7504515Z [cluster1] "f:valueFrom": {
2021-07-14T16:20:05.7504977Z [cluster1] ".": {},
2021-07-14T16:20:05.7505427Z [cluster1] "f:fieldRef": {
2021-07-14T16:20:05.7505892Z [cluster1] ".": {},
2021-07-14T16:20:05.7506361Z [cluster1] "f:apiVersion": {},
2021-07-14T16:20:05.7506883Z [cluster1] "f:fieldPath": {}
2021-07-14T16:20:05.7507334Z [cluster1] }
2021-07-14T16:20:05.7507744Z [cluster1] }
2021-07-14T16:20:05.7508138Z [cluster1] },
2021-07-14T16:20:05.7508630Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-14T16:20:05.7509130Z [cluster1] ".": {},
2021-07-14T16:20:05.7509550Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7510027Z [cluster1] "f:valueFrom": {
2021-07-14T16:20:05.7510552Z [cluster1] ".": {},
2021-07-14T16:20:05.7511012Z [cluster1] "f:fieldRef": {
2021-07-14T16:20:05.7511460Z [cluster1] ".": {},
2021-07-14T16:20:05.7511942Z [cluster1] "f:apiVersion": {},
2021-07-14T16:20:05.7512469Z [cluster1] "f:fieldPath": {}
2021-07-14T16:20:05.7512917Z [cluster1] }
2021-07-14T16:20:05.7513323Z [cluster1] }
2021-07-14T16:20:05.7513715Z [cluster1] }
2021-07-14T16:20:05.7514113Z [cluster1] },
2021-07-14T16:20:05.7514730Z [cluster1] "f:image": {},
2021-07-14T16:20:05.7545389Z [cluster1] "f:imagePullPolicy": {},
2021-07-14T16:20:05.7546178Z [cluster1] "f:name": {},
2021-07-14T16:20:05.7546650Z [cluster1] "f:resources": {},
2021-07-14T16:20:05.7547267Z [cluster1] "f:terminationMessagePath": {},
2021-07-14T16:20:05.7548010Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-14T16:20:05.7548598Z [cluster1] }
2021-07-14T16:20:05.7548981Z [cluster1] },
2021-07-14T16:20:05.7549418Z [cluster1] "f:dnsPolicy": {},
2021-07-14T16:20:05.7549968Z [cluster1] "f:enableServiceLinks": {},
2021-07-14T16:20:05.7550561Z [cluster1] "f:restartPolicy": {},
2021-07-14T16:20:05.7551087Z [cluster1] "f:schedulerName": {},
2021-07-14T16:20:05.7551643Z [cluster1] "f:securityContext": {},
2021-07-14T16:20:05.7552208Z [cluster1] "f:serviceAccount": {},
2021-07-14T16:20:05.7552783Z [cluster1] "f:serviceAccountName": {},
2021-07-14T16:20:05.7553555Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-14T16:20:05.7554186Z [cluster1] }
2021-07-14T16:20:05.7554566Z [cluster1] },
2021-07-14T16:20:05.7555610Z [cluster1] "manager": "kube-controller-manager",
2021-07-14T16:20:05.7556441Z [cluster1] "operation": "Update",
2021-07-14T16:20:05.7557077Z [cluster1] "time": "2021-07-14T16:18:53Z"
2021-07-14T16:20:05.7557482Z [cluster1] },
2021-07-14T16:20:05.7557841Z [cluster1] {
2021-07-14T16:20:05.7558255Z [cluster1] "apiVersion": "v1",
2021-07-14T16:20:05.7558772Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:05.7559251Z [cluster1] "fieldsV1": {
2021-07-14T16:20:05.7559688Z [cluster1] "f:status": {
2021-07-14T16:20:05.7560138Z [cluster1] "f:conditions": {
2021-07-14T16:20:05.7560700Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-14T16:20:05.7561207Z [cluster1] ".": {},
2021-07-14T16:20:05.7561690Z [cluster1] "f:lastProbeTime": {},
2021-07-14T16:20:05.7562273Z [cluster1] "f:lastTransitionTime": {},
2021-07-14T16:20:05.7562819Z [cluster1] "f:status": {},
2021-07-14T16:20:05.7563268Z [cluster1] "f:type": {}
2021-07-14T16:20:05.7563670Z [cluster1] },
2021-07-14T16:20:05.7564324Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-14T16:20:05.7564806Z [cluster1] ".": {},
2021-07-14T16:20:05.7565273Z [cluster1] "f:lastProbeTime": {},
2021-07-14T16:20:05.7565964Z [cluster1] "f:lastTransitionTime": {},
2021-07-14T16:20:05.7566506Z [cluster1] "f:status": {},
2021-07-14T16:20:05.7566941Z [cluster1] "f:type": {}
2021-07-14T16:20:05.7567353Z [cluster1] },
2021-07-14T16:20:05.7568246Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-14T16:20:05.7568697Z [cluster1] ".": {},
2021-07-14T16:20:05.7569172Z [cluster1] "f:lastProbeTime": {},
2021-07-14T16:20:05.7569770Z [cluster1] "f:lastTransitionTime": {},
2021-07-14T16:20:05.7570298Z [cluster1] "f:status": {},
2021-07-14T16:20:05.7570744Z [cluster1] "f:type": {}
2021-07-14T16:20:05.7571156Z [cluster1] }
2021-07-14T16:20:05.7571526Z [cluster1] },
2021-07-14T16:20:05.7572028Z [cluster1] "f:containerStatuses": {},
2021-07-14T16:20:05.7572542Z [cluster1] "f:hostIP": {},
2021-07-14T16:20:05.7572991Z [cluster1] "f:phase": {},
2021-07-14T16:20:05.7573419Z [cluster1] "f:podIP": {},
2021-07-14T16:20:05.7573870Z [cluster1] "f:podIPs": {
2021-07-14T16:20:05.7574285Z [cluster1] ".": {},
2021-07-14T16:20:05.7574717Z [cluster1] "k:{\"ip\":\"10.1.0.6\"}": {
2021-07-14T16:20:05.7575135Z [cluster1] ".": {},
2021-07-14T16:20:05.7575559Z [cluster1] "f:ip": {}
2021-07-14T16:20:05.7575965Z [cluster1] }
2021-07-14T16:20:05.7576337Z [cluster1] },
2021-07-14T16:20:05.7576774Z [cluster1] "f:startTime": {}
2021-07-14T16:20:05.7577188Z [cluster1] }
2021-07-14T16:20:05.7577570Z [cluster1] },
2021-07-14T16:20:05.7577996Z [cluster1] "manager": "kubelet",
2021-07-14T16:20:05.7578499Z [cluster1] "operation": "Update",
2021-07-14T16:20:05.7579198Z [cluster1] "time": "2021-07-14T16:18:54Z"
2021-07-14T16:20:05.7579609Z [cluster1] }
2021-07-14T16:20:05.7579961Z [cluster1] ],
2021-07-14T16:20:05.7580817Z [cluster1] "name": "submariner-operator-5bfdb87494-vncqj",
2021-07-14T16:20:05.7581911Z [cluster1] "namespace": "submariner-operator",
2021-07-14T16:20:05.7582519Z [cluster1] "ownerReferences": [
2021-07-14T16:20:05.7582971Z [cluster1] {
2021-07-14T16:20:05.7583401Z [cluster1] "apiVersion": "apps/v1",
2021-07-14T16:20:05.7583984Z [cluster1] "blockOwnerDeletion": true,
2021-07-14T16:20:05.7584529Z [cluster1] "controller": true,
2021-07-14T16:20:05.7585023Z [cluster1] "kind": "ReplicaSet",
2021-07-14T16:20:05.7585877Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-14T16:20:05.7586803Z [cluster1] "uid": "c1fe1180-1482-4305-907d-b227bb044168"
2021-07-14T16:20:05.7587298Z [cluster1] }
2021-07-14T16:20:05.7587640Z [cluster1] ],
2021-07-14T16:20:05.7588091Z [cluster1] "resourceVersion": "2080",
2021-07-14T16:20:05.7588857Z [cluster1] "uid": "289cc675-6c3c-45da-9f0b-a42d4962537b"
2021-07-14T16:20:05.7589373Z [cluster1] },
2021-07-14T16:20:05.7589740Z [cluster1] "spec": {
2021-07-14T16:20:05.7590169Z [cluster1] "containers": [
2021-07-14T16:20:05.7590563Z [cluster1] {
2021-07-14T16:20:05.7590960Z [cluster1] "command": [
2021-07-14T16:20:05.7591618Z [cluster1] "submariner-operator",
2021-07-14T16:20:05.7592401Z [cluster1] "-alsologtostderr",
2021-07-14T16:20:05.7592974Z [cluster1] "-v=1"
2021-07-14T16:20:05.7593445Z [cluster1] ],
2021-07-14T16:20:05.7593831Z [cluster1] "env": [
2021-07-14T16:20:05.7594206Z [cluster1] {
2021-07-14T16:20:05.7594671Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-14T16:20:05.7595163Z [cluster1] "valueFrom": {
2021-07-14T16:20:05.7595633Z [cluster1] "fieldRef": {
2021-07-14T16:20:05.7596116Z [cluster1] "apiVersion": "v1",
2021-07-14T16:20:05.7596721Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-14T16:20:05.7597246Z [cluster1] }
2021-07-14T16:20:05.7597636Z [cluster1] }
2021-07-14T16:20:05.7598019Z [cluster1] },
2021-07-14T16:20:05.7598385Z [cluster1] {
2021-07-14T16:20:05.7598812Z [cluster1] "name": "POD_NAME",
2021-07-14T16:20:05.7599267Z [cluster1] "valueFrom": {
2021-07-14T16:20:05.7599738Z [cluster1] "fieldRef": {
2021-07-14T16:20:05.7600219Z [cluster1] "apiVersion": "v1",
2021-07-14T16:20:05.7600778Z [cluster1] "fieldPath": "metadata.name"
2021-07-14T16:20:05.7601263Z [cluster1] }
2021-07-14T16:20:05.7601645Z [cluster1] }
2021-07-14T16:20:05.7602019Z [cluster1] },
2021-07-14T16:20:05.7602405Z [cluster1] {
2021-07-14T16:20:05.7602865Z [cluster1] "name": "OPERATOR_NAME",
2021-07-14T16:20:05.7603605Z [cluster1] "value": "submariner-operator"
2021-07-14T16:20:05.7604136Z [cluster1] }
2021-07-14T16:20:05.7604497Z [cluster1] ],
2021-07-14T16:20:05.7605261Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-14T16:20:05.7605984Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-14T16:20:05.7606796Z [cluster1] "name": "submariner-operator",
2021-07-14T16:20:05.7607335Z [cluster1] "resources": {},
2021-07-14T16:20:05.7608329Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-14T16:20:05.7609160Z [cluster1] "terminationMessagePolicy": "File",
2021-07-14T16:20:05.7609772Z [cluster1] "volumeMounts": [
2021-07-14T16:20:05.7610205Z [cluster1] {
2021-07-14T16:20:05.7610916Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-14T16:20:05.7611999Z [cluster1] "name": "submariner-operator-token-tpqxl",
2021-07-14T16:20:05.7612727Z [cluster1] "readOnly": true
2021-07-14T16:20:05.7613148Z [cluster1] }
2021-07-14T16:20:05.7613507Z [cluster1] ]
2021-07-14T16:20:05.7613869Z [cluster1] }
2021-07-14T16:20:05.7614246Z [cluster1] ],
2021-07-14T16:20:05.7614712Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-14T16:20:05.7615329Z [cluster1] "enableServiceLinks": true,
2021-07-14T16:20:05.7616103Z [cluster1] "nodeName": "cluster1-worker2",
2021-07-14T16:20:05.7616845Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-14T16:20:05.7617466Z [cluster1] "priority": 0,
2021-07-14T16:20:05.7617962Z [cluster1] "restartPolicy": "Always",
2021-07-14T16:20:05.7618727Z [cluster1] "schedulerName": "default-scheduler",
2021-07-14T16:20:05.7619351Z [cluster1] "securityContext": {},
2021-07-14T16:20:05.7620139Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-14T16:20:05.7621080Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-14T16:20:05.7621935Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-14T16:20:05.7622591Z [cluster1] "tolerations": [
2021-07-14T16:20:05.7623014Z [cluster1] {
2021-07-14T16:20:05.7623537Z [cluster1] "effect": "NoExecute",
2021-07-14T16:20:05.7624293Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-14T16:20:05.7624866Z [cluster1] "operator": "Exists",
2021-07-14T16:20:05.7625403Z [cluster1] "tolerationSeconds": 300
2021-07-14T16:20:05.7625868Z [cluster1] },
2021-07-14T16:20:05.7626232Z [cluster1] {
2021-07-14T16:20:05.7626672Z [cluster1] "effect": "NoExecute",
2021-07-14T16:20:05.7627290Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-14T16:20:05.7627890Z [cluster1] "operator": "Exists",
2021-07-14T16:20:05.7628404Z [cluster1] "tolerationSeconds": 300
2021-07-14T16:20:05.7628875Z [cluster1] }
2021-07-14T16:20:05.7629226Z [cluster1] ],
2021-07-14T16:20:05.7629619Z [cluster1] "volumes": [
2021-07-14T16:20:05.7629994Z [cluster1] {
2021-07-14T16:20:05.7630808Z [cluster1] "name": "submariner-operator-token-tpqxl",
2021-07-14T16:20:05.7631476Z [cluster1] "secret": {
2021-07-14T16:20:05.7631931Z [cluster1] "defaultMode": 420,
2021-07-14T16:20:05.7632831Z [cluster1] "secretName": "submariner-operator-token-tpqxl"
2021-07-14T16:20:05.7633516Z [cluster1] }
2021-07-14T16:20:05.7633884Z [cluster1] }
2021-07-14T16:20:05.7634232Z [cluster1] ]
2021-07-14T16:20:05.7634595Z [cluster1] },
2021-07-14T16:20:05.7634961Z [cluster1] "status": {
2021-07-14T16:20:05.7635386Z [cluster1] "conditions": [
2021-07-14T16:20:05.7635778Z [cluster1] {
2021-07-14T16:20:05.7636280Z [cluster1] "lastProbeTime": null,
2021-07-14T16:20:05.7637037Z [cluster1] "lastTransitionTime": "2021-07-14T16:18:53Z",
2021-07-14T16:20:05.7637593Z [cluster1] "status": "True",
2021-07-14T16:20:05.7638062Z [cluster1] "type": "Initialized"
2021-07-14T16:20:05.7638503Z [cluster1] },
2021-07-14T16:20:05.7638853Z [cluster1] {
2021-07-14T16:20:05.7639308Z [cluster1] "lastProbeTime": null,
2021-07-14T16:20:05.7640078Z [cluster1] "lastTransitionTime": "2021-07-14T16:18:54Z",
2021-07-14T16:20:05.7640619Z [cluster1] "status": "True",
2021-07-14T16:20:05.7641064Z [cluster1] "type": "Ready"
2021-07-14T16:20:05.7641457Z [cluster1] },
2021-07-14T16:20:05.7641927Z [cluster1] {
2021-07-14T16:20:05.7642373Z [cluster1] "lastProbeTime": null,
2021-07-14T16:20:05.7643140Z [cluster1] "lastTransitionTime": "2021-07-14T16:18:54Z",
2021-07-14T16:20:05.7643686Z [cluster1] "status": "True",
2021-07-14T16:20:05.7644204Z [cluster1] "type": "ContainersReady"
2021-07-14T16:20:05.7644660Z [cluster1] },
2021-07-14T16:20:05.7645022Z [cluster1] {
2021-07-14T16:20:05.7645486Z [cluster1] "lastProbeTime": null,
2021-07-14T16:20:05.7646221Z [cluster1] "lastTransitionTime": "2021-07-14T16:18:53Z",
2021-07-14T16:20:05.7646778Z [cluster1] "status": "True",
2021-07-14T16:20:05.7647265Z [cluster1] "type": "PodScheduled"
2021-07-14T16:20:05.7647716Z [cluster1] }
2021-07-14T16:20:05.7688563Z [cluster1] ],
2021-07-14T16:20:05.7689073Z [cluster1] "containerStatuses": [
2021-07-14T16:20:05.7689552Z [cluster1] {
2021-07-14T16:20:05.7691078Z [cluster1] "containerID": "containerd://68dc4b454b430347dbc2dfbdf987f7e8867435be091bcd54342bd4fe83eedca0",
2021-07-14T16:20:05.7693194Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-14T16:20:05.7694783Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:2ce83eb8311f1e46b6bb05dfea2f41f88e2193cce581c56fae9f10cde31e799c",
2021-07-14T16:20:05.7696170Z [cluster1] "lastState": {},
2021-07-14T16:20:05.7696874Z [cluster1] "name": "submariner-operator",
2021-07-14T16:20:05.7697422Z [cluster1] "ready": true,
2021-07-14T16:20:05.7697875Z [cluster1] "restartCount": 0,
2021-07-14T16:20:05.7698358Z [cluster1] "started": true,
2021-07-14T16:20:05.7698777Z [cluster1] "state": {
2021-07-14T16:20:05.7699200Z [cluster1] "running": {
2021-07-14T16:20:06.3413024Z [cluster1] "startedAt": "2021-02021-07-14T16:19:01Z"
2021-07-14T16:20:06.3413631Z [cluster2] }
2021-07-14T16:20:06.3414007Z [cluster2] }
2021-07-14T16:20:06.3414364Z [cluster2] }
2021-07-14T16:20:06.3414726Z [cluster2] ],
2021-07-14T16:20:06.3415236Z [cluster2] "hostIP": "172.18.0.5",
2021-07-14T16:20:06.3415688Z [cluster2] "phase": "Running",
2021-07-14T16:20:06.3416116Z [cluster2] "podIP": "10.2.128.5",
2021-07-14T16:20:06.3416548Z [cluster2] "podIPs": [
2021-07-14T16:20:06.3416926Z [cluster2] {
2021-07-14T16:20:06.3417317Z [cluster2] "ip": "10.2.128.5"
2021-07-14T16:20:06.3417686Z [cluster2] }
2021-07-14T16:20:06.3418046Z [cluster2] ],
2021-07-14T16:20:06.3418490Z [cluster2] "qosClass": "BestEffort",
2021-07-14T16:20:06.3419171Z [cluster2] "startTime": "2021-07-14T16:19:00Z"
2021-07-14T16:20:06.3419678Z [cluster2] }
2021-07-14T16:20:06.3420017Z [cluster2] }
2021-07-14T16:20:06.3421411Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.3422863Z [submariner-operator]$ [cluster2] grep Running
2021-07-14T16:20:06.3424408Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.3426658Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.3427881Z [cluster2] Running
2021-07-14T16:20:06.3429138Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator
2021-07-14T16:20:06.3431291Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator
2021-07-14T16:20:06.3433326Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-9gp9g --namespace=submariner-operator
2021-07-14T16:20:06.3434562Z [cluster2] I0714 16:19:02.362830 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-14T16:20:06.3435163Z [cluster2] I0714 16:19:02.362886 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-14T16:20:06.3436022Z [cluster2] I0714 16:19:02.362894 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-14T16:20:06.3436989Z [cluster2] I0714 16:19:02.362909 1 main.go:80] cmd "msg"="Submariner operator version: devel-0aa05fd"
2021-07-14T16:20:06.3437780Z [cluster2] I0714 16:19:02.363109 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-14T16:20:06.3439073Z [cluster2] I0714 16:19:03.048067 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-ggvjv"
2021-07-14T16:20:06.3440102Z [cluster2] I0714 16:19:03.310746 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.3440816Z [cluster2] I0714 16:19:04.441935 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.3441519Z [cluster2] I0714 16:19:06.837497 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.3442242Z [cluster2] I0714 16:19:11.384869 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.3443063Z [cluster2] I0714 16:19:20.095193 1 leader.go:149] leader "msg"="Became the leader."
2021-07-14T16:20:06.3444253Z [cluster2] I0714 16:19:20.699651 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-14T16:20:06.3445163Z [cluster2] I0714 16:19:20.699990 1 main.go:129] cmd "msg"="Registering Components."
2021-07-14T16:20:06.3445874Z [cluster2] I0714 16:19:20.700081 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-14T16:20:06.3446814Z [cluster2] I0714 16:19:25.048533 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3448690Z [cluster2] I0714 16:19:25.048724 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3449745Z [cluster2] I0714 16:19:25.048896 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-14T16:20:06.3450826Z [cluster2] I0714 16:19:25.050018 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-14T16:20:06.3463054Z [cluster2] I0714 16:19:25.050579 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-14T16:20:06.3468050Z [cluster2] I0714 16:19:25.050668 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-14T16:20:06.3473538Z [cluster2] I0714 16:19:25.050782 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-14T16:20:06.3479384Z [cluster2] I0714 16:19:25.050834 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-14T16:20:06.3483383Z [cluster2] I0714 16:19:25.050865 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-14T16:20:06.3486096Z [cluster2] I0714 16:19:25.151584 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.3491482Z [cluster2] I0714 16:19:25.151624 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-14T16:20:06.3493687Z [cluster2] I0714 16:19:25.151662 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-14T16:20:06.3495822Z [cluster2] I0714 16:19:25.151683 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-14T16:20:06.3498565Z [cluster2] I0714 16:19:25.153366 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-14T16:20:06.3502193Z [cluster2] I0714 16:19:25.153376 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-14T16:20:06.3514797Z [cluster2] I0714 16:19:25.153390 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-14T16:20:06.3517206Z [cluster2] I0714 16:19:25.254790 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-14T16:20:06.3518968Z [cluster2] I0714 16:19:25.254831 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-14T16:20:06.3521001Z [cluster2] I0714 16:19:25.254904 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-14T16:20:06.3522938Z [cluster2] I0714 16:19:25.254925 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-14T16:20:06.3524857Z [cluster2] I0714 16:19:25.254985 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3527599Z [cluster2] I0714 16:19:25.255100 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-14T16:20:06.3530136Z [cluster2] I0714 16:19:25.355751 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-14T16:20:06.3531716Z [cluster2] I0714 16:19:25.355798 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-14T16:20:06.3538361Z [cluster2] I0714 16:19:25.355873 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3540003Z [cluster2] I0714 16:19:25.465692 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-14T16:20:06.3546141Z [cluster2] I0714 16:19:25.466078 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-14T16:20:06.3547617Z [cluster2] I0714 16:19:25.466033 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-14T16:20:06.3549283Z [cluster2] I0714 16:19:25.466257 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-14T16:20:06.3550580Z [cluster2] I0714 16:19:25.466326 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3556475Z [cluster2] I0714 16:19:25.466393 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3557678Z [cluster2] I0714 16:19:25.466830 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3558961Z [cluster2] I0714 16:19:25.466931 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3561198Z [cluster2] I0714 16:19:25.503517 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3583794Z [cluster2] E0714 16:19:25.553970 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-14T16:20:06.3586796Z [cluster2] I0714 16:19:25.559348 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3588231Z [cluster2] I0714 16:19:25.559525 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3589410Z [cluster2] I0714 16:19:25.559614 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3591567Z [cluster2] I0714 16:19:25.590396 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3594316Z [cluster2] I0714 16:19:25.742679 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3597696Z [cluster2] E0714 16:19:25.742866 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-14T16:20:06.3600529Z [cluster2] I0714 16:19:25.742954 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3605181Z [cluster2] I0714 16:19:25.743026 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3606434Z [cluster2] I0714 16:19:25.743075 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3608821Z [cluster2] I0714 16:19:25.790898 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3611597Z [cluster2] I0714 16:19:25.896179 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3623340Z [cluster2] E0714 16:19:25.921331 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-14T16:20:06.3640767Z [cluster2] I0714 16:19:25.940002 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3642218Z [cluster2] I0714 16:19:25.940164 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3643524Z [cluster2] I0714 16:19:25.940231 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3645662Z [cluster2] I0714 16:19:26.140760 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3648994Z [cluster2] I0714 16:19:26.294849 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3651784Z [cluster2] I0714 16:19:26.505763 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3654785Z [cluster2] I0714 16:19:26.583959 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3657321Z [cluster2] I0714 16:19:26.682612 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3659644Z [cluster2] I0714 16:19:26.683104 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3662105Z [cluster2] I0714 16:19:26.712596 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-14T16:20:06.3665128Z [cluster2] I0714 16:19:26.719539 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3669034Z [cluster2] E0714 16:19:27.052330 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-14T16:20:06.3672371Z [cluster2] I0714 16:19:27.057401 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3674898Z [cluster2] I0714 16:19:27.058556 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3677645Z [cluster2] I0714 16:19:27.232158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3680681Z [cluster2] I0714 16:19:27.320915 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3683239Z [cluster2] I0714 16:19:27.405515 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3684671Z [cluster2] I0714 16:19:27.405633 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3685957Z [cluster2] I0714 16:19:27.405660 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3709024Z [cluster2] E0714 16:19:27.686920 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3712129Z [cluster2] I0714 16:19:27.687160 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3713556Z [cluster2] I0714 16:19:27.687292 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3714756Z [cluster2] I0714 16:19:27.687347 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3716886Z [cluster2] I0714 16:19:27.702125 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3719859Z [cluster2] I0714 16:19:27.703230 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3723059Z [cluster2] I0714 16:19:27.840932 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3726064Z [cluster2] I0714 16:19:28.074028 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3729451Z [cluster2] I0714 16:19:28.074248 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3733725Z [cluster2] I0714 16:19:28.107388 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3737843Z [cluster2] I0714 16:19:28.392581 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-14T16:20:06.3751519Z [cluster2] I0714 16:19:28.435554 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3754844Z [cluster2] I0714 16:19:28.636645 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3758480Z [cluster2] E0714 16:19:28.639942 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found"
2021-07-14T16:20:06.3762366Z [cluster2] E0714 16:19:28.640005 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-14T16:20:06.3766405Z [cluster2] I0714 16:19:28.640039 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3772244Z [cluster2] I0714 16:19:28.775718 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3775966Z [cluster2] I0714 16:19:28.925484 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3780057Z [cluster2] I0714 16:19:28.952441 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3784239Z [cluster2] I0714 16:19:29.140881 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3787717Z [cluster2] I0714 16:19:29.208146 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3791391Z [cluster2] I0714 16:19:29.957598 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3809534Z [cluster2] I0714 16:19:30.254099 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3811031Z [cluster2] I0714 16:19:30.254141 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3812219Z [cluster2] I0714 16:19:30.254149 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3815169Z [cluster2] I0714 16:19:30.255194 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3818553Z [cluster2] I0714 16:19:30.977112 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3822116Z [cluster2] E0714 16:19:31.294698 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3824711Z [cluster2] I0714 16:19:31.294742 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3826130Z [cluster2] I0714 16:19:31.294782 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3827300Z [cluster2] I0714 16:19:31.294792 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3829416Z [cluster2] I0714 16:19:31.687762 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3832268Z [cluster2] I0714 16:19:31.730631 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3835153Z [cluster2] I0714 16:19:31.745030 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3838043Z [cluster2] I0714 16:19:31.749114 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3842195Z [cluster2] I0714 16:19:31.911678 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3861556Z [cluster2] I0714 16:19:32.291376 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3870794Z [cluster2] I0714 16:19:32.313283 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3874000Z [cluster2] I0714 16:19:32.313560 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3877708Z [cluster2] E0714 16:19:32.898818 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-14T16:20:06.3881192Z [cluster2] I0714 16:19:32.898866 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3883960Z [cluster2] I0714 16:19:32.996883 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3886647Z [cluster2] I0714 16:19:33.000474 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3892871Z [cluster2] I0714 16:19:33.001452 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3895985Z [cluster2] I0714 16:19:33.071163 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3899594Z [cluster2] I0714 16:19:33.121512 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3904613Z [cluster2] I0714 16:19:33.121549 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.3908616Z [cluster2] I0714 16:19:33.226777 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3911425Z [cluster2] I0714 16:19:33.227372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3915063Z [cluster2] I0714 16:19:33.473780 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3918463Z [cluster2] E0714 16:19:33.595285 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3921038Z [cluster2] I0714 16:19:33.595331 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3922848Z [cluster2] I0714 16:19:33.595366 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3924359Z [cluster2] I0714 16:19:33.595375 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3926626Z [cluster2] I0714 16:19:33.777031 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3931501Z [cluster2] I0714 16:19:34.156394 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3934408Z [cluster2] I0714 16:19:34.341593 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3944221Z [cluster2] I0714 16:19:34.341907 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3947838Z [cluster2] I0714 16:19:34.514680 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3951057Z [cluster2] I0714 16:19:34.995663 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3953796Z [cluster2] I0714 16:19:35.177198 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3956652Z [cluster2] I0714 16:19:35.177888 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3959032Z [cluster2] I0714 16:19:35.531745 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3960596Z [cluster2] I0714 16:19:35.531833 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3961788Z [cluster2] I0714 16:19:35.531845 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.3964646Z [cluster2] I0714 16:19:35.534223 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3968954Z [cluster2] I0714 16:19:35.534304 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.3973733Z [cluster2] I0714 16:19:35.717208 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3976366Z [cluster2] I0714 16:19:35.723330 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3979165Z [cluster2] I0714 16:19:35.774380 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3982746Z [cluster2] I0714 16:19:35.774740 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.3986362Z [cluster2] I0714 16:19:35.997261 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.3989968Z [cluster2] I0714 16:19:36.405126 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.3993078Z [cluster2] I0714 16:19:36.545718 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.3995455Z [cluster2] I0714 16:19:36.635973 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.3996884Z [cluster2] I0714 16:19:36.636018 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.3999348Z [cluster2] I0714 16:19:36.636028 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4001195Z [cluster2] I0714 16:19:36.641438 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4002638Z [cluster2] I0714 16:19:36.641499 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4003924Z [cluster2] I0714 16:19:36.641517 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4007166Z [cluster2] I0714 16:19:36.651234 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4012438Z [cluster2] I0714 16:19:36.757446 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4015918Z [cluster2] I0714 16:19:36.768140 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4018688Z [cluster2] I0714 16:19:36.769431 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4021746Z [cluster2] I0714 16:19:36.806363 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4051672Z [cluster2] I0714 16:19:36.806827 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4054461Z [cluster2] I0714 16:19:36.863147 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4057335Z [cluster2] I0714 16:19:37.409018 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4060374Z [cluster2] I0714 16:19:37.414439 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4063008Z [cluster2] I0714 16:19:37.414482 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4066796Z [cluster2] I0714 16:19:37.414512 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.4070383Z [cluster2] I0714 16:19:37.440305 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4073125Z [cluster2] I0714 16:19:37.489431 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4075572Z [cluster2] I0714 16:19:37.536591 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4077137Z [cluster2] I0714 16:19:37.537738 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4078591Z [cluster2] I0714 16:19:37.537770 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4080735Z [cluster2] I0714 16:19:37.548722 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4083270Z [cluster2] I0714 16:19:37.549251 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4086064Z [cluster2] I0714 16:19:37.571128 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4100863Z [cluster2] E0714 16:19:37.614681 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4103595Z [cluster2] I0714 16:19:37.614757 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4105333Z [cluster2] I0714 16:19:37.614880 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4106519Z [cluster2] I0714 16:19:37.614898 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4109036Z [cluster2] I0714 16:19:37.641162 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4112044Z [cluster2] I0714 16:19:37.657134 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4114787Z [cluster2] I0714 16:19:37.658216 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4117804Z [cluster2] I0714 16:19:37.671809 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4121044Z [cluster2] I0714 16:19:37.712236 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4123891Z [cluster2] I0714 16:19:38.265387 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4126850Z [cluster2] I0714 16:19:38.284178 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4130346Z [cluster2] I0714 16:19:38.286711 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4133478Z [cluster2] I0714 16:19:38.296964 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4136878Z [cluster2] I0714 16:19:38.313164 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4139973Z [cluster2] I0714 16:19:38.371057 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4142807Z [cluster2] I0714 16:19:38.430031 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4145897Z [cluster2] I0714 16:19:38.915241 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4148647Z [cluster2] I0714 16:19:39.054395 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4152452Z [cluster2] I0714 16:19:39.054443 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.4155564Z [cluster2] I0714 16:19:40.240986 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4157007Z [cluster2] I0714 16:19:40.241203 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4158216Z [cluster2] I0714 16:19:40.241283 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4160355Z [cluster2] I0714 16:19:40.250014 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4163142Z [cluster2] I0714 16:19:40.254051 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4166180Z [cluster2] I0714 16:19:40.856491 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4193364Z [cluster2] I0714 16:19:40.862971 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4195783Z [cluster2] I0714 16:19:40.921077 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4197196Z [cluster2] I0714 16:19:40.921329 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4198390Z [cluster2] I0714 16:19:40.921401 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4200091Z [cluster2] I0714 16:19:40.968940 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4201499Z [cluster2] I0714 16:19:40.969161 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4202932Z [cluster2] I0714 16:19:40.969234 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4205065Z [cluster2] I0714 16:19:41.017796 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4207766Z [cluster2] I0714 16:19:41.041485 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4210638Z [cluster2] I0714 16:19:41.069125 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4213238Z [cluster2] I0714 16:19:41.094554 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4216239Z [cluster2] I0714 16:19:41.095205 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4219436Z [cluster2] I0714 16:19:41.131077 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4222503Z [cluster2] I0714 16:19:41.157899 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4225583Z [cluster2] I0714 16:19:41.696508 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4228333Z [cluster2] I0714 16:19:41.702075 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4230639Z [cluster2] I0714 16:19:41.711136 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4232054Z [cluster2] I0714 16:19:41.711183 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4233238Z [cluster2] I0714 16:19:41.711311 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4235337Z [cluster2] I0714 16:19:41.718028 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4238113Z [cluster2] I0714 16:19:41.722842 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4240941Z [cluster2] I0714 16:19:41.738361 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4243693Z [cluster2] I0714 16:19:41.748478 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4246796Z [cluster2] E0714 16:19:41.754816 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4271162Z [cluster2] I0714 16:19:41.755040 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4272628Z [cluster2] I0714 16:19:41.755115 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4273835Z [cluster2] I0714 16:19:41.755132 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4276074Z [cluster2] I0714 16:19:41.761324 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4278865Z [cluster2] I0714 16:19:41.764742 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4281991Z [cluster2] I0714 16:19:41.776017 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4285200Z [cluster2] I0714 16:19:41.780313 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4288600Z [cluster2] I0714 16:19:41.783585 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4291644Z [cluster2] I0714 16:19:42.324705 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4294377Z [cluster2] I0714 16:19:42.330101 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4296698Z [cluster2] I0714 16:19:42.339067 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4298196Z [cluster2] I0714 16:19:42.339147 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4299380Z [cluster2] I0714 16:19:42.339164 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4301509Z [cluster2] I0714 16:19:42.345611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4304270Z [cluster2] I0714 16:19:42.348898 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4307043Z [cluster2] I0714 16:19:42.366741 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4309762Z [cluster2] I0714 16:19:42.372404 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4312925Z [cluster2] E0714 16:19:42.378166 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4315500Z [cluster2] I0714 16:19:42.378224 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4316930Z [cluster2] I0714 16:19:42.378286 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4318182Z [cluster2] I0714 16:19:42.378300 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4320522Z [cluster2] I0714 16:19:42.385558 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4323342Z [cluster2] I0714 16:19:42.395158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4325984Z [cluster2] I0714 16:19:42.396331 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4364478Z [cluster2] I0714 16:19:42.396493 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.4368142Z [cluster2] I0714 16:19:42.406308 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4370882Z [cluster2] I0714 16:19:42.410548 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4373922Z [cluster2] I0714 16:19:42.432479 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4377155Z [cluster2] I0714 16:19:42.438379 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4380158Z [cluster2] I0714 16:19:42.951145 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4383156Z [cluster2] I0714 16:19:42.962939 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4385927Z [cluster2] I0714 16:19:43.012989 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4388678Z [cluster2] I0714 16:19:43.017909 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4391740Z [cluster2] I0714 16:19:43.040320 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4394896Z [cluster2] I0714 16:19:43.044593 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.4398231Z [cluster2] I0714 16:19:43.048000 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4401360Z [cluster2] I0714 16:19:43.650434 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4404089Z [cluster2] I0714 16:19:43.652500 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4421424Z [cluster2] I0714 16:19:43.652543 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.15.232\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.4424755Z [cluster2] I0714 16:19:46.980763 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4426217Z [cluster2] I0714 16:19:46.981096 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4427424Z [cluster2] I0714 16:19:46.981108 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4429558Z [cluster2] I0714 16:19:46.998705 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4432362Z [cluster2] I0714 16:19:47.003221 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4435110Z [cluster2] I0714 16:19:47.605314 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4437846Z [cluster2] I0714 16:19:47.612628 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4440337Z [cluster2] I0714 16:19:47.624900 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4441864Z [cluster2] I0714 16:19:47.625985 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4443148Z [cluster2] I0714 16:19:47.626170 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4444921Z [cluster2] I0714 16:19:47.633047 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4446339Z [cluster2] I0714 16:19:47.633221 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4447531Z [cluster2] I0714 16:19:47.633238 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4449749Z [cluster2] I0714 16:19:47.636722 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4452605Z [cluster2] I0714 16:19:47.641813 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4455472Z [cluster2] I0714 16:19:47.671176 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4458260Z [cluster2] I0714 16:19:47.675404 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4461025Z [cluster2] I0714 16:19:48.243897 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4463776Z [cluster2] I0714 16:19:48.261505 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4466527Z [cluster2] I0714 16:19:48.281426 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4469282Z [cluster2] I0714 16:19:48.296244 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4471643Z [cluster2] I0714 16:19:52.005246 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4473062Z [cluster2] I0714 16:19:52.005346 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4474337Z [cluster2] I0714 16:19:52.005366 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4476479Z [cluster2] I0714 16:19:52.019693 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4479235Z [cluster2] I0714 16:19:52.024495 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4481997Z [cluster2] I0714 16:19:52.626767 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4484745Z [cluster2] I0714 16:19:52.632182 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4487066Z [cluster2] I0714 16:19:52.643986 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4488663Z [cluster2] I0714 16:19:52.644193 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4489861Z [cluster2] I0714 16:19:52.644274 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4491551Z [cluster2] I0714 16:19:52.646478 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4492950Z [cluster2] I0714 16:19:52.646646 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4494131Z [cluster2] I0714 16:19:52.646726 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4496294Z [cluster2] I0714 16:19:52.667904 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4499043Z [cluster2] I0714 16:19:52.688319 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4501785Z [cluster2] I0714 16:19:52.688850 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4504534Z [cluster2] I0714 16:19:52.724367 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4507261Z [cluster2] I0714 16:19:53.290136 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4510083Z [cluster2] I0714 16:19:53.297480 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4512863Z [cluster2] I0714 16:19:53.330737 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4515615Z [cluster2] I0714 16:19:53.347245 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4517945Z [cluster2] I0714 16:19:57.034910 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4519360Z [cluster2] I0714 16:19:57.035010 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4520542Z [cluster2] I0714 16:19:57.035021 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4522660Z [cluster2] I0714 16:19:57.045332 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4525501Z [cluster2] I0714 16:19:57.049775 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4602927Z [cluster2] I0714 16:19:57.651273 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4606182Z [cluster2] I0714 16:19:57.657469 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4608695Z [cluster2] I0714 16:19:57.666488 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4610146Z [cluster2] I0714 16:19:57.666539 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4611333Z [cluster2] I0714 16:19:57.666549 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4613049Z [cluster2] I0714 16:19:57.668064 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4614466Z [cluster2] I0714 16:19:57.668102 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4615652Z [cluster2] I0714 16:19:57.668113 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4618045Z [cluster2] I0714 16:19:57.678046 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4620859Z [cluster2] I0714 16:19:57.681409 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4623638Z [cluster2] I0714 16:19:57.683815 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4626420Z [cluster2] I0714 16:19:57.695619 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4629174Z [cluster2] I0714 16:19:58.294748 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4631863Z [cluster2] I0714 16:19:58.338373 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4634712Z [cluster2] I0714 16:19:58.362458 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4637593Z [cluster2] I0714 16:19:58.390734 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4640007Z [cluster2] I0714 16:20:02.057641 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4641420Z [cluster2] I0714 16:20:02.057706 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.4642615Z [cluster2] I0714 16:20:02.057715 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:06.4644747Z [cluster2] I0714 16:20:02.071497 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4647508Z [cluster2] I0714 16:20:02.076238 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.4683350Z [cluster2] I0714 16:20:02.681897 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.4686116Z [cluster2] I0714 16:20:02.694991 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.4688753Z [cluster2] I0714 16:20:02.713749 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.4690392Z [cluster2] I0714 16:20:02.713797 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5452135Z [cluster2] I0714 16:20:02.713807 1 subma7-14T16:18:53Z"
2021-07-14T16:20:06.5452630Z [cluster1] }
2021-07-14T16:20:06.5453009Z [cluster1] }
2021-07-14T16:20:06.5453406Z [cluster1] }
2021-07-14T16:20:06.5453755Z [cluster1] ],
2021-07-14T16:20:06.5454164Z [cluster1] "hostIP": "172.18.0.9",
2021-07-14T16:20:06.5454603Z [cluster1] "phase": "Running",
2021-07-14T16:20:06.5455145Z [cluster1] "podIP": "10.1.0.6",
2021-07-14T16:20:06.5455555Z [cluster1] "podIPs": [
2021-07-14T16:20:06.5455953Z [cluster1] {
2021-07-14T16:20:06.5456328Z [cluster1] "ip": "10.1.0.6"
2021-07-14T16:20:06.5456720Z [cluster1] }
2021-07-14T16:20:06.5457079Z [cluster1] ],
2021-07-14T16:20:06.5457527Z [cluster1] "qosClass": "BestEffort",
2021-07-14T16:20:06.5458216Z [cluster1] "startTime": "2021-07-14T16:18:53Z"
2021-07-14T16:20:06.5458626Z [cluster1] }
2021-07-14T16:20:06.5458978Z [cluster1] }
2021-07-14T16:20:06.5460508Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.5462525Z [submariner-operator]$ [cluster1] grep Running
2021-07-14T16:20:06.5464069Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.5471592Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-14T16:20:06.5472884Z [cluster1] Running
2021-07-14T16:20:06.5474128Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator
2021-07-14T16:20:06.5475996Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator
2021-07-14T16:20:06.5477985Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-vncqj --namespace=submariner-operator
2021-07-14T16:20:06.5479235Z [cluster1] I0714 16:18:54.279108 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-14T16:20:06.5479857Z [cluster1] I0714 16:18:54.279160 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-14T16:20:06.5480705Z [cluster1] I0714 16:18:54.279166 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-14T16:20:06.5481667Z [cluster1] I0714 16:18:54.279172 1 main.go:80] cmd "msg"="Submariner operator version: devel-0aa05fd"
2021-07-14T16:20:06.5482445Z [cluster1] I0714 16:18:54.279499 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-14T16:20:06.5483736Z [cluster1] I0714 16:18:54.946810 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-bt8hm"
2021-07-14T16:20:06.5484775Z [cluster1] I0714 16:18:55.127004 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.5485473Z [cluster1] I0714 16:18:56.259194 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.5486191Z [cluster1] I0714 16:18:58.645442 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.5487077Z [cluster1] I0714 16:19:03.270093 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-14T16:20:06.5487988Z [cluster1] I0714 16:19:11.978322 1 leader.go:149] leader "msg"="Became the leader."
2021-07-14T16:20:06.5489369Z [cluster1] I0714 16:19:12.581851 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-14T16:20:06.5490266Z [cluster1] I0714 16:19:12.582132 1 main.go:129] cmd "msg"="Registering Components."
2021-07-14T16:20:06.5490989Z [cluster1] I0714 16:19:12.582258 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-14T16:20:06.5491920Z [cluster1] I0714 16:19:16.316264 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5493694Z [cluster1] I0714 16:19:16.316304 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5494769Z [cluster1] I0714 16:19:16.316348 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-14T16:20:06.5495952Z [cluster1] I0714 16:19:16.316634 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-14T16:20:06.5546195Z [cluster1] I0714 16:19:16.317173 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-14T16:20:06.5554125Z [cluster1] I0714 16:19:16.317377 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-14T16:20:06.5559874Z [cluster1] I0714 16:19:16.317497 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-14T16:20:06.5563928Z [cluster1] I0714 16:19:16.317593 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-14T16:20:06.5567193Z [cluster1] I0714 16:19:16.317717 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-14T16:20:06.5569498Z [cluster1] I0714 16:19:16.417673 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-14T16:20:06.5571739Z [cluster1] I0714 16:19:16.417930 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-14T16:20:06.5573702Z [cluster1] I0714 16:19:16.418051 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5575532Z [cluster1] I0714 16:19:16.418136 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-14T16:20:06.5578093Z [cluster1] I0714 16:19:16.419147 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-14T16:20:06.5581854Z [cluster1] I0714 16:19:16.419458 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-14T16:20:06.5666196Z [cluster1] I0714 16:19:16.419548 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-14T16:20:06.5668717Z [cluster1] I0714 16:19:16.519373 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-14T16:20:06.5670643Z [cluster1] I0714 16:19:16.519421 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-14T16:20:06.5673582Z [cluster1] I0714 16:19:16.519663 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-14T16:20:06.5676029Z [cluster1] I0714 16:19:16.519862 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-14T16:20:06.5678363Z [cluster1] E0714 16:19:16.572245 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5680505Z [cluster1] I0714 16:19:16.619878 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-14T16:20:06.5682101Z [cluster1] I0714 16:19:16.619915 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-14T16:20:06.5683797Z [cluster1] I0714 16:19:16.620060 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-14T16:20:06.5686356Z [cluster1] E0714 16:19:16.629787 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5689342Z [cluster1] E0714 16:19:16.719750 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5692309Z [cluster1] E0714 16:19:16.785101 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5695166Z [cluster1] E0714 16:19:16.870097 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5698016Z [cluster1] E0714 16:19:17.129567 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5700954Z [cluster1] E0714 16:19:17.481298 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5703900Z [cluster1] E0714 16:19:17.875653 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5706745Z [cluster1] E0714 16:19:18.558710 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5709083Z [cluster1] I0714 16:19:18.796025 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5710990Z [cluster1] I0714 16:19:18.796761 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5712361Z [cluster1] I0714 16:19:18.856946 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-14T16:20:06.5713852Z [cluster1] I0714 16:19:18.857120 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-14T16:20:06.5715131Z [cluster1] I0714 16:19:18.857175 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5716316Z [cluster1] I0714 16:19:18.857222 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5718468Z [cluster1] I0714 16:19:18.866646 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5720220Z [cluster1] I0714 16:19:18.869945 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-14T16:20:06.5721731Z [cluster1] I0714 16:19:18.869976 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-14T16:20:06.5745764Z [cluster1] I0714 16:19:18.869986 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5747200Z [cluster1] I0714 16:19:18.869995 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5749706Z [cluster1] I0714 16:19:18.898373 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5752453Z [cluster1] I0714 16:19:18.924541 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5755238Z [cluster1] I0714 16:19:19.046541 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5758385Z [cluster1] I0714 16:19:19.527366 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5761091Z [cluster1] I0714 16:19:19.532208 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5763616Z [cluster1] I0714 16:19:19.538900 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5765944Z [cluster1] I0714 16:19:19.539130 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5768832Z [cluster1] I0714 16:19:19.539934 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-14T16:20:06.5774925Z [cluster1] I0714 16:19:19.545774 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5778845Z [cluster1] E0714 16:19:19.549578 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-14T16:20:06.5784589Z [cluster1] I0714 16:19:19.553388 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5787467Z [cluster1] I0714 16:19:19.555353 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5798401Z [cluster1] I0714 16:19:19.663381 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5801845Z [cluster1] I0714 16:19:19.679112 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5804131Z [cluster1] I0714 16:19:19.713446 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5805777Z [cluster1] I0714 16:19:19.713581 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5806963Z [cluster1] I0714 16:19:19.713635 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5809727Z [cluster1] I0714 16:19:19.728096 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5813506Z [cluster1] I0714 16:19:19.728617 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5816272Z [cluster1] I0714 16:19:19.742569 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5819388Z [cluster1] E0714 16:19:19.768690 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5822329Z [cluster1] I0714 16:19:19.768900 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5823773Z [cluster1] I0714 16:19:19.769023 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5824958Z [cluster1] I0714 16:19:19.769068 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5827134Z [cluster1] I0714 16:19:19.807372 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5830040Z [cluster1] I0714 16:19:19.808715 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5832815Z [cluster1] I0714 16:19:19.821152 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5835932Z [cluster1] E0714 16:19:19.895099 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5838873Z [cluster1] I0714 16:19:20.158287 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5842257Z [cluster1] I0714 16:19:20.294462 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-14T16:20:06.5845803Z [cluster1] E0714 16:19:20.294769 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-14T16:20:06.5850422Z [cluster1] E0714 16:19:20.300492 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-14T16:20:06.5854337Z [cluster1] I0714 16:19:20.300899 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5857022Z [cluster1] I0714 16:19:20.341099 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5860447Z [cluster1] I0714 16:19:20.365573 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5864421Z [cluster1] I0714 16:19:20.400754 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5867907Z [cluster1] I0714 16:19:20.425918 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5871117Z [cluster1] I0714 16:19:20.538670 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5874430Z [cluster1] I0714 16:19:20.556769 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5877319Z [cluster1] I0714 16:19:20.593873 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5880076Z [cluster1] I0714 16:19:20.686837 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5882850Z [cluster1] I0714 16:19:20.746173 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5885990Z [cluster1] E0714 16:19:20.919306 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5889523Z [cluster1] I0714 16:19:20.919458 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5891086Z [cluster1] I0714 16:19:20.919491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5892285Z [cluster1] I0714 16:19:20.919499 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5894283Z [cluster1] I0714 16:19:20.920994 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5895705Z [cluster1] I0714 16:19:20.921037 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.5896885Z [cluster1] I0714 16:19:20.921048 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.5907780Z [cluster1] I0714 16:19:20.973837 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5917185Z [cluster1] I0714 16:19:21.250368 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5920394Z [cluster1] I0714 16:19:21.250856 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5923286Z [cluster1] I0714 16:19:21.326466 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5926316Z [cluster1] I0714 16:19:21.461697 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5929789Z [cluster1] I0714 16:19:21.461967 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5932681Z [cluster1] I0714 16:19:21.660275 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5935901Z [cluster1] I0714 16:19:21.863823 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5940033Z [cluster1] I0714 16:19:21.863864 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.159.120\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.5944002Z [cluster1] I0714 16:19:21.921150 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5947254Z [cluster1] I0714 16:19:22.140996 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5950891Z [cluster1] I0714 16:19:22.141938 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5954577Z [cluster1] I0714 16:19:22.257097 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5958947Z [cluster1] I0714 16:19:22.324151 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5962003Z [cluster1] I0714 16:19:22.324893 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.5964866Z [cluster1] I0714 16:19:22.879134 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.5976218Z [cluster1] I0714 16:19:22.898388 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5980289Z [cluster1] I0714 16:19:22.898436 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.159.120\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.5983628Z [cluster1] I0714 16:19:22.911849 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.5986433Z [cluster1] I0714 16:19:22.940108 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.5989660Z [cluster1] I0714 16:19:22.976211 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.5992885Z [cluster1] E0714 16:19:23.147057 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.5996290Z [cluster1] I0714 16:19:23.585168 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6000334Z [cluster1] I0714 16:19:23.601618 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.6069320Z [cluster1] I0714 16:19:23.622908 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6072584Z [cluster1] I0714 16:19:24.227142 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6075298Z [cluster1] I0714 16:19:24.233407 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6079612Z [cluster1] I0714 16:19:24.233449 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.159.120\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.6082862Z [cluster1] I0714 16:19:27.189877 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6084380Z [cluster1] I0714 16:19:27.189932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6085576Z [cluster1] I0714 16:19:27.189942 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6088025Z [cluster1] I0714 16:19:27.304636 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6090905Z [cluster1] I0714 16:19:27.374305 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6093885Z [cluster1] I0714 16:19:27.978039 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6096773Z [cluster1] I0714 16:19:28.012136 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6099091Z [cluster1] I0714 16:19:28.051408 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6100505Z [cluster1] I0714 16:19:28.051523 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6101684Z [cluster1] I0714 16:19:28.051550 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6103375Z [cluster1] I0714 16:19:28.060934 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6104762Z [cluster1] I0714 16:19:28.088788 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6105929Z [cluster1] I0714 16:19:28.088879 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6108021Z [cluster1] I0714 16:19:28.215125 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6110825Z [cluster1] I0714 16:19:28.215641 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6113714Z [cluster1] I0714 16:19:28.235512 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6116534Z [cluster1] I0714 16:19:28.440945 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6119266Z [cluster1] I0714 16:19:28.943370 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6121994Z [cluster1] I0714 16:19:29.005762 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6124842Z [cluster1] E0714 16:19:29.131788 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.6127615Z [cluster1] I0714 16:19:29.175751 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6130670Z [cluster1] I0714 16:19:29.350683 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6132982Z [cluster1] I0714 16:19:29.589053 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6134388Z [cluster1] I0714 16:19:29.589095 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6135607Z [cluster1] I0714 16:19:29.589104 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6137719Z [cluster1] I0714 16:19:29.631420 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6140470Z [cluster1] I0714 16:19:29.662226 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6143233Z [cluster1] I0714 16:19:30.266038 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6145964Z [cluster1] I0714 16:19:30.445750 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6148480Z [cluster1] I0714 16:19:30.483641 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6208436Z [cluster1] I0714 16:19:30.493146 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6210899Z [cluster1] I0714 16:19:30.493315 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6212308Z [cluster1] I0714 16:19:30.493373 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6213676Z [cluster1] I0714 16:19:30.493393 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6214910Z [cluster1] I0714 16:19:30.493430 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6216087Z [cluster1] I0714 16:19:30.493460 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6218238Z [cluster1] I0714 16:19:30.545910 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6221295Z [cluster1] I0714 16:19:30.546558 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.6224451Z [cluster1] I0714 16:19:30.547102 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6227242Z [cluster1] I0714 16:19:30.644246 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6230430Z [cluster1] I0714 16:19:30.644647 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6233481Z [cluster1] I0714 16:19:30.645163 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6236286Z [cluster1] I0714 16:19:31.252345 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6239104Z [cluster1] I0714 16:19:31.254684 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6241865Z [cluster1] I0714 16:19:31.257736 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6244673Z [cluster1] I0714 16:19:31.349350 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6248001Z [cluster1] I0714 16:19:31.350034 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.6251010Z [cluster1] I0714 16:19:31.350520 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6254075Z [cluster1] I0714 16:19:31.377863 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6257354Z [cluster1] I0714 16:19:31.979663 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6260163Z [cluster1] I0714 16:19:31.982111 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6264135Z [cluster1] I0714 16:19:31.982202 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.159.120\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.6267237Z [cluster1] I0714 16:19:32.431543 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6268651Z [cluster1] I0714 16:19:32.454377 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6269828Z [cluster1] I0714 16:19:32.454568 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6271956Z [cluster1] I0714 16:19:32.473535 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6274732Z [cluster1] I0714 16:19:32.487139 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6277488Z [cluster1] I0714 16:19:33.092120 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6280215Z [cluster1] I0714 16:19:33.127589 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6282595Z [cluster1] I0714 16:19:33.155789 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6284038Z [cluster1] I0714 16:19:33.155846 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6285217Z [cluster1] I0714 16:19:33.156035 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6286878Z [cluster1] I0714 16:19:33.158030 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6330275Z [cluster1] I0714 16:19:33.158072 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6331621Z [cluster1] I0714 16:19:33.158594 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6333932Z [cluster1] I0714 16:19:33.192589 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6337024Z [cluster1] I0714 16:19:33.278232 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6339906Z [cluster1] I0714 16:19:33.365675 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6342675Z [cluster1] I0714 16:19:33.435472 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6345438Z [cluster1] I0714 16:19:33.880077 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6348177Z [cluster1] I0714 16:19:33.897895 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6350513Z [cluster1] I0714 16:19:33.925876 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6351921Z [cluster1] I0714 16:19:33.926091 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6353115Z [cluster1] I0714 16:19:33.926171 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6355236Z [cluster1] I0714 16:19:33.958407 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6358112Z [cluster1] I0714 16:19:33.977097 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6360876Z [cluster1] I0714 16:19:34.041606 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6363591Z [cluster1] I0714 16:19:34.050469 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6366765Z [cluster1] E0714 16:19:34.063780 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6369507Z [cluster1] I0714 16:19:34.068470 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6370905Z [cluster1] I0714 16:19:34.068653 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6372183Z [cluster1] I0714 16:19:34.068721 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6374302Z [cluster1] I0714 16:19:34.098741 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6377069Z [cluster1] I0714 16:19:34.127695 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6379595Z [cluster1] I0714 16:19:34.252038 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6382401Z [cluster1] I0714 16:19:34.300501 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.6385766Z [cluster1] I0714 16:19:34.347597 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6388821Z [cluster1] I0714 16:19:34.583997 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6449309Z [cluster1] I0714 16:19:34.623610 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6452648Z [cluster1] I0714 16:19:34.757256 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6455644Z [cluster1] I0714 16:19:34.779011 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6458618Z [cluster1] I0714 16:19:34.951931 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6462019Z [cluster1] I0714 16:19:34.980910 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-14T16:20:06.6465472Z [cluster1] I0714 16:19:34.988837 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6468706Z [cluster1] I0714 16:19:35.599629 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6471595Z [cluster1] I0714 16:19:35.606610 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6475497Z [cluster1] I0714 16:19:35.606657 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.159.120\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-14T16:20:06.6490609Z [cluster1] I0714 16:19:39.000977 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6492348Z [cluster1] I0714 16:19:39.001044 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6493674Z [cluster1] I0714 16:19:39.001062 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6495967Z [cluster1] I0714 16:19:39.043909 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6498750Z [cluster1] I0714 16:19:39.100791 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6501779Z [cluster1] E0714 16:19:39.533657 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:06.6504580Z [cluster1] I0714 16:19:39.703199 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6507293Z [cluster1] I0714 16:19:39.710015 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6509628Z [cluster1] I0714 16:19:39.721753 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6511044Z [cluster1] I0714 16:19:39.721969 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6512224Z [cluster1] I0714 16:19:39.722054 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6513906Z [cluster1] I0714 16:19:39.728490 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6515385Z [cluster1] I0714 16:19:39.728690 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6516567Z [cluster1] I0714 16:19:39.728772 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6518698Z [cluster1] I0714 16:19:39.747687 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6521404Z [cluster1] I0714 16:19:39.756457 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6524154Z [cluster1] I0714 16:19:39.764082 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6580337Z [cluster1] I0714 16:19:39.764896 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6583460Z [cluster1] I0714 16:19:40.366557 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6586157Z [cluster1] I0714 16:19:40.367534 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6589011Z [cluster1] I0714 16:19:40.379001 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6592010Z [cluster1] I0714 16:19:40.384630 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6594319Z [cluster1] I0714 16:19:44.055298 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6595743Z [cluster1] I0714 16:19:44.055351 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6596908Z [cluster1] I0714 16:19:44.055361 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6599018Z [cluster1] I0714 16:19:44.062531 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6601779Z [cluster1] I0714 16:19:44.067169 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6604534Z [cluster1] I0714 16:19:44.669665 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6607353Z [cluster1] I0714 16:19:44.675388 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6610038Z [cluster1] I0714 16:19:44.687319 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6611546Z [cluster1] I0714 16:19:44.687478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6612714Z [cluster1] I0714 16:19:44.687495 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6614401Z [cluster1] I0714 16:19:44.696546 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6615809Z [cluster1] I0714 16:19:44.696711 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6616973Z [cluster1] I0714 16:19:44.696730 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6619086Z [cluster1] I0714 16:19:44.713534 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6621784Z [cluster1] I0714 16:19:44.715485 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6624630Z [cluster1] I0714 16:19:44.718909 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6627459Z [cluster1] I0714 16:19:44.719282 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6630205Z [cluster1] I0714 16:19:45.321238 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6632882Z [cluster1] I0714 16:19:45.321518 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6635649Z [cluster1] I0714 16:19:45.338129 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6638418Z [cluster1] I0714 16:19:45.338697 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6640797Z [cluster1] I0714 16:19:49.074071 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6642205Z [cluster1] I0714 16:19:49.074135 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6678358Z [cluster1] I0714 16:19:49.074146 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6680843Z [cluster1] I0714 16:19:49.103833 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6683705Z [cluster1] I0714 16:19:49.121571 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:06.6686556Z [cluster1] I0714 16:19:49.723768 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:06.6689408Z [cluster1] I0714 16:19:49.730032 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6691813Z [cluster1] I0714 16:19:49.744521 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6693382Z [cluster1] I0714 16:19:49.744574 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6694576Z [cluster1] I0714 16:19:49.744584 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6696508Z [cluster1] I0714 16:19:49.747317 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:06.6697935Z [cluster1] I0714 16:19:49.747357 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-14T16:20:06.6699111Z [cluster1] I0714 16:19:49.747366 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-14T16:20:06.6701218Z [cluster1] I0714 16:19:49.755975 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:06.6703976Z [cluster1] I0714 16:19:49.767965 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:07.1303907Z [cluster1] I0714 16:19:49.769831 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespriner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:07.1306871Z [cluster2] I0714 16:20:02.714205 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-14T16:20:07.1308694Z [cluster2] I0714 16:20:02.714244 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-14T16:20:07.1309975Z [cluster2] I0714 16:20:02.714253 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-14T16:20:07.1312162Z [cluster2] I0714 16:20:02.731672 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.1314899Z [cluster2] I0714 16:20:02.734985 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.1317651Z [cluster2] I0714 16:20:02.745290 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:07.1320451Z [cluster2] I0714 16:20:02.745609 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:07.1323212Z [cluster2] I0714 16:20:03.349998 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:07.1325992Z [cluster2] I0714 16:20:03.353067 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:07.1329556Z [cluster2] I0714 16:20:03.360174 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.1332413Z [cluster2] I0714 16:20:03.360664 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.1334129Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-14T16:20:07.1334957Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-14T16:20:07.1336057Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-14T16:20:07.1337130Z [submariner-operator]$ [cluster2] grep submariner
2021-07-14T16:20:07.1338271Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-14T16:20:07.1339693Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-14T16:20:07.1340564Z [cluster2] submariner 52s
2021-07-14T16:20:07.1341477Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-14T16:20:07.1342780Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.1344072Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-14T16:20:07.1345377Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.1347022Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.1347915Z [cluster2] {
2021-07-14T16:20:07.1348408Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.1348969Z [cluster2] "kind": "Submariner",
2021-07-14T16:20:07.1349403Z [cluster2] "metadata": {
2021-07-14T16:20:07.1350094Z [cluster2] "creationTimestamp": "2021-07-14T16:19:14Z",
2021-07-14T16:20:07.1350650Z [cluster2] "generation": 1,
2021-07-14T16:20:07.1351122Z [cluster2] "managedFields": [
2021-07-14T16:20:07.1351561Z [cluster2] {
2021-07-14T16:20:07.1352067Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.1352676Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:07.1353156Z [cluster2] "fieldsV1": {
2021-07-14T16:20:07.1353590Z [cluster2] "f:spec": {
2021-07-14T16:20:07.1354003Z [cluster2] ".": {},
2021-07-14T16:20:07.1354422Z [cluster2] "f:broker": {},
2021-07-14T16:20:07.1354952Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-14T16:20:07.1355644Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-14T16:20:07.1356266Z [cluster2] "f:brokerK8sCA": {},
2021-07-14T16:20:07.1356884Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-14T16:20:07.1357515Z [cluster2] "f:cableDriver": {},
2021-07-14T16:20:07.1358023Z [cluster2] "f:ceIPSecDebug": {},
2021-07-14T16:20:07.1358575Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-14T16:20:07.1359139Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-14T16:20:07.1359684Z [cluster2] "f:ceIPSecPSK": {},
2021-07-14T16:20:07.1360180Z [cluster2] "f:clusterCIDR": {},
2021-07-14T16:20:07.1360672Z [cluster2] "f:clusterID": {},
2021-07-14T16:20:07.1361161Z [cluster2] "f:colorCodes": {},
2021-07-14T16:20:07.1361737Z [cluster2] "f:connectionHealthCheck": {
2021-07-14T16:20:07.1362281Z [cluster2] ".": {},
2021-07-14T16:20:07.1362703Z [cluster2] "f:enabled": {},
2021-07-14T16:20:07.1363316Z [cluster2] "f:intervalSeconds": {},
2021-07-14T16:20:07.1363908Z [cluster2] "f:maxPacketLossCount": {}
2021-07-14T16:20:07.1364414Z [cluster2] },
2021-07-14T16:20:07.1364813Z [cluster2] "f:debug": {},
2021-07-14T16:20:07.1365274Z [cluster2] "f:namespace": {},
2021-07-14T16:20:07.1365760Z [cluster2] "f:natEnabled": {},
2021-07-14T16:20:07.1366235Z [cluster2] "f:repository": {},
2021-07-14T16:20:07.1366739Z [cluster2] "f:serviceCIDR": {},
2021-07-14T16:20:07.1367352Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-14T16:20:07.1383679Z [cluster2] "f:version": {}
2021-07-14T16:20:07.1384182Z [cluster2] }
2021-07-14T16:20:07.1384556Z [cluster2] },
2021-07-14T16:20:07.1384970Z [cluster2] "manager": "subctl",
2021-07-14T16:20:07.1385469Z [cluster2] "operation": "Update",
2021-07-14T16:20:07.1386417Z [cluster2] "time": "2021-07-14T16:19:14Z"
2021-07-14T16:20:07.1386827Z [cluster2] },
2021-07-14T16:20:07.1387190Z [cluster2] {
2021-07-14T16:20:07.1387700Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.1388300Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:07.1388775Z [cluster2] "fieldsV1": {
2021-07-14T16:20:07.1389453Z [cluster2] "f:status": {
2021-07-14T16:20:07.1389856Z [cluster2] ".": {},
2021-07-14T16:20:07.1390306Z [cluster2] "f:clusterCIDR": {},
2021-07-14T16:20:07.1390785Z [cluster2] "f:clusterID": {},
2021-07-14T16:20:07.1391267Z [cluster2] "f:colorCodes": {},
2021-07-14T16:20:07.1391796Z [cluster2] "f:deploymentInfo": {},
2021-07-14T16:20:07.1392420Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-14T16:20:07.1392974Z [cluster2] ".": {},
2021-07-14T16:20:07.1393497Z [cluster2] "f:lastResourceVersion": {},
2021-07-14T16:20:07.1394219Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-14T16:20:07.1394975Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-14T16:20:07.1395571Z [cluster2] "f:status": {
2021-07-14T16:20:07.1395988Z [cluster2] ".": {},
2021-07-14T16:20:07.1396551Z [cluster2] "f:currentNumberScheduled": {},
2021-07-14T16:20:07.1397281Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-14T16:20:07.1397920Z [cluster2] "f:numberAvailable": {},
2021-07-14T16:20:07.1398531Z [cluster2] "f:numberMisscheduled": {},
2021-07-14T16:20:07.1399099Z [cluster2] "f:numberReady": {},
2021-07-14T16:20:07.1399679Z [cluster2] "f:observedGeneration": {},
2021-07-14T16:20:07.1400349Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-14T16:20:07.1400904Z [cluster2] }
2021-07-14T16:20:07.1401278Z [cluster2] },
2021-07-14T16:20:07.1401705Z [cluster2] "f:gateways": {},
2021-07-14T16:20:07.1402325Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-14T16:20:07.1402891Z [cluster2] ".": {},
2021-07-14T16:20:07.1403487Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-14T16:20:07.1404066Z [cluster2] },
2021-07-14T16:20:07.1404572Z [cluster2] "f:loadBalancerStatus": {},
2021-07-14T16:20:07.1405110Z [cluster2] "f:natEnabled": {},
2021-07-14T16:20:07.1405726Z [cluster2] "f:networkPlugin": {},
2021-07-14T16:20:07.1406384Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-14T16:20:07.1406980Z [cluster2] ".": {},
2021-07-14T16:20:07.1407711Z [cluster2] "f:lastResourceVersion": {},
2021-07-14T16:20:07.1427675Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-14T16:20:07.1428460Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-14T16:20:07.1429054Z [cluster2] "f:status": {
2021-07-14T16:20:07.1429487Z [cluster2] ".": {},
2021-07-14T16:20:07.1430039Z [cluster2] "f:currentNumberScheduled": {},
2021-07-14T16:20:07.1430769Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-14T16:20:07.1431505Z [cluster2] "f:numberAvailable": {},
2021-07-14T16:20:07.1432105Z [cluster2] "f:numberMisscheduled": {},
2021-07-14T16:20:07.1432684Z [cluster2] "f:numberReady": {},
2021-07-14T16:20:07.1433245Z [cluster2] "f:observedGeneration": {},
2021-07-14T16:20:07.1433926Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-14T16:20:07.1434471Z [cluster2] }
2021-07-14T16:20:07.1434852Z [cluster2] },
2021-07-14T16:20:07.1435424Z [cluster2] "f:serviceCIDR": {}
2021-07-14T16:20:07.1435864Z [cluster2] }
2021-07-14T16:20:07.1436234Z [cluster2] },
2021-07-14T16:20:07.1437100Z [cluster2] "manager": "submariner-operator",
2021-07-14T16:20:07.1437783Z [cluster2] "operation": "Update",
2021-07-14T16:20:07.1438491Z [cluster2] "time": "2021-07-14T16:19:41Z"
2021-07-14T16:20:07.1438947Z [cluster2] }
2021-07-14T16:20:07.1439294Z [cluster2] ],
2021-07-14T16:20:07.1439715Z [cluster2] "name": "submariner",
2021-07-14T16:20:07.1440429Z [cluster2] "namespace": "submariner-operator",
2021-07-14T16:20:07.1441041Z [cluster2] "resourceVersion": "2422",
2021-07-14T16:20:07.1441776Z [cluster2] "uid": "d406478a-3065-49ba-b9f8-875c114c7acc"
2021-07-14T16:20:07.1442265Z [cluster2] },
2021-07-14T16:20:07.1442632Z [cluster2] "spec": {
2021-07-14T16:20:07.1443031Z [cluster2] "broker": "k8s",
2021-07-14T16:20:07.1443557Z [cluster2] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-14T16:20:07.1611182Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-14T16:20:07.2268821Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-14T16:20:07.2774418Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-14T16:20:07.2775239Z [cluster2] "cableDriver": "libreswan",
2021-07-14T16:20:07.2775814Z [cluster2] "ceIPSecDebug": false,
2021-07-14T16:20:07.2776336Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-14T16:20:07.2776909Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-14T16:20:07.2778456Z [cluster2] "ceIPSecPSK": "eNyoMJLjNFcdKnGHxz1BqVsdMz5rqMpCAriv0eYv0Y6t7lEitIH6uA9wkidvk35Y",
2021-07-14T16:20:07.2780121Z [cluster2] "clusterCIDR": "",
2021-07-14T16:20:07.2780619Z [cluster2] "clusterID": "cluster2",
2021-07-14T16:20:07.2781098Z [cluster2] "colorCodes": "blue",
2021-07-14T16:20:07.2781661Z [cluster2] "connectionHealthCheck": {
2021-07-14T16:20:07.2782216Z [cluster2] "enabled": true,
2021-07-14T16:20:07.2782715Z [cluster2] "intervalSeconds": 1,
2021-07-14T16:20:07.2783284Z [cluster2] "maxPacketLossCount": 5
2021-07-14T16:20:07.2783744Z [cluster2] },
2021-07-14T16:20:07.2784144Z [cluster2] "debug": false,
2021-07-14T16:20:07.2784910Z [cluster2] "namespace": "submariner-operator",
2021-07-14T16:20:07.2785500Z [cluster2] "natEnabled": false,
2021-07-14T16:20:07.2786001Z [cluster2] "repository": "localhost:5000",
2021-07-14T16:20:07.2786799Z [cluster2] "serviceCIDR": "",
2021-07-14T16:20:07.2787392Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-14T16:20:07.2787980Z [cluster2] "version": "local"
2021-07-14T16:20:07.2788366Z [cluster2] },
2021-07-14T16:20:07.2788738Z [cluster2] "status": {
2021-07-14T16:20:07.2789172Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-14T16:20:07.2789684Z [cluster2] "clusterID": "cluster2",
2021-07-14T16:20:07.2790184Z [cluster2] "colorCodes": "blue",
2021-07-14T16:20:07.2790668Z [cluster2] "deploymentInfo": {},
2021-07-14T16:20:07.2791270Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-14T16:20:07.2791916Z [cluster2] "lastResourceVersion": "2258",
2021-07-14T16:20:07.2792633Z [cluster2] "mismatchedContainerImages": false,
2021-07-14T16:20:07.2793370Z [cluster2] "nonReadyContainerStates": [],
2021-07-14T16:20:07.2793926Z [cluster2] "status": {
2021-07-14T16:20:07.2794471Z [cluster2] "currentNumberScheduled": 1,
2021-07-14T16:20:07.2795171Z [cluster2] "desiredNumberScheduled": 1,
2021-07-14T16:20:07.2795793Z [cluster2] "numberAvailable": 1,
2021-07-14T16:20:07.2796358Z [cluster2] "numberMisscheduled": 0,
2021-07-14T16:20:07.2796909Z [cluster2] "numberReady": 1,
2021-07-14T16:20:07.2797469Z [cluster2] "observedGeneration": 1,
2021-07-14T16:20:07.2798121Z [cluster2] "updatedNumberScheduled": 1
2021-07-14T16:20:07.2798639Z [cluster2] }
2021-07-14T16:20:07.2798996Z [cluster2] },
2021-07-14T16:20:07.2799377Z [cluster2] "gateways": [
2021-07-14T16:20:07.2799769Z [cluster2] {
2021-07-14T16:20:07.2800182Z [cluster2] "connections": [
2021-07-14T16:20:07.2800602Z [cluster2] {
2021-07-14T16:20:07.2801010Z [cluster2] "endpoint": {
2021-07-14T16:20:07.2801510Z [cluster2] "backend": "libreswan",
2021-07-14T16:20:07.2802010Z [cluster2] "backend_config": {
2021-07-14T16:20:07.2803211Z [cluster2] "natt-discovery-port": "4490",
2021-07-14T16:20:07.2804008Z [cluster2] "preferred-server": "false"
2021-07-14T16:20:07.2804504Z [cluster2] },
2021-07-14T16:20:07.2805566Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-4",
2021-07-14T16:20:07.2806374Z [cluster2] "cluster_id": "cluster1",
2021-07-14T16:20:07.2806919Z [cluster2] "healthCheckIP": "10.1.128.0",
2021-07-14T16:20:07.2807672Z [cluster2] "hostname": "cluster1-worker",
2021-07-14T16:20:07.2809020Z [cluster2] "nat_enabled": false,
2021-07-14T16:20:07.2809521Z [cluster2] "private_ip": "172.18.0.4",
2021-07-14T16:20:07.2810003Z [cluster2] "public_ip": "40.76.68.190",
2021-07-14T16:20:07.2810466Z [cluster2] "subnets": [
2021-07-14T16:20:07.2810884Z [cluster2] "100.1.0.0/16",
2021-07-14T16:20:07.2811298Z [cluster2] "10.1.0.0/16"
2021-07-14T16:20:07.2811682Z [cluster2] ]
2021-07-14T16:20:07.2812067Z [cluster2] },
2021-07-14T16:20:07.2812503Z [cluster2] "latencyRTT": {
2021-07-14T16:20:07.2813181Z [cluster2] "average": "426.894µs",
2021-07-14T16:20:07.2813790Z [cluster2] "last": "209.904µs",
2021-07-14T16:20:07.2814219Z [cluster2] "max": "4.191379ms",
2021-07-14T16:20:07.2814800Z [cluster2] "min": "157.503µs",
2021-07-14T16:20:07.2815385Z [cluster2] "stdDev": "831.889µs"
2021-07-14T16:20:07.2815935Z [cluster2] },
2021-07-14T16:20:07.2816375Z [cluster2] "status": "connected",
2021-07-14T16:20:07.2816900Z [cluster2] "statusMessage": "",
2021-07-14T16:20:07.2817398Z [cluster2] "usingIP": "172.18.0.4"
2021-07-14T16:20:07.2817804Z [cluster2] }
2021-07-14T16:20:07.2818175Z [cluster2] ],
2021-07-14T16:20:07.2818600Z [cluster2] "haStatus": "active",
2021-07-14T16:20:07.2819103Z [cluster2] "localEndpoint": {
2021-07-14T16:20:07.2819614Z [cluster2] "backend": "libreswan",
2021-07-14T16:20:07.2820109Z [cluster2] "backend_config": {
2021-07-14T16:20:07.2820814Z [cluster2] "natt-discovery-port": "4490",
2021-07-14T16:20:07.2821589Z [cluster2] "preferred-server": "false"
2021-07-14T16:20:07.5125086Z [cluster2] },ace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.5128411Z [cluster1] I0714 16:19:49.784943 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-14T16:20:07.5131521Z [cluster1] I0714 16:19:50.369831 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:07.5134537Z [cluster1] I0714 16:19:50.376382 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.5137527Z [cluster1] I0714 16:19:50.387177 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-14T16:20:07.5140730Z [cluster1] I0714 16:19:50.395168 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-14T16:20:07.5143892Z [cluster1] E0714 16:20:00.086557 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-14T16:20:07.5149207Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-14T16:20:07.5150061Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-14T16:20:07.5151165Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-14T16:20:07.5152445Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-14T16:20:07.5153857Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-14T16:20:07.5155051Z [submariner-operator]$ [cluster1] grep submariner
2021-07-14T16:20:07.5155645Z [cluster1] submariner 48s
2021-07-14T16:20:07.5156561Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-14T16:20:07.5157862Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.5159125Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-14T16:20:07.5160591Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.5162164Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:07.5163037Z [cluster1] {
2021-07-14T16:20:07.5163543Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.5164105Z [cluster1] "kind": "Submariner",
2021-07-14T16:20:07.5164545Z [cluster1] "metadata": {
2021-07-14T16:20:07.5165241Z [cluster1] "creationTimestamp": "2021-07-14T16:19:18Z",
2021-07-14T16:20:07.5165771Z [cluster1] "generation": 1,
2021-07-14T16:20:07.5166251Z [cluster1] "managedFields": [
2021-07-14T16:20:07.5166674Z [cluster1] {
2021-07-14T16:20:07.5167196Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.5168550Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:07.5169085Z [cluster1] "fieldsV1": {
2021-07-14T16:20:07.5169574Z [cluster1] "f:spec": {
2021-07-14T16:20:07.5169983Z [cluster1] ".": {},
2021-07-14T16:20:07.5170403Z [cluster1] "f:broker": {},
2021-07-14T16:20:07.5170930Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-14T16:20:07.5171615Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-14T16:20:07.5172229Z [cluster1] "f:brokerK8sCA": {},
2021-07-14T16:20:07.5172865Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-14T16:20:07.5173488Z [cluster1] "f:cableDriver": {},
2021-07-14T16:20:07.5174014Z [cluster1] "f:ceIPSecDebug": {},
2021-07-14T16:20:07.5174555Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-14T16:20:07.5175252Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-14T16:20:07.5175843Z [cluster1] "f:ceIPSecPSK": {},
2021-07-14T16:20:07.5176340Z [cluster1] "f:clusterCIDR": {},
2021-07-14T16:20:07.5176832Z [cluster1] "f:clusterID": {},
2021-07-14T16:20:07.5177307Z [cluster1] "f:colorCodes": {},
2021-07-14T16:20:07.5177897Z [cluster1] "f:connectionHealthCheck": {
2021-07-14T16:20:07.5178425Z [cluster1] ".": {},
2021-07-14T16:20:07.5178995Z [cluster1] "f:enabled": {},
2021-07-14T16:20:07.5179517Z [cluster1] "f:intervalSeconds": {},
2021-07-14T16:20:07.5180124Z [cluster1] "f:maxPacketLossCount": {}
2021-07-14T16:20:07.5180629Z [cluster1] },
2021-07-14T16:20:07.5181027Z [cluster1] "f:debug": {},
2021-07-14T16:20:07.5181487Z [cluster1] "f:namespace": {},
2021-07-14T16:20:07.5181963Z [cluster1] "f:natEnabled": {},
2021-07-14T16:20:07.5182461Z [cluster1] "f:repository": {},
2021-07-14T16:20:07.5182952Z [cluster1] "f:serviceCIDR": {},
2021-07-14T16:20:07.5183640Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-14T16:20:07.5184235Z [cluster1] "f:version": {}
2021-07-14T16:20:07.5184647Z [cluster1] }
2021-07-14T16:20:07.5185021Z [cluster1] },
2021-07-14T16:20:07.5185464Z [cluster1] "manager": "subctl",
2021-07-14T16:20:07.5185950Z [cluster1] "operation": "Update",
2021-07-14T16:20:07.5186738Z [cluster1] "time": "2021-07-14T16:19:18Z"
2021-07-14T16:20:07.5187140Z [cluster1] },
2021-07-14T16:20:07.5187489Z [cluster1] {
2021-07-14T16:20:07.5188012Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-14T16:20:07.5188599Z [cluster1] "fieldsType": "FieldsV1",
2021-07-14T16:20:07.5189192Z [cluster1] "fieldsV1": {
2021-07-14T16:20:07.5189618Z [cluster1] "f:status": {
2021-07-14T16:20:07.5190028Z [cluster1] ".": {},
2021-07-14T16:20:07.5190477Z [cluster1] "f:clusterCIDR": {},
2021-07-14T16:20:07.5190956Z [cluster1] "f:clusterID": {},
2021-07-14T16:20:07.5191443Z [cluster1] "f:colorCodes": {},
2021-07-14T16:20:07.5191960Z [cluster1] "f:deploymentInfo": {},
2021-07-14T16:20:07.5192597Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-14T16:20:07.5193138Z [cluster1] ".": {},
2021-07-14T16:20:07.5193665Z [cluster1] "f:lastResourceVersion": {},
2021-07-14T16:20:07.5194376Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-14T16:20:07.5195152Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-14T16:20:07.5195753Z [cluster1] "f:status": {
2021-07-14T16:20:07.5196167Z [cluster1] ".": {},
2021-07-14T16:20:07.5196737Z [cluster1] "f:currentNumberScheduled": {},
2021-07-14T16:20:07.5197454Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-14T16:20:07.5198114Z [cluster1] "f:numberAvailable": {},
2021-07-14T16:20:07.5198717Z [cluster1] "f:numberMisscheduled": {},
2021-07-14T16:20:07.5199292Z [cluster1] "f:numberReady": {},
2021-07-14T16:20:07.5199857Z [cluster1] "f:observedGeneration": {},
2021-07-14T16:20:07.5200535Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-14T16:20:07.5201096Z [cluster1] }
2021-07-14T16:20:07.5201470Z [cluster1] },
2021-07-14T16:20:07.5201903Z [cluster1] "f:gateways": {},
2021-07-14T16:20:07.5202506Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-14T16:20:07.5203085Z [cluster1] ".": {},
2021-07-14T16:20:07.5203669Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-14T16:20:07.5204251Z [cluster1] },
2021-07-14T16:20:07.5204748Z [cluster1] "f:loadBalancerStatus": {},
2021-07-14T16:20:07.5205388Z [cluster1] "f:natEnabled": {},
2021-07-14T16:20:07.5205911Z [cluster1] "f:networkPlugin": {},
2021-07-14T16:20:07.5206567Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-14T16:20:07.5207162Z [cluster1] ".": {},
2021-07-14T16:20:07.5207716Z [cluster1] "f:lastResourceVersion": {},
2021-07-14T16:20:07.5208588Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-14T16:20:07.5209356Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-14T16:20:07.5209953Z [cluster1] "f:status": {
2021-07-14T16:20:07.5210364Z [cluster1] ".": {},
2021-07-14T16:20:07.5210935Z [cluster1] "f:currentNumberScheduled": {},
2021-07-14T16:20:07.5211663Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-14T16:20:07.5212303Z [cluster1] "f:numberAvailable": {},
2021-07-14T16:20:07.5212916Z [cluster1] "f:numberMisscheduled": {},
2021-07-14T16:20:07.5213492Z [cluster1] "f:numberReady": {},
2021-07-14T16:20:07.5214069Z [cluster1] "f:observedGeneration": {},
2021-07-14T16:20:07.5214742Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-14T16:20:07.5215380Z [cluster1] }
2021-07-14T16:20:07.5215768Z [cluster1] },
2021-07-14T16:20:07.5216205Z [cluster1] "f:serviceCIDR": {}
2021-07-14T16:20:07.5216646Z [cluster1] }
2021-07-14T16:20:07.5217005Z [cluster1] },
2021-07-14T16:20:07.5217782Z [cluster1] "manager": "submariner-operator",
2021-07-14T16:20:07.5218356Z [cluster1] "operation": "Update",
2021-07-14T16:20:07.5218994Z [cluster1] "time": "2021-07-14T16:19:33Z"
2021-07-14T16:20:07.5219389Z [cluster1] }
2021-07-14T16:20:07.5219750Z [cluster1] ],
2021-07-14T16:20:07.5220157Z [cluster1] "name": "submariner",
2021-07-14T16:20:07.5220888Z [cluster1] "namespace": "submariner-operator",
2021-07-14T16:20:07.5221508Z [cluster1] "resourceVersion": "2507",
2021-07-14T16:20:07.5222322Z [cluster1] "uid": "bdbb53b5-17a4-4cb7-a859-7bd3d190c7b8"
2021-07-14T16:20:07.5222882Z [cluster1] },
2021-07-14T16:20:07.5223234Z [cluster1] "spec": {
2021-07-14T16:20:07.5223642Z [cluster1] "broker": "k8s",
2021-07-14T16:20:07.5224157Z [cluster1] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-14T16:20:07.5367616Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-14T16:20:07.5837222Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-14T16:20:07.6312917Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-14T16:20:07.6313751Z [cluster1] "cableDriver": "libreswan",
2021-07-14T16:20:07.6314312Z [cluster1] "ceIPSecDebug": false,
2021-07-14T16:20:07.6314853Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-14T16:20:07.6315392Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-14T16:20:07.6316881Z [cluster1] "ceIPSecPSK": "eNyoMJLjNFcdKnGHxz1BqVsdMz5rqMpCAriv0eYv0Y6t7lEitIH6uA9wkidvk35Y",
2021-07-14T16:20:07.6318341Z [cluster1] "clusterCIDR": "",
2021-07-14T16:20:07.6318822Z [cluster1] "clusterID": "cluster1",
2021-07-14T16:20:07.6319321Z [cluster1] "colorCodes": "blue",
2021-07-14T16:20:07.6319902Z [cluster1] "connectionHealthCheck": {
2021-07-14T16:20:07.6320442Z [cluster1] "enabled": true,
2021-07-14T16:20:07.6320939Z [cluster1] "intervalSeconds": 1,
2021-07-14T16:20:07.6321513Z [cluster1] "maxPacketLossCount": 5
2021-07-14T16:20:07.6321989Z [cluster1] },
2021-07-14T16:20:07.6322378Z [cluster1] "debug": false,
2021-07-14T16:20:07.6323110Z [cluster1] "namespace": "submariner-operator",
2021-07-14T16:20:07.6323688Z [cluster1] "natEnabled": false,
2021-07-14T16:20:07.6324478Z [cluster1] "repository": "localhost:5000",
2021-07-14T16:20:07.6325001Z [cluster1] "serviceCIDR": "",
2021-07-14T16:20:07.6325612Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-14T16:20:07.6326209Z [cluster1] "version": "local"
2021-07-14T16:20:07.6326595Z [cluster1] },
2021-07-14T16:20:07.6326971Z [cluster1] "status": {
2021-07-14T16:20:07.6327409Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-14T16:20:07.6328081Z [cluster1] "clusterID": "cluster1",
2021-07-14T16:20:07.6328565Z [cluster1] "colorCodes": "blue",
2021-07-14T16:20:07.6329068Z [cluster1] "deploymentInfo": {},
2021-07-14T16:20:07.6329664Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-14T16:20:07.6330325Z [cluster1] "lastResourceVersion": "2434",
2021-07-14T16:20:07.6331028Z [cluster1] "mismatchedContainerImages": false,
2021-07-14T16:20:07.6331780Z [cluster1] "nonReadyContainerStates": [],
2021-07-14T16:20:07.6332352Z [cluster1] "status": {
2021-07-14T16:20:07.6332892Z [cluster1] "currentNumberScheduled": 1,
2021-07-14T16:20:07.6333589Z [cluster1] "desiredNumberScheduled": 1,
2021-07-14T16:20:07.6334201Z [cluster1] "numberAvailable": 1,
2021-07-14T16:20:07.6334781Z [cluster1] "numberMisscheduled": 0,
2021-07-14T16:20:07.6335313Z [cluster1] "numberReady": 1,
2021-07-14T16:20:07.6335861Z [cluster1] "observedGeneration": 1,
2021-07-14T16:20:07.6336503Z [cluster1] "updatedNumberScheduled": 1
2021-07-14T16:20:07.6337029Z [cluster1] }
2021-07-14T16:20:07.6337382Z [cluster1] },
2021-07-14T16:20:07.6337776Z [cluster1] "gateways": [
2021-07-14T16:20:07.6338171Z [cluster1] {
2021-07-14T16:20:07.6338579Z [cluster1] "connections": [
2021-07-14T16:20:07.6338999Z [cluster1] {
2021-07-14T16:20:07.6339408Z [cluster1] "endpoint": {
2021-07-14T16:20:07.6339903Z [cluster1] "backend": "libreswan",
2021-07-14T16:20:07.6340397Z [cluster1] "backend_config": {
2021-07-14T16:20:07.6341186Z [cluster1] "natt-discovery-port": "4490",
2021-07-14T16:20:07.6341972Z [cluster1] "preferred-server": "false"
2021-07-14T16:20:07.6342480Z [cluster1] },
2021-07-14T16:20:07.6350284Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-14T16:20:07.6352177Z [cluster1] "cluster_id": "cluster2",
2021-07-14T16:20:07.6352735Z [cluster1] "healthCheckIP": "10.2.0.1",
2021-07-14T16:20:07.6353728Z [cluster1] "hostname": "cluster2-worker",
2021-07-14T16:20:07.6354563Z [cluster1] "nat_enabled": false,
2021-07-14T16:20:07.6360480Z [cluster1] "private_ip": "172.18.0.7",
2021-07-14T16:20:07.6360990Z [cluster1] "public_ip": "40.76.68.190",
2021-07-14T16:20:07.6361443Z [cluster1] "subnets": [
2021-07-14T16:20:07.6361884Z [cluster1] "100.2.0.0/16",
2021-07-14T16:20:07.6362300Z [cluster1] "10.2.0.0/16"
2021-07-14T16:20:07.6362682Z [cluster1] ]
2021-07-14T16:20:07.6363082Z [cluster1] },
2021-07-14T16:20:07.6363508Z [cluster1] "latencyRTT": {
2021-07-14T16:20:07.6363986Z [cluster1] "average": "0s",
2021-07-14T16:20:07.6364416Z [cluster1] "last": "0s",
2021-07-14T16:20:07.6364837Z [cluster1] "max": "0s",
2021-07-14T16:20:07.6365242Z [cluster1] "min": "0s",
2021-07-14T16:20:07.6365683Z [cluster1] "stdDev": "0s"
2021-07-14T16:20:07.6366245Z [cluster1] },
2021-07-14T16:20:07.6366682Z [cluster1] "status": "error",
2021-07-14T16:20:07.6367370Z [cluster1] "statusMessage": "Failed to successfully ping the remote endpoint IP \"10.2.0.1\"",
2021-07-14T16:20:07.6368310Z [cluster1] "usingIP": "172.18.0.7"
2021-07-14T16:20:07.6368730Z [cluster1] }
2021-07-14T16:20:07.6369123Z [cluster1] ],
2021-07-14T16:20:07.6369554Z [cluster1] "haStatus": "active",
2021-07-14T16:20:07.6370037Z [cluster1] "localEndpoint": {
2021-07-14T16:20:07.6370550Z [cluster1] "backend": "libreswan",
2021-07-14T16:20:07.6371030Z [cluster1] "backend_config": {
2021-07-14T16:20:07.6371933Z [cluster1] "natt-discovery-port": "4490",
2021-07-14T16:20:07.6372717Z [cluster1] "preferred-server": "false"
2021-07-14T16:20:07.6373250Z [cluster1] },
2021-07-14T16:20:07.6374160Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-4",
2021-07-14T16:20:07.6374953Z [cluster1] "cluster_id": "cluster1",
2021-07-14T16:20:07.6375482Z [cluster1] "healthCheckIP": "10.1.128.0",
2021-07-14T16:20:07.6376196Z [cluster1] "hostname": "cluster1-worker",
2021-07-14T16:20:07.6376746Z [cluster1] "nat_enabled": false,
2021-07-14T16:20:07.6377218Z [cluster1] "private_ip": "172.18.0.4",
2021-07-14T16:20:07.6377691Z [cluster1] "public_ip": "40.76.68.190",
2021-07-14T16:20:07.6378139Z [cluster1] "subnets": [
2021-07-14T16:20:07.6378547Z [cluster1] "100.1.0.0/16",
2021-07-14T16:20:07.6378946Z [cluster1] "10.1.0.0/16"
2021-07-14T16:20:07.6379320Z [cluster1] ]
2021-07-14T16:20:07.6379695Z [cluster1] },
2021-07-14T16:20:07.6380129Z [cluster1] "statusFailure": "",
2021-07-14T16:20:07.6380831Z [cluster1] "version": "devel-8222ad2"
2021-07-14T16:20:07.6381264Z [cluster1] }
2021-07-14T16:20:07.6381624Z [cluster1] ],
2021-07-14T16:20:07.6382162Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-14T16:20:07.6382925Z [cluster1] "mismatchedContainerImages": false
2021-07-14T16:20:07.6383617Z [cluster1] },
2021-07-14T16:20:07.6384094Z [cluster1] "loadBalancerStatus": {},
2021-07-14T16:20:07.6384781Z [cluster1] "natEnabled": f
2021-07-14T16:20:07.6385777Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-14T16:20:07.6386589Z [cluster2] "cluster_id": "cluster2",
2021-07-14T16:20:07.6387104Z [cluster2] "healthCheckIP": "10.2.0.1",
2021-07-14T16:20:07.6387832Z [cluster2] "hostname": "cluster2-worker",
2021-07-14T16:20:07.6388386Z [cluster2] "nat_enabled": false,
2021-07-14T16:20:07.6388855Z [cluster2] "private_ip": "172.18.0.7",
2021-07-14T16:20:07.6389323Z [cluster2] "public_ip": "40.76.68.190",
2021-07-14T16:20:07.6389759Z [cluster2] "subnets": [
2021-07-14T16:20:07.6390182Z [cluster2] "100.2.0.0/16",
2021-07-14T16:20:07.6390573Z [cluster2] "10.2.0.0/16"
2021-07-14T16:20:07.6390957Z [cluster2] ]
2021-07-14T16:20:07.6391321Z [cluster2] },
2021-07-14T16:20:07.6391764Z [cluster2] "statusFailure": "",
2021-07-14T16:20:07.6392460Z [cluster2] "version": "devel-8222ad2"
2021-07-14T16:20:07.6392891Z [cluster2] }
2021-07-14T16:20:07.6393248Z [cluster2] ],
2021-07-14T16:20:07.6393784Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-14T16:20:07.6394701Z [cluster2] "mismatchedContainerImages": false
2021-07-14T16:20:07.6395251Z [cluster2] },
2021-07-14T16:20:07.6395726Z [cluster2] "loadBalancerStatus": {},
2021-07-14T16:20:07.6396258Z [cluster2] "natEnabled": false,
2021-07-14T16:20:07.6396949Z [cluster2] "networkPlugin": "weave-net",
2021-07-14T16:20:07.6397610Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-14T16:20:07.6398306Z [cluster2] "lastResourceVersion": "2317",
2021-07-14T16:20:07.6399024Z [cluster2] "mismatchedContainerImages": false,
2021-07-14T16:20:07.6399758Z [cluster2] "nonReadyContainerStates": [],
2021-07-14T16:20:07.6400324Z [cluster2] "status": {
2021-07-14T16:20:07.6400869Z [cluster2] "currentNumberScheduled": 3,
2021-07-14T16:20:07.6401572Z [cluster2] "desiredNumberScheduled": 3,
2021-07-14T16:20:07.6402180Z [cluster2] "numberAvailable": 3,
2021-07-14T16:20:07.6403134Z [cluster2] "numberMisscheduled": 0,
2021-07-14T16:20:07.6403683Z [cluster2] "numberReady": 3,
2021-07-14T16:20:07.6404234Z [cluster2] "observedGeneration": 1,
2021-07-14T16:20:07.6404879Z [cluster2] "updatedNumberScheduled": 3
2021-07-14T16:20:07.6405405Z [cluster2] }
2021-07-14T16:20:07.6405766Z [cluster2] },
2021-07-14T16:20:07.6406184Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-14T16:20:07.6406609Z [cluster2] }
2021-07-14T16:20:07.6406947Z [cluster2] }
2021-07-14T16:20:07.6408127Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-14T16:20:07.6409507Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-14T16:20:07.6411287Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-14T16:20:07.6412806Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-14T16:20:07.6414217Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-14T16:20:07.6415458Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-14T16:20:07.6416577Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-14T16:20:07.6417574Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-14T16:20:07.6418788Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-14T16:20:07.6419962Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-14T16:20:07.6421072Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-14T16:20:07.6422272Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-14T16:20:07.6423721Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-14T16:20:07.6424987Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-14T16:20:07.6426390Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-14T16:20:07.6994232Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-14T16:20:07.7223994Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-14T16:20:07.7226194Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-14T16:20:07.7908363Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:20:07.9546611Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYalse,
2021-07-14T16:20:07.9850938Z [cluster1] "networkPlugin": "weave-net",
2021-07-14T16:20:07.9851835Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-14T16:20:07.9852928Z [cluster1] "lastResourceVersion": "2413",
2021-07-14T16:20:07.9854074Z [cluster1] "mismatchedContainerImages": false,
2021-07-14T16:20:07.9854979Z [cluster1] "nonReadyContainerStates": [],
2021-07-14T16:20:07.9856330Z [cluster1] "status": {
2021-07-14T16:20:07.9856904Z [cluster1] "currentNumberScheduled": 3,
2021-07-14T16:20:07.9857896Z [cluster1] "desiredNumberScheduled": 3,
2021-07-14T16:20:07.9858535Z [cluster1] "numberAvailable": 3,
2021-07-14T16:20:07.9859118Z [cluster1] "numberMisscheduled": 0,
2021-07-14T16:20:07.9859653Z [cluster1] "numberReady": 3,
2021-07-14T16:20:07.9860202Z [cluster1] "observedGeneration": 1,
2021-07-14T16:20:07.9860850Z [cluster1] "updatedNumberScheduled": 3
2021-07-14T16:20:07.9861622Z [cluster1] }
2021-07-14T16:20:07.9861972Z [cluster1] },
2021-07-14T16:20:07.9862407Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-14T16:20:07.9862829Z [cluster1] }
2021-07-14T16:20:07.9863161Z [cluster1] }
2021-07-14T16:20:07.9864805Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-14T16:20:07.9866493Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-14T16:20:07.9883178Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-14T16:20:07.9885216Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-14T16:20:07.9886417Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-14T16:20:07.9887657Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-14T16:20:07.9889723Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-14T16:20:07.9890760Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-14T16:20:07.9891857Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-14T16:20:07.9893004Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-14T16:20:07.9894095Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-14T16:20:07.9895309Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-14T16:20:07.9896613Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-14T16:20:07.9897869Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-14T16:20:07.9899512Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-14T16:20:08.0120263Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-14T16:20:08.1353867Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-14T16:20:08.1356037Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-14T16:20:08.1924838Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:20:08.2880928Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:20:08.3371005Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-14T16:20:08.3372596Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-14T16:20:08.3374325Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-14T16:20:08.3376021Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-14T16:20:08.3377416Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-14T16:20:08.3378564Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-14T16:20:08.5711092Z [submariner-operator]$ [cluster1] jq -r -MWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-14T16:20:08.5739516Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5741101Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-14T16:20:08.5742772Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-14T16:20:08.5744635Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5746283Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-14T16:20:08.5747434Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-14T16:20:08.5748799Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5750153Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-14T16:20:08.5751309Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-14T16:20:08.5752610Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5753905Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-14T16:20:08.5755079Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-14T16:20:08.5756385Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5757681Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-14T16:20:08.5758815Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-14T16:20:08.5760058Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5761328Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-14T16:20:08.5762516Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-14T16:20:08.5806101Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5807271Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-14T16:20:08.5808914Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-14T16:20:08.5810083Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5811415Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5812272Z [cluster2] Generated cluster id: cluster2
2021-07-14T16:20:08.5813173Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-14T16:20:08.5814269Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-14T16:20:08.5815498Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5816670Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-14T16:20:08.5817660Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-14T16:20:08.5818802Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5820078Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-14T16:20:08.5821479Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-14T16:20:08.5822868Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5824054Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-14T16:20:08.5825138Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-14T16:20:08.5826355Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-14T16:20:08.5827505Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-14T16:20:08.5828484Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-14T16:20:08.5829453Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-14T16:20:08.5830717Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-14T16:20:08.5831628Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:20:08.5832447Z [submariner-operator]$ [cluster2] wait 9958
2021-07-14T16:20:08.5833282Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-14T16:20:09.1176239Z [submariner-operat .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1177660Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-14T16:20:09.1178866Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-14T16:20:09.1180188Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1181628Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-14T16:20:09.1182816Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-14T16:20:09.1184155Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1185465Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-14T16:20:09.1186614Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-14T16:20:09.1187848Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1189361Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-14T16:20:09.1190400Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-14T16:20:09.1191577Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1192789Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-14T16:20:09.1193790Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-14T16:20:09.1194952Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1196240Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1197091Z [cluster1] Generated cluster id: cluster1
2021-07-14T16:20:09.1197980Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-14T16:20:09.1199062Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-14T16:20:09.1200308Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1201463Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-14T16:20:09.1202483Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-14T16:20:09.1203621Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1204900Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-14T16:20:09.1206171Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-14T16:20:09.1207486Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1209213Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-14T16:20:09.1210303Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-14T16:20:09.1211547Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1212680Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-14T16:20:09.1213657Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-14T16:20:09.1214762Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-14T16:20:09.1215769Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-14T16:20:09.1216679Z [submariner-operator]$ [cluster1] iteration=1
2021-07-14T16:20:09.1217544Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-14T16:20:09.1218389Z [submariner-operator]$ [cluster1] wait 9983
2021-07-14T16:20:09.1219215Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-14T16:20:09.1220228Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-14T16:20:09.1221125Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-14T16:20:09.1222173Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-14T16:20:09.1222959Z [cluster1] 
2021-07-14T16:20:09.1223441Z [cluster1] 
2021-07-14T16:20:09.1224565Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:09.1225944Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-14T16:20:09.1227097Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-14T16:20:09.1228373Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-14T16:20:09.1229637Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-14T16:20:09.1230861Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-14T16:20:10.3617283Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.clusteror]$ [cluster2] verify_subm_cr_status_
2021-07-14T16:20:10.3618556Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-14T16:20:10.3619457Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-14T16:20:10.3620531Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-14T16:20:10.3621343Z [cluster2] 
2021-07-14T16:20:10.3621804Z [cluster2] 
2021-07-14T16:20:10.3622921Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-14T16:20:10.3624272Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-14T16:20:10.3625416Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-14T16:20:10.3626685Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-14T16:20:10.3627955Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-14T16:20:10.3629076Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-14T16:20:10.3630323Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-14T16:20:10.3631403Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:20:10.3632181Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:20:10.3633081Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-14T16:20:10.3634060Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-14T16:20:10.3635242Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-14T16:20:10.3636594Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-14T16:20:10.3637796Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-14T16:20:10.3638913Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-14T16:20:10.3639951Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-14T16:20:10.3641171Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-14T16:20:10.3642099Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:20:10.3642903Z [submariner-operator]$ [cluster2] wait 10018
2021-07-14T16:20:10.3643760Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-14T16:20:10.3644643Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-14T16:20:10.3645315Z [cluster2] 
2021-07-14T16:20:10.3645966Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:20:10.3646901Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-14T16:20:10.3648106Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-14T16:20:10.3649051Z [submariner-operator]$ [cluster2] iteration=1
2021-07-14T16:20:10.3649875Z [submariner-operator]$ [cluster2] wait 10068
2021-07-14T16:20:10.3650877Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-14T16:20:10.3651800Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-14T16:20:10.3653189Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.3655009Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.3656919Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.3658843Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.3660368Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.3662013Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.3663254Z [submariner-operator]$ [cluster2] return 0
2021-07-14T16:20:10.3664112Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-14T16:20:10.3665029Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-14T16:20:10.3666412Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.3668305Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.3670200Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.3671596Z [cluster2] pod/submariner-gateway-l7w26 condition met
2021-07-14T16:20:10.9727455Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods 1.json
2021-07-14T16:20:10.9728897Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:20:10.9729703Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:20:10.9730620Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-14T16:20:10.9731609Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-14T16:20:10.9732811Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-14T16:20:10.9734158Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-14T16:20:10.9735367Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-14T16:20:10.9736471Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-14T16:20:10.9737747Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-14T16:20:10.9738785Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-14T16:20:10.9739678Z [submariner-operator]$ [cluster1] iteration=1
2021-07-14T16:20:10.9740552Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-14T16:20:10.9741436Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-14T16:20:10.9742281Z [submariner-operator]$ [cluster1] wait 10050
2021-07-14T16:20:10.9742911Z [cluster1] 
2021-07-14T16:20:10.9743555Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:20:10.9744484Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-14T16:20:10.9745491Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-14T16:20:10.9746415Z [submariner-operator]$ [cluster1] iteration=1
2021-07-14T16:20:10.9747232Z [submariner-operator]$ [cluster1] wait 10091
2021-07-14T16:20:10.9748115Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-14T16:20:10.9749036Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-14T16:20:10.9750448Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.9752270Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.9754338Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-14T16:20:10.9756100Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.9757639Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.9759281Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-14T16:20:10.9760513Z [submariner-operator]$ [cluster1] return 0
2021-07-14T16:20:10.9761377Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-14T16:20:10.9762304Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-14T16:20:10.9763695Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.9765458Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.9767341Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-14T16:20:10.9770227Z [cluster1] pod/submariner-gateway-kfh9m condition met
2021-07-14T16:20:10.9771651Z [submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-14T16:20:10.9773472Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:10.9775304Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:10.9777275Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:10.9779073Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-kfh9m.cluster1.json
2021-07-14T16:20:10.9780844Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-kfh9m --namespace=submariner-operator -o json
2021-07-14T16:20:10.9782452Z [submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-kfh9m.cluster1.json
2021-07-14T16:20:11.0793526Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-kfh9m --namespace=submariner-o--namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-14T16:20:11.0800277Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:11.0805403Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:11.0810226Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-14T16:20:11.0812309Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner-gateway-l7w26.cluster2.json
2021-07-14T16:20:11.0815229Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-l7w26 --namespace=submariner-operator -o json
2021-07-14T16:20:11.0816811Z [submariner-operator]$ [cluster2] tee /tmp/submariner-gateway-l7w26.cluster2.json
2021-07-14T16:20:11.0818399Z [submariner-operator]$ [cluster2] kubectl get pod submariner-gateway-l7w26 --namespace=submariner-operator -o json
2021-07-14T16:20:11.0820605Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-gateway-l7w26 --namespace=submariner-operator -o json
2021-07-14T16:20:11.0821593Z [cluster2] {
2021-07-14T16:20:11.0821998Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.0822437Z [cluster2] "kind": "Pod",
2021-07-14T16:20:11.0822856Z [cluster2] "metadata": {
2021-07-14T16:20:11.0823541Z [cluster2] "creationTimestamp": "2021-07-14T16:19:25Z",
2021-07-14T16:20:11.0824376Z [cluster2] "generateName": "submariner-gateway-",
2021-07-14T16:20:11.0824936Z [cluster2] "labels": {
2021-07-14T16:20:11.0825586Z [cluster2] "app": "submariner-gateway",
2021-07-14T16:20:11.0826406Z [cluster2] "controller-revision-hash": "646b4c844",
2021-07-14T16:20:11.0827346Z [cluster2] "gateway.submariner.io/node": "cluster2-worker",
2021-07-14T16:20:11.0828117Z [cluster2] "gateway.submariner.io/status": "active",
2021-07-14T16:20:11.0828969Z [cluster2] "pod-template-generation": "1"
2021-07-14T16:20:11.0829483Z [cluster2] },
2021-07-14T16:20:11.0829917Z [cluster2] "managedFields": [
2021-07-14T16:20:11.0830361Z [cluster2] {
2021-07-14T16:20:11.0830777Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.0831410Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:11.0831896Z [cluster2] "fieldsV1": {
2021-07-14T16:20:11.0832361Z [cluster2] "f:metadata": {
2021-07-14T16:20:11.0832903Z [cluster2] "f:generateName": {},
2021-07-14T16:20:11.0833396Z [cluster2] "f:labels": {
2021-07-14T16:20:11.0833806Z [cluster2] ".": {},
2021-07-14T16:20:11.0834226Z [cluster2] "f:app": {},
2021-07-14T16:20:11.0834987Z [cluster2] "f:controller-revision-hash": {},
2021-07-14T16:20:11.0835890Z [cluster2] "f:pod-template-generation": {}
2021-07-14T16:20:11.0836453Z [cluster2] },
2021-07-14T16:20:11.0836929Z [cluster2] "f:ownerReferences": {
2021-07-14T16:20:11.0837561Z [cluster2] ".": {},
2021-07-14T16:20:11.0838303Z [cluster2] "k:{\"uid\":\"7a07b450-7dc6-4974-9df7-0671144904ec\"}": {
2021-07-14T16:20:11.0838854Z [cluster2] ".": {},
2021-07-14T16:20:11.0839466Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:11.0840047Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-14T16:20:11.0840630Z [cluster2] "f:controller": {},
2021-07-14T16:20:11.0841084Z [cluster2] "f:kind": {},
2021-07-14T16:20:11.0841521Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0842059Z [cluster2] "f:uid": {}
2021-07-14T16:20:11.0842480Z [cluster2] }
2021-07-14T16:20:11.0842853Z [cluster2] }
2021-07-14T16:20:11.0843243Z [cluster2] },
2021-07-14T16:20:11.0843634Z [cluster2] "f:spec": {
2021-07-14T16:20:11.0844082Z [cluster2] "f:affinity": {
2021-07-14T16:20:11.0844504Z [cluster2] ".": {},
2021-07-14T16:20:11.0845045Z [cluster2] "f:nodeAffinity": {
2021-07-14T16:20:11.0845520Z [cluster2] ".": {},
2021-07-14T16:20:11.0846468Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-14T16:20:11.0847532Z [cluster2] ".": {},
2021-07-14T16:20:11.0881780Z [cluster2] "f:nodeSelectorTerms": {}
2021-07-14T16:20:11.0882321Z [cluster2] }
2021-07-14T16:20:11.0882964Z [cluster2] },
2021-07-14T16:20:11.0883467Z [cluster2] "f:podAntiAffinity": {
2021-07-14T16:20:11.0883947Z [cluster2] ".": {},
2021-07-14T16:20:11.0884923Z [cluster2] "f:requiredDuringSchedulingIgnoredDuringExecution": {}
2021-07-14T16:20:11.0885878Z [cluster2] }
2021-07-14T16:20:11.0886256Z [cluster2] },
2021-07-14T16:20:11.0886703Z [cluster2] "f:containers": {
2021-07-14T16:20:11.0888506Z [cluster2] "k:{\"name\":\"submariner-gateway\"}": {
2021-07-14T16:20:11.0889058Z [cluster2] ".": {},
2021-07-14T16:20:11.0889485Z [cluster2] "f:command": {},
2021-07-14T16:20:11.0889942Z [cluster2] "f:env": {
2021-07-14T16:20:11.0890371Z [cluster2] ".": {},
2021-07-14T16:20:11.0891002Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVER\"}": {
2021-07-14T16:20:11.0891535Z [cluster2] ".": {},
2021-07-14T16:20:11.0891965Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0892459Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0892886Z [cluster2] },
2021-07-14T16:20:11.0893441Z [cluster2] "k:{\"name\":\"BROKER_K8S_APISERVERTOKEN\"}": {
2021-07-14T16:20:11.0894069Z [cluster2] ".": {},
2021-07-14T16:20:11.0894495Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0894949Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0895367Z [cluster2] },
2021-07-14T16:20:11.0895931Z [cluster2] "k:{\"name\":\"BROKER_K8S_CA\"}": {
2021-07-14T16:20:11.0896406Z [cluster2] ".": {},
2021-07-14T16:20:11.0896844Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0897312Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0897740Z [cluster2] },
2021-07-14T16:20:11.0898425Z [cluster2] "k:{\"name\":\"BROKER_K8S_REMOTENAMESPACE\"}": {
2021-07-14T16:20:11.0899086Z [cluster2] ".": {},
2021-07-14T16:20:11.0899532Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0899971Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0900395Z [cluster2] },
2021-07-14T16:20:11.0900863Z [cluster2] "k:{\"name\":\"CE_IPSEC_DEBUG\"}": {
2021-07-14T16:20:11.0901361Z [cluster2] ".": {},
2021-07-14T16:20:11.0901784Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0902235Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0902667Z [cluster2] },
2021-07-14T16:20:11.0903454Z [cluster2] "k:{\"name\":\"CE_IPSEC_FORCEENCAPS\"}": {
2021-07-14T16:20:11.0904176Z [cluster2] ".": {},
2021-07-14T16:20:11.0904603Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0905058Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0905467Z [cluster2] },
2021-07-14T16:20:11.0905956Z [cluster2] "k:{\"name\":\"CE_IPSEC_IKEPORT\"}": {
2021-07-14T16:20:11.0906460Z [cluster2] ".": {},
2021-07-14T16:20:11.0906972Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0907425Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0907841Z [cluster2] },
2021-07-14T16:20:11.0908340Z [cluster2] "k:{\"name\":\"CE_IPSEC_NATTPORT\"}": {
2021-07-14T16:20:11.0908838Z [cluster2] ".": {},
2021-07-14T16:20:11.0909278Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0909714Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0910146Z [cluster2] },
2021-07-14T16:20:11.0910698Z [cluster2] "k:{\"name\":\"CE_IPSEC_PREFERREDSERVER\"}": {
2021-07-14T16:20:11.0911242Z [cluster2] ".": {},
2021-07-14T16:20:11.0911681Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0912126Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0912549Z [cluster2] },
2021-07-14T16:20:11.0913009Z [cluster2] "k:{\"name\":\"CE_IPSEC_PSK\"}": {
2021-07-14T16:20:11.0913490Z [cluster2] ".": {},
2021-07-14T16:20:11.0913923Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0914369Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0914796Z [cluster2] },
2021-07-14T16:20:11.0915244Z [cluster2] "k:{\"name\":\"NODE_NAME\"}": {
2021-07-14T16:20:11.0915716Z [cluster2] ".": {},
2021-07-14T16:20:11.0916140Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0916615Z [cluster2] "f:valueFrom": {
2021-07-14T16:20:11.0917068Z [cluster2] ".": {},
2021-07-14T16:20:11.0917529Z [cluster2] "f:fieldRef": {
2021-07-14T16:20:11.0917989Z [cluster2] ".": {},
2021-07-14T16:20:11.0918459Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:11.0918987Z [cluster2] "f:fieldPath": {}
2021-07-14T16:20:11.0919502Z [cluster2] }
2021-07-14T16:20:11.0919944Z [cluster2] }
2021-07-14T16:20:11.0920336Z [cluster2] },
2021-07-14T16:20:11.0920798Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-14T16:20:11.0921263Z [cluster2] ".": {},
2021-07-14T16:20:11.0921681Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0922161Z [cluster2] "f:valueFrom": {
2021-07-14T16:20:11.0922606Z [cluster2] ".": {},
2021-07-14T16:20:11.0923066Z [cluster2] "f:fieldRef": {
2021-07-14T16:20:11.0923513Z [cluster2] ".": {},
2021-07-14T16:20:11.0923990Z [cluster2] "f:apiVersion": {},
2021-07-14T16:20:11.0924504Z [cluster2] "f:fieldPath": {}
2021-07-14T16:20:11.0924968Z [cluster2] }
2021-07-14T16:20:11.0925373Z [cluster2] }
2021-07-14T16:20:11.0925765Z [cluster2] },
2021-07-14T16:20:11.0926269Z [cluster2] "k:{\"name\":\"SUBMARINER_BROKER\"}": {
2021-07-14T16:20:11.0926760Z [cluster2] ".": {},
2021-07-14T16:20:11.0927248Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0927685Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0928219Z [cluster2] },
2021-07-14T16:20:11.0928736Z [cluster2] "k:{\"name\":\"SUBMARINER_CABLEDRIVER\"}": {
2021-07-14T16:20:11.0929279Z [cluster2] ".": {},
2021-07-14T16:20:11.0929712Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0930144Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0930572Z [cluster2] },
2021-07-14T16:20:11.0931094Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERCIDR\"}": {
2021-07-14T16:20:11.0931630Z [cluster2] ".": {},
2021-07-14T16:20:11.0932056Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0932507Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0932932Z [cluster2] },
2021-07-14T16:20:11.0933440Z [cluster2] "k:{\"name\":\"SUBMARINER_CLUSTERID\"}": {
2021-07-14T16:20:11.0933962Z [cluster2] ".": {},
2021-07-14T16:20:11.0934383Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0934833Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0935243Z [cluster2] },
2021-07-14T16:20:11.0935766Z [cluster2] "k:{\"name\":\"SUBMARINER_COLORCODES\"}": {
2021-07-14T16:20:11.0936276Z [cluster2] ".": {},
2021-07-14T16:20:11.0936705Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0937156Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0937585Z [cluster2] },
2021-07-14T16:20:11.0938079Z [cluster2] "k:{\"name\":\"SUBMARINER_DEBUG\"}": {
2021-07-14T16:20:11.0938569Z [cluster2] ".": {},
2021-07-14T16:20:11.0938999Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0939531Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0952127Z [cluster2] },
2021-07-14T16:20:11.0952834Z [cluster2] "k:{\"name\":\"SUBMARINER_GLOBALCIDR\"}": {
2021-07-14T16:20:11.0953446Z [cluster2] ".": {},
2021-07-14T16:20:11.0953884Z [cluster2] "f:name": {}
2021-07-14T16:20:11.0954299Z [cluster2] },
2021-07-14T16:20:11.0954916Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKENABLED\"}": {
2021-07-14T16:20:11.0955496Z [cluster2] ".": {},
2021-07-14T16:20:11.0955928Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0956367Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0956793Z [cluster2] },
2021-07-14T16:20:11.0957389Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKINTERVAL\"}": {
2021-07-14T16:20:11.0957983Z [cluster2] ".": {},
2021-07-14T16:20:11.0958412Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0958843Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0959264Z [cluster2] },
2021-07-14T16:20:11.0959978Z [cluster2] "k:{\"name\":\"SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT\"}": {
2021-07-14T16:20:11.0960919Z [cluster2] ".": {},
2021-07-14T16:20:11.0961355Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0961798Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0962228Z [cluster2] },
2021-07-14T16:20:11.0962737Z [cluster2] "k:{\"name\":\"SUBMARINER_NAMESPACE\"}": {
2021-07-14T16:20:11.0963259Z [cluster2] ".": {},
2021-07-14T16:20:11.0963684Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0964134Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0964550Z [cluster2] },
2021-07-14T16:20:11.0965076Z [cluster2] "k:{\"name\":\"SUBMARINER_NATENABLED\"}": {
2021-07-14T16:20:11.0965607Z [cluster2] ".": {},
2021-07-14T16:20:11.0966028Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0966479Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0966894Z [cluster2] },
2021-07-14T16:20:11.0967423Z [cluster2] "k:{\"name\":\"SUBMARINER_SERVICECIDR\"}": {
2021-07-14T16:20:11.0968112Z [cluster2] ".": {},
2021-07-14T16:20:11.0968551Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0969001Z [cluster2] "f:value": {}
2021-07-14T16:20:11.0969412Z [cluster2] }
2021-07-14T16:20:11.0969809Z [cluster2] },
2021-07-14T16:20:11.0970219Z [cluster2] "f:image": {},
2021-07-14T16:20:11.0970752Z [cluster2] "f:imagePullPolicy": {},
2021-07-14T16:20:11.0971256Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0971698Z [cluster2] "f:ports": {
2021-07-14T16:20:11.0972118Z [cluster2] ".": {},
2021-07-14T16:20:11.0972667Z [cluster2] "k:{\"containerPort\":4490,\"protocol\":\"UDP\"}": {
2021-07-14T16:20:11.0973317Z [cluster2] ".": {},
2021-07-14T16:20:11.0973800Z [cluster2] "f:containerPort": {},
2021-07-14T16:20:11.0974333Z [cluster2] "f:hostPort": {},
2021-07-14T16:20:11.0974791Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0975257Z [cluster2] "f:protocol": {}
2021-07-14T16:20:11.0975698Z [cluster2] },
2021-07-14T16:20:11.0976248Z [cluster2] "k:{\"containerPort\":4500,\"protocol\":\"UDP\"}": {
2021-07-14T16:20:11.0976790Z [cluster2] ".": {},
2021-07-14T16:20:11.0977263Z [cluster2] "f:containerPort": {},
2021-07-14T16:20:11.0977790Z [cluster2] "f:hostPort": {},
2021-07-14T16:20:11.0978250Z [cluster2] "f:name": {},
2021-07-14T16:20:11.0979561Z [cluster2] "f:protocol": {}
2021-07-14T16:20:11.0980238Z [cluster2] }
2021-07-14T16:20:11.0980795Z [cluster2] },
2021-07-14T16:20:11.0981239Z [cluster2] "f:resources": {},
2021-07-14T16:20:11.0981921Z [cluster2] "f:securityContext": {
2021-07-14T16:20:11.0982562Z [cluster2] ".": {},
2021-07-14T16:20:11.0983239Z [cluster2] "f:allowPrivilegeEscalation": {},
2021-07-14T16:20:11.0983911Z [cluster2] "f:capabilities": {
2021-07-14T16:20:11.0984373Z [cluster2] ".": {},
2021-07-14T16:20:11.0984804Z [cluster2] "f:add": {},
2021-07-14T16:20:11.0985238Z [cluster2] "f:drop": {}
2021-07-14T16:20:11.0985659Z [cluster2] },
2021-07-14T16:20:11.0986109Z [cluster2] "f:privileged": {},
2021-07-14T16:20:11.0986735Z [cluster2] "f:readOnlyRootFilesystem": {},
2021-07-14T16:20:11.0987372Z [cluster2] "f:runAsNonRoot": {}
2021-07-14T16:20:11.0987823Z [cluster2] },
2021-07-14T16:20:11.0988391Z [cluster2] "f:terminationMessagePath": {},
2021-07-14T16:20:11.0989138Z [cluster2] "f:terminationMessagePolicy": {},
2021-07-14T16:20:11.0989794Z [cluster2] "f:volumeMounts": {
2021-07-14T16:20:11.0990251Z [cluster2] ".": {},
2021-07-14T16:20:11.0990757Z [cluster2] "k:{\"mountPath\":\"/etc/ipsec.d\"}": {
2021-07-14T16:20:11.0991265Z [cluster2] ".": {},
2021-07-14T16:20:11.0992054Z [cluster2] "f:mountPath": {},
2021-07-14T16:20:11.0992530Z [cluster2] "f:name": {}
2021-07-14T16:20:11.0992935Z [cluster2] },
2021-07-14T16:20:11.0993447Z [cluster2] "k:{\"mountPath\":\"/var/lib/ipsec/nss\"}": {
2021-07-14T16:20:11.0993944Z [cluster2] ".": {},
2021-07-14T16:20:11.0994404Z [cluster2] "f:mountPath": {},
2021-07-14T16:20:11.0995002Z [cluster2] "f:name": {}
2021-07-14T16:20:11.0995423Z [cluster2] }
2021-07-14T16:20:11.0995823Z [cluster2] }
2021-07-14T16:20:11.0996196Z [cluster2] }
2021-07-14T16:20:11.0996579Z [cluster2] },
2021-07-14T16:20:11.0997073Z [cluster2] "f:dnsPolicy": {},
2021-07-14T16:20:11.0997991Z [cluster2] "f:enableServiceLinks": {},
2021-07-14T16:20:11.0998690Z [cluster2] "f:hostNetwork": {},
2021-07-14T16:20:11.0999207Z [cluster2] "f:nodeSelector": {
2021-07-14T16:20:11.0999655Z [cluster2] ".": {},
2021-07-14T16:20:11.1000150Z [cluster2] "f:submariner.io/gateway": {}
2021-07-14T16:20:11.1000635Z [cluster2] },
2021-07-14T16:20:11.1001724Z [cluster2] "f:restartPolicy": {},
2021-07-14T16:20:11.1002444Z [cluster2] "f:schedulerName": {},
2021-07-14T16:20:11.1002995Z [cluster2] "f:securityContext": {},
2021-07-14T16:20:11.1003558Z [cluster2] "f:serviceAccount": {},
2021-07-14T16:20:11.1004138Z [cluster2] "f:serviceAccountName": {},
2021-07-14T16:20:11.1004910Z [cluster2] "f:terminationGracePeriodSeconds": {},
2021-07-14T16:20:11.1005602Z [cluster2] "f:tolerations": {},
2021-07-14T16:20:11.1006080Z [cluster2] "f:volumes": {
2021-07-14T16:20:11.1006508Z [cluster2] ".": {},
2021-07-14T16:20:11.1006954Z [cluster2] "k:{\"name\":\"ipsecd\"}": {
2021-07-14T16:20:11.1007404Z [cluster2] ".": {},
2021-07-14T16:20:11.1008232Z [cluster2] "f:emptyDir": {},
2021-07-14T16:20:11.1008795Z [cluster2] "f:name": {}
2021-07-14T16:20:11.1009193Z [cluster2] },
2021-07-14T16:20:11.1009646Z [cluster2] "k:{\"name\":\"ipsecnss\"}": {
2021-07-14T16:20:11.1010094Z [cluster2] ".": {},
2021-07-14T16:20:11.1010544Z [cluster2] "f:emptyDir": {},
2021-07-14T16:20:11.1011010Z [cluster2] "f:name": {}
2021-07-14T16:20:11.1011406Z [cluster2] }
2021-07-14T16:20:11.1011791Z [cluster2] }
2021-07-14T16:20:11.1012167Z [cluster2] }
2021-07-14T16:20:11.1012788Z [cluster2] },
2021-07-14T16:20:11.1014106Z [cluster2] "manager": "kube-controller-manager",
2021-07-14T16:20:11.1014744Z [cluster2] "operation": "Update",
2021-07-14T16:20:11.1015377Z [cluster2] "time": "2021-07-14T16:19:25Z"
2021-07-14T16:20:11.1015784Z [cluster2] },
2021-07-14T16:20:11.1016141Z [cluster2] {
2021-07-14T16:20:11.1016570Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.1017095Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:11.1017578Z [cluster2] "fieldsV1": {
2021-07-14T16:20:11.1018014Z [cluster2] "f:status": {
2021-07-14T16:20:11.1018463Z [cluster2] "f:conditions": {
2021-07-14T16:20:11.1019019Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-14T16:20:11.1019520Z [cluster2] ".": {},
2021-07-14T16:20:11.1020038Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:11.1020627Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:11.1021172Z [cluster2] "f:status": {},
2021-07-14T16:20:11.1021623Z [cluster2] "f:type": {}
2021-07-14T16:20:11.1022017Z [cluster2] },
2021-07-14T16:20:11.1022500Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-14T16:20:11.1022973Z [cluster2] ".": {},
2021-07-14T16:20:11.1023454Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:11.1024158Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:11.1024703Z [cluster2] "f:status": {},
2021-07-14T16:20:11.1025135Z [cluster2] "f:type": {}
2021-07-14T16:20:11.1025547Z [cluster2] },
2021-07-14T16:20:11.1025989Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-14T16:20:11.1026420Z [cluster2] ".": {},
2021-07-14T16:20:11.1026902Z [cluster2] "f:lastProbeTime": {},
2021-07-14T16:20:11.1027483Z [cluster2] "f:lastTransitionTime": {},
2021-07-14T16:20:11.1028021Z [cluster2] "f:status": {},
2021-07-14T16:20:11.1028452Z [cluster2] "f:type": {}
2021-07-14T16:20:11.1028862Z [cluster2] }
2021-07-14T16:20:11.1029233Z [cluster2] },
2021-07-14T16:20:11.1029730Z [cluster2] "f:containerStatuses": {},
2021-07-14T16:20:11.1030260Z [cluster2] "f:hostIP": {},
2021-07-14T16:20:11.1030693Z [cluster2] "f:phase": {},
2021-07-14T16:20:11.1031139Z [cluster2] "f:podIP": {},
2021-07-14T16:20:11.1031573Z [cluster2] "f:podIPs": {
2021-07-14T16:20:11.1032000Z [cluster2] ".": {},
2021-07-14T16:20:11.1032424Z [cluster2] "k:{\"ip\":\"172.18.0.7\"}": {
2021-07-14T16:20:11.1032927Z [cluster2] ".": {},
2021-07-14T16:20:11.1033332Z [cluster2] "f:ip": {}
2021-07-14T16:20:11.1033739Z [cluster2] }
2021-07-14T16:20:11.1034112Z [cluster2] },
2021-07-14T16:20:11.1034552Z [cluster2] "f:startTime": {}
2021-07-14T16:20:11.1034979Z [cluster2] }
2021-07-14T16:20:11.1035340Z [cluster2] },
2021-07-14T16:20:11.1035782Z [cluster2] "manager": "kubelet",
2021-07-14T16:20:11.1036269Z [cluster2] "operation": "Update",
2021-07-14T16:20:11.1036956Z [cluster2] "time": "2021-07-14T16:19:34Z"
2021-07-14T16:20:11.1037354Z [cluster2] },
2021-07-14T16:20:11.1037717Z [cluster2] {
2021-07-14T16:20:11.1038136Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.1038651Z [cluster2] "fieldsType": "FieldsV1",
2021-07-14T16:20:11.1039136Z [cluster2] "fieldsV1": {
2021-07-14T16:20:11.1039586Z [cluster2] "f:metadata": {
2021-07-14T16:20:11.1040036Z [cluster2] "f:labels": {
2021-07-14T16:20:11.1040598Z [cluster2] "f:gateway.submariner.io/node": {},
2021-07-14T16:20:11.1041304Z [cluster2] "f:gateway.submariner.io/status": {}
2021-07-14T16:20:11.1041836Z [cluster2] }
2021-07-14T16:20:11.1042216Z [cluster2] }
2021-07-14T16:20:11.1042574Z [cluster2] },
2021-07-14T16:20:11.1043240Z [cluster2] "manager": "submariner-gateway",
2021-07-14T16:20:11.1044224Z [cluster2] "operation": "Update",
2021-07-14T16:20:11.1044920Z [cluster2] "time": "2021-07-14T16:19:36Z"
2021-07-14T16:20:11.1045329Z [cluster2] }
2021-07-14T16:20:11.1045677Z [cluster2] ],
2021-07-14T16:20:11.1046373Z [cluster2] "name": "submariner-gateway-l7w26",
2021-07-14T16:20:11.1047214Z [cluster2] "namespace": "submariner-operator",
2021-07-14T16:20:11.1048000Z [cluster2] "ownerReferences": [
2021-07-14T16:20:11.1048450Z [cluster2] {
2021-07-14T16:20:11.1048896Z [cluster2] "apiVersion": "apps/v1",
2021-07-14T16:20:11.1049476Z [cluster2] "blockOwnerDeletion": true,
2021-07-14T16:20:11.1050042Z [cluster2] "controller": true,
2021-07-14T16:20:11.1050627Z [cluster2] "kind": "DaemonSet",
2021-07-14T16:20:11.1051350Z [cluster2] "name": "submariner-gateway",
2021-07-14T16:20:11.1052149Z [cluster2] "uid": "7a07b450-7dc6-4974-9df7-0671144904ec"
2021-07-14T16:20:11.1052637Z [cluster2] }
2021-07-14T16:20:11.1052997Z [cluster2] ],
2021-07-14T16:20:11.1060503Z [cluster2] "resourceVersion": "2291",
2021-07-14T16:20:11.1061601Z [cluster2] "uid": "74d44e7f-3f76-4db7-871e-b9fe215826ef"
2021-07-14T16:20:11.1062132Z [cluster2] },
2021-07-14T16:20:11.1062505Z [cluster2] "spec": {
2021-07-14T16:20:11.1062902Z [cluster2] "affinity": {
2021-07-14T16:20:11.1063360Z [cluster2] "nodeAffinity": {
2021-07-14T16:20:11.1070426Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": {
2021-07-14T16:20:11.1071487Z [cluster2] "nodeSelectorTerms": [
2021-07-14T16:20:11.1071982Z [cluster2] {
2021-07-14T16:20:11.1072428Z [cluster2] "matchFields": [
2021-07-14T16:20:11.1072882Z [cluster2] {
2021-07-14T16:20:11.1073351Z [cluster2] "key": "metadata.name",
2021-07-14T16:20:11.1073873Z [cluster2] "operator": "In",
2021-07-14T16:20:11.1080721Z [cluster2] "values": [
2021-07-14T16:20:11.1081811Z [cluster2] "cluster2-worker"
2021-07-14T16:20:11.1082609Z [cluster2] ]
2021-07-14T16:20:11.1083012Z [cluster2] }
2021-07-14T16:20:11.1083405Z [cluster2] ]
2021-07-14T16:20:11.1083772Z [cluster2] }
2021-07-14T16:20:11.1084154Z [cluster2] ]
2021-07-14T16:20:11.1084511Z [cluster2] }
2021-07-14T16:20:11.1084875Z [cluster2] },
2021-07-14T16:20:11.1085320Z [cluster2] "podAntiAffinity": {
2021-07-14T16:20:11.1086343Z [cluster2] "requiredDuringSchedulingIgnoredDuringExecution": [
2021-07-14T16:20:11.1087261Z [cluster2] {
2021-07-14T16:20:11.1087716Z [cluster2] "labelSelector": {
2021-07-14T16:20:11.1088315Z [cluster2] "matchLabels": {
2021-07-14T16:20:11.1089109Z [cluster2] "app": "submariner-gateway"
2021-07-14T16:20:11.1089620Z [cluster2] }
2021-07-14T16:20:11.1090214Z [cluster2] },
2021-07-14T16:20:11.1090769Z [cluster2] "topologyKey": "kubernetes.io/hostname"
2021-07-14T16:20:11.1091284Z [cluster2] }
2021-07-14T16:20:11.1091656Z [cluster2] ]
2021-07-14T16:20:11.1092007Z [cluster2] }
2021-07-14T16:20:11.1092367Z [cluster2] },
2021-07-14T16:20:11.1093108Z [cluster2] "containers": [
2021-07-14T16:20:11.1093531Z [cluster2] {
2021-07-14T16:20:11.1094069Z [cluster2] "command": [
2021-07-14T16:20:11.1094537Z [cluster2] "submariner.sh"
2021-07-14T16:20:11.1094949Z [cluster2] ],
2021-07-14T16:20:11.1095336Z [cluster2] "env": [
2021-07-14T16:20:11.1095724Z [cluster2] {
2021-07-14T16:20:11.1096197Z [cluster2] "name": "SUBMARINER_NAMESPACE",
2021-07-14T16:20:11.1097017Z [cluster2] "value": "submariner-operator"
2021-07-14T16:20:11.1097521Z [cluster2] },
2021-07-14T16:20:11.1097984Z [cluster2] {
2021-07-14T16:20:11.1098502Z [cluster2] "name": "SUBMARINER_CLUSTERCIDR",
2021-07-14T16:20:11.1099099Z [cluster2] "value": "10.2.0.0/16"
2021-07-14T16:20:11.1099534Z [cluster2] },
2021-07-14T16:20:11.1100091Z [cluster2] {
2021-07-14T16:20:11.1100981Z [cluster2] "name": "SUBMARINER_SERVICECIDR",
2021-07-14T16:20:11.1101601Z [cluster2] "value": "100.2.0.0/16"
2021-07-14T16:20:11.1102034Z [cluster2] },
2021-07-14T16:20:11.1102502Z [cluster2] {
2021-07-14T16:20:11.1103056Z [cluster2] "name": "SUBMARINER_GLOBALCIDR"
2021-07-14T16:20:11.1103611Z [cluster2] },
2021-07-14T16:20:11.1104008Z [cluster2] {
2021-07-14T16:20:11.1104567Z [cluster2] "name": "SUBMARINER_CLUSTERID",
2021-07-14T16:20:11.1105130Z [cluster2] "value": "cluster2"
2021-07-14T16:20:11.1105668Z [cluster2] },
2021-07-14T16:20:11.1106797Z [cluster2] {
2021-07-14T16:20:11.1107517Z [cluster2] "name": "SUBMARINER_COLORCODES",
2021-07-14T16:20:11.1108115Z [cluster2] "value": "blue"
2021-07-14T16:20:11.1108566Z [cluster2] },
2021-07-14T16:20:11.1109043Z [cluster2] {
2021-07-14T16:20:11.1109528Z [cluster2] "name": "SUBMARINER_DEBUG",
2021-07-14T16:20:11.1110098Z [cluster2] "value": "false"
2021-07-14T16:20:11.1110536Z [cluster2] },
2021-07-14T16:20:11.1110995Z [cluster2] {
2021-07-14T16:20:11.1111507Z [cluster2] "name": "SUBMARINER_NATENABLED",
2021-07-14T16:20:11.1112115Z [cluster2] "value": "false"
2021-07-14T16:20:11.1112647Z [cluster2] },
2021-07-14T16:20:11.1113091Z [cluster2] {
2021-07-14T16:20:11.1113653Z [cluster2] "name": "SUBMARINER_BROKER",
2021-07-14T16:20:11.1114166Z [cluster2] "value": "k8s"
2021-07-14T16:20:11.1114658Z [cluster2] },
2021-07-14T16:20:11.1115056Z [cluster2] {
2021-07-14T16:20:11.1115638Z [cluster2] "name": "SUBMARINER_CABLEDRIVER",
2021-07-14T16:20:11.1116215Z [cluster2] "value": "libreswan"
2021-07-14T16:20:11.1116725Z [cluster2] },
2021-07-14T16:20:11.1117135Z [cluster2] {
2021-07-14T16:20:11.1117684Z [cluster2] "name": "BROKER_K8S_APISERVER",
2021-07-14T16:20:11.1129381Z [cluster2] "value": "172.18.0.6:6443"
2021-07-14T16:20:11.1129815Z [cluster2] },
2021-07-14T16:20:11.1130194Z [cluster2] {
2021-07-14T16:20:11.1130998Z [cluster2] "name": "BROKER_K8S_APISERVERTOKEN",
2021-07-14T16:20:11.1232860Z [cluster2] "value": "***"
2021-07-14T16:20:11.1233310Z [cluster2] },
2021-07-14T16:20:11.1233693Z [cluster2] {
2021-07-14T16:20:11.1234204Z [cluster2] "name": "BROKER_K8S_REMOTENAMESPACE",
2021-07-14T16:20:11.1246362Z [cluster2] "value": "submariner-k8s-broker"
2021-07-14T16:20:11.1246904Z [cluster2] },
2021-07-14T16:20:11.1247281Z [cluster2] {
2021-07-14T16:20:11.1247722Z [cluster2] "name": "BROKER_K8S_CA",
2021-07-14T16:20:11.1788104Z [cluster2] "value": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hOREUyTVRFd04xb1hEVE14TURjeE1qRTJNVEV3TjFvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBT3dOCkZySzdva0gydlRoa2I2UzRMV01wMHNGcXlmdGNUK3VNS2pLQW5mNjNDM3JCNkF6VmE0Qk5BWDN1L2VjaTZ4WTAKclNYSm5VaTZGZ1N6clBIREtuSzZ1VTBLTXJIcFJHVDAraVE2MCsyWWRjbEtNbEdLbGIwWlpvcUlMSjcySW14NwpoYkhLalZ2ZUdoWUlLSys5K3V3NVdmeTY2M3NyYU9SZHhMa01uQnZ0eXlTWkt1QitTN0Q0emhhd2hWZGJFZW4rCjlwS1hnRkF3amYvQjNSekZFZ2VzbUZtMW5ZdlhHaEpNYkFWN1hBVGZxM2FxNXl0R1o2cjV5OXRyL0RPMlg5WlYKdXVjSURjcW1yNE9TL0xSNHlTVFcvZDQvUFFtSjBtRzgvNjNIZE0xRk1rbXU1Yk00OXVCU2ZHTTRtZUJ0SEZYUgpMc2ZEUFVUMVdTYWplMXF3ZjQ4Q0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZQRmVlWGpFbkpZb0hpWGJmR2oxZHBDWHQ3TTdNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFBZlhVLzBENGJyOUJyL0xxZS9jTnZNdTNuL3A5VzVGSlZXWUFaRGpmUTlEeFBDM3kzNAprcVUveDh2bDFNZ3lEYkwwZGtvNGlPYm15bHdmeXJqVk5MZmE4NFdvQlJPelJHQzk0ZytrR0Y5bC9MS21paEd4CnpYWDRpQ1UxeU5ZWWVYOXBWSlRrdHMwMlVtRDFWYmNPdXAwZXFHZjNZVURkeXpvQ2Jxakl6VXBvTytmcnZJbjYKRGVhVDY2a3Flb3hEQ29VRzdKZ1B4QjM5ckJLbHdmTndMcVJUNlBGTDdwK0ZpL0JuM1gwRjhnMmtUYmtLQTkxYQpZRXJMRFBMRHpBTm14NkllMk0raGRTcUFTaVFncWhWVGdYZUVqQVNvMDVQS3ZhNnl6bmYxektNbmNIOE9RdWkyCmYyNlZ0eEZTWU9JSWRXRUJ3QVRhY1U2N1lvd25pU2xDVzFVKwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg=="
2021-07-14T16:20:11.2288695Z [cluster2] },
2021-07-14T16:20:11.2289113Z [cluster2] {
2021-07-14T16:20:11.2289585Z [cluster2] "name": "CE_IPSEC_PSK",
2021-07-14T16:20:11.2291053Z [cluster2] "value": "eNyoMJLjNFcdKnGHxz1BqVsdMz5rqMpCAriv0eYv0Y6t7lEitIH6uA9wkidvk35Y"
2021-07-14T16:20:11.2292450Z [cluster2] },
2021-07-14T16:20:11.2292814Z [cluster2] {
2021-07-14T16:20:11.2293267Z [cluster2] "name": "CE_IPSEC_DEBUG",
2021-07-14T16:20:11.2293745Z [cluster2] "value": "false"
2021-07-14T16:20:11.2294147Z [cluster2] },
2021-07-14T16:20:11.2294519Z [cluster2] {
2021-07-14T16:20:11.2295053Z [cluster2] "name": "SUBMARINER_HEALTHCHECKENABLED",
2021-07-14T16:20:11.2295986Z [cluster2] "value": "true"
2021-07-14T16:20:11.2296385Z [cluster2] },
2021-07-14T16:20:11.2296754Z [cluster2] {
2021-07-14T16:20:11.2297301Z [cluster2] "name": "SUBMARINER_HEALTHCHECKINTERVAL",
2021-07-14T16:20:11.2297875Z [cluster2] "value": "1"
2021-07-14T16:20:11.2298263Z [cluster2] },
2021-07-14T16:20:11.2298641Z [cluster2] {
2021-07-14T16:20:11.2299311Z [cluster2] "name": "SUBMARINER_HEALTHCHECKMAXPACKETLOSSCOUNT",
2021-07-14T16:20:11.2299997Z [cluster2] "value": "5"
2021-07-14T16:20:11.2300398Z [cluster2] },
2021-07-14T16:20:11.2300759Z [cluster2] {
2021-07-14T16:20:11.2301183Z [cluster2] "name": "NODE_NAME",
2021-07-14T16:20:11.2301638Z [cluster2] "valueFrom": {
2021-07-14T16:20:11.2302111Z [cluster2] "fieldRef": {
2021-07-14T16:20:11.2302589Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.2303151Z [cluster2] "fieldPath": "spec.nodeName"
2021-07-14T16:20:11.2303655Z [cluster2] }
2021-07-14T16:20:11.2304020Z [cluster2] }
2021-07-14T16:20:11.2304397Z [cluster2] },
2021-07-14T16:20:11.2304760Z [cluster2] {
2021-07-14T16:20:11.2305193Z [cluster2] "name": "POD_NAME",
2021-07-14T16:20:11.2305651Z [cluster2] "valueFrom": {
2021-07-14T16:20:11.2306110Z [cluster2] "fieldRef": {
2021-07-14T16:20:11.2306585Z [cluster2] "apiVersion": "v1",
2021-07-14T16:20:11.2307135Z [cluster2] "fieldPath": "metadata.name"
2021-07-14T16:20:11.2307621Z [cluster2] }
2021-07-14T16:20:11.2308073Z [cluster2] }
2021-07-14T16:20:11.2308448Z [cluster2] },
2021-07-14T16:20:11.2308806Z [cluster2] {
2021-07-14T16:20:11.2309280Z [cluster2] "name": "CE_IPSEC_IKEPORT",
2021-07-14T16:20:11.2309742Z [cluster2] "value": "500"
2021-07-14T16:20:11.2310147Z [cluster2] },
2021-07-14T16:20:11.2310615Z [cluster2] {
2021-07-14T16:20:11.2311082Z [cluster2] "name": "CE_IPSEC_NATTPORT",
2021-07-14T16:20:11.2311546Z [cluster2] "value": "4500"
2021-07-14T16:20:11.2311949Z [cluster2] },
2021-07-14T16:20:11.2312310Z [cluster2] {
2021-07-14T16:20:11.2312817Z [cluster2] "name": "CE_IPSEC_PREFERREDSERVER",
2021-07-14T16:20:11.2313361Z [cluster2] "value": "false"
2021-07-14T16:20:11.2313766Z [cluster2] },
2021-07-14T16:20:11.2314140Z [cluster2] {
2021-07-14T16:20:11.2314881Z [cluster2] "name": "CE_IPSEC_FORCEENCAPS",
2021-07-14T16:20:11.2315396Z [cluster2] "value": "false"
2021-07-14T16:20:11.2315796Z [cluster2] }
2021-07-14T16:20:11.2316166Z [cluster2] ],
2021-07-14T16:20:11.2317327Z [cluster2] "image": "localhost:5000/submariner-gateway:local",
2021-07-14T16:20:11.2318008Z [cluster2] "imagePullPolicy": "Always",
2021-07-14T16:20:11.2318759Z [cluster2] "name": "submariner-gateway",
2021-07-14T16:20:11.2319275Z [cluster2] "ports": [
2021-07-14T16:20:11.2319674Z [cluster2] {
2021-07-14T16:20:11.2320152Z [cluster2] "containerPort": 4500,
2021-07-14T16:20:11.2320653Z [cluster2] "hostPort": 4500,
2021-07-14T16:20:11.2321424Z [cluster2] "name": "cable-encaps",
2021-07-14T16:20:11.2322294Z [cluster2] "protocol": "UDP"
2021-07-14T16:20:11.2322712Z [cluster2] },
2021-07-14T16:20:11.2323085Z [cluster2] {
2021-07-14T16:20:11.2323525Z [cluster2] "containerPort": 4490,
2021-07-14T16:20:11.2324024Z [cluster2] "hostPort": 4490,
2021-07-14T16:20:11.2324727Z [cluster2] "name": "natt-discovery",
2021-07-14T16:20:11.2325231Z [cluster2] "protocol": "UDP"
2021-07-14T16:20:11.2325653Z [cluster2] }
2021-07-14T16:20:11.2326010Z [cluster2] ],
2021-07-14T16:20:11.2326429Z [cluster2] "resources": {},
2021-07-14T16:20:11.2326916Z [cluster2] "securityContext": {
2021-07-14T16:20:11.2327588Z [cluster2] "allowPrivilegeEscalation": true,
2021-07-14T16:20:11.2328321Z [cluster2] "capabilities": {
2021-07-14T16:20:11.2328773Z [cluster2] "add": [
2021-07-14T16:20:11.2329184Z [cluster2] "net_admin"
2021-07-14T16:20:11.2329592Z [cluster2] ],
2021-07-14T16:20:11.2329991Z [cluster2] "drop": [
2021-07-14T16:20:11.2330386Z [cluster2] "all"
2021-07-14T16:20:11.2330775Z [cluster2] ]
2021-07-14T16:20:11.2331138Z [cluster2] },
2021-07-14T16:20:11.2331587Z [cluster2] "privileged": true,
2021-07-14T16:20:11.2332195Z [cluster2] "readOnlyRootFilesystem": false,
2021-07-14T16:20:11.2332823Z [cluster2] "runAsNonRoot": false
2021-07-14T16:20:11.2333251Z [cluster2] },
2021-07-14T16:20:11.2334063Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-14T16:20:11.2336354Z [cluster2] "terminationMessagePolicy": "File",
2021-07-14T16:20:11.2337022Z [cluster2] "volumeMounts": [
2021-07-14T16:20:11.2337459Z [cluster2] {
2021-07-14T16:20:11.2338702Z [cluster2] "mountPath": "/etc/ipsec.d",
2021-07-14T16:20:11.2339358Z [cluster2] "name": "ipsecd"
2021-07-14T16:20:11.2339775Z [cluster2] },
2021-07-14T16:20:11.2340151Z [cluster2] {
2021-07-14T16:20:11.2340769Z [cluster2] "mountPath": "/var/lib/ipsec/nss",
2021-07-14T16:20:11.2341304Z [cluster2] "name": "ipsecnss"
2021-07-14T16:20:11.2341720Z [cluster2] },
2021-07-14T16:20:11.2342097Z [cluster2] {
2021-07-14T16:20:11.2342723Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-14T16:20:11.2343854Z [cluster2] "name": "submariner-gateway-token-62tz6",
2021-07-14T16:20:11.2345047Z [cluster2] "readOnly": true
2021-07-14T16:20:11.2345882Z [cluster2] }
2021-07-14T16:20:11.2346257Z [cluster2] ]
2021-07-14T16:20:11.2346608Z [cluster2] }
2021-07-14T16:20:11.2346972Z [cluster2] ],
2021-07-14T16:20:11.2347425Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-14T1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment