Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 14, 2021 15:16
Show Gist options
  • Save dfarrell07/f7dd1d1dd730102e667421e1b32e4392 to your computer and use it in GitHub Desktop.
Save dfarrell07/f7dd1d1dd730102e667421e1b32e4392 to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210711
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-11T01:27:53.3058285Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-11T01:27:53.3058343Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-11T01:28:01.5375558Z Current runner version: '2.278.0'
2021-07-11T01:28:01.5405255Z ##[group]Operating System
2021-07-11T01:28:01.5406358Z Ubuntu
2021-07-11T01:28:01.5406971Z 20.04.2
2021-07-11T01:28:01.5407464Z LTS
2021-07-11T01:28:01.5408042Z ##[endgroup]
2021-07-11T01:28:01.5408694Z ##[group]Virtual Environment
2021-07-11T01:28:01.5409470Z Environment: ubuntu-20.04
2021-07-11T01:28:01.5410099Z Version: 20210628.1
2021-07-11T01:28:01.5411324Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210628.1/images/linux/Ubuntu2004-README.md
2021-07-11T01:28:01.5412899Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210628.1
2021-07-11T01:28:01.5413970Z ##[endgroup]
2021-07-11T01:28:01.5416216Z ##[group]GITHUB_TOKEN Permissions
2021-07-11T01:28:01.5417593Z Actions: write
2021-07-11T01:28:01.5418237Z Checks: write
2021-07-11T01:28:01.5418884Z Contents: write
2021-07-11T01:28:01.5419495Z Deployments: write
2021-07-11T01:28:01.5420317Z Discussions: write
2021-07-11T01:28:01.5421022Z Issues: write
2021-07-11T01:28:01.5421655Z Metadata: read
2021-07-11T01:28:01.5422238Z Packages: write
2021-07-11T01:28:01.5422920Z PullRequests: write
2021-07-11T01:28:01.5423647Z RepositoryProjects: write
2021-07-11T01:28:01.5424450Z SecurityEvents: write
2021-07-11T01:28:01.5425099Z Statuses: write
2021-07-11T01:28:01.5425824Z ##[endgroup]
2021-07-11T01:28:01.5429267Z Prepare workflow directory
2021-07-11T01:28:01.6145298Z Prepare all required actions
2021-07-11T01:28:01.6157939Z Getting action download info
2021-07-11T01:28:02.1488525Z Download action repository 'actions/checkout@v2'
2021-07-11T01:28:04.0609800Z Download action repository 'submariner-io/shipyard@devel'
2021-07-11T01:28:04.5447142Z ##[group]Run actions/checkout@v2
2021-07-11T01:28:04.5447959Z with:
2021-07-11T01:28:04.5448699Z repository: submariner-io/submariner-operator
2021-07-11T01:28:04.5449966Z token: ***
2021-07-11T01:28:04.5450493Z ssh-strict: true
2021-07-11T01:28:04.5451149Z persist-credentials: true
2021-07-11T01:28:04.5451790Z clean: true
2021-07-11T01:28:04.5452322Z fetch-depth: 1
2021-07-11T01:28:04.5452832Z lfs: false
2021-07-11T01:28:04.5453362Z submodules: false
2021-07-11T01:28:04.5453898Z ##[endgroup]
2021-07-11T01:28:04.8175297Z Syncing repository: submariner-io/submariner-operator
2021-07-11T01:28:04.8195185Z ##[group]Getting Git version info
2021-07-11T01:28:04.8196722Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-11T01:28:04.8253837Z [command]/usr/bin/git version
2021-07-11T01:28:04.8420446Z git version 2.32.0
2021-07-11T01:28:04.8442963Z ##[endgroup]
2021-07-11T01:28:04.8451120Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-11T01:28:04.8455143Z ##[group]Initializing the repository
2021-07-11T01:28:04.8460049Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-11T01:28:05.2573375Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-11T01:28:05.2581013Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-11T01:28:05.2582203Z hint: of your new repositories, which will suppress this warning, call:
2021-07-11T01:28:05.2583061Z hint:
2021-07-11T01:28:05.2584262Z hint: git config --global init.defaultBranch <name>
2021-07-11T01:28:05.2585082Z hint:
2021-07-11T01:28:05.2586126Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-11T01:28:05.2587480Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-11T01:28:05.2588366Z hint:
2021-07-11T01:28:05.2589204Z hint: git branch -m <name>
2021-07-11T01:28:05.2590823Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-11T01:28:05.2592697Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-11T01:28:05.2593935Z ##[endgroup]
2021-07-11T01:28:05.2594771Z ##[group]Disabling automatic garbage collection
2021-07-11T01:28:05.2596147Z [command]/usr/bin/git config --local gc.auto 0
2021-07-11T01:28:05.2596950Z ##[endgroup]
2021-07-11T01:28:05.2599184Z ##[group]Setting up auth
2021-07-11T01:28:05.2600433Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-11T01:28:05.2602326Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-11T01:28:05.2604260Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-11T01:28:05.2606593Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-11T01:28:05.2608854Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-11T01:28:05.2609998Z ##[endgroup]
2021-07-11T01:28:05.2610774Z ##[group]Fetching the repository
2021-07-11T01:28:05.2612799Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +1a48316f3cfbf3af9d2ab5c043cb2268adf4c43d:refs/remotes/origin/devel
2021-07-11T01:28:05.2614483Z remote: Enumerating objects: 486, done.
2021-07-11T01:28:05.2615338Z remote: Counting objects: 0% (1/486)
2021-07-11T01:28:05.2616147Z remote: Counting objects: 1% (5/486)
2021-07-11T01:28:05.2616944Z remote: Counting objects: 2% (10/486)
2021-07-11T01:28:05.2617751Z remote: Counting objects: 3% (15/486)
2021-07-11T01:28:05.2618713Z remote: Counting objects: 4% (20/486)
2021-07-11T01:28:05.2619527Z remote: Counting objects: 5% (25/486)
2021-07-11T01:28:05.2620338Z remote: Counting objects: 6% (30/486)
2021-07-11T01:28:05.2621698Z remote: Counting objects: 7% (35/486)
2021-07-11T01:28:05.2622580Z remote: Counting objects: 8% (39/486)
2021-07-11T01:28:05.2623400Z remote: Counting objects: 9% (44/486)
2021-07-11T01:28:05.2624188Z remote: Counting objects: 10% (49/486)
2021-07-11T01:28:05.2624989Z remote: Counting objects: 11% (54/486)
2021-07-11T01:28:05.2625792Z remote: Counting objects: 12% (59/486)
2021-07-11T01:28:05.2626594Z remote: Counting objects: 13% (64/486)
2021-07-11T01:28:05.2627400Z remote: Counting objects: 14% (69/486)
2021-07-11T01:28:05.2628192Z remote: Counting objects: 15% (73/486)
2021-07-11T01:28:05.2628999Z remote: Counting objects: 16% (78/486)
2021-07-11T01:28:05.2629817Z remote: Counting objects: 17% (83/486)
2021-07-11T01:28:05.2630887Z remote: Counting objects: 18% (88/486)
2021-07-11T01:28:05.2689468Z remote: Counting objects: 19% (93/486)
2021-07-11T01:28:05.2690527Z remote: Counting objects: 20% (98/486)
2021-07-11T01:28:05.2691383Z remote: Counting objects: 21% (103/486)
2021-07-11T01:28:05.2692253Z remote: Counting objects: 22% (107/486)
2021-07-11T01:28:05.2693335Z remote: Counting objects: 23% (112/486)
2021-07-11T01:28:05.2694186Z remote: Counting objects: 24% (117/486)
2021-07-11T01:28:05.2694994Z remote: Counting objects: 25% (122/486)
2021-07-11T01:28:05.2695811Z remote: Counting objects: 26% (127/486)
2021-07-11T01:28:05.2696635Z remote: Counting objects: 27% (132/486)
2021-07-11T01:28:05.2697444Z remote: Counting objects: 28% (137/486)
2021-07-11T01:28:05.2698252Z remote: Counting objects: 29% (141/486)
2021-07-11T01:28:05.2699082Z remote: Counting objects: 30% (146/486)
2021-07-11T01:28:05.2699895Z remote: Counting objects: 31% (151/486)
2021-07-11T01:28:05.2700704Z remote: Counting objects: 32% (156/486)
2021-07-11T01:28:05.2701504Z remote: Counting objects: 33% (161/486)
2021-07-11T01:28:05.2702312Z remote: Counting objects: 34% (166/486)
2021-07-11T01:28:05.2703335Z remote: Counting objects: 35% (171/486)
2021-07-11T01:28:05.2704141Z remote: Counting objects: 36% (175/486)
2021-07-11T01:28:05.2704960Z remote: Counting objects: 37% (180/486)
2021-07-11T01:28:05.2705757Z remote: Counting objects: 38% (185/486)
2021-07-11T01:28:05.2706579Z remote: Counting objects: 39% (190/486)
2021-07-11T01:28:05.2707393Z remote: Counting objects: 40% (195/486)
2021-07-11T01:28:05.2708211Z remote: Counting objects: 41% (200/486)
2021-07-11T01:28:05.2709024Z remote: Counting objects: 42% (205/486)
2021-07-11T01:28:05.2709839Z remote: Counting objects: 43% (209/486)
2021-07-11T01:28:05.2711665Z remote: Counting objects: 44% (214/486)
2021-07-11T01:28:05.2712497Z remote: Counting objects: 45% (219/486)
2021-07-11T01:28:05.2713296Z remote: Counting objects: 46% (224/486)
2021-07-11T01:28:05.2714115Z remote: Counting objects: 47% (229/486)
2021-07-11T01:28:05.2714921Z remote: Counting objects: 48% (234/486)
2021-07-11T01:28:05.2715731Z remote: Counting objects: 49% (239/486)
2021-07-11T01:28:05.2716540Z remote: Counting objects: 50% (243/486)
2021-07-11T01:28:05.2717342Z remote: Counting objects: 51% (248/486)
2021-07-11T01:28:05.2718151Z remote: Counting objects: 52% (253/486)
2021-07-11T01:28:05.2718954Z remote: Counting objects: 53% (258/486)
2021-07-11T01:28:05.2719765Z remote: Counting objects: 54% (263/486)
2021-07-11T01:28:05.2720570Z remote: Counting objects: 55% (268/486)
2021-07-11T01:28:05.2721494Z remote: Counting objects: 56% (273/486)
2021-07-11T01:28:05.2722345Z remote: Counting objects: 57% (278/486)
2021-07-11T01:28:05.2723152Z remote: Counting objects: 58% (282/486)
2021-07-11T01:28:05.2723953Z remote: Counting objects: 59% (287/486)
2021-07-11T01:28:05.2724774Z remote: Counting objects: 60% (292/486)
2021-07-11T01:28:05.2725576Z remote: Counting objects: 61% (297/486)
2021-07-11T01:28:05.2726393Z remote: Counting objects: 62% (302/486)
2021-07-11T01:28:05.2727214Z remote: Counting objects: 63% (307/486)
2021-07-11T01:28:05.2728024Z remote: Counting objects: 64% (312/486)
2021-07-11T01:28:05.2728840Z remote: Counting objects: 65% (316/486)
2021-07-11T01:28:05.2729636Z remote: Counting objects: 66% (321/486)
2021-07-11T01:28:05.2730450Z remote: Counting objects: 67% (326/486)
2021-07-11T01:28:05.2731266Z remote: Counting objects: 68% (331/486)
2021-07-11T01:28:05.2732065Z remote: Counting objects: 69% (336/486)
2021-07-11T01:28:05.2732879Z remote: Counting objects: 70% (341/486)
2021-07-11T01:28:05.2733881Z remote: Counting objects: 71% (346/486)
2021-07-11T01:28:05.2734687Z remote: Counting objects: 72% (350/486)
2021-07-11T01:28:05.2735508Z remote: Counting objects: 73% (355/486)
2021-07-11T01:28:05.2736344Z remote: Counting objects: 74% (360/486)
2021-07-11T01:28:05.2737148Z remote: Counting objects: 75% (365/486)
2021-07-11T01:28:05.2737959Z remote: Counting objects: 76% (370/486)
2021-07-11T01:28:05.2738768Z remote: Counting objects: 77% (375/486)
2021-07-11T01:28:05.2739575Z remote: Counting objects: 78% (380/486)
2021-07-11T01:28:05.2740392Z remote: Counting objects: 79% (384/486)
2021-07-11T01:28:05.2741188Z remote: Counting objects: 80% (389/486)
2021-07-11T01:28:05.2742014Z remote: Counting objects: 81% (394/486)
2021-07-11T01:28:05.2742805Z remote: Counting objects: 82% (399/486)
2021-07-11T01:28:05.2743629Z remote: Counting objects: 83% (404/486)
2021-07-11T01:28:05.2744449Z remote: Counting objects: 84% (409/486)
2021-07-11T01:28:05.2745241Z remote: Counting objects: 85% (414/486)
2021-07-11T01:28:05.2746051Z remote: Counting objects: 86% (418/486)
2021-07-11T01:28:05.2746998Z remote: Counting objects: 87% (423/486)
2021-07-11T01:28:05.2747804Z remote: Counting objects: 88% (428/486)
2021-07-11T01:28:05.2748629Z remote: Counting objects: 89% (433/486)
2021-07-11T01:28:05.2749424Z remote: Counting objects: 90% (438/486)
2021-07-11T01:28:05.2750383Z remote: Counting objects: 91% (443/486)
2021-07-11T01:28:05.2751216Z remote: Counting objects: 92% (448/486)
2021-07-11T01:28:05.2752023Z remote: Counting objects: 93% (452/486)
2021-07-11T01:28:05.2752831Z remote: Counting objects: 94% (457/486)
2021-07-11T01:28:05.2753625Z remote: Counting objects: 95% (462/486)
2021-07-11T01:28:05.2754452Z remote: Counting objects: 96% (467/486)
2021-07-11T01:28:05.2755275Z remote: Counting objects: 97% (472/486)
2021-07-11T01:28:05.2756071Z remote: Counting objects: 98% (477/486)
2021-07-11T01:28:05.2756884Z remote: Counting objects: 99% (482/486)
2021-07-11T01:28:05.2757684Z remote: Counting objects: 100% (486/486)
2021-07-11T01:28:05.2758539Z remote: Counting objects: 100% (486/486), done.
2021-07-11T01:28:05.2759414Z remote: Compressing objects: 0% (1/346)
2021-07-11T01:28:05.2760278Z remote: Compressing objects: 1% (4/346)
2021-07-11T01:28:05.2761150Z remote: Compressing objects: 2% (7/346)
2021-07-11T01:28:05.2762021Z remote: Compressing objects: 3% (11/346)
2021-07-11T01:28:05.2762884Z remote: Compressing objects: 4% (14/346)
2021-07-11T01:28:05.2763739Z remote: Compressing objects: 5% (18/346)
2021-07-11T01:28:05.2764591Z remote: Compressing objects: 6% (21/346)
2021-07-11T01:28:05.2765570Z remote: Compressing objects: 7% (25/346)
2021-07-11T01:28:05.2766452Z remote: Compressing objects: 8% (28/346)
2021-07-11T01:28:05.2767304Z remote: Compressing objects: 9% (32/346)
2021-07-11T01:28:05.2768161Z remote: Compressing objects: 10% (35/346)
2021-07-11T01:28:05.2769024Z remote: Compressing objects: 11% (39/346)
2021-07-11T01:28:05.2769898Z remote: Compressing objects: 12% (42/346)
2021-07-11T01:28:05.2770758Z remote: Compressing objects: 13% (45/346)
2021-07-11T01:28:05.2771608Z remote: Compressing objects: 14% (49/346)
2021-07-11T01:28:05.2772462Z remote: Compressing objects: 15% (52/346)
2021-07-11T01:28:05.2773321Z remote: Compressing objects: 16% (56/346)
2021-07-11T01:28:05.2774177Z remote: Compressing objects: 17% (59/346)
2021-07-11T01:28:05.2775047Z remote: Compressing objects: 18% (63/346)
2021-07-11T01:28:05.2775896Z remote: Compressing objects: 19% (66/346)
2021-07-11T01:28:05.2776765Z remote: Compressing objects: 20% (70/346)
2021-07-11T01:28:05.2777627Z remote: Compressing objects: 21% (73/346)
2021-07-11T01:28:05.2778479Z remote: Compressing objects: 22% (77/346)
2021-07-11T01:28:05.2779385Z remote: Compressing objects: 23% (80/346)
2021-07-11T01:28:05.2780250Z remote: Compressing objects: 24% (84/346)
2021-07-11T01:28:05.2781113Z remote: Compressing objects: 25% (87/346)
2021-07-11T01:28:05.2781981Z remote: Compressing objects: 26% (90/346)
2021-07-11T01:28:05.2782825Z remote: Compressing objects: 27% (94/346)
2021-07-11T01:28:05.2783698Z remote: Compressing objects: 28% (97/346)
2021-07-11T01:28:05.2784561Z remote: Compressing objects: 29% (101/346)
2021-07-11T01:28:05.2785421Z remote: Compressing objects: 30% (104/346)
2021-07-11T01:28:05.2786296Z remote: Compressing objects: 31% (108/346)
2021-07-11T01:28:05.2787163Z remote: Compressing objects: 32% (111/346)
2021-07-11T01:28:05.2788039Z remote: Compressing objects: 33% (115/346)
2021-07-11T01:28:05.2788915Z remote: Compressing objects: 34% (118/346)
2021-07-11T01:28:05.2789768Z remote: Compressing objects: 35% (122/346)
2021-07-11T01:28:05.2790820Z remote: Compressing objects: 36% (125/346)
2021-07-11T01:28:05.2791802Z remote: Compressing objects: 37% (129/346)
2021-07-11T01:28:05.2792668Z remote: Compressing objects: 38% (132/346)
2021-07-11T01:28:05.2793532Z remote: Compressing objects: 39% (135/346)
2021-07-11T01:28:05.2794380Z remote: Compressing objects: 40% (139/346)
2021-07-11T01:28:05.2795242Z remote: Compressing objects: 41% (142/346)
2021-07-11T01:28:05.2796095Z remote: Compressing objects: 42% (146/346)
2021-07-11T01:28:05.2796966Z remote: Compressing objects: 43% (149/346)
2021-07-11T01:28:05.2797827Z remote: Compressing objects: 44% (153/346)
2021-07-11T01:28:05.2798682Z remote: Compressing objects: 45% (156/346)
2021-07-11T01:28:05.2799554Z remote: Compressing objects: 46% (160/346)
2021-07-11T01:28:05.2800416Z remote: Compressing objects: 47% (163/346)
2021-07-11T01:28:05.2801271Z remote: Compressing objects: 48% (167/346)
2021-07-11T01:28:05.2802140Z remote: Compressing objects: 49% (170/346)
2021-07-11T01:28:05.2802987Z remote: Compressing objects: 50% (173/346)
2021-07-11T01:28:05.2803848Z remote: Compressing objects: 51% (177/346)
2021-07-11T01:28:05.2804710Z remote: Compressing objects: 52% (180/346)
2021-07-11T01:28:05.2805563Z remote: Compressing objects: 53% (184/346)
2021-07-11T01:28:05.2806428Z remote: Compressing objects: 54% (187/346)
2021-07-11T01:28:05.2807271Z remote: Compressing objects: 55% (191/346)
2021-07-11T01:28:05.2808144Z remote: Compressing objects: 56% (194/346)
2021-07-11T01:28:05.2809007Z remote: Compressing objects: 57% (198/346)
2021-07-11T01:28:05.2809963Z remote: Compressing objects: 58% (201/346)
2021-07-11T01:28:05.2810846Z remote: Compressing objects: 59% (205/346)
2021-07-11T01:28:05.2811711Z remote: Compressing objects: 60% (208/346)
2021-07-11T01:28:05.2812558Z remote: Compressing objects: 61% (212/346)
2021-07-11T01:28:05.2813429Z remote: Compressing objects: 62% (215/346)
2021-07-11T01:28:05.2814274Z remote: Compressing objects: 63% (218/346)
2021-07-11T01:28:05.2815140Z remote: Compressing objects: 64% (222/346)
2021-07-11T01:28:05.2816002Z remote: Compressing objects: 65% (225/346)
2021-07-11T01:28:05.2816847Z remote: Compressing objects: 66% (229/346)
2021-07-11T01:28:05.2817720Z remote: Compressing objects: 67% (232/346)
2021-07-11T01:28:05.2818564Z remote: Compressing objects: 68% (236/346)
2021-07-11T01:28:05.2819429Z remote: Compressing objects: 69% (239/346)
2021-07-11T01:28:05.2820302Z remote: Compressing objects: 70% (243/346)
2021-07-11T01:28:05.2821149Z remote: Compressing objects: 71% (246/346)
2021-07-11T01:28:05.2822019Z remote: Compressing objects: 72% (250/346)
2021-07-11T01:28:05.2822886Z remote: Compressing objects: 73% (253/346)
2021-07-11T01:28:05.2823735Z remote: Compressing objects: 74% (257/346)
2021-07-11T01:28:05.2824600Z remote: Compressing objects: 75% (260/346)
2021-07-11T01:28:05.2825455Z remote: Compressing objects: 76% (263/346)
2021-07-11T01:28:05.2826325Z remote: Compressing objects: 77% (267/346)
2021-07-11T01:28:05.2827188Z remote: Compressing objects: 78% (270/346)
2021-07-11T01:28:05.2828032Z remote: Compressing objects: 79% (274/346)
2021-07-11T01:28:05.2828892Z remote: Compressing objects: 80% (277/346)
2021-07-11T01:28:05.2829740Z remote: Compressing objects: 81% (281/346)
2021-07-11T01:28:05.2830762Z remote: Compressing objects: 82% (284/346)
2021-07-11T01:28:05.2831643Z remote: Compressing objects: 83% (288/346)
2021-07-11T01:28:05.2832487Z remote: Compressing objects: 84% (291/346)
2021-07-11T01:28:05.2833347Z remote: Compressing objects: 85% (295/346)
2021-07-11T01:28:05.2834193Z remote: Compressing objects: 86% (298/346)
2021-07-11T01:28:05.2835174Z remote: Compressing objects: 87% (302/346)
2021-07-11T01:28:05.2836040Z remote: Compressing objects: 88% (305/346)
2021-07-11T01:28:05.2836875Z remote: Compressing objects: 89% (308/346)
2021-07-11T01:28:05.2837740Z remote: Compressing objects: 90% (312/346)
2021-07-11T01:28:05.2838605Z remote: Compressing objects: 91% (315/346)
2021-07-11T01:28:05.2839457Z remote: Compressing objects: 92% (319/346)
2021-07-11T01:28:05.2840324Z remote: Compressing objects: 93% (322/346)
2021-07-11T01:28:05.2841170Z remote: Compressing objects: 94% (326/346)
2021-07-11T01:28:05.2842036Z remote: Compressing objects: 95% (329/346)
2021-07-11T01:28:05.2842903Z remote: Compressing objects: 96% (333/346)
2021-07-11T01:28:05.2844138Z remote: Compressing objects: 97% (336/346)
2021-07-11T01:28:05.2845322Z remote: Compressing objects: 98% (340/346)
2021-07-11T01:28:05.2925294Z remote: Compressing objects: 99% (343/346)
2021-07-11T01:28:05.2926338Z remote: Compressing objects: 100% (346/346)
2021-07-11T01:28:05.2927279Z remote: Compressing objects: 100% (346/346), done.
2021-07-11T01:28:05.2928123Z Receiving objects: 0% (1/486)
2021-07-11T01:28:05.2928892Z Receiving objects: 1% (5/486)
2021-07-11T01:28:05.2929655Z Receiving objects: 2% (10/486)
2021-07-11T01:28:05.2930405Z Receiving objects: 3% (15/486)
2021-07-11T01:28:05.2931166Z Receiving objects: 4% (20/486)
2021-07-11T01:28:05.2931897Z Receiving objects: 5% (25/486)
2021-07-11T01:28:05.2932645Z Receiving objects: 6% (30/486)
2021-07-11T01:28:05.2933676Z Receiving objects: 7% (35/486)
2021-07-11T01:28:05.2934620Z Receiving objects: 8% (39/486)
2021-07-11T01:28:05.2935410Z Receiving objects: 9% (44/486)
2021-07-11T01:28:05.2936283Z Receiving objects: 10% (49/486)
2021-07-11T01:28:05.2937046Z Receiving objects: 11% (54/486)
2021-07-11T01:28:05.2937797Z Receiving objects: 12% (59/486)
2021-07-11T01:28:05.2938557Z Receiving objects: 13% (64/486)
2021-07-11T01:28:05.2939328Z Receiving objects: 14% (69/486)
2021-07-11T01:28:05.2940071Z Receiving objects: 15% (73/486)
2021-07-11T01:28:05.2940826Z Receiving objects: 16% (78/486)
2021-07-11T01:28:05.2941570Z Receiving objects: 17% (83/486)
2021-07-11T01:28:05.2942330Z Receiving objects: 18% (88/486)
2021-07-11T01:28:05.2943086Z Receiving objects: 19% (93/486)
2021-07-11T01:28:05.2943827Z Receiving objects: 20% (98/486)
2021-07-11T01:28:05.2944583Z Receiving objects: 21% (103/486)
2021-07-11T01:28:05.2945328Z Receiving objects: 22% (107/486)
2021-07-11T01:28:05.2946090Z Receiving objects: 23% (112/486)
2021-07-11T01:28:05.2946864Z Receiving objects: 24% (117/486)
2021-07-11T01:28:05.2947606Z Receiving objects: 25% (122/486)
2021-07-11T01:28:05.2948363Z Receiving objects: 26% (127/486)
2021-07-11T01:28:05.2949109Z Receiving objects: 27% (132/486)
2021-07-11T01:28:05.2949869Z Receiving objects: 28% (137/486)
2021-07-11T01:28:05.2950782Z Receiving objects: 29% (141/486)
2021-07-11T01:28:05.2951533Z Receiving objects: 30% (146/486)
2021-07-11T01:28:05.2952294Z Receiving objects: 31% (151/486)
2021-07-11T01:28:05.2953035Z Receiving objects: 32% (156/486)
2021-07-11T01:28:05.2953792Z Receiving objects: 33% (161/486)
2021-07-11T01:28:05.2954554Z Receiving objects: 34% (166/486)
2021-07-11T01:28:05.2955290Z Receiving objects: 35% (171/486)
2021-07-11T01:28:05.2956051Z Receiving objects: 36% (175/486)
2021-07-11T01:28:05.2956791Z Receiving objects: 37% (180/486)
2021-07-11T01:28:05.2957547Z Receiving objects: 38% (185/486)
2021-07-11T01:28:05.2958315Z Receiving objects: 39% (190/486)
2021-07-11T01:28:05.2959059Z Receiving objects: 40% (195/486)
2021-07-11T01:28:05.2959813Z Receiving objects: 41% (200/486)
2021-07-11T01:28:05.2960557Z Receiving objects: 42% (205/486)
2021-07-11T01:28:05.2961305Z Receiving objects: 43% (209/486)
2021-07-11T01:28:05.2962061Z Receiving objects: 44% (214/486)
2021-07-11T01:28:05.2962805Z Receiving objects: 45% (219/486)
2021-07-11T01:28:05.2963707Z Receiving objects: 46% (224/486)
2021-07-11T01:28:05.2964447Z Receiving objects: 47% (229/486)
2021-07-11T01:28:05.2965212Z Receiving objects: 48% (234/486)
2021-07-11T01:28:05.2965962Z Receiving objects: 49% (239/486)
2021-07-11T01:28:05.2966697Z Receiving objects: 50% (243/486)
2021-07-11T01:28:05.2967455Z Receiving objects: 51% (248/486)
2021-07-11T01:28:05.2968193Z Receiving objects: 52% (253/486)
2021-07-11T01:28:05.2968952Z Receiving objects: 53% (258/486)
2021-07-11T01:28:05.2969714Z Receiving objects: 54% (263/486)
2021-07-11T01:28:05.2970448Z Receiving objects: 55% (268/486)
2021-07-11T01:28:05.2971201Z Receiving objects: 56% (273/486)
2021-07-11T01:28:05.2971939Z Receiving objects: 57% (278/486)
2021-07-11T01:28:05.2972698Z Receiving objects: 58% (282/486)
2021-07-11T01:28:05.2973452Z Receiving objects: 59% (287/486)
2021-07-11T01:28:05.2974190Z Receiving objects: 60% (292/486)
2021-07-11T01:28:05.2974939Z Receiving objects: 61% (297/486)
2021-07-11T01:28:05.2975674Z Receiving objects: 62% (302/486)
2021-07-11T01:28:05.2976438Z Receiving objects: 63% (307/486)
2021-07-11T01:28:05.2977190Z Receiving objects: 64% (312/486)
2021-07-11T01:28:05.2977917Z Receiving objects: 65% (316/486)
2021-07-11T01:28:05.2978671Z Receiving objects: 66% (321/486)
2021-07-11T01:28:05.2979477Z Receiving objects: 67% (326/486)
2021-07-11T01:28:05.2980222Z Receiving objects: 68% (331/486)
2021-07-11T01:28:05.2980977Z Receiving objects: 69% (336/486)
2021-07-11T01:28:05.2981716Z Receiving objects: 70% (341/486)
2021-07-11T01:28:05.2982478Z Receiving objects: 71% (346/486)
2021-07-11T01:28:05.2983238Z Receiving objects: 72% (350/486)
2021-07-11T01:28:05.2984069Z Receiving objects: 73% (355/486)
2021-07-11T01:28:05.2984842Z Receiving objects: 74% (360/486)
2021-07-11T01:28:05.2985582Z Receiving objects: 75% (365/486)
2021-07-11T01:28:05.2986335Z Receiving objects: 76% (370/486)
2021-07-11T01:28:05.2987098Z Receiving objects: 77% (375/486)
2021-07-11T01:28:05.2987830Z Receiving objects: 78% (380/486)
2021-07-11T01:28:05.2988599Z Receiving objects: 79% (384/486)
2021-07-11T01:28:05.2989334Z Receiving objects: 80% (389/486)
2021-07-11T01:28:05.2990201Z Receiving objects: 81% (394/486)
2021-07-11T01:28:05.3007051Z Receiving objects: 82% (399/486)
2021-07-11T01:28:05.3007922Z Receiving objects: 83% (404/486)
2021-07-11T01:28:05.3009377Z remote: Total 486 (delta 155), reused 315 (delta 94), pack-reused 0
2021-07-11T01:28:05.3010287Z Receiving objects: 84% (409/486)
2021-07-11T01:28:05.3011051Z Receiving objects: 85% (414/486)
2021-07-11T01:28:05.3011813Z Receiving objects: 86% (418/486)
2021-07-11T01:28:05.3012556Z Receiving objects: 87% (423/486)
2021-07-11T01:28:05.3013336Z Receiving objects: 88% (428/486)
2021-07-11T01:28:05.3014080Z Receiving objects: 89% (433/486)
2021-07-11T01:28:05.3014841Z Receiving objects: 90% (438/486)
2021-07-11T01:28:05.3015605Z Receiving objects: 91% (443/486)
2021-07-11T01:28:05.3016344Z Receiving objects: 92% (448/486)
2021-07-11T01:28:05.3017113Z Receiving objects: 93% (452/486)
2021-07-11T01:28:05.3017851Z Receiving objects: 94% (457/486)
2021-07-11T01:28:05.3018607Z Receiving objects: 95% (462/486)
2021-07-11T01:28:05.3019369Z Receiving objects: 96% (467/486)
2021-07-11T01:28:05.3020112Z Receiving objects: 97% (472/486)
2021-07-11T01:28:05.3020868Z Receiving objects: 98% (477/486)
2021-07-11T01:28:05.3021605Z Receiving objects: 99% (482/486)
2021-07-11T01:28:05.3022364Z Receiving objects: 100% (486/486)
2021-07-11T01:28:05.3023209Z Receiving objects: 100% (486/486), 346.76 KiB | 21.67 MiB/s, done.
2021-07-11T01:28:05.3024014Z Resolving deltas: 0% (0/155)
2021-07-11T01:28:05.3024752Z Resolving deltas: 1% (2/155)
2021-07-11T01:28:05.3025481Z Resolving deltas: 2% (4/155)
2021-07-11T01:28:05.3026222Z Resolving deltas: 3% (6/155)
2021-07-11T01:28:05.3026958Z Resolving deltas: 4% (7/155)
2021-07-11T01:28:05.3027674Z Resolving deltas: 5% (8/155)
2021-07-11T01:28:05.3028407Z Resolving deltas: 6% (10/155)
2021-07-11T01:28:05.3029126Z Resolving deltas: 7% (11/155)
2021-07-11T01:28:05.3030242Z Resolving deltas: 8% (13/155)
2021-07-11T01:28:05.3031012Z Resolving deltas: 9% (14/155)
2021-07-11T01:28:05.3031735Z Resolving deltas: 10% (16/155)
2021-07-11T01:28:05.3032477Z Resolving deltas: 11% (18/155)
2021-07-11T01:28:05.3033194Z Resolving deltas: 12% (19/155)
2021-07-11T01:28:05.3033939Z Resolving deltas: 13% (21/155)
2021-07-11T01:28:05.3034679Z Resolving deltas: 14% (22/155)
2021-07-11T01:28:05.3035410Z Resolving deltas: 15% (24/155)
2021-07-11T01:28:05.3036152Z Resolving deltas: 16% (25/155)
2021-07-11T01:28:05.3036881Z Resolving deltas: 17% (27/155)
2021-07-11T01:28:05.3037640Z Resolving deltas: 18% (28/155)
2021-07-11T01:28:05.3038385Z Resolving deltas: 19% (30/155)
2021-07-11T01:28:05.3039107Z Resolving deltas: 20% (31/155)
2021-07-11T01:28:05.3039844Z Resolving deltas: 21% (33/155)
2021-07-11T01:28:05.3040563Z Resolving deltas: 22% (35/155)
2021-07-11T01:28:05.3041306Z Resolving deltas: 23% (36/155)
2021-07-11T01:28:05.3042053Z Resolving deltas: 24% (38/155)
2021-07-11T01:28:05.3042770Z Resolving deltas: 25% (39/155)
2021-07-11T01:28:05.3043509Z Resolving deltas: 26% (41/155)
2021-07-11T01:28:05.3044242Z Resolving deltas: 27% (42/155)
2021-07-11T01:28:05.3044978Z Resolving deltas: 28% (44/155)
2021-07-11T01:28:05.3045710Z Resolving deltas: 29% (45/155)
2021-07-11T01:28:05.3046427Z Resolving deltas: 30% (47/155)
2021-07-11T01:28:05.3047163Z Resolving deltas: 31% (49/155)
2021-07-11T01:28:05.3047881Z Resolving deltas: 32% (50/155)
2021-07-11T01:28:05.3048621Z Resolving deltas: 33% (52/155)
2021-07-11T01:28:05.3049349Z Resolving deltas: 34% (53/155)
2021-07-11T01:28:05.3050180Z Resolving deltas: 35% (55/155)
2021-07-11T01:28:05.3050943Z Resolving deltas: 36% (56/155)
2021-07-11T01:28:05.3051660Z Resolving deltas: 37% (58/155)
2021-07-11T01:28:05.3052405Z Resolving deltas: 38% (59/155)
2021-07-11T01:28:05.3053143Z Resolving deltas: 39% (61/155)
2021-07-11T01:28:05.3053861Z Resolving deltas: 40% (62/155)
2021-07-11T01:28:05.3054614Z Resolving deltas: 41% (64/155)
2021-07-11T01:28:05.3055333Z Resolving deltas: 42% (66/155)
2021-07-11T01:28:05.3056072Z Resolving deltas: 43% (67/155)
2021-07-11T01:28:05.3056807Z Resolving deltas: 44% (69/155)
2021-07-11T01:28:05.3057535Z Resolving deltas: 45% (70/155)
2021-07-11T01:28:05.3058274Z Resolving deltas: 46% (72/155)
2021-07-11T01:28:05.3059003Z Resolving deltas: 47% (73/155)
2021-07-11T01:28:05.3059748Z Resolving deltas: 48% (75/155)
2021-07-11T01:28:05.3060487Z Resolving deltas: 49% (76/155)
2021-07-11T01:28:05.3061208Z Resolving deltas: 50% (78/155)
2021-07-11T01:28:05.3061950Z Resolving deltas: 51% (80/155)
2021-07-11T01:28:05.3062677Z Resolving deltas: 52% (81/155)
2021-07-11T01:28:05.3063424Z Resolving deltas: 53% (83/155)
2021-07-11T01:28:05.3064159Z Resolving deltas: 54% (84/155)
2021-07-11T01:28:05.3064883Z Resolving deltas: 55% (86/155)
2021-07-11T01:28:05.3065622Z Resolving deltas: 56% (87/155)
2021-07-11T01:28:05.3066347Z Resolving deltas: 57% (89/155)
2021-07-11T01:28:05.3067100Z Resolving deltas: 58% (90/155)
2021-07-11T01:28:05.3067830Z Resolving deltas: 59% (92/155)
2021-07-11T01:28:05.3068556Z Resolving deltas: 60% (93/155)
2021-07-11T01:28:05.3069289Z Resolving deltas: 61% (95/155)
2021-07-11T01:28:05.3070017Z Resolving deltas: 62% (97/155)
2021-07-11T01:28:05.3070880Z Resolving deltas: 63% (98/155)
2021-07-11T01:28:05.3071629Z Resolving deltas: 64% (100/155)
2021-07-11T01:28:05.3072365Z Resolving deltas: 65% (101/155)
2021-07-11T01:28:05.3073104Z Resolving deltas: 66% (103/155)
2021-07-11T01:28:05.3073831Z Resolving deltas: 67% (104/155)
2021-07-11T01:28:05.3074582Z Resolving deltas: 68% (106/155)
2021-07-11T01:28:05.3075330Z Resolving deltas: 69% (107/155)
2021-07-11T01:28:05.3076061Z Resolving deltas: 70% (109/155)
2021-07-11T01:28:05.3076808Z Resolving deltas: 71% (111/155)
2021-07-11T01:28:05.3077532Z Resolving deltas: 72% (112/155)
2021-07-11T01:28:05.3078273Z Resolving deltas: 73% (114/155)
2021-07-11T01:28:05.3079016Z Resolving deltas: 74% (115/155)
2021-07-11T01:28:05.3079923Z Resolving deltas: 75% (117/155)
2021-07-11T01:28:05.3080673Z Resolving deltas: 76% (118/155)
2021-07-11T01:28:05.3081405Z Resolving deltas: 77% (120/155)
2021-07-11T01:28:05.3082158Z Resolving deltas: 78% (121/155)
2021-07-11T01:28:05.3082899Z Resolving deltas: 79% (123/155)
2021-07-11T01:28:05.3083630Z Resolving deltas: 80% (124/155)
2021-07-11T01:28:05.3084375Z Resolving deltas: 81% (126/155)
2021-07-11T01:28:05.3085103Z Resolving deltas: 82% (128/155)
2021-07-11T01:28:05.3085893Z Resolving deltas: 83% (129/155)
2021-07-11T01:28:05.3086667Z Resolving deltas: 84% (131/155)
2021-07-11T01:28:05.3087402Z Resolving deltas: 85% (132/155)
2021-07-11T01:28:05.3088155Z Resolving deltas: 86% (134/155)
2021-07-11T01:28:05.3088881Z Resolving deltas: 87% (135/155)
2021-07-11T01:28:05.3089631Z Resolving deltas: 88% (137/155)
2021-07-11T01:28:05.3090369Z Resolving deltas: 89% (138/155)
2021-07-11T01:28:05.3091092Z Resolving deltas: 90% (140/155)
2021-07-11T01:28:05.3091854Z Resolving deltas: 91% (142/155)
2021-07-11T01:28:05.3092593Z Resolving deltas: 92% (143/155)
2021-07-11T01:28:05.3093333Z Resolving deltas: 93% (145/155)
2021-07-11T01:28:05.3094069Z Resolving deltas: 94% (146/155)
2021-07-11T01:28:05.3094797Z Resolving deltas: 95% (148/155)
2021-07-11T01:28:05.3095536Z Resolving deltas: 96% (149/155)
2021-07-11T01:28:05.3096270Z Resolving deltas: 97% (151/155)
2021-07-11T01:28:05.3097014Z Resolving deltas: 98% (152/155)
2021-07-11T01:28:05.3097751Z Resolving deltas: 99% (154/155)
2021-07-11T01:28:05.3098481Z Resolving deltas: 100% (155/155)
2021-07-11T01:28:05.3099311Z Resolving deltas: 100% (155/155), done.
2021-07-11T01:28:05.3100880Z From https://github.com/submariner-io/submariner-operator
2021-07-11T01:28:05.3102509Z * [new ref] 1a48316f3cfbf3af9d2ab5c043cb2268adf4c43d -> origin/devel
2021-07-11T01:28:05.3103689Z ##[endgroup]
2021-07-11T01:28:05.3104499Z ##[group]Determining the checkout info
2021-07-11T01:28:05.3105284Z ##[endgroup]
2021-07-11T01:28:05.3106029Z ##[group]Checking out the ref
2021-07-11T01:28:05.3107275Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-11T01:28:05.3108482Z Switched to a new branch 'devel'
2021-07-11T01:28:05.3109607Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-11T01:28:05.3110632Z ##[endgroup]
2021-07-11T01:28:05.3111598Z [command]/usr/bin/git log -1 --format='%H'
2021-07-11T01:28:05.3112792Z '1a48316f3cfbf3af9d2ab5c043cb2268adf4c43d'
2021-07-11T01:28:05.3198926Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-11T01:28:05.3199762Z ##[endgroup]
2021-07-11T01:28:06.0598326Z ##[group]Reclaiming free space
2021-07-11T01:28:26.8505425Z Filesystem Size Used Avail Use% Mounted on
2021-07-11T01:28:26.8513953Z /dev/root 84G 41G 43G 49% /
2021-07-11T01:28:26.8514631Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-11T01:28:26.8515168Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-11T01:28:26.8515871Z tmpfs 696M 1.1M 695M 1% /run
2021-07-11T01:28:26.8516379Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-11T01:28:26.8516924Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-11T01:28:26.8517495Z /dev/loop1 56M 56M 0 100% /snap/core18/2074
2021-07-11T01:28:26.8518100Z /dev/loop0 56M 56M 0 100% /snap/core18/2066
2021-07-11T01:28:26.8518678Z /dev/loop2 68M 68M 0 100% /snap/lxd/20326
2021-07-11T01:28:26.8519348Z /dev/loop3 33M 33M 0 100% /snap/snapd/12159
2021-07-11T01:28:26.8519948Z /dev/loop4 33M 33M 0 100% /snap/snapd/12398
2021-07-11T01:28:26.8520508Z /dev/sda15 105M 7.9M 97M 8% /boot/efi
2021-07-11T01:28:26.8521058Z /dev/sdb1 14G 4.1G 9.0G 32% /mnt
2021-07-11T01:28:26.8523076Z ##[endgroup]
2021-07-11T01:28:26.8688612Z ##[group]Disable swap
2021-07-11T01:28:26.9135947Z ##[endgroup]
2021-07-11T01:28:26.9281268Z ##[group]Report available RAM
2021-07-11T01:28:26.9447447Z total used free shared buff/cache available
2021-07-11T01:28:26.9448865Z Mem: 6.8Gi 493Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-11T01:28:26.9449924Z Swap: 0B 0B 0B
2021-07-11T01:28:26.9452214Z ##[endgroup]
2021-07-11T01:28:26.9677405Z Downloading Makefile.dapper
2021-07-11T01:28:27.0012715Z Downloading dapper
2021-07-11T01:28:27.1351358Z .dapper.tmp version v0.5.6
2021-07-11T01:28:27.1374489Z Downloading Dockerfile.dapper
2021-07-11T01:28:27.1667658Z docker network create -d bridge kind
2021-07-11T01:28:31.4833796Z d4741b6c7ddd02adb4dc85ab210da0f44780720a1e382a6e6e0491e0a9de5101
2021-07-11T01:28:31.4880489Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-11T01:28:31.7707822Z Sending build context to Docker daemon 7.512MB
2021-07-11T01:28:31.7709476Z
2021-07-11T01:28:31.7835674Z Step 1/8 : ARG BASE_BRANCH
2021-07-11T01:28:31.7837680Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-11T01:28:32.1322843Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-11T01:28:32.1489476Z b1495d80d526: Pulling fs layer
2021-07-11T01:28:32.1493597Z 2a02672b66c6: Pulling fs layer
2021-07-11T01:28:32.1507295Z 5db9b2f5db95: Pulling fs layer
2021-07-11T01:28:32.1508830Z c66bc097ebf0: Pulling fs layer
2021-07-11T01:28:32.1509836Z b168025ef1e7: Pulling fs layer
2021-07-11T01:28:32.1511175Z 0a203e29c4d1: Pulling fs layer
2021-07-11T01:28:32.1512259Z 81562e2231ae: Pulling fs layer
2021-07-11T01:28:32.1513516Z ddfd8913804d: Pulling fs layer
2021-07-11T01:28:32.1514876Z b168025ef1e7: Waiting
2021-07-11T01:28:32.1516027Z 0a203e29c4d1: Waiting
2021-07-11T01:28:32.1517165Z 81562e2231ae: Waiting
2021-07-11T01:28:32.1518322Z ddfd8913804d: Waiting
2021-07-11T01:28:32.1519751Z c66bc097ebf0: Waiting
2021-07-11T01:28:32.7403940Z 5db9b2f5db95: Verifying Checksum
2021-07-11T01:28:32.7425128Z 5db9b2f5db95: Download complete
2021-07-11T01:28:32.8039681Z b1495d80d526: Verifying Checksum
2021-07-11T01:28:32.8062245Z b1495d80d526: Download complete
2021-07-11T01:28:32.8587511Z c66bc097ebf0: Verifying Checksum
2021-07-11T01:28:32.8588283Z c66bc097ebf0: Download complete
2021-07-11T01:28:32.9406937Z b168025ef1e7: Verifying Checksum
2021-07-11T01:28:32.9407784Z b168025ef1e7: Download complete
2021-07-11T01:28:33.0312503Z 0a203e29c4d1: Verifying Checksum
2021-07-11T01:28:33.0314828Z 0a203e29c4d1: Download complete
2021-07-11T01:28:33.0449596Z 81562e2231ae: Verifying Checksum
2021-07-11T01:28:33.0450948Z 81562e2231ae: Download complete
2021-07-11T01:28:33.1458164Z ddfd8913804d: Verifying Checksum
2021-07-11T01:28:33.1458966Z ddfd8913804d: Download complete
2021-07-11T01:28:35.2551690Z 2a02672b66c6: Verifying Checksum
2021-07-11T01:28:35.2559545Z 2a02672b66c6: Download complete
2021-07-11T01:28:36.2747515Z b1495d80d526: Pull complete
2021-07-11T01:28:48.1738618Z 2a02672b66c6: Pull complete
2021-07-11T01:28:49.7267937Z 5db9b2f5db95: Pull complete
2021-07-11T01:28:49.8042997Z c66bc097ebf0: Pull complete
2021-07-11T01:28:49.8841682Z b168025ef1e7: Pull complete
2021-07-11T01:28:50.0853346Z 0a203e29c4d1: Pull complete
2021-07-11T01:28:50.1560547Z 81562e2231ae: Pull complete
2021-07-11T01:28:50.2446357Z ddfd8913804d: Pull complete
2021-07-11T01:28:50.2495974Z Digest: sha256:a9a752c38efa7d06c4eaefe12b19eb091eda92e6a93d6c8044bdad219b688105
2021-07-11T01:28:50.2522043Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-11T01:28:50.2541836Z ---> 6070ab7cfbe7
2021-07-11T01:28:50.2542375Z Step 3/8 : ARG PROJECT
2021-07-11T01:28:50.2774530Z ---> Running in 062c0b53c8eb
2021-07-11T01:28:51.2813357Z Removing intermediate container 062c0b53c8eb
2021-07-11T01:28:51.2822277Z ---> 60f2a59e12ac
2021-07-11T01:28:51.2824286Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-11T01:28:51.3152455Z ---> Running in cf6f1b4dadeb
2021-07-11T01:28:52.3106734Z Removing intermediate container cf6f1b4dadeb
2021-07-11T01:28:52.3108814Z ---> e5520f814e7c
2021-07-11T01:28:52.3109832Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-11T01:28:53.0707573Z ---> Running in dce8ce7b42ae
2021-07-11T01:28:53.3851725Z Removing intermediate container dce8ce7b42ae
2021-07-11T01:28:53.3852988Z ---> 0d0edb2e150b
2021-07-11T01:28:53.3853541Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-11T01:28:53.4088494Z ---> Running in 6a76fc99b4a9
2021-07-11T01:28:54.4232889Z Removing intermediate container 6a76fc99b4a9
2021-07-11T01:28:54.4234225Z ---> 55aca5eed7d8
2021-07-11T01:28:54.4234949Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-11T01:28:54.4389009Z ---> Running in acb3c9406b56
2021-07-11T01:28:55.4412113Z Removing intermediate container acb3c9406b56
2021-07-11T01:28:55.4413753Z ---> 4499fddda886
2021-07-11T01:28:55.4414454Z Step 8/8 : CMD ["sh"]
2021-07-11T01:28:55.4615216Z ---> Running in 2f6627e8d53d
2021-07-11T01:28:56.4706406Z Removing intermediate container 2f6627e8d53d
2021-07-11T01:28:56.4833669Z ---> 9500284c07cd
2021-07-11T01:28:56.4834236Z Successfully built 9500284c07cd
2021-07-11T01:28:56.4870040Z Successfully tagged submariner-operator:devel
2021-07-11T01:28:58.0217117Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-11T01:28:58.0223532Z [submariner-operator]$ mkdir -p bin dist output
2021-07-11T01:28:58.0272446Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-11T01:28:58.0273174Z GNU Make 4.3
2021-07-11T01:28:58.0273876Z Built for x86_64-redhat-linux-gnu
2021-07-11T01:28:58.0274740Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-11T01:28:58.0275649Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-11T01:28:58.0276562Z This is free software: you are free to change and redistribute it.
2021-07-11T01:28:58.0277377Z There is NO WARRANTY, to the extent permitted by law.
2021-07-11T01:28:58.0278027Z Reading makefiles...
2021-07-11T01:28:58.1683214Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-11T01:28:58.1685243Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-11T01:28:58.4212066Z Updating makefiles....
2021-07-11T01:28:58.4224897Z Updating goal targets....
2021-07-11T01:28:58.4229958Z File 'upgrade-e2e' does not exist.
2021-07-11T01:28:58.4238736Z File 'deploy-latest' does not exist.
2021-07-11T01:28:58.4239583Z Must remake target 'deploy-latest'.
2021-07-11T01:28:58.4244920Z curl -L get.submariner.io | VERSION=latest bash
2021-07-11T01:28:58.4429682Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-11T01:28:58.4430686Z Dload Upload Total Spent Left Speed
2021-07-11T01:28:58.4431104Z
2021-07-11T01:28:58.4985332Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-11T01:28:58.4986747Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-11T01:28:58.5622520Z
2021-07-11T01:28:58.5624437Z 100 4155 0 4155 0 0 33240 0 --:--:-- --:--:-- --:--:-- 33240
2021-07-11T01:28:58.6591850Z Installing subctl version latest
2021-07-11T01:28:58.6592479Z OS detected: linux
2021-07-11T01:28:58.6597489Z Architecture detected: amd64
2021-07-11T01:28:58.6599417Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-11T01:28:58.6600365Z
2021-07-11T01:28:58.6600781Z Downloading...
2021-07-11T01:28:59.8685965Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-11T01:28:59.9049020Z This provides subctl version: v0.9.1
2021-07-11T01:28:59.9065628Z
2021-07-11T01:28:59.9066625Z please update your path (and consider adding it to ~/.profile):
2021-07-11T01:28:59.9067383Z export PATH=$PATH:/root/.local/bin
2021-07-11T01:28:59.9067843Z
2021-07-11T01:28:59.9156247Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-11T01:28:59.9190485Z GNU Make 4.3
2021-07-11T01:28:59.9191425Z Built for x86_64-redhat-linux-gnu
2021-07-11T01:28:59.9192317Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-11T01:28:59.9193215Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-11T01:28:59.9194157Z This is free software: you are free to change and redistribute it.
2021-07-11T01:28:59.9194950Z There is NO WARRANTY, to the extent permitted by law.
2021-07-11T01:28:59.9195599Z Reading makefiles...
2021-07-11T01:28:59.9196659Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-11T01:29:00.0542054Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-11T01:29:00.0544060Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-11T01:29:00.3084941Z Updating makefiles....
2021-07-11T01:29:00.3098092Z Updating goal targets....
2021-07-11T01:29:00.3099404Z File 'clusters' does not exist.
2021-07-11T01:29:00.3100182Z Must remake target 'clusters'.
2021-07-11T01:29:00.3101649Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:29:00.3129393Z Downloading shflags 1.0.3
2021-07-11T01:29:00.3193868Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-11T01:29:00.3194715Z Dload Upload Total Spent Left Speed
2021-07-11T01:29:00.3195128Z
2021-07-11T01:29:00.3462911Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-11T01:29:00.3463719Z 100 31091 100 31091 0 0 1124k 0 --:--:-- --:--:-- --:--:-- 1124k
2021-07-11T01:29:00.4137166Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-11T01:29:00.4163877Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-11T01:29:00.4174891Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:29:00.4187573Z [submariner-operator]$ script_name=utils
2021-07-11T01:29:00.4201157Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:29:00.4222069Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-11T01:29:00.4235313Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:29:00.4248001Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:29:00.4260193Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:29:00.4283104Z [submariner-operator]$ broker=cluster1
2021-07-11T01:29:00.4293766Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-11T01:29:00.4307125Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-11T01:29:00.4318053Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-11T01:29:00.4330879Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-11T01:29:00.4343177Z [submariner-operator]$ declare -gA cluster_subm
2021-07-11T01:29:00.4356025Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-11T01:29:00.4368417Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-11T01:29:00.4380801Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-11T01:29:00.4393155Z [submariner-operator]$ declare -gA cluster_cni
2021-07-11T01:29:00.4405067Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-11T01:29:00.4417879Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-11T01:29:00.4432656Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:29:00.4446286Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:29:00.4459609Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:29:00.4472900Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:29:00.4495423Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-11T01:29:00.4508722Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-11T01:29:00.4542418Z [submariner-operator]$ cat <<EOM
2021-07-11T01:29:00.4543777Z Cluster settings::
2021-07-11T01:29:00.4544453Z broker - ${broker@Q}
2021-07-11T01:29:00.4545080Z clusters - ${clusters[*]@Q}
2021-07-11T01:29:00.4545835Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-11T01:29:00.4546718Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-11T01:29:00.4547693Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-11T01:29:00.4548380Z EOM
2021-07-11T01:29:00.4569909Z [submariner-operator]$ typeset -p cluster_cni
2021-07-11T01:29:00.4585478Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:29:00.4616753Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-11T01:29:00.4633430Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:29:00.4659887Z [submariner-operator]$ typeset -p cluster_subm
2021-07-11T01:29:00.4674348Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:29:00.4722101Z Cluster settings::
2021-07-11T01:29:00.4723974Z broker - 'cluster1'
2021-07-11T01:29:00.4725888Z clusters - 'cluster1' 'cluster2'
2021-07-11T01:29:00.4726783Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-11T01:29:00.4728217Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-11T01:29:00.4729601Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-11T01:29:00.4753956Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-11T01:29:00.4775844Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-11T01:29:00.4796813Z [submariner-operator]$ run_local_registry
2021-07-11T01:29:00.4807195Z [submariner-operator]$ run_local_registry
2021-07-11T01:29:00.4816308Z [submariner-operator]$ registry_running
2021-07-11T01:29:00.4825265Z [submariner-operator]$ registry_running
2021-07-11T01:29:00.4837912Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-11T01:29:00.4846251Z [submariner-operator]$ grep kind-registry
2021-07-11T01:29:00.7846740Z [submariner-operator]$ return 0
2021-07-11T01:29:00.7847865Z Deploying local registry kind-registry to serve images centrally.
2021-07-11T01:29:00.7860182Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-11T01:29:00.7871286Z [submariner-operator]$ selinuxenabled
2021-07-11T01:29:00.7896741Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-11T01:29:01.0923660Z Unable to find image 'registry:2' locally
2021-07-11T01:29:01.2660432Z 2: Pulling from library/registry
2021-07-11T01:29:01.3155717Z ddad3d7c1e96: Already exists
2021-07-11T01:29:01.3253336Z 6eda6749503f: Pulling fs layer
2021-07-11T01:29:01.3253917Z 363ab70c2143: Pulling fs layer
2021-07-11T01:29:01.3254425Z 5b94580856e6: Pulling fs layer
2021-07-11T01:29:01.3254925Z 12008541203a: Pulling fs layer
2021-07-11T01:29:01.3260260Z 12008541203a: Waiting
2021-07-11T01:29:01.4003258Z 6eda6749503f: Download complete
2021-07-11T01:29:01.4074112Z 5b94580856e6: Verifying Checksum
2021-07-11T01:29:01.4074989Z 5b94580856e6: Download complete
2021-07-11T01:29:01.4613540Z 12008541203a: Verifying Checksum
2021-07-11T01:29:01.4614218Z 12008541203a: Download complete
2021-07-11T01:29:01.5557134Z 363ab70c2143: Verifying Checksum
2021-07-11T01:29:01.5557816Z 363ab70c2143: Download complete
2021-07-11T01:29:01.8231767Z 6eda6749503f: Pull complete
2021-07-11T01:29:02.1260642Z 363ab70c2143: Pull complete
2021-07-11T01:29:02.2197970Z 5b94580856e6: Pull complete
2021-07-11T01:29:02.2966610Z 12008541203a: Pull complete
2021-07-11T01:29:02.3037505Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-11T01:29:02.3051579Z Status: Downloaded newer image for registry:2
2021-07-11T01:29:02.3280316Z 36126a490622fdbf0a100ee6532dc68a88d2738fcc81bffa8bef95019e149ad3
2021-07-11T01:29:02.9468748Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-11T01:29:03.3919402Z [submariner-operator]$ declare_cidrs
2021-07-11T01:29:03.3934036Z [submariner-operator]$ declare_cidrs
2021-07-11T01:29:03.3949133Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-11T01:29:03.3950366Z [submariner-operator]$ i=1
2021-07-11T01:29:03.3958131Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:29:03.3973955Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:29:03.3983669Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-11T01:29:03.3990044Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-11T01:29:03.4003752Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-11T01:29:03.4016728Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:29:03.4031116Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:29:03.4045157Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-11T01:29:03.4058891Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-11T01:29:03.4074309Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-11T01:29:03.4095625Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4096790Z [submariner-operator]$ [cluster2] wait 287
2021-07-11T01:29:03.4108017Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4120458Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4134771Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4149662Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:29:03.4206024Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:29:03.4207196Z [submariner-operator]$ [cluster1] pids[cluster1]=296
2021-07-11T01:29:03.4222384Z [submariner-operator]$ [cluster2] pids[cluster2]=298
2021-07-11T01:29:03.4223465Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:29:03.4235523Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4238483Z [submariner-operator]$ [cluster2] wait 298
2021-07-11T01:29:03.4255440Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:29:03.4259086Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:29:03.4275190Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-11T01:29:03.4288925Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:31:05.6752420Z [submariner-operator]$ [cluster2] with_retries
2021-07-11T01:31:05.6754203Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:31:05.6755715Z [submariner-operator]$ [cluster2] wait 320
2021-07-11T01:31:05.6756920Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-11T01:31:05.6758164Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-11T01:31:05.6760259Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:05.6762751Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:05.6764477Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-11T01:31:05.6765684Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-11T01:31:05.6766577Z [cluster2] No kind clusters found.
2021-07-11T01:31:05.6767308Z [cluster2] Creating KIND cluster...
2021-07-11T01:31:05.6768419Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-11T01:31:05.6769700Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-11T01:31:05.6770944Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-11T01:31:05.6772094Z [submariner-operator]$ [cluster2] nodes=
2021-07-11T01:31:05.6773127Z [cluster2] - role: control-plane
2021-07-11T01:31:05.6774160Z [submariner-operator]$ [cluster2] nodes=
2021-07-11T01:31:05.6775164Z [cluster2] - role: control-plane
2021-07-11T01:31:05.6776032Z [cluster2] - role: worker
2021-07-11T01:31:05.6777005Z [submariner-operator]$ [cluster2] nodes=
2021-07-11T01:31:05.6778001Z [cluster2] - role: control-plane
2021-07-11T01:31:05.6778842Z [cluster2] - role: worker
2021-07-11T01:31:05.6779662Z [cluster2] - role: worker
2021-07-11T01:31:05.6780419Z [cluster2] 
2021-07-11T01:31:05.6781149Z [cluster2] 
2021-07-11T01:31:05.6782133Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-11T01:31:05.6783806Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-11T01:31:05.6787249Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-11T01:31:05.6788390Z [submariner-operator]$ [cluster2] kind version
2021-07-11T01:31:05.6789166Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-11T01:31:05.6796138Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-11T01:31:05.6797808Z [cluster2] ---
2021-07-11T01:31:05.6798297Z [cluster2] kind: Cluster
2021-07-11T01:31:05.6799135Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-11T01:31:05.6799931Z [cluster2] networking:
2021-07-11T01:31:05.6800575Z [cluster2] disableDefaultCNI: true
2021-07-11T01:31:05.6801204Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-11T01:31:05.6801801Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-11T01:31:05.6802529Z [cluster2] containerdConfigPatches:
2021-07-11T01:31:05.6803321Z [cluster2] - |-
2021-07-11T01:31:05.6804203Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-11T01:31:05.6805520Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-11T01:31:05.6806365Z [cluster2] kubeadmConfigPatches:
2021-07-11T01:31:05.6807083Z [cluster2] - |
2021-07-11T01:31:05.6807701Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-11T01:31:05.6808459Z [cluster2] kind: ClusterConfiguration
2021-07-11T01:31:05.6809100Z [cluster2] metadata:
2021-07-11T01:31:05.6809598Z [cluster2] name: config
2021-07-11T01:31:05.6810131Z [cluster2] networking:
2021-07-11T01:31:05.6810670Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-11T01:31:05.6811269Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-11T01:31:05.6811918Z [cluster2] dnsDomain: cluster2.local
2021-07-11T01:31:05.6812499Z [cluster2] nodes:
2021-07-11T01:31:05.6813181Z [cluster2] - role: control-plane
2021-07-11T01:31:05.6813894Z [cluster2] - role: worker
2021-07-11T01:31:05.6814678Z [cluster2] - role: worker
2021-07-11T01:31:05.6816295Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-11T01:31:05.6817579Z [cluster2] Creating cluster "cluster2" ...
2021-07-11T01:31:05.6819775Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-11T01:31:05.6820805Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-11T01:31:05.6821696Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-11T01:31:05.6822483Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-11T01:31:05.6823426Z [cluster2] • Writing configuration 📜 ...
2021-07-11T01:31:05.6824253Z [cluster2] ✓ Writing configuration 📜
2021-07-11T01:31:05.6825112Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-11T01:31:05.6825947Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-11T01:31:05.6826805Z [cluster2] • Installing StorageClass 💾 ...
2021-07-11T01:31:05.6827659Z [cluster2] ✓ Installing StorageClass 💾
2021-07-11T01:31:05.6828472Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-11T01:31:05.6829216Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-11T01:31:05.6835063Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-11T01:31:05.6835894Z [cluster2] You can now use your cluster with:
2021-07-11T01:31:05.6836435Z [cluster2]
2021-07-11T01:31:05.6837421Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-11T01:31:05.6838049Z [cluster2]
2021-07-11T01:31:05.6838723Z [cluster2] Have a nice day! 👋
2021-07-11T01:31:05.6839608Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-11T01:31:05.6840666Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-11T01:31:05.6842308Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-11T01:31:05.6843992Z [submariner-operator]$ [cluster2] head -n 1
2021-07-11T01:31:13.0385320Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\[submariner-operator]$ [cluster1] with_retries
2021-07-11T01:31:13.0386908Z [submariner-operator]$ [cluster1] iteration=1
2021-07-11T01:31:13.0387927Z [submariner-operator]$ [cluster1] wait 316
2021-07-11T01:31:13.0388941Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-11T01:31:13.0390018Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-11T01:31:13.0392461Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:13.0394718Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:13.0396275Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-11T01:31:13.0397443Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-11T01:31:13.0398207Z [cluster1] No kind clusters found.
2021-07-11T01:31:13.0398813Z [cluster1] Creating KIND cluster...
2021-07-11T01:31:13.0399792Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-11T01:31:13.0400892Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-11T01:31:13.0401968Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-11T01:31:13.0402960Z [submariner-operator]$ [cluster1] nodes=
2021-07-11T01:31:13.0403820Z [cluster1] - role: control-plane
2021-07-11T01:31:13.0404699Z [submariner-operator]$ [cluster1] nodes=
2021-07-11T01:31:13.0405684Z [cluster1] - role: control-plane
2021-07-11T01:31:13.0406415Z [cluster1] - role: worker
2021-07-11T01:31:13.0407225Z [submariner-operator]$ [cluster1] nodes=
2021-07-11T01:31:13.0408070Z [cluster1] - role: control-plane
2021-07-11T01:31:13.0408762Z [cluster1] - role: worker
2021-07-11T01:31:13.0409430Z [cluster1] - role: worker
2021-07-11T01:31:13.0410193Z [cluster1] 
2021-07-11T01:31:13.0410767Z [cluster1] 
2021-07-11T01:31:13.0411601Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-11T01:31:13.0413004Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-11T01:31:13.0414466Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-11T01:31:13.0415559Z [submariner-operator]$ [cluster1] kind version
2021-07-11T01:31:13.0416295Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-11T01:31:13.0417484Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-11T01:31:13.0418506Z [cluster1] ---
2021-07-11T01:31:13.0418971Z [cluster1] kind: Cluster
2021-07-11T01:31:13.0419770Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-11T01:31:13.0420403Z [cluster1] networking:
2021-07-11T01:31:13.0421039Z [cluster1] disableDefaultCNI: true
2021-07-11T01:31:13.0421688Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-11T01:31:13.0422265Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-11T01:31:13.0423005Z [cluster1] containerdConfigPatches:
2021-07-11T01:31:13.0423765Z [cluster1] - |-
2021-07-11T01:31:13.0424645Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-11T01:31:13.0425924Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-11T01:31:13.0426760Z [cluster1] kubeadmConfigPatches:
2021-07-11T01:31:13.0427479Z [cluster1] - |
2021-07-11T01:31:13.0428093Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-11T01:31:13.0428846Z [cluster1] kind: ClusterConfiguration
2021-07-11T01:31:13.0429479Z [cluster1] metadata:
2021-07-11T01:31:13.0429997Z [cluster1] name: config
2021-07-11T01:31:13.0430892Z [cluster1] networking:
2021-07-11T01:31:13.0431455Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-11T01:31:13.0432040Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-11T01:31:13.0432713Z [cluster1] dnsDomain: cluster1.local
2021-07-11T01:31:13.0433277Z [cluster1] nodes:
2021-07-11T01:31:13.0434012Z [cluster1] - role: control-plane
2021-07-11T01:31:13.0434710Z [cluster1] - role: worker
2021-07-11T01:31:13.0435362Z [cluster1] - role: worker
2021-07-11T01:31:13.0436871Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-11T01:31:13.0438264Z [cluster1] Creating cluster "cluster1" ...
2021-07-11T01:31:13.0439315Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-11T01:31:13.0440313Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-11T01:31:13.0441269Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-11T01:31:13.0442323Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-11T01:31:13.0443156Z [cluster1] • Writing configuration 📜 ...
2021-07-11T01:31:13.0443952Z [cluster1] ✓ Writing configuration 📜
2021-07-11T01:31:13.0444850Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-11T01:31:13.0445676Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-11T01:31:13.0446530Z [cluster1] • Installing StorageClass 💾 ...
2021-07-11T01:31:13.0447358Z [cluster1] ✓ Installing StorageClass 💾
2021-07-11T01:31:13.0448172Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-11T01:31:13.0448925Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-11T01:31:13.0449758Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-11T01:31:13.0450503Z [cluster1] You can now use your cluster with:
2021-07-11T01:31:13.0451027Z [cluster1]
2021-07-11T01:31:13.0451847Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-11T01:31:13.0452479Z [cluster1]
2021-07-11T01:31:13.0453134Z [cluster1] Thanks for using kind! 😊
2021-07-11T01:31:13.0454030Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-11T01:31:13.0455080Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-11T01:31:13.0456716Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-11T01:31:13.0458378Z [submariner-operator]$ [cluster1] head -n 1
2021-07-11T01:31:40.6655068Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: h/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6658320Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6661816Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6664276Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6666876Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6669267Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:31:40.6671168Z [submariner-operator]$ [cluster2] wait 1515
2021-07-11T01:31:40.6672285Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-11T01:31:40.6673482Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-11T01:31:40.6674572Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-11T01:31:40.6675551Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-11T01:31:40.6676611Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-11T01:31:40.6677680Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-11T01:31:40.6678725Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-11T01:31:40.6679491Z [cluster2] Applying weave network...
2021-07-11T01:31:40.6680982Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-11T01:31:40.6683204Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-11T01:31:40.6685353Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-11T01:31:40.6686877Z [cluster2] serviceaccount/weave-net created
2021-07-11T01:31:40.6688183Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:40.6689952Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:40.6691603Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:40.6693061Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:40.6694321Z [cluster2] daemonset.apps/weave-net created
2021-07-11T01:31:40.6695242Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-11T01:31:40.6696598Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:40.6698281Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:40.6700103Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:40.6701479Z [cluster2] pod/weave-net-fdx6x condition met
2021-07-11T01:31:40.6702392Z [cluster2] pod/weave-net-jdvh8 condition met
2021-07-11T01:31:40.6703316Z [cluster2] pod/weave-net-n62lb condition met
2021-07-11T01:31:40.6704400Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-11T01:31:40.6705687Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:40.6707209Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:40.6708857Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:40.6727948Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-11T01:31:40.6729236Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-11T01:31:40.6730234Z [cluster2] deployment "coredns" successfully rolled out
2021-07-11T01:31:40.6731495Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:31:40.6744799Z [submariner-operator]$ [cluster2] wait 296
2021-07-11T01:31:42.1240859Z ttps:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1244810Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1248962Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1253126Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1257554Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1261634Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:31:42.1264773Z [submariner-operator]$ [cluster1] wait 1646
2021-07-11T01:31:42.1266623Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-11T01:31:42.1268671Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-11T01:31:42.1271410Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-11T01:31:42.1273172Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-11T01:31:42.1274972Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-11T01:31:42.1276777Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-11T01:31:42.1278551Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-11T01:31:42.1279833Z [cluster1] Applying weave network...
2021-07-11T01:31:42.1282391Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-11T01:31:42.1356032Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-11T01:31:42.1358296Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-11T01:31:42.1359868Z [cluster1] serviceaccount/weave-net created
2021-07-11T01:31:42.1361252Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:42.1382502Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:42.1385053Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:42.1386557Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-11T01:31:42.1387828Z [cluster1] daemonset.apps/weave-net created
2021-07-11T01:31:42.1454034Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-11T01:31:42.1456849Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:42.1459253Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:42.1461129Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-11T01:31:42.1462657Z [cluster1] pod/weave-net-kdksm condition met
2021-07-11T01:31:42.1463578Z [cluster1] pod/weave-net-p7ltw condition met
2021-07-11T01:31:42.1464509Z [cluster1] pod/weave-net-xm5br condition met
2021-07-11T01:31:42.1465455Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-11T01:31:42.1466739Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:42.1468259Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:42.1470044Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-11T01:31:42.1476068Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-11T01:31:42.1477240Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-11T01:31:42.1478235Z [cluster1] deployment "coredns" successfully rolled out
2021-07-11T01:31:42.1479654Z [submariner-operator]$ [cluster1] return 0
2021-07-11T01:31:42.1480945Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-11T01:31:42.1482186Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-11T01:31:42.1483306Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-11T01:31:42.1484223Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-11T01:31:42.1484778Z
2021-07-11T01:31:42.1485793Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-11T01:31:42.1486555Z
2021-07-11T01:31:42.1487353Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-11T01:31:42.1487862Z
2021-07-11T01:31:42.1488595Z To clean everthing up, just run: make clean-clusters
2021-07-11T01:31:42.1490126Z EOM
2021-07-11T01:31:42.1490849Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-11T01:31:42.1491416Z
2021-07-11T01:31:42.1492413Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-11T01:31:42.1493079Z
2021-07-11T01:31:42.1493910Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-11T01:31:42.1494401Z
2021-07-11T01:31:42.1495132Z To clean everthing up, just run: make clean-clusters
2021-07-11T01:31:42.1496044Z Successfully remade target file 'clusters'.
2021-07-11T01:31:42.1496839Z File 'bin/subctl' does not exist.
2021-07-11T01:31:42.1497786Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-11T01:31:42.1498863Z File 'generate-embeddedyamls' does not exist.
2021-07-11T01:31:42.1499747Z File 'generate' does not exist.
2021-07-11T01:31:42.1500921Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-11T01:31:42.1502096Z File 'vendor/modules.txt' does not exist.
2021-07-11T01:31:42.1502937Z Must remake target 'vendor/modules.txt'.
2021-07-11T01:31:42.1503505Z go mod download
2021-07-11T01:32:40.4415194Z go mod vendor
2021-07-11T01:32:42.8737482Z go mod tidy
2021-07-11T01:32:43.5863005Z Successfully remade target file 'vendor/modules.txt'.
2021-07-11T01:32:43.5864571Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-11T01:32:43.6405864Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-11T01:32:43.6436673Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-11T01:33:06.4441576Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-11T01:33:06.4443155Z Must remake target 'generate'.
2021-07-11T01:33:06.4458523Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-11T01:33:20.4792722Z Successfully remade target file 'generate'.
2021-07-11T01:33:20.4793958Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-11T01:33:20.4807163Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-11T01:33:20.4808622Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-11T01:33:20.4810541Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-11T01:33:22.8343071Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-11T01:33:22.8352224Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-11T01:33:22.8353579Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-11T01:33:22.8355753Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-11T01:33:24.3254416Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-11T01:33:24.3391674Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-11T01:33:24.3392739Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-11T01:33:25.1131134Z Generating yamls.go
2021-07-11T01:33:25.1135433Z deploy/crds/submariner.io_brokers.yaml
2021-07-11T01:33:25.1139313Z deploy/crds/submariner.io_submariners.yaml
2021-07-11T01:33:25.1175286Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-11T01:33:25.1180510Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-11T01:33:25.1181494Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-11T01:33:25.1182341Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-11T01:33:25.1187583Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-11T01:33:25.1194559Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-11T01:33:25.1205088Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-11T01:33:25.1211739Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-11T01:33:25.1218255Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-11T01:33:25.1225765Z config/broker/broker-admin/service_account.yaml
2021-07-11T01:33:25.1230443Z config/broker/broker-admin/role.yaml
2021-07-11T01:33:25.1234106Z config/broker/broker-admin/role_binding.yaml
2021-07-11T01:33:25.1238601Z config/broker/broker-client/service_account.yaml
2021-07-11T01:33:25.1240949Z config/broker/broker-client/role.yaml
2021-07-11T01:33:25.1245988Z config/broker/broker-client/role_binding.yaml
2021-07-11T01:33:25.1249520Z config/rbac/submariner-operator/service_account.yaml
2021-07-11T01:33:25.1253910Z config/rbac/submariner-operator/role.yaml
2021-07-11T01:33:25.1257712Z config/rbac/submariner-operator/role_binding.yaml
2021-07-11T01:33:25.1260528Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-11T01:33:25.1264602Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-11T01:33:25.1268438Z config/rbac/submariner-gateway/service_account.yaml
2021-07-11T01:33:25.1272605Z config/rbac/submariner-gateway/role.yaml
2021-07-11T01:33:25.1277333Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-11T01:33:25.1281516Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-11T01:33:25.1285419Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-11T01:33:25.1288577Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-11T01:33:25.1292669Z config/rbac/submariner-route-agent/role.yaml
2021-07-11T01:33:25.1296586Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-11T01:33:25.1299739Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-11T01:33:25.1303136Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-11T01:33:25.1305526Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-11T01:33:25.1308256Z config/rbac/submariner-globalnet/role.yaml
2021-07-11T01:33:25.1314040Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-11T01:33:25.1316632Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-11T01:33:25.1324190Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-11T01:33:25.1328374Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-11T01:33:25.1331416Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-11T01:33:25.1334152Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-11T01:33:25.1337936Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-11T01:33:25.1339215Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-11T01:33:25.1340316Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-11T01:33:25.1341477Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-11T01:33:25.1343052Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-11T01:33:25.1347656Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-11T01:33:25.1351357Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-11T01:33:25.6484935Z [submariner-operator]$ mkdir -p bin
2021-07-11T01:33:25.6486163Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-11T01:33:25.6497287Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-11T01:33:25.6500070Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-11T01:33:25.6501244Z Must remake target 'generate-embeddedyamls'.
2021-07-11T01:33:25.6502672Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-11T01:33:25.6506070Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-11T01:33:25.6508804Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-11T01:33:25.6509793Z mkdir -p bin
2021-07-11T01:33:25.6513979Z target=bin/subctl-latest-linux-amd64; \
2021-07-11T01:33:25.6514665Z target=${target%.exe}; \
2021-07-11T01:33:25.6515374Z components=($(echo ${target//-/ })); \
2021-07-11T01:33:25.6516054Z GOOS=${components[-2]}; \
2021-07-11T01:33:25.6516716Z GOARCH=${components[-1]}; \
2021-07-11T01:33:25.6517211Z export GOARCH GOOS; \
2021-07-11T01:33:25.6517781Z /opt/shipyard/scripts/compile.sh \
2021-07-11T01:33:25.6518980Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-11T01:33:25.6521017Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-11T01:33:25.6522839Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-11T01:33:25.6525499Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-11T01:35:30.2859085Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-11T01:35:30.2860819Z Must remake target 'bin/subctl'.
2021-07-11T01:35:30.2862009Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-11T01:35:30.2907338Z Successfully remade target file 'bin/subctl'.
2021-07-11T01:35:30.2908726Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-11T01:35:30.2910014Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-11T01:35:30.2911529Z Must remake target 'deploy'.
2021-07-11T01:35:30.2917320Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:35:30.3931339Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-11T01:35:30.3964792Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-11T01:35:30.3980095Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:35:30.3994845Z [submariner-operator]$ script_name=utils
2021-07-11T01:35:30.4008563Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:35:30.4029294Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-11T01:35:30.4051230Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:35:30.4062814Z [submariner-operator]$ script_name=deploy_funcs
2021-07-11T01:35:30.4076745Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:35:30.4099651Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-11T01:35:30.4118994Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:35:30.4134707Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:35:30.4148425Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:35:30.4172584Z [submariner-operator]$ broker=cluster1
2021-07-11T01:35:30.4186887Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-11T01:35:30.4202733Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-11T01:35:30.4216989Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-11T01:35:30.4231958Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-11T01:35:30.4247524Z [submariner-operator]$ declare -gA cluster_subm
2021-07-11T01:35:30.4261663Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-11T01:35:30.4275338Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-11T01:35:30.4290055Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-11T01:35:30.4300594Z [submariner-operator]$ declare -gA cluster_cni
2021-07-11T01:35:30.4315398Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-11T01:35:30.4329316Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-11T01:35:30.4344722Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:35:30.4363309Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:35:30.4377215Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:35:30.4391256Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:35:30.4416950Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-11T01:35:30.4431876Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-11T01:35:30.4467456Z [submariner-operator]$ declare_cidrs
2021-07-11T01:35:30.4481826Z [submariner-operator]$ declare_cidrs
2021-07-11T01:35:30.4495268Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-11T01:35:30.4509034Z [submariner-operator]$ i=1
2021-07-11T01:35:30.4524727Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:35:30.4539335Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:35:30.4556626Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-11T01:35:30.4572213Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-11T01:35:30.4588208Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-11T01:35:30.4605069Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:35:30.4617808Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:35:30.4636344Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-11T01:35:30.4651706Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-11T01:35:30.4668092Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-11T01:35:30.4683766Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-11T01:35:30.4699032Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-11T01:35:30.4713797Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-11T01:35:30.4727741Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-11T01:35:30.4740884Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-11T01:35:30.4763422Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-11T01:35:30.4813076Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-11T01:35:30.7029536Z Installing subctl version latest
2021-07-11T01:35:30.7099929Z OS detected: linux
2021-07-11T01:35:30.7100917Z Architecture detected: amd64
2021-07-11T01:35:30.7102934Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-11T01:35:30.7104236Z
2021-07-11T01:35:30.7104797Z Downloading...
2021-07-11T01:35:32.0028040Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-11T01:35:32.0431720Z This provides subctl version: v0.9.1
2021-07-11T01:35:32.0455548Z
2021-07-11T01:35:32.0457677Z please update your path (and consider adding it to ~/.profile):
2021-07-11T01:35:32.0458349Z export PATH=$PATH:/go/bin
2021-07-11T01:35:32.0458910Z
2021-07-11T01:35:32.0575936Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-11T01:35:32.0589219Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-11T01:35:32.0598738Z Will deploy submariner using operator
2021-07-11T01:35:32.0612958Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-11T01:35:32.0632998Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:35:32.0649939Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-11T01:35:32.0663323Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-11T01:35:32.0685723Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-11T01:35:32.0699448Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-11T01:35:32.0713971Z 
2021-07-11T01:35:32.0734027Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-11T01:35:32.2387054Z subctl version: v0.9.1
2021-07-11T01:35:32.2425975Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-11T01:35:32.2442487Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-11T01:35:32.2458770Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-11T01:35:32.2481808Z [submariner-operator]$ [cluster2] grep -q function
2021-07-11T01:35:32.2519020Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:35:32.2533021Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-11T01:35:32.2545134Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-11T01:35:32.2558903Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-11T01:35:32.2594952Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-11T01:35:32.2610388Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-11T01:35:32.2626258Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:35:32.2648933Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:35:32.2671733Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:35:32.2677907Z [submariner-operator]$ [cluster1] pids[cluster1]=6312
2021-07-11T01:35:32.2685942Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-11T01:35:32.2705276Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:35:32.2712839Z [submariner-operator]$ [cluster2] pids[cluster2]=6316
2021-07-11T01:35:32.2733048Z [submariner-operator]$ [cluster2] wait 6316
2021-07-11T01:35:32.2753360Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:35:32.2768323Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-11T01:35:32.2791400Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:35:32.6885133Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-11T01:35:32.6886312Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-11T01:35:32.6887396Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-11T01:35:32.6888828Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6890768Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6892829Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6894220Z [cluster1] node/cluster1-worker labeled
2021-07-11T01:35:32.6931447Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-11T01:35:32.6932732Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-11T01:35:32.6933821Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-11T01:35:32.6935284Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6936974Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6938825Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:35:32.6940196Z [cluster2] node/cluster2-worker labeled
2021-07-11T01:35:32.6962781Z [submariner-operator]$ [cluster2] wait 6312
2021-07-11T01:35:32.6979132Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-11T01:35:32.7000782Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-11T01:35:32.7035781Z [submariner-operator]$ [cluster1] setup_broker
2021-07-11T01:35:32.7058671Z [submariner-operator]$ [cluster1] setup_broker
2021-07-11T01:35:32.7070985Z Installing broker...
2021-07-11T01:35:32.7084623Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-11T01:35:32.7115524Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-11T01:35:32.7134353Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:35:32.7648273Z • Setting up broker RBAC ...
2021-07-11T01:35:32.8497891Z ✓ Setting up broker RBAC
2021-07-11T01:35:32.8498820Z • Deploying the Submariner operator ...
2021-07-11T01:35:43.2773874Z ✓ Deploying the Submariner operator
2021-07-11T01:35:43.2775352Z ✓ Created operator CRDs
2021-07-11T01:35:43.2776672Z ✓ Created operator namespace: submariner-operator
2021-07-11T01:35:43.2778025Z ✓ Created operator service account and role
2021-07-11T01:35:43.2779277Z ✓ Created lighthouse service account and role
2021-07-11T01:35:43.2780547Z ✓ Created Lighthouse service accounts and roles
2021-07-11T01:35:43.2781760Z ✓ Deployed the operator successfully
2021-07-11T01:35:43.2782848Z • Deploying the broker ...
2021-07-11T01:35:43.3470995Z ✓ Deploying the broker
2021-07-11T01:35:43.3475691Z ✓ The broker has been deployed
2021-07-11T01:35:43.3480740Z • Creating broker-info.subm file ...
2021-07-11T01:35:43.3583640Z ✓ Creating broker-info.subm file
2021-07-11T01:35:43.3590801Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-11T01:35:43.3641384Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-11T01:35:43.3660301Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-11T01:35:43.3678871Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-11T01:35:43.3690261Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-11T01:35:43.3701624Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-11T01:35:43.3734633Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-11T01:35:43.3747382Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-11T01:35:43.3758086Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:35:43.3774292Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:35:43.3886046Z [submariner-operator]$ [cluster1] pids[cluster1]=6381
2021-07-11T01:35:43.3887200Z [submariner-operator]$ [cluster2] pids[cluster2]=6383
2021-07-11T01:35:43.3888369Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:35:43.3889371Z [submariner-operator]$ [cluster2] wait 6383
2021-07-11T01:35:43.3890377Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:35:43.3891420Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-11T01:35:43.3900787Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-11T01:35:43.3917842Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:35:43.3927394Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:35:50.1091494Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-11T01:35:50.1092666Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-11T01:35:50.1093780Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-11T01:35:50.1096901Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-11T01:35:50.1100015Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-11T01:35:50.1101451Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-11T01:35:50.1102309Z [cluster1] - cluster1-worker
2021-07-11T01:35:50.1103161Z [cluster1] • Discovering network details ...
2021-07-11T01:35:50.1103843Z [cluster1] Discovered network details:
2021-07-11T01:35:50.1104699Z [cluster1] Network plugin: weave-net
2021-07-11T01:35:50.1105412Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-11T01:35:50.1106008Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-11T01:35:50.1106804Z [cluster1] ✓ Discovering network details
2021-07-11T01:35:50.1107690Z [cluster1] • Discovering multi cluster details ...
2021-07-11T01:35:50.1108620Z [cluster1] • Validating Globalnet configurations ...
2021-07-11T01:35:50.1109586Z [cluster1] ✓ Validating Globalnet configurations
2021-07-11T01:35:50.1110898Z [cluster1] ✓ Discovering multi cluster details
2021-07-11T01:35:50.1111834Z [cluster1] • Deploying the Submariner operator ...
2021-07-11T01:35:50.1112746Z [cluster1] ✓ Deploying the Submariner operator
2021-07-11T01:35:50.1113698Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-11T01:35:50.1114588Z [cluster1] • Creating SA for cluster ...
2021-07-11T01:35:50.1115457Z [cluster1] ✓ Creating SA for cluster
2021-07-11T01:35:50.1116241Z [cluster1] • Deploying Submariner ...
2021-07-11T01:35:50.1117125Z [cluster1] ✓ Deploying Submariner
2021-07-11T01:35:50.1117934Z [cluster1] ✓ Submariner is up and running
2021-07-11T01:35:54.6681650Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-11T01:35:54.6682830Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-11T01:35:54.6683921Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-11T01:35:54.6687083Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-11T01:35:54.6690369Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-11T01:35:54.6691565Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-11T01:35:54.6692647Z [cluster2] - cluster2-worker
2021-07-11T01:35:54.6693526Z [cluster2] • Discovering network details ...
2021-07-11T01:35:54.6694225Z [cluster2] Discovered network details:
2021-07-11T01:35:54.6695071Z [cluster2] Network plugin: weave-net
2021-07-11T01:35:54.6695711Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-11T01:35:54.6696299Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-11T01:35:54.6697085Z [cluster2] ✓ Discovering network details
2021-07-11T01:35:54.6698002Z [cluster2] • Discovering multi cluster details ...
2021-07-11T01:35:54.6698934Z [cluster2] • Validating Globalnet configurations ...
2021-07-11T01:35:54.6699897Z [cluster2] ✓ Validating Globalnet configurations
2021-07-11T01:35:54.6700795Z [cluster2] ✓ Discovering multi cluster details
2021-07-11T01:35:54.6701702Z [cluster2] • Deploying the Submariner operator ...
2021-07-11T01:35:54.6702601Z [cluster2] ✓ Deploying the Submariner operator
2021-07-11T01:35:54.6703451Z [cluster2] ✓ Created operator CRDs
2021-07-11T01:35:54.6704440Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-11T01:35:54.6705471Z [cluster2] ✓ Created operator service account and role
2021-07-11T01:35:54.6706433Z [cluster2] ✓ Created lighthouse service account and role
2021-07-11T01:35:54.6707442Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-11T01:35:54.6708402Z [cluster2] ✓ Deployed the operator successfully
2021-07-11T01:35:54.6709234Z [cluster2] • Creating SA for cluster ...
2021-07-11T01:35:54.6710472Z [cluster2] ✓ Creating SA for cluster
2021-07-11T01:35:54.6711277Z [cluster2] • Deploying Submariner ...
2021-07-11T01:35:54.6712069Z [cluster2] ✓ Deploying Submariner
2021-07-11T01:35:54.6712860Z [cluster2] ✓ Submariner is up and running
2021-07-11T01:35:54.6713825Z [submariner-operator]$ [cluster2] wait 6381
2021-07-11T01:35:54.6726378Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-11T01:35:54.6742021Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-11T01:35:54.6769670Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-11T01:35:54.6795362Z [submariner-operator]$ [cluster2] with_retries
2021-07-11T01:35:54.6823849Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:35:54.6860397Z [submariner-operator]$ [cluster2] wait 6422
2021-07-11T01:35:54.6865187Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:35:54.6878721Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:35:54.6907241Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:35:54.6925271Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:35:54.6943681Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:35:54.8011871Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:35:54.8034175Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:35:54.8740417Z • ...
2021-07-11T01:35:54.8854852Z • ...
2021-07-11T01:35:54.8907455Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:35:54.8929329Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:00.8972454Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:00.9013438Z [submariner-operator]$ [cluster2] wait 6449
2021-07-11T01:36:00.9077213Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:00.9095686Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:00.9109813Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:00.9149976Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:00.9169574Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:01.1545067Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:01.1578601Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:01.2919380Z • ...
2021-07-11T01:36:01.3011113Z • ...
2021-07-11T01:36:01.3063296Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:01.3078303Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:07.3114355Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:07.3202645Z [submariner-operator]$ [cluster2] wait 6476
2021-07-11T01:36:07.3215486Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:07.3270777Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:07.3391289Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:07.3402360Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:07.3556833Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:07.6535991Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:07.6559754Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:07.8334561Z • ...
2021-07-11T01:36:08.1684305Z • ...
2021-07-11T01:36:08.1712661Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:08.1729074Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:14.1769078Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:14.1821760Z [submariner-operator]$ [cluster2] wait 6502
2021-07-11T01:36:14.1830827Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:14.1877712Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:14.1889224Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:14.1917289Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:14.2074539Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:14.7873880Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:14.7894067Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:15.1494753Z • ...
2021-07-11T01:36:15.1808892Z • ...
2021-07-11T01:36:15.1835804Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:15.1854918Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:21.1884226Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:21.1941123Z [submariner-operator]$ [cluster2] wait 6528
2021-07-11T01:36:21.1951197Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:21.1985229Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:21.2004340Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:21.2106005Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:21.2121893Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:21.5121551Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:21.5144414Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:21.9382077Z • ...
2021-07-11T01:36:21.9909978Z • ...
2021-07-11T01:36:21.9939399Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:21.9955987Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:27.9986853Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:28.0063413Z [submariner-operator]$ [cluster2] wait 6554
2021-07-11T01:36:28.0075236Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:28.0201248Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:28.0232234Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:28.0284927Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:28.0331700Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:28.3942515Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:28.3960809Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:28.5161438Z • ...
2021-07-11T01:36:28.7155608Z • ...
2021-07-11T01:36:28.7186034Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:28.7200675Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:34.7232724Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:34.7323893Z [submariner-operator]$ [cluster2] wait 6580
2021-07-11T01:36:34.7344872Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:34.7382088Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:34.7392589Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:34.7412127Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:34.7453171Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:34.9299424Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:34.9348741Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:35.0215673Z • ...
2021-07-11T01:36:35.0431786Z • ...
2021-07-11T01:36:35.0558519Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:35.0575961Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:41.0613966Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:41.0659340Z [submariner-operator]$ [cluster2] wait 6607
2021-07-11T01:36:41.0676625Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:41.0700722Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:41.0713512Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:41.0727591Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:41.0821015Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:41.1369342Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:41.1520363Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:41.1842288Z • ...
2021-07-11T01:36:41.1952709Z • ...
2021-07-11T01:36:41.1974896Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:41.1985081Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:47.2016325Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:47.2080799Z [submariner-operator]$ [cluster2] wait 6633
2021-07-11T01:36:47.2114390Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:47.2126124Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:47.2140477Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:47.2155611Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:47.2171086Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:47.3633449Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:47.3658933Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:47.4222147Z • ...
2021-07-11T01:36:47.4257461Z • ...
2021-07-11T01:36:47.4284920Z iter: 9. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:36:47.4299708Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:36:53.4326641Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:36:53.4435149Z [submariner-operator]$ [cluster2] wait 6660
2021-07-11T01:36:53.4496925Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:53.4512333Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:36:53.4535336Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:36:53.4555603Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:53.4601883Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:36:53.5588660Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:36:53.5607870Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:36:53.6110479Z • ...
2021-07-11T01:36:53.6292600Z • ...
2021-07-11T01:36:53.6319210Z cluster2-worker cluster2 172.18.0.7 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 191.28µs
2021-07-11T01:36:53.6320453Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 277.905µs
2021-07-11T01:36:53.6344202Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:36:53.6361383Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:36:53.6380588Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-11T01:36:53.6398022Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-11T01:36:53.6427819Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-11T01:36:53.6441872Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-11T01:36:53.6460028Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-11T01:36:53.6487670Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-11T01:36:53.6503130Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-11T01:36:53.6520713Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-11T01:36:53.9792362Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-11T01:36:53.9850492Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-11T01:36:54.5706001Z latest: Pulling from submariner/nettest
2021-07-11T01:36:54.5731739Z df20fa9351a1: Pulling fs layer
2021-07-11T01:36:54.5741045Z 741138c6c583: Pulling fs layer
2021-07-11T01:36:54.5741660Z d34ea735672c: Pulling fs layer
2021-07-11T01:36:54.5742275Z c91acd455ec9: Pulling fs layer
2021-07-11T01:36:54.5752866Z c91acd455ec9: Waiting
2021-07-11T01:36:54.7142528Z df20fa9351a1: Verifying Checksum
2021-07-11T01:36:54.7143232Z df20fa9351a1: Download complete
2021-07-11T01:36:54.7643057Z 741138c6c583: Verifying Checksum
2021-07-11T01:36:54.7643687Z 741138c6c583: Download complete
2021-07-11T01:36:54.9686250Z d34ea735672c: Verifying Checksum
2021-07-11T01:36:54.9686946Z d34ea735672c: Download complete
2021-07-11T01:36:55.0175020Z c91acd455ec9: Verifying Checksum
2021-07-11T01:36:55.0178082Z c91acd455ec9: Download complete
2021-07-11T01:36:55.2290517Z df20fa9351a1: Pull complete
2021-07-11T01:36:55.3561070Z 741138c6c583: Pull complete
2021-07-11T01:36:55.7946155Z d34ea735672c: Pull complete
2021-07-11T01:36:55.8976615Z c91acd455ec9: Pull complete
2021-07-11T01:36:55.9031728Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-11T01:36:55.9052906Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-11T01:36:55.9111638Z quay.io/submariner/nettest:latest
2021-07-11T01:36:55.9127844Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-11T01:36:56.2579989Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-11T01:36:56.5829144Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-11T01:36:56.8912219Z The push refers to repository [localhost:5000/nettest]
2021-07-11T01:36:56.9356788Z 7497bfb0ae54: Preparing
2021-07-11T01:36:56.9357796Z 17de069c349e: Preparing
2021-07-11T01:36:56.9358470Z b85398c91342: Preparing
2021-07-11T01:36:56.9359099Z 50644c29ef5a: Preparing
2021-07-11T01:36:57.1492213Z b85398c91342: Pushed
2021-07-11T01:36:57.2181117Z 7497bfb0ae54: Pushed
2021-07-11T01:36:57.7164245Z 50644c29ef5a: Pushed
2021-07-11T01:36:58.7350543Z 17de069c349e: Pushed
2021-07-11T01:36:58.7765923Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-11T01:36:58.7834663Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:36:58.7864459Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:36:58.7883275Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-11T01:36:58.7913074Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-11T01:36:58.7941372Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:36:58.7958430Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:36:58.7973551Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:36:59.5059618Z deployment.apps/netshoot created
2021-07-11T01:36:59.5156180Z Waiting for netshoot pods to be ready.
2021-07-11T01:36:59.5171443Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-11T01:36:59.5182833Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-11T01:36:59.5196112Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-11T01:36:59.8821529Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-11T01:37:02.5777201Z deployment "netshoot" successfully rolled out
2021-07-11T01:37:02.5833383Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:02.5850610Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:02.5871177Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:02.5887196Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-11T01:37:02.5904161Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-11T01:37:02.5928911Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-11T01:37:02.5973027Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:02.5985776Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:02.6010065Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:03.2895256Z deployment.apps/nginx-demo created
2021-07-11T01:37:03.3065265Z service/nginx-demo created
2021-07-11T01:37:03.4069978Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-11T01:37:03.4130706Z Waiting for nginx-demo pods to be ready.
2021-07-11T01:37:03.4144482Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:37:03.4161486Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:37:03.4174801Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:37:04.1669706Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-11T01:37:09.4765815Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-11T01:37:09.5795003Z deployment "nginx-demo" successfully rolled out
2021-07-11T01:37:09.5868115Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-11T01:37:09.5918672Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-11T01:37:09.5953912Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-11T01:37:09.5980986Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-11T01:37:09.6011976Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-11T01:37:10.0907663Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-11T01:37:10.0926830Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-11T01:37:10.0949759Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-11T01:37:10.0966612Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-11T01:37:10.0992406Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-11T01:37:10.1008481Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-11T01:37:10.1027517Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:37:10.1048708Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:37:10.1060531Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-11T01:37:10.1068030Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:37:10.4454322Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-b587d 100.1.122.166
2021-07-11T01:37:10.4471805Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-b587d 100.1.122.166
2021-07-11T01:37:10.4486706Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:37:10.4522294Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-b587d 100.1.122.166
2021-07-11T01:37:10.4527982Z [submariner-operator]$ [cluster2] wait 6812
2021-07-11T01:37:10.4546529Z [submariner-operator]$ [cluster2] test_connection
2021-07-11T01:37:10.4555258Z Attempting connectivity between clusters - netshoot-57677568b8-b587d --> 100.1.122.166
2021-07-11T01:37:10.4569744Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-11T01:37:10.4584375Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-11T01:37:10.4603639Z [submariner-operator]$ [cluster2] date +%s
2021-07-11T01:37:10.4655722Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-b587d -- curl --output /dev/null -m 30 --silent --head --fail 100.1.122.166
2021-07-11T01:37:10.4668693Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-b587d -- curl --output /dev/null -m 30 --silent --head --fail 100.1.122.166
2021-07-11T01:37:10.4683765Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-b587d -- curl --output /dev/null -m 30 --silent --head --fail 100.1.122.166
2021-07-11T01:37:10.9263168Z Connection test was successful!
2021-07-11T01:37:10.9283049Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:37:10.9299250Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:37:10.9317493Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:37:10.9341192Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:37:10.9357230Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:37:10.9373529Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:37:11.2524168Z deployment.apps "netshoot" deleted
2021-07-11T01:37:11.2604758Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.2632700Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.2651772Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.2667982Z [submariner-operator]$ [cluster1] remove_resource
2021-07-11T01:37:11.2688281Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.2706590Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.2721209Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:37:11.5836413Z deployment.apps "nginx-demo" deleted
2021-07-11T01:37:11.6402142Z service "nginx-demo" deleted
2021-07-11T01:37:11.6806029Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-11T01:37:11.7957708Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-11T01:37:11.7983518Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-11T01:37:11.8034846Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-11T01:37:11.8075051Z [submariner-operator]$ [cluster2] grep -q function
2021-07-11T01:37:11.8131122Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:37:11.8137826Z Successfully remade target file 'deploy'.
2021-07-11T01:37:11.8191227Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-11T01:37:11.8268084Z Successfully remade target file 'deploy-latest'.
2021-07-11T01:37:11.8270977Z File 'clusters' does not exist.
2021-07-11T01:37:11.8271737Z Must remake target 'clusters'.
2021-07-11T01:37:11.8273204Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:37:12.0575013Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-11T01:37:12.0664303Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-11T01:37:12.0730310Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:37:12.0755452Z [submariner-operator]$ script_name=utils
2021-07-11T01:37:12.0782708Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:37:12.0805599Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-11T01:37:12.0822263Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:37:12.0838151Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:37:12.0852587Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:37:12.0879321Z [submariner-operator]$ broker=cluster1
2021-07-11T01:37:12.0899658Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-11T01:37:12.0916245Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-11T01:37:12.0951817Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-11T01:37:12.0966794Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-11T01:37:12.0979760Z [submariner-operator]$ declare -gA cluster_subm
2021-07-11T01:37:12.0995623Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-11T01:37:12.1009561Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-11T01:37:12.1027926Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-11T01:37:12.1087338Z [submariner-operator]$ declare -gA cluster_cni
2021-07-11T01:37:12.1099198Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-11T01:37:12.1177595Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-11T01:37:12.1249452Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:37:12.1290904Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:37:12.1307065Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:37:12.1322295Z [submariner-operator]$ exec_name=clusters.sh
2021-07-11T01:37:12.1347251Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-11T01:37:12.1370518Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-11T01:37:12.1439116Z [submariner-operator]$ cat <<EOM
2021-07-11T01:37:12.1447806Z Cluster settings::
2021-07-11T01:37:12.1448841Z broker - ${broker@Q}
2021-07-11T01:37:12.1449496Z clusters - ${clusters[*]@Q}
2021-07-11T01:37:12.1450245Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-11T01:37:12.1451141Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-11T01:37:12.1452205Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-11T01:37:12.1452948Z EOM
2021-07-11T01:37:12.1485676Z [submariner-operator]$ typeset -p cluster_cni
2021-07-11T01:37:12.1503081Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:37:12.1568360Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-11T01:37:12.1599506Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:37:12.1641893Z [submariner-operator]$ typeset -p cluster_subm
2021-07-11T01:37:12.1660195Z [submariner-operator]$ cut -f 2- -d=
2021-07-11T01:37:12.1712779Z Cluster settings::
2021-07-11T01:37:12.1713636Z broker - 'cluster1'
2021-07-11T01:37:12.1714362Z clusters - 'cluster1' 'cluster2'
2021-07-11T01:37:12.1715173Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-11T01:37:12.1716581Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-11T01:37:12.1717942Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-11T01:37:12.1739212Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-11T01:37:12.1770678Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-11T01:37:12.1813487Z [submariner-operator]$ run_local_registry
2021-07-11T01:37:12.1823854Z [submariner-operator]$ run_local_registry
2021-07-11T01:37:12.1834179Z [submariner-operator]$ registry_running
2021-07-11T01:37:12.1846939Z [submariner-operator]$ registry_running
2021-07-11T01:37:12.1862015Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-11T01:37:12.1874955Z [submariner-operator]$ grep kind-registry
2021-07-11T01:37:12.5476992Z 36126a490622 registry:2 "/entrypoint.sh /etc…" 8 minutes ago Up 8 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-11T01:37:12.5490499Z [submariner-operator]$ return 0
2021-07-11T01:37:12.5496319Z Local registry kind-registry already running.
2021-07-11T01:37:12.5509355Z [submariner-operator]$ declare_cidrs
2021-07-11T01:37:12.5523637Z [submariner-operator]$ declare_cidrs
2021-07-11T01:37:12.5536872Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-11T01:37:12.5550007Z [submariner-operator]$ i=1
2021-07-11T01:37:12.5565768Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:37:12.5578860Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:37:12.5596586Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-11T01:37:12.5612226Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-11T01:37:12.5625168Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-11T01:37:12.5639739Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:37:12.5651515Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:37:12.5668044Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-11T01:37:12.5682584Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-11T01:37:12.5698333Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-11T01:37:12.5718743Z [submariner-operator]$ [cluster2] wait 7022
2021-07-11T01:37:12.5743792Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5759246Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5772117Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5785631Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5798744Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:37:12.5817836Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:37:12.5843100Z [submariner-operator]$ [cluster1] pids[cluster1]=7031
2021-07-11T01:37:12.5853675Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:37:12.5868441Z [submariner-operator]$ [cluster2] pids[cluster2]=7034
2021-07-11T01:37:12.5876718Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:37:12.5889432Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5897096Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-11T01:37:12.5914668Z [submariner-operator]$ [cluster2] wait 7034
2021-07-11T01:37:12.5951046Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:37:12.5987118Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:37:20.6758714Z [submariner-operator]$ [cluster2] with_retries
2021-07-11T01:37:20.6759854Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:37:20.6760852Z [submariner-operator]$ [cluster2] wait 7055
2021-07-11T01:37:20.6762029Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-11T01:37:20.6763129Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-11T01:37:20.6764855Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6767193Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6768763Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-11T01:37:20.6769814Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-11T01:37:20.6770715Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-11T01:37:20.6772105Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-11T01:37:20.6773232Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-11T01:37:20.6774215Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-11T01:37:20.6775267Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-11T01:37:20.6776898Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-11T01:37:20.6778404Z [submariner-operator]$ [cluster2] head -n 1
2021-07-11T01:37:20.6780208Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.4:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6782775Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6785194Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6787642Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6791020Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6793771Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-11T01:37:20.6795288Z [submariner-operator]$ [cluster2] return
2021-07-11T01:37:20.6796253Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:37:20.6823564Z [submariner-operator]$ [cluster2] wait 7031
2021-07-11T01:37:20.6928462Z [submariner-operator]$ [cluster1] with_retries
2021-07-11T01:37:20.6929614Z [submariner-operator]$ [cluster1] iteration=1
2021-07-11T01:37:20.6930615Z [submariner-operator]$ [cluster1] wait 7051
2021-07-11T01:37:20.6931633Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-11T01:37:20.6932721Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-11T01:37:20.6934471Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6936656Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6938202Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-11T01:37:20.6939250Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-11T01:37:20.6940153Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-11T01:37:20.6941324Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-11T01:37:20.6942424Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-11T01:37:20.6943423Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-11T01:37:20.6944457Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-11T01:37:20.6946108Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-11T01:37:20.6947609Z [submariner-operator]$ [cluster1] head -n 1
2021-07-11T01:37:20.6950009Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6953259Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6955682Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6958124Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6960793Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6963198Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-11T01:37:20.6965347Z [submariner-operator]$ [cluster1] return
2021-07-11T01:37:20.6966316Z [submariner-operator]$ [cluster1] return 0
2021-07-11T01:37:20.6967432Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-11T01:37:20.6968548Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-11T01:37:20.6983997Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-11T01:37:20.6984939Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-11T01:37:20.6985495Z
2021-07-11T01:37:20.6986636Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-11T01:37:20.6987593Z
2021-07-11T01:37:20.6998610Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-11T01:37:20.6999142Z
2021-07-11T01:37:20.7000079Z To clean everthing up, just run: make clean-clusters
2021-07-11T01:37:20.7001008Z EOM
2021-07-11T01:37:20.7001759Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-11T01:37:20.7002325Z
2021-07-11T01:37:20.7003321Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-11T01:37:20.7003990Z
2021-07-11T01:37:20.7004894Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-11T01:37:20.7005388Z
2021-07-11T01:37:20.7006113Z To clean everthing up, just run: make clean-clusters
2021-07-11T01:37:20.7007014Z Successfully remade target file 'clusters'.
2021-07-11T01:37:20.7007877Z File 'preload-images' does not exist.
2021-07-11T01:37:20.7008643Z File 'images' does not exist.
2021-07-11T01:37:20.7009612Z File 'package/.image.submariner-operator' does not exist.
2021-07-11T01:37:20.7085950Z find: 'bin/submariner-operator': No such file or directory
2021-07-11T01:37:21.0623236Z File 'bin/submariner-operator' does not exist.
2021-07-11T01:37:21.0632339Z File 'generate-embeddedyamls' does not exist.
2021-07-11T01:37:21.0633321Z File 'generate' does not exist.
2021-07-11T01:37:21.0634235Z Must remake target 'generate'.
2021-07-11T01:37:21.0690847Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-11T01:37:24.7883970Z Successfully remade target file 'generate'.
2021-07-11T01:37:24.8021119Z Must remake target 'generate-embeddedyamls'.
2021-07-11T01:37:24.8022362Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-11T01:37:24.8023477Z Must remake target 'bin/submariner-operator'.
2021-07-11T01:37:24.8024302Z /opt/shipyard/scripts/compile.sh \
2021-07-11T01:37:24.8025553Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316" \
2021-07-11T01:37:24.8026763Z bin/submariner-operator main.go
2021-07-11T01:37:24.8597569Z [submariner-operator]$ mkdir -p bin
2021-07-11T01:37:24.8617287Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316')
2021-07-11T01:37:24.8631150Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316
2021-07-11T01:37:24.8646393Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316 -o bin/submariner-operator main.go
2021-07-11T01:37:43.3504799Z [submariner-operator]$ upx bin/submariner-operator
2021-07-11T01:37:49.6961839Z Ultimate Packer for eXecutables
2021-07-11T01:37:49.6963141Z Copyright (C) 1996 - 2020
2021-07-11T01:37:49.6963816Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-11T01:37:49.6964296Z
2021-07-11T01:37:49.6964744Z File size Ratio Format Name
2021-07-11T01:37:49.6965612Z -------------------- ------ ----------- -----------
2021-07-11T01:37:49.6966545Z 34459648 -> 9932116 28.82% linux/amd64 submariner-operator
2021-07-11T01:37:49.6967176Z
2021-07-11T01:37:49.6967568Z Packed 1 file.
2021-07-11T01:37:49.6976794Z Successfully remade target file 'bin/submariner-operator'.
2021-07-11T01:37:49.6980272Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-11T01:37:49.6982475Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-11T01:37:49.6984748Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-11T01:37:49.6986515Z File 'FORCE_IMAGE' does not exist.
2021-07-11T01:37:49.6987261Z Must remake target 'FORCE_IMAGE'.
2021-07-11T01:37:49.6988098Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-11T01:37:49.6989164Z Must remake target 'package/.image.submariner-operator'.
2021-07-11T01:37:49.6991240Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-11T01:37:49.7833655Z flags:WARN flag short name (h) already defined
2021-07-11T01:37:49.8481893Z [submariner-operator]$ set -e
2021-07-11T01:37:49.8525136Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:49.8547402Z [submariner-operator]$ cache_flag=
2021-07-11T01:37:49.8561093Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:49.8584508Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:50.1848456Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:50.6774393Z devel: Pulling from submariner/submariner-operator
2021-07-11T01:37:50.6775186Z 6df74d099db7: Pulling fs layer
2021-07-11T01:37:50.8159043Z 6df74d099db7: Verifying Checksum
2021-07-11T01:37:50.8159755Z 6df74d099db7: Download complete
2021-07-11T01:37:51.0329254Z 6df74d099db7: Pull complete
2021-07-11T01:37:51.0369496Z Digest: sha256:155eeb6cb16ce14f12c8799d5dec79dca7e835f2cb0ab8e90ee4cd88498a041c
2021-07-11T01:37:51.0387858Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:51.0437897Z quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:51.0463166Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-11T01:37:51.0483375Z [submariner-operator]$ cut -f2 -d 
2021-07-11T01:37:51.0487197Z [submariner-operator]$ grep -v scratch
2021-07-11T01:37:51.0508306Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-11T01:37:51.0525761Z 
2021-07-11T01:37:51.9830880Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-11T01:37:52.9427191Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-11T01:37:52.9505168Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-11T01:37:53.8755266Z buildx_builder
2021-07-11T01:37:53.8836181Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-11T01:37:54.7767038Z #1 [internal] booting buildkit
2021-07-11T01:37:54.7770204Z #1 sha256:c591f6b6494a4a0a305c1a221c01b30bc851ed606b601eaaba5b3e7e7ea8be57
2021-07-11T01:37:54.9277440Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-11T01:37:57.9302612Z #1 pulling image moby/buildkit:buildx-stable-1 3.1s done
2021-07-11T01:37:57.9307656Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-11T01:37:59.2060056Z #1 creating container buildx_buildkit_buildx_builder0 0.9s done
2021-07-11T01:37:59.2060829Z #1 DONE 4.0s
2021-07-11T01:37:59.2061104Z
2021-07-11T01:37:59.2062557Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-11T01:37:59.2064215Z #2 sha256:d0d3ed39cf34b3cb848c5155f7e8fab60a4d0d2cfbd6932e3a08a01b07895772
2021-07-11T01:37:59.2065978Z #2 transferring dockerfile: 230B done
2021-07-11T01:37:59.2066491Z #2 DONE 0.0s
2021-07-11T01:37:59.2066760Z
2021-07-11T01:37:59.2067227Z #3 [internal] load .dockerignore
2021-07-11T01:37:59.2068466Z #3 sha256:0583d8b14b8dd17738b82c48355c157f937def4190424d9ad6ed4d00bb221981
2021-07-11T01:37:59.2069440Z #3 transferring context: 2B done
2021-07-11T01:37:59.2069917Z #3 DONE 0.0s
2021-07-11T01:37:59.2341518Z
2021-07-11T01:37:59.2342282Z #4 [internal] load build context
2021-07-11T01:37:59.2343504Z #4 sha256:d4c4d2799a11ccc98b8d78979c45ea9944f327d0c10b42b3f812b00391924882
2021-07-11T01:37:59.2344491Z #4 DONE 0.0s
2021-07-11T01:37:59.2344763Z
2021-07-11T01:37:59.2346142Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-11T01:37:59.2347612Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-11T01:37:59.5125534Z #6 DONE 0.3s
2021-07-11T01:37:59.5135506Z
2021-07-11T01:37:59.5140887Z #4 [internal] load build context
2021-07-11T01:37:59.5158700Z #4 sha256:d4c4d2799a11ccc98b8d78979c45ea9944f327d0c10b42b3f812b00391924882
2021-07-11T01:37:59.7841243Z #4 transferring context: 9.93MB 0.4s done
2021-07-11T01:37:59.9344701Z #4 DONE 0.4s
2021-07-11T01:37:59.9345051Z
2021-07-11T01:37:59.9346393Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-11T01:37:59.9347691Z #5 sha256:509c8af0895f536f856fe7f6b1d3ebda9f67e280c968cd5e547fd89fdec0d594
2021-07-11T01:37:59.9348684Z #5 DONE 0.0s
2021-07-11T01:38:00.4887262Z
2021-07-11T01:38:00.4888018Z #7 exporting to oci image format
2021-07-11T01:38:00.4889140Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-11T01:38:00.6427196Z #7 exporting layers done
2021-07-11T01:38:00.6428670Z #7 exporting manifest sha256:ac65b25313ef621df7b4bdaace2cef0b7ac383b0d5c4ef56e4cc57979deb07e7 0.0s done
2021-07-11T01:38:00.6430786Z #7 exporting config sha256:778269d39e3cebd3ff8e7b6d8ee26f52893427817cf11a35714ff7c7a42500ee done
2021-07-11T01:38:00.6431907Z #7 sending tarball
2021-07-11T01:38:01.0543711Z #7 ...
2021-07-11T01:38:01.0544131Z
2021-07-11T01:38:01.0551162Z #8 importing to docker
2021-07-11T01:38:01.0554312Z #8 sha256:e188f047ad2dedbcff8daa9d3e9afa25be84bd2fd94e18c55c21d00e5591db6d
2021-07-11T01:38:01.0555877Z #8 DONE 0.2s
2021-07-11T01:38:01.0617738Z
2021-07-11T01:38:01.0618801Z #7 exporting to oci image format
2021-07-11T01:38:01.0620443Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-11T01:38:01.0621849Z #7 sending tarball 0.5s done
2021-07-11T01:38:01.0622791Z #7 DONE 0.6s
2021-07-11T01:38:01.0623539Z
2021-07-11T01:38:01.0624235Z #9 exporting cache
2021-07-11T01:38:01.0676462Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-11T01:38:01.0678595Z #9 preparing build cache for export done
2021-07-11T01:38:01.0680178Z #9 DONE 0.0s
2021-07-11T01:38:01.0744775Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-11T01:38:01.4057230Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-11T01:38:01.4058332Z File 'build' does not exist.
2021-07-11T01:38:01.4059490Z File 'bin/subctl-devel-1a48316-linux-amd64' does not exist.
2021-07-11T01:38:01.4342532Z Must remake target 'bin/subctl-devel-1a48316-linux-amd64'.
2021-07-11T01:38:01.4346840Z mkdir -p bin
2021-07-11T01:38:01.4373776Z target=bin/subctl-devel-1a48316-linux-amd64; \
2021-07-11T01:38:01.4374564Z target=${target%.exe}; \
2021-07-11T01:38:01.4375266Z components=($(echo ${target//-/ })); \
2021-07-11T01:38:01.4375958Z GOOS=${components[-2]}; \
2021-07-11T01:38:01.4376603Z GOARCH=${components[-1]}; \
2021-07-11T01:38:01.4377135Z export GOARCH GOOS; \
2021-07-11T01:38:01.4377687Z /opt/shipyard/scripts/compile.sh \
2021-07-11T01:38:01.4379072Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316 \
2021-07-11T01:38:01.4381167Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-11T01:38:01.4383062Z --noupx bin/subctl-devel-1a48316-linux-amd64 ./pkg/subctl/main.go
2021-07-11T01:38:01.4956093Z [submariner-operator]$ mkdir -p bin
2021-07-11T01:38:01.4976343Z Building 'bin/subctl-devel-1a48316-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316 \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-11T01:38:01.4994563Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-11T01:38:01.5042166Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-1a48316 -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-1a48316-linux-amd64 ./pkg/subctl/main.go
2021-07-11T01:38:05.3435362Z Successfully remade target file 'bin/subctl-devel-1a48316-linux-amd64'.
2021-07-11T01:38:05.3437400Z Prerequisite 'bin/subctl-devel-1a48316-linux-amd64' is newer than target 'bin/subctl'.
2021-07-11T01:38:05.3438703Z Must remake target 'bin/subctl'.
2021-07-11T01:38:05.3439856Z ln -sf subctl-devel-1a48316-linux-amd64 bin/subctl
2021-07-11T01:38:05.3485765Z Successfully remade target file 'bin/subctl'.
2021-07-11T01:38:05.3486603Z Must remake target 'build'.
2021-07-11T01:38:05.3487395Z Successfully remade target file 'build'.
2021-07-11T01:38:05.3491280Z Must remake target 'images'.
2021-07-11T01:38:05.3492062Z Successfully remade target file 'images'.
2021-07-11T01:38:05.3492917Z Must remake target 'preload-images'.
2021-07-11T01:38:05.3498194Z set -e;\
2021-07-11T01:38:05.3498727Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-11T01:38:05.3499400Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-11T01:38:05.3500928Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-11T01:38:05.3502235Z import_image quay.io/submariner/${image};\
2021-07-11T01:38:05.3502745Z done
2021-07-11T01:38:05.3555479Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-11T01:38:05.3570088Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-11T01:38:05.3583586Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-11T01:38:05.6622276Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-11T01:38:05.9782326Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-11T01:38:05.9813910Z b21943b51f64: Preparing
2021-07-11T01:38:06.6201473Z b21943b51f64: Pushed
2021-07-11T01:38:06.6420953Z local: digest: sha256:5d9a89c190aa03771e6fb566d777af54cc39655ccb6a5a53d108b11e6a2a5cb0 size: 528
2021-07-11T01:38:06.6471329Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-11T01:38:06.6484944Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-11T01:38:06.6504551Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-11T01:38:06.9555425Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-11T01:38:06.9596245Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-11T01:38:07.4834335Z devel: Pulling from submariner/submariner-gateway
2021-07-11T01:38:07.4835111Z 8c741e919b67: Pulling fs layer
2021-07-11T01:38:07.4835635Z 13495efbbac4: Pulling fs layer
2021-07-11T01:38:07.4836170Z 9d49a81b7342: Pulling fs layer
2021-07-11T01:38:07.4836698Z 33f61fcad3e9: Pulling fs layer
2021-07-11T01:38:07.4837227Z 30d2c490d677: Pulling fs layer
2021-07-11T01:38:07.4842754Z ecfd9f79eec4: Pulling fs layer
2021-07-11T01:38:07.4845104Z 33f61fcad3e9: Waiting
2021-07-11T01:38:07.4845587Z 30d2c490d677: Waiting
2021-07-11T01:38:07.4846066Z ecfd9f79eec4: Waiting
2021-07-11T01:38:07.5797463Z 13495efbbac4: Verifying Checksum
2021-07-11T01:38:07.5798106Z 13495efbbac4: Download complete
2021-07-11T01:38:07.8913898Z 33f61fcad3e9: Verifying Checksum
2021-07-11T01:38:07.8919093Z 33f61fcad3e9: Download complete
2021-07-11T01:38:07.9242258Z 9d49a81b7342: Verifying Checksum
2021-07-11T01:38:07.9242947Z 9d49a81b7342: Download complete
2021-07-11T01:38:08.0015698Z 30d2c490d677: Verifying Checksum
2021-07-11T01:38:08.0016434Z 30d2c490d677: Download complete
2021-07-11T01:38:08.0367012Z ecfd9f79eec4: Verifying Checksum
2021-07-11T01:38:08.0368196Z ecfd9f79eec4: Download complete
2021-07-11T01:38:08.4573104Z 8c741e919b67: Verifying Checksum
2021-07-11T01:38:08.4573761Z 8c741e919b67: Download complete
2021-07-11T01:38:11.8587732Z 8c741e919b67: Pull complete
2021-07-11T01:38:12.9174319Z 13495efbbac4: Pull complete
2021-07-11T01:38:14.3260918Z 9d49a81b7342: Pull complete
2021-07-11T01:38:14.5605975Z 33f61fcad3e9: Pull complete
2021-07-11T01:38:14.6677226Z 30d2c490d677: Pull complete
2021-07-11T01:38:14.7564285Z ecfd9f79eec4: Pull complete
2021-07-11T01:38:14.7603082Z Digest: sha256:a120e7dd9990d997567a23b2ecfec987a641b808fc92e0ab0467f164106738e5
2021-07-11T01:38:14.7621274Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-11T01:38:14.7640353Z quay.io/submariner/submariner-gateway:devel
2021-07-11T01:38:14.7675834Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-11T01:38:15.0979664Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-11T01:38:15.4013454Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-11T01:38:15.7021877Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-11T01:38:15.7074911Z b55478c8d9fc: Preparing
2021-07-11T01:38:15.7075639Z 824bdd40c27f: Preparing
2021-07-11T01:38:15.7076289Z 2fead8360a87: Preparing
2021-07-11T01:38:15.7076836Z 8a01ec0f4808: Preparing
2021-07-11T01:38:15.7077461Z 00c5f6897675: Preparing
2021-07-11T01:38:15.7078093Z b3b62c837788: Preparing
2021-07-11T01:38:15.7078694Z b3b62c837788: Waiting
2021-07-11T01:38:16.3600565Z b55478c8d9fc: Pushed
2021-07-11T01:38:16.3601453Z 00c5f6897675: Pushed
2021-07-11T01:38:16.3601933Z 824bdd40c27f: Pushed
2021-07-11T01:38:16.6530314Z 2fead8360a87: Pushed
2021-07-11T01:38:20.8211568Z 8a01ec0f4808: Pushed
2021-07-11T01:38:29.8172817Z b3b62c837788: Pushed
2021-07-11T01:38:29.8400828Z local: digest: sha256:a120e7dd9990d997567a23b2ecfec987a641b808fc92e0ab0467f164106738e5 size: 1575
2021-07-11T01:38:29.8455400Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-11T01:38:29.8468848Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-11T01:38:29.8484595Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-11T01:38:30.1828890Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-11T01:38:30.1864680Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-11T01:38:30.6676210Z devel: Pulling from submariner/submariner-route-agent
2021-07-11T01:38:30.6680945Z 8c741e919b67: Already exists
2021-07-11T01:38:30.6698993Z 13495efbbac4: Already exists
2021-07-11T01:38:30.6728455Z 70cc6422093d: Pulling fs layer
2021-07-11T01:38:30.6728998Z 8754067de0ce: Pulling fs layer
2021-07-11T01:38:30.6729532Z f7767a8dcf1b: Pulling fs layer
2021-07-11T01:38:30.6733689Z 9f5d65e812c0: Pulling fs layer
2021-07-11T01:38:30.6735118Z 9f5d65e812c0: Waiting
2021-07-11T01:38:30.7625154Z f7767a8dcf1b: Verifying Checksum
2021-07-11T01:38:30.7625794Z f7767a8dcf1b: Download complete
2021-07-11T01:38:30.8666282Z 9f5d65e812c0: Verifying Checksum
2021-07-11T01:38:30.8666936Z 9f5d65e812c0: Download complete
2021-07-11T01:38:30.8734605Z 8754067de0ce: Verifying Checksum
2021-07-11T01:38:30.8735223Z 8754067de0ce: Download complete
2021-07-11T01:38:31.0878477Z 70cc6422093d: Verifying Checksum
2021-07-11T01:38:31.0879126Z 70cc6422093d: Download complete
2021-07-11T01:38:32.7567669Z 70cc6422093d: Pull complete
2021-07-11T01:38:32.9695374Z 8754067de0ce: Pull complete
2021-07-11T01:38:33.0501833Z f7767a8dcf1b: Pull complete
2021-07-11T01:38:33.1562698Z 9f5d65e812c0: Pull complete
2021-07-11T01:38:33.1609482Z Digest: sha256:ff1eefd3e71284f74248114c8337feaba12284803134a1a937ab83a4d4528edf
2021-07-11T01:38:33.1636158Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-11T01:38:33.1644743Z quay.io/submariner/submariner-route-agent:devel
2021-07-11T01:38:33.1684210Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-11T01:38:33.4964165Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-11T01:38:33.8073946Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-11T01:38:34.1182256Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-11T01:38:34.1414529Z 76660b11c7e4: Preparing
2021-07-11T01:38:34.1428520Z 36dcc9486abe: Preparing
2021-07-11T01:38:34.1429417Z 173e2d227fa2: Preparing
2021-07-11T01:38:34.1430035Z 6931e591f8e2: Preparing
2021-07-11T01:38:34.1431236Z 00c5f6897675: Preparing
2021-07-11T01:38:34.1431869Z b3b62c837788: Preparing
2021-07-11T01:38:34.1432459Z b3b62c837788: Waiting
2021-07-11T01:38:34.9049048Z 00c5f6897675: Mounted from submariner-gateway
2021-07-11T01:38:34.9049913Z 36dcc9486abe: Pushed
2021-07-11T01:38:34.9050537Z 76660b11c7e4: Pushed
2021-07-11T01:38:35.0198456Z b3b62c837788: Mounted from submariner-gateway
2021-07-11T01:38:35.0202698Z 173e2d227fa2: Pushed
2021-07-11T01:38:39.3449867Z 6931e591f8e2: Pushed
2021-07-11T01:38:39.3658750Z local: digest: sha256:ff1eefd3e71284f74248114c8337feaba12284803134a1a937ab83a4d4528edf size: 1575
2021-07-11T01:38:39.3730902Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-11T01:38:39.3746909Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-11T01:38:39.3764958Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-11T01:38:39.6947967Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-11T01:38:39.6986813Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-11T01:38:40.2117863Z devel: Pulling from submariner/lighthouse-agent
2021-07-11T01:38:40.2124086Z 24e80574ab61: Pulling fs layer
2021-07-11T01:38:40.2127862Z 977c13f0686c: Pulling fs layer
2021-07-11T01:38:40.2837108Z 24e80574ab61: Download complete
2021-07-11T01:38:40.3965374Z 977c13f0686c: Verifying Checksum
2021-07-11T01:38:40.3966316Z 977c13f0686c: Download complete
2021-07-11T01:38:40.4098335Z 24e80574ab61: Pull complete
2021-07-11T01:38:40.6207635Z 977c13f0686c: Pull complete
2021-07-11T01:38:40.6256704Z Digest: sha256:a98d59631fc7e8719a7069090a8283ccec411cf1ac09b3a23bb24d11a43de085
2021-07-11T01:38:40.6316490Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-11T01:38:40.6353287Z quay.io/submariner/lighthouse-agent:devel
2021-07-11T01:38:40.6392286Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-11T01:38:40.9616722Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-11T01:38:41.2739613Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-11T01:38:41.5731395Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-11T01:38:41.5976528Z 1724808889be: Preparing
2021-07-11T01:38:41.5977139Z 1f074d552703: Preparing
2021-07-11T01:38:41.6304878Z 1f074d552703: Pushed
2021-07-11T01:38:42.1707638Z 1724808889be: Pushed
2021-07-11T01:38:42.1914213Z local: digest: sha256:a98d59631fc7e8719a7069090a8283ccec411cf1ac09b3a23bb24d11a43de085 size: 735
2021-07-11T01:38:42.1965530Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-11T01:38:42.1979902Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-11T01:38:42.1994390Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-11T01:38:42.4979840Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-11T01:38:42.5018386Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-11T01:38:43.1128945Z devel: Pulling from submariner/lighthouse-coredns
2021-07-11T01:38:43.1130647Z 088e56360f76: Pulling fs layer
2021-07-11T01:38:43.1133523Z 5235624ac275: Pulling fs layer
2021-07-11T01:38:43.2169528Z 088e56360f76: Verifying Checksum
2021-07-11T01:38:43.2176098Z 088e56360f76: Download complete
2021-07-11T01:38:43.3524885Z 088e56360f76: Pull complete
2021-07-11T01:38:43.5391686Z 5235624ac275: Verifying Checksum
2021-07-11T01:38:43.5392294Z 5235624ac275: Download complete
2021-07-11T01:38:43.8250451Z 5235624ac275: Pull complete
2021-07-11T01:38:43.8312045Z Digest: sha256:7d53e0c2e4e5258b73fe3932495f4b10a0553f8318aad337747da7d485e1d469
2021-07-11T01:38:43.8321997Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-11T01:38:43.8354829Z quay.io/submariner/lighthouse-coredns:devel
2021-07-11T01:38:43.8392991Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-11T01:38:44.1752802Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-11T01:38:44.5045292Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-11T01:38:44.8247793Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-11T01:38:44.8306851Z d33a291fbccc: Preparing
2021-07-11T01:38:44.8307495Z 4fa0ece06e25: Preparing
2021-07-11T01:38:44.9343092Z 4fa0ece06e25: Pushed
2021-07-11T01:38:45.6867343Z d33a291fbccc: Pushed
2021-07-11T01:38:45.7108064Z local: digest: sha256:7d53e0c2e4e5258b73fe3932495f4b10a0553f8318aad337747da7d485e1d469 size: 739
2021-07-11T01:38:45.7153240Z Successfully remade target file 'preload-images'.
2021-07-11T01:38:45.7154345Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-11T01:38:45.7155443Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-11T01:38:45.7156499Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-11T01:38:45.7161562Z Must remake target 'deploy'.
2021-07-11T01:38:45.7163020Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:38:45.8271556Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-11T01:38:45.8302005Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-11T01:38:45.8316801Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:38:45.8329338Z [submariner-operator]$ script_name=utils
2021-07-11T01:38:45.8341310Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:38:45.8361306Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-11T01:38:45.8375227Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:38:45.8388112Z [submariner-operator]$ script_name=deploy_funcs
2021-07-11T01:38:45.8400985Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:38:45.8421495Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-11T01:38:45.8437343Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:38:45.8455678Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:38:45.8502442Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:38:45.8542687Z [submariner-operator]$ broker=cluster1
2021-07-11T01:38:45.8556216Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-11T01:38:45.8568966Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-11T01:38:45.8582729Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-11T01:38:45.8596460Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-11T01:38:45.8609475Z [submariner-operator]$ declare -gA cluster_subm
2021-07-11T01:38:45.8621517Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-11T01:38:45.8634275Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-11T01:38:46.7254701Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-11T01:38:46.7255670Z Installing subctl version devel
2021-07-11T01:38:46.7256263Z OS detected: linux
2021-07-11T01:38:46.7256811Z Architecture detected: amd64
2021-07-11T01:38:46.7258552Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-11T01:38:46.7259663Z
2021-07-11T01:38:46.7260067Z Downloading...
2021-07-11T01:38:46.7262416Z [submariner-operator]$ declare -gA cluster_cni
2021-07-11T01:38:46.7263463Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-11T01:38:46.7264539Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-11T01:38:46.7266054Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:38:46.7267574Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:38:46.7268688Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:38:46.7269922Z [submariner-operator]$ exec_name=deploy.sh
2021-07-11T01:38:46.7271620Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-11T01:38:46.7272964Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-11T01:38:46.7274097Z [submariner-operator]$ declare_cidrs
2021-07-11T01:38:46.7275035Z [submariner-operator]$ declare_cidrs
2021-07-11T01:38:46.7276155Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-11T01:38:46.7277199Z [submariner-operator]$ i=1
2021-07-11T01:38:46.7278206Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:38:46.7279359Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:38:46.7280509Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-11T01:38:46.7281686Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-11T01:38:46.7282913Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-11T01:38:46.7283980Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:38:46.7285178Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:38:46.7286322Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-11T01:38:46.7287485Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-11T01:38:46.7288674Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-11T01:38:46.7289713Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-11T01:38:46.7290803Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-11T01:38:46.7292157Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-11T01:38:46.7293357Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-11T01:38:46.7294748Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-11T01:38:46.7296542Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-11T01:38:46.7298547Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-11T01:38:47.4649867Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-11T01:38:47.4857307Z This provides subctl version: devel
2021-07-11T01:38:47.4882594Z
2021-07-11T01:38:47.4883364Z please update your path (and consider adding it to ~/.profile):
2021-07-11T01:38:47.4884046Z export PATH=$PATH:/go/bin
2021-07-11T01:38:47.4884473Z
2021-07-11T01:38:47.5004391Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-11T01:38:47.5015842Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-11T01:38:47.5022162Z Will deploy submariner using operator
2021-07-11T01:38:47.5036791Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-11T01:38:47.5087810Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:38:47.5105833Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-11T01:38:47.5122305Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-11T01:38:47.5146499Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-11T01:38:47.5161980Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-11T01:38:47.5176595Z 
2021-07-11T01:38:47.5193056Z [submariner-operator]$ [cluster2] subctl version
2021-07-11T01:38:47.5408879Z subctl version: devel-1a48316
2021-07-11T01:38:47.5448884Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-11T01:38:47.5475474Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-11T01:38:47.5495670Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-11T01:38:47.5515401Z [submariner-operator]$ [cluster2] grep -q function
2021-07-11T01:38:47.5545573Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:38:47.5562065Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-11T01:38:47.5576740Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-11T01:38:47.5592106Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-11T01:38:47.5638237Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-11T01:38:47.5652510Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-11T01:38:47.5667303Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:38:47.5686857Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:38:47.5712876Z [submariner-operator]$ [cluster1] pids[cluster1]=8671
2021-07-11T01:38:47.5730224Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:38:47.5736847Z [submariner-operator]$ [cluster2] pids[cluster2]=8674
2021-07-11T01:38:47.5749462Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-11T01:38:47.5769690Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:38:47.5775948Z [submariner-operator]$ [cluster2] wait 8674
2021-07-11T01:38:47.5789487Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:38:47.5802351Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-11T01:38:47.5832367Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:38:47.9849188Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-11T01:38:47.9850630Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-11T01:38:47.9851767Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-11T01:38:47.9853197Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:47.9854914Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:47.9856781Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:47.9858177Z [cluster1] node/cluster1-worker not labeled
2021-07-11T01:38:48.0319670Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-11T01:38:48.0320901Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-11T01:38:48.0322002Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-11T01:38:48.0323433Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:48.0325182Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:48.0327192Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-11T01:38:48.0328590Z [cluster2] node/cluster2-worker not labeled
2021-07-11T01:38:48.0355720Z [submariner-operator]$ [cluster2] wait 8671
2021-07-11T01:38:48.0370829Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-11T01:38:48.0384782Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-11T01:38:48.0401811Z [submariner-operator]$ [cluster1] setup_broker
2021-07-11T01:38:48.0417820Z [submariner-operator]$ [cluster1] setup_broker
2021-07-11T01:38:48.0425530Z Installing broker...
2021-07-11T01:38:48.0440037Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-11T01:38:48.0456773Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-11T01:38:48.0478815Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-11T01:38:48.0495803Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-11T01:38:48.0732982Z • Setting up broker RBAC ...
2021-07-11T01:38:48.1638401Z ✓ Setting up broker RBAC
2021-07-11T01:38:48.1639315Z • Deploying the Submariner operator ...
2021-07-11T01:38:54.3669105Z ✓ Deploying the Submariner operator
2021-07-11T01:38:54.3671133Z ✓ Created operator service account and role
2021-07-11T01:38:54.3672297Z ✓ Created Lighthouse service accounts and roles
2021-07-11T01:38:54.3673349Z • Deploying the broker ...
2021-07-11T01:38:55.4104566Z ✓ Deploying the broker
2021-07-11T01:38:55.4105355Z ✓ The broker has been deployed
2021-07-11T01:38:55.4106169Z • Creating broker-info.subm file ...
2021-07-11T01:38:55.4320910Z ✓ Creating broker-info.subm file
2021-07-11T01:38:55.4322171Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-11T01_38_55Z
2021-07-11T01:38:55.4330392Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-11T01:38:55.4377538Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-11T01:38:55.4392822Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-11T01:38:55.4405755Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-11T01:38:55.4418542Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-11T01:38:55.4458286Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-11T01:38:55.4520038Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-11T01:38:55.4537956Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-11T01:38:55.4549968Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:38:55.4612615Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:38:55.4652154Z [submariner-operator]$ [cluster1] pids[cluster1]=8735
2021-07-11T01:38:55.4671208Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:38:55.4697894Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-11T01:38:55.4709250Z [submariner-operator]$ [cluster2] pids[cluster2]=8737
2021-07-11T01:38:55.4731160Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:38:55.4757293Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:38:55.4761201Z [submariner-operator]$ [cluster2] wait 8737
2021-07-11T01:38:55.4799552Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-11T01:38:55.4858981Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:39:15.8666968Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-11T01:39:15.8669631Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-11T01:39:15.8671201Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-11T01:39:15.8672489Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-11T01:39:15.8675656Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-11T01:39:15.8679172Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-11T01:39:15.8680405Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-11T01:39:15.8681263Z [cluster1] - cluster1-worker
2021-07-11T01:39:15.8682123Z [cluster1] • Discovering network details ...
2021-07-11T01:39:15.8682977Z [cluster1] Network plugin: weave-net
2021-07-11T01:39:15.8683604Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-11T01:39:15.8684198Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-11T01:39:15.8685006Z [cluster1] ✓ Discovering network details
2021-07-11T01:39:15.8685891Z [cluster1] • Discovering multi cluster details ...
2021-07-11T01:39:15.8686829Z [cluster1] • Validating Globalnet configurations ...
2021-07-11T01:39:15.8687802Z [cluster1] ✓ Validating Globalnet configurations
2021-07-11T01:39:15.8688712Z [cluster1] ✓ Discovering multi cluster details
2021-07-11T01:39:15.8689620Z [cluster1] • Deploying the Submariner operator ...
2021-07-11T01:39:15.8690530Z [cluster1] ✓ Deploying the Submariner operator
2021-07-11T01:39:15.8691504Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-11T01:39:15.8692395Z [cluster1] • Creating SA for cluster ...
2021-07-11T01:39:15.8693150Z [cluster1] ✓ Creating SA for cluster
2021-07-11T01:39:15.8693935Z [cluster1] • Deploying Submariner ...
2021-07-11T01:39:15.8694709Z [cluster1] ✓ Deploying Submariner
2021-07-11T01:39:15.8695509Z [cluster1] ✓ Submariner is up and running
2021-07-11T01:39:20.3657752Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-11T01:39:20.3659173Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-11T01:39:20.3660477Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-11T01:39:20.3661752Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-11T01:39:20.3664907Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-11T01:39:20.3668163Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.9:6443
2021-07-11T01:39:20.3669382Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-11T01:39:20.3670350Z [cluster2] - cluster2-worker
2021-07-11T01:39:20.3671217Z [cluster2] • Discovering network details ...
2021-07-11T01:39:20.3672051Z [cluster2] Network plugin: weave-net
2021-07-11T01:39:20.3672690Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-11T01:39:20.3673285Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-11T01:39:20.3674062Z [cluster2] ✓ Discovering network details
2021-07-11T01:39:20.3674955Z [cluster2] • Discovering multi cluster details ...
2021-07-11T01:39:20.3675889Z [cluster2] • Validating Globalnet configurations ...
2021-07-11T01:39:20.3676863Z [cluster2] ✓ Validating Globalnet configurations
2021-07-11T01:39:20.3677765Z [cluster2] ✓ Discovering multi cluster details
2021-07-11T01:39:20.3678665Z [cluster2] • Deploying the Submariner operator ...
2021-07-11T01:39:20.3679569Z [cluster2] ✓ Deploying the Submariner operator
2021-07-11T01:39:20.3680638Z [cluster2] ✓ Created operator service account and role
2021-07-11T01:39:20.3681633Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-11T01:39:20.3682496Z [cluster2] • Creating SA for cluster ...
2021-07-11T01:39:20.3683262Z [cluster2] ✓ Creating SA for cluster
2021-07-11T01:39:20.3684028Z [cluster2] • Deploying Submariner ...
2021-07-11T01:39:20.3684814Z [cluster2] ✓ Deploying Submariner
2021-07-11T01:39:20.3685598Z [cluster2] ✓ Submariner is up and running
2021-07-11T01:39:20.3708637Z [submariner-operator]$ [cluster2] wait 8735
2021-07-11T01:39:20.3736499Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-11T01:39:20.3758744Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-11T01:39:20.3777806Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-11T01:39:20.3795410Z [submariner-operator]$ [cluster2] with_retries
2021-07-11T01:39:20.3831902Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:39:20.3904679Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:20.3927687Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:20.3937943Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:39:20.3950811Z [submariner-operator]$ [cluster2] wait 8778
2021-07-11T01:39:20.4010546Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:20.4028065Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:39:20.6793963Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:20.6815091Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:39:20.8608363Z • ...
2021-07-11T01:39:21.0152261Z • ...
2021-07-11T01:39:21.0183004Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:39:21.0199352Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:39:27.0232618Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:39:27.0293619Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:27.0310629Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:27.0325855Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:39:27.0343233Z [submariner-operator]$ [cluster2] wait 8806
2021-07-11T01:39:27.0355072Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:27.0416469Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:39:27.2982131Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:27.3011450Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:39:27.4939971Z • ...
2021-07-11T01:39:27.5884982Z • ...
2021-07-11T01:39:27.5918248Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:39:27.5935730Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:39:33.6476740Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:39:33.6992424Z [submariner-operator]$ [cluster2] wait 8833
2021-07-11T01:39:33.7025210Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:33.7053482Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:33.7082298Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:39:33.7111766Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:33.7160811Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:39:34.1994179Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:34.2024750Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:39:34.3655131Z • ...
2021-07-11T01:39:34.6360617Z • ...
2021-07-11T01:39:34.6393685Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:39:34.6408323Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:39:40.6442608Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:39:40.6550007Z [submariner-operator]$ [cluster2] wait 8859
2021-07-11T01:39:40.6556291Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:40.6567861Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:40.6583260Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:39:40.6594623Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:40.6610400Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:39:40.7262779Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:40.7280087Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:39:40.7794648Z • ...
2021-07-11T01:39:40.7905499Z • ...
2021-07-11T01:39:40.7933038Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-11T01:39:40.7947007Z [submariner-operator]$ [cluster2] sleep 6
2021-07-11T01:39:46.7974856Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:39:46.8027166Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:46.8028265Z [submariner-operator]$ [cluster2] wait 8887
2021-07-11T01:39:46.8043755Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-11T01:39:46.8057225Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-11T01:39:46.8070554Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:46.8088306Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-11T01:39:46.8874821Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-11T01:39:46.8892437Z [submariner-operator]$ [cluster2] grep connected
2021-07-11T01:39:46.9412822Z • ...
2021-07-11T01:39:46.9451855Z • ...
2021-07-11T01:39:46.9548733Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:39:46.9549947Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 262.251µs
2021-07-11T01:39:46.9555487Z cluster2-worker cluster2 172.18.0.7 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 0s
2021-07-11T01:39:46.9569016Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:39:46.9589024Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-11T01:39:46.9608425Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-11T01:39:46.9628340Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-11T01:39:46.9655494Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-11T01:39:46.9670558Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-11T01:39:46.9690287Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-11T01:39:46.9702885Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-11T01:39:46.9722478Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-11T01:39:47.3048916Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-11T01:39:47.3113887Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-11T01:39:47.8496138Z devel: Pulling from submariner/nettest
2021-07-11T01:39:47.8497499Z 5843afab3874: Pulling fs layer
2021-07-11T01:39:47.8498261Z ef9794a0673d: Pulling fs layer
2021-07-11T01:39:47.8498794Z 25ba4020e36b: Pulling fs layer
2021-07-11T01:39:47.8534761Z a17a8e0e6e26: Pulling fs layer
2021-07-11T01:39:47.8535356Z a17a8e0e6e26: Waiting
2021-07-11T01:39:48.0280679Z 5843afab3874: Verifying Checksum
2021-07-11T01:39:48.0282039Z 5843afab3874: Download complete
2021-07-11T01:39:48.0416106Z ef9794a0673d: Verifying Checksum
2021-07-11T01:39:48.0416747Z ef9794a0673d: Download complete
2021-07-11T01:39:48.2034610Z 25ba4020e36b: Verifying Checksum
2021-07-11T01:39:48.2039882Z 25ba4020e36b: Download complete
2021-07-11T01:39:48.2451379Z a17a8e0e6e26: Verifying Checksum
2021-07-11T01:39:48.2466446Z a17a8e0e6e26: Download complete
2021-07-11T01:39:48.2565802Z 5843afab3874: Pull complete
2021-07-11T01:39:48.3839589Z ef9794a0673d: Pull complete
2021-07-11T01:39:48.8319206Z 25ba4020e36b: Pull complete
2021-07-11T01:39:48.9295849Z a17a8e0e6e26: Pull complete
2021-07-11T01:39:48.9336191Z Digest: sha256:9b34bfaaf7b52895f37cc024fffadc1b33ce966c5c0d47d735f0403a4901ffe7
2021-07-11T01:39:48.9354726Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-11T01:39:48.9392647Z quay.io/submariner/nettest:devel
2021-07-11T01:39:48.9425927Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-11T01:39:49.2971646Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-11T01:39:49.7130005Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-11T01:39:50.0495300Z The push refers to repository [localhost:5000/nettest]
2021-07-11T01:39:50.0558480Z 06472d5a3e44: Preparing
2021-07-11T01:39:50.0559088Z 9efeca3c2ccb: Preparing
2021-07-11T01:39:50.0559624Z f584ea8869ae: Preparing
2021-07-11T01:39:50.0560208Z 72e830a4dff5: Preparing
2021-07-11T01:39:50.7779752Z 06472d5a3e44: Pushed
2021-07-11T01:39:50.7836546Z f584ea8869ae: Pushed
2021-07-11T01:39:50.7839722Z 72e830a4dff5: Pushed
2021-07-11T01:39:51.5355604Z 9efeca3c2ccb: Pushed
2021-07-11T01:39:51.5608439Z local: digest: sha256:9b34bfaaf7b52895f37cc024fffadc1b33ce966c5c0d47d735f0403a4901ffe7 size: 1155
2021-07-11T01:39:51.5691915Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:39:51.5706097Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:39:51.5725077Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-11T01:39:51.5750452Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-11T01:39:51.5773558Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:39:51.5790469Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:39:51.5807426Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:39:52.1176415Z deployment.apps/netshoot created
2021-07-11T01:39:52.1288334Z Waiting for netshoot pods to be ready.
2021-07-11T01:39:52.1320431Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-11T01:39:52.1338189Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-11T01:39:52.1366815Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-11T01:39:52.4983054Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-11T01:39:54.3712859Z deployment "netshoot" successfully rolled out
2021-07-11T01:39:54.3785845Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.3801538Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.3827327Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.3862599Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-11T01:39:54.3903014Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-11T01:39:54.3921815Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-11T01:39:54.3943234Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.3957130Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.3970361Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:39:54.9597905Z deployment.apps/nginx-demo created
2021-07-11T01:39:54.9839007Z service/nginx-demo created
2021-07-11T01:39:55.0733650Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-11T01:39:55.0786318Z Waiting for nginx-demo pods to be ready.
2021-07-11T01:39:55.0803483Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:39:55.0819258Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:39:55.0866487Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-11T01:39:55.7973055Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-11T01:39:56.9798342Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-11T01:39:57.0012627Z deployment "nginx-demo" successfully rolled out
2021-07-11T01:39:57.0069916Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-11T01:39:57.0088587Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-11T01:39:57.0104687Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-11T01:39:57.0138524Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-11T01:39:57.0211820Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-11T01:39:57.3718068Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-11T01:39:57.3738990Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-11T01:39:57.3752519Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-11T01:39:57.3769427Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-11T01:39:57.3783865Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-11T01:39:57.3801578Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-11T01:39:57.3822261Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:39:57.3840862Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-11T01:39:57.3852187Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:39:57.3868735Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-11T01:39:57.7022167Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-jfkz2 100.1.187.98
2021-07-11T01:39:57.7037256Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-jfkz2 100.1.187.98
2021-07-11T01:39:57.7053398Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:39:57.7083746Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-jfkz2 100.1.187.98
2021-07-11T01:39:57.7085012Z [submariner-operator]$ [cluster2] wait 9039
2021-07-11T01:39:57.7092197Z [submariner-operator]$ [cluster2] test_connection
2021-07-11T01:39:57.7099604Z Attempting connectivity between clusters - netshoot-57677568b8-jfkz2 --> 100.1.187.98
2021-07-11T01:39:57.7112922Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-11T01:39:57.7129512Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-11T01:39:57.7145921Z [submariner-operator]$ [cluster2] date +%s
2021-07-11T01:39:57.7176076Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:39:57.7186514Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:39:57.7206641Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:40:28.1803961Z command terminated with exit code 28
2021-07-11T01:40:28.1851796Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-11T01:40:28.1872631Z [submariner-operator]$ [cluster2] date +%s
2021-07-11T01:40:28.1895284Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-11T01:40:28.1907289Z [submariner-operator]$ [cluster2] return 1
2021-07-11T01:40:28.1951001Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-jfkz2 100.1.187.98
2021-07-11T01:40:28.1953259Z [submariner-operator]$ [cluster2] wait 9062
2021-07-11T01:40:28.1968150Z [submariner-operator]$ [cluster2] test_connection
2021-07-11T01:40:28.1973566Z Attempting connectivity between clusters - netshoot-57677568b8-jfkz2 --> 100.1.187.98
2021-07-11T01:40:28.1987051Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-11T01:40:28.2000962Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-11T01:40:28.2018113Z [submariner-operator]$ [cluster2] date +%s
2021-07-11T01:40:28.2042755Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:40:28.2055544Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:40:28.2071932Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-jfkz2 -- curl --output /dev/null -m 30 --silent --head --fail 100.1.187.98
2021-07-11T01:40:28.6064548Z Connection test was successful!
2021-07-11T01:40:28.6089765Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:28.6109979Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:40:28.6128697Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:40:28.6147807Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:40:28.6227373Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:40:28.6244721Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-11T01:40:28.9492179Z deployment.apps "netshoot" deleted
2021-07-11T01:40:28.9652913Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:28.9667215Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:28.9718437Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:28.9751767Z [submariner-operator]$ [cluster1] remove_resource
2021-07-11T01:40:28.9768789Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:28.9784923Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:28.9802722Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-11T01:40:29.3318625Z deployment.apps "nginx-demo" deleted
2021-07-11T01:40:29.3878556Z service "nginx-demo" deleted
2021-07-11T01:40:29.4116735Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-11T01:40:29.4253537Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-11T01:40:29.4266184Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-11T01:40:29.4285429Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-11T01:40:29.4308271Z [submariner-operator]$ [cluster2] grep -q function
2021-07-11T01:40:29.4424532Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:29.4456844Z Successfully remade target file 'deploy'.
2021-07-11T01:40:29.4457666Z File 'e2e' does not exist.
2021-07-11T01:40:29.4458426Z Must remake target 'e2e'.
2021-07-11T01:40:29.4459109Z scripts/kind-e2e/e2e.sh
2021-07-11T01:40:29.4543454Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-11T01:40:29.4599783Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:40:29.4641647Z [submariner-operator]$ script_name=utils
2021-07-11T01:40:29.4666472Z [submariner-operator]$ exec_name=e2e.sh
2021-07-11T01:40:29.4689104Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-11T01:40:29.4705729Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:40:29.4717992Z [submariner-operator]$ script_name=deploy_funcs
2021-07-11T01:40:29.4733680Z [submariner-operator]$ exec_name=e2e.sh
2021-07-11T01:40:29.4753753Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-11T01:40:29.4821354Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:40:29.4873196Z [submariner-operator]$ script_name=deploy_operator
2021-07-11T01:40:29.4892126Z [submariner-operator]$ exec_name=e2e.sh
2021-07-11T01:40:29.4973242Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-11T01:40:29.5021983Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:40:29.5041885Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:40:29.5166808Z [submariner-operator]$ exec_name=e2e.sh
2021-07-11T01:40:29.5202412Z [submariner-operator]$ broker=cluster1
2021-07-11T01:40:29.5247125Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-11T01:40:29.5267167Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-11T01:40:29.5281967Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-11T01:40:29.5319750Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-11T01:40:29.5337039Z [submariner-operator]$ declare -gA cluster_subm
2021-07-11T01:40:29.5360438Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-11T01:40:29.5375700Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-11T01:40:29.5386696Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-11T01:40:29.5398098Z [submariner-operator]$ declare -gA cluster_cni
2021-07-11T01:40:29.5410860Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-11T01:40:29.5436984Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-11T01:40:29.5468005Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-11T01:40:29.5481291Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-11T01:40:29.5494251Z [submariner-operator]$ script_name=cluster_settings
2021-07-11T01:40:29.5521652Z [submariner-operator]$ exec_name=e2e.sh
2021-07-11T01:40:29.5566173Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-11T01:40:29.5586603Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-11T01:40:29.5618459Z [submariner-operator]$ timeout=2m
2021-07-11T01:40:29.5676730Z [submariner-operator]$ declare_kubeconfig
2021-07-11T01:40:29.5690560Z [submariner-operator]$ declare_kubeconfig
2021-07-11T01:40:29.5702898Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-11T01:40:29.5728594Z [submariner-operator]$ export KUBECONFIG
2021-07-11T01:40:29.5739580Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-11T01:40:29.5768987Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-11T01:40:29.5800336Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-11T01:40:29.5866141Z [submariner-operator]$ create_subm_vars
2021-07-11T01:40:29.5877040Z [submariner-operator]$ create_subm_vars
2021-07-11T01:40:29.5904414Z [submariner-operator]$ deployment_name=submariner
2021-07-11T01:40:29.5915650Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-11T01:40:29.5925685Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-11T01:40:29.5935848Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-11T01:40:29.5956865Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-11T01:40:29.5982455Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-11T01:40:29.6015750Z [submariner-operator]$ declare_cidrs
2021-07-11T01:40:29.6026718Z [submariner-operator]$ declare_cidrs
2021-07-11T01:40:29.6048569Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-11T01:40:29.6058757Z [submariner-operator]$ i=1
2021-07-11T01:40:29.6071678Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:40:29.6082066Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-11T01:40:29.6117582Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-11T01:40:29.6128989Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-11T01:40:29.6170557Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-11T01:40:29.6185148Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:40:29.6196043Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-11T01:40:29.6217510Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-11T01:40:29.6229198Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-11T01:40:29.6245244Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-11T01:40:29.6256326Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-11T01:40:29.6300238Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-11T01:40:29.6312787Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-11T01:40:29.6336320Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-11T01:40:29.6359427Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-11T01:40:29.6371887Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-11T01:40:29.6382231Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-11T01:40:29.6392895Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-11T01:40:29.6406996Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-11T01:40:29.6421219Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-11T01:40:29.6438112Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-11T01:40:29.6457899Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-11T01:40:29.6481245Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-11T01:40:29.6496582Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-11T01:40:29.6537009Z [submariner-operator]$ [cluster1] broker_vars
2021-07-11T01:40:29.6551710Z [submariner-operator]$ [cluster1] broker_vars
2021-07-11T01:40:29.6565101Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-11T01:40:29.6588716Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-11T01:40:29.6603352Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-11T01:40:29.6618324Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-11T01:40:30.1787985Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-11T01:40:30.1875811Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-11T01:40:30.1896067Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-11T01:40:30.1915650Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-11T01:40:30.6692233Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-11T01:40:30.6707819Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-11T01:40:30.6751736Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-11T01:40:30.6761189Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-11T01:40:30.6778993Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-11T01:40:31.7572348Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-11T01:40:31.7576452Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-11T01:40:31.7578222Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-11T01:40:31.7579643Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-11T01:40:31.8306502Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:31.9377976Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:32.0025780Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-11T01:40:32.0027255Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-11T01:40:32.0028712Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-11T01:40:32.0029988Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-11T01:40:32.0072196Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-11T01:40:32.0073865Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-11T01:40:32.0075159Z [submariner-operator]$ [cluster1] return
2021-07-11T01:40:32.0076412Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-11T01:40:32.0077849Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-11T01:40:32.0079734Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-11T01:40:32.0082229Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-11T01:40:32.0085315Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-11T01:40:32.0088584Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-11T01:40:32.0090375Z NAME TYPE DATA AGE
2021-07-11T01:40:32.0091620Z cluster-cluster1-token-cx5b4 kubernetes.io/service-account-token 3 4m41s
2021-07-11T01:40:32.0093285Z cluster-cluster2-token-cpg72 kubernetes.io/service-account-token 3 4m37s
2021-07-11T01:40:32.0094836Z default-token-cs8fh kubernetes.io/service-account-token 3 4m59s
2021-07-11T01:40:32.0096545Z submariner-k8s-broker-admin-token-xsrpt kubernetes.io/service-account-token 3 4m59s
2021-07-11T01:40:32.0098591Z submariner-k8s-broker-client-token-8tdwt kubernetes.io/service-account-token 3 4m59s
2021-07-11T01:40:32.2195660Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.2207635Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-8tdwt -n submariner-k8s-broker -o json
2021-07-11T01:40:32.2226306Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.2248411Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-8tdwt -n submariner-k8s-broker -o json
2021-07-11T01:40:32.2262638Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-8tdwt -n submariner-k8s-broker -o json
2021-07-11T01:40:32.5621710Z {
2021-07-11T01:40:32.5622340Z "apiVersion": "v1",
2021-07-11T01:40:32.5622779Z "data": {
2021-07-11T01:40:32.6273424Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-11T01:40:32.6901275Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-11T01:40:32.7417316Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNklsTkRORVJMUW1oNVpUYzBUV1ZPVVZoNFh6SjZZVzFPYTFGbU5sbzNSRzFVTFhBNGQwMWxWRlp6VUVFaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkwNGRHUjNkQ0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pT0RjMlpqazRZbVl0WWpKa1pTMDBNbU16TFdJek5UTXRZV1EyWW1abU5XVTROR0k1SWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLlBhNEpGVk1hNU55WnhFR0NfY0FXRGNwV0d2QU1BNEFqVTlLd01rUm5JcWNuNHJEbTZQWTRzeWNkcEZrS2I4aTdVX2U3M2xJXzI0SGZhU0t4akdvTXd2MkplMXhfd1RvTFlKUFByMXlCUDVwZVpPYnc5ZERVNFJnelJlMVNtQmN1Yk02dW1KVFVkeTFDNVpJV3JLUk0tSTFqS0tBMW8wWi02MEwwZTJMUWNDTHN6c2FHV2trTTdEbURCTnJqVjdDaTZMNS12MzhnX1ZtaEE5WXg1M085NDZ3NnJjZDBGMkRoakpXYmdhNy1jYVlOOUxKSElUdU9PeUlOOFZOcEExMGNrVklrOHdLaUxZc2U2N0RsU2NiQmNhcTNOUFVNbWFWNGJVVm56cEltYkRNNzVkNEJuaXN0Zk14SnU2d3FMTXc4WTVrUF93Ykg4UzFyY0J4Z2FXY2lmdw=="
2021-07-11T01:40:32.7941154Z },
2021-07-11T01:40:32.7941578Z "kind": "Secret",
2021-07-11T01:40:32.7942350Z "metadata": {
2021-07-11T01:40:32.7942802Z "annotations": {
2021-07-11T01:40:32.7944391Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-11T01:40:32.7945958Z "kubernetes.io/service-account.uid": "876f98bf-b2de-42c3-b353-ad6bff5e84b9"
2021-07-11T01:40:32.7946760Z },
2021-07-11T01:40:32.7947463Z "creationTimestamp": "2021-07-11T01:35:32Z",
2021-07-11T01:40:32.7948051Z "managedFields": [
2021-07-11T01:40:32.7948499Z {
2021-07-11T01:40:32.7948915Z "apiVersion": "v1",
2021-07-11T01:40:32.7949454Z "fieldsType": "FieldsV1",
2021-07-11T01:40:32.7949951Z "fieldsV1": {
2021-07-11T01:40:32.7950563Z "f:data": {
2021-07-11T01:40:32.7950952Z ".": {},
2021-07-11T01:40:32.7951370Z "f:ca.crt": {},
2021-07-11T01:40:32.7951843Z "f:namespace": {},
2021-07-11T01:40:32.7952296Z "f:token": {}
2021-07-11T01:40:32.7952705Z },
2021-07-11T01:40:32.7953114Z "f:metadata": {
2021-07-11T01:40:32.7953603Z "f:annotations": {
2021-07-11T01:40:32.7954040Z ".": {},
2021-07-11T01:40:32.7954908Z "f:kubernetes.io/service-account.name": {},
2021-07-11T01:40:32.7955942Z "f:kubernetes.io/service-account.uid": {}
2021-07-11T01:40:32.7956555Z }
2021-07-11T01:40:32.7956915Z },
2021-07-11T01:40:32.7957312Z "f:type": {}
2021-07-11T01:40:32.7957683Z },
2021-07-11T01:40:32.7958449Z "manager": "kube-controller-manager",
2021-07-11T01:40:32.7959133Z "operation": "Update",
2021-07-11T01:40:32.7959784Z "time": "2021-07-11T01:35:32Z"
2021-07-11T01:40:32.7960226Z }
2021-07-11T01:40:32.7960564Z ],
2021-07-11T01:40:32.7961608Z "name": "submariner-k8s-broker-client-token-8tdwt",
2021-07-11T01:40:32.7962827Z "namespace": "submariner-k8s-broker",
2021-07-11T01:40:32.7963514Z "resourceVersion": "1215",
2021-07-11T01:40:32.7964403Z "uid": "c601be3e-759f-4c71-adde-b7c92d33bbe1"
2021-07-11T01:40:32.7965003Z },
2021-07-11T01:40:32.7965774Z "type": "kubernetes.io/service-account-token"
2021-07-11T01:40:32.7966387Z }
2021-07-11T01:40:32.7967495Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-11T01:40:32.7968675Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-11T01:40:32.7970654Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.7972809Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-11T01:40:32.7974467Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-11T01:40:32.7976661Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.7979115Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-8tdwt
2021-07-11T01:40:32.7981352Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-8tdwt
2021-07-11T01:40:32.7983893Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.7986143Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-11T01:40:32.7988142Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-11T01:40:32.7990627Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.7993622Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-8tdwt.cluster1.json
2021-07-11T01:40:32.8072603Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-11T01:40:32.8091136Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-11T01:40:32.8107187Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-11T01:40:32.8121402Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-11T01:40:32.8160464Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-11T01:40:32.8175199Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-11T01:40:32.8190996Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-11T01:40:32.8213151Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-11T01:40:32.8240132Z [submariner-operator]$ [cluster1] pids[cluster1]=9311
2021-07-11T01:40:32.8246863Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-11T01:40:32.8266131Z [submariner-operator]$ [cluster2] pids[cluster2]=9314
2021-07-11T01:40:32.8275240Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-11T01:40:32.8286345Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-11T01:40:32.8295453Z [submariner-operator]$ [cluster2] wait 9314
2021-07-11T01:40:32.8304280Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-11T01:40:32.8310697Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-11T01:40:32.8340050Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-11T01:40:33.8440121Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-11T01:40:33.8441430Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-11T01:40:33.8442576Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-11T01:40:33.8443901Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-11T01:40:33.8445446Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-11T01:40:33.8446922Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-11T01:40:33.8448633Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-11T01:40:33.8450276Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-11T01:40:33.8451314Z [cluster1] NAME CREATED AT
2021-07-11T01:40:33.8452246Z [cluster1] endpoints.submariner.io 2021-07-11T01:35:43Z
2021-07-11T01:40:33.8453748Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:33.8455471Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8457110Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8458788Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:33.8460623Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8461587Z [cluster1] {
2021-07-11T01:40:33.8462257Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:33.8463141Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-11T01:40:33.8463858Z [cluster1] "metadata": {
2021-07-11T01:40:33.8464382Z [cluster1] "annotations": {
2021-07-11T01:40:33.8465431Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:33.8466189Z [cluster1] },
2021-07-11T01:40:33.8466980Z [cluster1] "creationTimestamp": "2021-07-11T01:35:43Z",
2021-07-11T01:40:33.8467754Z [cluster1] "generation": 1,
2021-07-11T01:40:33.8468339Z [cluster1] "managedFields": [
2021-07-11T01:40:33.8468864Z [cluster1] {
2021-07-11T01:40:33.8469528Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:33.8470544Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:33.8471133Z [cluster1] "fieldsV1": {
2021-07-11T01:40:33.8471686Z [cluster1] "f:metadata": {
2021-07-11T01:40:33.8472250Z [cluster1] "f:annotations": {
2021-07-11T01:40:33.8472789Z [cluster1] ".": {},
2021-07-11T01:40:33.8473816Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:33.8474606Z [cluster1] }
2021-07-11T01:40:33.8475051Z [cluster1] },
2021-07-11T01:40:33.8475537Z [cluster1] "f:spec": {
2021-07-11T01:40:33.8476094Z [cluster1] "f:conversion": {
2021-07-11T01:40:33.8476610Z [cluster1] ".": {},
2021-07-11T01:40:33.8477134Z [cluster1] "f:strategy": {}
2021-07-11T01:40:33.8477629Z [cluster1] },
2021-07-11T01:40:33.8478126Z [cluster1] "f:group": {},
2021-07-11T01:40:33.8478635Z [cluster1] "f:names": {
2021-07-11T01:40:33.8479160Z [cluster1] "f:kind": {},
2021-07-11T01:40:33.8479694Z [cluster1] "f:listKind": {},
2021-07-11T01:40:33.8480251Z [cluster1] "f:plural": {},
2021-07-11T01:40:33.8480809Z [cluster1] "f:singular": {}
2021-07-11T01:40:33.8481303Z [cluster1] },
2021-07-11T01:40:33.8481801Z [cluster1] "f:scope": {},
2021-07-11T01:40:33.8482328Z [cluster1] "f:versions": {}
2021-07-11T01:40:33.8482839Z [cluster1] },
2021-07-11T01:40:33.8483313Z [cluster1] "f:status": {
2021-07-11T01:40:33.8483903Z [cluster1] "f:acceptedNames": {
2021-07-11T01:40:33.8484473Z [cluster1] "f:kind": {},
2021-07-11T01:40:33.8485004Z [cluster1] "f:plural": {}
2021-07-11T01:40:33.8485492Z [cluster1] },
2021-07-11T01:40:33.8486118Z [cluster1] "f:conditions": {},
2021-07-11T01:40:33.8486752Z [cluster1] "f:storedVersions": {}
2021-07-11T01:40:33.8487295Z [cluster1] }
2021-07-11T01:40:33.8487747Z [cluster1] },
2021-07-11T01:40:33.8488591Z [cluster1] "manager": "submariner-operator",
2021-07-11T01:40:33.8489316Z [cluster1] "operation": "Update",
2021-07-11T01:40:33.8490073Z [cluster1] "time": "2021-07-11T01:35:50Z"
2021-07-11T01:40:33.8490575Z [cluster1] }
2021-07-11T01:40:33.8490996Z [cluster1] ],
2021-07-11T01:40:33.8491653Z [cluster1] "name": "endpoints.submariner.io",
2021-07-11T01:40:33.8492410Z [cluster1] "resourceVersion": "1404",
2021-07-11T01:40:33.8493349Z [cluster1] "uid": "65a4ecfa-8335-42b8-9906-64320f10972b"
2021-07-11T01:40:33.8493966Z [cluster1] },
2021-07-11T01:40:33.8494401Z [cluster1] "spec": {
2021-07-11T01:40:33.8495068Z [cluster1] "conversion": {
2021-07-11T01:40:33.8495626Z [cluster1] "strategy": "None"
2021-07-11T01:40:33.8496221Z [cluster1] },
2021-07-11T01:40:33.8496853Z [cluster1] "group": "submariner.io",
2021-07-11T01:40:33.8497416Z [cluster1] "names": {
2021-07-11T01:40:33.8497930Z [cluster1] "kind": "Endpoint",
2021-07-11T01:40:33.8498628Z [cluster1] "listKind": "EndpointList",
2021-07-11T01:40:33.8499335Z [cluster1] "plural": "endpoints",
2021-07-11T01:40:33.8500060Z [cluster1] "singular": "endpoint"
2021-07-11T01:40:33.8500567Z [cluster1] },
2021-07-11T01:40:33.8501093Z [cluster1] "scope": "Namespaced",
2021-07-11T01:40:33.8501658Z [cluster1] "versions": [
2021-07-11T01:40:33.8502123Z [cluster1] {
2021-07-11T01:40:33.8502593Z [cluster1] "name": "v1",
2021-07-11T01:40:33.8503084Z [cluster1] "schema": {
2021-07-11T01:40:33.8503688Z [cluster1] "openAPIV3Schema": {
2021-07-11T01:40:33.8504320Z [cluster1] "properties": {
2021-07-11T01:40:33.8504919Z [cluster1] "apiVersion": {
2021-07-11T01:40:33.8507432Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:33.8509378Z [cluster1] "type": "string"
2021-07-11T01:40:33.8509908Z [cluster1] },
2021-07-11T01:40:33.8546221Z [cluster1] "kind": {
2021-07-11T01:40:33.8548974Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:33.8551113Z [cluster1] "type": "string"
2021-07-11T01:40:33.8551637Z [cluster1] },
2021-07-11T01:40:33.8552164Z [cluster1] "metadata": {
2021-07-11T01:40:33.8552850Z [cluster1] "type": "object"
2021-07-11T01:40:33.8553355Z [cluster1] },
2021-07-11T01:40:33.8553865Z [cluster1] "spec": {
2021-07-11T01:40:33.8554418Z [cluster1] "properties": {
2021-07-11T01:40:33.8555003Z [cluster1] "backend": {
2021-07-11T01:40:33.8555560Z [cluster1] "type": "string"
2021-07-11T01:40:33.8556102Z [cluster1] },
2021-07-11T01:40:33.8556832Z [cluster1] "backend_config": {
2021-07-11T01:40:33.8557574Z [cluster1] "additionalProperties": {
2021-07-11T01:40:33.8558290Z [cluster1] "type": "string"
2021-07-11T01:40:33.8558818Z [cluster1] },
2021-07-11T01:40:33.8559365Z [cluster1] "type": "object"
2021-07-11T01:40:33.8559888Z [cluster1] },
2021-07-11T01:40:33.8560429Z [cluster1] "cable_name": {
2021-07-11T01:40:33.8560990Z [cluster1] "type": "string"
2021-07-11T01:40:33.8561521Z [cluster1] },
2021-07-11T01:40:33.8562039Z [cluster1] "cluster_id": {
2021-07-11T01:40:33.8562623Z [cluster1] "type": "string"
2021-07-11T01:40:33.8563158Z [cluster1] },
2021-07-11T01:40:33.8563728Z [cluster1] "healthCheckIP": {
2021-07-11T01:40:33.8564359Z [cluster1] "type": "string"
2021-07-11T01:40:33.8564877Z [cluster1] },
2021-07-11T01:40:33.8565408Z [cluster1] "hostname": {
2021-07-11T01:40:33.8565973Z [cluster1] "type": "string"
2021-07-11T01:40:33.8566515Z [cluster1] },
2021-07-11T01:40:33.8567140Z [cluster1] "nat_enabled": {
2021-07-11T01:40:33.8567724Z [cluster1] "type": "boolean"
2021-07-11T01:40:33.8568264Z [cluster1] },
2021-07-11T01:40:33.8568786Z [cluster1] "private_ip": {
2021-07-11T01:40:33.8569369Z [cluster1] "type": "string"
2021-07-11T01:40:33.8569894Z [cluster1] },
2021-07-11T01:40:33.8570419Z [cluster1] "public_ip": {
2021-07-11T01:40:33.8570982Z [cluster1] "type": "string"
2021-07-11T01:40:33.8571630Z [cluster1] },
2021-07-11T01:40:33.8572153Z [cluster1] "subnets": {
2021-07-11T01:40:33.8572694Z [cluster1] "items": {
2021-07-11T01:40:33.8573265Z [cluster1] "type": "string"
2021-07-11T01:40:33.8573793Z [cluster1] },
2021-07-11T01:40:33.8574334Z [cluster1] "type": "array"
2021-07-11T01:40:33.8574852Z [cluster1] }
2021-07-11T01:40:33.8575336Z [cluster1] },
2021-07-11T01:40:33.8575843Z [cluster1] "required": [
2021-07-11T01:40:33.8576411Z [cluster1] "backend",
2021-07-11T01:40:33.8576971Z [cluster1] "cable_name",
2021-07-11T01:40:33.8577530Z [cluster1] "cluster_id",
2021-07-11T01:40:33.8756075Z [cluster1] [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-11T01:40:33.8757411Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-11T01:40:33.8758534Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-11T01:40:33.8759881Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-11T01:40:33.8761422Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-11T01:40:33.8762903Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-11T01:40:33.8764557Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-11T01:40:33.8766170Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-11T01:40:33.8767210Z [cluster2] NAME CREATED AT
2021-07-11T01:40:33.8768113Z [cluster2] endpoints.submariner.io 2021-07-11T01:35:53Z
2021-07-11T01:40:33.8769760Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:33.8771486Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8773175Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:33.8774966Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8776602Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-11T01:40:33.8777578Z [cluster2] {
2021-07-11T01:40:33.8778246Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:33.8779229Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-11T01:40:33.8779946Z [cluster2] "metadata": {
2021-07-11T01:40:33.8780469Z [cluster2] "annotations": {
2021-07-11T01:40:33.8781526Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:33.8782292Z [cluster2] },
2021-07-11T01:40:33.8783083Z [cluster2] "creationTimestamp": "2021-07-11T01:35:53Z",
2021-07-11T01:40:33.8783837Z [cluster2] "generation": 1,
2021-07-11T01:40:33.8784424Z [cluster2] "managedFields": [
2021-07-11T01:40:33.8784933Z [cluster2] {
2021-07-11T01:40:33.8785608Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:33.8786394Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:33.8786982Z [cluster2] "fieldsV1": {
2021-07-11T01:40:33.8787533Z [cluster2] "f:metadata": {
2021-07-11T01:40:33.8788100Z [cluster2] "f:annotations": {
2021-07-11T01:40:33.8788641Z [cluster2] ".": {},
2021-07-11T01:40:33.8789653Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:33.8790586Z [cluster2] }
2021-07-11T01:40:33.8791034Z [cluster2] },
2021-07-11T01:40:33.8791523Z [cluster2] "f:spec": {
2021-07-11T01:40:33.8792066Z [cluster2] "f:conversion": {
2021-07-11T01:40:33.8792604Z [cluster2] ".": {},
2021-07-11T01:40:33.8793132Z [cluster2] "f:strategy": {}
2021-07-11T01:40:33.8793633Z [cluster2] },
2021-07-11T01:40:33.8794161Z [cluster2] "f:group": {},
2021-07-11T01:40:33.8794669Z [cluster2] "f:names": {
2021-07-11T01:40:33.8795190Z [cluster2] "f:kind": {},
2021-07-11T01:40:33.8795731Z [cluster2] "f:listKind": {},
2021-07-11T01:40:33.8796294Z [cluster2] "f:plural": {},
2021-07-11T01:40:33.8796840Z [cluster2] "f:singular": {}
2021-07-11T01:40:33.8797345Z [cluster2] },
2021-07-11T01:40:33.8797845Z [cluster2] "f:scope": {},
2021-07-11T01:40:33.8798376Z [cluster2] "f:versions": {}
2021-07-11T01:40:33.8798887Z [cluster2] },
2021-07-11T01:40:33.8799364Z [cluster2] "f:status": {
2021-07-11T01:40:33.8799959Z [cluster2] "f:acceptedNames": {
2021-07-11T01:40:33.8800536Z [cluster2] "f:kind": {},
2021-07-11T01:40:33.8801063Z [cluster2] "f:plural": {}
2021-07-11T01:40:33.8801548Z [cluster2] },
2021-07-11T01:40:33.8802082Z [cluster2] "f:conditions": {},
2021-07-11T01:40:33.8802788Z [cluster2] "f:storedVersions": {}
2021-07-11T01:40:33.8803356Z [cluster2] }
2021-07-11T01:40:33.8803805Z [cluster2] },
2021-07-11T01:40:33.8804656Z [cluster2] "manager": "submariner-operator",
2021-07-11T01:40:33.8805383Z [cluster2] "operation": "Update",
2021-07-11T01:40:33.8806135Z [cluster2] "time": "2021-07-11T01:36:01Z"
2021-07-11T01:40:33.8806627Z [cluster2] }
2021-07-11T01:40:33.8807056Z [cluster2] ],
2021-07-11T01:40:33.8807714Z [cluster2] "name": "endpoints.submariner.io",
2021-07-11T01:40:33.8808473Z [cluster2] "resourceVersion": "1380",
2021-07-11T01:40:33.8809447Z [cluster2] "uid": "db3b38da-7780-456a-8a98-03fad30d9843"
2021-07-11T01:40:33.8810089Z [cluster2] },
2021-07-11T01:40:33.8810543Z [cluster2] "spec": {
2021-07-11T01:40:33.8811057Z [cluster2] "conversion": {
2021-07-11T01:40:33.8811604Z [cluster2] "strategy": "None"
2021-07-11T01:40:33.8812105Z [cluster2] },
2021-07-11T01:40:33.8812638Z [cluster2] "group": "submariner.io",
2021-07-11T01:40:33.8813201Z [cluster2] "names": {
2021-07-11T01:40:33.8813715Z [cluster2] "kind": "Endpoint",
2021-07-11T01:40:33.8814351Z [cluster2] "listKind": "EndpointList",
2021-07-11T01:40:33.8814986Z [cluster2] "plural": "endpoints",
2021-07-11T01:40:33.8815602Z [cluster2] "singular": "endpoint"
2021-07-11T01:40:33.8816209Z [cluster2] },
2021-07-11T01:40:33.8816735Z [cluster2] "scope": "Namespaced",
2021-07-11T01:40:33.8817294Z [cluster2] "versions": [
2021-07-11T01:40:33.8817776Z [cluster2] {
2021-07-11T01:40:33.8818251Z [cluster2] "name": "v1",
2021-07-11T01:40:33.8818744Z [cluster2] "schema": {
2021-07-11T01:40:33.8819346Z [cluster2] "openAPIV3Schema": {
2021-07-11T01:40:33.8819977Z [cluster2] "properties": {
2021-07-11T01:40:33.8820577Z [cluster2] "apiVersion": {
2021-07-11T01:40:33.8823058Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:33.8825145Z [cluster2] "type": "string"
2021-07-11T01:40:33.8825674Z [cluster2] },
2021-07-11T01:40:33.8826154Z [cluster2] "kind": {
2021-07-11T01:40:33.8828654Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:33.8845288Z [cluster2] "type": "string"
2021-07-11T01:40:33.8845842Z [cluster2] },
2021-07-11T01:40:33.8846372Z [cluster2] "metadata": {
2021-07-11T01:40:33.8846939Z [cluster2] "type": "object"
2021-07-11T01:40:33.8847463Z [cluster2] },
2021-07-11T01:40:33.8848059Z [cluster2] "spec": {
2021-07-11T01:40:33.8848620Z [cluster2] "properties": {
2021-07-11T01:40:33.8849244Z [cluster2] "backend": {
2021-07-11T01:40:33.8849808Z [cluster2] "type": "string"
2021-07-11T01:40:33.8850426Z [cluster2] },
2021-07-11T01:40:33.8851012Z [cluster2] "backend_config": {
2021-07-11T01:40:33.8852012Z [cluster2] "additionalProperties": {
2021-07-11T01:40:33.8852777Z [cluster2] "type": "string"
2021-07-11T01:40:33.8853498Z [cluster2] },
2021-07-11T01:40:33.8854310Z [cluster2] "type": "object"
2021-07-11T01:40:33.8854882Z [cluster2] },
2021-07-11T01:40:33.8855505Z [cluster2] "cable_name": {
2021-07-11T01:40:33.8856122Z [cluster2] "type": "string"
2021-07-11T01:40:33.8856745Z [cluster2] },
2021-07-11T01:40:33.8857336Z [cluster2] "cluster_id": {
2021-07-11T01:40:33.8858000Z [cluster2] "type": "string"
2021-07-11T01:40:33.8858580Z [cluster2] },
2021-07-11T01:40:33.8859254Z [cluster2] "healthCheckIP": {
2021-07-11T01:40:33.8859968Z [cluster2] "type": "string"
2021-07-11T01:40:33.8860546Z [cluster2] },
2021-07-11T01:40:33.9002908Z [cluster2] "hostname": {
2021-07-11T01:40:33.9003621Z [cluster2] "type": "string"
2021-07-11T01:40:33.9004175Z [cluster2] },
2021-07-11T01:40:33.9004904Z [cluster2] "nat_enabled": {
2021-07-11T01:40:33.9005501Z [cluster2] "type": "boolean"
2021-07-11T01:40:33.9006037Z [cluster2] },
2021-07-11T01:40:33.9006560Z [cluster2] "private_ip": {
2021-07-11T01:40:33.9007148Z [cluster2] "type": "string"
2021-07-11T01:40:33.9007672Z [cluster2] },
2021-07-11T01:40:33.9008200Z [cluster2] "public_ip": {
2021-07-11T01:40:33.9008763Z [cluster2] "type": "string"
2021-07-11T01:40:33.9009293Z [cluster2] },
2021-07-11T01:40:33.9009806Z [cluster2] "subnets": {
2021-07-11T01:40:33.9010359Z [cluster2] "items": {
2021-07-11T01:40:33.9010932Z [cluster2] "type": "string"
2021-07-11T01:40:33.9011468Z [cluster2] },
2021-07-11T01:40:33.9012001Z [cluster2] "type": "array"
2021-07-11T01:40:33.9012511Z [cluster2] }
2021-07-11T01:40:33.9012985Z [cluster2] },
2021-07-11T01:40:33.9013489Z [cluster2] "required": [
2021-07-11T01:40:33.9014055Z [cluster2] "backend",
2021-07-11T01:40:33.9014603Z [cluster2] "cable_name",
2021-07-11T01:40:33.9015179Z [cluster2] "cluster_id",
2021-07-11T01:40:34.5887437Z [cluster2] "hostname",
2021-07-11T01:40:34.5888179Z [cluster1] "nat_enabled",
2021-07-11T01:40:34.5888768Z [cluster1] "private_ip",
2021-07-11T01:40:34.5889390Z [cluster1] "public_ip",
2021-07-11T01:40:34.5889943Z [cluster1] "subnets"
2021-07-11T01:40:34.5890461Z [cluster1] ],
2021-07-11T01:40:34.5890986Z [cluster1] "type": "object"
2021-07-11T01:40:34.5891513Z [cluster1] }
2021-07-11T01:40:34.5891967Z [cluster1] },
2021-07-11T01:40:34.5892739Z [cluster1] "required": [
2021-07-11T01:40:34.5893288Z [cluster1] "spec"
2021-07-11T01:40:34.5893761Z [cluster1] ],
2021-07-11T01:40:34.5894283Z [cluster1] "type": "object"
2021-07-11T01:40:34.5894778Z [cluster1] }
2021-07-11T01:40:34.5895235Z [cluster1] },
2021-07-11T01:40:34.5895729Z [cluster1] "served": true,
2021-07-11T01:40:34.5896286Z [cluster1] "storage": true
2021-07-11T01:40:34.5896772Z [cluster1] }
2021-07-11T01:40:34.5897212Z [cluster1] ]
2021-07-11T01:40:34.5897634Z [cluster1] },
2021-07-11T01:40:34.5898094Z [cluster1] "status": {
2021-07-11T01:40:34.5898638Z [cluster1] "acceptedNames": {
2021-07-11T01:40:34.5899241Z [cluster1] "kind": "Endpoint",
2021-07-11T01:40:34.5899873Z [cluster1] "listKind": "EndpointList",
2021-07-11T01:40:34.5900516Z [cluster1] "plural": "endpoints",
2021-07-11T01:40:34.5901141Z [cluster1] "singular": "endpoint"
2021-07-11T01:40:34.5901650Z [cluster1] },
2021-07-11T01:40:34.5902144Z [cluster1] "conditions": [
2021-07-11T01:40:34.5902627Z [cluster1] {
2021-07-11T01:40:34.5907540Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:34.5908284Z [cluster1] "message": "no conflicts found",
2021-07-11T01:40:34.5908949Z [cluster1] "reason": "NoConflicts",
2021-07-11T01:40:34.5909699Z [cluster1] "status": "True",
2021-07-11T01:40:34.5910709Z [cluster1] "type": "NamesAccepted"
2021-07-11T01:40:34.5911272Z [cluster1] },
2021-07-11T01:40:34.5911702Z [cluster1] {
2021-07-11T01:40:34.5912592Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:34.5913397Z [cluster1] "message": "the initial names have been accepted",
2021-07-11T01:40:34.5914265Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-11T01:40:34.5914957Z [cluster1] "status": "True",
2021-07-11T01:40:34.5915551Z [cluster1] "type": "Established"
2021-07-11T01:40:34.5916071Z [cluster1] }
2021-07-11T01:40:34.5916510Z [cluster1] ],
2021-07-11T01:40:34.5917035Z [cluster1] "storedVersions": [
2021-07-11T01:40:34.5917578Z [cluster1] "v1"
2021-07-11T01:40:34.5918021Z [cluster1] ]
2021-07-11T01:40:34.5918441Z [cluster1] }
2021-07-11T01:40:34.5918867Z [cluster1] }
2021-07-11T01:40:34.5920019Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-11T01:40:34.5921873Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-11T01:40:34.5923776Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:34.5925464Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:34.5926796Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:34.5928483Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:34.5930148Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:34.5931508Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:34.5933215Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:34.5934900Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-11T01:40:34.5936243Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-11T01:40:34.5938000Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:34.5940202Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-11T01:40:34.5941856Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-11T01:40:34.5943889Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-11T01:40:34.5945572Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-11T01:40:34.5946664Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-11T01:40:34.5947972Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-11T01:40:34.5949441Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-11T01:40:34.5966144Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-11T01:40:34.5968112Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-11T01:40:34.5969733Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-11T01:40:34.5970753Z [cluster1] NAME CREATED AT
2021-07-11T01:40:34.7208658Z [cluster1] clusters.submariner.io 20 "hostname",
2021-07-11T01:40:34.7209591Z [cluster2] "nat_enabled",
2021-07-11T01:40:34.7210196Z [cluster2] "private_ip",
2021-07-11T01:40:34.7211026Z [cluster2] "public_ip",
2021-07-11T01:40:34.7211597Z [cluster2] "subnets"
2021-07-11T01:40:34.7212107Z [cluster2] ],
2021-07-11T01:40:34.7212649Z [cluster2] "type": "object"
2021-07-11T01:40:34.7213183Z [cluster2] }
2021-07-11T01:40:34.7213644Z [cluster2] },
2021-07-11T01:40:34.7214174Z [cluster2] "required": [
2021-07-11T01:40:34.7214696Z [cluster2] "spec"
2021-07-11T01:40:34.7215183Z [cluster2] ],
2021-07-11T01:40:34.7215689Z [cluster2] "type": "object"
2021-07-11T01:40:34.7216205Z [cluster2] }
2021-07-11T01:40:34.7216648Z [cluster2] },
2021-07-11T01:40:34.7217162Z [cluster2] "served": true,
2021-07-11T01:40:34.7217705Z [cluster2] "storage": true
2021-07-11T01:40:34.7218211Z [cluster2] }
2021-07-11T01:40:34.7218648Z [cluster2] ]
2021-07-11T01:40:34.7219065Z [cluster2] },
2021-07-11T01:40:34.7219526Z [cluster2] "status": {
2021-07-11T01:40:34.7220071Z [cluster2] "acceptedNames": {
2021-07-11T01:40:34.7220673Z [cluster2] "kind": "Endpoint",
2021-07-11T01:40:34.7221289Z [cluster2] "listKind": "EndpointList",
2021-07-11T01:40:34.7221946Z [cluster2] "plural": "endpoints",
2021-07-11T01:40:34.7222557Z [cluster2] "singular": "endpoint"
2021-07-11T01:40:34.7223091Z [cluster2] },
2021-07-11T01:40:34.7223572Z [cluster2] "conditions": [
2021-07-11T01:40:34.7224067Z [cluster2] {
2021-07-11T01:40:34.7225326Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:53Z",
2021-07-11T01:40:34.7226078Z [cluster2] "message": "no conflicts found",
2021-07-11T01:40:34.7226746Z [cluster2] "reason": "NoConflicts",
2021-07-11T01:40:34.7227335Z [cluster2] "status": "True",
2021-07-11T01:40:34.7227958Z [cluster2] "type": "NamesAccepted"
2021-07-11T01:40:34.7228504Z [cluster2] },
2021-07-11T01:40:34.7228950Z [cluster2] {
2021-07-11T01:40:34.7229771Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:53Z",
2021-07-11T01:40:34.7231188Z [cluster2] "message": "the initial names have been accepted",
2021-07-11T01:40:34.7232184Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-11T01:40:34.7232903Z [cluster2] "status": "True",
2021-07-11T01:40:34.7233491Z [cluster2] "type": "Established"
2021-07-11T01:40:34.7234012Z [cluster2] }
2021-07-11T01:40:34.7234457Z [cluster2] ],
2021-07-11T01:40:34.7234985Z [cluster2] "storedVersions": [
2021-07-11T01:40:34.7235529Z [cluster2] "v1"
2021-07-11T01:40:34.7235959Z [cluster2] ]
2021-07-11T01:40:34.7236402Z [cluster2] }
2021-07-11T01:40:34.7236815Z [cluster2] }
2021-07-11T01:40:34.7238028Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-11T01:40:34.7239673Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-11T01:40:34.7241555Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:34.7243245Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:34.7244552Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:34.7246242Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:34.7247914Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:34.7249275Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:34.7251078Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:34.7252771Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-11T01:40:34.7254141Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-11T01:40:34.7255888Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:34.7257748Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-11T01:40:34.7259356Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-11T01:40:34.7261366Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-11T01:40:34.7263065Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-11T01:40:34.7264138Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-11T01:40:34.7265436Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-11T01:40:34.7266912Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-11T01:40:34.7268364Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-11T01:40:34.7269773Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-11T01:40:34.7295146Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-11T01:40:34.7296209Z [cluster2] NAME CREATED AT
2021-07-11T01:40:35.0135412Z [cluster2] clusters.submariner.io 2021-07-11T01:35:43Z
2021-07-11T01:40:35.0137090Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:35.0139171Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-11T01:40:35.0140900Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:35.0143297Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-11T01:40:35.0144922Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-11T01:40:35.0145887Z [cluster1] {
2021-07-11T01:40:35.0146799Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:35.0147704Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-11T01:40:35.0148423Z [cluster1] "metadata": {
2021-07-11T01:40:35.0149046Z [cluster1] "annotations": {
2021-07-11T01:40:35.0150275Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:35.0151041Z [cluster1] },
2021-07-11T01:40:35.0151853Z [cluster1] "creationTimestamp": "2021-07-11T01:35:43Z",
2021-07-11T01:40:35.0152509Z [cluster1] "generation": 1,
2021-07-11T01:40:35.0153214Z [cluster1] "managedFields": [
2021-07-11T01:40:35.0153746Z [cluster1] {
2021-07-11T01:40:35.0154404Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:35.0155192Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:35.0155783Z [cluster1] "fieldsV1": {
2021-07-11T01:40:35.0156340Z [cluster1] "f:metadata": {
2021-07-11T01:40:35.0156912Z [cluster1] "f:annotations": {
2021-07-11T01:40:35.0157459Z [cluster1] ".": {},
2021-07-11T01:40:35.0158485Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:35.0159278Z [cluster1] }
2021-07-11T01:40:35.0159741Z [cluster1] },
2021-07-11T01:40:35.0160216Z [cluster1] "f:spec": {
2021-07-11T01:40:35.0160914Z [cluster1] "f:conversion": {
2021-07-11T01:40:35.0161435Z [cluster1] ".": {},
2021-07-11T01:40:35.0161970Z [cluster1] "f:strategy": {}
2021-07-11T01:40:35.0162473Z [cluster1] },
2021-07-11T01:40:35.0162976Z [cluster1] "f:group": {},
2021-07-11T01:40:35.0163489Z [cluster1] "f:names": {
2021-07-11T01:40:35.0164008Z [cluster1] "f:kind": {},
2021-07-11T01:40:35.0164551Z [cluster1] "f:listKind": {},
2021-07-11T01:40:35.0165116Z [cluster1] "f:plural": {},
2021-07-11T01:40:35.0165683Z [cluster1] "f:singular": {}
2021-07-11T01:40:35.0166181Z [cluster1] },
2021-07-11T01:40:35.0166680Z [cluster1] "f:scope": {},
2021-07-11T01:40:35.0167335Z [cluster1] "f:versions": {}
2021-07-11T01:40:35.0167850Z [cluster1] },
2021-07-11T01:40:35.0168326Z [cluster1] "f:status": {
2021-07-11T01:40:35.0168920Z [cluster1] "f:acceptedNames": {
2021-07-11T01:40:35.0169487Z [cluster1] "f:kind": {},
2021-07-11T01:40:35.0170019Z [cluster1] "f:plural": {}
2021-07-11T01:40:35.0170519Z [cluster1] },
2021-07-11T01:40:35.0171035Z [cluster1] "f:conditions": {},
2021-07-11T01:40:35.0171675Z [cluster1] "f:storedVersions": {}
2021-07-11T01:40:35.0172220Z [cluster1] }
2021-07-11T01:40:35.0172666Z [cluster1] },
2021-07-11T01:40:35.0173528Z [cluster1] "manager": "submariner-operator",
2021-07-11T01:40:35.0174286Z [cluster1] "operation": "Update",
2021-07-11T01:40:35.0175046Z [cluster1] "time": "2021-07-11T01:35:50Z"
2021-07-11T01:40:35.0175535Z [cluster1] }
2021-07-11T01:40:35.0175964Z [cluster1] ],
2021-07-11T01:40:35.0176604Z [cluster1] "name": "clusters.submariner.io",
2021-07-11T01:40:35.0177360Z [cluster1] "resourceVersion": "1403",
2021-07-11T01:40:35.0178336Z [cluster1] "uid": "215a01a4-8bef-4b58-a8ca-f6e63d10e085"
2021-07-11T01:40:35.0178997Z [cluster1] },
2021-07-11T01:40:35.0179441Z [cluster1] "spec": {
2021-07-11T01:40:35.0179955Z [cluster1] "conversion": {
2021-07-11T01:40:35.0180613Z [cluster1] "strategy": "None"
2021-07-11T01:40:35.0181120Z [cluster1] },
2021-07-11T01:40:35.0181653Z [cluster1] "group": "submariner.io",
2021-07-11T01:40:35.0182221Z [cluster1] "names": {
2021-07-11T01:40:35.0182727Z [cluster1] "kind": "Cluster",
2021-07-11T01:40:35.0183332Z [cluster1] "listKind": "ClusterList",
2021-07-11T01:40:35.0183947Z [cluster1] "plural": "clusters",
2021-07-11T01:40:35.0184546Z [cluster1] "singular": "cluster"
2021-07-11T01:40:35.0185066Z [cluster1] },
2021-07-11T01:40:35.0185576Z [cluster1] "scope": "Namespaced",
2021-07-11T01:40:35.0186137Z [cluster1] "versions": [
2021-07-11T01:40:35.0186604Z [cluster1] {
2021-07-11T01:40:35.0187073Z [cluster1] "name": "v1",
2021-07-11T01:40:35.0187562Z [cluster1] "schema": {
2021-07-11T01:40:35.0188162Z [cluster1] "openAPIV3Schema": {
2021-07-11T01:40:35.0188794Z [cluster1] "properties": {
2021-07-11T01:40:35.0189385Z [cluster1] "apiVersion": {
2021-07-11T01:40:35.0192131Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:35.0194266Z [cluster1] "type": "string"
2021-07-11T01:40:35.0194789Z [cluster1] },
2021-07-11T01:40:35.0195291Z [cluster1] "kind": {
2021-07-11T01:40:35.0197693Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:35.0199603Z [cluster1] "type": "string"
2021-07-11T01:40:35.0200134Z [cluster1] },
2021-07-11T01:40:35.0200644Z [cluster1] "metadata": {
2021-07-11T01:40:35.0201215Z [cluster1] "type": "object"
2021-07-11T01:40:35.0201720Z [cluster1] },
2021-07-11T01:40:35.0202221Z [cluster1] "spec": {
2021-07-11T01:40:35.0202790Z [cluster1] "properties": {
2021-07-11T01:40:35.0203377Z [cluster1] "cluster_cidr": {
2021-07-11T01:40:35.0203948Z [cluster1] "items": {
2021-07-11T01:40:35.0204512Z [cluster1] "type": "string"
2021-07-11T01:40:35.0205060Z [cluster1] },
2021-07-11T01:40:35.0205586Z [cluster1] "type": "array"
2021-07-11T01:40:35.0206116Z [cluster1] },
2021-07-11T01:40:35.0206633Z [cluster1] "cluster_id": {
2021-07-11T01:40:35.0207217Z [cluster1] "type": "string"
2021-07-11T01:40:35.0207757Z [cluster1] },
2021-07-11T01:40:35.0208269Z [cluster1] "color_codes": {
2021-07-11T01:40:35.0208832Z [cluster1] "items": {
2021-07-11T01:40:35.0209390Z [cluster1] "type": "string"
2021-07-11T01:40:35.0209939Z [cluster1] },
2021-07-11T01:40:35.0210466Z [cluster1] "type": "array"
2021-07-11T01:40:35.0210994Z [cluster1] },
2021-07-11T01:40:35.0211620Z [cluster1] "global_cidr": {
2021-07-11T01:40:35.0212171Z [cluster1] "items": {
2021-07-11T01:40:35.0212742Z [cluster1] "type": "string"
2021-07-11T01:40:35.0213286Z [cluster1] },
2021-07-11T01:40:35.0213830Z [cluster1] "type": "array"
2021-07-11T01:40:35.0214350Z [cluster1] },
2021-07-11T01:40:35.0214902Z [cluster1] "service_cidr": {
2021-07-11T01:40:35.0215470Z [cluster1] "items": {
2021-07-11T01:40:35.0216045Z [cluster1] "type": "string"
2021-07-11T01:40:35.0216594Z [cluster1] },
2021-07-11T01:40:35.0217125Z [cluster1] "type": "array"
2021-07-11T01:40:35.0217663Z [cluster1] }
2021-07-11T01:40:35.0218130Z [cluster1] },
2021-07-11T01:40:35.0218662Z [cluster1] "required": [
2021-07-11T01:40:35.0219229Z [cluster1] "cluster_cidr",
2021-07-11T01:40:35.0219805Z [cluster1] "cluster_id",
2021-07-11T01:40:35.0220364Z [cluster1] "color_codes",
2021-07-11T01:40:35.0269408Z [cluster1] "global_cidr",
2021-07-11T01:40:35.0270675Z [cluster1] "service_cidr"
2021-07-11T01:40:35.0271213Z [cluster1] ],
2021-07-11T01:40:35.0271754Z [cluster1] "type": "object"
2021-07-11T01:40:35.0272265Z [cluster1] }
2021-07-11T01:40:35.0272738Z [cluster1] },
2021-07-11T01:40:35.0273240Z [cluster1] "required": [
2021-07-11T01:40:35.0273783Z [cluster1] "spec"
2021-07-11T01:40:35.0274287Z [cluster1] ],
2021-07-11T01:40:35.0274806Z [cluster1] "type": "object"
2021-07-11T01:40:35.0275300Z [cluster1] }
2021-07-11T01:40:35.0275864Z [cluster1] },
2021-07-11T01:40:35.0276375Z [cluster1] "served": true,
2021-07-11T01:40:35.0276914Z [cluster1] "storage": true
2021-07-11T01:40:35.0277415Z [cluster1] }
2021-07-11T01:40:35.0277838Z [cluster1] ]
2021-07-11T01:40:35.0278341Z [cluster1] },
2021-07-11T01:40:35.0278790Z [cluster1] "status": {
2021-07-11T01:40:35.0279347Z [cluster1] "acceptedNames": {
2021-07-11T01:40:35.0279921Z [cluster1] "kind": "Cluster",
2021-07-11T01:40:35.0280530Z [cluster1] "listKind": "ClusterList",
2021-07-11T01:40:35.0281148Z [cluster1] "plural": "clusters",
2021-07-11T01:40:35.0281751Z [cluster1] "singular": "cluster"
2021-07-11T01:40:35.0282246Z [cluster1] },
2021-07-11T01:40:35.0282741Z [cluster1] "conditions": [
2021-07-11T01:40:35.0283237Z [cluster1] {
2021-07-11T01:40:35.0284330Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:35.0285081Z [cluster1] "message": "no conflicts found",
2021-07-11T01:40:35.0285728Z [cluster1] "reason": "NoConflicts",
2021-07-11T01:40:35.0286326Z [cluster1] "status": "True",
2021-07-11T01:40:35.0286932Z [cluster1] "type": "NamesAccepted"
2021-07-11T01:40:35.1494409Z [cluste21-07-11T01:35:53Z
2021-07-11T01:40:35.1495945Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:35.1497795Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-11T01:40:35.1499817Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-11T01:40:35.1502008Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-11T01:40:35.1504074Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:35.1505104Z [cluster2] {
2021-07-11T01:40:35.1505759Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:35.1506672Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-11T01:40:35.1507397Z [cluster2] "metadata": {
2021-07-11T01:40:35.1507941Z [cluster2] "annotations": {
2021-07-11T01:40:35.1508991Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:35.1509766Z [cluster2] },
2021-07-11T01:40:35.1511200Z [cluster2] "creationTimestamp": "2021-07-11T01:35:53Z",
2021-07-11T01:40:35.1511857Z [cluster2] "generation": 1,
2021-07-11T01:40:35.1512443Z [cluster2] "managedFields": [
2021-07-11T01:40:35.1512964Z [cluster2] {
2021-07-11T01:40:35.1513650Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:35.1514428Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:35.1515033Z [cluster2] "fieldsV1": {
2021-07-11T01:40:35.1515571Z [cluster2] "f:metadata": {
2021-07-11T01:40:35.1516148Z [cluster2] "f:annotations": {
2021-07-11T01:40:35.1516678Z [cluster2] ".": {},
2021-07-11T01:40:35.1517878Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:35.1518678Z [cluster2] }
2021-07-11T01:40:35.1519129Z [cluster2] },
2021-07-11T01:40:35.1519622Z [cluster2] "f:spec": {
2021-07-11T01:40:35.1520161Z [cluster2] "f:conversion": {
2021-07-11T01:40:35.1520701Z [cluster2] ".": {},
2021-07-11T01:40:35.1521349Z [cluster2] "f:strategy": {}
2021-07-11T01:40:35.1521868Z [cluster2] },
2021-07-11T01:40:35.1522360Z [cluster2] "f:group": {},
2021-07-11T01:40:35.1522888Z [cluster2] "f:names": {
2021-07-11T01:40:35.1523411Z [cluster2] "f:kind": {},
2021-07-11T01:40:35.1523946Z [cluster2] "f:listKind": {},
2021-07-11T01:40:35.1524517Z [cluster2] "f:plural": {},
2021-07-11T01:40:35.1525062Z [cluster2] "f:singular": {}
2021-07-11T01:40:35.1525579Z [cluster2] },
2021-07-11T01:40:35.1526069Z [cluster2] "f:scope": {},
2021-07-11T01:40:35.1526622Z [cluster2] "f:versions": {}
2021-07-11T01:40:35.1527119Z [cluster2] },
2021-07-11T01:40:35.1527604Z [cluster2] "f:status": {
2021-07-11T01:40:35.1528184Z [cluster2] "f:acceptedNames": {
2021-07-11T01:40:35.1528774Z [cluster2] "f:kind": {},
2021-07-11T01:40:35.1529317Z [cluster2] "f:plural": {}
2021-07-11T01:40:35.1529806Z [cluster2] },
2021-07-11T01:40:35.1530336Z [cluster2] "f:conditions": {},
2021-07-11T01:40:35.1530953Z [cluster2] "f:storedVersions": {}
2021-07-11T01:40:35.1531507Z [cluster2] }
2021-07-11T01:40:35.1531950Z [cluster2] },
2021-07-11T01:40:35.1532805Z [cluster2] "manager": "submariner-operator",
2021-07-11T01:40:35.1533518Z [cluster2] "operation": "Update",
2021-07-11T01:40:35.1534286Z [cluster2] "time": "2021-07-11T01:36:01Z"
2021-07-11T01:40:35.1534783Z [cluster2] }
2021-07-11T01:40:35.1535308Z [cluster2] ],
2021-07-11T01:40:35.1535958Z [cluster2] "name": "clusters.submariner.io",
2021-07-11T01:40:35.1536827Z [cluster2] "resourceVersion": "1379",
2021-07-11T01:40:35.1537815Z [cluster2] "uid": "5f5f241b-2c3d-4772-8f9d-055f8958a4af"
2021-07-11T01:40:35.1538430Z [cluster2] },
2021-07-11T01:40:35.1538886Z [cluster2] "spec": {
2021-07-11T01:40:35.1539391Z [cluster2] "conversion": {
2021-07-11T01:40:35.1539952Z [cluster2] "strategy": "None"
2021-07-11T01:40:35.1540438Z [cluster2] },
2021-07-11T01:40:35.1540985Z [cluster2] "group": "submariner.io",
2021-07-11T01:40:35.1541544Z [cluster2] "names": {
2021-07-11T01:40:35.1542067Z [cluster2] "kind": "Cluster",
2021-07-11T01:40:35.1542678Z [cluster2] "listKind": "ClusterList",
2021-07-11T01:40:35.1543291Z [cluster2] "plural": "clusters",
2021-07-11T01:40:35.1543886Z [cluster2] "singular": "cluster"
2021-07-11T01:40:35.1544383Z [cluster2] },
2021-07-11T01:40:35.1544919Z [cluster2] "scope": "Namespaced",
2021-07-11T01:40:35.1545482Z [cluster2] "versions": [
2021-07-11T01:40:35.1545966Z [cluster2] {
2021-07-11T01:40:35.1546426Z [cluster2] "name": "v1",
2021-07-11T01:40:35.1546937Z [cluster2] "schema": {
2021-07-11T01:40:35.1547531Z [cluster2] "openAPIV3Schema": {
2021-07-11T01:40:35.1548177Z [cluster2] "properties": {
2021-07-11T01:40:35.1548777Z [cluster2] "apiVersion": {
2021-07-11T01:40:35.1551698Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:35.1554000Z [cluster2] "type": "string"
2021-07-11T01:40:35.1554538Z [cluster2] },
2021-07-11T01:40:35.1555035Z [cluster2] "kind": {
2021-07-11T01:40:35.1557475Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:35.1559360Z [cluster2] "type": "string"
2021-07-11T01:40:35.1559883Z [cluster2] },
2021-07-11T01:40:35.1560409Z [cluster2] "metadata": {
2021-07-11T01:40:35.1560975Z [cluster2] "type": "object"
2021-07-11T01:40:35.1561510Z [cluster2] },
2021-07-11T01:40:35.1562012Z [cluster2] "spec": {
2021-07-11T01:40:35.1562570Z [cluster2] "properties": {
2021-07-11T01:40:35.1563179Z [cluster2] "cluster_cidr": {
2021-07-11T01:40:35.1563742Z [cluster2] "items": {
2021-07-11T01:40:35.1564315Z [cluster2] "type": "string"
2021-07-11T01:40:35.1564851Z [cluster2] },
2021-07-11T01:40:35.1565398Z [cluster2] "type": "array"
2021-07-11T01:40:35.1565934Z [cluster2] },
2021-07-11T01:40:35.1566468Z [cluster2] "cluster_id": {
2021-07-11T01:40:35.1567050Z [cluster2] "type": "string"
2021-07-11T01:40:35.1567580Z [cluster2] },
2021-07-11T01:40:35.1568126Z [cluster2] "color_codes": {
2021-07-11T01:40:35.1568679Z [cluster2] "items": {
2021-07-11T01:40:35.1569355Z [cluster2] "type": "string"
2021-07-11T01:40:35.1569900Z [cluster2] },
2021-07-11T01:40:35.1570447Z [cluster2] "type": "array"
2021-07-11T01:40:35.1570984Z [cluster2] },
2021-07-11T01:40:35.1571503Z [cluster2] "global_cidr": {
2021-07-11T01:40:35.1572062Z [cluster2] "items": {
2021-07-11T01:40:35.1572633Z [cluster2] "type": "string"
2021-07-11T01:40:35.1573183Z [cluster2] },
2021-07-11T01:40:35.1573710Z [cluster2] "type": "array"
2021-07-11T01:40:35.1574247Z [cluster2] },
2021-07-11T01:40:35.1574791Z [cluster2] "service_cidr": {
2021-07-11T01:40:35.1575350Z [cluster2] "items": {
2021-07-11T01:40:35.1575926Z [cluster2] "type": "string"
2021-07-11T01:40:35.1576461Z [cluster2] },
2021-07-11T01:40:35.1576999Z [cluster2] "type": "array"
2021-07-11T01:40:35.1577520Z [cluster2] }
2021-07-11T01:40:35.1578010Z [cluster2] },
2021-07-11T01:40:35.1578527Z [cluster2] "required": [
2021-07-11T01:40:35.1579185Z [cluster2] "cluster_cidr",
2021-07-11T01:40:35.1579762Z [cluster2] "cluster_id",
2021-07-11T01:40:35.1580327Z [cluster2] "color_codes",
2021-07-11T01:40:35.1580891Z [cluster2] "global_cidr",
2021-07-11T01:40:35.1581454Z [cluster2] "service_cidr"
2021-07-11T01:40:35.1581991Z [cluster2] ],
2021-07-11T01:40:35.1582515Z [cluster2] "type": "object"
2021-07-11T01:40:35.1583035Z [cluster2] }
2021-07-11T01:40:35.1583494Z [cluster2] },
2021-07-11T01:40:35.1584012Z [cluster2] "required": [
2021-07-11T01:40:35.1584530Z [cluster2] "spec"
2021-07-11T01:40:35.1585066Z [cluster2] ],
2021-07-11T01:40:35.1585592Z [cluster2] "type": "object"
2021-07-11T01:40:35.1586098Z [cluster2] }
2021-07-11T01:40:35.1586554Z [cluster2] },
2021-07-11T01:40:35.1587046Z [cluster2] "served": true,
2021-07-11T01:40:35.1587606Z [cluster2] "storage": true
2021-07-11T01:40:35.1588094Z [cluster2] }
2021-07-11T01:40:35.1588538Z [cluster2] ]
2021-07-11T01:40:35.1588962Z [cluster2] },
2021-07-11T01:40:35.1589421Z [cluster2] "status": {
2021-07-11T01:40:35.1589975Z [cluster2] "acceptedNames": {
2021-07-11T01:40:35.1590693Z [cluster2] "kind": "Cluster",
2021-07-11T01:40:35.1591295Z [cluster2] "listKind": "ClusterList",
2021-07-11T01:40:35.1591932Z [cluster2] "plural": "clusters",
2021-07-11T01:40:35.1592532Z [cluster2] "singular": "cluster"
2021-07-11T01:40:35.1593030Z [cluster2] },
2021-07-11T01:40:35.1593527Z [cluster2] "conditions": [
2021-07-11T01:40:35.1594016Z [cluster2] {
2021-07-11T01:40:35.1594984Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:53Z",
2021-07-11T01:40:35.1632171Z [cluster2] "message": "no conflicts found",
2021-07-11T01:40:35.1632942Z [cluster2] "reason": "NoConflicts",
2021-07-11T01:40:35.1633531Z [cluster2] "status": "True",
2021-07-11T01:40:35.1634157Z [cluster2] "type": "NamesAccepted"
2021-07-11T01:40:36.2655798Z [cluster2] },
2021-07-11T01:40:36.2656723Z [cluster2] {
2021-07-11T01:40:36.2658058Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:53Z",
2021-07-11T01:40:36.2658899Z [cluster2] "message": "the initial names have been accepted",
2021-07-11T01:40:36.2659765Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-11T01:40:36.2660465Z [cluster2] "status": "True",
2021-07-11T01:40:36.2661054Z [cluster2] "type": "Established"
2021-07-11T01:40:36.2661586Z [cluster2] }
2021-07-11T01:40:36.2662023Z [cluster2] ],
2021-07-11T01:40:36.2662542Z [cluster2] "storedVersions": [
2021-07-11T01:40:36.2663086Z [cluster2] "v1"
2021-07-11T01:40:36.2663516Z [cluster2] ]
2021-07-11T01:40:36.2663946Z [cluster2] }
2021-07-11T01:40:36.2664355Z [cluster2] }
2021-07-11T01:40:36.2665518Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-11T01:40:36.2667139Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-11T01:40:36.2668961Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:36.2671001Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:36.2672329Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:36.2673995Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:36.2675833Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:36.2677181Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:36.2678862Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:36.2680498Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-11T01:40:36.2681843Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-11T01:40:36.2683542Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:36.2685363Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-11T01:40:36.2686973Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-11T01:40:36.2688954Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-11T01:40:36.2690608Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-11T01:40:36.2691745Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-11T01:40:36.2693146Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-11T01:40:36.2694853Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-11T01:40:36.2696427Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-11T01:40:36.2697934Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-11T01:40:36.2699656Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-11T01:40:36.2700735Z [cluster2] NAME CREATED AT
2021-07-11T01:40:36.2701668Z [cluster2] submariners.submariner.io 2021-07-11T01:35:43Z
2021-07-11T01:40:36.2703253Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:36.2705030Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-11T01:40:36.2706561Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-11T01:40:36.2708359Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-11T01:40:36.2710501Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:36.2711592Z [cluster2] {
2021-07-11T01:40:36.2712242Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:36.2713148Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-11T01:40:36.2713932Z [cluster2] "metadata": {
2021-07-11T01:40:36.2714483Z [cluster2] "annotations": {
2021-07-11T01:40:36.2715594Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:36.2716356Z [cluster2] },
2021-07-11T01:40:36.2717153Z [cluster2] "creationTimestamp": "2021-07-11T01:35:43Z",
2021-07-11T01:40:36.2717802Z [cluster2] "generation": 2,
2021-07-11T01:40:36.2718390Z [cluster2] "managedFields": [
2021-07-11T01:40:36.2718902Z [cluster2] {
2021-07-11T01:40:36.2719587Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:36.2720360Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:36.2720968Z [cluster2] "fieldsV1": {
2021-07-11T01:40:36.2721507Z [cluster2] "f:metadata": {
2021-07-11T01:40:36.2722094Z [cluster2] "f:annotations": {
2021-07-11T01:40:36.2722643Z [cluster2] ".": {},
2021-07-11T01:40:36.2723798Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:36.2724631Z [cluster2] }
2021-07-11T01:40:36.2725087Z [cluster2] },
2021-07-11T01:40:36.2725592Z [cluster2] "f:spec": {
2021-07-11T01:40:36.2726149Z [cluster2] "f:conversion": {
2021-07-11T01:40:36.2726705Z [cluster2] ".": {},
2021-07-11T01:40:36.2727230Z [cluster2] "f:strategy": {}
2021-07-11T01:40:36.2727769Z [cluster2] },
2021-07-11T01:40:36.2728280Z [cluster2] "f:group": {},
2021-07-11T01:40:36.2728799Z [cluster2] "f:names": {
2021-07-11T01:40:36.2729324Z [cluster2] "f:kind": {},
2021-07-11T01:40:36.2729866Z [cluster2] "f:listKind": {},
2021-07-11T01:40:36.2730447Z [cluster2] "f:plural": {},
2021-07-11T01:40:36.2730994Z [cluster2] "f:singular": {}
2021-07-11T01:40:36.2731514Z [cluster2] },
2021-07-11T01:40:36.2732002Z [cluster2] "f:scope": {},
2021-07-11T01:40:36.2732559Z [cluster2] "f:versions": {}
2021-07-11T01:40:36.2733083Z [cluster2] },
2021-07-11T01:40:36.2733581Z [cluster2] "f:status": {
2021-07-11T01:40:36.2734315Z [cluster2] "f:acceptedNames": {
2021-07-11T01:40:36.2734897Z [cluster2] "f:kind": {},
2021-07-11T01:40:36.2735437Z [cluster2] "f:plural": {}
2021-07-11T01:40:36.2735926Z [cluster2] },
2021-07-11T01:40:36.2736460Z [cluster2] "f:conditions": {},
2021-07-11T01:40:36.2737078Z [cluster2] "f:storedVersions": {}
2021-07-11T01:40:36.2737636Z [cluster2] }
2021-07-11T01:40:36.2738078Z [cluster2] },
2021-07-11T01:40:36.2738610Z [cluster2] "manager": "subctl",
2021-07-11T01:40:36.2739212Z [cluster2] "operation": "Update",
2021-07-11T01:40:36.2740014Z [cluster2] "time": "2021-07-11T01:38:55Z"
2021-07-11T01:40:36.2740509Z [cluster2] }
2021-07-11T01:40:36.2740936Z [cluster2] ],
2021-07-11T01:40:36.2741620Z [cluster2] "name": "submariners.submariner.io",
2021-07-11T01:40:36.2742529Z [cluster2] "resourceVersion": "2032",
2021-07-11T01:40:36.2743502Z [cluster2] "uid": "f6105f9d-f17d-44f0-b501-a583410019f6"
2021-07-11T01:40:36.2744122Z [cluster2] },
2021-07-11T01:40:36.2744584Z [cluster2] "spec": {
2021-07-11T01:40:36.2745088Z [cluster2] "conversion": {
2021-07-11T01:40:36.2745650Z [cluster2] "strategy": "None"
2021-07-11T01:40:36.2746138Z [cluster2] },
2021-07-11T01:40:36.2746686Z [cluster2] "group": "submariner.io",
2021-07-11T01:40:36.2747250Z [cluster2] "names": {
2021-07-11T01:40:36.2747784Z [cluster2] "kind": "Submariner",
2021-07-11T01:40:36.2748444Z [cluster2] "listKind": "SubmarinerList",
2021-07-11T01:40:36.2749107Z [cluster2] "plural": "submariners",
2021-07-11T01:40:36.2749748Z [cluster2] "singular": "submariner"
2021-07-11T01:40:36.2816698Z [cluster2] },
2021-07-11T01:40:36.2817501Z [cluster2] "scope": "Namespaced",
2021-07-11T01:40:36.2818077Z [cluster2] "versions": [
2021-07-11T01:40:36.2818599Z [cluster2] {
2021-07-11T01:40:36.2819210Z [cluster2] "name": "v1alpha1",
2021-07-11T01:40:36.2819762Z [cluster2] "schema": {
2021-07-11T01:40:36.2820375Z [cluster2] "openAPIV3Schema": {
2021-07-11T01:40:36.2821226Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-11T01:40:36.2822518Z [cluster2] "properties": {
2021-07-11T01:40:36.2823271Z [cluster2] "apiVersion": {
2021-07-11T01:40:36.2826061Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:36.2827999Z [cluster2] "type": "string"
2021-07-11T01:40:36.2828519Z [cluster2] },
2021-07-11T01:40:36.2829018Z [cluster2] "kind": {
2021-07-11T01:40:36.2831522Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:36.2833424Z [cluster2] "type": "string"
2021-07-11T01:40:36.2833954Z [cluster2] },
2021-07-11T01:40:36.2834466Z [cluster2] "metadata": {
2021-07-11T01:40:36.2835046Z [cluster2] "type": "object"
2021-07-11T01:40:36.2835575Z [cluster2] },
2021-07-11T01:40:36.2836059Z [cluster2] "spec": {
2021-07-11T01:40:36.2836906Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-11T01:40:36.2837774Z [cluster2] "properties": {
2021-07-11T01:40:36.2838358Z [cluster2] "broker": {
2021-07-11T01:40:36.2838916Z [cluster2] "type": "string"
2021-07-11T01:40:36.2839455Z [cluster2] },
2021-07-11T01:40:36.2851571Z [cluster2] "brokerK8sApiServer": {
2021-07-11T01:40:36.2852512Z [cluster2] "type": "string"
2021-07-11T01:40:36.2853063Z [cluster2] },
2021-07-11T01:40:36.2853852Z [cluster2] "brokerK8sApiServerToken": {
2021-07-11T01:40:36.2854608Z [cluster2] "type": "string"
2021-07-11T01:40:36.2855304Z [cluster2] },
2021-07-11T01:40:36.2855878Z [cluster2] "brokerK8sCA": {
2021-07-11T01:40:36.2856473Z [cluster2] "type": "string"
2021-07-11T01:40:36.2857033Z [cluster2] },
2021-07-11T01:40:36.2857759Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-11T01:40:36.2858515Z [cluster2] "type": "string"
2021-07-11T01:40:36.2859075Z [cluster2] },
2021-07-11T01:40:36.2859625Z [cluster2] "cableDriver": {
2021-07-11T01:40:36.2860236Z [cluster2] "type": "string"
2021-07-11T01:40:36.2860765Z [cluster2] },
2021-07-11T01:40:36.2861687Z [cluster2] "ceIPSecDebug": {
2021-07-11T01:40:36.2862341Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2862880Z [cluster2] },
2021-07-11T01:40:36.2863570Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-11T01:40:36.2864307Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2864858Z [cluster2] },
2021-07-11T01:40:36.2865442Z [cluster2] "ceIPSecIKEPort": {
2021-07-11T01:40:36.2866204Z [cluster2] "type": "integer"
2021-07-11T01:40:36.2866740Z [cluster2] },
2021-07-11T01:40:36.2867345Z [cluster2] "ceIPSecNATTPort": {
2021-07-11T01:40:36.2868012Z [cluster2] "type": "integer"
2021-07-11T01:40:36.2868543Z [cluster2] },
2021-07-11T01:40:36.2869105Z [cluster2] "ceIPSecPSK": {
2021-07-11T01:40:36.2869706Z [cluster2] "type": "string"
2021-07-11T01:40:36.2870597Z [cluster2] },
2021-07-11T01:40:36.2871967Z [cluster2] "ceIPSecPreferredServer": {
2021-07-11T01:40:36.2872979Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2873592Z [cluster2] },
2021-07-11T01:40:36.2874151Z [cluster2] "clusterCIDR": {
2021-07-11T01:40:36.2874767Z [cluster2] "type": "string"
2021-07-11T01:40:36.2875297Z [cluster2] },
2021-07-11T01:40:36.2875838Z [cluster2] "clusterID": {
2021-07-11T01:40:36.2876418Z [cluster2] "type": "string"
2021-07-11T01:40:36.2876952Z [cluster2] },
2021-07-11T01:40:36.2877489Z [cluster2] "colorCodes": {
2021-07-11T01:40:36.2878094Z [cluster2] "type": "string"
2021-07-11T01:40:36.2878634Z [cluster2] },
2021-07-11T01:40:36.2879295Z [cluster2] "connectionHealthCheck": {
2021-07-11T01:40:36.2880042Z [cluster2] "properties": {
2021-07-11T01:40:36.2880635Z [cluster2] "enabled": {
2021-07-11T01:40:36.2881244Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2881796Z [cluster2] },
2021-07-11T01:40:36.2882410Z [cluster2] "intervalSeconds": {
2021-07-11T01:40:36.2883265Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-11T01:40:36.2884463Z [cluster2] "format": "int64",
2021-07-11T01:40:36.2885092Z [cluster2] "type": "integer"
2021-07-11T01:40:36.2885643Z [cluster2] },
2021-07-11T01:40:36.2886291Z [cluster2] "maxPacketLossCount": {
2021-07-11T01:40:36.2887350Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-11T01:40:36.2888321Z [cluster2] "format": "int64",
2021-07-11T01:40:36.2888943Z [cluster2] "type": "integer"
2021-07-11T01:40:36.2889497Z [cluster2] }
2021-07-11T01:40:36.2889994Z [cluster2] },
2021-07-11T01:40:36.2890534Z [cluster2] "type": "object"
2021-07-11T01:40:36.2891078Z [cluster2] },
2021-07-11T01:40:36.2891715Z [cluster2] "coreDNSCustomConfig": {
2021-07-11T01:40:36.2892438Z [cluster2] "properties": {
2021-07-11T01:40:36.2893095Z [cluster2] "configMapName": {
2021-07-11T01:40:36.2893728Z [cluster2] "type": "string"
2021-07-11T01:40:36.2904869Z [cluster2] },
2021-07-11T01:40:36.2905702Z [cluster2] "namespace": {
2021-07-11T01:40:36.2906320Z [cluster2] "type": "string"
2021-07-11T01:40:36.2906867Z [cluster2] }
2021-07-11T01:40:36.2907370Z [cluster2] },
2021-07-11T01:40:36.2907935Z [cluster2] "type": "object"
2021-07-11T01:40:36.2917677Z [cluster2] },
2021-07-11T01:40:36.2918289Z [cluster2] "customDomains": {
2021-07-11T01:40:36.2919392Z [cluster2] "items": {
2021-07-11T01:40:36.2920155Z [cluster2] "type": "string"
2021-07-11T01:40:36.2920701Z [cluster2] },
2021-07-11T01:40:36.2921263Z [cluster2] "type": "array",
2021-07-11T01:40:36.2922430Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-11T01:40:36.2923420Z [cluster2] },
2021-07-11T01:40:36.2924109Z [cluster2] "debug": {
2021-07-11T01:40:36.2924678Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2925467Z [cluster2] },
2021-07-11T01:40:36.2926171Z [cluster2] "globalCIDR": {
2021-07-11T01:40:36.2926781Z [cluster2] "type": "string"
2021-07-11T01:40:36.2927310Z [cluster2] },
2021-07-11T01:40:36.2927902Z [cluster2] "imageOverrides": {
2021-07-11T01:40:36.2928653Z [cluster2] "additionalProperties": {
2021-07-11T01:40:36.2929389Z [cluster2] "type": "string"
2021-07-11T01:40:36.2929939Z [cluster2] },
2021-07-11T01:40:36.2930471Z [cluster2] "type": "object"
2021-07-11T01:40:36.2931015Z [cluster2] },
2021-07-11T01:40:36.2931646Z [cluster2] "loadBalancerEnabled": {
2021-07-11T01:40:36.2932518Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2933063Z [cluster2] },
2021-07-11T01:40:36.2933613Z [cluster2] "namespace": {
2021-07-11T01:40:36.2934194Z [cluster2] "type": "string"
2021-07-11T01:40:36.2934734Z [cluster2] },
2021-07-11T01:40:36.2935284Z [cluster2] "natEnabled": {
2021-07-11T01:40:36.2935878Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2936430Z [cluster2] },
2021-07-11T01:40:36.2936969Z [cluster2] "repository": {
2021-07-11T01:40:36.2937565Z [cluster2] "type": "string"
2021-07-11T01:40:36.2938089Z [cluster2] },
2021-07-11T01:40:36.2938647Z [cluster2] "serviceCIDR": {
2021-07-11T01:40:36.2939267Z [cluster2] "type": "string"
2021-07-11T01:40:36.2939792Z [cluster2] },
2021-07-11T01:40:36.2940499Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-11T01:40:36.2941247Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2941801Z [cluster2] },
2021-07-11T01:40:36.2942312Z [cluster2] "version": {
2021-07-11T01:40:36.2942967Z [cluster2] "type": "string"
2021-07-11T01:40:36.2943489Z [cluster2] }
2021-07-11T01:40:36.2943975Z [cluster2] },
2021-07-11T01:40:36.2944504Z [cluster2] "required": [
2021-07-11T01:40:36.2945051Z [cluster2] "broker",
2021-07-11T01:40:36.2945720Z [cluster2] "brokerK8sApiServer",
2021-07-11T01:40:36.2946546Z [cluster2] "brokerK8sApiServerToken",
2021-07-11T01:40:36.2947320Z [cluster2] "brokerK8sCA",
2021-07-11T01:40:36.2948087Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-11T01:40:36.2948886Z [cluster2] "ceIPSecDebug",
2021-07-11T01:40:36.2949512Z [cluster2] "ceIPSecPSK",
2021-07-11T01:40:36.2950414Z [cluster2] "clusterCIDR",
2021-07-11T01:40:36.2951472Z [cluster2] "clusterID",
2021-07-11T01:40:36.2952190Z [cluster2] "debug",
2021-07-11T01:40:36.2952778Z [cluster2] "namespace",
2021-07-11T01:40:36.2953366Z [cluster2] "natEnabled",
2021-07-11T01:40:36.2953978Z [cluster2] "serviceCIDR"
2021-07-11T01:40:36.2954517Z [cluster2] ],
2021-07-11T01:40:36.2955058Z [cluster2] "type": "object"
2021-07-11T01:40:36.2955566Z [cluster2] },
2021-07-11T01:40:36.2956067Z [cluster2] "status": {
2021-07-11T01:40:36.2956933Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-11T01:40:36.2957825Z [cluster2] "properties": {
2021-07-11T01:40:36.2958454Z [cluster2] "clusterCIDR": {
2021-07-11T01:40:36.2959051Z [cluster2] "type": "string"
2021-07-11T01:40:36.2959589Z [cluster2] },
2021-07-11T01:40:36.2960122Z [cluster2] "clusterID": {
2021-07-11T01:40:36.2960714Z [cluster2] "type": "string"
2021-07-11T01:40:36.2962246Z [cluster2] },
2021-07-11T01:40:36.2962797Z [cluster2] "colorCodes": {
2021-07-11T01:40:36.2963402Z [cluster2] "type": "string"
2021-07-11T01:40:36.2963926Z [cluster2] },
2021-07-11T01:40:36.2964517Z [cluster2] "deploymentInfo": {
2021-07-11T01:40:36.2965161Z [cluster2] "properties": {
2021-07-11T01:40:36.2965823Z [cluster2] "cloudProvider": {
2021-07-11T01:40:36.2966455Z [cluster2] "type": "string"
2021-07-11T01:40:36.2967008Z [cluster2] },
2021-07-11T01:40:36.2967613Z [cluster2] "kubernetesType": {
2021-07-11T01:40:36.2968261Z [cluster2] "type": "string"
2021-07-11T01:40:36.2968817Z [cluster2] },
2021-07-11T01:40:36.2969783Z [cluster2] "kubernetesTypeVersion": {
2021-07-11T01:40:36.2970699Z [cluster2] "type": "string"
2021-07-11T01:40:36.2971241Z [cluster2] },
2021-07-11T01:40:36.2971882Z [cluster2] "kubernetesVersion": {
2021-07-11T01:40:36.2972653Z [cluster2] "type": "string"
2021-07-11T01:40:36.2973187Z [cluster2] }
2021-07-11T01:40:36.2973690Z [cluster2] },
2021-07-11T01:40:36.2974227Z [cluster2] "type": "object"
2021-07-11T01:40:36.2974769Z [cluster2] },
2021-07-11T01:40:36.2975456Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-11T01:40:36.2976219Z [cluster2] "properties": {
2021-07-11T01:40:36.2984108Z [cluster2] "lastResourceVersion": {
2021-07-11T01:40:36.2984838Z [cluster2] "type": "string"
2021-07-11T01:40:36.2985403Z [cluster2] },
2021-07-11T01:40:36.2986135Z [cluster2] "mismatchedContainerImages": {
2021-07-11T01:40:36.2986990Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.2987542Z [cluster2] },
2021-07-11T01:40:36.2988571Z [cluster2] "nonReadyContainerStates": {
2021-07-11T01:40:36.2989315Z [cluster2] "items": {
2021-07-11T01:40:36.2991337Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.2992750Z [cluster2] "properties": {
2021-07-11T01:40:36.2993359Z [cluster2] "running": {
2021-07-11T01:40:36.2994131Z [cluster2] "description": "Details about a running container",
2021-07-11T01:40:36.2994925Z [cluster2] "properties": {
2021-07-11T01:40:36.2995642Z [cluster2] "startedAt": {
2021-07-11T01:40:36.2996936Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.2998182Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.2998844Z [cluster2] "type": "string"
2021-07-11T01:40:36.2999438Z [cluster2] }
2021-07-11T01:40:36.2999966Z [cluster2] },
2021-07-11T01:40:36.3000547Z [cluster2] "type": "object"
2021-07-11T01:40:36.3001118Z [cluster2] },
2021-07-11T01:40:36.3001701Z [cluster2] "terminated": {
2021-07-11T01:40:36.3002809Z [cluster2] "description": "Details about a terminated container",
2021-07-11T01:40:36.3003623Z [cluster2] "properties": {
2021-07-11T01:40:36.3004288Z [cluster2] "containerID": {
2021-07-11T01:40:36.3005533Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.3006410Z [cluster2] "type": "string"
2021-07-11T01:40:36.3007004Z [cluster2] },
2021-07-11T01:40:36.3007680Z [cluster2] "exitCode": {
2021-07-11T01:40:36.3008541Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.3009378Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3010567Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3011180Z [cluster2] },
2021-07-11T01:40:36.3011767Z [cluster2] "finishedAt": {
2021-07-11T01:40:36.3012599Z [cluster2] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.3014154Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3014879Z [cluster2] "type": "string"
2021-07-11T01:40:36.3015468Z [cluster2] },
2021-07-11T01:40:36.3016032Z [cluster2] "message": {
2021-07-11T01:40:36.3017202Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.3018078Z [cluster2] "type": "string"
2021-07-11T01:40:36.3018663Z [cluster2] },
2021-07-11T01:40:36.3019227Z [cluster2] "reason": {
2021-07-11T01:40:36.3020069Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.3020930Z [cluster2] "type": "string"
2021-07-11T01:40:36.3021494Z [cluster2] },
2021-07-11T01:40:36.3022059Z [cluster2] "signal": {
2021-07-11T01:40:36.3022974Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.3024001Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3024748Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3025755Z [cluster2] },
2021-07-11T01:40:36.3026367Z [cluster2] "startedAt": {
2021-07-11T01:40:36.3027625Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.3028868Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3029538Z [cluster2] "type": "string"
2021-07-11T01:40:36.3030275Z [cluster2] }
2021-07-11T01:40:36.3030893Z [cluster2] },
2021-07-11T01:40:36.3031461Z [cluster2] "required": [
2021-07-11T01:40:36.3032091Z [cluster2] "exitCode"
2021-07-11T01:40:36.3032772Z [cluster2] ],
2021-07-11T01:40:36.3033667Z [cluster2] "type": "object"
2021-07-11T01:40:36.3034525Z [cluster2] },
2021-07-11T01:40:36.3035080Z [cluster2] "waiting": {
2021-07-11T01:40:36.3035855Z [cluster2] "description": "Details about a waiting container",
2021-07-11T01:40:36.3036635Z [cluster2] "properties": {
2021-07-11T01:40:36.3037271Z [cluster2] "message": {
2021-07-11T01:40:36.3038131Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.3038971Z [cluster2] "type": "string"
2021-07-11T01:40:36.3039854Z [cluster2] },
2021-07-11T01:40:36.3040406Z [cluster2] "reason": {
2021-07-11T01:40:36.3041207Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.3042027Z [cluster2] "type": "string"
2021-07-11T01:40:36.3042599Z [cluster2] }
2021-07-11T01:40:36.3043135Z [cluster2] },
2021-07-11T01:40:36.3043695Z [cluster2] "type": "object"
2021-07-11T01:40:36.3044271Z [cluster2] }
2021-07-11T01:40:36.3044786Z [cluster2] },
2021-07-11T01:40:36.3045358Z [cluster2] "type": "object"
2021-07-11T01:40:36.3045921Z [cluster2] },
2021-07-11T01:40:36.3046468Z [cluster2] "type": "array"
2021-07-11T01:40:36.3047017Z [cluster2] },
2021-07-11T01:40:36.3047628Z [cluster2] "status": {
2021-07-11T01:40:36.3048529Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.3049441Z [cluster2] "properties": {
2021-07-11T01:40:36.3050324Z [cluster2] "collisionCount": {
2021-07-11T01:40:36.3051792Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.3053191Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3054172Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3054788Z [cluster2] },
2021-07-11T01:40:36.3055351Z [cluster2] "conditions": {
2021-07-11T01:40:36.3056735Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.3057664Z [cluster2] "items": {
2021-07-11T01:40:36.3058957Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.3060065Z [cluster2] "properties": {
2021-07-11T01:40:36.3060780Z [cluster2] "lastTransitionTime": {
2021-07-11T01:40:36.3061771Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.3062971Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3063645Z [cluster2] "type": "string"
2021-07-11T01:40:36.3064224Z [cluster2] },
2021-07-11T01:40:36.3064786Z [cluster2] "message": {
2021-07-11T01:40:36.3065699Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.3067247Z [cluster2] "type": "string"
2021-07-11T01:40:36.3067830Z [cluster2] },
2021-07-11T01:40:36.3068398Z [cluster2] "reason": {
2021-07-11T01:40:36.3069520Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.3070753Z [cluster2] "type": "string"
2021-07-11T01:40:36.3071322Z [cluster2] },
2021-07-11T01:40:36.3071882Z [cluster2] "status": {
2021-07-11T01:40:36.3072720Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.3073869Z [cluster2] "type": "string"
2021-07-11T01:40:36.3074453Z [cluster2] },
2021-07-11T01:40:36.3075113Z [cluster2] "type": {
2021-07-11T01:40:36.3075876Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.3076639Z [cluster2] "type": "string"
2021-07-11T01:40:36.3084737Z [cluster2] }
2021-07-11T01:40:36.3086335Z [cluster2] },
2021-07-11T01:40:36.3087124Z [cluster2] "required": [
2021-07-11T01:40:36.3087747Z [cluster2] "status",
2021-07-11T01:40:36.3088321Z [cluster2] "type"
2021-07-11T01:40:36.3088878Z [cluster2] ],
2021-07-11T01:40:36.3089449Z [cluster2] "type": "object"
2021-07-11T01:40:36.3090038Z [cluster2] },
2021-07-11T01:40:36.3090606Z [cluster2] "type": "array"
2021-07-11T01:40:36.3091151Z [cluster2] },
2021-07-11T01:40:36.3091860Z [cluster2] "currentNumberScheduled": {
2021-07-11T01:40:36.3093548Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3094931Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3095826Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3096395Z [cluster2] },
2021-07-11T01:40:36.3097109Z [cluster2] "desiredNumberScheduled": {
2021-07-11T01:40:36.3098727Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3100169Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3100803Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3101381Z [cluster2] },
2021-07-11T01:40:36.3101987Z [cluster2] "numberAvailable": {
2021-07-11T01:40:36.3103562Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3104787Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3105416Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3105990Z [cluster2] },
2021-07-11T01:40:36.3106789Z [cluster2] "numberMisscheduled": {
2021-07-11T01:40:36.3108262Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3109697Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3110590Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3111172Z [cluster2] },
2021-07-11T01:40:36.3111740Z [cluster2] "numberReady": {
2021-07-11T01:40:36.3112784Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.3113983Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3114609Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3115212Z [cluster2] },
2021-07-11T01:40:36.3115858Z [cluster2] "numberUnavailable": {
2021-07-11T01:40:36.3117173Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3118384Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3119001Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3119655Z [cluster2] },
2021-07-11T01:40:36.3120312Z [cluster2] "observedGeneration": {
2021-07-11T01:40:36.3121311Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.3122193Z [cluster2] "format": "int64",
2021-07-11T01:40:36.3122825Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3123389Z [cluster2] },
2021-07-11T01:40:36.3124105Z [cluster2] "updatedNumberScheduled": {
2021-07-11T01:40:36.3125104Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.3125931Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3126552Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3127113Z [cluster2] }
2021-07-11T01:40:36.3127625Z [cluster2] },
2021-07-11T01:40:36.3128161Z [cluster2] "required": [
2021-07-11T01:40:36.3128915Z [cluster2] "currentNumberScheduled",
2021-07-11T01:40:36.3129820Z [cluster2] "desiredNumberScheduled",
2021-07-11T01:40:36.3130643Z [cluster2] "numberMisscheduled",
2021-07-11T01:40:36.3131363Z [cluster2] "numberReady"
2021-07-11T01:40:36.3131923Z [cluster2] ],
2021-07-11T01:40:36.3132491Z [cluster2] "type": "object"
2021-07-11T01:40:36.3133028Z [cluster2] }
2021-07-11T01:40:36.3133519Z [cluster2] },
2021-07-11T01:40:36.3134060Z [cluster2] "required": [
2021-07-11T01:40:36.3134828Z [cluster2] "mismatchedContainerImages"
2021-07-11T01:40:36.3135623Z [cluster2] ],
2021-07-11T01:40:36.3136160Z [cluster2] "type": "object"
2021-07-11T01:40:36.3136699Z [cluster2] },
2021-07-11T01:40:36.3137217Z [cluster2] "gateways": {
2021-07-11T01:40:36.3137772Z [cluster2] "items": {
2021-07-11T01:40:36.3138341Z [cluster2] "properties": {
2021-07-11T01:40:36.3138983Z [cluster2] "connections": {
2021-07-11T01:40:36.3139581Z [cluster2] "items": {
2021-07-11T01:40:36.3140170Z [cluster2] "properties": {
2021-07-11T01:40:36.3140802Z [cluster2] "endpoint": {
2021-07-11T01:40:36.3141428Z [cluster2] "properties": {
2021-07-11T01:40:36.3142113Z [cluster2] "backend": {
2021-07-11T01:40:36.3142718Z [cluster2] "type": "string"
2021-07-11T01:40:36.3143308Z [cluster2] },
2021-07-11T01:40:36.3143902Z [cluster2] "backend_config": {
2021-07-11T01:40:36.3144709Z [cluster2] "additionalProperties": {
2021-07-11T01:40:36.3145469Z [cluster2] "type": "string"
2021-07-11T01:40:36.3146047Z [cluster2] },
2021-07-11T01:40:36.3146637Z [cluster2] "type": "object"
2021-07-11T01:40:36.3147496Z [cluster2] },
2021-07-11T01:40:36.3148058Z [cluster2] "cable_name": {
2021-07-11T01:40:36.3148687Z [cluster2] "type": "string"
2021-07-11T01:40:36.3149264Z [cluster2] },
2021-07-11T01:40:36.3149847Z [cluster2] "cluster_id": {
2021-07-11T01:40:36.3150558Z [cluster2] "type": "string"
2021-07-11T01:40:36.3151149Z [cluster2] },
2021-07-11T01:40:36.3151778Z [cluster2] "healthCheckIP": {
2021-07-11T01:40:36.3152446Z [cluster2] "type": "string"
2021-07-11T01:40:36.3153031Z [cluster2] },
2021-07-11T01:40:36.3153589Z [cluster2] "hostname": {
2021-07-11T01:40:36.3154220Z [cluster2] "type": "string"
2021-07-11T01:40:36.3154803Z [cluster2] },
2021-07-11T01:40:36.3155362Z [cluster2] "nat_enabled": {
2021-07-11T01:40:36.3156624Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3157547Z [cluster2] },
2021-07-11T01:40:36.3158237Z [cluster2] "private_ip": {
2021-07-11T01:40:36.3158867Z [cluster2] "type": "string"
2021-07-11T01:40:36.3159461Z [cluster2] },
2021-07-11T01:40:36.3160035Z [cluster2] "public_ip": {
2021-07-11T01:40:36.3160649Z [cluster2] "type": "string"
2021-07-11T01:40:36.3161241Z [cluster2] },
2021-07-11T01:40:36.3161799Z [cluster2] "subnets": {
2021-07-11T01:40:36.3162395Z [cluster2] "items": {
2021-07-11T01:40:36.3162998Z [cluster2] "type": "string"
2021-07-11T01:40:36.3163592Z [cluster2] },
2021-07-11T01:40:36.3164373Z [cluster2] "type": "array"
2021-07-11T01:40:36.3164941Z [cluster2] }
2021-07-11T01:40:36.3165480Z [cluster2] },
2021-07-11T01:40:36.3166041Z [cluster2] "required": [
2021-07-11T01:40:36.3166961Z [cluster2] "backend",
2021-07-11T01:40:36.3167577Z [cluster2] "cable_name",
2021-07-11T01:40:36.3168372Z [cluster2] "cluster_id",
2021-07-11T01:40:36.3169002Z [cluster2] "hostname",
2021-07-11T01:40:36.3169610Z [cluster2] "nat_enabled",
2021-07-11T01:40:36.3170825Z [cluster2] "private_ip",
2021-07-11T01:40:36.3171463Z [cluster2] "public_ip",
2021-07-11T01:40:36.3172075Z [cluster2] "subnets"
2021-07-11T01:40:36.3172647Z [cluster2] ],
2021-07-11T01:40:36.3173215Z [cluster2] "type": "object"
2021-07-11T01:40:36.3173793Z [cluster2] },
2021-07-11T01:40:36.3174372Z [cluster2] "latencyRTT": {
2021-07-11T01:40:36.3175479Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-11T01:40:36.3176579Z [cluster2] "properties": {
2021-07-11T01:40:36.3177203Z [cluster2] "average": {
2021-07-11T01:40:36.3177829Z [cluster2] "type": "string"
2021-07-11T01:40:36.3178406Z [cluster2] },
2021-07-11T01:40:36.3179147Z [cluster2] "last": {
2021-07-11T01:40:36.3179743Z [cluster2] "type": "string"
2021-07-11T01:40:36.3180679Z [cluster2] },
2021-07-11T01:40:36.3181528Z [cluster2] "max": {
2021-07-11T01:40:36.3182129Z [cluster2] "type": "string"
2021-07-11T01:40:36.3182718Z [cluster2] },
2021-07-11T01:40:36.3183258Z [cluster2] "min": {
2021-07-11T01:40:36.3183865Z [cluster2] "type": "string"
2021-07-11T01:40:36.3184458Z [cluster2] },
2021-07-11T01:40:36.3185012Z [cluster2] "stdDev": {
2021-07-11T01:40:36.3185631Z [cluster2] "type": "string"
2021-07-11T01:40:36.3186200Z [cluster2] }
2021-07-11T01:40:36.3186734Z [cluster2] },
2021-07-11T01:40:36.3187305Z [cluster2] "type": "object"
2021-07-11T01:40:36.3188283Z [cluster2] },
2021-07-11T01:40:36.3189077Z [cluster2] "status": {
2021-07-11T01:40:36.3190323Z [cluster2] "type": "string"
2021-07-11T01:40:36.3190923Z [cluster2] },
2021-07-11T01:40:36.3191515Z [cluster2] "statusMessage": {
2021-07-11T01:40:36.3192180Z [cluster2] "type": "string"
2021-07-11T01:40:36.3192752Z [cluster2] },
2021-07-11T01:40:36.3193325Z [cluster2] "usingIP": {
2021-07-11T01:40:36.3193941Z [cluster2] "type": "string"
2021-07-11T01:40:36.3194502Z [cluster2] },
2021-07-11T01:40:36.3195077Z [cluster2] "usingNAT": {
2021-07-11T01:40:36.3195697Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3196280Z [cluster2] }
2021-07-11T01:40:36.3196787Z [cluster2] },
2021-07-11T01:40:36.3197587Z [cluster2] "required": [
2021-07-11T01:40:36.3198209Z [cluster2] "endpoint",
2021-07-11T01:40:36.3198798Z [cluster2] "status",
2021-07-11T01:40:36.3199431Z [cluster2] "statusMessage"
2021-07-11T01:40:36.3200208Z [cluster2] ],
2021-07-11T01:40:36.3200796Z [cluster2] "type": "object"
2021-07-11T01:40:36.3201347Z [cluster2] },
2021-07-11T01:40:36.3201907Z [cluster2] "type": "array"
2021-07-11T01:40:36.3202464Z [cluster2] },
2021-07-11T01:40:36.3203003Z [cluster2] "haStatus": {
2021-07-11T01:40:36.3203605Z [cluster2] "type": "string"
2021-07-11T01:40:36.3204244Z [cluster2] },
2021-07-11T01:40:36.3204838Z [cluster2] "localEndpoint": {
2021-07-11T01:40:36.3205488Z [cluster2] "properties": {
2021-07-11T01:40:36.3206995Z [cluster2] "backend": {
2021-07-11T01:40:36.3207893Z [cluster2] "type": "string"
2021-07-11T01:40:36.3208457Z [cluster2] },
2021-07-11T01:40:36.3209045Z [cluster2] "backend_config": {
2021-07-11T01:40:36.3209792Z [cluster2] "additionalProperties": {
2021-07-11T01:40:36.3210540Z [cluster2] "type": "string"
2021-07-11T01:40:36.3211288Z [cluster2] },
2021-07-11T01:40:36.3211871Z [cluster2] "type": "object"
2021-07-11T01:40:36.3212869Z [cluster2] },
2021-07-11T01:40:36.3213433Z [cluster2] "cable_name": {
2021-07-11T01:40:36.3214050Z [cluster2] "type": "string"
2021-07-11T01:40:36.3214607Z [cluster2] },
2021-07-11T01:40:36.3215303Z [cluster2] "cluster_id": {
2021-07-11T01:40:36.3215900Z [cluster2] "type": "string"
2021-07-11T01:40:36.3216469Z [cluster2] },
2021-07-11T01:40:36.3217073Z [cluster2] "healthCheckIP": {
2021-07-11T01:40:36.3217727Z [cluster2] "type": "string"
2021-07-11T01:40:36.3218295Z [cluster2] },
2021-07-11T01:40:36.3218844Z [cluster2] "hostname": {
2021-07-11T01:40:36.3219454Z [cluster2] "type": "string"
2021-07-11T01:40:36.3220007Z [cluster2] },
2021-07-11T01:40:36.3220588Z [cluster2] "nat_enabled": {
2021-07-11T01:40:36.3221393Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3221966Z [cluster2] },
2021-07-11T01:40:36.3222534Z [cluster2] "private_ip": {
2021-07-11T01:40:36.3223144Z [cluster2] "type": "string"
2021-07-11T01:40:36.3223715Z [cluster2] },
2021-07-11T01:40:36.3224259Z [cluster2] "public_ip": {
2021-07-11T01:40:36.3224868Z [cluster2] "type": "string"
2021-07-11T01:40:36.3225436Z [cluster2] },
2021-07-11T01:40:36.3225972Z [cluster2] "subnets": {
2021-07-11T01:40:36.3226556Z [cluster2] "items": {
2021-07-11T01:40:36.3227138Z [cluster2] "type": "string"
2021-07-11T01:40:36.3228105Z [cluster2] },
2021-07-11T01:40:36.3228916Z [cluster2] "type": "array"
2021-07-11T01:40:36.3229871Z [cluster2] }
2021-07-11T01:40:36.3230653Z [cluster2] },
2021-07-11T01:40:36.3231561Z [cluster2] "required": [
2021-07-11T01:40:36.3232601Z [cluster2] "backend",
2021-07-11T01:40:36.3233199Z [cluster2] "cable_name",
2021-07-11T01:40:36.3233803Z [cluster2] "cluster_id",
2021-07-11T01:40:36.3234387Z [cluster2] "hostname",
2021-07-11T01:40:36.3234991Z [cluster2] "nat_enabled",
2021-07-11T01:40:36.3235600Z [cluster2] "private_ip",
2021-07-11T01:40:36.3236192Z [cluster2] "public_ip",
2021-07-11T01:40:36.3236786Z [cluster2] "subnets"
2021-07-11T01:40:36.3237324Z [cluster2] ],
2021-07-11T01:40:36.3237885Z [cluster2] "type": "object"
2021-07-11T01:40:36.3238428Z [cluster2] },
2021-07-11T01:40:36.3239014Z [cluster2] "statusFailure": {
2021-07-11T01:40:36.3239743Z [cluster2] "type": "string"
2021-07-11T01:40:36.3240293Z [cluster2] },
2021-07-11T01:40:36.3240832Z [cluster2] "version": {
2021-07-11T01:40:36.3241924Z [cluster2] "type": "string"
2021-07-11T01:40:36.3242669Z [cluster2] }
2021-07-11T01:40:36.3243161Z [cluster2] },
2021-07-11T01:40:36.3243711Z [cluster2] "required": [
2021-07-11T01:40:36.3244324Z [cluster2] "connections",
2021-07-11T01:40:36.3244920Z [cluster2] "haStatus",
2021-07-11T01:40:36.3245552Z [cluster2] "localEndpoint",
2021-07-11T01:40:36.3246212Z [cluster2] "statusFailure",
2021-07-11T01:40:36.3246837Z [cluster2] "version"
2021-07-11T01:40:36.3247357Z [cluster2] ],
2021-07-11T01:40:36.3247912Z [cluster2] "type": "object"
2021-07-11T01:40:36.3248458Z [cluster2] },
2021-07-11T01:40:36.3248992Z [cluster2] "type": "array"
2021-07-11T01:40:36.3249523Z [cluster2] },
2021-07-11T01:40:36.3250054Z [cluster2] "globalCIDR": {
2021-07-11T01:40:36.3250645Z [cluster2] "type": "string"
2021-07-11T01:40:36.3251168Z [cluster2] },
2021-07-11T01:40:36.3251888Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-11T01:40:36.3252663Z [cluster2] "properties": {
2021-07-11T01:40:36.3253374Z [cluster2] "lastResourceVersion": {
2021-07-11T01:40:36.3254075Z [cluster2] "type": "string"
2021-07-11T01:40:36.3254620Z [cluster2] },
2021-07-11T01:40:36.3255362Z [cluster2] "mismatchedContainerImages": {
2021-07-11T01:40:36.3256229Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3256793Z [cluster2] },
2021-07-11T01:40:36.3257490Z [cluster2] "nonReadyContainerStates": {
2021-07-11T01:40:36.3258242Z [cluster2] "items": {
2021-07-11T01:40:36.3260173Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.3261589Z [cluster2] "properties": {
2021-07-11T01:40:36.3262210Z [cluster2] "running": {
2021-07-11T01:40:36.3262961Z [cluster2] "description": "Details about a running container",
2021-07-11T01:40:36.3263749Z [cluster2] "properties": {
2021-07-11T01:40:36.3264376Z [cluster2] "startedAt": {
2021-07-11T01:40:36.3265698Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.3266776Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3267513Z [cluster2] "type": "string"
2021-07-11T01:40:36.3268093Z [cluster2] }
2021-07-11T01:40:36.3268614Z [cluster2] },
2021-07-11T01:40:36.3269202Z [cluster2] "type": "object"
2021-07-11T01:40:36.3269766Z [cluster2] },
2021-07-11T01:40:36.3270601Z [cluster2] "terminated": {
2021-07-11T01:40:36.3271413Z [cluster2] "description": "Details about a terminated container",
2021-07-11T01:40:36.3272207Z [cluster2] "properties": {
2021-07-11T01:40:36.3272873Z [cluster2] "containerID": {
2021-07-11T01:40:36.3274092Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.3274969Z [cluster2] "type": "string"
2021-07-11T01:40:36.3275549Z [cluster2] },
2021-07-11T01:40:36.3276118Z [cluster2] "exitCode": {
2021-07-11T01:40:36.3276972Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.3277808Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3278713Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3279315Z [cluster2] },
2021-07-11T01:40:36.3279892Z [cluster2] "finishedAt": {
2021-07-11T01:40:36.3280727Z [cluster2] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.3281929Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3282597Z [cluster2] "type": "string"
2021-07-11T01:40:36.3283170Z [cluster2] },
2021-07-11T01:40:36.3283743Z [cluster2] "message": {
2021-07-11T01:40:36.3284611Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.3285481Z [cluster2] "type": "string"
2021-07-11T01:40:36.3286060Z [cluster2] },
2021-07-11T01:40:36.3286606Z [cluster2] "reason": {
2021-07-11T01:40:36.3287457Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.3288318Z [cluster2] "type": "string"
2021-07-11T01:40:36.3289375Z [cluster2] },
2021-07-11T01:40:36.3289945Z [cluster2] "signal": {
2021-07-11T01:40:36.3291006Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.3292578Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3293355Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3294074Z [cluster2] },
2021-07-11T01:40:36.3294791Z [cluster2] "startedAt": {
2021-07-11T01:40:36.3295824Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.3297339Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3298147Z [cluster2] "type": "string"
2021-07-11T01:40:36.3298868Z [cluster2] }
2021-07-11T01:40:36.3299535Z [cluster2] },
2021-07-11T01:40:36.3300237Z [cluster2] "required": [
2021-07-11T01:40:36.3300997Z [cluster2] "exitCode"
2021-07-11T01:40:36.3301587Z [cluster2] ],
2021-07-11T01:40:36.3302320Z [cluster2] "type": "object"
2021-07-11T01:40:36.3303032Z [cluster2] },
2021-07-11T01:40:36.3303726Z [cluster2] "waiting": {
2021-07-11T01:40:36.3304630Z [cluster2] "description": "Details about a waiting container",
2021-07-11T01:40:36.3305663Z [cluster2] "properties": {
2021-07-11T01:40:36.3306434Z [cluster2] "message": {
2021-07-11T01:40:36.3307427Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.3308530Z [cluster2] "type": "string"
2021-07-11T01:40:36.3309267Z [cluster2] },
2021-07-11T01:40:36.3310697Z [cluster2] "reason": {
2021-07-11T01:40:36.3311661Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.3312600Z [cluster2] "type": "string"
2021-07-11T01:40:36.3313482Z [cluster2] }
2021-07-11T01:40:36.3314164Z [cluster2] },
2021-07-11T01:40:36.3315211Z [cluster2] "type": "object"
2021-07-11T01:40:36.3316477Z [cluster2] }
2021-07-11T01:40:36.3317010Z [cluster2] },
2021-07-11T01:40:36.3317732Z [cluster2] "type": "object"
2021-07-11T01:40:36.3318423Z [cluster2] },
2021-07-11T01:40:36.3319115Z [cluster2] "type": "array"
2021-07-11T01:40:36.3319793Z [cluster2] },
2021-07-11T01:40:36.3320576Z [cluster2] "status": {
2021-07-11T01:40:36.3321862Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.3322917Z [cluster2] "properties": {
2021-07-11T01:40:36.3323852Z [cluster2] "collisionCount": {
2021-07-11T01:40:36.3325589Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.3327387Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3328150Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3328730Z [cluster2] },
2021-07-11T01:40:36.3329448Z [cluster2] "conditions": {
2021-07-11T01:40:36.3331275Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.3332361Z [cluster2] "items": {
2021-07-11T01:40:36.3333339Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.3334469Z [cluster2] "properties": {
2021-07-11T01:40:36.3335201Z [cluster2] "lastTransitionTime": {
2021-07-11T01:40:36.3336314Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.3337504Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3338164Z [cluster2] "type": "string"
2021-07-11T01:40:36.3338733Z [cluster2] },
2021-07-11T01:40:36.3339304Z [cluster2] "message": {
2021-07-11T01:40:36.3340477Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.3341407Z [cluster2] "type": "string"
2021-07-11T01:40:36.3341988Z [cluster2] },
2021-07-11T01:40:36.3342538Z [cluster2] "reason": {
2021-07-11T01:40:36.3343669Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.3344484Z [cluster2] "type": "string"
2021-07-11T01:40:36.3345060Z [cluster2] },
2021-07-11T01:40:36.3345626Z [cluster2] "status": {
2021-07-11T01:40:36.3346839Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.3347697Z [cluster2] "type": "string"
2021-07-11T01:40:36.3348268Z [cluster2] },
2021-07-11T01:40:36.3348823Z [cluster2] "type": {
2021-07-11T01:40:36.3349655Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.3350600Z [cluster2] "type": "string"
2021-07-11T01:40:36.3351183Z [cluster2] }
2021-07-11T01:40:36.3351706Z [cluster2] },
2021-07-11T01:40:36.3352280Z [cluster2] "required": [
2021-07-11T01:40:36.3352871Z [cluster2] "status",
2021-07-11T01:40:36.3353453Z [cluster2] "type"
2021-07-11T01:40:36.3353988Z [cluster2] ],
2021-07-11T01:40:36.3354568Z [cluster2] "type": "object"
2021-07-11T01:40:36.3355142Z [cluster2] },
2021-07-11T01:40:36.3355689Z [cluster2] "type": "array"
2021-07-11T01:40:36.3356251Z [cluster2] },
2021-07-11T01:40:36.3356946Z [cluster2] "currentNumberScheduled": {
2021-07-11T01:40:36.3358493Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3359868Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3360558Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3361144Z [cluster2] },
2021-07-11T01:40:36.3361846Z [cluster2] "desiredNumberScheduled": {
2021-07-11T01:40:36.3363734Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3365501Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3366127Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3366961Z [cluster2] },
2021-07-11T01:40:36.3367885Z [cluster2] "numberAvailable": {
2021-07-11T01:40:36.3369218Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3370461Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3371067Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3371642Z [cluster2] },
2021-07-11T01:40:36.3372281Z [cluster2] "numberMisscheduled": {
2021-07-11T01:40:36.3373749Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3375110Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3375809Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3376384Z [cluster2] },
2021-07-11T01:40:36.3376952Z [cluster2] "numberReady": {
2021-07-11T01:40:36.3377996Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.3378999Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3379602Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3380178Z [cluster2] },
2021-07-11T01:40:36.3380799Z [cluster2] "numberUnavailable": {
2021-07-11T01:40:36.3382120Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3383335Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3383941Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3384516Z [cluster2] },
2021-07-11T01:40:36.3385160Z [cluster2] "observedGeneration": {
2021-07-11T01:40:36.3386159Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.3387031Z [cluster2] "format": "int64",
2021-07-11T01:40:36.3387654Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3388229Z [cluster2] },
2021-07-11T01:40:36.3388929Z [cluster2] "updatedNumberScheduled": {
2021-07-11T01:40:36.3390011Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.3390996Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3391624Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3392200Z [cluster2] }
2021-07-11T01:40:36.3392702Z [cluster2] },
2021-07-11T01:40:36.3393259Z [cluster2] "required": [
2021-07-11T01:40:36.3394323Z [cluster2] "currentNumberScheduled",
2021-07-11T01:40:36.3395256Z [cluster2] "desiredNumberScheduled",
2021-07-11T01:40:36.3396087Z [cluster2] "numberMisscheduled",
2021-07-11T01:40:36.3397136Z [cluster2] "numberReady"
2021-07-11T01:40:36.3397887Z [cluster2] ],
2021-07-11T01:40:36.3398447Z [cluster2] "type": "object"
2021-07-11T01:40:36.3399007Z [cluster2] }
2021-07-11T01:40:36.3399495Z [cluster2] },
2021-07-11T01:40:36.3400036Z [cluster2] "required": [
2021-07-11T01:40:36.3401019Z [cluster2] "mismatchedContainerImages"
2021-07-11T01:40:36.3401768Z [cluster2] ],
2021-07-11T01:40:36.3402401Z [cluster2] "type": "object"
2021-07-11T01:40:36.3402946Z [cluster2] },
2021-07-11T01:40:36.3403580Z [cluster2] "loadBalancerStatus": {
2021-07-11T01:40:36.3404267Z [cluster2] "properties": {
2021-07-11T01:40:36.3405067Z [cluster2] "status": {
2021-07-11T01:40:36.3406428Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-11T01:40:36.3407393Z [cluster2] "properties": {
2021-07-11T01:40:36.3407992Z [cluster2] "ingress": {
2021-07-11T01:40:36.3409953Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-11T01:40:36.3411282Z [cluster2] "items": {
2021-07-11T01:40:36.3413157Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-11T01:40:36.3414446Z [cluster2] "properties": {
2021-07-11T01:40:36.3415122Z [cluster2] "hostname": {
2021-07-11T01:40:36.3416501Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-11T01:40:36.3417551Z [cluster2] "type": "string"
2021-07-11T01:40:36.3418125Z [cluster2] },
2021-07-11T01:40:36.3418666Z [cluster2] "ip": {
2021-07-11T01:40:36.3420048Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-11T01:40:36.3421221Z [cluster2] "type": "string"
2021-07-11T01:40:36.3421818Z [cluster2] }
2021-07-11T01:40:36.3422553Z [cluster2] },
2021-07-11T01:40:36.3423135Z [cluster2] "type": "object"
2021-07-11T01:40:36.3423702Z [cluster2] },
2021-07-11T01:40:36.3424271Z [cluster2] "type": "array"
2021-07-11T01:40:36.3424832Z [cluster2] }
2021-07-11T01:40:36.3425527Z [cluster2] },
2021-07-11T01:40:36.3426095Z [cluster2] "type": "object"
2021-07-11T01:40:36.3426637Z [cluster2] }
2021-07-11T01:40:36.3427141Z [cluster2] },
2021-07-11T01:40:36.3427676Z [cluster2] "type": "object"
2021-07-11T01:40:36.3428214Z [cluster2] },
2021-07-11T01:40:36.3429024Z [cluster2] "natEnabled": {
2021-07-11T01:40:36.3429813Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3430587Z [cluster2] },
2021-07-11T01:40:36.3431258Z [cluster2] "networkPlugin": {
2021-07-11T01:40:36.3431884Z [cluster2] "type": "string"
2021-07-11T01:40:36.3432730Z [cluster2] },
2021-07-11T01:40:36.3433649Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-11T01:40:36.3434449Z [cluster2] "properties": {
2021-07-11T01:40:36.3457176Z [cluster2] "lastResourceVersion": {
2021-07-11T01:40:36.3457994Z [cluster2] "type": "string"
2021-07-11T01:40:36.3458562Z [cluster2] },
2021-07-11T01:40:36.3459292Z [cluster2] "mismatchedContainerImages": {
2021-07-11T01:40:36.3460109Z [cluster2] "type": "boolean"
2021-07-11T01:40:36.3460680Z [cluster2] },
2021-07-11T01:40:36.3461390Z [cluster2] "nonReadyContainerStates": {
2021-07-11T01:40:36.3462135Z [cluster2] "items": {
2021-07-11T01:40:36.3463486Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.3464875Z [cluster2] "properties": {
2021-07-11T01:40:36.3465505Z [cluster2] "running": {
2021-07-11T01:40:36.3466245Z [cluster2] "description": "Details about a running container",
2021-07-11T01:40:36.3467031Z [cluster2] "properties": {
2021-07-11T01:40:36.3467662Z [cluster2] "startedAt": {
2021-07-11T01:40:36.3468940Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.3470022Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3471010Z [cluster2] "type": "string"
2021-07-11T01:40:36.3471609Z [cluster2] }
2021-07-11T01:40:36.3472131Z [cluster2] },
2021-07-11T01:40:36.3472716Z [cluster2] "type": "object"
2021-07-11T01:40:36.3473277Z [cluster2] },
2021-07-11T01:40:36.3473870Z [cluster2] "terminated": {
2021-07-11T01:40:36.3474683Z [cluster2] "description": "Details about a terminated container",
2021-07-11T01:40:36.3475476Z [cluster2] "properties": {
2021-07-11T01:40:36.3476140Z [cluster2] "containerID": {
2021-07-11T01:40:36.3477683Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.3478558Z [cluster2] "type": "string"
2021-07-11T01:40:36.3479779Z [cluster2] },
2021-07-11T01:40:36.3480365Z [cluster2] "exitCode": {
2021-07-11T01:40:36.3481339Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.3482175Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3482819Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3483419Z [cluster2] },
2021-07-11T01:40:36.3483998Z [cluster2] "finishedAt": {
2021-07-11T01:40:36.3484834Z [cluster2] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.3485952Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3486609Z [cluster2] "type": "string"
2021-07-11T01:40:36.3487372Z [cluster2] },
2021-07-11T01:40:36.3487959Z [cluster2] "message": {
2021-07-11T01:40:36.3488832Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.3489697Z [cluster2] "type": "string"
2021-07-11T01:40:36.3490284Z [cluster2] },
2021-07-11T01:40:36.3490831Z [cluster2] "reason": {
2021-07-11T01:40:36.3491680Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.3492855Z [cluster2] "type": "string"
2021-07-11T01:40:36.3493424Z [cluster2] },
2021-07-11T01:40:36.3493983Z [cluster2] "signal": {
2021-07-11T01:40:36.3494792Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.3495711Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3496355Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3496930Z [cluster2] },
2021-07-11T01:40:36.3497514Z [cluster2] "startedAt": {
2021-07-11T01:40:36.3499277Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.3500699Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3501351Z [cluster2] "type": "string"
2021-07-11T01:40:36.3501939Z [cluster2] }
2021-07-11T01:40:36.3502821Z [cluster2] },
2021-07-11T01:40:36.3503402Z [cluster2] "required": [
2021-07-11T01:40:36.3504033Z [cluster2] "exitCode"
2021-07-11T01:40:36.3504594Z [cluster2] ],
2021-07-11T01:40:36.3505179Z [cluster2] "type": "object"
2021-07-11T01:40:36.3506555Z [cluster2] },
2021-07-11T01:40:36.3507276Z [cluster2] "waiting": {
2021-07-11T01:40:36.3508056Z [cluster2] "description": "Details about a waiting container",
2021-07-11T01:40:36.3509228Z [cluster2] "properties": {
2021-07-11T01:40:36.3509872Z [cluster2] "message": {
2021-07-11T01:40:36.3510960Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.3512027Z [cluster2] "type": "string"
2021-07-11T01:40:36.3512593Z [cluster2] },
2021-07-11T01:40:36.3513366Z [cluster2] "reason": {
2021-07-11T01:40:36.3514166Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.3515016Z [cluster2] "type": "string"
2021-07-11T01:40:36.3515608Z [cluster2] }
2021-07-11T01:40:36.3516120Z [cluster2] },
2021-07-11T01:40:36.3516698Z [cluster2] "type": "object"
2021-07-11T01:40:36.3517257Z [cluster2] }
2021-07-11T01:40:36.3517770Z [cluster2] },
2021-07-11T01:40:36.3518337Z [cluster2] "type": "object"
2021-07-11T01:40:36.3518899Z [cluster2] },
2021-07-11T01:40:36.3519451Z [cluster2] "type": "array"
2021-07-11T01:40:36.3519990Z [cluster2] },
2021-07-11T01:40:36.3520523Z [cluster2] "status": {
2021-07-11T01:40:36.3521534Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.3522774Z [cluster2] "properties": {
2021-07-11T01:40:36.3523618Z [cluster2] "collisionCount": {
2021-07-11T01:40:36.3525284Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.3526705Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3527333Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3527894Z [cluster2] },
2021-07-11T01:40:36.3528467Z [cluster2] "conditions": {
2021-07-11T01:40:36.3529870Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.3530812Z [cluster2] "items": {
2021-07-11T01:40:36.3531784Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.3532876Z [cluster2] "properties": {
2021-07-11T01:40:36.3533606Z [cluster2] "lastTransitionTime": {
2021-07-11T01:40:36.3534901Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.3536124Z [cluster2] "format": "date-time",
2021-07-11T01:40:36.3536793Z [cluster2] "type": "string"
2021-07-11T01:40:36.3537369Z [cluster2] },
2021-07-11T01:40:36.3537942Z [cluster2] "message": {
2021-07-11T01:40:36.3538842Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.3539760Z [cluster2] "type": "string"
2021-07-11T01:40:36.3540343Z [cluster2] },
2021-07-11T01:40:36.3540890Z [cluster2] "reason": {
2021-07-11T01:40:36.3541989Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.3542805Z [cluster2] "type": "string"
2021-07-11T01:40:36.3543389Z [cluster2] },
2021-07-11T01:40:36.3543932Z [cluster2] "status": {
2021-07-11T01:40:36.3544763Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.3545614Z [cluster2] "type": "string"
2021-07-11T01:40:36.3546181Z [cluster2] },
2021-07-11T01:40:36.3546737Z [cluster2] "type": {
2021-07-11T01:40:36.3547556Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.3548343Z [cluster2] "type": "string"
2021-07-11T01:40:36.3548956Z [cluster2] }
2021-07-11T01:40:36.3550760Z [cluster2] },
2021-07-11T01:40:36.3551526Z [cluster2] "required": [
2021-07-11T01:40:36.3552124Z [cluster2] "status",
2021-07-11T01:40:36.3552709Z [cluster2] "type"
2021-07-11T01:40:36.3553246Z [cluster2] ],
2021-07-11T01:40:36.3553835Z [cluster2] "type": "object"
2021-07-11T01:40:36.3554419Z [cluster2] },
2021-07-11T01:40:36.3554974Z [cluster2] "type": "array"
2021-07-11T01:40:36.3555532Z [cluster2] },
2021-07-11T01:40:36.3556233Z [cluster2] "currentNumberScheduled": {
2021-07-11T01:40:36.3557864Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3559339Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3559967Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3560538Z [cluster2] },
2021-07-11T01:40:36.3561249Z [cluster2] "desiredNumberScheduled": {
2021-07-11T01:40:36.3562878Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3564336Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3564965Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3565542Z [cluster2] },
2021-07-11T01:40:36.3566146Z [cluster2] "numberAvailable": {
2021-07-11T01:40:36.3567458Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3568707Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3569312Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3569892Z [cluster2] },
2021-07-11T01:40:36.3570535Z [cluster2] "numberMisscheduled": {
2021-07-11T01:40:36.3572019Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.3573387Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3574002Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3574644Z [cluster2] },
2021-07-11T01:40:36.3575229Z [cluster2] "numberReady": {
2021-07-11T01:40:36.3576278Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.3585939Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3587254Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3588498Z [cluster2] },
2021-07-11T01:40:36.3589326Z [cluster2] "numberUnavailable": {
2021-07-11T01:40:36.3590772Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.3591990Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3592626Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3593209Z [cluster2] },
2021-07-11T01:40:36.3593851Z [cluster2] "observedGeneration": {
2021-07-11T01:40:36.3595056Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.3595938Z [cluster2] "format": "int64",
2021-07-11T01:40:36.3596568Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3597152Z [cluster2] },
2021-07-11T01:40:36.3598057Z [cluster2] "updatedNumberScheduled": {
2021-07-11T01:40:36.3599081Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.3599910Z [cluster2] "format": "int32",
2021-07-11T01:40:36.3600537Z [cluster2] "type": "integer"
2021-07-11T01:40:36.3601100Z [cluster2] }
2021-07-11T01:40:36.3601613Z [cluster2] },
2021-07-11T01:40:36.3602179Z [cluster2] "required": [
2021-07-11T01:40:36.3602918Z [cluster2] "currentNumberScheduled",
2021-07-11T01:40:36.3603826Z [cluster2] "desiredNumberScheduled",
2021-07-11T01:40:36.3604667Z [cluster2] "numberMisscheduled",
2021-07-11T01:40:36.3605635Z [cluster2] "numberReady"
2021-07-11T01:40:36.3606210Z [cluster2] ],
2021-07-11T01:40:36.3606772Z [cluster2] "type": "object"
2021-07-11T01:40:36.3607345Z [cluster2] }
2021-07-11T01:40:36.3607829Z [cluster2] },
2021-07-11T01:40:36.3608373Z [cluster2] "required": [
2021-07-11T01:40:36.3609134Z [cluster2] "mismatchedContainerImages"
2021-07-11T01:40:36.3609867Z [cluster2] ],
2021-07-11T01:40:36.3610495Z [cluster2] "type": "object"
2021-07-11T01:40:36.3611048Z [cluster2] },
2021-07-11T01:40:36.3611598Z [cluster2] "serviceCIDR": {
2021-07-11T01:40:36.3612216Z [cluster2] "type": "string"
2021-07-11T01:40:36.3612756Z [cluster2] }
2021-07-11T01:40:36.3613223Z [cluster2] },
2021-07-11T01:40:36.3613751Z [cluster2] "required": [
2021-07-11T01:40:36.3614329Z [cluster2] "clusterID",
2021-07-11T01:40:36.3614965Z [cluster2] "natEnabled"
2021-07-11T01:40:36.3615495Z [cluster2] ],
2021-07-11T01:40:36.3616240Z [cluster2] "type": "object"
2021-07-11T01:40:36.3616755Z [cluster2] }
2021-07-11T01:40:36.3617228Z [cluster2] },
2021-07-11T01:40:36.3617756Z [cluster2] "type": "object"
2021-07-11T01:40:36.3618255Z [cluster2] }
2021-07-11T01:40:36.3618715Z [cluster2] },
2021-07-11T01:40:36.3619210Z [cluster2] "served": true,
2021-07-11T01:40:36.3619773Z [cluster2] "storage": true,
2021-07-11T01:40:36.3620342Z [cluster2] "subresources": {
2021-07-11T01:40:36.3620905Z [cluster2] "status": {}
2021-07-11T01:40:36.3621373Z [cluster2] }
2021-07-11T01:40:36.3621902Z [cluster2] }
2021-07-11T01:40:36.3622325Z [cluster2] ]
2021-07-11T01:40:36.3622758Z [cluster2] },
2021-07-11T01:40:36.3623202Z [cluster2] "status": {
2021-07-11T01:40:36.3623759Z [cluster2] "acceptedNames": {
2021-07-11T01:40:36.3624376Z [cluster2] "kind": "Submariner",
2021-07-11T01:40:36.3625021Z [cluster2] "listKind": "SubmarinerList",
2021-07-11T01:40:36.3625712Z [cluster2] "plural": "submariners",
2021-07-11T01:40:36.3626339Z [cluster2] "singular": "submariner"
2021-07-11T01:40:36.3627067Z [cluster2] },
2021-07-11T01:40:36.3627556Z [cluster2] "conditions": [
2021-07-11T01:40:36.3628470Z [cluster2] {
2021-07-11T01:40:36.3629480Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:36.4626499Z [cluster2] "message": "nr1] },
2021-07-11T01:40:36.4627136Z [cluster1] {
2021-07-11T01:40:36.4628444Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:36.4629282Z [cluster1] "message": "the initial names have been accepted",
2021-07-11T01:40:36.4630565Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-11T01:40:36.4631268Z [cluster1] "status": "True",
2021-07-11T01:40:36.4631949Z [cluster1] "type": "Established"
2021-07-11T01:40:36.4632475Z [cluster1] }
2021-07-11T01:40:36.4632932Z [cluster1] ],
2021-07-11T01:40:36.4633552Z [cluster1] "storedVersions": [
2021-07-11T01:40:36.4634106Z [cluster1] "v1"
2021-07-11T01:40:36.4634608Z [cluster1] ]
2021-07-11T01:40:36.4635042Z [cluster1] }
2021-07-11T01:40:36.4635458Z [cluster1] }
2021-07-11T01:40:36.4636647Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-11T01:40:36.4638291Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-11T01:40:36.4640128Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:36.4641903Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:36.4643222Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:36.4645078Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:36.4646759Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:36.4648205Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:36.4649892Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:36.4651528Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-11T01:40:36.4652889Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-11T01:40:36.4654606Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:36.4656606Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-11T01:40:36.4658226Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-11T01:40:36.4660218Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-11T01:40:36.4661874Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-11T01:40:36.4663601Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-11T01:40:36.4665327Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-11T01:40:36.4667741Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-11T01:40:36.4669523Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-11T01:40:36.4671163Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-11T01:40:36.4673065Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-11T01:40:36.4674509Z [cluster1] NAME CREATED AT
2021-07-11T01:40:36.4675873Z [cluster1] submariners.submariner.io 2021-07-11T01:35:32Z
2021-07-11T01:40:36.4677765Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:36.4680138Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-11T01:40:36.4682388Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:36.4684766Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-11T01:40:36.4686930Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-11T01:40:36.4688387Z [cluster1] {
2021-07-11T01:40:36.4689224Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:36.4690441Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-11T01:40:36.4691170Z [cluster1] "metadata": {
2021-07-11T01:40:36.4691953Z [cluster1] "annotations": {
2021-07-11T01:40:36.4693496Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-11T01:40:36.4694473Z [cluster1] },
2021-07-11T01:40:36.4695444Z [cluster1] "creationTimestamp": "2021-07-11T01:35:32Z",
2021-07-11T01:40:36.4696424Z [cluster1] "generation": 2,
2021-07-11T01:40:36.4697167Z [cluster1] "managedFields": [
2021-07-11T01:40:36.4697973Z [cluster1] {
2021-07-11T01:40:36.4698940Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-11T01:40:36.4699969Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:36.4700710Z [cluster1] "fieldsV1": {
2021-07-11T01:40:36.4701505Z [cluster1] "f:metadata": {
2021-07-11T01:40:36.4702438Z [cluster1] "f:annotations": {
2021-07-11T01:40:36.4703200Z [cluster1] ".": {},
2021-07-11T01:40:36.4704782Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-11T01:40:36.4714339Z [cluster1] }
2021-07-11T01:40:36.4714834Z [cluster1] },
2021-07-11T01:40:36.4715687Z [cluster1] "f:spec": {
2021-07-11T01:40:36.4716410Z [cluster1] "f:conversion": {
2021-07-11T01:40:36.4717082Z [cluster1] ".": {},
2021-07-11T01:40:36.4717759Z [cluster1] "f:strategy": {}
2021-07-11T01:40:36.4718423Z [cluster1] },
2021-07-11T01:40:36.4719362Z [cluster1] "f:group": {},
2021-07-11T01:40:36.4720014Z [cluster1] "f:names": {
2021-07-11T01:40:36.4720724Z [cluster1] "f:kind": {},
2021-07-11T01:40:36.4721430Z [cluster1] "f:listKind": {},
2021-07-11T01:40:36.4722175Z [cluster1] "f:plural": {},
2021-07-11T01:40:36.4724047Z [cluster1] "f:singular": {}
2021-07-11T01:40:36.4725100Z [cluster1] },
2021-07-11T01:40:36.4725802Z [cluster1] "f:scope": {},
2021-07-11T01:40:36.4726341Z [cluster1] "f:versions": {}
2021-07-11T01:40:36.4727450Z [cluster1] },
2021-07-11T01:40:36.4728022Z [cluster1] "f:status": {
2021-07-11T01:40:36.4728625Z [cluster1] "f:acceptedNames": {
2021-07-11T01:40:36.4729210Z [cluster1] "f:kind": {},
2021-07-11T01:40:36.4729928Z [cluster1] "f:plural": {}
2021-07-11T01:40:36.4730421Z [cluster1] },
2021-07-11T01:40:36.4730958Z [cluster1] "f:conditions": {},
2021-07-11T01:40:36.4731598Z [cluster1] "f:storedVersions": {}
2021-07-11T01:40:36.4732148Z [cluster1] }
2021-07-11T01:40:36.4732605Z [cluster1] },
2021-07-11T01:40:36.4733123Z [cluster1] "manager": "subctl",
2021-07-11T01:40:36.4733985Z [cluster1] "operation": "Update",
2021-07-11T01:40:36.4735033Z [cluster1] "time": "2021-07-11T01:35:44Z"
2021-07-11T01:40:36.4735537Z [cluster1] }
2021-07-11T01:40:36.4735966Z [cluster1] ],
2021-07-11T01:40:36.4736653Z [cluster1] "name": "submariners.submariner.io",
2021-07-11T01:40:36.4737436Z [cluster1] "resourceVersion": "2114",
2021-07-11T01:40:36.4738450Z [cluster1] "uid": "8cebc957-ca79-407a-b179-c6ec11a0f5e6"
2021-07-11T01:40:36.4739143Z [cluster1] },
2021-07-11T01:40:36.4739591Z [cluster1] "spec": {
2021-07-11T01:40:36.4740115Z [cluster1] "conversion": {
2021-07-11T01:40:36.4740665Z [cluster1] "strategy": "None"
2021-07-11T01:40:36.4741171Z [cluster1] },
2021-07-11T01:40:36.4741703Z [cluster1] "group": "submariner.io",
2021-07-11T01:40:36.4742278Z [cluster1] "names": {
2021-07-11T01:40:36.4742815Z [cluster1] "kind": "Submariner",
2021-07-11T01:40:36.4743482Z [cluster1] "listKind": "SubmarinerList",
2021-07-11T01:40:36.4744151Z [cluster1] "plural": "submariners",
2021-07-11T01:40:36.4744797Z [cluster1] "singular": "submariner"
2021-07-11T01:40:36.4745322Z [cluster1] },
2021-07-11T01:40:36.4745854Z [cluster1] "scope": "Namespaced",
2021-07-11T01:40:36.4746426Z [cluster1] "versions": [
2021-07-11T01:40:36.4746907Z [cluster1] {
2021-07-11T01:40:36.4747427Z [cluster1] "name": "v1alpha1",
2021-07-11T01:40:36.4747960Z [cluster1] "schema": {
2021-07-11T01:40:36.4748571Z [cluster1] "openAPIV3Schema": {
2021-07-11T01:40:36.4749414Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-11T01:40:36.4750413Z [cluster1] "properties": {
2021-07-11T01:40:36.4751540Z [cluster1] "apiVersion": {
2021-07-11T01:40:36.4754807Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-11T01:40:36.4757194Z [cluster1] "type": "string"
2021-07-11T01:40:36.4757768Z [cluster1] },
2021-07-11T01:40:36.4758602Z [cluster1] "kind": {
2021-07-11T01:40:36.4761706Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-11T01:40:36.4764086Z [cluster1] "type": "string"
2021-07-11T01:40:36.4764774Z [cluster1] },
2021-07-11T01:40:36.4765316Z [cluster1] "metadata": {
2021-07-11T01:40:36.4766037Z [cluster1] "type": "object"
2021-07-11T01:40:36.4766571Z [cluster1] },
2021-07-11T01:40:36.4767058Z [cluster1] "spec": {
2021-07-11T01:40:36.4768072Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-11T01:40:36.4769111Z [cluster1] "properties": {
2021-07-11T01:40:36.4769696Z [cluster1] "broker": {
2021-07-11T01:40:36.4770298Z [cluster1] "type": "string"
2021-07-11T01:40:36.4770838Z [cluster1] },
2021-07-11T01:40:36.4771648Z [cluster1] "brokerK8sApiServer": {
2021-07-11T01:40:36.4772347Z [cluster1] "type": "string"
2021-07-11T01:40:36.4772894Z [cluster1] },
2021-07-11T01:40:36.4773594Z [cluster1] "brokerK8sApiServerToken": {
2021-07-11T01:40:36.4774364Z [cluster1] "type": "string"
2021-07-11T01:40:36.4774911Z [cluster1] },
2021-07-11T01:40:36.4775455Z [cluster1] "brokerK8sCA": {
2021-07-11T01:40:36.4776062Z [cluster1] "type": "string"
2021-07-11T01:40:36.4776589Z [cluster1] },
2021-07-11T01:40:36.4777306Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-11T01:40:36.4778056Z [cluster1] "type": "string"
2021-07-11T01:40:36.4779064Z [cluster1] },
2021-07-11T01:40:36.4779631Z [cluster1] "cableDriver": {
2021-07-11T01:40:36.4780219Z [cluster1] "type": "string"
2021-07-11T01:40:36.4780757Z [cluster1] },
2021-07-11T01:40:36.4781332Z [cluster1] "ceIPSecDebug": {
2021-07-11T01:40:36.4781968Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4782511Z [cluster1] },
2021-07-11T01:40:36.4783197Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-11T01:40:36.4783931Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4784713Z [cluster1] },
2021-07-11T01:40:36.4785317Z [cluster1] "ceIPSecIKEPort": {
2021-07-11T01:40:36.4786196Z [cluster1] "type": "integer"
2021-07-11T01:40:36.4786869Z [cluster1] },
2021-07-11T01:40:36.4787469Z [cluster1] "ceIPSecNATTPort": {
2021-07-11T01:40:36.4788138Z [cluster1] "type": "integer"
2021-07-11T01:40:36.4788673Z [cluster1] },
2021-07-11T01:40:36.4789240Z [cluster1] "ceIPSecPSK": {
2021-07-11T01:40:36.4789859Z [cluster1] "type": "string"
2021-07-11T01:40:36.4790643Z [cluster1] },
2021-07-11T01:40:36.4791356Z [cluster1] "ceIPSecPreferredServer": {
2021-07-11T01:40:36.4793287Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4794025Z [cluster1] },
2021-07-11T01:40:36.4794578Z [cluster1] "clusterCIDR": {
2021-07-11T01:40:36.4795373Z [cluster1] "type": "string"
2021-07-11T01:40:36.4795898Z [cluster1] },
2021-07-11T01:40:36.4796445Z [cluster1] "clusterID": {
2021-07-11T01:40:36.4797851Z [cluster1] "type": "string"
2021-07-11T01:40:36.4798395Z [cluster1] },
2021-07-11T01:40:36.4799465Z [cluster1] "colorCodes": {
2021-07-11T01:40:36.4800370Z [cluster1] "type": "string"
2021-07-11T01:40:36.4800914Z [cluster1] },
2021-07-11T01:40:36.4801576Z [cluster1] "connectionHealthCheck": {
2021-07-11T01:40:36.4802323Z [cluster1] "properties": {
2021-07-11T01:40:36.4802920Z [cluster1] "enabled": {
2021-07-11T01:40:36.4805252Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4806033Z [cluster1] },
2021-07-11T01:40:36.4806633Z [cluster1] "intervalSeconds": {
2021-07-11T01:40:36.4807504Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-11T01:40:36.4808482Z [cluster1] "format": "int64",
2021-07-11T01:40:36.4809122Z [cluster1] "type": "integer"
2021-07-11T01:40:36.4809665Z [cluster1] },
2021-07-11T01:40:36.4810309Z [cluster1] "maxPacketLossCount": {
2021-07-11T01:40:36.4811370Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-11T01:40:36.4812321Z [cluster1] "format": "int64",
2021-07-11T01:40:36.4812940Z [cluster1] "type": "integer"
2021-07-11T01:40:36.4813483Z [cluster1] }
2021-07-11T01:40:36.4813982Z [cluster1] },
2021-07-11T01:40:36.4814532Z [cluster1] "type": "object"
2021-07-11T01:40:36.4815062Z [cluster1] },
2021-07-11T01:40:36.4815716Z [cluster1] "coreDNSCustomConfig": {
2021-07-11T01:40:36.4816618Z [cluster1] "properties": {
2021-07-11T01:40:36.4817282Z [cluster1] "configMapName": {
2021-07-11T01:40:36.4818140Z [cluster1] "type": "string"
2021-07-11T01:40:36.4819052Z [cluster1] },
2021-07-11T01:40:36.4819623Z [cluster1] "namespace": {
2021-07-11T01:40:36.4820217Z [cluster1] "type": "string"
2021-07-11T01:40:36.4820771Z [cluster1] }
2021-07-11T01:40:36.4821932Z [cluster1] },
2021-07-11T01:40:36.4822498Z [cluster1] "type": "object"
2021-07-11T01:40:36.4823035Z [cluster1] },
2021-07-11T01:40:36.4823613Z [cluster1] "customDomains": {
2021-07-11T01:40:36.4824202Z [cluster1] "items": {
2021-07-11T01:40:36.4824785Z [cluster1] "type": "string"
2021-07-11T01:40:36.4825331Z [cluster1] },
2021-07-11T01:40:36.4825865Z [cluster1] "type": "array",
2021-07-11T01:40:36.4828421Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-11T01:40:36.4830640Z [cluster1] },
2021-07-11T01:40:36.4831162Z [cluster1] "debug": {
2021-07-11T01:40:36.4831727Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4832275Z [cluster1] },
2021-07-11T01:40:36.4832824Z [cluster1] "globalCIDR": {
2021-07-11T01:40:36.4833898Z [cluster1] "type": "string"
2021-07-11T01:40:36.4834456Z [cluster1] },
2021-07-11T01:40:36.4835031Z [cluster1] "imageOverrides": {
2021-07-11T01:40:36.4836101Z [cluster1] "additionalProperties": {
2021-07-11T01:40:36.4837026Z [cluster1] "type": "string"
2021-07-11T01:40:36.4837592Z [cluster1] },
2021-07-11T01:40:36.4838126Z [cluster1] "type": "object"
2021-07-11T01:40:36.4838666Z [cluster1] },
2021-07-11T01:40:36.4839311Z [cluster1] "loadBalancerEnabled": {
2021-07-11T01:40:36.4841679Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4855624Z [cluster1] },
2021-07-11T01:40:36.4857144Z [cluster1] "namespace": {
2021-07-11T01:40:36.4857763Z [cluster1] "type": "string"
2021-07-11T01:40:36.4858298Z [cluster1] },
2021-07-11T01:40:36.4858849Z [cluster1] "natEnabled": {
2021-07-11T01:40:36.4859445Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4860011Z [cluster1] },
2021-07-11T01:40:36.4860560Z [cluster1] "repository": {
2021-07-11T01:40:36.4861347Z [cluster1] "type": "string"
2021-07-11T01:40:36.4862089Z [cluster1] },
2021-07-11T01:40:36.4862639Z [cluster1] "serviceCIDR": {
2021-07-11T01:40:36.4863250Z [cluster1] "type": "string"
2021-07-11T01:40:36.4863784Z [cluster1] },
2021-07-11T01:40:36.4864492Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-11T01:40:36.4865244Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4865788Z [cluster1] },
2021-07-11T01:40:36.4866313Z [cluster1] "version": {
2021-07-11T01:40:36.4867047Z [cluster1] "type": "string"
2021-07-11T01:40:36.4867589Z [cluster1] }
2021-07-11T01:40:36.4868056Z [cluster1] },
2021-07-11T01:40:36.4868579Z [cluster1] "required": [
2021-07-11T01:40:36.4869120Z [cluster1] "broker",
2021-07-11T01:40:36.4870468Z [cluster1] "brokerK8sApiServer",
2021-07-11T01:40:36.4871793Z [cluster1] "brokerK8sApiServerToken",
2021-07-11T01:40:36.4872844Z [cluster1] "brokerK8sCA",
2021-07-11T01:40:36.4873631Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-11T01:40:36.4874420Z [cluster1] "ceIPSecDebug",
2021-07-11T01:40:36.4875068Z [cluster1] "ceIPSecPSK",
2021-07-11T01:40:36.4875685Z [cluster1] "clusterCIDR",
2021-07-11T01:40:36.4876289Z [cluster1] "clusterID",
2021-07-11T01:40:36.4876838Z [cluster1] "debug",
2021-07-11T01:40:36.4877410Z [cluster1] "namespace",
2021-07-11T01:40:36.4878008Z [cluster1] "natEnabled",
2021-07-11T01:40:36.4878611Z [cluster1] "serviceCIDR"
2021-07-11T01:40:36.4879162Z [cluster1] ],
2021-07-11T01:40:36.4879799Z [cluster1] "type": "object"
2021-07-11T01:40:36.4880326Z [cluster1] },
2021-07-11T01:40:36.4880817Z [cluster1] "status": {
2021-07-11T01:40:36.4881689Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-11T01:40:36.4882578Z [cluster1] "properties": {
2021-07-11T01:40:36.4883202Z [cluster1] "clusterCIDR": {
2021-07-11T01:40:36.4883812Z [cluster1] "type": "string"
2021-07-11T01:40:36.4884337Z [cluster1] },
2021-07-11T01:40:36.4884882Z [cluster1] "clusterID": {
2021-07-11T01:40:36.4885456Z [cluster1] "type": "string"
2021-07-11T01:40:36.4900257Z [cluster1] },
2021-07-11T01:40:36.4901090Z [cluster1] "colorCodes": {
2021-07-11T01:40:36.4901714Z [cluster1] "type": "string"
2021-07-11T01:40:36.4902249Z [cluster1] },
2021-07-11T01:40:36.4911580Z [cluster1] "deploymentInfo": {
2021-07-11T01:40:36.4913008Z [cluster1] "properties": {
2021-07-11T01:40:36.4913842Z [cluster1] "cloudProvider": {
2021-07-11T01:40:36.4914667Z [cluster1] "type": "string"
2021-07-11T01:40:36.4915374Z [cluster1] },
2021-07-11T01:40:36.4916140Z [cluster1] "kubernetesType": {
2021-07-11T01:40:36.4916940Z [cluster1] "type": "string"
2021-07-11T01:40:36.4917651Z [cluster1] },
2021-07-11T01:40:36.4918512Z [cluster1] "kubernetesTypeVersion": {
2021-07-11T01:40:36.4919406Z [cluster1] "type": "string"
2021-07-11T01:40:36.4920121Z [cluster1] },
2021-07-11T01:40:36.4921086Z [cluster1] "kubernetesVersion": {
2021-07-11T01:40:36.4922208Z [cluster1] "type": "string"
2021-07-11T01:40:36.4923403Z [cluster1] }
2021-07-11T01:40:36.4924163Z [cluster1] },
2021-07-11T01:40:36.4924941Z [cluster1] "type": "object"
2021-07-11T01:40:36.4925870Z [cluster1] },
2021-07-11T01:40:36.4927209Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-11T01:40:36.4928234Z [cluster1] "properties": {
2021-07-11T01:40:36.4929302Z [cluster1] "lastResourceVersion": {
2021-07-11T01:40:36.4959300Z [cluster1] "type": "string"
2021-07-11T01:40:36.4959892Z [cluster1] },
2021-07-11T01:40:36.4960632Z [cluster1] "mismatchedContainerImages": {
2021-07-11T01:40:36.4961475Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.4962117Z [cluster1] },
2021-07-11T01:40:36.4962828Z [cluster1] "nonReadyContainerStates": {
2021-07-11T01:40:36.4963576Z [cluster1] "items": {
2021-07-11T01:40:36.4965786Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.4967378Z [cluster1] "properties": {
2021-07-11T01:40:36.4969066Z [cluster1] "running": {
2021-07-11T01:40:36.4970282Z [cluster1] "description": "Details about a running container",
2021-07-11T01:40:36.4972690Z [cluster1] "properties": {
2021-07-11T01:40:36.4973727Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5005413Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.5006534Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5007208Z [cluster1] "type": "string"
2021-07-11T01:40:36.5007804Z [cluster1] }
2021-07-11T01:40:36.5008346Z [cluster1] },
2021-07-11T01:40:36.5008919Z [cluster1] "type": "object"
2021-07-11T01:40:36.5009507Z [cluster1] },
2021-07-11T01:40:36.5010083Z [cluster1] "terminated": {
2021-07-11T01:40:36.5010896Z [cluster1] "description": "Details about a terminated container",
2021-07-11T01:40:36.5011701Z [cluster1] "properties": {
2021-07-11T01:40:36.5012376Z [cluster1] "containerID": {
2021-07-11T01:40:36.5013582Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.5014453Z [cluster1] "type": "string"
2021-07-11T01:40:36.5015050Z [cluster1] },
2021-07-11T01:40:36.5015818Z [cluster1] "exitCode": {
2021-07-11T01:40:36.5016679Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.5017672Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5018311Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5019023Z [cluster1] },
2021-07-11T01:40:36.5019622Z [cluster1] "finishedAt": {
2021-07-11T01:40:36.5020454Z [cluster1] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.5036492Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5037164Z [cluster1] "type": "string"
2021-07-11T01:40:36.5037755Z [cluster1] },
2021-07-11T01:40:36.5038331Z [cluster1] "message": {
2021-07-11T01:40:36.5039194Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.5040236Z [cluster1] "type": "string"
2021-07-11T01:40:36.5040950Z [cluster1] },
2021-07-11T01:40:36.5041520Z [cluster1] "reason": {
2021-07-11T01:40:36.5042359Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.5043222Z [cluster1] "type": "string"
2021-07-11T01:40:36.5043880Z [cluster1] },
2021-07-11T01:40:36.5044432Z [cluster1] "signal": {
2021-07-11T01:40:36.5045467Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.5046294Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5047016Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5047609Z [cluster1] },
2021-07-11T01:40:36.5048187Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5049072Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.5050261Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5050931Z [cluster1] "type": "string"
2021-07-11T01:40:36.5051518Z [cluster1] }
2021-07-11T01:40:36.5052040Z [cluster1] },
2021-07-11T01:40:36.5052619Z [cluster1] "required": [
2021-07-11T01:40:36.5053314Z [cluster1] "exitCode"
2021-07-11T01:40:36.5054009Z [cluster1] ],
2021-07-11T01:40:36.5054588Z [cluster1] "type": "object"
2021-07-11T01:40:36.5055167Z [cluster1] },
2021-07-11T01:40:36.5055731Z [cluster1] "waiting": {
2021-07-11T01:40:36.5056485Z [cluster1] "description": "Details about a waiting container",
2021-07-11T01:40:36.5057289Z [cluster1] "properties": {
2021-07-11T01:40:36.5057910Z [cluster1] "message": {
2021-07-11T01:40:36.5058765Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.5059625Z [cluster1] "type": "string"
2021-07-11T01:40:36.5060199Z [cluster1] },
2021-07-11T01:40:36.5060766Z [cluster1] "reason": {
2021-07-11T01:40:36.5061560Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.5062376Z [cluster1] "type": "string"
2021-07-11T01:40:36.5063009Z [cluster1] }
2021-07-11T01:40:36.5063540Z [cluster1] },
2021-07-11T01:40:36.5064120Z [cluster1] "type": "object"
2021-07-11T01:40:36.5064676Z [cluster1] }
2021-07-11T01:40:36.5065199Z [cluster1] },
2021-07-11T01:40:36.5065756Z [cluster1] "type": "object"
2021-07-11T01:40:36.5066320Z [cluster1] },
2021-07-11T01:40:36.5066860Z [cluster1] "type": "array"
2021-07-11T01:40:36.5067406Z [cluster1] },
2021-07-11T01:40:36.5067939Z [cluster1] "status": {
2021-07-11T01:40:36.5068822Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.5069749Z [cluster1] "properties": {
2021-07-11T01:40:36.5071856Z [cluster1] "collisionCount": {
2021-07-11T01:40:36.5073430Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.5074837Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5075456Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5076041Z [cluster1] },
2021-07-11T01:40:36.5076609Z [cluster1] "conditions": {
2021-07-11T01:40:36.5078026Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.5078973Z [cluster1] "items": {
2021-07-11T01:40:36.5080065Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.5081074Z [cluster1] "properties": {
2021-07-11T01:40:36.5081803Z [cluster1] "lastTransitionTime": {
2021-07-11T01:40:36.5082782Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.5083960Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5084611Z [cluster1] "type": "string"
2021-07-11T01:40:36.5085196Z [cluster1] },
2021-07-11T01:40:36.5085761Z [cluster1] "message": {
2021-07-11T01:40:36.5086678Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.5087599Z [cluster1] "type": "string"
2021-07-11T01:40:36.5088166Z [cluster1] },
2021-07-11T01:40:36.5088733Z [cluster1] "reason": {
2021-07-11T01:40:36.5089909Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.5090732Z [cluster1] "type": "string"
2021-07-11T01:40:36.5091308Z [cluster1] },
2021-07-11T01:40:36.5092344Z [cluster1] "status": {
2021-07-11T01:40:36.5093189Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.5094013Z [cluster1] "type": "string"
2021-07-11T01:40:36.5094589Z [cluster1] },
2021-07-11T01:40:36.5095145Z [cluster1] "type": {
2021-07-11T01:40:36.5095887Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.5096662Z [cluster1] "type": "string"
2021-07-11T01:40:36.5097232Z [cluster1] }
2021-07-11T01:40:36.5097764Z [cluster1] },
2021-07-11T01:40:36.5098327Z [cluster1] "required": [
2021-07-11T01:40:36.5098969Z [cluster1] "status",
2021-07-11T01:40:36.5099548Z [cluster1] "type"
2021-07-11T01:40:36.5100080Z [cluster1] ],
2021-07-11T01:40:36.5100655Z [cluster1] "type": "object"
2021-07-11T01:40:36.5101307Z [cluster1] },
2021-07-11T01:40:36.5101873Z [cluster1] "type": "array"
2021-07-11T01:40:36.5102478Z [cluster1] },
2021-07-11T01:40:36.5103198Z [cluster1] "currentNumberScheduled": {
2021-07-11T01:40:36.5104838Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5106206Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5106843Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5107426Z [cluster1] },
2021-07-11T01:40:36.5108129Z [cluster1] "desiredNumberScheduled": {
2021-07-11T01:40:36.5109750Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5111289Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5111909Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5112488Z [cluster1] },
2021-07-11T01:40:36.5113102Z [cluster1] "numberAvailable": {
2021-07-11T01:40:36.5114420Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5115736Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5116344Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5116921Z [cluster1] },
2021-07-11T01:40:36.5117562Z [cluster1] "numberMisscheduled": {
2021-07-11T01:40:36.5119025Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5120393Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5121018Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5121599Z [cluster1] },
2021-07-11T01:40:36.5148212Z [cluster1] "numberReady": {
2021-07-11T01:40:36.5149324Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.5150502Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5162548Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5163157Z [cluster1] },
2021-07-11T01:40:36.5163799Z [cluster1] "numberUnavailable": {
2021-07-11T01:40:36.5165126Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5166366Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5166981Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5167738Z [cluster1] },
2021-07-11T01:40:36.5168392Z [cluster1] "observedGeneration": {
2021-07-11T01:40:36.5169396Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.5170288Z [cluster1] "format": "int64",
2021-07-11T01:40:36.5170985Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5171574Z [cluster1] },
2021-07-11T01:40:36.5172456Z [cluster1] "updatedNumberScheduled": {
2021-07-11T01:40:36.5173469Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.5174299Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5174928Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5175511Z [cluster1] }
2021-07-11T01:40:36.5176010Z [cluster1] },
2021-07-11T01:40:36.5176562Z [cluster1] "required": [
2021-07-11T01:40:36.5177302Z [cluster1] "currentNumberScheduled",
2021-07-11T01:40:36.5178304Z [cluster1] "desiredNumberScheduled",
2021-07-11T01:40:36.5179139Z [cluster1] "numberMisscheduled",
2021-07-11T01:40:36.5179858Z [cluster1] "numberReady"
2021-07-11T01:40:36.5180641Z [cluster1] ],
2021-07-11T01:40:36.5181194Z [cluster1] "type": "object"
2021-07-11T01:40:36.5181752Z [cluster1] }
2021-07-11T01:40:36.5182237Z [cluster1] },
2021-07-11T01:40:36.5182780Z [cluster1] "required": [
2021-07-11T01:40:36.5183553Z [cluster1] "mismatchedContainerImages"
2021-07-11T01:40:36.5184285Z [cluster1] ],
2021-07-11T01:40:36.5184837Z [cluster1] "type": "object"
2021-07-11T01:40:36.5185365Z [cluster1] },
2021-07-11T01:40:36.5185903Z [cluster1] "gateways": {
2021-07-11T01:40:36.5186447Z [cluster1] "items": {
2021-07-11T01:40:36.5187038Z [cluster1] "properties": {
2021-07-11T01:40:36.5187665Z [cluster1] "connections": {
2021-07-11T01:40:36.5188266Z [cluster1] "items": {
2021-07-11T01:40:36.5188863Z [cluster1] "properties": {
2021-07-11T01:40:36.5189503Z [cluster1] "endpoint": {
2021-07-11T01:40:36.5190259Z [cluster1] "properties": {
2021-07-11T01:40:36.5190891Z [cluster1] "backend": {
2021-07-11T01:40:36.5191520Z [cluster1] "type": "string"
2021-07-11T01:40:36.5192091Z [cluster1] },
2021-07-11T01:40:36.5192697Z [cluster1] "backend_config": {
2021-07-11T01:40:36.5193928Z [cluster1] "additionalProperties": {
2021-07-11T01:40:36.5194674Z [cluster1] "type": "string"
2021-07-11T01:40:36.5195271Z [cluster1] },
2021-07-11T01:40:36.5195856Z [cluster1] "type": "object"
2021-07-11T01:40:36.5196449Z [cluster1] },
2021-07-11T01:40:36.5197019Z [cluster1] "cable_name": {
2021-07-11T01:40:36.5197646Z [cluster1] "type": "string"
2021-07-11T01:40:36.5198236Z [cluster1] },
2021-07-11T01:40:36.5198812Z [cluster1] "cluster_id": {
2021-07-11T01:40:36.5199484Z [cluster1] "type": "string"
2021-07-11T01:40:36.5200060Z [cluster1] },
2021-07-11T01:40:36.5200687Z [cluster1] "healthCheckIP": {
2021-07-11T01:40:36.5201371Z [cluster1] "type": "string"
2021-07-11T01:40:36.5202019Z [cluster1] },
2021-07-11T01:40:36.5202607Z [cluster1] "hostname": {
2021-07-11T01:40:36.5203227Z [cluster1] "type": "string"
2021-07-11T01:40:36.5203821Z [cluster1] },
2021-07-11T01:40:36.5204392Z [cluster1] "nat_enabled": {
2021-07-11T01:40:36.5205044Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5205635Z [cluster1] },
2021-07-11T01:40:36.5206200Z [cluster1] "private_ip": {
2021-07-11T01:40:36.5206833Z [cluster1] "type": "string"
2021-07-11T01:40:36.5207412Z [cluster1] },
2021-07-11T01:40:36.5207990Z [cluster1] "public_ip": {
2021-07-11T01:40:36.5208624Z [cluster1] "type": "string"
2021-07-11T01:40:36.5209198Z [cluster1] },
2021-07-11T01:40:36.5209768Z [cluster1] "subnets": {
2021-07-11T01:40:36.5210356Z [cluster1] "items": {
2021-07-11T01:40:36.5211111Z [cluster1] "type": "string"
2021-07-11T01:40:36.5211688Z [cluster1] },
2021-07-11T01:40:36.5212282Z [cluster1] "type": "array"
2021-07-11T01:40:36.5212866Z [cluster1] }
2021-07-11T01:40:36.5213383Z [cluster1] },
2021-07-11T01:40:36.5214053Z [cluster1] "required": [
2021-07-11T01:40:36.5214664Z [cluster1] "backend",
2021-07-11T01:40:36.5215276Z [cluster1] "cable_name",
2021-07-11T01:40:36.5215896Z [cluster1] "cluster_id",
2021-07-11T01:40:36.5216501Z [cluster1] "hostname",
2021-07-11T01:40:36.5217132Z [cluster1] "nat_enabled",
2021-07-11T01:40:36.5217749Z [cluster1] "private_ip",
2021-07-11T01:40:36.5218366Z [cluster1] "public_ip",
2021-07-11T01:40:36.5218965Z [cluster1] "subnets"
2021-07-11T01:40:36.5219542Z [cluster1] ],
2021-07-11T01:40:36.5220121Z [cluster1] "type": "object"
2021-07-11T01:40:36.5220685Z [cluster1] },
2021-07-11T01:40:36.5221275Z [cluster1] "latencyRTT": {
2021-07-11T01:40:36.5222379Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-11T01:40:36.5223537Z [cluster1] "properties": {
2021-07-11T01:40:36.5224175Z [cluster1] "average": {
2021-07-11T01:40:36.5224785Z [cluster1] "type": "string"
2021-07-11T01:40:36.5225383Z [cluster1] },
2021-07-11T01:40:36.5225927Z [cluster1] "last": {
2021-07-11T01:40:36.5226535Z [cluster1] "type": "string"
2021-07-11T01:40:36.5227105Z [cluster1] },
2021-07-11T01:40:36.5227657Z [cluster1] "max": {
2021-07-11T01:40:36.5228268Z [cluster1] "type": "string"
2021-07-11T01:40:36.5228843Z [cluster1] },
2021-07-11T01:40:36.5229392Z [cluster1] "min": {
2021-07-11T01:40:36.5229987Z [cluster1] "type": "string"
2021-07-11T01:40:36.5258721Z [cluster1] },
2021-07-11T01:40:36.5259405Z [cluster1] "stdDev": {
2021-07-11T01:40:36.5260043Z [cluster1] "type": "string"
2021-07-11T01:40:36.5260633Z [cluster1] }
2021-07-11T01:40:36.5261175Z [cluster1] },
2021-07-11T01:40:36.5261765Z [cluster1] "type": "object"
2021-07-11T01:40:36.5262328Z [cluster1] },
2021-07-11T01:40:36.5262890Z [cluster1] "status": {
2021-07-11T01:40:36.5263655Z [cluster1] "type": "string"
2021-07-11T01:40:36.5264230Z [cluster1] },
2021-07-11T01:40:36.5264942Z [cluster1] "statusMessage": {
2021-07-11T01:40:36.5265595Z [cluster1] "type": "string"
2021-07-11T01:40:36.5266170Z [cluster1] },
2021-07-11T01:40:36.5266735Z [cluster1] "usingIP": {
2021-07-11T01:40:36.5267352Z [cluster1] "type": "string"
2021-07-11T01:40:36.5267936Z [cluster1] },
2021-07-11T01:40:36.5268589Z [cluster1] "usingNAT": {
2021-07-11T01:40:36.5269301Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5269879Z [cluster1] }
2021-07-11T01:40:36.5270617Z [cluster1] },
2021-07-11T01:40:36.5271181Z [cluster1] "required": [
2021-07-11T01:40:36.5271799Z [cluster1] "endpoint",
2021-07-11T01:40:36.5272404Z [cluster1] "status",
2021-07-11T01:40:36.5273119Z [cluster1] "statusMessage"
2021-07-11T01:40:36.5273733Z [cluster1] ],
2021-07-11T01:40:36.5274292Z [cluster1] "type": "object"
2021-07-11T01:40:36.5274858Z [cluster1] },
2021-07-11T01:40:36.5275410Z [cluster1] "type": "array"
2021-07-11T01:40:36.5275966Z [cluster1] },
2021-07-11T01:40:36.5276524Z [cluster1] "haStatus": {
2021-07-11T01:40:36.5277113Z [cluster1] "type": "string"
2021-07-11T01:40:36.5277672Z [cluster1] },
2021-07-11T01:40:36.5278257Z [cluster1] "localEndpoint": {
2021-07-11T01:40:36.5278923Z [cluster1] "properties": {
2021-07-11T01:40:36.5279522Z [cluster1] "backend": {
2021-07-11T01:40:36.5280126Z [cluster1] "type": "string"
2021-07-11T01:40:36.5297042Z [cluster1] },
2021-07-11T01:40:36.5297734Z [cluster1] "backend_config": {
2021-07-11T01:40:36.5298601Z [cluster1] "additionalProperties": {
2021-07-11T01:40:36.5299377Z [cluster1] "type": "string"
2021-07-11T01:40:36.5299964Z [cluster1] },
2021-07-11T01:40:36.5300534Z [cluster1] "type": "object"
2021-07-11T01:40:36.5301124Z [cluster1] },
2021-07-11T01:40:36.5301696Z [cluster1] "cable_name": {
2021-07-11T01:40:36.5302293Z [cluster1] "type": "string"
2021-07-11T01:40:36.5302865Z [cluster1] },
2021-07-11T01:40:36.5303667Z [cluster1] "cluster_id": {
2021-07-11T01:40:36.5304300Z [cluster1] "type": "string"
2021-07-11T01:40:36.5304941Z [cluster1] },
2021-07-11T01:40:36.5305558Z [cluster1] "healthCheckIP": {
2021-07-11T01:40:36.5306223Z [cluster1] "type": "string"
2021-07-11T01:40:36.5306784Z [cluster1] },
2021-07-11T01:40:36.5307354Z [cluster1] "hostname": {
2021-07-11T01:40:36.5307960Z [cluster1] "type": "string"
2021-07-11T01:40:36.5308528Z [cluster1] },
2021-07-11T01:40:36.5309093Z [cluster1] "nat_enabled": {
2021-07-11T01:40:36.5309792Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5310548Z [cluster1] },
2021-07-11T01:40:36.5311106Z [cluster1] "private_ip": {
2021-07-11T01:40:36.5311731Z [cluster1] "type": "string"
2021-07-11T01:40:36.5312380Z [cluster1] },
2021-07-11T01:40:36.5312947Z [cluster1] "public_ip": {
2021-07-11T01:40:36.5313541Z [cluster1] "type": "string"
2021-07-11T01:40:36.5314122Z [cluster1] },
2021-07-11T01:40:36.5314687Z [cluster1] "subnets": {
2021-07-11T01:40:36.5315260Z [cluster1] "items": {
2021-07-11T01:40:36.5315866Z [cluster1] "type": "string"
2021-07-11T01:40:36.5316437Z [cluster1] },
2021-07-11T01:40:36.5317018Z [cluster1] "type": "array"
2021-07-11T01:40:36.5317577Z [cluster1] }
2021-07-11T01:40:36.5318102Z [cluster1] },
2021-07-11T01:40:36.5318668Z [cluster1] "required": [
2021-07-11T01:40:36.5319253Z [cluster1] "backend",
2021-07-11T01:40:36.5319855Z [cluster1] "cable_name",
2021-07-11T01:40:36.5320446Z [cluster1] "cluster_id",
2021-07-11T01:40:36.5321047Z [cluster1] "hostname",
2021-07-11T01:40:36.5321636Z [cluster1] "nat_enabled",
2021-07-11T01:40:36.5322253Z [cluster1] "private_ip",
2021-07-11T01:40:36.5322859Z [cluster1] "public_ip",
2021-07-11T01:40:36.5323447Z [cluster1] "subnets"
2021-07-11T01:40:36.5324002Z [cluster1] ],
2021-07-11T01:40:36.5324559Z [cluster1] "type": "object"
2021-07-11T01:40:36.5325120Z [cluster1] },
2021-07-11T01:40:36.5325734Z [cluster1] "statusFailure": {
2021-07-11T01:40:36.5326552Z [cluster1] "type": "string"
2021-07-11T01:40:36.5327118Z [cluster1] },
2021-07-11T01:40:36.5327647Z [cluster1] "version": {
2021-07-11T01:40:36.5328241Z [cluster1] "type": "string"
2021-07-11T01:40:36.5328786Z [cluster1] }
2021-07-11T01:40:36.5329299Z [cluster1] },
2021-07-11T01:40:36.5329832Z [cluster1] "required": [
2021-07-11T01:40:36.5330448Z [cluster1] "connections",
2021-07-11T01:40:36.5331045Z [cluster1] "haStatus",
2021-07-11T01:40:36.5331680Z [cluster1] "localEndpoint",
2021-07-11T01:40:36.5332362Z [cluster1] "statusFailure",
2021-07-11T01:40:36.5332971Z [cluster1] "version"
2021-07-11T01:40:36.5333514Z [cluster1] ],
2021-07-11T01:40:36.5334057Z [cluster1] "type": "object"
2021-07-11T01:40:36.5334610Z [cluster1] },
2021-07-11T01:40:36.5335142Z [cluster1] "type": "array"
2021-07-11T01:40:36.5335738Z [cluster1] },
2021-07-11T01:40:36.5336293Z [cluster1] "globalCIDR": {
2021-07-11T01:40:36.5336881Z [cluster1] "type": "string"
2021-07-11T01:40:36.5337422Z [cluster1] },
2021-07-11T01:40:36.5338136Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-11T01:40:36.5338930Z [cluster1] "properties": {
2021-07-11T01:40:36.5339640Z [cluster1] "lastResourceVersion": {
2021-07-11T01:40:36.5340354Z [cluster1] "type": "string"
2021-07-11T01:40:36.5340895Z [cluster1] },
2021-07-11T01:40:36.5341640Z [cluster1] "mismatchedContainerImages": {
2021-07-11T01:40:36.5342444Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5342990Z [cluster1] },
2021-07-11T01:40:36.5343707Z [cluster1] "nonReadyContainerStates": {
2021-07-11T01:40:36.5344432Z [cluster1] "items": {
2021-07-11T01:40:36.5345807Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.5347299Z [cluster1] "properties": {
2021-07-11T01:40:36.5347961Z [cluster1] "running": {
2021-07-11T01:40:36.5348716Z [cluster1] "description": "Details about a running container",
2021-07-11T01:40:36.5349495Z [cluster1] "properties": {
2021-07-11T01:40:36.5350221Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5351593Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.5352658Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5353414Z [cluster1] "type": "string"
2021-07-11T01:40:36.5353991Z [cluster1] }
2021-07-11T01:40:36.5354523Z [cluster1] },
2021-07-11T01:40:36.5355090Z [cluster1] "type": "object"
2021-07-11T01:40:36.5355668Z [cluster1] },
2021-07-11T01:40:36.5356255Z [cluster1] "terminated": {
2021-07-11T01:40:36.5357051Z [cluster1] "description": "Details about a terminated container",
2021-07-11T01:40:36.5357860Z [cluster1] "properties": {
2021-07-11T01:40:36.5358519Z [cluster1] "containerID": {
2021-07-11T01:40:36.5359727Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.5360601Z [cluster1] "type": "string"
2021-07-11T01:40:36.5361176Z [cluster1] },
2021-07-11T01:40:36.5361754Z [cluster1] "exitCode": {
2021-07-11T01:40:36.5362679Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.5363518Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5364146Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5364740Z [cluster1] },
2021-07-11T01:40:36.5365335Z [cluster1] "finishedAt": {
2021-07-11T01:40:36.5366149Z [cluster1] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.5367240Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5367892Z [cluster1] "type": "string"
2021-07-11T01:40:36.5368473Z [cluster1] },
2021-07-11T01:40:36.5369042Z [cluster1] "message": {
2021-07-11T01:40:36.5369909Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.5370789Z [cluster1] "type": "string"
2021-07-11T01:40:36.5371356Z [cluster1] },
2021-07-11T01:40:36.5371922Z [cluster1] "reason": {
2021-07-11T01:40:36.5372774Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.5373621Z [cluster1] "type": "string"
2021-07-11T01:40:36.5374195Z [cluster1] },
2021-07-11T01:40:36.5374743Z [cluster1] "signal": {
2021-07-11T01:40:36.5375628Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.5376464Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5377092Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5377681Z [cluster1] },
2021-07-11T01:40:36.5378250Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5379141Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.5380270Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5380936Z [cluster1] "type": "string"
2021-07-11T01:40:36.5381523Z [cluster1] }
2021-07-11T01:40:36.5382039Z [cluster1] },
2021-07-11T01:40:36.5382617Z [cluster1] "required": [
2021-07-11T01:40:36.5383226Z [cluster1] "exitCode"
2021-07-11T01:40:36.5383801Z [cluster1] ],
2021-07-11T01:40:36.5384430Z [cluster1] "type": "object"
2021-07-11T01:40:36.5385006Z [cluster1] },
2021-07-11T01:40:36.5385562Z [cluster1] "waiting": {
2021-07-11T01:40:36.5386309Z [cluster1] "description": "Details about a waiting container",
2021-07-11T01:40:36.5387098Z [cluster1] "properties": {
2021-07-11T01:40:36.5387708Z [cluster1] "message": {
2021-07-11T01:40:36.5388555Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.5389412Z [cluster1] "type": "string"
2021-07-11T01:40:36.5389978Z [cluster1] },
2021-07-11T01:40:36.5404385Z [cluster1] "reason": {
2021-07-11T01:40:36.5405201Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.5406020Z [cluster1] "type": "string"
2021-07-11T01:40:36.5406622Z [cluster1] }
2021-07-11T01:40:36.5407144Z [cluster1] },
2021-07-11T01:40:36.5407727Z [cluster1] "type": "object"
2021-07-11T01:40:36.5408288Z [cluster1] }
2021-07-11T01:40:36.5408812Z [cluster1] },
2021-07-11T01:40:36.5409371Z [cluster1] "type": "object"
2021-07-11T01:40:36.5409928Z [cluster1] },
2021-07-11T01:40:36.5410463Z [cluster1] "type": "array"
2021-07-11T01:40:36.5411015Z [cluster1] },
2021-07-11T01:40:36.5411677Z [cluster1] "status": {
2021-07-11T01:40:36.5412726Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.5413653Z [cluster1] "properties": {
2021-07-11T01:40:36.5414305Z [cluster1] "collisionCount": {
2021-07-11T01:40:36.5415775Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.5417184Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5417797Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5418380Z [cluster1] },
2021-07-11T01:40:36.5418940Z [cluster1] "conditions": {
2021-07-11T01:40:36.5420403Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.5421467Z [cluster1] "items": {
2021-07-11T01:40:36.5422415Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.5423512Z [cluster1] "properties": {
2021-07-11T01:40:36.5424225Z [cluster1] "lastTransitionTime": {
2021-07-11T01:40:36.5425212Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.5426399Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5427054Z [cluster1] "type": "string"
2021-07-11T01:40:36.5427634Z [cluster1] },
2021-07-11T01:40:36.5428193Z [cluster1] "message": {
2021-07-11T01:40:36.5430319Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.5431267Z [cluster1] "type": "string"
2021-07-11T01:40:36.5431835Z [cluster1] },
2021-07-11T01:40:36.5432399Z [cluster1] "reason": {
2021-07-11T01:40:36.5433555Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.5434377Z [cluster1] "type": "string"
2021-07-11T01:40:36.5434946Z [cluster1] },
2021-07-11T01:40:36.5435511Z [cluster1] "status": {
2021-07-11T01:40:36.5436339Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.5437676Z [cluster1] "type": "string"
2021-07-11T01:40:36.5438451Z [cluster1] },
2021-07-11T01:40:36.5438992Z [cluster1] "type": {
2021-07-11T01:40:36.5440094Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.5440889Z [cluster1] "type": "string"
2021-07-11T01:40:36.5441460Z [cluster1] }
2021-07-11T01:40:36.5441990Z [cluster1] },
2021-07-11T01:40:36.5442548Z [cluster1] "required": [
2021-07-11T01:40:36.5443902Z [cluster1] "status",
2021-07-11T01:40:36.5444478Z [cluster1] "type"
2021-07-11T01:40:36.5445024Z [cluster1] ],
2021-07-11T01:40:36.5445824Z [cluster1] "type": "object"
2021-07-11T01:40:36.5446557Z [cluster1] },
2021-07-11T01:40:36.5447281Z [cluster1] "type": "array"
2021-07-11T01:40:36.5448343Z [cluster1] },
2021-07-11T01:40:36.5449064Z [cluster1] "currentNumberScheduled": {
2021-07-11T01:40:36.5450791Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5452297Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5452933Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5453502Z [cluster1] },
2021-07-11T01:40:36.5454219Z [cluster1] "desiredNumberScheduled": {
2021-07-11T01:40:36.5455812Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5457249Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5457888Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5458446Z [cluster1] },
2021-07-11T01:40:36.5459333Z [cluster1] "numberAvailable": {
2021-07-11T01:40:36.5460807Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5462048Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5462682Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5463245Z [cluster1] },
2021-07-11T01:40:36.5464206Z [cluster1] "numberMisscheduled": {
2021-07-11T01:40:36.5466344Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5467992Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5477994Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5478597Z [cluster1] },
2021-07-11T01:40:36.5479199Z [cluster1] "numberReady": {
2021-07-11T01:40:36.5480237Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.5481258Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5481887Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5489101Z [cluster1] },
2021-07-11T01:40:36.5489765Z [cluster1] "numberUnavailable": {
2021-07-11T01:40:36.5491090Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5492320Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5493309Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5493895Z [cluster1] },
2021-07-11T01:40:36.5494717Z [cluster1] "observedGeneration": {
2021-07-11T01:40:36.5495707Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.5496600Z [cluster1] "format": "int64",
2021-07-11T01:40:36.5497234Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5497802Z [cluster1] },
2021-07-11T01:40:36.5498518Z [cluster1] "updatedNumberScheduled": {
2021-07-11T01:40:36.5499932Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.5500963Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5501587Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5502167Z [cluster1] }
2021-07-11T01:40:36.5502683Z [cluster1] },
2021-07-11T01:40:36.5503223Z [cluster1] "required": [
2021-07-11T01:40:36.5504177Z [cluster1] "currentNumberScheduled",
2021-07-11T01:40:36.5505080Z [cluster1] "desiredNumberScheduled",
2021-07-11T01:40:36.5505925Z [cluster1] "numberMisscheduled",
2021-07-11T01:40:36.5506635Z [cluster1] "numberReady"
2021-07-11T01:40:36.5507220Z [cluster1] ],
2021-07-11T01:40:36.5507778Z [cluster1] "type": "object"
2021-07-11T01:40:36.5508319Z [cluster1] }
2021-07-11T01:40:36.5509065Z [cluster1] },
2021-07-11T01:40:36.5509747Z [cluster1] "required": [
2021-07-11T01:40:36.5511287Z [cluster1] "mismatchedContainerImages"
2021-07-11T01:40:36.5512177Z [cluster1] ],
2021-07-11T01:40:36.5513007Z [cluster1] "type": "object"
2021-07-11T01:40:36.5513740Z [cluster1] },
2021-07-11T01:40:36.5514526Z [cluster1] "loadBalancerStatus": {
2021-07-11T01:40:36.5515485Z [cluster1] "properties": {
2021-07-11T01:40:36.5516223Z [cluster1] "status": {
2021-07-11T01:40:36.5517632Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-11T01:40:36.5518595Z [cluster1] "properties": {
2021-07-11T01:40:36.5519208Z [cluster1] "ingress": {
2021-07-11T01:40:36.5521020Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-11T01:40:36.5522159Z [cluster1] "items": {
2021-07-11T01:40:36.5524315Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-11T01:40:36.5525777Z [cluster1] "properties": {
2021-07-11T01:40:36.5526543Z [cluster1] "hostname": {
2021-07-11T01:40:36.5527975Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-11T01:40:36.5529009Z [cluster1] "type": "string"
2021-07-11T01:40:36.5529599Z [cluster1] },
2021-07-11T01:40:36.5530129Z [cluster1] "ip": {
2021-07-11T01:40:36.5531713Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-11T01:40:36.5532798Z [cluster1] "type": "string"
2021-07-11T01:40:36.5533373Z [cluster1] }
2021-07-11T01:40:36.5533901Z [cluster1] },
2021-07-11T01:40:36.5534467Z [cluster1] "type": "object"
2021-07-11T01:40:36.5535039Z [cluster1] },
2021-07-11T01:40:36.5535608Z [cluster1] "type": "array"
2021-07-11T01:40:36.5536385Z [cluster1] }
2021-07-11T01:40:36.5536904Z [cluster1] },
2021-07-11T01:40:36.5537448Z [cluster1] "type": "object"
2021-07-11T01:40:36.5538007Z [cluster1] }
2021-07-11T01:40:36.5538490Z [cluster1] },
2021-07-11T01:40:36.5539042Z [cluster1] "type": "object"
2021-07-11T01:40:36.5539744Z [cluster1] },
2021-07-11T01:40:36.5540294Z [cluster1] "natEnabled": {
2021-07-11T01:40:36.5540900Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5541437Z [cluster1] },
2021-07-11T01:40:36.5542112Z [cluster1] "networkPlugin": {
2021-07-11T01:40:36.5542729Z [cluster1] "type": "string"
2021-07-11T01:40:36.5543264Z [cluster1] },
2021-07-11T01:40:36.5543989Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-11T01:40:36.5544794Z [cluster1] "properties": {
2021-07-11T01:40:36.5545502Z [cluster1] "lastResourceVersion": {
2021-07-11T01:40:36.5546212Z [cluster1] "type": "string"
2021-07-11T01:40:36.5546764Z [cluster1] },
2021-07-11T01:40:36.5547488Z [cluster1] "mismatchedContainerImages": {
2021-07-11T01:40:36.5548297Z [cluster1] "type": "boolean"
2021-07-11T01:40:36.5548852Z [cluster1] },
2021-07-11T01:40:36.5549571Z [cluster1] "nonReadyContainerStates": {
2021-07-11T01:40:36.5550729Z [cluster1] "items": {
2021-07-11T01:40:36.5552098Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-11T01:40:36.5553593Z [cluster1] "properties": {
2021-07-11T01:40:36.5554186Z [cluster1] "running": {
2021-07-11T01:40:36.5554940Z [cluster1] "description": "Details about a running container",
2021-07-11T01:40:36.5555718Z [cluster1] "properties": {
2021-07-11T01:40:36.5556368Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5557581Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-11T01:40:36.5559922Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5561183Z [cluster1] "type": "string"
2021-07-11T01:40:36.5561779Z [cluster1] }
2021-07-11T01:40:36.5562308Z [cluster1] },
2021-07-11T01:40:36.5562894Z [cluster1] "type": "object"
2021-07-11T01:40:36.5563451Z [cluster1] },
2021-07-11T01:40:36.5564039Z [cluster1] "terminated": {
2021-07-11T01:40:36.5564831Z [cluster1] "description": "Details about a terminated container",
2021-07-11T01:40:36.5565645Z [cluster1] "properties": {
2021-07-11T01:40:36.5577658Z [cluster1] "containerID": {
2021-07-11T01:40:36.5579179Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-11T01:40:36.5580079Z [cluster1] "type": "string"
2021-07-11T01:40:36.5580650Z [cluster1] },
2021-07-11T01:40:36.5581233Z [cluster1] "exitCode": {
2021-07-11T01:40:36.5582249Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-11T01:40:36.5583112Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5583749Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5584331Z [cluster1] },
2021-07-11T01:40:36.5584925Z [cluster1] "finishedAt": {
2021-07-11T01:40:36.5585757Z [cluster1] "description": "Time at which the container last terminated",
2021-07-11T01:40:36.5588331Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5589012Z [cluster1] "type": "string"
2021-07-11T01:40:36.5589590Z [cluster1] },
2021-07-11T01:40:36.5590740Z [cluster1] "message": {
2021-07-11T01:40:36.5591626Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-11T01:40:36.5592510Z [cluster1] "type": "string"
2021-07-11T01:40:36.5593230Z [cluster1] },
2021-07-11T01:40:36.5593784Z [cluster1] "reason": {
2021-07-11T01:40:36.5594630Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-11T01:40:36.5595480Z [cluster1] "type": "string"
2021-07-11T01:40:36.5596065Z [cluster1] },
2021-07-11T01:40:36.5596607Z [cluster1] "signal": {
2021-07-11T01:40:36.5597429Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-11T01:40:36.5598262Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5599591Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5600201Z [cluster1] },
2021-07-11T01:40:36.5600770Z [cluster1] "startedAt": {
2021-07-11T01:40:36.5606366Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-11T01:40:36.5607705Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5608373Z [cluster1] "type": "string"
2021-07-11T01:40:36.5608944Z [cluster1] }
2021-07-11T01:40:36.5609477Z [cluster1] },
2021-07-11T01:40:36.5610049Z [cluster1] "required": [
2021-07-11T01:40:36.5610671Z [cluster1] "exitCode"
2021-07-11T01:40:36.5612105Z [cluster1] ],
2021-07-11T01:40:36.5612998Z [cluster1] "type": "object"
2021-07-11T01:40:36.5613966Z [cluster1] },
2021-07-11T01:40:36.5614705Z [cluster1] "waiting": {
2021-07-11T01:40:36.5615631Z [cluster1] "description": "Details about a waiting container",
2021-07-11T01:40:36.5616580Z [cluster1] "properties": {
2021-07-11T01:40:36.5617383Z [cluster1] "message": {
2021-07-11T01:40:36.5618715Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-11T01:40:36.5619954Z [cluster1] "type": "string"
2021-07-11T01:40:36.5620541Z [cluster1] },
2021-07-11T01:40:36.5621102Z [cluster1] "reason": {
2021-07-11T01:40:36.5622697Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-11T01:40:36.5623662Z [cluster1] "type": "string"
2021-07-11T01:40:36.5624251Z [cluster1] }
2021-07-11T01:40:36.5624782Z [cluster1] },
2021-07-11T01:40:36.5625446Z [cluster1] "type": "object"
2021-07-11T01:40:36.5626021Z [cluster1] }
2021-07-11T01:40:36.5626533Z [cluster1] },
2021-07-11T01:40:36.5627100Z [cluster1] "type": "object"
2021-07-11T01:40:36.5627654Z [cluster1] },
2021-07-11T01:40:36.5628295Z [cluster1] "type": "array"
2021-07-11T01:40:36.5628850Z [cluster1] },
2021-07-11T01:40:36.5629365Z [cluster1] "status": {
2021-07-11T01:40:36.5630516Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-11T01:40:36.5631444Z [cluster1] "properties": {
2021-07-11T01:40:36.5632114Z [cluster1] "collisionCount": {
2021-07-11T01:40:36.5647962Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-11T01:40:36.5649462Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5650100Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5650668Z [cluster1] },
2021-07-11T01:40:36.5651246Z [cluster1] "conditions": {
2021-07-11T01:40:36.5652686Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-11T01:40:36.5653634Z [cluster1] "items": {
2021-07-11T01:40:36.5654605Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-11T01:40:36.5655757Z [cluster1] "properties": {
2021-07-11T01:40:36.5656503Z [cluster1] "lastTransitionTime": {
2021-07-11T01:40:36.5657476Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-11T01:40:36.5658660Z [cluster1] "format": "date-time",
2021-07-11T01:40:36.5659334Z [cluster1] "type": "string"
2021-07-11T01:40:36.5659902Z [cluster1] },
2021-07-11T01:40:36.5660475Z [cluster1] "message": {
2021-07-11T01:40:36.5661507Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-11T01:40:36.5662507Z [cluster1] "type": "string"
2021-07-11T01:40:36.5663091Z [cluster1] },
2021-07-11T01:40:36.5663640Z [cluster1] "reason": {
2021-07-11T01:40:36.5664745Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-11T01:40:36.5665658Z [cluster1] "type": "string"
2021-07-11T01:40:36.5666238Z [cluster1] },
2021-07-11T01:40:36.5666799Z [cluster1] "status": {
2021-07-11T01:40:36.5667632Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-11T01:40:36.5668470Z [cluster1] "type": "string"
2021-07-11T01:40:36.5670005Z [cluster1] },
2021-07-11T01:40:36.5670660Z [cluster1] "type": {
2021-07-11T01:40:36.5671570Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-11T01:40:36.5672454Z [cluster1] "type": "string"
2021-07-11T01:40:36.5673116Z [cluster1] }
2021-07-11T01:40:36.5673632Z [cluster1] },
2021-07-11T01:40:36.5674204Z [cluster1] "required": [
2021-07-11T01:40:36.5674793Z [cluster1] "status",
2021-07-11T01:40:36.5675377Z [cluster1] "type"
2021-07-11T01:40:36.5675921Z [cluster1] ],
2021-07-11T01:40:36.5676491Z [cluster1] "type": "object"
2021-07-11T01:40:36.5677064Z [cluster1] },
2021-07-11T01:40:36.5677616Z [cluster1] "type": "array"
2021-07-11T01:40:36.5678172Z [cluster1] },
2021-07-11T01:40:36.5678863Z [cluster1] "currentNumberScheduled": {
2021-07-11T01:40:36.5681926Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5683332Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5683956Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5684537Z [cluster1] },
2021-07-11T01:40:36.5685729Z [cluster1] "desiredNumberScheduled": {
2021-07-11T01:40:36.5687451Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5688897Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5690174Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5691224Z [cluster1] },
2021-07-11T01:40:36.5691839Z [cluster1] "numberAvailable": {
2021-07-11T01:40:36.5693158Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5714650Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5715457Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5716050Z [cluster1] },
2021-07-11T01:40:36.5716698Z [cluster1] "numberMisscheduled": {
2021-07-11T01:40:36.5718203Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-11T01:40:36.5719568Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5720186Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5720767Z [cluster1] },
2021-07-11T01:40:36.5721347Z [cluster1] "numberReady": {
2021-07-11T01:40:36.5722394Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-11T01:40:36.5723392Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5724015Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5724593Z [cluster1] },
2021-07-11T01:40:36.5725218Z [cluster1] "numberUnavailable": {
2021-07-11T01:40:36.5726663Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-11T01:40:36.5727900Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5728514Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5729087Z [cluster1] },
2021-07-11T01:40:36.5729729Z [cluster1] "observedGeneration": {
2021-07-11T01:40:36.5730908Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-11T01:40:36.5731796Z [cluster1] "format": "int64",
2021-07-11T01:40:36.5732421Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5732999Z [cluster1] },
2021-07-11T01:40:36.5733701Z [cluster1] "updatedNumberScheduled": {
2021-07-11T01:40:36.5734707Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-11T01:40:36.5735533Z [cluster1] "format": "int32",
2021-07-11T01:40:36.5736155Z [cluster1] "type": "integer"
2021-07-11T01:40:36.5736732Z [cluster1] }
2021-07-11T01:40:36.5737229Z [cluster1] },
2021-07-11T01:40:36.5737783Z [cluster1] "required": [
2021-07-11T01:40:36.5738517Z [cluster1] "currentNumberScheduled",
2021-07-11T01:40:36.5739413Z [cluster1] "desiredNumberScheduled",
2021-07-11T01:40:36.5740322Z [cluster1] "numberMisscheduled",
2021-07-11T01:40:36.5741080Z [cluster1] "numberReady"
2021-07-11T01:40:36.5741662Z [cluster1] ],
2021-07-11T01:40:36.5742208Z [cluster1] "type": "object"
2021-07-11T01:40:36.5742764Z [cluster1] }
2021-07-11T01:40:36.5743245Z [cluster1] },
2021-07-11T01:40:36.5743788Z [cluster1] "required": [
2021-07-11T01:40:36.5744555Z [cluster1] "mismatchedContainerImages"
2021-07-11T01:40:36.5745284Z [cluster1] ],
2021-07-11T01:40:36.5745814Z [cluster1] "type": "object"
2021-07-11T01:40:36.5746353Z [cluster1] },
2021-07-11T01:40:36.5746922Z [cluster1] "serviceCIDR": {
2021-07-11T01:40:36.5747521Z [cluster1] "type": "string"
2021-07-11T01:40:36.5748054Z [cluster1] }
2021-07-11T01:40:36.5749451Z [cluster1] },
2021-07-11T01:40:36.5750148Z [cluster1] "required": [
2021-07-11T01:40:36.5750727Z [cluster1] "clusterID",
2021-07-11T01:40:36.5751317Z [cluster1] "natEnabled"
2021-07-11T01:40:36.5751843Z [cluster1] ],
2021-07-11T01:40:36.5752375Z [cluster1] "type": "object"
2021-07-11T01:40:36.5752903Z [cluster1] }
2021-07-11T01:40:36.5753356Z [cluster1] },
2021-07-11T01:40:36.5753874Z [cluster1] "type": "object"
2021-07-11T01:40:36.5754374Z [cluster1] }
2021-07-11T01:40:36.5754823Z [cluster1] },
2021-07-11T01:40:36.5755315Z [cluster1] "served": true,
2021-07-11T01:40:36.5755874Z [cluster1] "storage": true,
2021-07-11T01:40:36.5756436Z [cluster1] "subresources": {
2021-07-11T01:40:36.5756996Z [cluster1] "status": {}
2021-07-11T01:40:36.5757459Z [cluster1] }
2021-07-11T01:40:36.5758075Z [cluster1] }
2021-07-11T01:40:36.5758518Z [cluster1] ]
2021-07-11T01:40:36.5758934Z [cluster1] },
2021-07-11T01:40:36.5759392Z [cluster1] "status": {
2021-07-11T01:40:36.5759931Z [cluster1] "acceptedNames": {
2021-07-11T01:40:36.5760540Z [cluster1] "kind": "Submariner",
2021-07-11T01:40:36.5761186Z [cluster1] "listKind": "SubmarinerList",
2021-07-11T01:40:36.5762280Z [cluster1] "plural": "submariners",
2021-07-11T01:40:36.5763096Z [cluster1] "singular": "submariner"
2021-07-11T01:40:36.5763637Z [cluster1] },
2021-07-11T01:40:36.5764118Z [cluster1] "conditions": [
2021-07-11T01:40:36.5764611Z [cluster1] {
2021-07-11T01:40:36.5765617Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:32Z",
2021-07-11T01:40:38.7354305Z [cluster1] "message": "no conflicts found",
2021-07-11T01:40:38.7355040Z [cluster2] "reason": "NoConflicts",
2021-07-11T01:40:38.7355655Z [cluster2] "status": "True",
2021-07-11T01:40:38.7356276Z [cluster2] "type": "NamesAccepted"
2021-07-11T01:40:38.7356821Z [cluster2] },
2021-07-11T01:40:38.7357260Z [cluster2] {
2021-07-11T01:40:38.7358619Z [cluster2] "lastTransitionTime": "2021-07-11T01:35:43Z",
2021-07-11T01:40:38.7359591Z [cluster2] "message": "the initial names have been accepted",
2021-07-11T01:40:38.7360451Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-11T01:40:38.7361372Z [cluster2] "status": "True",
2021-07-11T01:40:38.7361960Z [cluster2] "type": "Established"
2021-07-11T01:40:38.7362475Z [cluster2] }
2021-07-11T01:40:38.7362912Z [cluster2] ],
2021-07-11T01:40:38.7363436Z [cluster2] "storedVersions": [
2021-07-11T01:40:38.7364014Z [cluster2] "v1alpha1"
2021-07-11T01:40:38.7364474Z [cluster2] ]
2021-07-11T01:40:38.7364903Z [cluster2] }
2021-07-11T01:40:38.7365321Z [cluster2] }
2021-07-11T01:40:38.7366569Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-11T01:40:38.7368289Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-11T01:40:38.7370221Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:38.7372089Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:38.7373403Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-11T01:40:38.7375132Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:38.7376850Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:38.7378304Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-11T01:40:38.7380070Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:38.7381799Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-11T01:40:38.7383185Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-11T01:40:38.7384964Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-11T01:40:38.7386585Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-11T01:40:38.7387676Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-11T01:40:38.7388878Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-11T01:40:38.7390324Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-11T01:40:38.7392062Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-11T01:40:38.7393058Z [cluster2] NAME STATUS AGE
2021-07-11T01:40:38.7393918Z [cluster2] submariner-operator Active 4m54s
2021-07-11T01:40:38.7395179Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-11T01:40:38.7396695Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-11T01:40:38.7398335Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-11T01:40:38.7399407Z [cluster2] NAME CREATED AT
2021-07-11T01:40:38.7400329Z [cluster2] submariners.submariner.io 2021-07-11T01:35:43Z
2021-07-11T01:40:38.7401462Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-11T01:40:38.7402600Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-11T01:40:38.7403895Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-11T01:40:38.7405133Z [submariner-operator]$ [cluster2] grep submariners
2021-07-11T01:40:38.7406088Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-11T01:40:38.7407591Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7409348Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7411372Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7412550Z [cluster2] NAME SECRETS AGE
2021-07-11T01:40:38.7413369Z [cluster2] submariner-operator 1 4m55s
2021-07-11T01:40:38.7414769Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7416562Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7418510Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:38.7419679Z [cluster2] NAME CREATED AT
2021-07-11T01:40:38.7420660Z [cluster2] submariner-operator 2021-07-11T01:35:44Z
2021-07-11T01:40:39.0098017Z [submariner-operator]$ [cluster2] kubectl geto conflicts found",
2021-07-11T01:40:39.0098923Z [cluster1] "reason": "NoConflicts",
2021-07-11T01:40:39.0099531Z [cluster1] "status": "True",
2021-07-11T01:40:39.0100134Z [cluster1] "type": "NamesAccepted"
2021-07-11T01:40:39.0100695Z [cluster1] },
2021-07-11T01:40:39.0101122Z [cluster1] {
2021-07-11T01:40:39.0101971Z [cluster1] "lastTransitionTime": "2021-07-11T01:35:32Z",
2021-07-11T01:40:39.0102803Z [cluster1] "message": "the initial names have been accepted",
2021-07-11T01:40:39.0103637Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-11T01:40:39.0104341Z [cluster1] "status": "True",
2021-07-11T01:40:39.0104913Z [cluster1] "type": "Established"
2021-07-11T01:40:39.0105445Z [cluster1] }
2021-07-11T01:40:39.0105869Z [cluster1] ],
2021-07-11T01:40:39.0106403Z [cluster1] "storedVersions": [
2021-07-11T01:40:39.0106963Z [cluster1] "v1alpha1"
2021-07-11T01:40:39.0107437Z [cluster1] ]
2021-07-11T01:40:39.0107852Z [cluster1] }
2021-07-11T01:40:39.0108278Z [cluster1] }
2021-07-11T01:40:39.0109464Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-11T01:40:39.0111317Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-11T01:40:39.0113446Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:39.0115189Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:39.0116505Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-11T01:40:39.0118237Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:39.0120076Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:39.0121539Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-11T01:40:39.0123285Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:39.0125015Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-11T01:40:39.0126383Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-11T01:40:39.0128188Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-11T01:40:39.0129819Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-11T01:40:39.0130893Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-11T01:40:39.0132112Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-11T01:40:39.0133437Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-11T01:40:39.0135104Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-11T01:40:39.0136063Z [cluster1] NAME STATUS AGE
2021-07-11T01:40:39.0136913Z [cluster1] submariner-operator Active 5m5s
2021-07-11T01:40:39.0138180Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-11T01:40:39.0139676Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-11T01:40:39.0141330Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-11T01:40:39.0142371Z [cluster1] NAME CREATED AT
2021-07-11T01:40:39.0143312Z [cluster1] submariners.submariner.io 2021-07-11T01:35:32Z
2021-07-11T01:40:39.0144434Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-11T01:40:39.0145581Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-11T01:40:39.0146878Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-11T01:40:39.0148080Z [submariner-operator]$ [cluster1] grep submariners
2021-07-11T01:40:39.0149047Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-11T01:40:39.0181580Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0183755Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0185681Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0186865Z [cluster1] NAME SECRETS AGE
2021-07-11T01:40:39.0187711Z [cluster1] submariner-operator 1 5m6s
2021-07-11T01:40:39.0189212Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0191289Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0193262Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-11T01:40:39.0194446Z [cluster1] NAME CREATED AT
2021-07-11T01:40:39.0195496Z [cluster1] submariner-operator 2021-07-11T01:35:33Z
2021-07-11T01:40:40.7037701Z [submariner-operator]$ [cluster1] kubectl get r rolebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7039905Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7041974Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7043258Z [cluster2] NAME ROLE AGE
2021-07-11T01:40:40.7044287Z [cluster2] submariner-operator Role/submariner-operator 4m55s
2021-07-11T01:40:40.7045887Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7047785Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7049826Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.7051344Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-11T01:40:40.7052324Z [cluster2] submariner-operator 1/1 1 1 4m50s
2021-07-11T01:40:40.7053552Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-11T01:40:40.7054618Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-11T01:40:40.7056587Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-11T01:40:40.7058830Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.7061130Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.7063549Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.7066014Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o json
2021-07-11T01:40:40.7068415Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o json
2021-07-11T01:40:40.7071492Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o json
2021-07-11T01:40:40.7072894Z [cluster2] {
2021-07-11T01:40:40.7073404Z [cluster2] "apiVersion": "v1",
2021-07-11T01:40:40.7073931Z [cluster2] "kind": "Pod",
2021-07-11T01:40:40.7074448Z [cluster2] "metadata": {
2021-07-11T01:40:40.7075420Z [cluster2] "creationTimestamp": "2021-07-11T01:39:02Z",
2021-07-11T01:40:40.7076636Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-11T01:40:40.7077492Z [cluster2] "labels": {
2021-07-11T01:40:40.7078311Z [cluster2] "name": "submariner-operator",
2021-07-11T01:40:40.7079257Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-11T01:40:40.7079946Z [cluster2] },
2021-07-11T01:40:40.7080460Z [cluster2] "managedFields": [
2021-07-11T01:40:40.7080994Z [cluster2] {
2021-07-11T01:40:40.7081517Z [cluster2] "apiVersion": "v1",
2021-07-11T01:40:40.7082133Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:40.7082736Z [cluster2] "fieldsV1": {
2021-07-11T01:40:40.7083268Z [cluster2] "f:metadata": {
2021-07-11T01:40:40.7083868Z [cluster2] "f:generateName": {},
2021-07-11T01:40:40.7084611Z [cluster2] "f:labels": {
2021-07-11T01:40:40.7085130Z [cluster2] ".": {},
2021-07-11T01:40:40.7085621Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7086474Z [cluster2] "f:pod-template-hash": {}
2021-07-11T01:40:40.7087058Z [cluster2] },
2021-07-11T01:40:40.7087649Z [cluster2] "f:ownerReferences": {
2021-07-11T01:40:40.7088247Z [cluster2] ".": {},
2021-07-11T01:40:40.7089191Z [cluster2] "k:{\"uid\":\"689171ec-afa5-42f5-b5fa-4f269906d318\"}": {
2021-07-11T01:40:40.7089914Z [cluster2] ".": {},
2021-07-11T01:40:40.7090458Z [cluster2] "f:apiVersion": {},
2021-07-11T01:40:40.7091198Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-11T01:40:40.7091875Z [cluster2] "f:controller": {},
2021-07-11T01:40:40.7092446Z [cluster2] "f:kind": {},
2021-07-11T01:40:40.7092988Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7093500Z [cluster2] "f:uid": {}
2021-07-11T01:40:40.7093989Z [cluster2] }
2021-07-11T01:40:40.7094441Z [cluster2] }
2021-07-11T01:40:40.7094905Z [cluster2] },
2021-07-11T01:40:40.7095383Z [cluster2] "f:spec": {
2021-07-11T01:40:40.7096034Z [cluster2] "f:containers": {
2021-07-11T01:40:40.7096971Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-11T01:40:40.7097643Z [cluster2] ".": {},
2021-07-11T01:40:40.7098163Z [cluster2] "f:command": {},
2021-07-11T01:40:40.7098718Z [cluster2] "f:env": {
2021-07-11T01:40:40.7099233Z [cluster2] ".": {},
2021-07-11T01:40:40.7099816Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-11T01:40:40.7100415Z [cluster2] ".": {},
2021-07-11T01:40:40.7100929Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7101477Z [cluster2] "f:value": {}
2021-07-11T01:40:40.7101982Z [cluster2] },
2021-07-11T01:40:40.7102551Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-11T01:40:40.7103102Z [cluster2] ".": {},
2021-07-11T01:40:40.7103630Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7104202Z [cluster2] "f:valueFrom": {
2021-07-11T01:40:40.7104749Z [cluster2] ".": {},
2021-07-11T01:40:40.7105310Z [cluster2] "f:fieldRef": {
2021-07-11T01:40:40.7105862Z [cluster2] ".": {},
2021-07-11T01:40:40.7106449Z [cluster2] "f:apiVersion": {},
2021-07-11T01:40:40.7107073Z [cluster2] "f:fieldPath": {}
2021-07-11T01:40:40.7107635Z [cluster2] }
2021-07-11T01:40:40.7108135Z [cluster2] }
2021-07-11T01:40:40.7108613Z [cluster2] },
2021-07-11T01:40:40.7109214Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-11T01:40:40.7109805Z [cluster2] ".": {},
2021-07-11T01:40:40.7138740Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7139422Z [cluster2] "f:valueFrom": {
2021-07-11T01:40:40.7140184Z [cluster2] ".": {},
2021-07-11T01:40:40.7140739Z [cluster2] "f:fieldRef": {
2021-07-11T01:40:40.7141303Z [cluster2] ".": {},
2021-07-11T01:40:40.7141893Z [cluster2] "f:apiVersion": {},
2021-07-11T01:40:40.7142515Z [cluster2] "f:fieldPath": {}
2021-07-11T01:40:40.7143083Z [cluster2] }
2021-07-11T01:40:40.7143576Z [cluster2] }
2021-07-11T01:40:40.7144065Z [cluster2] }
2021-07-11T01:40:40.7144528Z [cluster2] },
2021-07-11T01:40:40.7145043Z [cluster2] "f:image": {},
2021-07-11T01:40:40.7145679Z [cluster2] "f:imagePullPolicy": {},
2021-07-11T01:40:40.7146296Z [cluster2] "f:name": {},
2021-07-11T01:40:40.7146862Z [cluster2] "f:resources": {},
2021-07-11T01:40:40.7147595Z [cluster2] "f:terminationMessagePath": {},
2021-07-11T01:40:40.7148620Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-11T01:40:40.7149316Z [cluster2] }
2021-07-11T01:40:40.7149789Z [cluster2] },
2021-07-11T01:40:40.7150574Z [cluster2] "f:dnsPolicy": {},
2021-07-11T01:40:40.7151263Z [cluster2] "f:enableServiceLinks": {},
2021-07-11T01:40:40.7151981Z [cluster2] "f:restartPolicy": {},
2021-07-11T01:40:40.7152624Z [cluster2] "f:schedulerName": {},
2021-07-11T01:40:40.7153297Z [cluster2] "f:securityContext": {},
2021-07-11T01:40:40.7153972Z [cluster2] "f:serviceAccount": {},
2021-07-11T01:40:40.7154701Z [cluster2] "f:serviceAccountName": {},
2021-07-11T01:40:40.7155623Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-11T01:40:40.7156401Z [cluster2] }
2021-07-11T01:40:40.7156837Z [cluster2] },
2021-07-11T01:40:40.7157988Z [cluster2] "manager": "kube-controller-manager",
2021-07-11T01:40:40.7158764Z [cluster2] "operation": "Update",
2021-07-11T01:40:40.7159527Z [cluster2] "time": "2021-07-11T01:39:02Z"
2021-07-11T01:40:40.7160029Z [cluster2] },
2021-07-11T01:40:40.7160458Z [cluster2] {
2021-07-11T01:40:40.7160982Z [cluster2] "apiVersion": "v1",
2021-07-11T01:40:40.7161597Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:40.7162195Z [cluster2] "fieldsV1": {
2021-07-11T01:40:40.7162713Z [cluster2] "f:status": {
2021-07-11T01:40:40.7163272Z [cluster2] "f:conditions": {
2021-07-11T01:40:40.7163939Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-11T01:40:40.7164570Z [cluster2] ".": {},
2021-07-11T01:40:40.7165153Z [cluster2] "f:lastProbeTime": {},
2021-07-11T01:40:40.7165861Z [cluster2] "f:lastTransitionTime": {},
2021-07-11T01:40:40.7166523Z [cluster2] "f:status": {},
2021-07-11T01:40:40.7167053Z [cluster2] "f:type": {}
2021-07-11T01:40:40.7167557Z [cluster2] },
2021-07-11T01:40:40.7168122Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-11T01:40:40.7168708Z [cluster2] ".": {},
2021-07-11T01:40:40.7169276Z [cluster2] "f:lastProbeTime": {},
2021-07-11T01:40:40.7169998Z [cluster2] "f:lastTransitionTime": {},
2021-07-11T01:40:40.7170760Z [cluster2] "f:status": {},
2021-07-11T01:40:40.7171290Z [cluster2] "f:type": {}
2021-07-11T01:40:40.7171789Z [cluster2] },
2021-07-11T01:40:40.7172318Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-11T01:40:40.7172858Z [cluster2] ".": {},
2021-07-11T01:40:40.7173427Z [cluster2] "f:lastProbeTime": {},
2021-07-11T01:40:40.7174159Z [cluster2] "f:lastTransitionTime": {},
2021-07-11T01:40:40.7174801Z [cluster2] "f:status": {},
2021-07-11T01:40:40.7175347Z [cluster2] "f:type": {}
2021-07-11T01:40:40.7175847Z [cluster2] }
2021-07-11T01:40:40.7176297Z [cluster2] },
2021-07-11T01:40:40.7176905Z [cluster2] "f:containerStatuses": {},
2021-07-11T01:40:40.7177532Z [cluster2] "f:hostIP": {},
2021-07-11T01:40:40.7178079Z [cluster2] "f:phase": {},
2021-07-11T01:40:40.7178601Z [cluster2] "f:podIP": {},
2021-07-11T01:40:40.7179148Z [cluster2] "f:podIPs": {
2021-07-11T01:40:40.7179650Z [cluster2] ".": {},
2021-07-11T01:40:40.7180167Z [cluster2] "k:{\"ip\":\"10.2.128.4\"}": {
2021-07-11T01:40:40.7180761Z [cluster2] ".": {},
2021-07-11T01:40:40.7181249Z [cluster2] "f:ip": {}
2021-07-11T01:40:40.7181743Z [cluster2] }
2021-07-11T01:40:40.7182193Z [cluster2] },
2021-07-11T01:40:40.7182717Z [cluster2] "f:startTime": {}
2021-07-11T01:40:40.7183221Z [cluster2] }
2021-07-11T01:40:40.7183675Z [cluster2] },
2021-07-11T01:40:40.7184194Z [cluster2] "manager": "kubelet",
2021-07-11T01:40:40.7184803Z [cluster2] "operation": "Update",
2021-07-11T01:40:40.7185593Z [cluster2] "time": "2021-07-11T01:39:04Z"
2021-07-11T01:40:40.7186090Z [cluster2] }
2021-07-11T01:40:40.7186531Z [cluster2] ],
2021-07-11T01:40:40.7187582Z [cluster2] "name": "submariner-operator-5bfdb87494-hz454",
2021-07-11T01:40:40.7188828Z [cluster2] "namespace": "submariner-operator",
2021-07-11T01:40:40.7189570Z [cluster2] "ownerReferences": [
2021-07-11T01:40:40.7198227Z [cluster2] {
2021-07-11T01:40:40.7198911Z [cluster2] "apiVersion": "apps/v1",
2021-07-11T01:40:40.7199637Z [cluster2] "blockOwnerDeletion": true,
2021-07-11T01:40:40.7200317Z [cluster2] "controller": true,
2021-07-11T01:40:40.7200929Z [cluster2] "kind": "ReplicaSet",
2021-07-11T01:40:40.7202248Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-11T01:40:40.7203456Z [cluster2] "uid": "689171ec-afa5-42f5-b5fa-4f269906d318"
2021-07-11T01:40:40.7204376Z [cluster2] }
2021-07-11T01:40:40.7204804Z [cluster2] ],
2021-07-11T01:40:40.7205362Z [cluster2] "resourceVersion": "2118",
2021-07-11T01:40:40.7206312Z [cluster2] "uid": "4a62523f-5ff7-4a15-ae66-4b96268e4933"
2021-07-11T01:40:40.7206938Z [cluster2] },
2021-07-11T01:40:40.7207376Z [cluster2] "spec": {
2021-07-11T01:40:40.7207903Z [cluster2] "containers": [
2021-07-11T01:40:40.7208383Z [cluster2] {
2021-07-11T01:40:40.7208860Z [cluster2] "command": [
2021-07-11T01:40:40.7209667Z [cluster2] "submariner-operator",
2021-07-11T01:40:40.7210541Z [cluster2] "-alsologtostderr",
2021-07-11T01:40:40.7211264Z [cluster2] "-v=1"
2021-07-11T01:40:40.7211710Z [cluster2] ],
2021-07-11T01:40:40.7212332Z [cluster2] "env": [
2021-07-11T01:40:40.7212956Z [cluster2] {
2021-07-11T01:40:40.7213529Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-11T01:40:40.7214127Z [cluster2] "valueFrom": {
2021-07-11T01:40:40.7214695Z [cluster2] "fieldRef": {
2021-07-11T01:40:40.7215278Z [cluster2] "apiVersion": "v1",
2021-07-11T01:40:40.7216017Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-11T01:40:40.7216673Z [cluster2] }
2021-07-11T01:40:40.7217139Z [cluster2] }
2021-07-11T01:40:40.7217602Z [cluster2] },
2021-07-11T01:40:40.7218044Z [cluster2] {
2021-07-11T01:40:40.7218567Z [cluster2] "name": "POD_NAME",
2021-07-11T01:40:40.7219125Z [cluster2] "valueFrom": {
2021-07-11T01:40:40.7219694Z [cluster2] "fieldRef": {
2021-07-11T01:40:40.7220282Z [cluster2] "apiVersion": "v1",
2021-07-11T01:40:40.7220969Z [cluster2] "fieldPath": "metadata.name"
2021-07-11T01:40:40.7232439Z [cluster2] }
2021-07-11T01:40:40.7232970Z [cluster2] }
2021-07-11T01:40:40.7233423Z [cluster2] },
2021-07-11T01:40:40.7233887Z [cluster2] {
2021-07-11T01:40:40.7234446Z [cluster2] "name": "OPERATOR_NAME",
2021-07-11T01:40:40.7235773Z [cluster2] "value": "submariner-operator"
2021-07-11T01:40:40.7236509Z [cluster2] }
2021-07-11T01:40:40.7236952Z [cluster2] ],
2021-07-11T01:40:40.7237878Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-11T01:40:40.7238771Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-11T01:40:40.7239776Z [cluster2] "name": "submariner-operator",
2021-07-11T01:40:40.7240442Z [cluster2] "resources": {},
2021-07-11T01:40:40.7241461Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-11T01:40:40.7242587Z [cluster2] "terminationMessagePolicy": "File",
2021-07-11T01:40:40.7243354Z [cluster2] "volumeMounts": [
2021-07-11T01:40:40.7243890Z [cluster2] {
2021-07-11T01:40:40.7244629Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-11T01:40:40.7245960Z [cluster2] "name": "submariner-operator-token-wc9vw",
2021-07-11T01:40:40.7246824Z [cluster2] "readOnly": true
2021-07-11T01:40:40.7247348Z [cluster2] }
2021-07-11T01:40:40.7247783Z [cluster2] ]
2021-07-11T01:40:40.7248228Z [cluster2] }
2021-07-11T01:40:40.7248667Z [cluster2] ],
2021-07-11T01:40:40.7249230Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-11T01:40:40.7249973Z [cluster2] "enableServiceLinks": true,
2021-07-11T01:40:40.7250885Z [cluster2] "nodeName": "cluster2-worker",
2021-07-11T01:40:40.7251794Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-11T01:40:40.7252560Z [cluster2] "priority": 0,
2021-07-11T01:40:40.7253161Z [cluster2] "restartPolicy": "Always",
2021-07-11T01:40:40.7254093Z [cluster2] "schedulerName": "default-scheduler",
2021-07-11T01:40:40.7254863Z [cluster2] "securityContext": {},
2021-07-11T01:40:40.7255823Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-11T01:40:40.7256987Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-11T01:40:40.7258047Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-11T01:40:40.7258852Z [cluster2] "tolerations": [
2021-07-11T01:40:40.7259357Z [cluster2] {
2021-07-11T01:40:40.7259880Z [cluster2] "effect": "NoExecute",
2021-07-11T01:40:40.7260904Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-11T01:40:40.7261616Z [cluster2] "operator": "Exists",
2021-07-11T01:40:40.7262268Z [cluster2] "tolerationSeconds": 300
2021-07-11T01:40:40.7262834Z [cluster2] },
2021-07-11T01:40:40.7263279Z [cluster2] {
2021-07-11T01:40:40.7263805Z [cluster2] "effect": "NoExecute",
2021-07-11T01:40:40.7266109Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-11T01:40:40.7266911Z [cluster2] "operator": "Exists",
2021-07-11T01:40:40.7267554Z [cluster2] "tolerationSeconds": 300
2021-07-11T01:40:40.7268129Z [cluster2] }
2021-07-11T01:40:40.7268552Z [cluster2] ],
2021-07-11T01:40:40.7269025Z [cluster2] "volumes": [
2021-07-11T01:40:40.7269483Z [cluster2] {
2021-07-11T01:40:40.7270786Z [cluster2] "name": "submariner-operator-token-wc9vw",
2021-07-11T01:40:40.7271621Z [cluster2] "secret": {
2021-07-11T01:40:40.7272187Z [cluster2] "defaultMode": 420,
2021-07-11T01:40:40.7273312Z [cluster2] "secretName": "submariner-operator-token-wc9vw"
2021-07-11T01:40:40.7274159Z [cluster2] }
2021-07-11T01:40:40.7274607Z [cluster2] }
2021-07-11T01:40:40.7275028Z [cluster2] ]
2021-07-11T01:40:40.7275459Z [cluster2] },
2021-07-11T01:40:40.7275901Z [cluster2] "status": {
2021-07-11T01:40:40.7276563Z [cluster2] "conditions": [
2021-07-11T01:40:40.7277040Z [cluster2] {
2021-07-11T01:40:40.7277598Z [cluster2] "lastProbeTime": null,
2021-07-11T01:40:40.7278526Z [cluster2] "lastTransitionTime": "2021-07-11T01:39:02Z",
2021-07-11T01:40:40.7279201Z [cluster2] "status": "True",
2021-07-11T01:40:40.7279778Z [cluster2] "type": "Initialized"
2021-07-11T01:40:40.7280316Z [cluster2] },
2021-07-11T01:40:40.7280749Z [cluster2] {
2021-07-11T01:40:40.7281310Z [cluster2] "lastProbeTime": null,
2021-07-11T01:40:40.7282243Z [cluster2] "lastTransitionTime": "2021-07-11T01:39:03Z",
2021-07-11T01:40:40.7282898Z [cluster2] "status": "True",
2021-07-11T01:40:40.7283443Z [cluster2] "type": "Ready"
2021-07-11T01:40:40.7283916Z [cluster2] },
2021-07-11T01:40:40.7284359Z [cluster2] {
2021-07-11T01:40:40.7284901Z [cluster2] "lastProbeTime": null,
2021-07-11T01:40:40.7285824Z [cluster2] "lastTransitionTime": "2021-07-11T01:39:03Z",
2021-07-11T01:40:40.7286757Z [cluster2] "status": "True",
2021-07-11T01:40:40.7287397Z [cluster2] "type": "ContainersReady"
2021-07-11T01:40:40.7287973Z [cluster2] },
2021-07-11T01:40:40.7288400Z [cluster2] {
2021-07-11T01:40:40.7288956Z [cluster2] "lastProbeTime": null,
2021-07-11T01:40:40.7289918Z [cluster2] "lastTransitionTime": "2021-07-11T01:39:02Z",
2021-07-11T01:40:40.7290585Z [cluster2] "status": "True",
2021-07-11T01:40:40.7291218Z [cluster2] "type": "PodScheduled"
2021-07-11T01:40:40.7291768Z [cluster2] }
2021-07-11T01:40:40.7292192Z [cluster2] ],
2021-07-11T01:40:40.7292757Z [cluster2] "containerStatuses": [
2021-07-11T01:40:40.7293308Z [cluster2] {
2021-07-11T01:40:40.7295796Z [cluster2] "containerID": "containerd://8286f1bb7e493f00bd4c1e148e25cf7fb3c6d5852302bb72029dc3d0c1324d04",
2021-07-11T01:40:40.7298330Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-11T01:40:40.7300173Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:5d9a89c190aa03771e6fb566d777af54cc39655ccb6a5a53d108b11e6a2a5cb0",
2021-07-11T01:40:40.7301515Z [cluster2] "lastState": {},
2021-07-11T01:40:40.7302893Z [cluster2] "name": "submariner-operator",
2021-07-11T01:40:40.7303771Z [cluster2] "ready": true,
2021-07-11T01:40:40.7304330Z [cluster2] "restartCount": 0,
2021-07-11T01:40:40.7304914Z [cluster2] "started": true,
2021-07-11T01:40:40.7305424Z [cluster2] "state": {
2021-07-11T01:40:40.7305936Z [cluster2] "running": {
2021-07-11T01:40:40.8828408Z [cluster2] "startedAt": "2olebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8830648Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8832744Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8833975Z [cluster1] NAME ROLE AGE
2021-07-11T01:40:40.8835014Z [cluster1] submariner-operator Role/submariner-operator 5m6s
2021-07-11T01:40:40.8836722Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8838626Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8840777Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-11T01:40:40.8842535Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-11T01:40:40.8843717Z [cluster1] submariner-operator 1/1 1 1 5m1s
2021-07-11T01:40:40.8844732Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-11T01:40:40.8845779Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-11T01:40:40.8847459Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-11T01:40:40.8849707Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.8852000Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.8854409Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:40.8856853Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o json
2021-07-11T01:40:40.8859223Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o json
2021-07-11T01:40:40.8861718Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o json
2021-07-11T01:40:40.8863089Z [cluster1] {
2021-07-11T01:40:40.8863590Z [cluster1] "apiVersion": "v1",
2021-07-11T01:40:40.8864110Z [cluster1] "kind": "Pod",
2021-07-11T01:40:40.8864711Z [cluster1] "metadata": {
2021-07-11T01:40:40.8865548Z [cluster1] "creationTimestamp": "2021-07-11T01:38:54Z",
2021-07-11T01:40:40.8866833Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-11T01:40:40.8867797Z [cluster1] "labels": {
2021-07-11T01:40:40.8868629Z [cluster1] "name": "submariner-operator",
2021-07-11T01:40:40.8869588Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-11T01:40:40.8870326Z [cluster1] },
2021-07-11T01:40:40.8870860Z [cluster1] "managedFields": [
2021-07-11T01:40:40.8871369Z [cluster1] {
2021-07-11T01:40:40.8872020Z [cluster1] "apiVersion": "v1",
2021-07-11T01:40:40.8872647Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:40.8873250Z [cluster1] "fieldsV1": {
2021-07-11T01:40:40.8873780Z [cluster1] "f:metadata": {
2021-07-11T01:40:40.8874381Z [cluster1] "f:generateName": {},
2021-07-11T01:40:40.8874961Z [cluster1] "f:labels": {
2021-07-11T01:40:40.8875472Z [cluster1] ".": {},
2021-07-11T01:40:40.8875980Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8876929Z [cluster1] "f:pod-template-hash": {}
2021-07-11T01:40:40.8877534Z [cluster1] },
2021-07-11T01:40:40.8878111Z [cluster1] "f:ownerReferences": {
2021-07-11T01:40:40.8878700Z [cluster1] ".": {},
2021-07-11T01:40:40.8879599Z [cluster1] "k:{\"uid\":\"33f1318c-21c5-4612-81f4-d75dc5ef1ccb\"}": {
2021-07-11T01:40:40.8880284Z [cluster1] ".": {},
2021-07-11T01:40:40.8880831Z [cluster1] "f:apiVersion": {},
2021-07-11T01:40:40.8881532Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-11T01:40:40.8882227Z [cluster1] "f:controller": {},
2021-07-11T01:40:40.8882776Z [cluster1] "f:kind": {},
2021-07-11T01:40:40.8883302Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8883911Z [cluster1] "f:uid": {}
2021-07-11T01:40:40.8884433Z [cluster1] }
2021-07-11T01:40:40.8884888Z [cluster1] }
2021-07-11T01:40:40.8885351Z [cluster1] },
2021-07-11T01:40:40.8885826Z [cluster1] "f:spec": {
2021-07-11T01:40:40.8886380Z [cluster1] "f:containers": {
2021-07-11T01:40:40.8887329Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-11T01:40:40.8887986Z [cluster1] ".": {},
2021-07-11T01:40:40.8888512Z [cluster1] "f:command": {},
2021-07-11T01:40:40.8889043Z [cluster1] "f:env": {
2021-07-11T01:40:40.8889551Z [cluster1] ".": {},
2021-07-11T01:40:40.8890126Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-11T01:40:40.8890728Z [cluster1] ".": {},
2021-07-11T01:40:40.8891237Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8891790Z [cluster1] "f:value": {}
2021-07-11T01:40:40.8892307Z [cluster1] },
2021-07-11T01:40:40.8892845Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-11T01:40:40.8893411Z [cluster1] ".": {},
2021-07-11T01:40:40.8893916Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8894490Z [cluster1] "f:valueFrom": {
2021-07-11T01:40:40.8895031Z [cluster1] ".": {},
2021-07-11T01:40:40.8895583Z [cluster1] "f:fieldRef": {
2021-07-11T01:40:40.8896128Z [cluster1] ".": {},
2021-07-11T01:40:40.8896717Z [cluster1] "f:apiVersion": {},
2021-07-11T01:40:40.8897351Z [cluster1] "f:fieldPath": {}
2021-07-11T01:40:40.8897902Z [cluster1] }
2021-07-11T01:40:40.8898397Z [cluster1] }
2021-07-11T01:40:40.8898869Z [cluster1] },
2021-07-11T01:40:40.8899551Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-11T01:40:40.8900149Z [cluster1] ".": {},
2021-07-11T01:40:40.8900680Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8901249Z [cluster1] "f:valueFrom": {
2021-07-11T01:40:40.8904732Z [cluster1] ".": {},
2021-07-11T01:40:40.8905324Z [cluster1] "f:fieldRef": {
2021-07-11T01:40:40.8905897Z [cluster1] ".": {},
2021-07-11T01:40:40.8906486Z [cluster1] "f:apiVersion": {},
2021-07-11T01:40:40.8907108Z [cluster1] "f:fieldPath": {}
2021-07-11T01:40:40.8907668Z [cluster1] }
2021-07-11T01:40:40.8908148Z [cluster1] }
2021-07-11T01:40:40.8908647Z [cluster1] }
2021-07-11T01:40:40.8909128Z [cluster1] },
2021-07-11T01:40:40.8909623Z [cluster1] "f:image": {},
2021-07-11T01:40:40.8910347Z [cluster1] "f:imagePullPolicy": {},
2021-07-11T01:40:40.8910961Z [cluster1] "f:name": {},
2021-07-11T01:40:40.8911526Z [cluster1] "f:resources": {},
2021-07-11T01:40:40.8912417Z [cluster1] "f:terminationMessagePath": {},
2021-07-11T01:40:40.8913338Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-11T01:40:40.8914028Z [cluster1] }
2021-07-11T01:40:40.8957260Z [cluster1] },
2021-07-11T01:40:40.8957815Z [cluster1] "f:dnsPolicy": {},
2021-07-11T01:40:40.8958502Z [cluster1] "f:enableServiceLinks": {},
2021-07-11T01:40:40.8959394Z [cluster1] "f:restartPolicy": {},
2021-07-11T01:40:40.8960038Z [cluster1] "f:schedulerName": {},
2021-07-11T01:40:40.8960715Z [cluster1] "f:securityContext": {},
2021-07-11T01:40:40.8961387Z [cluster1] "f:serviceAccount": {},
2021-07-11T01:40:40.8962110Z [cluster1] "f:serviceAccountName": {},
2021-07-11T01:40:40.8963037Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-11T01:40:40.8963833Z [cluster1] }
2021-07-11T01:40:40.8964291Z [cluster1] },
2021-07-11T01:40:40.8965487Z [cluster1] "manager": "kube-controller-manager",
2021-07-11T01:40:40.8966374Z [cluster1] "operation": "Update",
2021-07-11T01:40:40.8967154Z [cluster1] "time": "2021-07-11T01:38:54Z"
2021-07-11T01:40:40.8967726Z [cluster1] },
2021-07-11T01:40:40.8968169Z [cluster1] {
2021-07-11T01:40:40.8968688Z [cluster1] "apiVersion": "v1",
2021-07-11T01:40:40.8969303Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:40.8969905Z [cluster1] "fieldsV1": {
2021-07-11T01:40:40.8970422Z [cluster1] "f:status": {
2021-07-11T01:40:40.8970986Z [cluster1] "f:conditions": {
2021-07-11T01:40:40.8971666Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-11T01:40:40.8972282Z [cluster1] ".": {},
2021-07-11T01:40:40.8972871Z [cluster1] "f:lastProbeTime": {},
2021-07-11T01:40:40.8973579Z [cluster1] "f:lastTransitionTime": {},
2021-07-11T01:40:40.8974241Z [cluster1] "f:status": {},
2021-07-11T01:40:40.8974766Z [cluster1] "f:type": {}
2021-07-11T01:40:40.8975429Z [cluster1] },
2021-07-11T01:40:40.8976017Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-11T01:40:40.8976588Z [cluster1] ".": {},
2021-07-11T01:40:40.8977170Z [cluster1] "f:lastProbeTime": {},
2021-07-11T01:40:40.8977880Z [cluster1] "f:lastTransitionTime": {},
2021-07-11T01:40:40.8978545Z [cluster1] "f:status": {},
2021-07-11T01:40:40.8979075Z [cluster1] "f:type": {}
2021-07-11T01:40:40.8979576Z [cluster1] },
2021-07-11T01:40:40.8980099Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-11T01:40:40.8980640Z [cluster1] ".": {},
2021-07-11T01:40:40.8981225Z [cluster1] "f:lastProbeTime": {},
2021-07-11T01:40:40.8982057Z [cluster1] "f:lastTransitionTime": {},
2021-07-11T01:40:40.8982811Z [cluster1] "f:status": {},
2021-07-11T01:40:40.8983350Z [cluster1] "f:type": {}
2021-07-11T01:40:40.8983851Z [cluster1] }
2021-07-11T01:40:40.8984304Z [cluster1] },
2021-07-11T01:40:40.8984948Z [cluster1] "f:containerStatuses": {},
2021-07-11T01:40:40.8985572Z [cluster1] "f:hostIP": {},
2021-07-11T01:40:40.8986180Z [cluster1] "f:phase": {},
2021-07-11T01:40:40.8986800Z [cluster1] "f:podIP": {},
2021-07-11T01:40:40.8987347Z [cluster1] "f:podIPs": {
2021-07-11T01:40:40.8987865Z [cluster1] ".": {},
2021-07-11T01:40:40.8988454Z [cluster1] "k:{\"ip\":\"10.1.128.5\"}": {
2021-07-11T01:40:40.8988972Z [cluster1] ".": {},
2021-07-11T01:40:40.8989528Z [cluster1] "f:ip": {}
2021-07-11T01:40:40.8990023Z [cluster1] }
2021-07-11T01:40:40.9019223Z [cluster1] },
2021-07-11T01:40:40.9019842Z [cluster1] "f:startTime": {}
2021-07-11T01:40:40.9020351Z [cluster1] }
2021-07-11T01:40:40.9020806Z [cluster1] },
2021-07-11T01:40:40.9021334Z [cluster1] "manager": "kubelet",
2021-07-11T01:40:40.9021937Z [cluster1] "operation": "Update",
2021-07-11T01:40:40.9022965Z [cluster1] "time": "2021-07-11T01:38:55Z"
2021-07-11T01:40:40.9023449Z [cluster1] }
2021-07-11T01:40:40.9023999Z [cluster1] ],
2021-07-11T01:40:40.9025070Z [cluster1] "name": "submariner-operator-5bfdb87494-pr8vl",
2021-07-11T01:40:40.9026307Z [cluster1] "namespace": "submariner-operator",
2021-07-11T01:40:40.9027047Z [cluster1] "ownerReferences": [
2021-07-11T01:40:40.9027602Z [cluster1] {
2021-07-11T01:40:40.9028135Z [cluster1] "apiVersion": "apps/v1",
2021-07-11T01:40:40.9028849Z [cluster1] "blockOwnerDeletion": true,
2021-07-11T01:40:40.9029542Z [cluster1] "controller": true,
2021-07-11T01:40:40.9030240Z [cluster1] "kind": "ReplicaSet",
2021-07-11T01:40:40.9031438Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-11T01:40:40.9032592Z [cluster1] "uid": "33f1318c-21c5-4612-81f4-d75dc5ef1ccb"
2021-07-11T01:40:40.9033219Z [cluster1] }
2021-07-11T01:40:40.9033647Z [cluster1] ],
2021-07-11T01:40:40.9034207Z [cluster1] "resourceVersion": "2183",
2021-07-11T01:40:40.9035136Z [cluster1] "uid": "8d3837ec-02b5-4869-a1c8-0c3237de975d"
2021-07-11T01:40:40.9035756Z [cluster1] },
2021-07-11T01:40:40.9036195Z [cluster1] "spec": {
2021-07-11T01:40:40.9036713Z [cluster1] "containers": [
2021-07-11T01:40:40.9037211Z [cluster1] {
2021-07-11T01:40:40.9037856Z [cluster1] "command": [
2021-07-11T01:40:40.9038698Z [cluster1] "submariner-operator",
2021-07-11T01:40:40.9039564Z [cluster1] "-alsologtostderr",
2021-07-11T01:40:40.9040288Z [cluster1] "-v=1"
2021-07-11T01:40:40.9040735Z [cluster1] ],
2021-07-11T01:40:40.9041208Z [cluster1] "env": [
2021-07-11T01:40:40.9041665Z [cluster1] {
2021-07-11T01:40:40.9042234Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-11T01:40:40.9042842Z [cluster1] "valueFrom": {
2021-07-11T01:40:40.9043412Z [cluster1] "fieldRef": {
2021-07-11T01:40:40.9044012Z [cluster1] "apiVersion": "v1",
2021-07-11T01:40:40.9044740Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-11T01:40:40.9045406Z [cluster1] }
2021-07-11T01:40:40.9045860Z [cluster1] }
2021-07-11T01:40:40.9046320Z [cluster1] },
2021-07-11T01:40:40.9046761Z [cluster1] {
2021-07-11T01:40:40.9047285Z [cluster1] "name": "POD_NAME",
2021-07-11T01:40:40.9047843Z [cluster1] "valueFrom": {
2021-07-11T01:40:40.9048411Z [cluster1] "fieldRef": {
2021-07-11T01:40:40.9048990Z [cluster1] "apiVersion": "v1",
2021-07-11T01:40:40.9049773Z [cluster1] "fieldPath": "metadata.name"
2021-07-11T01:40:40.9050380Z [cluster1] }
2021-07-11T01:40:40.9050832Z [cluster1] }
2021-07-11T01:40:40.9051290Z [cluster1] },
2021-07-11T01:40:40.9051727Z [cluster1] {
2021-07-11T01:40:40.9052280Z [cluster1] "name": "OPERATOR_NAME",
2021-07-11T01:40:40.9053323Z [cluster1] "value": "submariner-operator"
2021-07-11T01:40:40.9053966Z [cluster1] }
2021-07-11T01:40:40.9054409Z [cluster1] ],
2021-07-11T01:40:40.9055323Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-11T01:40:40.9056231Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-11T01:40:40.9057208Z [cluster1] "name": "submariner-operator",
2021-07-11T01:40:40.9057892Z [cluster1] "resources": {},
2021-07-11T01:40:40.9058903Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-11T01:40:40.9059935Z [cluster1] "terminationMessagePolicy": "File",
2021-07-11T01:40:40.9060780Z [cluster1] "volumeMounts": [
2021-07-11T01:40:40.9061312Z [cluster1] {
2021-07-11T01:40:40.9062054Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-11T01:40:40.9063380Z [cluster1] "name": "submariner-operator-token-62tgh",
2021-07-11T01:40:40.9064261Z [cluster1] "readOnly": true
2021-07-11T01:40:40.9064769Z [cluster1] }
2021-07-11T01:40:40.9065223Z [cluster1] ]
2021-07-11T01:40:40.9065652Z [cluster1] }
2021-07-11T01:40:40.9066092Z [cluster1] ],
2021-07-11T01:40:40.9066645Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-11T01:40:40.9067382Z [cluster1] "enableServiceLinks": true,
2021-07-11T01:40:40.9068306Z [cluster1] "nodeName": "cluster1-worker2",
2021-07-11T01:40:40.9069209Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-11T01:40:40.9069979Z [cluster1] "priority": 0,
2021-07-11T01:40:40.9070695Z [cluster1] "restartPolicy": "Always",
2021-07-11T01:40:40.9071770Z [cluster1] "schedulerName": "default-scheduler",
2021-07-11T01:40:40.9072519Z [cluster1] "securityContext": {},
2021-07-11T01:40:40.9073614Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-11T01:40:40.9074896Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-11T01:40:40.9075952Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-11T01:40:40.9076755Z [cluster1] "tolerations": [
2021-07-11T01:40:40.9077264Z [cluster1] {
2021-07-11T01:40:40.9077790Z [cluster1] "effect": "NoExecute",
2021-07-11T01:40:40.9078707Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-11T01:40:40.9079425Z [cluster1] "operator": "Exists",
2021-07-11T01:40:40.9080089Z [cluster1] "tolerationSeconds": 300
2021-07-11T01:40:40.9080668Z [cluster1] },
2021-07-11T01:40:40.9081093Z [cluster1] {
2021-07-11T01:40:40.9081630Z [cluster1] "effect": "NoExecute",
2021-07-11T01:40:40.9082496Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-11T01:40:40.9083245Z [cluster1] "operator": "Exists",
2021-07-11T01:40:40.9083999Z [cluster1] "tolerationSeconds": 300
2021-07-11T01:40:40.9084612Z [cluster1] }
2021-07-11T01:40:40.9085038Z [cluster1] ],
2021-07-11T01:40:40.9085510Z [cluster1] "volumes": [
2021-07-11T01:40:40.9085968Z [cluster1] {
2021-07-11T01:40:40.9086981Z [cluster1] "name": "submariner-operator-token-62tgh",
2021-07-11T01:40:40.9087811Z [cluster1] "secret": {
2021-07-11T01:40:40.9088355Z [cluster1] "defaultMode": 420,
2021-07-11T01:40:40.9089580Z [cluster1] "secretName": "submariner-operator-token-62tgh"
2021-07-11T01:40:40.9090402Z [cluster1] }
2021-07-11T01:40:40.9090845Z [cluster1] }
2021-07-11T01:40:40.9091262Z [cluster1] ]
2021-07-11T01:40:40.9091691Z [cluster1] },
2021-07-11T01:40:40.9092133Z [cluster1] "status": {
2021-07-11T01:40:40.9092652Z [cluster1] "conditions": [
2021-07-11T01:40:40.9093226Z [cluster1] {
2021-07-11T01:40:40.9093789Z [cluster1] "lastProbeTime": null,
2021-07-11T01:40:40.9094715Z [cluster1] "lastTransitionTime": "2021-07-11T01:38:54Z",
2021-07-11T01:40:40.9095388Z [cluster1] "status": "True",
2021-07-11T01:40:40.9095980Z [cluster1] "type": "Initialized"
2021-07-11T01:40:40.9096493Z [cluster1] },
2021-07-11T01:40:40.9096934Z [cluster1] {
2021-07-11T01:40:40.9097476Z [cluster1] "lastProbeTime": null,
2021-07-11T01:40:40.9098524Z [cluster1] "lastTransitionTime": "2021-07-11T01:38:55Z",
2021-07-11T01:40:40.9099184Z [cluster1] "status": "True",
2021-07-11T01:40:40.9099726Z [cluster1] "type": "Ready"
2021-07-11T01:40:40.9100201Z [cluster1] },
2021-07-11T01:40:40.9100644Z [cluster1] {
2021-07-11T01:40:40.9101185Z [cluster1] "lastProbeTime": null,
2021-07-11T01:40:40.9102113Z [cluster1] "lastTransitionTime": "2021-07-11T01:38:55Z",
2021-07-11T01:40:40.9102788Z [cluster1] "status": "True",
2021-07-11T01:40:40.9103401Z [cluster1] "type": "ContainersReady"
2021-07-11T01:40:40.9103973Z [cluster1] },
2021-07-11T01:40:40.9104397Z [cluster1] {
2021-07-11T01:40:40.9104953Z [cluster1] "lastProbeTime": null,
2021-07-11T01:40:40.9105852Z [cluster1] "lastTransitionTime": "2021-07-11T01:38:54Z",
2021-07-11T01:40:40.9106522Z [cluster1] "status": "True",
2021-07-11T01:40:40.9107115Z [cluster1] "type": "PodScheduled"
2021-07-11T01:40:40.9107664Z [cluster1] }
2021-07-11T01:40:40.9108084Z [cluster1] ],
2021-07-11T01:40:40.9108651Z [cluster1] "containerStatuses": [
2021-07-11T01:40:40.9109214Z [cluster1] {
2021-07-11T01:40:40.9111182Z [cluster1] "containerID": "containerd://0109e45b18bb38cf12730b5d9be5dbd38af4600c397a9e12fae1c68667e95c72",
2021-07-11T01:40:40.9113605Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-11T01:40:40.9115465Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:5d9a89c190aa03771e6fb566d777af54cc39655ccb6a5a53d108b11e6a2a5cb0",
2021-07-11T01:40:40.9116819Z [cluster1] "lastState": {},
2021-07-11T01:40:40.9117663Z [cluster1] "name": "submariner-operator",
2021-07-11T01:40:40.9118334Z [cluster1] "ready": true,
2021-07-11T01:40:40.9118913Z [cluster1] "restartCount": 0,
2021-07-11T01:40:40.9119481Z [cluster1] "started": true,
2021-07-11T01:40:40.9120011Z [cluster1] "state": {
2021-07-11T01:40:40.9120507Z [cluster1] "running": {
2021-07-11T01:40:41.6886211Z [cluster1] "startedAt": "2021021-07-11T01:39:03Z"
2021-07-11T01:40:41.6887047Z [cluster2] }
2021-07-11T01:40:41.6887517Z [cluster2] }
2021-07-11T01:40:41.6887982Z [cluster2] }
2021-07-11T01:40:41.6888427Z [cluster2] ],
2021-07-11T01:40:41.6888900Z [cluster2] "hostIP": "172.18.0.7",
2021-07-11T01:40:41.6889453Z [cluster2] "phase": "Running",
2021-07-11T01:40:41.6889985Z [cluster2] "podIP": "10.2.128.4",
2021-07-11T01:40:41.6890503Z [cluster2] "podIPs": [
2021-07-11T01:40:41.6890964Z [cluster2] {
2021-07-11T01:40:41.6891439Z [cluster2] "ip": "10.2.128.4"
2021-07-11T01:40:41.6892146Z [cluster2] }
2021-07-11T01:40:41.6892588Z [cluster2] ],
2021-07-11T01:40:41.6893128Z [cluster2] "qosClass": "BestEffort",
2021-07-11T01:40:41.6893989Z [cluster2] "startTime": "2021-07-11T01:39:02Z"
2021-07-11T01:40:41.6894508Z [cluster2] }
2021-07-11T01:40:41.6894917Z [cluster2] }
2021-07-11T01:40:41.6896605Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.6898374Z [submariner-operator]$ [cluster2] grep Running
2021-07-11T01:40:41.6900249Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.6903122Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.6904623Z [cluster2] Running
2021-07-11T01:40:41.6906166Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator
2021-07-11T01:40:41.6908460Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator
2021-07-11T01:40:41.6911037Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-hz454 --namespace=submariner-operator
2021-07-11T01:40:41.6912554Z [cluster2] I0711 01:39:04.009933 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-11T01:40:41.6913293Z [cluster2] I0711 01:39:04.010060 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-11T01:40:41.6914368Z [cluster2] I0711 01:39:04.010087 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-11T01:40:41.6915637Z [cluster2] I0711 01:39:04.010108 1 main.go:80] cmd "msg"="Submariner operator version: devel-1a48316"
2021-07-11T01:40:41.6916599Z [cluster2] I0711 01:39:04.011084 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-11T01:40:41.6918174Z [cluster2] I0711 01:39:04.741730 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-sbzrn"
2021-07-11T01:40:41.6919444Z [cluster2] I0711 01:39:04.770832 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-11T01:40:41.6920458Z [cluster2] I0711 01:39:05.915933 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-11T01:40:41.6921316Z [cluster2] I0711 01:39:08.326380 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-11T01:40:41.6922175Z [cluster2] I0711 01:39:12.868908 1 leader.go:149] leader "msg"="Became the leader."
2021-07-11T01:40:41.6923567Z [cluster2] I0711 01:39:13.473284 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-11T01:40:41.6924651Z [cluster2] I0711 01:39:13.473871 1 main.go:129] cmd "msg"="Registering Components."
2021-07-11T01:40:41.6925514Z [cluster2] I0711 01:39:13.474314 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-11T01:40:41.6926639Z [cluster2] I0711 01:39:17.241309 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.6928724Z [cluster2] I0711 01:39:17.241344 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.6930088Z [cluster2] I0711 01:39:17.241568 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-11T01:40:41.6931375Z [cluster2] I0711 01:39:17.243213 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-11T01:40:41.6959606Z [cluster2] I0711 01:39:17.243856 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-11T01:40:41.6969451Z [cluster2] I0711 01:39:17.244172 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-11T01:40:41.6976467Z [cluster2] I0711 01:39:17.244453 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-11T01:40:41.6981423Z [cluster2] I0711 01:39:17.244714 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-11T01:40:41.6985432Z [cluster2] I0711 01:39:17.244937 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-11T01:40:41.6988130Z [cluster2] I0711 01:39:17.344833 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-11T01:40:41.6990829Z [cluster2] I0711 01:39:17.352489 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-11T01:40:41.6994198Z [cluster2] I0711 01:39:17.346681 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-11T01:40:41.6997187Z [cluster2] I0711 01:39:17.352698 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.7000912Z [cluster2] I0711 01:39:17.352985 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-11T01:40:41.7005478Z [cluster2] I0711 01:39:17.353045 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-11T01:40:41.7008464Z [cluster2] I0711 01:39:17.453409 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-11T01:40:41.7010603Z [cluster2] I0711 01:39:17.453425 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-11T01:40:41.7012759Z [cluster2] I0711 01:39:17.453734 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-11T01:40:41.7015022Z [cluster2] I0711 01:39:17.453513 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-11T01:40:41.7045253Z [cluster2] I0711 01:39:17.453786 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-11T01:40:41.7048426Z [cluster2] I0711 01:39:17.453993 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-11T01:40:41.7050783Z [cluster2] I0711 01:39:17.454175 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7052942Z [cluster2] I0711 01:39:17.554230 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-11T01:40:41.7055080Z [cluster2] I0711 01:39:17.554627 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-11T01:40:41.7057287Z [cluster2] I0711 01:39:17.555097 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7059625Z [cluster2] I0711 01:39:18.983374 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7076733Z [cluster2] I0711 01:39:18.985252 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7079324Z [cluster2] I0711 01:39:19.085232 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7081680Z [cluster2] I0711 01:39:19.086031 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7083995Z [cluster2] I0711 01:39:20.361057 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7086529Z [cluster2] I0711 01:39:20.361058 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7088202Z [cluster2] I0711 01:39:20.510679 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-11T01:40:41.7090042Z [cluster2] I0711 01:39:20.510942 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-11T01:40:41.7091584Z [cluster2] I0711 01:39:20.511119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7093017Z [cluster2] I0711 01:39:20.511219 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7094428Z [cluster2] I0711 01:39:20.514227 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-11T01:40:41.7096261Z [cluster2] I0711 01:39:20.514417 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-11T01:40:41.7097783Z [cluster2] I0711 01:39:20.514555 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7099231Z [cluster2] I0711 01:39:20.514685 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7101789Z [cluster2] I0711 01:39:20.559402 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7105775Z [cluster2] E0711 01:39:20.565007 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-11T01:40:41.7109189Z [cluster2] I0711 01:39:20.570374 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7138192Z [cluster2] I0711 01:39:20.570575 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7139702Z [cluster2] I0711 01:39:20.570697 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7142593Z [cluster2] I0711 01:39:20.626928 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7145983Z [cluster2] I0711 01:39:20.740598 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7149952Z [cluster2] E0711 01:39:20.858842 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-11T01:40:41.7153736Z [cluster2] I0711 01:39:20.867788 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7155485Z [cluster2] I0711 01:39:20.867906 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7156933Z [cluster2] I0711 01:39:20.867974 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7159536Z [cluster2] I0711 01:39:21.122241 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7162915Z [cluster2] I0711 01:39:21.136608 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7166316Z [cluster2] I0711 01:39:21.359671 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7169628Z [cluster2] I0711 01:39:21.372846 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7172712Z [cluster2] I0711 01:39:21.420405 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7175576Z [cluster2] I0711 01:39:21.420914 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7251549Z [cluster2] I0711 01:39:21.426793 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-11T01:40:41.7255445Z [cluster2] I0711 01:39:21.453941 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7260242Z [cluster2] E0711 01:39:21.567152 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-11T01:40:41.7264349Z [cluster2] I0711 01:39:21.572501 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7266935Z [cluster2] I0711 01:39:21.734646 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7268679Z [cluster2] I0711 01:39:21.875733 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7270379Z [cluster2] I0711 01:39:21.875772 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7273483Z [cluster2] I0711 01:39:21.748279 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7277115Z [cluster2] I0711 01:39:21.877932 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7280993Z [cluster2] I0711 01:39:22.335542 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7284630Z [cluster2] I0711 01:39:22.338664 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7287996Z [cluster2] I0711 01:39:22.619612 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7291477Z [cluster2] I0711 01:39:22.623383 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7295317Z [cluster2] I0711 01:39:22.971855 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-11T01:40:41.7299462Z [cluster2] E0711 01:39:22.971941 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-11T01:40:41.7304028Z [cluster2] E0711 01:39:22.972011 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-11T01:40:41.7307866Z [cluster2] I0711 01:39:22.972072 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7311131Z [cluster2] I0711 01:39:23.059585 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7314994Z [cluster2] E0711 01:39:23.073087 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7318129Z [cluster2] I0711 01:39:23.073131 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7319951Z [cluster2] I0711 01:39:23.073164 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7321392Z [cluster2] I0711 01:39:23.073190 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7324368Z [cluster2] I0711 01:39:23.074421 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7328010Z [cluster2] I0711 01:39:23.241574 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7331652Z [cluster2] I0711 01:39:23.242097 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7335641Z [cluster2] I0711 01:39:23.572339 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7339350Z [cluster2] I0711 01:39:23.572433 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7342722Z [cluster2] I0711 01:39:23.661788 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7346123Z [cluster2] I0711 01:39:23.678163 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7350004Z [cluster2] I0711 01:39:23.680934 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7353767Z [cluster2] I0711 01:39:23.702489 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7355529Z [cluster2] I0711 01:39:23.702661 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7356993Z [cluster2] I0711 01:39:23.702677 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7359895Z [cluster2] I0711 01:39:23.847168 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7364251Z [cluster2] E0711 01:39:23.847217 1 servicediscovery_controller.go:158] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS deployment" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found"
2021-07-11T01:40:41.7369369Z [cluster2] E0711 01:39:23.847255 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-coredns: Deployment.apps \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-11T01:40:41.7373717Z [cluster2] I0711 01:39:23.855558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7376776Z [cluster2] I0711 01:39:23.858273 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7379951Z [cluster2] I0711 01:39:24.100675 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7383620Z [cluster2] I0711 01:39:24.259712 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7387353Z [cluster2] I0711 01:39:24.333474 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7390921Z [cluster2] I0711 01:39:24.334727 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7394675Z [cluster2] I0711 01:39:24.486655 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7398376Z [cluster2] I0711 01:39:24.563078 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7402217Z [cluster2] E0711 01:39:24.665458 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7405367Z [cluster2] I0711 01:39:24.665506 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7407091Z [cluster2] I0711 01:39:24.665555 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7408543Z [cluster2] I0711 01:39:24.665567 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7411228Z [cluster2] I0711 01:39:24.696199 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7414872Z [cluster2] I0711 01:39:24.697317 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7435055Z [cluster2] I0711 01:39:24.784657 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7438685Z [cluster2] I0711 01:39:24.833595 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7442673Z [cluster2] I0711 01:39:24.878339 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7447519Z [cluster2] E0711 01:39:24.878413 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: Service \"submariner-lighthouse-coredns-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-11T01:40:41.7451594Z [cluster2] I0711 01:39:24.878455 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7454759Z [cluster2] I0711 01:39:24.879565 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7458349Z [cluster2] I0711 01:39:25.127607 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7462104Z [cluster2] I0711 01:39:25.129505 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7465761Z [cluster2] I0711 01:39:25.142885 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7469562Z [cluster2] I0711 01:39:25.152054 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7473709Z [cluster2] I0711 01:39:25.194921 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7511523Z [cluster2] I0711 01:39:25.233084 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7515487Z [cluster2] I0711 01:39:25.511794 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7518813Z [cluster2] I0711 01:39:25.567180 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7522300Z [cluster2] I0711 01:39:25.847508 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7525840Z [cluster2] I0711 01:39:25.891755 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7529584Z [cluster2] I0711 01:39:26.055295 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7533116Z [cluster2] I0711 01:39:26.058059 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7537884Z [cluster2] I0711 01:39:26.058101 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.7542625Z [cluster2] I0711 01:39:26.175528 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7546466Z [cluster2] I0711 01:39:26.783832 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7549770Z [cluster2] I0711 01:39:26.789973 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7554932Z [cluster2] I0711 01:39:26.790014 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.7559163Z [cluster2] I0711 01:39:26.797948 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7562583Z [cluster2] I0711 01:39:26.838019 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7566587Z [cluster2] I0711 01:39:26.868051 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7594400Z [cluster2] I0711 01:39:27.469532 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7598454Z [cluster2] I0711 01:39:27.496497 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7602641Z [cluster2] I0711 01:39:27.619406 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7606474Z [cluster2] I0711 01:39:28.223883 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7609917Z [cluster2] I0711 01:39:28.228538 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7614571Z [cluster2] I0711 01:39:28.228586 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.7618370Z [cluster2] I0711 01:39:31.653437 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7620123Z [cluster2] I0711 01:39:31.655788 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7621696Z [cluster2] I0711 01:39:31.655851 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7624390Z [cluster2] I0711 01:39:31.768478 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7627791Z [cluster2] I0711 01:39:31.848493 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7632024Z [cluster2] I0711 01:39:32.451612 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7635429Z [cluster2] I0711 01:39:32.516388 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7638274Z [cluster2] I0711 01:39:32.594056 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7640002Z [cluster2] I0711 01:39:32.594112 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7642439Z [cluster2] I0711 01:39:32.594124 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7644990Z [cluster2] I0711 01:39:32.630751 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7646723Z [cluster2] I0711 01:39:32.630802 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7648172Z [cluster2] I0711 01:39:32.630813 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7650887Z [cluster2] I0711 01:39:32.710865 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7654242Z [cluster2] I0711 01:39:32.711657 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7657625Z [cluster2] I0711 01:39:32.742573 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7664963Z [cluster2] I0711 01:39:32.749692 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7668483Z [cluster2] I0711 01:39:33.503089 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7672036Z [cluster2] I0711 01:39:33.513170 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7685012Z [cluster2] I0711 01:39:33.663747 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7687909Z [cluster2] I0711 01:39:33.915821 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7689638Z [cluster2] I0711 01:39:33.915880 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7691097Z [cluster2] I0711 01:39:33.915891 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7694303Z [cluster2] I0711 01:39:34.193761 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7698862Z [cluster2] I0711 01:39:34.194667 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7702267Z [cluster2] I0711 01:39:34.458140 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7705102Z [cluster2] I0711 01:39:34.597543 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7706858Z [cluster2] I0711 01:39:34.597597 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7708453Z [cluster2] I0711 01:39:34.597607 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7711103Z [cluster2] I0711 01:39:34.832516 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7714696Z [cluster2] I0711 01:39:34.987527 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7718397Z [cluster2] I0711 01:39:35.049891 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7722542Z [cluster2] I0711 01:39:35.286648 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7726314Z [cluster2] I0711 01:39:35.458901 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7730809Z [cluster2] I0711 01:39:35.459557 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7735731Z [cluster2] I0711 01:39:35.459972 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7739930Z [cluster2] E0711 01:39:35.837892 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7743831Z [cluster2] I0711 01:39:35.837966 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7745875Z [cluster2] I0711 01:39:35.839229 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7747757Z [cluster2] I0711 01:39:35.839254 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7751019Z [cluster2] I0711 01:39:35.896130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7755197Z [cluster2] I0711 01:39:35.943737 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7759043Z [cluster2] I0711 01:39:36.078147 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7762798Z [cluster2] I0711 01:39:36.084247 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7769400Z [cluster2] I0711 01:39:36.090071 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7773095Z [cluster2] I0711 01:39:36.116116 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7776868Z [cluster2] I0711 01:39:36.116698 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7780571Z [cluster2] I0711 01:39:36.546557 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7784024Z [cluster2] I0711 01:39:36.556089 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7798087Z [cluster2] I0711 01:39:36.718928 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7801463Z [cluster2] I0711 01:39:36.722631 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7806637Z [cluster2] I0711 01:39:36.722723 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.7811717Z [cluster2] I0711 01:39:36.726273 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7816248Z [cluster2] I0711 01:39:36.732787 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7820457Z [cluster2] I0711 01:39:36.738170 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7823758Z [cluster2] I0711 01:39:36.814414 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7825501Z [cluster2] I0711 01:39:36.814480 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7827260Z [cluster2] I0711 01:39:36.814491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7829906Z [cluster2] I0711 01:39:36.828192 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7833404Z [cluster2] I0711 01:39:36.832776 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7836912Z [cluster2] I0711 01:39:37.340092 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7872741Z [cluster2] I0711 01:39:37.345087 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.7877215Z [cluster2] I0711 01:39:37.351944 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7880937Z [cluster2] I0711 01:39:37.435247 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7884272Z [cluster2] I0711 01:39:37.442430 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7896791Z [cluster2] I0711 01:39:37.455453 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7898567Z [cluster2] I0711 01:39:37.455498 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7900026Z [cluster2] I0711 01:39:37.455510 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7902075Z [cluster2] I0711 01:39:37.467589 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7903808Z [cluster2] I0711 01:39:37.467630 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7905254Z [cluster2] I0711 01:39:37.467640 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7907983Z [cluster2] I0711 01:39:37.482578 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7911460Z [cluster2] I0711 01:39:37.485859 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7914853Z [cluster2] I0711 01:39:37.489450 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7918269Z [cluster2] I0711 01:39:37.490822 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7921776Z [cluster2] I0711 01:39:37.954883 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7925087Z [cluster2] I0711 01:39:37.958196 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7929831Z [cluster2] I0711 01:39:37.958235 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.7934734Z [cluster2] I0711 01:39:38.091632 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7938969Z [cluster2] I0711 01:39:38.092692 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7943635Z [cluster2] I0711 01:39:38.114798 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7947052Z [cluster2] I0711 01:39:38.123574 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7950271Z [cluster2] I0711 01:39:38.369380 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7952112Z [cluster2] I0711 01:39:38.369435 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7954003Z [cluster2] I0711 01:39:38.369461 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7956696Z [cluster2] I0711 01:39:38.382698 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7960075Z [cluster2] I0711 01:39:38.402983 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7963410Z [cluster2] I0711 01:39:39.030380 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.7967188Z [cluster2] I0711 01:39:39.038076 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7970016Z [cluster2] I0711 01:39:39.049103 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7971727Z [cluster2] I0711 01:39:39.049256 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7973280Z [cluster2] I0711 01:39:39.049277 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7975350Z [cluster2] I0711 01:39:39.051160 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7977064Z [cluster2] I0711 01:39:39.051199 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.7978503Z [cluster2] I0711 01:39:39.051298 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.7981074Z [cluster2] I0711 01:39:39.060984 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7984364Z [cluster2] I0711 01:39:39.062823 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.7987741Z [cluster2] I0711 01:39:39.071830 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7991376Z [cluster2] I0711 01:39:39.077494 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.7994725Z [cluster2] I0711 01:39:39.365128 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.7998818Z [cluster2] I0711 01:39:39.376944 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.8003553Z [cluster2] I0711 01:39:39.388576 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8008292Z [cluster2] I0711 01:39:39.673568 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8011950Z [cluster2] I0711 01:39:39.681840 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8015636Z [cluster2] I0711 01:39:39.686072 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8018951Z [cluster2] I0711 01:39:39.692897 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8021900Z [cluster2] I0711 01:39:39.705982 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8024819Z [cluster2] I0711 01:39:39.706027 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8028060Z [cluster2] E0711 01:39:39.706203 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8031996Z [cluster2] I0711 01:39:39.706238 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8034530Z [cluster2] I0711 01:39:39.706316 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8035985Z [cluster2] I0711 01:39:39.706334 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8037429Z [cluster2] I0711 01:39:39.707631 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8040064Z [cluster2] I0711 01:39:39.715130 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8043460Z [cluster2] I0711 01:39:39.718155 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8047534Z [cluster2] I0711 01:39:39.720312 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8050979Z [cluster2] I0711 01:39:39.729351 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8054962Z [cluster2] I0711 01:39:39.990226 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8058794Z [cluster2] I0711 01:39:39.999411 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.8062830Z [cluster2] I0711 01:39:40.004240 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8067773Z [cluster2] I0711 01:39:40.322259 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8072040Z [cluster2] I0711 01:39:40.329286 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8075444Z [cluster2] I0711 01:39:40.333185 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8078743Z [cluster2] I0711 01:39:40.360027 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8082563Z [cluster2] I0711 01:39:40.607618 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8086301Z [cluster2] I0711 01:39:40.612378 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8091228Z [cluster2] I0711 01:39:40.612552 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.137.123\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.8095818Z [cluster2] I0711 01:39:44.293464 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8097577Z [cluster2] I0711 01:39:44.293526 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8099017Z [cluster2] I0711 01:39:44.293538 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8101623Z [cluster2] I0711 01:39:44.302281 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8105255Z [cluster2] I0711 01:39:44.305642 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8108655Z [cluster2] I0711 01:39:44.907813 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8112220Z [cluster2] I0711 01:39:44.914348 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8115486Z [cluster2] I0711 01:39:44.922773 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8117231Z [cluster2] I0711 01:39:44.922814 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8118684Z [cluster2] I0711 01:39:44.922825 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8120768Z [cluster2] I0711 01:39:44.928961 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8122494Z [cluster2] I0711 01:39:44.929012 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8123948Z [cluster2] I0711 01:39:44.929034 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8126512Z [cluster2] I0711 01:39:44.938395 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8129886Z [cluster2] I0711 01:39:44.943065 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8133247Z [cluster2] I0711 01:39:44.949720 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8136590Z [cluster2] I0711 01:39:44.956534 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8140036Z [cluster2] I0711 01:39:45.544446 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8143386Z [cluster2] I0711 01:39:45.550434 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8146718Z [cluster2] I0711 01:39:45.560011 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8157036Z [cluster2] I0711 01:39:45.565073 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8160206Z [cluster2] I0711 01:39:49.311524 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8161966Z [cluster2] I0711 01:39:49.311591 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8163593Z [cluster2] I0711 01:39:49.311602 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8166187Z [cluster2] I0711 01:39:49.320517 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8169564Z [cluster2] I0711 01:39:49.323710 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8172925Z [cluster2] I0711 01:39:49.926206 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8176761Z [cluster2] I0711 01:39:49.933848 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8179636Z [cluster2] I0711 01:39:49.944252 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8181379Z [cluster2] I0711 01:39:49.944486 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8183526Z [cluster2] I0711 01:39:49.944584 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8185640Z [cluster2] I0711 01:39:49.952294 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8187804Z [cluster2] I0711 01:39:49.952466 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8189385Z [cluster2] I0711 01:39:49.952733 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8192223Z [cluster2] I0711 01:39:49.967987 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8195552Z [cluster2] I0711 01:39:49.972937 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8198926Z [cluster2] I0711 01:39:49.976004 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8202339Z [cluster2] I0711 01:39:50.018863 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8205689Z [cluster2] I0711 01:39:50.577879 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8209530Z [cluster2] I0711 01:39:50.591349 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8212883Z [cluster2] I0711 01:39:50.621001 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8216491Z [cluster2] I0711 01:39:50.629486 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8219971Z [cluster2] I0711 01:39:54.327494 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8221731Z [cluster2] I0711 01:39:54.327587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8223182Z [cluster2] I0711 01:39:54.327605 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8225757Z [cluster2] I0711 01:39:54.346785 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8229135Z [cluster2] I0711 01:39:54.366893 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8232619Z [cluster2] I0711 01:39:54.969303 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8236048Z [cluster2] I0711 01:39:54.995465 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8239745Z [cluster2] I0711 01:39:55.010195 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8241806Z [cluster2] I0711 01:39:55.010263 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8243697Z [cluster2] I0711 01:39:55.010274 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8246549Z [cluster2] I0711 01:39:55.025841 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8248556Z [cluster2] I0711 01:39:55.025905 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8250181Z [cluster2] I0711 01:39:55.025916 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8252837Z [cluster2] I0711 01:39:55.034047 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8256276Z [cluster2] I0711 01:39:55.039363 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8259650Z [cluster2] I0711 01:39:55.046607 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8263045Z [cluster2] I0711 01:39:55.071835 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8266400Z [cluster2] I0711 01:39:55.649046 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8269721Z [cluster2] I0711 01:39:55.658086 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8273252Z [cluster2] I0711 01:39:55.675438 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8276565Z [cluster2] I0711 01:39:55.696076 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8279380Z [cluster2] I0711 01:39:59.353309 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8281199Z [cluster2] I0711 01:39:59.353374 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8282651Z [cluster2] I0711 01:39:59.353385 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8285218Z [cluster2] I0711 01:39:59.371194 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8288583Z [cluster2] I0711 01:39:59.375555 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8291933Z [cluster2] I0711 01:39:59.977445 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8295260Z [cluster2] I0711 01:39:59.983579 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8298130Z [cluster2] I0711 01:39:59.994374 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8299865Z [cluster2] I0711 01:39:59.994442 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8301311Z [cluster2] I0711 01:39:59.994453 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8303348Z [cluster2] I0711 01:40:00.000052 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8305078Z [cluster2] I0711 01:40:00.000172 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8306527Z [cluster2] I0711 01:40:00.000235 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8309096Z [cluster2] I0711 01:40:00.004454 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8312583Z [cluster2] I0711 01:40:00.007375 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8315955Z [cluster2] I0711 01:40:00.009225 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8319376Z [cluster2] I0711 01:40:00.011534 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8322776Z [cluster2] I0711 01:40:00.611526 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8326056Z [cluster2] I0711 01:40:00.612809 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8329941Z [cluster2] I0711 01:40:00.620420 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8333400Z [cluster2] I0711 01:40:00.622483 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8336189Z [cluster2] I0711 01:40:04.370330 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8337916Z [cluster2] I0711 01:40:04.370385 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8339455Z [cluster2] I0711 01:40:04.370491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8342343Z [cluster2] I0711 01:40:04.380025 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8345950Z [cluster2] I0711 01:40:04.383837 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8349306Z [cluster2] I0711 01:40:04.986070 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8353044Z [cluster2] I0711 01:40:04.992095 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8355872Z [cluster2] I0711 01:40:05.001698 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8357612Z [cluster2] I0711 01:40:05.001740 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8359048Z [cluster2] I0711 01:40:05.001756 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8361097Z [cluster2] I0711 01:40:05.002886 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8362825Z [cluster2] I0711 01:40:05.002928 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8364357Z [cluster2] I0711 01:40:05.002940 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8366954Z [cluster2] I0711 01:40:05.024950 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8370320Z [cluster2] I0711 01:40:05.033865 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8373661Z [cluster2] I0711 01:40:05.036222 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8377040Z [cluster2] I0711 01:40:05.062999 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8380390Z [cluster2] I0711 01:40:05.639799 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8383789Z [cluster2] I0711 01:40:05.646436 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8387093Z [cluster2] I0711 01:40:05.667236 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8390521Z [cluster2] I0711 01:40:05.673301 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8393346Z [cluster2] I0711 01:40:09.393285 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8395073Z [cluster2] I0711 01:40:09.393337 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8396516Z [cluster2] I0711 01:40:09.393347 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8399104Z [cluster2] I0711 01:40:09.401594 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8402441Z [cluster2] I0711 01:40:09.405137 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8405800Z [cluster2] I0711 01:40:10.006731 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8409533Z [cluster2] I0711 01:40:10.012378 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8412651Z [cluster2] I0711 01:40:10.021510 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8414387Z [cluster2] I0711 01:40:10.021551 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8415837Z [cluster2] I0711 01:40:10.021562 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8424776Z [cluster2] I0711 01:40:10.021703 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8426592Z [cluster2] I0711 01:40:10.021861 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8428045Z [cluster2] I0711 01:40:10.021996 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8431251Z [cluster2] I0711 01:40:10.030681 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8434990Z [cluster2] I0711 01:40:10.031248 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8438378Z [cluster2] I0711 01:40:10.034072 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8441788Z [cluster2] I0711 01:40:10.036024 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8445146Z [cluster2] I0711 01:40:10.637292 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8448425Z [cluster2] I0711 01:40:10.638556 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8451739Z [cluster2] I0711 01:40:10.642938 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8455146Z [cluster2] I0711 01:40:10.644811 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8457977Z [cluster2] I0711 01:40:14.415867 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8459929Z [cluster2] I0711 01:40:14.415925 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8461413Z [cluster2] I0711 01:40:14.415936 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8469172Z [cluster2] I0711 01:40:14.423907 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8472903Z [cluster2] I0711 01:40:14.427262 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8476323Z [cluster2] I0711 01:40:15.029196 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8479763Z [cluster2] I0711 01:40:15.035734 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8482835Z [cluster2] I0711 01:40:15.045041 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8484601Z [cluster2] I0711 01:40:15.045310 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8486165Z [cluster2] I0711 01:40:15.045383 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8488327Z [cluster2] I0711 01:40:15.045069 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8490076Z [cluster2] I0711 01:40:15.045503 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8491606Z [cluster2] I0711 01:40:15.045565 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8494826Z [cluster2] I0711 01:40:15.053153 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8505469Z [cluster2] I0711 01:40:15.053812 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8509077Z [cluster2] I0711 01:40:15.057911 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8517969Z [cluster2] I0711 01:40:15.059062 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8521561Z [cluster2] I0711 01:40:15.660328 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8524958Z [cluster2] I0711 01:40:15.662864 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8528476Z [cluster2] I0711 01:40:15.666835 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8537113Z [cluster2] I0711 01:40:15.669498 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8544622Z [cluster2] I0711 01:40:19.431613 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8546648Z [cluster2] I0711 01:40:19.431683 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8548280Z [cluster2] I0711 01:40:19.431694 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8568677Z [cluster2] I0711 01:40:19.442397 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8572318Z [cluster2] I0711 01:40:19.445677 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8575899Z [cluster2] I0711 01:40:20.048044 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8580621Z [cluster2] I0711 01:40:20.053498 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8583462Z [cluster2] I0711 01:40:20.061558 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8585202Z [cluster2] I0711 01:40:20.061605 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8586643Z [cluster2] I0711 01:40:20.061616 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8590001Z [cluster2] I0711 01:40:20.063526 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8592266Z [cluster2] I0711 01:40:20.063573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8593704Z [cluster2] I0711 01:40:20.063584 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8596549Z [cluster2] I0711 01:40:20.073879 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8599884Z [cluster2] I0711 01:40:20.078353 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8604434Z [cluster2] I0711 01:40:20.079134 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8616663Z [cluster2] I0711 01:40:20.088279 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8620089Z [cluster2] I0711 01:40:20.681160 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8623420Z [cluster2] I0711 01:40:20.686596 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8626950Z [cluster2] I0711 01:40:20.692364 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8634684Z [cluster2] I0711 01:40:20.699801 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8637870Z [cluster2] I0711 01:40:24.451532 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8639614Z [cluster2] I0711 01:40:24.451584 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8641184Z [cluster2] I0711 01:40:24.451701 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8643798Z [cluster2] I0711 01:40:24.461417 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8647154Z [cluster2] I0711 01:40:24.466331 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8650528Z [cluster2] I0711 01:40:25.068863 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8654024Z [cluster2] I0711 01:40:25.075847 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8656860Z [cluster2] I0711 01:40:25.085771 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8658589Z [cluster2] I0711 01:40:25.085843 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8660038Z [cluster2] I0711 01:40:25.085863 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8662073Z [cluster2] I0711 01:40:25.085955 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8663811Z [cluster2] I0711 01:40:25.086079 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8665253Z [cluster2] I0711 01:40:25.086171 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8667820Z [cluster2] I0711 01:40:25.097152 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8672486Z [cluster2] I0711 01:40:25.097675 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8675995Z [cluster2] I0711 01:40:25.101852 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8679389Z [cluster2] I0711 01:40:25.102223 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8689380Z [cluster2] I0711 01:40:25.703893 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8692706Z [cluster2] I0711 01:40:25.703925 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8696028Z [cluster2] I0711 01:40:25.717149 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8704915Z [cluster2] I0711 01:40:25.718173 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8707798Z [cluster2] I0711 01:40:29.499455 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8709706Z [cluster2] I0711 01:40:29.499506 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8711323Z [cluster2] I0711 01:40:29.499518 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8713951Z [cluster2] I0711 01:40:29.523764 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8717345Z [cluster2] I0711 01:40:29.550613 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8720699Z [cluster2] I0711 01:40:30.152489 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8724031Z [cluster2] I0711 01:40:30.163518 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8727422Z [cluster2] I0711 01:40:30.204342 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8729253Z [cluster2] I0711 01:40:30.204482 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8730703Z [cluster2] I0711 01:40:30.204569 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8732779Z [cluster2] I0711 01:40:30.239307 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8734480Z [cluster2] I0711 01:40:30.239437 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8735925Z [cluster2] I0711 01:40:30.239482 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8738842Z [cluster2] I0711 01:40:30.266461 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8742153Z [cluster2] I0711 01:40:30.269306 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8745527Z [cluster2] I0711 01:40:30.295398 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8748954Z [cluster2] I0711 01:40:30.313449 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8752597Z [cluster2] I0711 01:40:30.897534 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8756043Z [cluster2] I0711 01:40:30.905122 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8760043Z [cluster2] I0711 01:40:30.917095 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8764520Z [cluster2] I0711 01:40:30.932030 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8768076Z [cluster2] I0711 01:40:34.534237 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8769823Z [cluster2] I0711 01:40:34.534293 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8771273Z [cluster2] I0711 01:40:34.534304 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8773952Z [cluster2] I0711 01:40:34.550484 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8778085Z [cluster2] I0711 01:40:34.560108 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8781589Z [cluster2] I0711 01:40:35.162477 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8784898Z [cluster2] I0711 01:40:35.173959 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8787722Z [cluster2] I0711 01:40:35.185630 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8789461Z [cluster2] I0711 01:40:35.185794 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8790976Z [cluster2] I0711 01:40:35.185837 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8793031Z [cluster2] I0711 01:40:35.191069 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8794757Z [cluster2] I0711 01:40:35.191180 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8796177Z [cluster2] I0711 01:40:35.191313 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8798862Z [cluster2] I0711 01:40:35.203978 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8802181Z [cluster2] I0711 01:40:35.207704 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8805537Z [cluster2] I0711 01:40:35.222123 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8808975Z [cluster2] I0711 01:40:35.242673 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8812336Z [cluster2] I0711 01:40:35.823818 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8815650Z [cluster2] I0711 01:40:35.830673 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8820399Z [cluster2] I0711 01:40:35.844659 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8823736Z [cluster2] I0711 01:40:35.858508 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8826560Z [cluster2] I0711 01:40:39.555837 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8828285Z [cluster2] I0711 01:40:39.555970 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.8829727Z [cluster2] I0711 01:40:39.556027 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:41.8832491Z [cluster2] I0711 01:40:39.567958 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8836131Z [cluster2] I0711 01:40:39.579248 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.8839537Z [cluster2] I0711 01:40:40.181550 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8842974Z [cluster2] I0711 01:40:40.191032 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.8846587Z [cluster2] I0711 01:40:40.211085 1 submariner_controller.go:103] controller_submariner "ms-07-11T01:38:55Z"
2021-07-11T01:40:41.8847360Z [cluster1] }
2021-07-11T01:40:41.8847814Z [cluster1] }
2021-07-11T01:40:41.8848240Z [cluster1] }
2021-07-11T01:40:41.8848679Z [cluster1] ],
2021-07-11T01:40:41.8849144Z [cluster1] "hostIP": "172.18.0.6",
2021-07-11T01:40:41.8849702Z [cluster1] "phase": "Running",
2021-07-11T01:40:41.8850229Z [cluster1] "podIP": "10.1.128.5",
2021-07-11T01:40:41.8850740Z [cluster1] "podIPs": [
2021-07-11T01:40:41.8851199Z [cluster1] {
2021-07-11T01:40:41.8851667Z [cluster1] "ip": "10.1.128.5"
2021-07-11T01:40:41.8852116Z [cluster1] }
2021-07-11T01:40:41.8852549Z [cluster1] ],
2021-07-11T01:40:41.8853109Z [cluster1] "qosClass": "BestEffort",
2021-07-11T01:40:41.8853963Z [cluster1] "startTime": "2021-07-11T01:38:54Z"
2021-07-11T01:40:41.8854478Z [cluster1] }
2021-07-11T01:40:41.8854885Z [cluster1] }
2021-07-11T01:40:41.8856567Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.8858301Z [submariner-operator]$ [cluster1] grep Running
2021-07-11T01:40:41.8860175Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.8863022Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-11T01:40:41.8864519Z [cluster1] Running
2021-07-11T01:40:41.8866035Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator
2021-07-11T01:40:41.8868318Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator
2021-07-11T01:40:41.8870861Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-pr8vl --namespace=submariner-operator
2021-07-11T01:40:41.8872360Z [cluster1] I0711 01:38:56.172669 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-11T01:40:41.8873125Z [cluster1] I0711 01:38:56.172742 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-11T01:40:41.8874196Z [cluster1] I0711 01:38:56.172756 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-11T01:40:41.8875352Z [cluster1] I0711 01:38:56.172768 1 main.go:80] cmd "msg"="Submariner operator version: devel-1a48316"
2021-07-11T01:40:41.8876315Z [cluster1] I0711 01:38:56.172938 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-11T01:40:41.8877881Z [cluster1] I0711 01:38:56.789413 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-w2dg8"
2021-07-11T01:40:41.8879167Z [cluster1] I0711 01:38:56.798475 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-11T01:40:41.8880266Z [cluster1] I0711 01:38:57.934488 1 leader.go:171] leader "msg"="Leader pod has been deleted, waiting for garbage collection to remove the lock."
2021-07-11T01:40:41.8881415Z [cluster1] I0711 01:39:00.315504 1 leader.go:149] leader "msg"="Became the leader."
2021-07-11T01:40:41.8882809Z [cluster1] I0711 01:39:00.920505 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-11T01:40:41.8883884Z [cluster1] I0711 01:39:00.922684 1 main.go:129] cmd "msg"="Registering Components."
2021-07-11T01:40:41.8884754Z [cluster1] I0711 01:39:00.923099 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-11T01:40:41.8885984Z [cluster1] I0711 01:39:04.815921 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8887943Z [cluster1] I0711 01:39:04.815951 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.8889224Z [cluster1] I0711 01:39:04.816005 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-11T01:40:41.8890497Z [cluster1] I0711 01:39:04.816344 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-11T01:40:41.8896202Z [cluster1] I0711 01:39:04.816904 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-11T01:40:41.8905502Z [cluster1] I0711 01:39:04.823280 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-11T01:40:41.8912561Z [cluster1] I0711 01:39:04.823436 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-11T01:40:41.8917503Z [cluster1] I0711 01:39:04.823560 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-11T01:40:41.8921406Z [cluster1] I0711 01:39:04.823668 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-11T01:40:41.8923872Z [cluster1] I0711 01:39:04.934967 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.8926131Z [cluster1] I0711 01:39:04.935038 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-11T01:40:41.8929903Z [cluster1] I0711 01:39:04.954822 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-11T01:40:41.8933530Z [cluster1] I0711 01:39:04.968356 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-11T01:40:41.8936835Z [cluster1] I0711 01:39:04.969713 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-11T01:40:41.8942395Z [cluster1] I0711 01:39:04.969810 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-11T01:40:41.8946475Z [cluster1] I0711 01:39:05.055390 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-11T01:40:41.8950208Z [cluster1] I0711 01:39:05.069153 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-11T01:40:41.8953040Z [cluster1] I0711 01:39:05.069267 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8955502Z [cluster1] I0711 01:39:05.071202 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-11T01:40:41.8958190Z [cluster1] I0711 01:39:05.071526 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-11T01:40:41.8960560Z [cluster1] I0711 01:39:05.156600 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-11T01:40:41.8962523Z [cluster1] I0711 01:39:05.156645 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-11T01:40:41.8964689Z [cluster1] I0711 01:39:05.156771 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8967043Z [cluster1] I0711 01:39:05.172596 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-11T01:40:41.8969997Z [cluster1] I0711 01:39:05.172698 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8972499Z [cluster1] I0711 01:39:05.172815 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-11T01:40:41.8975150Z [cluster1] I0711 01:39:05.172877 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.8978417Z [cluster1] E0711 01:39:05.865582 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.8992105Z [cluster1] E0711 01:39:06.085573 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.8995723Z [cluster1] E0711 01:39:06.279242 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.8999240Z [cluster1] E0711 01:39:06.362143 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9003607Z [cluster1] E0711 01:39:06.474655 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9007313Z [cluster1] E0711 01:39:06.912830 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9010428Z [cluster1] I0711 01:39:07.128314 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9013655Z [cluster1] E0711 01:39:07.265808 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9016786Z [cluster1] I0711 01:39:07.414352 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9019604Z [cluster1] I0711 01:39:07.451345 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9022457Z [cluster1] I0711 01:39:07.747777 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9027153Z [cluster1] E0711 01:39:07.758675 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9031077Z [cluster1] I0711 01:39:07.786116 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9033952Z [cluster1] I0711 01:39:08.048084 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9037089Z [cluster1] I0711 01:39:08.106706 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9039966Z [cluster1] I0711 01:39:08.338764 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9042791Z [cluster1] I0711 01:39:08.339976 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9046024Z [cluster1] E0711 01:39:08.465199 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9049768Z [cluster1] E0711 01:39:09.805345 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9052707Z [cluster1] I0711 01:39:10.165256 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9055733Z [cluster1] E0711 01:39:12.421531 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9058780Z [cluster1] I0711 01:39:14.707281 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9061390Z [cluster1] I0711 01:39:14.736487 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9063723Z [cluster1] I0711 01:39:14.736793 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9066042Z [cluster1] I0711 01:39:15.860112 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9068352Z [cluster1] I0711 01:39:15.860393 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9070040Z [cluster1] I0711 01:39:15.905071 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-11T01:40:41.9072058Z [cluster1] I0711 01:39:15.905197 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-11T01:40:41.9073574Z [cluster1] I0711 01:39:15.905269 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9075115Z [cluster1] I0711 01:39:15.905349 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9076504Z [cluster1] I0711 01:39:15.906191 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-11T01:40:41.9078332Z [cluster1] I0711 01:39:15.906292 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-11T01:40:41.9079858Z [cluster1] I0711 01:39:15.906360 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9081289Z [cluster1] I0711 01:39:15.906401 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9084844Z [cluster1] I0711 01:39:15.914803 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9088655Z [cluster1] E0711 01:39:15.917485 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-11T01:40:41.9092260Z [cluster1] I0711 01:39:15.917518 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9093974Z [cluster1] I0711 01:39:15.917542 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9095433Z [cluster1] I0711 01:39:15.917552 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9098427Z [cluster1] I0711 01:39:15.931390 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9102155Z [cluster1] I0711 01:39:15.947520 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9106116Z [cluster1] E0711 01:39:15.947673 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-11T01:40:41.9109375Z [cluster1] I0711 01:39:15.947769 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9111328Z [cluster1] I0711 01:39:15.947850 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9112775Z [cluster1] I0711 01:39:15.947906 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9115368Z [cluster1] I0711 01:39:16.048282 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9118852Z [cluster1] I0711 01:39:16.070322 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9122280Z [cluster1] I0711 01:39:16.077646 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9125640Z [cluster1] I0711 01:39:16.672006 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9128925Z [cluster1] I0711 01:39:16.676593 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9132230Z [cluster1] I0711 01:39:16.681446 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9135269Z [cluster1] I0711 01:39:16.685985 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9138209Z [cluster1] I0711 01:39:16.686330 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9141268Z [cluster1] I0711 01:39:16.689772 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-11T01:40:41.9144537Z [cluster1] I0711 01:39:16.691956 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9148179Z [cluster1] I0711 01:39:16.696172 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9153222Z [cluster1] E0711 01:39:16.703938 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-11T01:40:41.9157084Z [cluster1] I0711 01:39:16.704106 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9160529Z [cluster1] I0711 01:39:16.728815 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9164568Z [cluster1] I0711 01:39:16.730110 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9168541Z [cluster1] I0711 01:39:16.785287 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9171669Z [cluster1] I0711 01:39:16.893561 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9173407Z [cluster1] I0711 01:39:16.893777 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9174839Z [cluster1] I0711 01:39:16.893868 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9177903Z [cluster1] E0711 01:39:16.895524 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9181034Z [cluster1] I0711 01:39:16.895732 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9183153Z [cluster1] I0711 01:39:16.895842 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9185008Z [cluster1] I0711 01:39:16.895930 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9187668Z [cluster1] I0711 01:39:16.917158 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9191102Z [cluster1] I0711 01:39:16.917662 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9194748Z [cluster1] I0711 01:39:16.928782 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9198205Z [cluster1] I0711 01:39:16.929552 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9201683Z [cluster1] I0711 01:39:17.338209 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9205241Z [cluster1] I0711 01:39:17.388292 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9209042Z [cluster1] I0711 01:39:17.400206 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-11T01:40:41.9213074Z [cluster1] E0711 01:39:17.400246 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found"
2021-07-11T01:40:41.9217634Z [cluster1] E0711 01:39:17.400275 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: ConfigMap \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-11T01:40:41.9221464Z [cluster1] I0711 01:39:17.400304 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9224884Z [cluster1] I0711 01:39:17.419976 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9228855Z [cluster1] I0711 01:39:17.457649 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9233045Z [cluster1] I0711 01:39:17.484003 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9236874Z [cluster1] I0711 01:39:17.566175 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9240380Z [cluster1] I0711 01:39:17.580021 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9243644Z [cluster1] I0711 01:39:17.581245 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9247307Z [cluster1] I0711 01:39:17.883990 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9251360Z [cluster1] I0711 01:39:17.910372 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9254989Z [cluster1] I0711 01:39:17.911078 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9258947Z [cluster1] E0711 01:39:18.194342 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9262607Z [cluster1] I0711 01:39:18.194508 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9264350Z [cluster1] I0711 01:39:18.194615 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9265799Z [cluster1] I0711 01:39:18.194629 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9267864Z [cluster1] I0711 01:39:18.213663 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9269595Z [cluster1] I0711 01:39:18.213794 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9271204Z [cluster1] I0711 01:39:18.213851 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9275216Z [cluster1] I0711 01:39:18.243315 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9278798Z [cluster1] I0711 01:39:18.262152 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9282122Z [cluster1] I0711 01:39:18.298704 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9285769Z [cluster1] I0711 01:39:18.417908 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9289480Z [cluster1] I0711 01:39:18.418921 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9293277Z [cluster1] I0711 01:39:18.456207 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9297020Z [cluster1] I0711 01:39:18.457706 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9300502Z [cluster1] I0711 01:39:18.531997 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9303888Z [cluster1] I0711 01:39:18.550154 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9308557Z [cluster1] I0711 01:39:18.550214 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9313148Z [cluster1] E0711 01:39:18.556712 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9316513Z [cluster1] I0711 01:39:19.032982 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9320322Z [cluster1] I0711 01:39:19.055328 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9323774Z [cluster1] I0711 01:39:19.062864 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9327179Z [cluster1] I0711 01:39:19.062824 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9330456Z [cluster1] I0711 01:39:19.102587 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9335067Z [cluster1] I0711 01:39:19.102644 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9339362Z [cluster1] I0711 01:39:19.108161 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9342464Z [cluster1] I0711 01:39:19.125584 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9346506Z [cluster1] I0711 01:39:19.160988 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9350698Z [cluster1] I0711 01:39:19.208039 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9354530Z [cluster1] I0711 01:39:19.810841 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9358638Z [cluster1] I0711 01:39:19.819139 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9362699Z [cluster1] I0711 01:39:19.835486 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9366517Z [cluster1] I0711 01:39:20.441771 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9369934Z [cluster1] I0711 01:39:20.445162 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9375903Z [cluster1] I0711 01:39:20.445198 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9380036Z [cluster1] I0711 01:39:24.884764 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9381763Z [cluster1] I0711 01:39:24.884812 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9383216Z [cluster1] I0711 01:39:24.884824 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9385804Z [cluster1] I0711 01:39:25.100696 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9389746Z [cluster1] I0711 01:39:25.127318 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9393365Z [cluster1] I0711 01:39:25.764873 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9414400Z [cluster1] I0711 01:39:25.842543 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9418844Z [cluster1] I0711 01:39:25.951584 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9421108Z [cluster1] I0711 01:39:25.951625 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9424138Z [cluster1] I0711 01:39:25.951637 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9426595Z [cluster1] I0711 01:39:25.957342 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9428341Z [cluster1] I0711 01:39:25.957371 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9429772Z [cluster1] I0711 01:39:25.957381 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9432839Z [cluster1] I0711 01:39:26.011354 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9436387Z [cluster1] I0711 01:39:26.044485 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9439760Z [cluster1] I0711 01:39:26.083669 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9444165Z [cluster1] I0711 01:39:26.083948 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9447558Z [cluster1] I0711 01:39:26.734752 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9450889Z [cluster1] I0711 01:39:26.792235 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9454270Z [cluster1] I0711 01:39:26.801993 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9457600Z [cluster1] I0711 01:39:26.888380 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9461551Z [cluster1] E0711 01:39:26.976080 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9464708Z [cluster1] I0711 01:39:26.976138 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9466447Z [cluster1] I0711 01:39:26.976187 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9467887Z [cluster1] I0711 01:39:26.976199 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9470572Z [cluster1] I0711 01:39:27.034655 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9474693Z [cluster1] I0711 01:39:27.059460 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9478100Z [cluster1] I0711 01:39:27.662125 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9481534Z [cluster1] I0711 01:39:27.688055 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9484628Z [cluster1] I0711 01:39:27.965849 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9488048Z [cluster1] I0711 01:39:28.002632 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9493096Z [cluster1] I0711 01:39:28.025164 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9497222Z [cluster1] I0711 01:39:28.630990 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9501576Z [cluster1] I0711 01:39:28.659413 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9505667Z [cluster1] I0711 01:39:28.699724 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9509826Z [cluster1] I0711 01:39:29.359411 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9513229Z [cluster1] I0711 01:39:29.465415 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9517849Z [cluster1] I0711 01:39:29.465458 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9522288Z [cluster1] E0711 01:39:29.526770 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9525420Z [cluster1] I0711 01:39:31.056630 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9528944Z [cluster1] I0711 01:39:31.124945 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9532900Z [cluster1] I0711 01:39:31.138855 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9536687Z [cluster1] I0711 01:39:31.740944 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9555186Z [cluster1] I0711 01:39:31.746788 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9559293Z [cluster1] I0711 01:39:31.757062 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9563518Z [cluster1] I0711 01:39:32.359119 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9566875Z [cluster1] I0711 01:39:32.362895 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9571676Z [cluster1] I0711 01:39:32.362942 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9575492Z [cluster1] I0711 01:39:33.245516 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9578122Z [cluster1] I0711 01:39:33.245564 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9579948Z [cluster1] I0711 01:39:33.245575 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9582624Z [cluster1] I0711 01:39:33.290177 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9586013Z [cluster1] I0711 01:39:33.303809 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9590996Z [cluster1] I0711 01:39:33.905928 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9594452Z [cluster1] I0711 01:39:33.913860 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9597276Z [cluster1] I0711 01:39:33.943852 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9599026Z [cluster1] I0711 01:39:33.943901 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9600467Z [cluster1] I0711 01:39:33.943912 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9602535Z [cluster1] I0711 01:39:33.945207 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9604270Z [cluster1] I0711 01:39:33.945248 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9605702Z [cluster1] I0711 01:39:33.945258 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9608291Z [cluster1] I0711 01:39:34.000645 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9611722Z [cluster1] I0711 01:39:34.025697 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9615095Z [cluster1] I0711 01:39:34.063236 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9618505Z [cluster1] I0711 01:39:34.063748 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9621884Z [cluster1] I0711 01:39:34.668277 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9625177Z [cluster1] I0711 01:39:34.669465 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9628486Z [cluster1] I0711 01:39:34.690771 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9632082Z [cluster1] I0711 01:39:34.699498 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9636206Z [cluster1] I0711 01:39:35.004390 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9639650Z [cluster1] I0711 01:39:35.043444 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9643804Z [cluster1] I0711 01:39:35.077169 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9647662Z [cluster1] I0711 01:39:35.678708 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9651788Z [cluster1] I0711 01:39:35.684620 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-11T01:40:41.9655868Z [cluster1] I0711 01:39:35.693503 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9659758Z [cluster1] I0711 01:39:36.296410 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9663193Z [cluster1] I0711 01:39:36.298704 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9668141Z [cluster1] I0711 01:39:36.298872 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.113.92\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-11T01:40:41.9672104Z [cluster1] I0711 01:39:38.927111 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9673837Z [cluster1] I0711 01:39:38.927156 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9675289Z [cluster1] I0711 01:39:38.927179 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9695149Z [cluster1] I0711 01:39:38.956641 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9699610Z [cluster1] I0711 01:39:38.962393 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9703071Z [cluster1] I0711 01:39:39.566580 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9706748Z [cluster1] I0711 01:39:39.573753 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9709593Z [cluster1] I0711 01:39:39.588813 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9711453Z [cluster1] I0711 01:39:39.588863 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9712897Z [cluster1] I0711 01:39:39.588874 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9714987Z [cluster1] I0711 01:39:39.590479 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9716726Z [cluster1] I0711 01:39:39.590509 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9718153Z [cluster1] I0711 01:39:39.590520 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9721219Z [cluster1] I0711 01:39:39.618118 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9725639Z [cluster1] I0711 01:39:39.619202 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9729994Z [cluster1] I0711 01:39:39.629093 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9733773Z [cluster1] I0711 01:39:39.629095 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9761288Z [cluster1] I0711 01:39:40.231785 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9764840Z [cluster1] I0711 01:39:40.232822 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9768589Z [cluster1] I0711 01:39:40.260502 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9771996Z [cluster1] I0711 01:39:40.262270 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9774812Z [cluster1] I0711 01:39:43.954195 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9776534Z [cluster1] I0711 01:39:43.954247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9780281Z [cluster1] I0711 01:39:43.954259 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9783001Z [cluster1] I0711 01:39:43.971959 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9786367Z [cluster1] I0711 01:39:43.982124 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9789739Z [cluster1] I0711 01:39:44.584804 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9793195Z [cluster1] I0711 01:39:44.590404 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9796547Z [cluster1] I0711 01:39:44.601434 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9798303Z [cluster1] I0711 01:39:44.601477 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9799751Z [cluster1] I0711 01:39:44.601600 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9801839Z [cluster1] I0711 01:39:44.601537 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9803573Z [cluster1] I0711 01:39:44.601694 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9805262Z [cluster1] I0711 01:39:44.601731 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9808332Z [cluster1] I0711 01:39:44.615428 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9811831Z [cluster1] I0711 01:39:44.617570 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9815202Z [cluster1] I0711 01:39:44.620047 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9834385Z [cluster1] I0711 01:39:44.622102 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9837774Z [cluster1] I0711 01:39:45.221669 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9842157Z [cluster1] I0711 01:39:45.225071 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9846153Z [cluster1] I0711 01:39:45.235742 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9849718Z [cluster1] I0711 01:39:45.235754 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9852584Z [cluster1] I0711 01:39:48.972878 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9854370Z [cluster1] I0711 01:39:48.972929 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9855969Z [cluster1] I0711 01:39:48.972940 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9858579Z [cluster1] I0711 01:39:48.990397 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9861961Z [cluster1] I0711 01:39:49.000478 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9865312Z [cluster1] I0711 01:39:49.602743 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9868633Z [cluster1] I0711 01:39:49.610358 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9872031Z [cluster1] I0711 01:39:49.635369 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9873869Z [cluster1] I0711 01:39:49.635413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9875324Z [cluster1] I0711 01:39:49.635424 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9877407Z [cluster1] I0711 01:39:49.644247 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:41.9879135Z [cluster1] I0711 01:39:49.644294 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-11T01:40:41.9880576Z [cluster1] I0711 01:39:49.644305 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-11T01:40:41.9883170Z [cluster1] I0711 01:39:49.653167 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9886537Z [cluster1] I0711 01:39:49.664161 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9889923Z [cluster1] I0711 01:39:49.676829 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9893306Z [cluster1] I0711 01:39:49.693764 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:41.9896899Z [cluster1] E0711 01:39:50.188364 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:41.9900275Z [cluster1] I0711 01:39:50.266153 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9903606Z [cluster1] I0711 01:39:50.280412 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:41.9907253Z [cluster1] I0711 01:39:50.295905 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:41.9910779Z [cluster1] I0711 01:39:50.304286 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:42.2645169Z [cluster1] E0711 01:40:31.219303 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-brg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:42.2648952Z [cluster2] I0711 01:40:40.211285 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:42.2650398Z [cluster2] I0711 01:40:40.211380 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:42.2652548Z [cluster2] I0711 01:40:40.219864 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-11T01:40:42.2654284Z [cluster2] I0711 01:40:40.219905 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-11T01:40:42.2655719Z [cluster2] I0711 01:40:40.219919 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-11T01:40:42.2658327Z [cluster2] I0711 01:40:40.229579 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:42.2661650Z [cluster2] I0711 01:40:40.235191 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:42.2665007Z [cluster2] I0711 01:40:40.236662 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:42.2668453Z [cluster2] I0711 01:40:40.245370 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-11T01:40:42.2672318Z [cluster2] I0711 01:40:40.838335 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:42.2675864Z [cluster2] I0711 01:40:40.850503 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:42.2679219Z [cluster2] I0711 01:40:40.857311 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-11T01:40:42.2682548Z [cluster2] I0711 01:40:40.870341 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-11T01:40:42.2684641Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-11T01:40:42.2685771Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-11T01:40:42.2687270Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-11T01:40:42.2688569Z [submariner-operator]$ [cluster2] grep submariner
2021-07-11T01:40:42.2689989Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-11T01:40:42.2691709Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner --namespace=submariner-operator
2021-07-11T01:40:42.2692870Z [cluster2] submariner 82s
2021-07-11T01:40:42.2693988Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-11T01:40:42.2695606Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.2697151Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-11T01:40:42.2698739Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.6808235Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.6809515Z [cluster2] {
2021-07-11T01:40:42.6810151Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.6810851Z [cluster2] "kind": "Submariner",
2021-07-11T01:40:42.6811607Z [cluster2] "metadata": {
2021-07-11T01:40:42.6812716Z [cluster2] "creationTimestamp": "2021-07-11T01:39:20Z",
2021-07-11T01:40:42.6813370Z [cluster2] "generation": 1,
2021-07-11T01:40:42.6814208Z [cluster2] "managedFields": [
2021-07-11T01:40:42.6814865Z [cluster2] {
2021-07-11T01:40:42.6815505Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.6816235Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:42.6816841Z [cluster2] "fieldsV1": {
2021-07-11T01:40:42.6817368Z [cluster2] "f:spec": {
2021-07-11T01:40:42.6817873Z [cluster2] ".": {},
2021-07-11T01:40:42.6818540Z [cluster2] "f:broker": {},
2021-07-11T01:40:42.6819327Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-11T01:40:42.6820246Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-11T01:40:42.6820994Z [cluster2] "f:brokerK8sCA": {},
2021-07-11T01:40:42.6821903Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-11T01:40:42.6822819Z [cluster2] "f:cableDriver": {},
2021-07-11T01:40:42.6823476Z [cluster2] "f:ceIPSecDebug": {},
2021-07-11T01:40:42.6824138Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-11T01:40:42.6824847Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-11T01:40:42.6825514Z [cluster2] "f:ceIPSecPSK": {},
2021-07-11T01:40:42.6826378Z [cluster2] "f:clusterCIDR": {},
2021-07-11T01:40:42.6826992Z [cluster2] "f:clusterID": {},
2021-07-11T01:40:42.6827570Z [cluster2] "f:colorCodes": {},
2021-07-11T01:40:42.6828294Z [cluster2] "f:connectionHealthCheck": {
2021-07-11T01:40:42.6828944Z [cluster2] ".": {},
2021-07-11T01:40:42.6829473Z [cluster2] "f:enabled": {},
2021-07-11T01:40:42.6830226Z [cluster2] "f:intervalSeconds": {},
2021-07-11T01:40:42.6830971Z [cluster2] "f:maxPacketLossCount": {}
2021-07-11T01:40:42.6831587Z [cluster2] },
2021-07-11T01:40:42.6832078Z [cluster2] "f:debug": {},
2021-07-11T01:40:42.6832632Z [cluster2] "f:namespace": {},
2021-07-11T01:40:42.6833215Z [cluster2] "f:natEnabled": {},
2021-07-11T01:40:42.6833820Z [cluster2] "f:repository": {},
2021-07-11T01:40:42.6834414Z [cluster2] "f:serviceCIDR": {},
2021-07-11T01:40:42.6835177Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-11T01:40:42.6835982Z [cluster2] "f:version": {}
2021-07-11T01:40:42.6836485Z [cluster2] }
2021-07-11T01:40:42.6836939Z [cluster2] },
2021-07-11T01:40:42.6837446Z [cluster2] "manager": "subctl",
2021-07-11T01:40:42.6838168Z [cluster2] "operation": "Update",
2021-07-11T01:40:42.6839050Z [cluster2] "time": "2021-07-11T01:39:20Z"
2021-07-11T01:40:42.6839547Z [cluster2] },
2021-07-11T01:40:42.6839979Z [cluster2] {
2021-07-11T01:40:42.6840615Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.6841339Z [cluster2] "fieldsType": "FieldsV1",
2021-07-11T01:40:42.6841949Z [cluster2] "fieldsV1": {
2021-07-11T01:40:42.6842471Z [cluster2] "f:status": {
2021-07-11T01:40:42.6842976Z [cluster2] ".": {},
2021-07-11T01:40:42.6843526Z [cluster2] "f:clusterCIDR": {},
2021-07-11T01:40:42.6844112Z [cluster2] "f:clusterID": {},
2021-07-11T01:40:42.6844702Z [cluster2] "f:colorCodes": {},
2021-07-11T01:40:42.6845325Z [cluster2] "f:deploymentInfo": {},
2021-07-11T01:40:42.6846106Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-11T01:40:42.6846774Z [cluster2] ".": {},
2021-07-11T01:40:42.6847425Z [cluster2] "f:lastResourceVersion": {},
2021-07-11T01:40:42.6848295Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-11T01:40:42.6849239Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-11T01:40:42.6849968Z [cluster2] "f:status": {
2021-07-11T01:40:42.6850475Z [cluster2] ".": {},
2021-07-11T01:40:42.6851167Z [cluster2] "f:currentNumberScheduled": {},
2021-07-11T01:40:42.6852042Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-11T01:40:42.6852843Z [cluster2] "f:numberAvailable": {},
2021-07-11T01:40:42.6853569Z [cluster2] "f:numberMisscheduled": {},
2021-07-11T01:40:42.6854278Z [cluster2] "f:numberReady": {},
2021-07-11T01:40:42.6854984Z [cluster2] "f:observedGeneration": {},
2021-07-11T01:40:42.6855803Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-11T01:40:42.6856484Z [cluster2] }
2021-07-11T01:40:42.6856934Z [cluster2] },
2021-07-11T01:40:42.6857588Z [cluster2] "f:gateways": {},
2021-07-11T01:40:42.6858332Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-11T01:40:42.6859042Z [cluster2] ".": {},
2021-07-11T01:40:42.6859879Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-11T01:40:42.6860577Z [cluster2] },
2021-07-11T01:40:42.6861201Z [cluster2] "f:loadBalancerStatus": {},
2021-07-11T01:40:42.6861864Z [cluster2] "f:natEnabled": {},
2021-07-11T01:40:42.6862492Z [cluster2] "f:networkPlugin": {},
2021-07-11T01:40:42.6863299Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-11T01:40:42.6864027Z [cluster2] ".": {},
2021-07-11T01:40:42.6864798Z [cluster2] "f:lastResourceVersion": {},
2021-07-11T01:40:42.6865670Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-11T01:40:42.6866617Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-11T01:40:42.6867331Z [cluster2] "f:status": {
2021-07-11T01:40:42.6867845Z [cluster2] ".": {},
2021-07-11T01:40:42.6868525Z [cluster2] "f:currentNumberScheduled": {},
2021-07-11T01:40:42.6869423Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-11T01:40:42.6877299Z [cluster2] "f:numberAvailable": {},
2021-07-11T01:40:42.6878435Z [cluster2] "f:numberMisscheduled": {},
2021-07-11T01:40:42.6879147Z [cluster2] "f:numberReady": {},
2021-07-11T01:40:42.6879845Z [cluster2] "f:observedGeneration": {},
2021-07-11T01:40:42.6880691Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-11T01:40:42.6881362Z [cluster2] }
2021-07-11T01:40:42.6881926Z [cluster2] },
2021-07-11T01:40:42.6882465Z [cluster2] "f:serviceCIDR": {}
2021-07-11T01:40:42.6883008Z [cluster2] }
2021-07-11T01:40:42.6883466Z [cluster2] },
2021-07-11T01:40:42.6884530Z [cluster2] "manager": "submariner-operator",
2021-07-11T01:40:42.6885267Z [cluster2] "operation": "Update",
2021-07-11T01:40:42.6886025Z [cluster2] "time": "2021-07-11T01:39:39Z"
2021-07-11T01:40:42.6886535Z [cluster2] }
2021-07-11T01:40:42.6886967Z [cluster2] ],
2021-07-11T01:40:42.6887492Z [cluster2] "name": "submariner",
2021-07-11T01:40:42.6888371Z [cluster2] "namespace": "submariner-operator",
2021-07-11T01:40:42.6889135Z [cluster2] "resourceVersion": "2660",
2021-07-11T01:40:42.6890134Z [cluster2] "uid": "a0a4ae3b-4dc2-4715-833c-1badb1cc2ee6"
2021-07-11T01:40:42.6890835Z [cluster2] },
2021-07-11T01:40:42.6891299Z [cluster2] "spec": {
2021-07-11T01:40:42.6891786Z [cluster2] "broker": "k8s",
2021-07-11T01:40:42.6892442Z [cluster2] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-11T01:40:42.7120033Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-11T01:40:42.7713453Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-11T01:40:42.8394212Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-11T01:40:42.8395455Z [cluster2] "cableDriver": "libreswan",
2021-07-11T01:40:42.8396439Z [cluster2] "ceIPSecDebug": false,
2021-07-11T01:40:42.8397328Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-11T01:40:42.8398146Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-11T01:40:42.8399738Z [cluster2] "ceIPSecPSK": "sWDmldNSIUX6Ceivyz8RZs/Jf3X/LLl+na5abxtzqlPZP6+NY8EmNAc7khFPZsG0",
2021-07-11T01:40:42.8401215Z [cluster2] "clusterCIDR": "",
2021-07-11T01:40:42.8401990Z [cluster2] "clusterID": "cluster2",
2021-07-11T01:40:42.8402756Z [cluster2] "colorCodes": "blue",
2021-07-11T01:40:42.8404006Z [cluster2] "connectionHealthCheck": {
2021-07-11T01:40:42.8404945Z [cluster2] "enabled": true,
2021-07-11T01:40:42.8405996Z [cluster2] "intervalSeconds": 1,
2021-07-11T01:40:42.8407046Z [cluster2] "maxPacketLossCount": 5
2021-07-11T01:40:42.8407625Z [cluster2] },
2021-07-11T01:40:42.8408117Z [cluster2] "debug": false,
2021-07-11T01:40:42.8409475Z [cluster2] "namespace": "submariner-operator",
2021-07-11T01:40:42.8410391Z [cluster2] "natEnabled": false,
2021-07-11T01:40:42.8411027Z [cluster2] "repository": "localhost:5000",
2021-07-11T01:40:42.8411654Z [cluster2] "serviceCIDR": "",
2021-07-11T01:40:42.8412381Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-11T01:40:42.8413102Z [cluster2] "version": "local"
2021-07-11T01:40:42.8413581Z [cluster2] },
2021-07-11T01:40:42.8414042Z [cluster2] "status": {
2021-07-11T01:40:42.8414576Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-11T01:40:42.8415194Z [cluster2] "clusterID": "cluster2",
2021-07-11T01:40:42.8415810Z [cluster2] "colorCodes": "blue",
2021-07-11T01:40:42.8416414Z [cluster2] "deploymentInfo": {},
2021-07-11T01:40:42.8417157Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-11T01:40:42.8417951Z [cluster2] "lastResourceVersion": "2381",
2021-07-11T01:40:42.8418834Z [cluster2] "mismatchedContainerImages": false,
2021-07-11T01:40:42.8419742Z [cluster2] "nonReadyContainerStates": [],
2021-07-11T01:40:42.8420433Z [cluster2] "status": {
2021-07-11T01:40:42.8421100Z [cluster2] "currentNumberScheduled": 1,
2021-07-11T01:40:42.8422214Z [cluster2] "desiredNumberScheduled": 1,
2021-07-11T01:40:42.8423144Z [cluster2] "numberAvailable": 1,
2021-07-11T01:40:42.8423836Z [cluster2] "numberMisscheduled": 0,
2021-07-11T01:40:42.8424506Z [cluster2] "numberReady": 1,
2021-07-11T01:40:42.8425160Z [cluster2] "observedGeneration": 1,
2021-07-11T01:40:42.8425971Z [cluster2] "updatedNumberScheduled": 1
2021-07-11T01:40:42.8426603Z [cluster2] }
2021-07-11T01:40:42.8427044Z [cluster2] },
2021-07-11T01:40:42.8427512Z [cluster2] "gateways": [
2021-07-11T01:40:42.8427995Z [cluster2] {
2021-07-11T01:40:42.8428494Z [cluster2] "connections": [
2021-07-11T01:40:42.8429306Z [cluster2] {
2021-07-11T01:40:42.8429960Z [cluster2] "endpoint": {
2021-07-11T01:40:42.8430724Z [cluster2] "backend": "libreswan",
2021-07-11T01:40:42.8431349Z [cluster2] "backend_config": {
2021-07-11T01:40:42.8432319Z [cluster2] "natt-discovery-port": "4490",
2021-07-11T01:40:42.8433291Z [cluster2] "preferred-server": "false"
2021-07-11T01:40:42.8433908Z [cluster2] },
2021-07-11T01:40:42.8435059Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-11T01:40:42.8436058Z [cluster2] "cluster_id": "cluster1",
2021-07-11T01:40:42.8436727Z [cluster2] "healthCheckIP": "10.1.0.1",
2021-07-11T01:40:42.8437641Z [cluster2] "hostname": "cluster1-worker",
2021-07-11T01:40:42.8438323Z [cluster2] "nat_enabled": false,
2021-07-11T01:40:42.8438941Z [cluster2] "private_ip": "172.18.0.8",
2021-07-11T01:40:42.8439739Z [cluster2] "public_ip": "20.102.70.128",
2021-07-11T01:40:42.8440315Z [cluster2] "subnets": [
2021-07-11T01:40:42.8440832Z [cluster2] "100.1.0.0/16",
2021-07-11T01:40:42.8441343Z [cluster2] "10.1.0.0/16"
2021-07-11T01:40:42.8441814Z [cluster2] ]
2021-07-11T01:40:42.8442281Z [cluster2] },
2021-07-11T01:40:42.8442923Z [cluster2] "latencyRTT": {
2021-07-11T01:40:42.8443762Z [cluster2] "average": "223.207µs",
2021-07-11T01:40:42.8444504Z [cluster2] "last": "222.416µs",
2021-07-11T01:40:42.8445197Z [cluster2] "max": "397.628µs",
2021-07-11T01:40:42.8445906Z [cluster2] "min": "128.909µs",
2021-07-11T01:40:42.8446616Z [cluster2] "stdDev": "71.977µs"
2021-07-11T01:40:42.8447131Z [cluster2] },
2021-07-11T01:40:42.8447912Z [cluster2] "status": "connected",
2021-07-11T01:40:42.8448556Z [cluster2] "statusMessage": "",
2021-07-11T01:40:42.8449165Z [cluster2] "usingIP": "172.18.0.8"
2021-07-11T01:40:42.8449657Z [cluster2] }
2021-07-11T01:40:42.8450114Z [cluster2] ],
2021-07-11T01:40:42.8451987Z [cluster2] "haStatus": "active",
2021-07-11T01:40:42.8454536Z [clustoker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-11T01:40:42.8455868Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-11T01:40:42.8456882Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-11T01:40:42.8458204Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-11T01:40:42.8459522Z [submariner-operator]$ [cluster1] grep submariner
2021-07-11T01:40:42.8461120Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-11T01:40:42.8462849Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-11T01:40:42.8464091Z [cluster1] submariner 87s
2021-07-11T01:40:42.8497759Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-11T01:40:42.8499876Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.8501730Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.8503641Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:42.8505523Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-11T01:40:42.8506365Z [cluster1] {
2021-07-11T01:40:42.8506975Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.8507676Z [cluster1] "kind": "Submariner",
2021-07-11T01:40:42.8508332Z [cluster1] "metadata": {
2021-07-11T01:40:42.8509181Z [cluster1] "creationTimestamp": "2021-07-11T01:39:15Z",
2021-07-11T01:40:42.8509844Z [cluster1] "generation": 1,
2021-07-11T01:40:42.8519352Z [cluster1] "managedFields": [
2021-07-11T01:40:42.8519932Z [cluster1] {
2021-07-11T01:40:42.8520560Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.8521313Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:42.8522002Z [cluster1] "fieldsV1": {
2021-07-11T01:40:42.8522615Z [cluster1] "f:spec": {
2021-07-11T01:40:42.8523103Z [cluster1] ".": {},
2021-07-11T01:40:42.8523623Z [cluster1] "f:broker": {},
2021-07-11T01:40:42.8524289Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-11T01:40:42.8525112Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-11T01:40:42.8525942Z [cluster1] "f:brokerK8sCA": {},
2021-07-11T01:40:42.8526773Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-11T01:40:42.8527611Z [cluster1] "f:cableDriver": {},
2021-07-11T01:40:42.8528416Z [cluster1] "f:ceIPSecDebug": {},
2021-07-11T01:40:42.8529091Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-11T01:40:42.8529779Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-11T01:40:42.8530445Z [cluster1] "f:ceIPSecPSK": {},
2021-07-11T01:40:42.8531061Z [cluster1] "f:clusterCIDR": {},
2021-07-11T01:40:42.8531645Z [cluster1] "f:clusterID": {},
2021-07-11T01:40:42.8532242Z [cluster1] "f:colorCodes": {},
2021-07-11T01:40:42.8532948Z [cluster1] "f:connectionHealthCheck": {
2021-07-11T01:40:42.8533606Z [cluster1] ".": {},
2021-07-11T01:40:42.8534122Z [cluster1] "f:enabled": {},
2021-07-11T01:40:42.8534766Z [cluster1] "f:intervalSeconds": {},
2021-07-11T01:40:42.8535484Z [cluster1] "f:maxPacketLossCount": {}
2021-07-11T01:40:42.8536105Z [cluster1] },
2021-07-11T01:40:42.8536602Z [cluster1] "f:debug": {},
2021-07-11T01:40:42.8537142Z [cluster1] "f:namespace": {},
2021-07-11T01:40:42.8537731Z [cluster1] "f:natEnabled": {},
2021-07-11T01:40:42.8538451Z [cluster1] "f:repository": {},
2021-07-11T01:40:42.8539060Z [cluster1] "f:serviceCIDR": {},
2021-07-11T01:40:42.8539816Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-11T01:40:42.8540548Z [cluster1] "f:version": {}
2021-07-11T01:40:42.8541034Z [cluster1] }
2021-07-11T01:40:42.8541487Z [cluster1] },
2021-07-11T01:40:42.8541991Z [cluster1] "manager": "subctl",
2021-07-11T01:40:42.8542591Z [cluster1] "operation": "Update",
2021-07-11T01:40:42.8543567Z [cluster1] "time": "2021-07-11T01:39:15Z"
2021-07-11T01:40:42.8544053Z [cluster1] },
2021-07-11T01:40:42.8544495Z [cluster1] {
2021-07-11T01:40:42.8545115Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-11T01:40:42.8545858Z [cluster1] "fieldsType": "FieldsV1",
2021-07-11T01:40:42.8546448Z [cluster1] "fieldsV1": {
2021-07-11T01:40:42.8546986Z [cluster1] "f:status": {
2021-07-11T01:40:42.8547479Z [cluster1] ".": {},
2021-07-11T01:40:42.8548135Z [cluster1] "f:clusterCIDR": {},
2021-07-11T01:40:42.8548800Z [cluster1] "f:clusterID": {},
2021-07-11T01:40:42.8549378Z [cluster1] "f:colorCodes": {},
2021-07-11T01:40:42.8550013Z [cluster1] "f:deploymentInfo": {},
2021-07-11T01:40:42.8550921Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-11T01:40:42.8551602Z [cluster1] ".": {},
2021-07-11T01:40:42.8552241Z [cluster1] "f:lastResourceVersion": {},
2021-07-11T01:40:42.8553133Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-11T01:40:42.8554066Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-11T01:40:42.8554792Z [cluster1] "f:status": {
2021-07-11T01:40:42.8555314Z [cluster1] ".": {},
2021-07-11T01:40:42.8556000Z [cluster1] "f:currentNumberScheduled": {},
2021-07-11T01:40:42.8556894Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-11T01:40:42.8557677Z [cluster1] "f:numberAvailable": {},
2021-07-11T01:40:42.8558420Z [cluster1] "f:numberMisscheduled": {},
2021-07-11T01:40:42.8559104Z [cluster1] "f:numberReady": {},
2021-07-11T01:40:42.8559804Z [cluster1] "f:observedGeneration": {},
2021-07-11T01:40:42.8560707Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-11T01:40:42.8561386Z [cluster1] }
2021-07-11T01:40:42.8561855Z [cluster1] },
2021-07-11T01:40:42.8562365Z [cluster1] "f:gateways": {},
2021-07-11T01:40:42.8563118Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-11T01:40:42.8563811Z [cluster1] ".": {},
2021-07-11T01:40:42.8588089Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-11T01:40:42.8588811Z [cluster1] },
2021-07-11T01:40:42.8589437Z [cluster1] "f:loadBalancerStatus": {},
2021-07-11T01:40:42.8590246Z [cluster1] "f:natEnabled": {},
2021-07-11T01:40:42.8590887Z [cluster1] "f:networkPlugin": {},
2021-07-11T01:40:42.8591708Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-11T01:40:42.8592430Z [cluster1] ".": {},
2021-07-11T01:40:42.8593082Z [cluster1] "f:lastResourceVersion": {},
2021-07-11T01:40:42.8593954Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-11T01:40:42.8594897Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-11T01:40:42.8595610Z [cluster1] "f:status": {
2021-07-11T01:40:42.8596133Z [cluster1] ".": {},
2021-07-11T01:40:42.8596811Z [cluster1] "f:currentNumberScheduled": {},
2021-07-11T01:40:42.8597703Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-11T01:40:42.8598511Z [cluster1] "f:numberAvailable": {},
2021-07-11T01:40:42.8599274Z [cluster1] "f:numberMisscheduled": {},
2021-07-11T01:40:42.8599978Z [cluster1] "f:numberReady": {},
2021-07-11T01:40:42.8600785Z [cluster1] "f:observedGeneration": {},
2021-07-11T01:40:42.8601624Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-11T01:40:42.8602381Z [cluster1] }
2021-07-11T01:40:42.8602854Z [cluster1] },
2021-07-11T01:40:42.8603409Z [cluster1] "f:serviceCIDR": {}
2021-07-11T01:40:42.8604114Z [cluster1] }
2021-07-11T01:40:42.8604579Z [cluster1] },
2021-07-11T01:40:42.8605595Z [cluster1] "manager": "submariner-operator",
2021-07-11T01:40:42.8606327Z [cluster1] "operation": "Update",
2021-07-11T01:40:42.8607086Z [cluster1] "time": "2021-07-11T01:39:33Z"
2021-07-11T01:40:42.8607585Z [cluster1] }
2021-07-11T01:40:42.8608011Z [cluster1] ],
2021-07-11T01:40:42.8608528Z [cluster1] "name": "submariner",
2021-07-11T01:40:42.8609406Z [cluster1] "namespace": "submariner-operator",
2021-07-11T01:40:42.8610174Z [cluster1] "resourceVersion": "2616",
2021-07-11T01:40:42.8611135Z [cluster1] "uid": "068ba4e1-6a77-41ff-9d11-07d1731dde7a"
2021-07-11T01:40:42.8611757Z [cluster1] },
2021-07-11T01:40:42.8612210Z [cluster1] "spec": {
2021-07-11T01:40:42.8612693Z [cluster1] "broker": "k8s",
2021-07-11T01:40:42.8613341Z [cluster1] "brokerK8sApiServer": "172.18.0.9:6443",
2021-07-11T01:40:42.8761890Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-11T01:40:42.9377540Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-11T01:40:42.9976446Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-11T01:40:42.9977445Z [cluster1] "cableDriver": "libreswan",
2021-07-11T01:40:42.9978446Z [cluster1] "ceIPSecDebug": false,
2021-07-11T01:40:42.9979126Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-11T01:40:42.9979782Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-11T01:40:42.9981063Z [cluster1] "ceIPSecPSK": "sWDmldNSIUX6Ceivyz8RZs/Jf3X/LLl+na5abxtzqlPZP6+NY8EmNAc7khFPZsG0",
2021-07-11T01:40:42.9982239Z [cluster1] "clusterCIDR": "",
2021-07-11T01:40:42.9982849Z [cluster1] "clusterID": "cluster1",
2021-07-11T01:40:42.9983446Z [cluster1] "colorCodes": "blue",
2021-07-11T01:40:42.9984153Z [cluster1] "connectionHealthCheck": {
2021-07-11T01:40:42.9984838Z [cluster1] "enabled": true,
2021-07-11T01:40:42.9985439Z [cluster1] "intervalSeconds": 1,
2021-07-11T01:40:42.9986494Z [cluster1] "maxPacketLossCount": 5
2021-07-11T01:40:42.9987259Z [cluster1] },
2021-07-11T01:40:42.9987763Z [cluster1] "debug": false,
2021-07-11T01:40:42.9989089Z [cluster1] "namespace": "submariner-operator",
2021-07-11T01:40:42.9989838Z [cluster1] "natEnabled": false,
2021-07-11T01:40:42.9990637Z [cluster1] "repository": "localhost:5000",
2021-07-11T01:40:42.9991260Z [cluster1] "serviceCIDR": "",
2021-07-11T01:40:42.9992264Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-11T01:40:42.9992995Z [cluster1] "version": "local"
2021-07-11T01:40:42.9993488Z [cluster1] },
2021-07-11T01:40:42.9993929Z [cluster1] "status": {
2021-07-11T01:40:42.9994476Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-11T01:40:42.9995071Z [cluster1] "clusterID": "cluster1",
2021-07-11T01:40:42.9995687Z [cluster1] "colorCodes": "blue",
2021-07-11T01:40:42.9996629Z [cluster1] "deploymentInfo": {},
2021-07-11T01:40:42.9997547Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-11T01:40:42.9998779Z [cluster1] "lastResourceVersion": "2550",
2021-07-11T01:40:42.9999892Z [cluster1] "mismatchedContainerImages": false,
2021-07-11T01:40:43.0001112Z [cluster1] "nonReadyContainerStates": [],
2021-07-11T01:40:43.0001966Z [cluster1] "status": {
2021-07-11T01:40:43.0002797Z [cluster1] "currentNumberScheduled": 1,
2021-07-11T01:40:43.0003796Z [cluster1] "desiredNumberScheduled": 1,
2021-07-11T01:40:43.0004711Z [cluster1] "numberAvailable": 1,
2021-07-11T01:40:43.0005682Z [cluster1] "numberMisscheduled": 0,
2021-07-11T01:40:43.0006505Z [cluster1] "numberReady": 1,
2021-07-11T01:40:43.0007304Z [cluster1] "observedGeneration": 1,
2021-07-11T01:40:43.0008123Z [cluster1] "updatedNumberScheduled": 1
2021-07-11T01:40:43.0008753Z [cluster1] }
2021-07-11T01:40:43.0009192Z [cluster1] },
2021-07-11T01:40:43.0009777Z [cluster1] "gateways": [
2021-07-11T01:40:43.0010264Z [cluster1] {
2021-07-11T01:40:43.0010780Z [cluster1] "connections": [
2021-07-11T01:40:43.0011278Z [cluster1] {
2021-07-11T01:40:43.0011791Z [cluster1] "endpoint": {
2021-07-11T01:40:43.0012382Z [cluster1] "backend": "libreswan",
2021-07-11T01:40:43.0013002Z [cluster1] "backend_config": {
2021-07-11T01:40:43.0014014Z [cluster1] "natt-discovery-port": "4490",
2021-07-11T01:40:43.0014997Z [cluster1] "preferred-server": "false"
2021-07-11T01:40:43.0015610Z [cluster1] },
2021-07-11T01:40:43.0017130Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-11T01:40:43.0018410Z [cluster1] "cluster_id": "cluster2",
2021-07-11T01:40:43.0019599Z [cluster1] "healthCheckIP": "10.2.128.0",
2021-07-11T01:40:43.0020754Z [cluster1] "hostname": "cluster2-worker",
2021-07-11T01:40:43.0348494Z [cluster1] "nat_enabled": false,
2021-07-11T01:40:43.0349353Z [cluster1] "private_ip": "172.18.0.7",
2021-07-11T01:40:43.0349960Z [cluster1] "public_ip": "20.102.70.128",
2021-07-11T01:40:43.0350965Z [cluster1] "subnets": [
2021-07-11T01:40:43.0351569Z [cluster1] "100.2.0.0/16",
2021-07-11T01:40:43.0352061Z [cluster1] "10.2.0.0/16"
2021-07-11T01:40:43.0352545Z [cluster1] ]
2021-07-11T01:40:43.0353001Z [cluster1] },
2021-07-11T01:40:43.0353534Z [cluster1] "latencyRTT": {
2021-07-11T01:40:43.0354110Z [cluster1] "average": "0s",
2021-07-11T01:40:43.0354647Z [cluster1] "last": "0s",
2021-07-11T01:40:43.0355168Z [cluster1] "max": "0s",
2021-07-11T01:40:43.0355763Z [cluster1] "min": "0s",
2021-07-11T01:40:43.0356301Z [cluster1] "stdDev": "0s"
2021-07-11T01:40:43.0356792Z [cluster1] },
2021-07-11T01:40:43.0357320Z [cluster1] "status": "error",
2021-07-11T01:40:43.0358458Z [cluster1] "statusMessage": "Failed to successfully ping the remote endpoint IP \"10.2.128.0\"",
2021-07-11T01:40:43.0359313Z [cluster1] "usingIP": "172.18.0.7"
2021-07-11T01:40:43.0359822Z [cluster1] }
2021-07-11T01:40:43.0360259Z [cluster1] ],
2021-07-11T01:40:43.0360785Z [cluster1] "haStatus": "active",
2021-07-11T01:40:43.0361466Z [cluster1] "localEndpoint": {
2021-07-11T01:40:43.0362092Z [cluster1] "backend": "libreswan",
2021-07-11T01:40:43.0362790Z [cluster1] "backend_config": {
2021-07-11T01:40:43.0363979Z [cluster1] "natt-discovery-port": "4490",
2021-07-11T01:40:43.0364930Z [cluster1] "preferred-server": "false"
2021-07-11T01:40:43.0365539Z [cluster1] },
2021-07-11T01:40:43.0366664Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-11T01:40:43.0367745Z [cluster1] "cluster_id": "cluster1",
2021-07-11T01:40:43.0368403Z [cluster1] "healthCheckIP": "10.1.0.1",
2021-07-11T01:40:43.0369291Z [cluster1] "hostname": "cluster1-worker",
2021-07-11T01:40:43.0369970Z [cluster1] "nat_enabled": false,
2021-07-11T01:40:43.0370548Z [cluster1] "private_ip": "172.18.0.8",
2021-07-11T01:40:43.0371128Z [cluster1] "public_ip": "20.102.70.128",
2021-07-11T01:40:43.0371780Z [cluster1] "subnets": [
2021-07-11T01:40:43.0372292Z [cluster1] "100.1.0.0/16",
2021-07-11T01:40:43.0372780Z [cluster1] "10.1.0.0/16"
2021-07-11T01:40:43.0373232Z [cluster1] ]
2021-07-11T01:40:43.0373682Z [cluster1] },
2021-07-11T01:40:43.0374209Z [cluster1] "statusFailure": "",
2021-07-11T01:40:43.0375047Z [cluster1] "version": "devel-19727bb"
2021-07-11T01:40:43.0375587Z [cluster1] }
2021-07-11T01:40:43.0376026Z [cluster1] ],
2021-07-11T01:40:43.0376682Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-11T01:40:43.0377622Z [cluster1] "mismatchedContainerImages": false
2021-07-11T01:40:43.0378309Z [cluster1] },
2021-07-11T01:40:43.0378898Z [cluster1] "loadBalancerStatus": {},
2021-07-11T01:40:43.0379546Z [cluster1] "natEnabled": false,
2021-07-11T01:40:43.0380385Z [cluster1] "networkPlugin": "weave-net",
2021-07-11T01:40:43.0381221Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-11T01:40:43.0382058Z [cluster1] "lastResourceVersion": "2504",
2021-07-11T01:40:43.0382933Z [cluster1] "mismatchedContainerImages": false,
2021-07-11T01:40:43.0383840Z [cluster1] "nonReadyContainerStates": [],
2021-07-11T01:40:43.0384528Z [cluster1] "status": {
2021-07-11T01:40:43.0385195Z [cluster1] "currentNumberScheduled": 3,
2021-07-11T01:40:43.0386052Z [cluster1] "desiredNumberScheduled": 3,
2021-07-11T01:40:43.0386801Z [cluster1] "numberAvailable": 3,
2021-07-11T01:40:43.0387503Z [cluster1] "numberMisscheduled": 0,
2021-07-11T01:40:43.0388165Z [cluster1] "numberReady": 3,
2021-07-11T01:40:43.0388815Z [cluster1] "observedGeneration": 1,
2021-07-11T01:40:43.0389614Z [cluster1] "updatedNumberScheduled": 3
2021-07-11T01:40:43.0390512Z [cluster1] }
2021-07-11T01:40:43.0390960Z [cluster1] },
2021-07-11T01:40:43.0391471Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-11T01:40:43.0392066Z [cluster1] }
2021-07-11T01:40:43.0392476Z [cluster1] }
2021-07-11T01:40:43.0393679Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-11T01:40:43.0395330Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-11T01:40:43.0397139Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-11T01:40:43.0398748Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-11T01:40:43.0400270Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-11T01:40:43.0401789Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-11T01:40:43.0403162Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-11T01:40:43.0404389Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-11T01:40:43.0405720Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-11T01:40:43.0720956Z [submariner-operator]$ [cluster1] validate_equals .metadata.name ser2] "localEndpoint": {
2021-07-11T01:40:43.0722169Z [cluster2] "backend": "libreswan",
2021-07-11T01:40:43.0722804Z [cluster2] "backend_config": {
2021-07-11T01:40:43.0723711Z [cluster2] "natt-discovery-port": "4490",
2021-07-11T01:40:43.0724668Z [cluster2] "preferred-server": "false"
2021-07-11T01:40:43.0725260Z [cluster2] },
2021-07-11T01:40:43.0726409Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-7",
2021-07-11T01:40:43.0727512Z [cluster2] "cluster_id": "cluster2",
2021-07-11T01:40:43.0728401Z [cluster2] "healthCheckIP": "10.2.128.0",
2021-07-11T01:40:43.0729303Z [cluster2] "hostname": "cluster2-worker",
2021-07-11T01:40:43.0729990Z [cluster2] "nat_enabled": false,
2021-07-11T01:40:43.0730575Z [cluster2] "private_ip": "172.18.0.7",
2021-07-11T01:40:43.0731157Z [cluster2] "public_ip": "20.102.70.128",
2021-07-11T01:40:43.0731713Z [cluster2] "subnets": [
2021-07-11T01:40:43.0732214Z [cluster2] "100.2.0.0/16",
2021-07-11T01:40:43.0732705Z [cluster2] "10.2.0.0/16"
2021-07-11T01:40:43.0733157Z [cluster2] ]
2021-07-11T01:40:43.0733609Z [cluster2] },
2021-07-11T01:40:43.0734143Z [cluster2] "statusFailure": "",
2021-07-11T01:40:43.0734968Z [cluster2] "version": "devel-19727bb"
2021-07-11T01:40:43.0735505Z [cluster2] }
2021-07-11T01:40:43.0735949Z [cluster2] ],
2021-07-11T01:40:43.0736613Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-11T01:40:43.0737551Z [cluster2] "mismatchedContainerImages": false
2021-07-11T01:40:43.0738354Z [cluster2] },
2021-07-11T01:40:43.0738926Z [cluster2] "loadBalancerStatus": {},
2021-07-11T01:40:43.0739593Z [cluster2] "natEnabled": false,
2021-07-11T01:40:43.0740421Z [cluster2] "networkPlugin": "weave-net",
2021-07-11T01:40:43.0741261Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-11T01:40:43.0742098Z [cluster2] "lastResourceVersion": "2439",
2021-07-11T01:40:43.0742979Z [cluster2] "mismatchedContainerImages": false,
2021-07-11T01:40:43.0743887Z [cluster2] "nonReadyContainerStates": [],
2021-07-11T01:40:43.0744664Z [cluster2] "status": {
2021-07-11T01:40:43.0745339Z [cluster2] "currentNumberScheduled": 3,
2021-07-11T01:40:43.0746197Z [cluster2] "desiredNumberScheduled": 3,
2021-07-11T01:40:43.0746970Z [cluster2] "numberAvailable": 3,
2021-07-11T01:40:43.0747657Z [cluster2] "numberMisscheduled": 0,
2021-07-11T01:40:43.0748396Z [cluster2] "numberReady": 3,
2021-07-11T01:40:43.0749047Z [cluster2] "observedGeneration": 1,
2021-07-11T01:40:43.0749927Z [cluster2] "updatedNumberScheduled": 3
2021-07-11T01:40:43.0750941Z [cluster2] }
2021-07-11T01:40:43.0751507Z [cluster2] },
2021-07-11T01:40:43.0752026Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-11T01:40:43.0752543Z [cluster2] }
2021-07-11T01:40:43.0752957Z [cluster2] }
2021-07-11T01:40:43.0754190Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-11T01:40:43.0755865Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-11T01:40:43.0757553Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-11T01:40:43.0759156Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-11T01:40:43.0760593Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-11T01:40:43.0762098Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-11T01:40:43.0763471Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-11T01:40:43.0764694Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-11T01:40:43.0766047Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-11T01:40:43.0767450Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-11T01:40:43.0768803Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-11T01:40:43.0770513Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-11T01:40:43.0772125Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-11T01:40:43.0773697Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-11T01:40:43.0775422Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-11T01:40:43.1656769Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-11T01:40:43.1860519Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-11T01:40:43.1862832Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-11T01:40:43.2492504Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:43.3251668Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTubmariner
2021-07-11T01:40:43.3423389Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-11T01:40:43.3424946Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-11T01:40:43.3426583Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-11T01:40:43.3428115Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.9:6443
2021-07-11T01:40:43.3429827Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-11T01:40:43.3567296Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-11T01:40:43.3709243Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-11T01:40:43.3711822Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-11T01:40:43.8468967Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:43.9887063Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hNVEF4TXpBd05Wb1hEVE14TURjd09UQXhNekF3TlZvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTXZ0CnlXZWJMSTU2dnZTYm1NM1ZncGV1N1oxSTRCUitOUFh3RUJjSzE1VlBOTm1KZkRHQmQrTUkyRVhxRXNzRWlUWXgKQXRrU3d0OHhPRmNsSDBVVXlRNUlZMjVOczdqREp2TEpkaE1LRk9PUTI2RDJKUTZjeFBvVUZkditaVkd4bUFFSApsRVBZYUVPTEpsNlNQRjBBaytKTWRVbHpWa2xFMG1vRGpFRkJuRG1mWHRDdVZROTBKWVpveTZQYUxvdndtQjdvCmJQUXFIVVdIbEMrUGFlZCtZKzA4ejdSOUZoa3l0NURpNmlJT0lEaUVubU5nMWlNcHB1MGNvbUVYNDArYXR0SEQKL09xL0ZvNnJBS21xTlJVdVlTSW5sc1pKbENUV3V4T3lFZ0w0d2lRa0RXbFdFTHFoTS9jNFVtUGZUWURaUVV0bAo0MEJpSjk3cDd0WkVUQmQ3L3ljQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:44.0545254Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0547194Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-11T01:40:44.0549291Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-11T01:40:44.0592418Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0594171Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-11T01:40:44.0595574Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-11T01:40:44.0597138Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0599259Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-11T01:40:44.0600670Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-11T01:40:44.0602256Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0603859Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-11T01:40:44.0605288Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-11T01:40:44.0606924Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0608608Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-11T01:40:44.0610008Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-11T01:40:44.0611542Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0613074Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-11T01:40:44.0614345Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-11T01:40:44.0615767Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0617161Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-11T01:40:44.0618371Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-11T01:40:44.0619777Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0621368Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-11T01:40:44.0622400Z [cluster1] Generated cluster id: cluster1
2021-07-11T01:40:44.0623602Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-11T01:40:44.0624906Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-11T01:40:44.0802865Z [subUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZIa3BFcGZzaDh3YmdkRkRVaXl0RVRzd3pxK3pNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCNnVmNVJhaTQvcDMxRVlSemdQai8yYjdHOXFNdGI0ZFlJZE1XdlN5Q0VoeHF2WmR4UQpJemoreEVuYUJHWlQ5QnkvY2N1Zzh6UlErSmlYakNlcFV5RDRmV0hQbUJNTFpJL1pPNXBxUGkvQ2NxVzBHWHpZCmFSbVdtTlk4clBTc0VTMVVzS1hVaVcreml1T3JFek5weGl4bjJxbjNUZk83d1k0N3B6WmhDYVA0dElaLy83cmgKWTZ6aWI3WGhZWHVEcUMxSlRUMm4wZXdIUnJEaFRQMERIczZlTHgxd3hOcDBPdGlqYjBxMmRqcndYczM1UGNBWQo2SUpmYXF2R3VyYWN4ZFpkT0dLSUs0aVNvcnJqcndDQ1phSTZ6TzB2M2tDNkhZTDlvcE15RkxTRzJBemJRK3BBCllXTkE1VUJvN1djbExMVkhXazN3Mi9NZ25aZFZGdmhSYmhhMAotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-11T01:40:44.0919917Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0921859Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-11T01:40:44.0923912Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-11T01:40:44.0926496Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0928266Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-11T01:40:44.0929651Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-11T01:40:44.0931225Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0932900Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-11T01:40:44.0934291Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-11T01:40:44.0936684Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0938276Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-11T01:40:44.0939807Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-11T01:40:44.0941434Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0943034Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-11T01:40:44.0944447Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-11T01:40:44.0946039Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0947497Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-11T01:40:44.0948735Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-11T01:40:44.0950262Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0951654Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-11T01:40:44.0952872Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-11T01:40:44.0954286Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0955866Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0956908Z [cluster2] Generated cluster id: cluster2
2021-07-11T01:40:44.0958003Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-11T01:40:44.0959312Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-11T01:40:44.0960797Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0962235Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-11T01:40:44.0963467Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-11T01:40:44.0964854Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0966419Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-11T01:40:44.0968091Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-11T01:40:44.0969736Z [submariner-operator]$ [cluster2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0971217Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-11T01:40:44.0972522Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-11T01:40:44.0974013Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-11T01:40:44.0975418Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-11T01:40:44.0976604Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-11T01:40:45.3524856Z [submariner-operator]$ [cluster2] with_retrmariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3526631Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-11T01:40:45.3527878Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-11T01:40:45.3529297Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3530869Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-11T01:40:45.3532431Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-11T01:40:45.3534255Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3535719Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-11T01:40:45.3537047Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-11T01:40:45.3538532Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3539958Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-11T01:40:45.3541149Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-11T01:40:45.3542334Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-11T01:40:45.3543537Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-11T01:40:45.3544610Z [submariner-operator]$ [cluster1] iteration=1
2021-07-11T01:40:45.3545674Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-11T01:40:45.3546741Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-11T01:40:45.3547815Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-11T01:40:45.3548825Z [submariner-operator]$ [cluster1] wait 10010
2021-07-11T01:40:45.3549828Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-11T01:40:45.3551288Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-11T01:40:45.3552263Z [cluster1] 
2021-07-11T01:40:45.3552837Z [cluster1] 
2021-07-11T01:40:45.3554207Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:45.3555877Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-11T01:40:45.3557252Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-11T01:40:45.3558811Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3560352Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-11T01:40:45.3561710Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-11T01:40:45.3563384Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-11T01:40:45.3564705Z [submariner-operator]$ [cluster1] return 0
2021-07-11T01:40:45.3565678Z [submariner-operator]$ [cluster1] return 0
2021-07-11T01:40:45.3566785Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-11T01:40:45.3567977Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-11T01:40:45.3569415Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-11T01:40:45.3571199Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-11T01:40:45.3572675Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-11T01:40:45.3574093Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-11T01:40:45.3575464Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-11T01:40:45.3576698Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-11T01:40:45.3577926Z [submariner-operator]$ [cluster1] iteration=1
2021-07-11T01:40:45.3578922Z [submariner-operator]$ [cluster1] wait 10077
2021-07-11T01:40:45.3579942Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-11T01:40:45.3581038Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-11T01:40:45.3581832Z [cluster1] 
2021-07-11T01:40:45.3582623Z [submariner-operator]$ [cluster1] return 0
2021-07-11T01:40:45.3583853Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-11T01:40:45.3585098Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-11T01:40:45.3586206Z [submariner-operator]$ [cluster1] iteration=1
2021-07-11T01:40:45.3587177Z [submariner-operator]$ [cluster1] wait 10112
2021-07-11T01:40:45.3588210Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-11T01:40:45.3589309Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-11T01:40:45.3613720Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-11T01:40:46.1423473Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath=ies 5 verify_subm_cr_status_
2021-07-11T01:40:46.1425009Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-11T01:40:46.1426154Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:40:46.1427131Z [submariner-operator]$ [cluster2] wait 9985
2021-07-11T01:40:46.1428229Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-11T01:40:46.1429303Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-11T01:40:46.1430591Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-11T01:40:46.1431699Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-11T01:40:46.1432976Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-11T01:40:46.1433962Z [cluster2] 
2021-07-11T01:40:46.1434654Z [cluster2] 
2021-07-11T01:40:46.1436037Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-11T01:40:46.1437796Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-11T01:40:46.1439173Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-11T01:40:46.1440734Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-11T01:40:46.1442260Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-11T01:40:46.1443627Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-11T01:40:46.1445419Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-11T01:40:46.1446753Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:46.1447850Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:46.1448954Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-11T01:40:46.1450164Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-11T01:40:46.1451589Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-11T01:40:46.1453213Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-11T01:40:46.1454668Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-11T01:40:46.1456109Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-11T01:40:46.1457382Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-11T01:40:46.1458570Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-11T01:40:46.1459668Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:40:46.1460637Z [submariner-operator]$ [cluster2] wait 10049
2021-07-11T01:40:46.1461660Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-11T01:40:46.1462723Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-11T01:40:46.1463661Z [cluster2] 
2021-07-11T01:40:46.1464435Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:46.1465552Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-11T01:40:46.1466783Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-11T01:40:46.1467911Z [submariner-operator]$ [cluster2] iteration=1
2021-07-11T01:40:46.1468985Z [submariner-operator]$ [cluster2] wait 10094
2021-07-11T01:40:46.1470046Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-11T01:40:46.1471526Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-11T01:40:46.1473279Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-11T01:40:46.1475521Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-11T01:40:46.1478022Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-11T01:40:46.1480162Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-11T01:40:46.1482203Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-11T01:40:46.1484287Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-11T01:40:46.1485798Z [submariner-operator]$ [cluster2] return 0
2021-07-11T01:40:46.1487062Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-11T01:40:46.1488195Z [submariner-operator]$ [cluster2] verify_subm_gateway_pod
2021-07-11T01:40:46.1489950Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-11T01:40:46.1492349Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-11T01:40:47.3874637Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-11T01:40:47.3877218Z [cluster2] pod/submariner-gateway-gmwkg condition met
2021-07-11T01:40:47.3879020Z [submariner-operator]$ [cluster2] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-11T01:40:47.3881381Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:47.3883719Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:47.3886153Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-11T01:40:47.38885
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment