Skip to content

Instantly share code, notes, and snippets.

@dfarrell07

dfarrell07/logs.txt

Created July 19, 2021 22:53
Show Gist options
  • Save dfarrell07/fd868c9f7ffe4db93ddee72d104ab728 to your computer and use it in GitHub Desktop.
Save dfarrell07/fd868c9f7ffe4db93ddee72d104ab728 to your computer and use it in GitHub Desktop.
Download ZIP
subm_random_fail_20210719-3
Raw
logs.txt
This file has been truncated, but you can view the full file.
2021-07-19T10:04:34.2772606Z Found online and idle hosted runner(s) in the current repository's organization account that matches the required labels: 'ubuntu-latest'
2021-07-19T10:04:34.2772658Z Waiting for a hosted runner in 'organization' to pick this job...
2021-07-19T10:05:43.0085551Z Current runner version: '2.278.0'
2021-07-19T10:05:43.0113484Z ##[group]Operating System
2021-07-19T10:05:43.0114539Z Ubuntu
2021-07-19T10:05:43.0115413Z 20.04.2
2021-07-19T10:05:43.0115951Z LTS
2021-07-19T10:05:43.0116479Z ##[endgroup]
2021-07-19T10:05:43.0117206Z ##[group]Virtual Environment
2021-07-19T10:05:43.0117938Z Environment: ubuntu-20.04
2021-07-19T10:05:43.0118612Z Version: 20210712.0
2021-07-19T10:05:43.0119735Z Included Software: https://github.com/actions/virtual-environments/blob/ubuntu20/20210712.0/images/linux/Ubuntu2004-README.md
2021-07-19T10:05:43.0121310Z Image Release: https://github.com/actions/virtual-environments/releases/tag/ubuntu20%2F20210712.0
2021-07-19T10:05:43.0122370Z ##[endgroup]
2021-07-19T10:05:43.0124560Z ##[group]GITHUB_TOKEN Permissions
2021-07-19T10:05:43.0125893Z Actions: write
2021-07-19T10:05:43.0126525Z Checks: write
2021-07-19T10:05:43.0127116Z Contents: write
2021-07-19T10:05:43.0127803Z Deployments: write
2021-07-19T10:05:43.0128561Z Discussions: write
2021-07-19T10:05:43.0129222Z Issues: write
2021-07-19T10:05:43.0129782Z Metadata: read
2021-07-19T10:05:43.0130466Z Packages: write
2021-07-19T10:05:43.0131081Z PullRequests: write
2021-07-19T10:05:43.0131839Z RepositoryProjects: write
2021-07-19T10:05:43.0132557Z SecurityEvents: write
2021-07-19T10:05:43.0133234Z Statuses: write
2021-07-19T10:05:43.0133986Z ##[endgroup]
2021-07-19T10:05:43.0137191Z Prepare workflow directory
2021-07-19T10:05:43.0816712Z Prepare all required actions
2021-07-19T10:05:43.0828481Z Getting action download info
2021-07-19T10:05:43.4415230Z Download action repository 'actions/checkout@v2'
2021-07-19T10:05:45.1358826Z Download action repository 'submariner-io/shipyard@devel'
2021-07-19T10:05:45.5330968Z ##[group]Run actions/checkout@v2
2021-07-19T10:05:45.5331693Z with:
2021-07-19T10:05:45.5332421Z repository: submariner-io/submariner-operator
2021-07-19T10:05:45.5333690Z token: ***
2021-07-19T10:05:45.5334202Z ssh-strict: true
2021-07-19T10:05:45.5334845Z persist-credentials: true
2021-07-19T10:05:45.5335580Z clean: true
2021-07-19T10:05:45.5336074Z fetch-depth: 1
2021-07-19T10:05:45.5336544Z lfs: false
2021-07-19T10:05:45.5337028Z submodules: false
2021-07-19T10:05:45.5337518Z ##[endgroup]
2021-07-19T10:05:45.7756435Z Syncing repository: submariner-io/submariner-operator
2021-07-19T10:05:45.7758194Z ##[group]Getting Git version info
2021-07-19T10:05:45.7759508Z Working directory is '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T10:05:45.7812001Z [command]/usr/bin/git version
2021-07-19T10:05:45.7952942Z git version 2.32.0
2021-07-19T10:05:45.7963661Z ##[endgroup]
2021-07-19T10:05:45.7971040Z Deleting the contents of '/home/runner/work/submariner-operator/submariner-operator'
2021-07-19T10:05:45.7975069Z ##[group]Initializing the repository
2021-07-19T10:05:45.7979532Z [command]/usr/bin/git init /home/runner/work/submariner-operator/submariner-operator
2021-07-19T10:05:45.8058900Z hint: Using 'master' as the name for the initial branch. This default branch name
2021-07-19T10:05:45.8060194Z hint: is subject to change. To configure the initial branch name to use in all
2021-07-19T10:05:45.8061321Z hint: of your new repositories, which will suppress this warning, call:
2021-07-19T10:05:45.8062192Z hint:
2021-07-19T10:05:45.8063225Z hint: git config --global init.defaultBranch <name>
2021-07-19T10:05:45.8064128Z hint:
2021-07-19T10:05:45.8065161Z hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and
2021-07-19T10:05:45.8066498Z hint: 'development'. The just-created branch can be renamed via this command:
2021-07-19T10:05:45.8067422Z hint:
2021-07-19T10:05:45.8068238Z hint: git branch -m <name>
2021-07-19T10:05:45.8074541Z Initialized empty Git repository in /home/runner/work/submariner-operator/submariner-operator/.git/
2021-07-19T10:05:45.8080962Z [command]/usr/bin/git remote add origin https://github.com/submariner-io/submariner-operator
2021-07-19T10:05:45.8122739Z ##[endgroup]
2021-07-19T10:05:45.8123738Z ##[group]Disabling automatic garbage collection
2021-07-19T10:05:45.8131299Z [command]/usr/bin/git config --local gc.auto 0
2021-07-19T10:05:45.8166086Z ##[endgroup]
2021-07-19T10:05:45.8175363Z ##[group]Setting up auth
2021-07-19T10:05:45.8186035Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand
2021-07-19T10:05:45.8220352Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :
2021-07-19T10:05:46.3573076Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader
2021-07-19T10:05:46.3575510Z [command]/usr/bin/git submodule foreach --recursive git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :
2021-07-19T10:05:46.3577704Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic ***
2021-07-19T10:05:46.3578948Z ##[endgroup]
2021-07-19T10:05:46.3579712Z ##[group]Fetching the repository
2021-07-19T10:05:46.3582212Z [command]/usr/bin/git -c protocol.version=2 fetch --no-tags --prune --progress --no-recurse-submodules --depth=1 origin +0105e4d08ef7236073547f1383566fc76c548f6d:refs/remotes/origin/devel
2021-07-19T10:05:46.3583608Z remote: Enumerating objects: 486, done.
2021-07-19T10:05:46.3584377Z remote: Counting objects: 0% (1/486)
2021-07-19T10:05:46.3585107Z remote: Counting objects: 1% (5/486)
2021-07-19T10:05:46.3585815Z remote: Counting objects: 2% (10/486)
2021-07-19T10:05:46.3586549Z remote: Counting objects: 3% (15/486)
2021-07-19T10:05:46.3587456Z remote: Counting objects: 4% (20/486)
2021-07-19T10:05:46.3588217Z remote: Counting objects: 5% (25/486)
2021-07-19T10:05:46.3588951Z remote: Counting objects: 6% (30/486)
2021-07-19T10:05:46.3589662Z remote: Counting objects: 7% (35/486)
2021-07-19T10:05:46.3590596Z remote: Counting objects: 8% (39/486)
2021-07-19T10:05:46.3591374Z remote: Counting objects: 9% (44/486)
2021-07-19T10:05:46.3592391Z remote: Counting objects: 10% (49/486)
2021-07-19T10:05:46.3593102Z remote: Counting objects: 11% (54/486)
2021-07-19T10:05:46.3593967Z remote: Counting objects: 12% (59/486)
2021-07-19T10:05:46.3594749Z remote: Counting objects: 13% (64/486)
2021-07-19T10:05:46.3595532Z remote: Counting objects: 14% (69/486)
2021-07-19T10:05:46.3596298Z remote: Counting objects: 15% (73/486)
2021-07-19T10:05:46.3597073Z remote: Counting objects: 16% (78/486)
2021-07-19T10:05:46.3597845Z remote: Counting objects: 17% (83/486)
2021-07-19T10:05:46.3598630Z remote: Counting objects: 18% (88/486)
2021-07-19T10:05:46.3599406Z remote: Counting objects: 19% (93/486)
2021-07-19T10:05:46.3600169Z remote: Counting objects: 20% (98/486)
2021-07-19T10:05:46.3600958Z remote: Counting objects: 21% (103/486)
2021-07-19T10:05:46.3601737Z remote: Counting objects: 22% (107/486)
2021-07-19T10:05:46.3602516Z remote: Counting objects: 23% (112/486)
2021-07-19T10:05:46.3603306Z remote: Counting objects: 24% (117/486)
2021-07-19T10:05:46.3604073Z remote: Counting objects: 25% (122/486)
2021-07-19T10:05:46.3604853Z remote: Counting objects: 26% (127/486)
2021-07-19T10:05:46.3605632Z remote: Counting objects: 27% (132/486)
2021-07-19T10:05:46.3606414Z remote: Counting objects: 28% (137/486)
2021-07-19T10:05:46.3607200Z remote: Counting objects: 29% (141/486)
2021-07-19T10:05:46.3607981Z remote: Counting objects: 30% (146/486)
2021-07-19T10:05:46.3608807Z remote: Counting objects: 31% (151/486)
2021-07-19T10:05:46.3609587Z remote: Counting objects: 32% (156/486)
2021-07-19T10:05:46.3610352Z remote: Counting objects: 33% (161/486)
2021-07-19T10:05:46.3611132Z remote: Counting objects: 34% (166/486)
2021-07-19T10:05:46.3612063Z remote: Counting objects: 35% (171/486)
2021-07-19T10:05:46.3612846Z remote: Counting objects: 36% (175/486)
2021-07-19T10:05:46.3613633Z remote: Counting objects: 37% (180/486)
2021-07-19T10:05:46.3614396Z remote: Counting objects: 38% (185/486)
2021-07-19T10:05:46.3615184Z remote: Counting objects: 39% (190/486)
2021-07-19T10:05:46.3615954Z remote: Counting objects: 40% (195/486)
2021-07-19T10:05:46.3616731Z remote: Counting objects: 41% (200/486)
2021-07-19T10:05:46.3617515Z remote: Counting objects: 42% (205/486)
2021-07-19T10:05:46.3618299Z remote: Counting objects: 43% (209/486)
2021-07-19T10:05:46.3619081Z remote: Counting objects: 44% (214/486)
2021-07-19T10:05:46.3619857Z remote: Counting objects: 45% (219/486)
2021-07-19T10:05:46.3620635Z remote: Counting objects: 46% (224/486)
2021-07-19T10:05:46.3621492Z remote: Counting objects: 47% (229/486)
2021-07-19T10:05:46.3622273Z remote: Counting objects: 48% (234/486)
2021-07-19T10:05:46.3623056Z remote: Counting objects: 49% (239/486)
2021-07-19T10:05:46.3623840Z remote: Counting objects: 50% (243/486)
2021-07-19T10:05:46.3624610Z remote: Counting objects: 51% (248/486)
2021-07-19T10:05:46.3625394Z remote: Counting objects: 52% (253/486)
2021-07-19T10:05:46.3626155Z remote: Counting objects: 53% (258/486)
2021-07-19T10:05:46.3627021Z remote: Counting objects: 54% (263/486)
2021-07-19T10:05:46.3627750Z remote: Counting objects: 55% (268/486)
2021-07-19T10:05:46.3628551Z remote: Counting objects: 56% (273/486)
2021-07-19T10:05:46.3629299Z remote: Counting objects: 57% (278/486)
2021-07-19T10:05:46.3630201Z remote: Counting objects: 58% (282/486)
2021-07-19T10:05:46.3630980Z remote: Counting objects: 59% (287/486)
2021-07-19T10:05:46.3631881Z remote: Counting objects: 60% (292/486)
2021-07-19T10:05:46.3632672Z remote: Counting objects: 61% (297/486)
2021-07-19T10:05:46.3633608Z remote: Counting objects: 62% (302/486)
2021-07-19T10:05:46.3634398Z remote: Counting objects: 63% (307/486)
2021-07-19T10:05:46.3635173Z remote: Counting objects: 64% (312/486)
2021-07-19T10:05:46.3635959Z remote: Counting objects: 65% (316/486)
2021-07-19T10:05:46.3636746Z remote: Counting objects: 66% (321/486)
2021-07-19T10:05:46.3637512Z remote: Counting objects: 67% (326/486)
2021-07-19T10:05:46.3638296Z remote: Counting objects: 68% (331/486)
2021-07-19T10:05:46.3639064Z remote: Counting objects: 69% (336/486)
2021-07-19T10:05:46.3639851Z remote: Counting objects: 70% (341/486)
2021-07-19T10:05:46.3640642Z remote: Counting objects: 71% (346/486)
2021-07-19T10:05:46.3641412Z remote: Counting objects: 72% (350/486)
2021-07-19T10:05:46.3642204Z remote: Counting objects: 73% (355/486)
2021-07-19T10:05:46.3642984Z remote: Counting objects: 74% (360/486)
2021-07-19T10:05:46.3643770Z remote: Counting objects: 75% (365/486)
2021-07-19T10:05:46.3644554Z remote: Counting objects: 76% (370/486)
2021-07-19T10:05:46.3645313Z remote: Counting objects: 77% (375/486)
2021-07-19T10:05:46.3646099Z remote: Counting objects: 78% (380/486)
2021-07-19T10:05:46.3646882Z remote: Counting objects: 79% (384/486)
2021-07-19T10:05:46.3647651Z remote: Counting objects: 80% (389/486)
2021-07-19T10:05:46.3648436Z remote: Counting objects: 81% (394/486)
2021-07-19T10:05:46.3649202Z remote: Counting objects: 82% (399/486)
2021-07-19T10:05:46.3649993Z remote: Counting objects: 83% (404/486)
2021-07-19T10:05:46.3650784Z remote: Counting objects: 84% (409/486)
2021-07-19T10:05:46.3651547Z remote: Counting objects: 85% (414/486)
2021-07-19T10:05:46.3652324Z remote: Counting objects: 86% (418/486)
2021-07-19T10:05:46.3653219Z remote: Counting objects: 87% (423/486)
2021-07-19T10:05:46.3653997Z remote: Counting objects: 88% (428/486)
2021-07-19T10:05:46.3654782Z remote: Counting objects: 89% (433/486)
2021-07-19T10:05:46.3655553Z remote: Counting objects: 90% (438/486)
2021-07-19T10:05:46.3656337Z remote: Counting objects: 91% (443/486)
2021-07-19T10:05:46.3657101Z remote: Counting objects: 92% (448/486)
2021-07-19T10:05:46.3657884Z remote: Counting objects: 93% (452/486)
2021-07-19T10:05:46.3658663Z remote: Counting objects: 94% (457/486)
2021-07-19T10:05:46.3659429Z remote: Counting objects: 95% (462/486)
2021-07-19T10:05:46.3660229Z remote: Counting objects: 96% (467/486)
2021-07-19T10:05:46.3661013Z remote: Counting objects: 97% (472/486)
2021-07-19T10:05:46.3661781Z remote: Counting objects: 98% (477/486)
2021-07-19T10:05:46.3662565Z remote: Counting objects: 99% (482/486)
2021-07-19T10:05:46.3663331Z remote: Counting objects: 100% (486/486)
2021-07-19T10:05:46.3664141Z remote: Counting objects: 100% (486/486), done.
2021-07-19T10:05:46.3664983Z remote: Compressing objects: 0% (1/353)
2021-07-19T10:05:46.3665799Z remote: Compressing objects: 1% (4/353)
2021-07-19T10:05:46.3666634Z remote: Compressing objects: 2% (8/353)
2021-07-19T10:05:46.3667458Z remote: Compressing objects: 3% (11/353)
2021-07-19T10:05:46.3668290Z remote: Compressing objects: 4% (15/353)
2021-07-19T10:05:46.3669128Z remote: Compressing objects: 5% (18/353)
2021-07-19T10:05:46.3669947Z remote: Compressing objects: 6% (22/353)
2021-07-19T10:05:46.3670897Z remote: Compressing objects: 7% (25/353)
2021-07-19T10:05:46.3672946Z remote: Compressing objects: 8% (29/353)
2021-07-19T10:05:46.3674095Z remote: Compressing objects: 9% (32/353)
2021-07-19T10:05:46.3674937Z remote: Compressing objects: 10% (36/353)
2021-07-19T10:05:46.3675766Z remote: Compressing objects: 11% (39/353)
2021-07-19T10:05:46.3676608Z remote: Compressing objects: 12% (43/353)
2021-07-19T10:05:46.3677436Z remote: Compressing objects: 13% (46/353)
2021-07-19T10:05:46.3678248Z remote: Compressing objects: 14% (50/353)
2021-07-19T10:05:46.3679085Z remote: Compressing objects: 15% (53/353)
2021-07-19T10:05:46.3679901Z remote: Compressing objects: 16% (57/353)
2021-07-19T10:05:46.3680730Z remote: Compressing objects: 17% (61/353)
2021-07-19T10:05:46.3681561Z remote: Compressing objects: 18% (64/353)
2021-07-19T10:05:46.3682382Z remote: Compressing objects: 19% (68/353)
2021-07-19T10:05:46.3683222Z remote: Compressing objects: 20% (71/353)
2021-07-19T10:05:46.3684037Z remote: Compressing objects: 21% (75/353)
2021-07-19T10:05:46.3684861Z remote: Compressing objects: 22% (78/353)
2021-07-19T10:05:46.3685686Z remote: Compressing objects: 23% (82/353)
2021-07-19T10:05:46.3686511Z remote: Compressing objects: 24% (85/353)
2021-07-19T10:05:46.3687342Z remote: Compressing objects: 25% (89/353)
2021-07-19T10:05:46.3688168Z remote: Compressing objects: 26% (92/353)
2021-07-19T10:05:46.3688979Z remote: Compressing objects: 27% (96/353)
2021-07-19T10:05:46.3689813Z remote: Compressing objects: 28% (99/353)
2021-07-19T10:05:46.3690630Z remote: Compressing objects: 29% (103/353)
2021-07-19T10:05:46.3691463Z remote: Compressing objects: 30% (106/353)
2021-07-19T10:05:46.3692293Z remote: Compressing objects: 31% (110/353)
2021-07-19T10:05:46.3693115Z remote: Compressing objects: 32% (113/353)
2021-07-19T10:05:46.3693952Z remote: Compressing objects: 33% (117/353)
2021-07-19T10:05:46.3694772Z remote: Compressing objects: 34% (121/353)
2021-07-19T10:05:46.3695598Z remote: Compressing objects: 35% (124/353)
2021-07-19T10:05:46.3696430Z remote: Compressing objects: 36% (128/353)
2021-07-19T10:05:46.3697363Z remote: Compressing objects: 37% (131/353)
2021-07-19T10:05:46.3698193Z remote: Compressing objects: 38% (135/353)
2021-07-19T10:05:46.3699008Z remote: Compressing objects: 39% (138/353)
2021-07-19T10:05:46.3699831Z remote: Compressing objects: 40% (142/353)
2021-07-19T10:05:46.3700664Z remote: Compressing objects: 41% (145/353)
2021-07-19T10:05:46.3701478Z remote: Compressing objects: 42% (149/353)
2021-07-19T10:05:46.3702305Z remote: Compressing objects: 43% (152/353)
2021-07-19T10:05:46.3703137Z remote: Compressing objects: 44% (156/353)
2021-07-19T10:05:46.3703961Z remote: Compressing objects: 45% (159/353)
2021-07-19T10:05:46.3704791Z remote: Compressing objects: 46% (163/353)
2021-07-19T10:05:46.3705606Z remote: Compressing objects: 47% (166/353)
2021-07-19T10:05:46.3706442Z remote: Compressing objects: 48% (170/353)
2021-07-19T10:05:46.3707286Z remote: Compressing objects: 49% (173/353)
2021-07-19T10:05:46.3708097Z remote: Compressing objects: 50% (177/353)
2021-07-19T10:05:46.3708930Z remote: Compressing objects: 51% (181/353)
2021-07-19T10:05:46.3709744Z remote: Compressing objects: 52% (184/353)
2021-07-19T10:05:46.3710573Z remote: Compressing objects: 53% (188/353)
2021-07-19T10:05:46.3711407Z remote: Compressing objects: 54% (191/353)
2021-07-19T10:05:46.3712341Z remote: Compressing objects: 55% (195/353)
2021-07-19T10:05:46.3713171Z remote: Compressing objects: 56% (198/353)
2021-07-19T10:05:46.3714006Z remote: Compressing objects: 57% (202/353)
2021-07-19T10:05:46.3714916Z remote: Compressing objects: 58% (205/353)
2021-07-19T10:05:46.3715769Z remote: Compressing objects: 59% (209/353)
2021-07-19T10:05:46.3716587Z remote: Compressing objects: 60% (212/353)
2021-07-19T10:05:46.3717413Z remote: Compressing objects: 61% (216/353)
2021-07-19T10:05:46.3718260Z remote: Compressing objects: 62% (219/353)
2021-07-19T10:05:46.3719081Z remote: Compressing objects: 63% (223/353)
2021-07-19T10:05:46.3719912Z remote: Compressing objects: 64% (226/353)
2021-07-19T10:05:46.3720727Z remote: Compressing objects: 65% (230/353)
2021-07-19T10:05:46.3721561Z remote: Compressing objects: 66% (233/353)
2021-07-19T10:05:46.3722387Z remote: Compressing objects: 67% (237/353)
2021-07-19T10:05:46.3723197Z remote: Compressing objects: 68% (241/353)
2021-07-19T10:05:46.3724025Z remote: Compressing objects: 69% (244/353)
2021-07-19T10:05:46.3724842Z remote: Compressing objects: 70% (248/353)
2021-07-19T10:05:46.3725674Z remote: Compressing objects: 71% (251/353)
2021-07-19T10:05:46.3726504Z remote: Compressing objects: 72% (255/353)
2021-07-19T10:05:46.3727316Z remote: Compressing objects: 73% (258/353)
2021-07-19T10:05:46.3728144Z remote: Compressing objects: 74% (262/353)
2021-07-19T10:05:46.3728987Z remote: Compressing objects: 75% (265/353)
2021-07-19T10:05:46.3729799Z remote: Compressing objects: 76% (269/353)
2021-07-19T10:05:46.3730626Z remote: Compressing objects: 77% (272/353)
2021-07-19T10:05:46.3731447Z remote: Compressing objects: 78% (276/353)
2021-07-19T10:05:46.3732272Z remote: Compressing objects: 79% (279/353)
2021-07-19T10:05:46.3733104Z remote: Compressing objects: 80% (283/353)
2021-07-19T10:05:46.3733923Z remote: Compressing objects: 81% (286/353)
2021-07-19T10:05:46.3734756Z remote: Compressing objects: 82% (290/353)
2021-07-19T10:05:46.3735573Z remote: Compressing objects: 83% (293/353)
2021-07-19T10:05:46.3736405Z remote: Compressing objects: 84% (297/353)
2021-07-19T10:05:46.3737237Z remote: Compressing objects: 85% (301/353)
2021-07-19T10:05:46.3738050Z remote: Compressing objects: 86% (304/353)
2021-07-19T10:05:46.3738972Z remote: Compressing objects: 87% (308/353)
2021-07-19T10:05:46.3739817Z remote: Compressing objects: 88% (311/353)
2021-07-19T10:05:46.3740650Z remote: Compressing objects: 89% (315/353)
2021-07-19T10:05:46.3741462Z remote: Compressing objects: 90% (318/353)
2021-07-19T10:05:46.3742289Z remote: Compressing objects: 91% (322/353)
2021-07-19T10:05:46.3743118Z remote: Compressing objects: 92% (325/353)
2021-07-19T10:05:46.3743936Z remote: Compressing objects: 93% (329/353)
2021-07-19T10:05:46.3744856Z remote: Compressing objects: 94% (332/353)
2021-07-19T10:05:46.3745623Z remote: Compressing objects: 95% (336/353)
2021-07-19T10:05:46.3746398Z remote: Compressing objects: 96% (339/353)
2021-07-19T10:05:46.3747164Z remote: Compressing objects: 97% (343/353)
2021-07-19T10:05:46.3747910Z remote: Compressing objects: 98% (346/353)
2021-07-19T10:05:46.3748682Z remote: Compressing objects: 99% (350/353)
2021-07-19T10:05:46.3749443Z remote: Compressing objects: 100% (353/353)
2021-07-19T10:05:46.3750233Z remote: Compressing objects: 100% (353/353), done.
2021-07-19T10:05:46.3750976Z Receiving objects: 0% (1/486)
2021-07-19T10:05:46.3751634Z Receiving objects: 1% (5/486)
2021-07-19T10:05:46.3752500Z Receiving objects: 2% (10/486)
2021-07-19T10:05:46.3753171Z Receiving objects: 3% (15/486)
2021-07-19T10:05:46.3753846Z Receiving objects: 4% (20/486)
2021-07-19T10:05:46.3754526Z Receiving objects: 5% (25/486)
2021-07-19T10:05:46.3755186Z Receiving objects: 6% (30/486)
2021-07-19T10:05:46.3755860Z Receiving objects: 7% (35/486)
2021-07-19T10:05:46.3756609Z Receiving objects: 8% (39/486)
2021-07-19T10:05:46.3757301Z Receiving objects: 9% (44/486)
2021-07-19T10:05:46.3757978Z Receiving objects: 10% (49/486)
2021-07-19T10:05:46.3758635Z Receiving objects: 11% (54/486)
2021-07-19T10:05:46.3759311Z Receiving objects: 12% (59/486)
2021-07-19T10:05:46.3759975Z Receiving objects: 13% (64/486)
2021-07-19T10:05:46.3760651Z Receiving objects: 14% (69/486)
2021-07-19T10:05:46.3761330Z Receiving objects: 15% (73/486)
2021-07-19T10:05:46.3761988Z Receiving objects: 16% (78/486)
2021-07-19T10:05:46.3762666Z Receiving objects: 17% (83/486)
2021-07-19T10:05:46.3763333Z Receiving objects: 18% (88/486)
2021-07-19T10:05:46.3764009Z Receiving objects: 19% (93/486)
2021-07-19T10:05:46.3764686Z Receiving objects: 20% (98/486)
2021-07-19T10:05:46.3765349Z Receiving objects: 21% (103/486)
2021-07-19T10:05:46.3766021Z Receiving objects: 22% (107/486)
2021-07-19T10:05:46.3766682Z Receiving objects: 23% (112/486)
2021-07-19T10:05:46.3767368Z Receiving objects: 24% (117/486)
2021-07-19T10:05:46.3768040Z Receiving objects: 25% (122/486)
2021-07-19T10:05:46.3768694Z Receiving objects: 26% (127/486)
2021-07-19T10:05:46.3769372Z Receiving objects: 27% (132/486)
2021-07-19T10:05:46.3770208Z Receiving objects: 28% (137/486)
2021-07-19T10:05:46.3770966Z Receiving objects: 29% (141/486)
2021-07-19T10:05:46.3771700Z Receiving objects: 30% (146/486)
2021-07-19T10:05:46.3772405Z Receiving objects: 31% (151/486)
2021-07-19T10:05:46.3773124Z Receiving objects: 32% (156/486)
2021-07-19T10:05:46.3773832Z Receiving objects: 33% (161/486)
2021-07-19T10:05:46.3774561Z Receiving objects: 34% (166/486)
2021-07-19T10:05:46.3775279Z Receiving objects: 35% (171/486)
2021-07-19T10:05:46.3775991Z Receiving objects: 36% (175/486)
2021-07-19T10:05:46.3776712Z Receiving objects: 37% (180/486)
2021-07-19T10:05:46.3777417Z Receiving objects: 38% (185/486)
2021-07-19T10:05:46.3778142Z Receiving objects: 39% (190/486)
2021-07-19T10:05:46.3778860Z Receiving objects: 40% (195/486)
2021-07-19T10:05:46.3779572Z Receiving objects: 41% (200/486)
2021-07-19T10:05:46.3780295Z Receiving objects: 42% (205/486)
2021-07-19T10:05:46.3781000Z Receiving objects: 43% (209/486)
2021-07-19T10:05:46.3781725Z Receiving objects: 44% (214/486)
2021-07-19T10:05:46.3782451Z Receiving objects: 45% (219/486)
2021-07-19T10:05:46.3783265Z Receiving objects: 46% (224/486)
2021-07-19T10:05:46.3783988Z Receiving objects: 47% (229/486)
2021-07-19T10:05:46.3784696Z Receiving objects: 48% (234/486)
2021-07-19T10:05:46.3785420Z Receiving objects: 49% (239/486)
2021-07-19T10:05:46.3786139Z Receiving objects: 50% (243/486)
2021-07-19T10:05:46.3786849Z Receiving objects: 51% (248/486)
2021-07-19T10:05:46.3787568Z Receiving objects: 52% (253/486)
2021-07-19T10:05:46.3788277Z Receiving objects: 53% (258/486)
2021-07-19T10:05:46.3789007Z Receiving objects: 54% (263/486)
2021-07-19T10:05:46.3789728Z Receiving objects: 55% (268/486)
2021-07-19T10:05:46.3790433Z Receiving objects: 56% (273/486)
2021-07-19T10:05:46.3791274Z Receiving objects: 57% (278/486)
2021-07-19T10:05:46.3792016Z Receiving objects: 58% (282/486)
2021-07-19T10:05:46.3792693Z Receiving objects: 59% (287/486)
2021-07-19T10:05:46.3793372Z Receiving objects: 60% (292/486)
2021-07-19T10:05:46.3794035Z Receiving objects: 61% (297/486)
2021-07-19T10:05:46.3794712Z Receiving objects: 62% (302/486)
2021-07-19T10:05:46.3795387Z Receiving objects: 63% (307/486)
2021-07-19T10:05:46.3796060Z Receiving objects: 64% (312/486)
2021-07-19T10:05:46.3796733Z Receiving objects: 65% (316/486)
2021-07-19T10:05:46.3797399Z Receiving objects: 66% (321/486)
2021-07-19T10:05:46.3798071Z Receiving objects: 67% (326/486)
2021-07-19T10:05:46.3798734Z Receiving objects: 68% (331/486)
2021-07-19T10:05:46.3799413Z Receiving objects: 69% (336/486)
2021-07-19T10:05:46.3800081Z Receiving objects: 70% (341/486)
2021-07-19T10:05:46.3800742Z Receiving objects: 71% (346/486)
2021-07-19T10:05:46.3801417Z Receiving objects: 72% (350/486)
2021-07-19T10:05:46.3802165Z Receiving objects: 73% (355/486)
2021-07-19T10:05:46.3802860Z Receiving objects: 74% (360/486)
2021-07-19T10:05:46.3803542Z Receiving objects: 75% (365/486)
2021-07-19T10:05:46.3804208Z Receiving objects: 76% (370/486)
2021-07-19T10:05:46.3804886Z Receiving objects: 77% (375/486)
2021-07-19T10:05:46.3805548Z Receiving objects: 78% (380/486)
2021-07-19T10:05:46.3806438Z Receiving objects: 79% (384/486)
2021-07-19T10:05:46.3807158Z Receiving objects: 80% (389/486)
2021-07-19T10:05:46.3807869Z Receiving objects: 81% (394/486)
2021-07-19T10:05:46.3808585Z Receiving objects: 82% (399/486)
2021-07-19T10:05:46.3809290Z Receiving objects: 83% (404/486)
2021-07-19T10:05:46.3810015Z Receiving objects: 84% (409/486)
2021-07-19T10:05:46.3810733Z Receiving objects: 85% (414/486)
2021-07-19T10:05:46.3811439Z Receiving objects: 86% (418/486)
2021-07-19T10:05:46.3812161Z Receiving objects: 87% (423/486)
2021-07-19T10:05:46.3812866Z Receiving objects: 88% (428/486)
2021-07-19T10:05:46.3813596Z Receiving objects: 89% (433/486)
2021-07-19T10:05:46.3814324Z Receiving objects: 90% (438/486)
2021-07-19T10:05:46.3815032Z Receiving objects: 91% (443/486)
2021-07-19T10:05:46.3815749Z Receiving objects: 92% (448/486)
2021-07-19T10:05:46.3816459Z Receiving objects: 93% (452/486)
2021-07-19T10:05:46.3817183Z Receiving objects: 94% (457/486)
2021-07-19T10:05:46.3817914Z Receiving objects: 95% (462/486)
2021-07-19T10:05:46.3818628Z Receiving objects: 96% (467/486)
2021-07-19T10:05:46.3819433Z Receiving objects: 97% (472/486)
2021-07-19T10:05:46.3820630Z remote: Total 486 (delta 154), reused 304 (delta 87), pack-reused 0
2021-07-19T10:05:46.3821442Z Receiving objects: 98% (477/486)
2021-07-19T10:05:46.3822120Z Receiving objects: 99% (482/486)
2021-07-19T10:05:46.3822782Z Receiving objects: 100% (486/486)
2021-07-19T10:05:46.3823524Z Receiving objects: 100% (486/486), 349.02 KiB | 5.29 MiB/s, done.
2021-07-19T10:05:46.3824238Z Resolving deltas: 0% (0/154)
2021-07-19T10:05:46.3824894Z Resolving deltas: 1% (2/154)
2021-07-19T10:05:46.3825564Z Resolving deltas: 2% (4/154)
2021-07-19T10:05:46.3826208Z Resolving deltas: 3% (5/154)
2021-07-19T10:05:46.3826866Z Resolving deltas: 4% (7/154)
2021-07-19T10:05:46.3827511Z Resolving deltas: 5% (8/154)
2021-07-19T10:05:46.3828179Z Resolving deltas: 6% (10/154)
2021-07-19T10:05:46.3828837Z Resolving deltas: 7% (11/154)
2021-07-19T10:05:46.3829609Z Resolving deltas: 8% (13/154)
2021-07-19T10:05:46.3830272Z Resolving deltas: 9% (14/154)
2021-07-19T10:05:46.3830924Z Resolving deltas: 10% (16/154)
2021-07-19T10:05:46.3831588Z Resolving deltas: 11% (17/154)
2021-07-19T10:05:46.3832394Z Resolving deltas: 12% (19/154)
2021-07-19T10:05:46.3833043Z Resolving deltas: 13% (21/154)
2021-07-19T10:05:46.3833704Z Resolving deltas: 14% (22/154)
2021-07-19T10:05:46.3834350Z Resolving deltas: 15% (24/154)
2021-07-19T10:05:46.3835007Z Resolving deltas: 16% (25/154)
2021-07-19T10:05:46.3835667Z Resolving deltas: 17% (27/154)
2021-07-19T10:05:46.3836313Z Resolving deltas: 18% (28/154)
2021-07-19T10:05:46.3836984Z Resolving deltas: 19% (30/154)
2021-07-19T10:05:46.3837631Z Resolving deltas: 20% (31/154)
2021-07-19T10:05:46.3838286Z Resolving deltas: 21% (33/154)
2021-07-19T10:05:46.3838946Z Resolving deltas: 22% (34/154)
2021-07-19T10:05:46.3839590Z Resolving deltas: 23% (36/154)
2021-07-19T10:05:46.3840252Z Resolving deltas: 24% (37/154)
2021-07-19T10:05:46.3840898Z Resolving deltas: 25% (39/154)
2021-07-19T10:05:46.3841559Z Resolving deltas: 26% (41/154)
2021-07-19T10:05:46.3842216Z Resolving deltas: 27% (42/154)
2021-07-19T10:05:46.3842857Z Resolving deltas: 28% (44/154)
2021-07-19T10:05:46.3843514Z Resolving deltas: 29% (45/154)
2021-07-19T10:05:46.3844160Z Resolving deltas: 30% (47/154)
2021-07-19T10:05:46.3844822Z Resolving deltas: 31% (48/154)
2021-07-19T10:05:46.3845486Z Resolving deltas: 32% (50/154)
2021-07-19T10:05:46.3846127Z Resolving deltas: 33% (51/154)
2021-07-19T10:05:46.3846787Z Resolving deltas: 34% (53/154)
2021-07-19T10:05:46.3847527Z Resolving deltas: 35% (54/154)
2021-07-19T10:05:46.3848206Z Resolving deltas: 36% (56/154)
2021-07-19T10:05:46.3848867Z Resolving deltas: 37% (57/154)
2021-07-19T10:05:46.3849514Z Resolving deltas: 38% (59/154)
2021-07-19T10:05:46.3850171Z Resolving deltas: 39% (61/154)
2021-07-19T10:05:46.3850815Z Resolving deltas: 40% (62/154)
2021-07-19T10:05:46.3851484Z Resolving deltas: 41% (64/154)
2021-07-19T10:05:46.3852141Z Resolving deltas: 42% (65/154)
2021-07-19T10:05:46.3852783Z Resolving deltas: 43% (67/154)
2021-07-19T10:05:46.3853441Z Resolving deltas: 44% (68/154)
2021-07-19T10:05:46.3854080Z Resolving deltas: 45% (70/154)
2021-07-19T10:05:46.3854734Z Resolving deltas: 46% (71/154)
2021-07-19T10:05:46.3855395Z Resolving deltas: 47% (73/154)
2021-07-19T10:05:46.3856034Z Resolving deltas: 48% (74/154)
2021-07-19T10:05:46.3856691Z Resolving deltas: 49% (76/154)
2021-07-19T10:05:46.3857341Z Resolving deltas: 50% (77/154)
2021-07-19T10:05:46.3857998Z Resolving deltas: 51% (79/154)
2021-07-19T10:05:46.3858663Z Resolving deltas: 52% (81/154)
2021-07-19T10:05:46.3859309Z Resolving deltas: 53% (82/154)
2021-07-19T10:05:46.3859967Z Resolving deltas: 54% (84/154)
2021-07-19T10:05:46.3860607Z Resolving deltas: 55% (85/154)
2021-07-19T10:05:46.3861269Z Resolving deltas: 56% (87/154)
2021-07-19T10:05:46.3862111Z Resolving deltas: 57% (88/154)
2021-07-19T10:05:46.3862843Z Resolving deltas: 58% (90/154)
2021-07-19T10:05:46.3863548Z Resolving deltas: 59% (91/154)
2021-07-19T10:05:46.3864237Z Resolving deltas: 60% (93/154)
2021-07-19T10:05:46.3864936Z Resolving deltas: 61% (94/154)
2021-07-19T10:05:46.3865640Z Resolving deltas: 62% (96/154)
2021-07-19T10:05:46.3866337Z Resolving deltas: 63% (98/154)
2021-07-19T10:05:46.3867045Z Resolving deltas: 64% (99/154)
2021-07-19T10:05:46.3867741Z Resolving deltas: 65% (101/154)
2021-07-19T10:05:46.3868464Z Resolving deltas: 66% (102/154)
2021-07-19T10:05:46.3869171Z Resolving deltas: 67% (104/154)
2021-07-19T10:05:46.3869866Z Resolving deltas: 68% (105/154)
2021-07-19T10:05:46.3870614Z Resolving deltas: 69% (107/154)
2021-07-19T10:05:46.3871311Z Resolving deltas: 70% (108/154)
2021-07-19T10:05:46.3936352Z Resolving deltas: 71% (110/154)
2021-07-19T10:05:46.3937402Z Resolving deltas: 72% (111/154)
2021-07-19T10:05:46.3938182Z Resolving deltas: 73% (113/154)
2021-07-19T10:05:46.3938915Z Resolving deltas: 74% (114/154)
2021-07-19T10:05:46.3939854Z Resolving deltas: 75% (116/154)
2021-07-19T10:05:46.3940551Z Resolving deltas: 76% (118/154)
2021-07-19T10:05:46.3941278Z Resolving deltas: 77% (119/154)
2021-07-19T10:05:46.3941973Z Resolving deltas: 78% (121/154)
2021-07-19T10:05:46.3942683Z Resolving deltas: 79% (122/154)
2021-07-19T10:05:46.3943405Z Resolving deltas: 80% (124/154)
2021-07-19T10:05:46.3944102Z Resolving deltas: 81% (125/154)
2021-07-19T10:05:46.3944810Z Resolving deltas: 82% (127/154)
2021-07-19T10:05:46.3945512Z Resolving deltas: 83% (128/154)
2021-07-19T10:05:46.3946226Z Resolving deltas: 84% (130/154)
2021-07-19T10:05:46.3946954Z Resolving deltas: 85% (131/154)
2021-07-19T10:05:46.3947653Z Resolving deltas: 86% (133/154)
2021-07-19T10:05:46.3948360Z Resolving deltas: 87% (134/154)
2021-07-19T10:05:46.3949051Z Resolving deltas: 88% (136/154)
2021-07-19T10:05:46.3949765Z Resolving deltas: 89% (138/154)
2021-07-19T10:05:46.3950477Z Resolving deltas: 90% (139/154)
2021-07-19T10:05:46.3951183Z Resolving deltas: 91% (141/154)
2021-07-19T10:05:46.3952033Z Resolving deltas: 92% (142/154)
2021-07-19T10:05:46.3952740Z Resolving deltas: 93% (144/154)
2021-07-19T10:05:46.3953452Z Resolving deltas: 94% (145/154)
2021-07-19T10:05:46.3954174Z Resolving deltas: 95% (147/154)
2021-07-19T10:05:46.3954873Z Resolving deltas: 96% (148/154)
2021-07-19T10:05:46.3955585Z Resolving deltas: 97% (150/154)
2021-07-19T10:05:46.3956282Z Resolving deltas: 98% (151/154)
2021-07-19T10:05:46.3956995Z Resolving deltas: 99% (153/154)
2021-07-19T10:05:46.3957705Z Resolving deltas: 100% (154/154)
2021-07-19T10:05:46.3958869Z Resolving deltas: 100% (154/154), done.
2021-07-19T10:05:46.3960575Z From https://github.com/submariner-io/submariner-operator
2021-07-19T10:05:46.3972452Z * [new ref] 0105e4d08ef7236073547f1383566fc76c548f6d -> origin/devel
2021-07-19T10:05:46.3973514Z ##[endgroup]
2021-07-19T10:05:46.3974515Z ##[group]Determining the checkout info
2021-07-19T10:05:46.3975312Z ##[endgroup]
2021-07-19T10:05:46.3976226Z ##[group]Checking out the ref
2021-07-19T10:05:46.3977622Z [command]/usr/bin/git checkout --progress --force -B devel refs/remotes/origin/devel
2021-07-19T10:05:46.3978806Z Switched to a new branch 'devel'
2021-07-19T10:05:46.3979922Z Branch 'devel' set up to track remote branch 'devel' from 'origin'.
2021-07-19T10:05:46.3980758Z ##[endgroup]
2021-07-19T10:05:46.3981674Z [command]/usr/bin/git log -1 --format='%H'
2021-07-19T10:05:46.3982731Z '0105e4d08ef7236073547f1383566fc76c548f6d'
2021-07-19T10:05:46.4082152Z ##[group]Run submariner-io/shipyard/gh-actions/upgrade-e2e@devel
2021-07-19T10:05:46.4082967Z ##[endgroup]
2021-07-19T10:05:46.4297411Z ##[group]Reclaiming free space
2021-07-19T10:06:00.9288860Z Filesystem Size Used Avail Use% Mounted on
2021-07-19T10:06:00.9291944Z /dev/root 84G 42G 43G 50% /
2021-07-19T10:06:00.9293581Z devtmpfs 3.4G 0 3.4G 0% /dev
2021-07-19T10:06:00.9295268Z tmpfs 3.4G 12K 3.4G 1% /dev/shm
2021-07-19T10:06:00.9296798Z tmpfs 696M 1.1M 695M 1% /run
2021-07-19T10:06:00.9298178Z tmpfs 5.0M 0 5.0M 0% /run/lock
2021-07-19T10:06:00.9299561Z tmpfs 3.4G 0 3.4G 0% /sys/fs/cgroup
2021-07-19T10:06:00.9300869Z /dev/loop0 56M 56M 0 100% /snap/core18/2074
2021-07-19T10:06:00.9302127Z /dev/loop2 33M 33M 0 100% /snap/snapd/12159
2021-07-19T10:06:00.9303576Z /dev/loop1 33M 33M 0 100% /snap/snapd/12398
2021-07-19T10:06:00.9304888Z /dev/loop3 68M 68M 0 100% /snap/lxd/20326
2021-07-19T10:06:00.9306349Z /dev/loop4 56M 56M 0 100% /snap/core18/2066
2021-07-19T10:06:00.9307222Z /dev/sda15 105M 7.9M 97M 8% /boot/efi
2021-07-19T10:06:00.9308287Z /dev/sdb1 14G 4.1G 9.0G 32% /mnt
2021-07-19T10:06:00.9309952Z ##[endgroup]
2021-07-19T10:06:00.9475782Z ##[group]Disable swap
2021-07-19T10:06:00.9855055Z ##[endgroup]
2021-07-19T10:06:01.0006140Z ##[group]Report available RAM
2021-07-19T10:06:01.0034049Z total used free shared buff/cache available
2021-07-19T10:06:01.0035100Z Mem: 6.8Gi 470Mi 5.2Gi 7.0Mi 1.1Gi 6.0Gi
2021-07-19T10:06:01.0035615Z Swap: 0B 0B 0B
2021-07-19T10:06:01.0036228Z ##[endgroup]
2021-07-19T10:06:01.0202908Z Downloading Makefile.dapper
2021-07-19T10:06:01.0673819Z Downloading dapper
2021-07-19T10:06:01.2650065Z .dapper.tmp version v0.5.6
2021-07-19T10:06:01.2682202Z Downloading Dockerfile.dapper
2021-07-19T10:06:01.3076773Z docker network create -d bridge kind
2021-07-19T10:06:01.6424532Z dc2738306981c976cf6a4417a781caadda53ada3ae9c129c99901e03a87080aa
2021-07-19T10:06:01.6445891Z ./.dapper -m bind make --debug=b upgrade-e2e
2021-07-19T10:06:01.8720197Z Sending build context to Docker daemon 7.517MB
2021-07-19T10:06:01.8721679Z
2021-07-19T10:06:01.8805095Z Step 1/8 : ARG BASE_BRANCH
2021-07-19T10:06:01.8806659Z Step 2/8 : FROM quay.io/submariner/shipyard-dapper-base:${BASE_BRANCH}
2021-07-19T10:06:02.2040171Z devel: Pulling from submariner/shipyard-dapper-base
2021-07-19T10:06:02.2042475Z b1495d80d526: Pulling fs layer
2021-07-19T10:06:02.2074796Z fb3037ce215d: Pulling fs layer
2021-07-19T10:06:02.2076791Z 95344349df1d: Pulling fs layer
2021-07-19T10:06:02.2078051Z a3e11b0fdbf6: Pulling fs layer
2021-07-19T10:06:02.2078962Z b2d0ef6cbe4f: Pulling fs layer
2021-07-19T10:06:02.2079710Z fa188fe30729: Pulling fs layer
2021-07-19T10:06:02.2080461Z 05ca4b0545ef: Pulling fs layer
2021-07-19T10:06:02.2081249Z b17ce80b21da: Pulling fs layer
2021-07-19T10:06:02.2082004Z a3e11b0fdbf6: Waiting
2021-07-19T10:06:02.2082636Z b2d0ef6cbe4f: Waiting
2021-07-19T10:06:02.2083319Z fa188fe30729: Waiting
2021-07-19T10:06:02.2084113Z 05ca4b0545ef: Waiting
2021-07-19T10:06:02.2084743Z b17ce80b21da: Waiting
2021-07-19T10:06:02.7902995Z 95344349df1d: Verifying Checksum
2021-07-19T10:06:02.7904584Z 95344349df1d: Download complete
2021-07-19T10:06:02.9553663Z b1495d80d526: Verifying Checksum
2021-07-19T10:06:02.9554397Z b1495d80d526: Download complete
2021-07-19T10:06:02.9685537Z a3e11b0fdbf6: Verifying Checksum
2021-07-19T10:06:02.9690744Z a3e11b0fdbf6: Download complete
2021-07-19T10:06:03.1019482Z b2d0ef6cbe4f: Verifying Checksum
2021-07-19T10:06:03.1021061Z b2d0ef6cbe4f: Download complete
2021-07-19T10:06:03.1123245Z fa188fe30729: Verifying Checksum
2021-07-19T10:06:03.1124203Z fa188fe30729: Download complete
2021-07-19T10:06:04.1389715Z b17ce80b21da: Verifying Checksum
2021-07-19T10:06:04.1391285Z b17ce80b21da: Download complete
2021-07-19T10:06:04.1392882Z 05ca4b0545ef: Verifying Checksum
2021-07-19T10:06:04.1393750Z 05ca4b0545ef: Download complete
2021-07-19T10:06:05.0809450Z fb3037ce215d: Verifying Checksum
2021-07-19T10:06:05.0810306Z fb3037ce215d: Download complete
2021-07-19T10:06:06.6529951Z b1495d80d526: Pull complete
2021-07-19T10:06:16.4540067Z fb3037ce215d: Pull complete
2021-07-19T10:06:17.8620510Z 95344349df1d: Pull complete
2021-07-19T10:06:17.9296322Z a3e11b0fdbf6: Pull complete
2021-07-19T10:06:17.9995566Z b2d0ef6cbe4f: Pull complete
2021-07-19T10:06:18.1614365Z fa188fe30729: Pull complete
2021-07-19T10:06:18.2290848Z 05ca4b0545ef: Pull complete
2021-07-19T10:06:18.3122362Z b17ce80b21da: Pull complete
2021-07-19T10:06:18.3176700Z Digest: sha256:29762595cdd1efd22ed179cd45188c3fef4adc232f27415f2ad4f15e621053b8
2021-07-19T10:06:18.3189201Z Status: Downloaded newer image for quay.io/submariner/shipyard-dapper-base:devel
2021-07-19T10:06:18.3206104Z ---> 92b726655a41
2021-07-19T10:06:18.3206602Z Step 3/8 : ARG PROJECT
2021-07-19T10:06:18.3392016Z ---> Running in 1ab2010d80e3
2021-07-19T10:06:19.3015369Z Removing intermediate container 1ab2010d80e3
2021-07-19T10:06:19.3016532Z ---> a59665531ad2
2021-07-19T10:06:19.3018165Z Step 4/8 : ENV DAPPER_ENV="QUAY_USERNAME QUAY_PASSWORD CLUSTERS_ARGS DEPLOY_ARGS CLEANUP_ARGS E2E_ARGS RELEASE_ARGS MAKEFLAGS FOCUS SKIP PLUGIN E2E_TESTDIR" DAPPER_SOURCE=/go/src/github.com/submariner-io/${PROJECT} DAPPER_DOCKER_SOCKET=true
2021-07-19T10:06:19.3238374Z ---> Running in 4a3000aa7e16
2021-07-19T10:06:20.2699658Z Removing intermediate container 4a3000aa7e16
2021-07-19T10:06:20.2702713Z ---> 24e98fa057a3
2021-07-19T10:06:20.2703348Z Step 5/8 : ENV DAPPER_OUTPUT=${DAPPER_SOURCE}/output
2021-07-19T10:06:20.2877230Z ---> Running in 4f7cbb2dfc83
2021-07-19T10:06:21.2080684Z Removing intermediate container 4f7cbb2dfc83
2021-07-19T10:06:21.2082416Z ---> 06b5c4e30824
2021-07-19T10:06:21.2083085Z Step 6/8 : WORKDIR ${DAPPER_SOURCE}
2021-07-19T10:06:21.2262986Z ---> Running in b01e64b9cfef
2021-07-19T10:06:22.1812737Z Removing intermediate container b01e64b9cfef
2021-07-19T10:06:22.1813884Z ---> e5a08d6565aa
2021-07-19T10:06:22.1814423Z Step 7/8 : ENTRYPOINT ["/opt/shipyard/scripts/entry"]
2021-07-19T10:06:22.2001921Z ---> Running in 9c5ae2ce985e
2021-07-19T10:06:23.1465583Z Removing intermediate container 9c5ae2ce985e
2021-07-19T10:06:23.1466796Z ---> 0432dd4d95ac
2021-07-19T10:06:23.1467210Z Step 8/8 : CMD ["sh"]
2021-07-19T10:06:23.1676246Z ---> Running in b8d88bfbefb5
2021-07-19T10:06:24.1109015Z Removing intermediate container b8d88bfbefb5
2021-07-19T10:06:24.1110245Z ---> 62a978793c54
2021-07-19T10:06:24.1245058Z Successfully built 62a978793c54
2021-07-19T10:06:24.1292642Z Successfully tagged submariner-operator:devel
2021-07-19T10:06:24.6238673Z [submariner-operator]$ trap chown -R 1001:121 . exit
2021-07-19T10:06:24.6251637Z [submariner-operator]$ mkdir -p bin dist output
2021-07-19T10:06:24.6284843Z [submariner-operator]$ make --debug=b upgrade-e2e
2021-07-19T10:06:24.6289520Z GNU Make 4.3
2021-07-19T10:06:24.6292281Z Built for x86_64-redhat-linux-gnu
2021-07-19T10:06:24.6299965Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-19T10:06:24.6300955Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-19T10:06:24.6301903Z This is free software: you are free to change and redistribute it.
2021-07-19T10:06:24.6302934Z There is NO WARRANTY, to the extent permitted by law.
2021-07-19T10:06:24.6303674Z Reading makefiles...
2021-07-19T10:06:24.7559832Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-19T10:06:24.7561327Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-19T10:06:24.9928590Z Updating makefiles....
2021-07-19T10:06:24.9937374Z Updating goal targets....
2021-07-19T10:06:24.9938609Z File 'upgrade-e2e' does not exist.
2021-07-19T10:06:24.9940410Z File 'deploy-latest' does not exist.
2021-07-19T10:06:24.9941884Z Must remake target 'deploy-latest'.
2021-07-19T10:06:24.9942895Z curl -L get.submariner.io | VERSION=latest bash
2021-07-19T10:06:25.0049906Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-19T10:06:25.0054497Z Dload Upload Total Spent Left Speed
2021-07-19T10:06:25.0054962Z
2021-07-19T10:06:25.0429954Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-19T10:06:25.0431022Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-19T10:06:25.1059873Z
2021-07-19T10:06:25.1095362Z 100 4155 0 4155 0 0 40339 0 --:--:-- --:--:-- --:--:-- 40339
2021-07-19T10:06:25.2268607Z Installing subctl version latest
2021-07-19T10:06:25.2273189Z OS detected: linux
2021-07-19T10:06:25.2274200Z Architecture detected: amd64
2021-07-19T10:06:25.2277126Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-19T10:06:25.2278709Z
2021-07-19T10:06:25.2279406Z Downloading...
2021-07-19T10:06:26.3741941Z subctl-v0.9.1-linux-amd64 has been installed as /root/.local/bin/subctl
2021-07-19T10:06:26.4108565Z This provides subctl version: v0.9.1
2021-07-19T10:06:26.4129816Z
2021-07-19T10:06:26.4130551Z please update your path (and consider adding it to ~/.profile):
2021-07-19T10:06:26.4131231Z export PATH=$PATH:/root/.local/bin
2021-07-19T10:06:26.4131682Z
2021-07-19T10:06:26.4214103Z make -o images -o preload-images deploy SUBCTL=~/.local/bin/subctl DEV_VERSION=latest CUTTING_EDGE=latest VERSION=latest DEPLOY_ARGS="--cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl" using=
2021-07-19T10:06:26.4248180Z GNU Make 4.3
2021-07-19T10:06:26.4249050Z Built for x86_64-redhat-linux-gnu
2021-07-19T10:06:26.4249900Z Copyright (C) 1988-2020 Free Software Foundation, Inc.
2021-07-19T10:06:26.4250776Z License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
2021-07-19T10:06:26.4251649Z This is free software: you are free to change and redistribute it.
2021-07-19T10:06:26.4252418Z There is NO WARRANTY, to the extent permitted by law.
2021-07-19T10:06:26.4253016Z Reading makefiles...
2021-07-19T10:06:26.4254043Z make[1]: Entering directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-19T10:06:26.5538435Z Makefile:94: warning: overriding recipe for target 'e2e'
2021-07-19T10:06:26.5539923Z /opt/shipyard/Makefile.inc:106: warning: ignoring old recipe for target 'e2e'
2021-07-19T10:06:26.7920242Z Updating makefiles....
2021-07-19T10:06:26.7926881Z Updating goal targets....
2021-07-19T10:06:26.7928019Z File 'clusters' does not exist.
2021-07-19T10:06:26.7928714Z Must remake target 'clusters'.
2021-07-19T10:06:26.7930082Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:06:26.7954694Z Downloading shflags 1.0.3
2021-07-19T10:06:26.8014176Z % Total % Received % Xferd Average Speed Time Time Time Current
2021-07-19T10:06:26.8014948Z Dload Upload Total Spent Left Speed
2021-07-19T10:06:26.8015349Z
2021-07-19T10:06:26.8341068Z 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0
2021-07-19T10:06:26.8342460Z 100 31091 100 31091 0 0 948k 0 --:--:-- --:--:-- --:--:-- 948k
2021-07-19T10:06:26.8990291Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-19T10:06:26.9012877Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T10:06:26.9025789Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:06:26.9038363Z [submariner-operator]$ script_name=utils
2021-07-19T10:06:26.9049621Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:06:26.9068850Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T10:06:26.9081213Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:06:26.9093529Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:06:26.9104430Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:06:26.9125175Z [submariner-operator]$ broker=cluster1
2021-07-19T10:06:26.9137478Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T10:06:26.9150395Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T10:06:26.9164153Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T10:06:26.9176755Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T10:06:26.9188751Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T10:06:26.9201472Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T10:06:26.9213813Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T10:06:26.9226099Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T10:06:26.9238660Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T10:06:26.9251231Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T10:06:26.9263646Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T10:06:26.9277785Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:06:26.9290837Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:06:26.9303696Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:06:26.9316630Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:06:26.9337990Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T10:06:26.9350956Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T10:06:26.9381266Z [submariner-operator]$ cat <<EOM
2021-07-19T10:06:26.9382661Z Cluster settings::
2021-07-19T10:06:26.9383258Z broker - ${broker@Q}
2021-07-19T10:06:26.9383841Z clusters - ${clusters[*]@Q}
2021-07-19T10:06:26.9384501Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-19T10:06:26.9385304Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-19T10:06:26.9386156Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-19T10:06:26.9386782Z EOM
2021-07-19T10:06:26.9407089Z [submariner-operator]$ typeset -p cluster_cni
2021-07-19T10:06:26.9420240Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:06:26.9448133Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-19T10:06:26.9462762Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:06:26.9492019Z [submariner-operator]$ typeset -p cluster_subm
2021-07-19T10:06:26.9505264Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:06:26.9525975Z Cluster settings::
2021-07-19T10:06:26.9526779Z broker - 'cluster1'
2021-07-19T10:06:26.9527455Z clusters - 'cluster1' 'cluster2'
2021-07-19T10:06:26.9528204Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-19T10:06:26.9529552Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-19T10:06:26.9530870Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-19T10:06:26.9548882Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T10:06:26.9569619Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T10:06:26.9593308Z [submariner-operator]$ run_local_registry
2021-07-19T10:06:26.9605533Z [submariner-operator]$ run_local_registry
2021-07-19T10:06:26.9617579Z [submariner-operator]$ registry_running
2021-07-19T10:06:26.9629356Z [submariner-operator]$ registry_running
2021-07-19T10:06:26.9641942Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-19T10:06:26.9656221Z [submariner-operator]$ grep kind-registry
2021-07-19T10:06:27.2490133Z [submariner-operator]$ return 0
2021-07-19T10:06:27.2492871Z Deploying local registry kind-registry to serve images centrally.
2021-07-19T10:06:27.2506269Z [submariner-operator]$ volume_flag=-v /dev/shm/kind-registry:/var/lib/registry
2021-07-19T10:06:27.2516218Z [submariner-operator]$ selinuxenabled
2021-07-19T10:06:27.2540621Z [submariner-operator]$ docker run -d -v /dev/shm/kind-registry:/var/lib/registry -p 127.0.0.1:5000:5000 --restart=always --name kind-registry registry:2
2021-07-19T10:06:27.5338737Z Unable to find image 'registry:2' locally
2021-07-19T10:06:27.7568037Z 2: Pulling from library/registry
2021-07-19T10:06:27.8423364Z ddad3d7c1e96: Already exists
2021-07-19T10:06:27.8445992Z 6eda6749503f: Pulling fs layer
2021-07-19T10:06:27.8447773Z 363ab70c2143: Pulling fs layer
2021-07-19T10:06:27.8448967Z 5b94580856e6: Pulling fs layer
2021-07-19T10:06:27.8454655Z 12008541203a: Pulling fs layer
2021-07-19T10:06:27.8455185Z 12008541203a: Waiting
2021-07-19T10:06:27.9190084Z 5b94580856e6: Verifying Checksum
2021-07-19T10:06:27.9191426Z 5b94580856e6: Download complete
2021-07-19T10:06:27.9448674Z 6eda6749503f: Verifying Checksum
2021-07-19T10:06:27.9449307Z 6eda6749503f: Download complete
2021-07-19T10:06:28.0059251Z 363ab70c2143: Verifying Checksum
2021-07-19T10:06:28.0059840Z 363ab70c2143: Download complete
2021-07-19T10:06:28.0192485Z 12008541203a: Verifying Checksum
2021-07-19T10:06:28.0193745Z 12008541203a: Download complete
2021-07-19T10:06:28.3275415Z 6eda6749503f: Pull complete
2021-07-19T10:06:28.6664505Z 363ab70c2143: Pull complete
2021-07-19T10:06:28.7358695Z 5b94580856e6: Pull complete
2021-07-19T10:06:28.8036102Z 12008541203a: Pull complete
2021-07-19T10:06:28.8086673Z Digest: sha256:aba2bfe9f0cff1ac0618ec4a54bfefb2e685bbac67c8ebaf3b6405929b3e616f
2021-07-19T10:06:28.8109266Z Status: Downloaded newer image for registry:2
2021-07-19T10:06:28.8300272Z 42ce52aeb99af89d321556182e4c83f10077d8b7ca23ae9cb01d4c2fca46a289
2021-07-19T10:06:29.1870640Z [submariner-operator]$ docker network connect kind kind-registry
2021-07-19T10:06:29.5752857Z [submariner-operator]$ declare_cidrs
2021-07-19T10:06:29.5765436Z [submariner-operator]$ declare_cidrs
2021-07-19T10:06:29.5780907Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T10:06:29.5781938Z [submariner-operator]$ i=1
2021-07-19T10:06:29.5800490Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:06:29.5810769Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:06:29.5821166Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-19T10:06:29.5831123Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-19T10:06:29.5836664Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T10:06:29.5862196Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:06:29.5863360Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:06:29.5867940Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-19T10:06:29.5872804Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-19T10:06:29.5887206Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T10:06:29.5894717Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T10:06:29.5905614Z [submariner-operator]$ [cluster2] wait 295
2021-07-19T10:06:29.5906847Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T10:06:29.5913891Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T10:06:29.5926079Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T10:06:29.5940010Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:06:29.5958411Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:06:29.5977263Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:06:29.5981968Z [submariner-operator]$ [cluster1] pids[cluster1]=304
2021-07-19T10:06:29.5990158Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-19T10:06:29.6003447Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:06:29.6004500Z [submariner-operator]$ [cluster2] pids[cluster2]=308
2021-07-19T10:06:29.6025909Z [submariner-operator]$ [cluster2] wait 308
2021-07-19T10:06:29.6032333Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:06:29.6045073Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-19T10:06:29.6069573Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:08:30.3771398Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T10:08:30.3772679Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:08:30.3773641Z [submariner-operator]$ [cluster2] wait 330
2021-07-19T10:08:30.3774616Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T10:08:30.3775782Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T10:08:30.3777442Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:08:30.3779628Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:08:30.3781130Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-19T10:08:30.3782229Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-19T10:08:30.3782944Z [cluster2] No kind clusters found.
2021-07-19T10:08:30.3783522Z [cluster2] Creating KIND cluster...
2021-07-19T10:08:30.3784462Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-19T10:08:30.3785519Z [submariner-operator]$ [cluster2] generate_cluster_yaml
2021-07-19T10:08:30.3786548Z [submariner-operator]$ [cluster2] disable_cni=true
2021-07-19T10:08:30.3787502Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T10:08:30.3788410Z [cluster2] - role: control-plane
2021-07-19T10:08:30.3789251Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T10:08:30.3790054Z [cluster2] - role: control-plane
2021-07-19T10:08:30.3790750Z [cluster2] - role: worker
2021-07-19T10:08:30.3791522Z [submariner-operator]$ [cluster2] nodes=
2021-07-19T10:08:30.3792736Z [cluster2] - role: control-plane
2021-07-19T10:08:30.3793404Z [cluster2] - role: worker
2021-07-19T10:08:30.3794044Z [cluster2] - role: worker
2021-07-19T10:08:30.3794628Z [cluster2] 
2021-07-19T10:08:30.3795181Z [cluster2] 
2021-07-19T10:08:30.3795989Z [submariner-operator]$ [cluster2] eval "echo \"$(cat $1)\""
2021-07-19T10:08:30.3797333Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-19T10:08:30.3798831Z [submariner-operator]$ [cluster2] image_flag=--image=kindest/node:v1.20.7
2021-07-19T10:08:30.3799892Z [submariner-operator]$ [cluster2] kind version
2021-07-19T10:08:30.3800592Z [cluster2] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T10:08:30.3801914Z [submariner-operator]$ [cluster2] cat /opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-19T10:08:30.3802926Z [cluster2] ---
2021-07-19T10:08:30.3803375Z [cluster2] kind: Cluster
2021-07-19T10:08:30.3804150Z [cluster2] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T10:08:30.3804770Z [cluster2] networking:
2021-07-19T10:08:30.3805360Z [cluster2] disableDefaultCNI: true
2021-07-19T10:08:30.3805973Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-19T10:08:30.3806521Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-19T10:08:30.3807223Z [cluster2] containerdConfigPatches:
2021-07-19T10:08:30.3807959Z [cluster2] - |-
2021-07-19T10:08:30.3808794Z [cluster2] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T10:08:30.3810021Z [cluster2] endpoint = ["http://kind-registry:5000"]
2021-07-19T10:08:30.3810826Z [cluster2] kubeadmConfigPatches:
2021-07-19T10:08:30.3811513Z [cluster2] - |
2021-07-19T10:08:30.3812104Z [cluster2] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T10:08:30.3812827Z [cluster2] kind: ClusterConfiguration
2021-07-19T10:08:30.3813438Z [cluster2] metadata:
2021-07-19T10:08:30.3813926Z [cluster2] name: config
2021-07-19T10:08:30.3814412Z [cluster2] networking:
2021-07-19T10:08:30.3814942Z [cluster2] podSubnet: 10.2.0.0/16
2021-07-19T10:08:30.3815497Z [cluster2] serviceSubnet: 100.2.0.0/16
2021-07-19T10:08:30.3816127Z [cluster2] dnsDomain: cluster2.local
2021-07-19T10:08:30.3816667Z [cluster2] nodes:
2021-07-19T10:08:30.3817345Z [cluster2] - role: control-plane
2021-07-19T10:08:30.3818264Z [cluster2] - role: worker
2021-07-19T10:08:30.3818890Z [cluster2] - role: worker
2021-07-19T10:08:30.3820324Z [submariner-operator]$ [cluster2] kind create cluster --image=kindest/node:v1.20.7 --name=cluster2 --config=/opt/shipyard/scripts/resources/cluster2-config.yaml
2021-07-19T10:08:30.3821542Z [cluster2] Creating cluster "cluster2" ...
2021-07-19T10:08:30.3823447Z [cluster2] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-19T10:08:30.3824455Z [cluster2] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-19T10:08:30.3825285Z [cluster2] • Preparing nodes 📦 📦 📦 ...
2021-07-19T10:08:30.3826015Z [cluster2] ✓ Preparing nodes 📦 📦 📦
2021-07-19T10:08:30.3826777Z [cluster2] • Writing configuration 📜 ...
2021-07-19T10:08:30.3827726Z [cluster2] ✓ Writing configuration 📜
2021-07-19T10:08:30.3828542Z [cluster2] • Starting control-plane 🕹️ ...
2021-07-19T10:08:30.3829337Z [cluster2] ✓ Starting control-plane 🕹️
2021-07-19T10:08:30.3830173Z [cluster2] • Installing StorageClass 💾 ...
2021-07-19T10:08:30.3839109Z [cluster2] ✓ Installing StorageClass 💾
2021-07-19T10:08:30.3840139Z [cluster2] • Joining worker nodes 🚜 ...
2021-07-19T10:08:30.3840879Z [cluster2] ✓ Joining worker nodes 🚜
2021-07-19T10:08:30.3841688Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-19T10:08:30.3843111Z [cluster2] You can now use your cluster with:
2021-07-19T10:08:30.3843875Z [cluster2]
2021-07-19T10:08:30.3845924Z [cluster2] kubectl cluster-info --context kind-cluster2
2021-07-19T10:08:30.3846807Z [cluster2]
2021-07-19T10:08:30.3849638Z [cluster2] Thanks for using kind! 😊
2021-07-19T10:08:30.3850731Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T10:08:30.3852083Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T10:08:30.3855543Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-19T10:08:30.3857125Z [submariner-operator]$ [cluster2] head -n 1
2021-07-19T10:08:34.8320041Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: h[submariner-operator]$ [cluster1] with_retries
2021-07-19T10:08:34.8321424Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T10:08:34.8322390Z [submariner-operator]$ [cluster1] wait 321
2021-07-19T10:08:34.8323455Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T10:08:34.8324727Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T10:08:34.8326404Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:08:34.8328502Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:08:34.8329987Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-19T10:08:34.8331013Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-19T10:08:34.8331734Z [cluster1] No kind clusters found.
2021-07-19T10:08:34.8332312Z [cluster1] Creating KIND cluster...
2021-07-19T10:08:34.8333247Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-19T10:08:34.8334299Z [submariner-operator]$ [cluster1] generate_cluster_yaml
2021-07-19T10:08:34.8335442Z [submariner-operator]$ [cluster1] disable_cni=true
2021-07-19T10:08:34.8336404Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T10:08:34.8337238Z [cluster1] - role: control-plane
2021-07-19T10:08:34.8338085Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T10:08:34.8338964Z [cluster1] - role: control-plane
2021-07-19T10:08:34.8339671Z [cluster1] - role: worker
2021-07-19T10:08:34.8340445Z [submariner-operator]$ [cluster1] nodes=
2021-07-19T10:08:34.8341361Z [cluster1] - role: control-plane
2021-07-19T10:08:34.8342026Z [cluster1] - role: worker
2021-07-19T10:08:34.8342842Z [cluster1] - role: worker
2021-07-19T10:08:34.8343425Z [cluster1] 
2021-07-19T10:08:34.8343979Z [cluster1] 
2021-07-19T10:08:34.8344869Z [submariner-operator]$ [cluster1] eval "echo \"$(cat $1)\""
2021-07-19T10:08:34.8346220Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/kind-cluster-config.yaml
2021-07-19T10:08:34.8347974Z [submariner-operator]$ [cluster1] image_flag=--image=kindest/node:v1.20.7
2021-07-19T10:08:34.8349130Z [submariner-operator]$ [cluster1] kind version
2021-07-19T10:08:34.8349832Z [cluster1] kind v0.11.1 go1.16.4 linux/amd64
2021-07-19T10:08:34.8351010Z [submariner-operator]$ [cluster1] cat /opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-19T10:08:34.8352113Z [cluster1] ---
2021-07-19T10:08:34.8352563Z [cluster1] kind: Cluster
2021-07-19T10:08:34.8353336Z [cluster1] apiVersion: kind.x-k8s.io/v1alpha4
2021-07-19T10:08:34.8353941Z [cluster1] networking:
2021-07-19T10:08:34.8354555Z [cluster1] disableDefaultCNI: true
2021-07-19T10:08:34.8355167Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-19T10:08:34.8355719Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-19T10:08:34.8356418Z [cluster1] containerdConfigPatches:
2021-07-19T10:08:34.8357153Z [cluster1] - |-
2021-07-19T10:08:34.8357994Z [cluster1] [plugins."io.containerd.grpc.v1.cri".registry.mirrors."localhost:5000"]
2021-07-19T10:08:34.8359226Z [cluster1] endpoint = ["http://kind-registry:5000"]
2021-07-19T10:08:34.8360026Z [cluster1] kubeadmConfigPatches:
2021-07-19T10:08:34.8360713Z [cluster1] - |
2021-07-19T10:08:34.8361296Z [cluster1] apiVersion: kubeadm.k8s.io/v1beta2
2021-07-19T10:08:34.8362020Z [cluster1] kind: ClusterConfiguration
2021-07-19T10:08:34.8362625Z [cluster1] metadata:
2021-07-19T10:08:34.8363103Z [cluster1] name: config
2021-07-19T10:08:34.8363604Z [cluster1] networking:
2021-07-19T10:08:34.8364135Z [cluster1] podSubnet: 10.1.0.0/16
2021-07-19T10:08:34.8364695Z [cluster1] serviceSubnet: 100.1.0.0/16
2021-07-19T10:08:34.8365332Z [cluster1] dnsDomain: cluster1.local
2021-07-19T10:08:34.8365867Z [cluster1] nodes:
2021-07-19T10:08:34.8366542Z [cluster1] - role: control-plane
2021-07-19T10:08:34.8367211Z [cluster1] - role: worker
2021-07-19T10:08:34.8367836Z [cluster1] - role: worker
2021-07-19T10:08:34.8369368Z [submariner-operator]$ [cluster1] kind create cluster --image=kindest/node:v1.20.7 --name=cluster1 --config=/opt/shipyard/scripts/resources/cluster1-config.yaml
2021-07-19T10:08:34.8370704Z [cluster1] Creating cluster "cluster1" ...
2021-07-19T10:08:34.8372052Z [cluster1] • Ensuring node image (kindest/node:v1.20.7) 🖼 ...
2021-07-19T10:08:34.8373023Z [cluster1] ✓ Ensuring node image (kindest/node:v1.20.7) 🖼
2021-07-19T10:08:34.8373948Z [cluster1] • Preparing nodes 📦 📦 📦 ...
2021-07-19T10:08:34.8374961Z [cluster1] ✓ Preparing nodes 📦 📦 📦
2021-07-19T10:08:34.8375753Z [cluster1] • Writing configuration 📜 ...
2021-07-19T10:08:34.8376676Z [cluster1] ✓ Writing configuration 📜
2021-07-19T10:08:34.8377499Z [cluster1] • Starting control-plane 🕹️ ...
2021-07-19T10:08:34.8378320Z [cluster1] ✓ Starting control-plane 🕹️
2021-07-19T10:08:34.8379132Z [cluster1] • Installing StorageClass 💾 ...
2021-07-19T10:08:34.8379954Z [cluster1] ✓ Installing StorageClass 💾
2021-07-19T10:08:34.8380725Z [cluster1] • Joining worker nodes 🚜 ...
2021-07-19T10:08:34.8381457Z [cluster1] ✓ Joining worker nodes 🚜
2021-07-19T10:08:34.8382289Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-19T10:08:34.8382972Z [cluster1] You can now use your cluster with:
2021-07-19T10:08:34.8383476Z [cluster1]
2021-07-19T10:08:34.8384349Z [cluster1] kubectl cluster-info --context kind-cluster1
2021-07-19T10:08:34.8384948Z [cluster1]
2021-07-19T10:08:34.8385553Z [cluster1] Have a nice day! 👋
2021-07-19T10:08:34.8386396Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T10:08:34.8387408Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T10:08:34.8389150Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-19T10:08:34.8390587Z [submariner-operator]$ [cluster1] head -n 1
2021-07-19T10:09:01.6817065Z [submariner-operator]$ [cluster2] wait 304
2021-07-19T10:09:01.6819241Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\ttps:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6822747Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6825338Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6827825Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6830438Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6833556Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:09:01.6835704Z [submariner-operator]$ [cluster2] wait 1549
2021-07-19T10:09:01.6836773Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-19T10:09:01.6837937Z [submariner-operator]$ [cluster2] deploy_cluster_capabilities
2021-07-19T10:09:01.6838971Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-19T10:09:01.6839931Z [submariner-operator]$ [cluster2] deploy_cni
2021-07-19T10:09:01.6841095Z [submariner-operator]$ [cluster2] eval deploy_weave_cni
2021-07-19T10:09:01.6842124Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-19T10:09:01.6843120Z [submariner-operator]$ [cluster2] deploy_weave_cni
2021-07-19T10:09:01.6843860Z [cluster2] Applying weave network...
2021-07-19T10:09:01.6845385Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-19T10:09:01.6847676Z [submariner-operator]$ [cluster2] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-19T10:09:01.6849778Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.2.0.0/16
2021-07-19T10:09:01.6851373Z [cluster2] serviceaccount/weave-net created
2021-07-19T10:09:01.6852616Z [cluster2] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:01.6854330Z [cluster2] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:01.6855904Z [cluster2] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:01.6857552Z [cluster2] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:01.6858749Z [cluster2] daemonset.apps/weave-net created
2021-07-19T10:09:01.6859653Z [cluster2] Waiting for weave-net pods to be ready...
2021-07-19T10:09:01.6861067Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:01.6862687Z [submariner-operator]$ [cluster2] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:01.6864428Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:01.6865742Z [cluster2] pod/weave-net-f84nt condition met
2021-07-19T10:09:01.6866795Z [cluster2] pod/weave-net-vgcnw condition met
2021-07-19T10:09:01.6867666Z [cluster2] pod/weave-net-zh6nd condition met
2021-07-19T10:09:01.6868667Z [cluster2] Waiting for core-dns deployment to be ready...
2021-07-19T10:09:01.6870032Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:01.6871620Z [submariner-operator]$ [cluster2] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:01.6878326Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:01.6879650Z [cluster2] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T10:09:01.6881076Z [cluster2] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T10:09:01.6882016Z [cluster2] deployment "coredns" successfully rolled out
2021-07-19T10:09:01.6883032Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:09:08.4684527Z /\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4686719Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4689079Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4707050Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T10:09:08.4708904Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4713432Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4715666Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:09:08.4717016Z [submariner-operator]$ [cluster1] wait 1652
2021-07-19T10:09:08.4718237Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-19T10:09:08.4719343Z [submariner-operator]$ [cluster1] deploy_cluster_capabilities
2021-07-19T10:09:08.4720317Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-19T10:09:08.4721185Z [submariner-operator]$ [cluster1] deploy_cni
2021-07-19T10:09:08.4722125Z [submariner-operator]$ [cluster1] eval deploy_weave_cni
2021-07-19T10:09:08.4723071Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-19T10:09:08.4724009Z [submariner-operator]$ [cluster1] deploy_weave_cni
2021-07-19T10:09:08.4724689Z [cluster1] Applying weave network...
2021-07-19T10:09:08.4726017Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-19T10:09:08.4727786Z [submariner-operator]$ [cluster1] kubectl apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-19T10:09:08.4729665Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f https://cloud.weave.works/k8s/net?k8s-version=v1.20.7&env.IPALLOC_RANGE=10.1.0.0/16
2021-07-19T10:09:08.4731018Z [cluster1] serviceaccount/weave-net created
2021-07-19T10:09:08.4732159Z [cluster1] clusterrole.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:08.4733755Z [cluster1] clusterrolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:08.4735184Z [cluster1] role.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:08.4736604Z [cluster1] rolebinding.rbac.authorization.k8s.io/weave-net created
2021-07-19T10:09:08.4737724Z [cluster1] daemonset.apps/weave-net created
2021-07-19T10:09:08.4738543Z [cluster1] Waiting for weave-net pods to be ready...
2021-07-19T10:09:08.4739753Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:08.4741242Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:08.4742856Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l name=weave-net -n kube-system --timeout=5m
2021-07-19T10:09:08.4744083Z [cluster1] pod/weave-net-9dppf condition met
2021-07-19T10:09:08.4744894Z [cluster1] pod/weave-net-n85lj condition met
2021-07-19T10:09:08.4745718Z [cluster1] pod/weave-net-pbvmd condition met
2021-07-19T10:09:08.4746563Z [cluster1] Waiting for core-dns deployment to be ready...
2021-07-19T10:09:08.4747757Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:08.4749089Z [submariner-operator]$ [cluster1] kubectl -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:08.4750562Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n kube-system rollout status deploy/coredns --timeout=5m
2021-07-19T10:09:08.4797635Z [cluster1] Waiting for deployment "coredns" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T10:09:08.4798833Z [cluster1] Waiting for deployment "coredns" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T10:09:08.4799790Z [cluster1] deployment "coredns" successfully rolled out
2021-07-19T10:09:08.4800948Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:09:08.4802029Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T10:09:08.4826875Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-19T10:09:08.4827782Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T10:09:08.4828422Z
2021-07-19T10:09:08.4829407Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T10:09:08.4830061Z
2021-07-19T10:09:08.4830827Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T10:09:08.4831312Z
2021-07-19T10:09:08.4832936Z To clean everthing up, just run: make clean-clusters
2021-07-19T10:09:08.4833742Z EOM
2021-07-19T10:09:08.4839698Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T10:09:08.4840292Z
2021-07-19T10:09:08.4841387Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T10:09:08.4842027Z
2021-07-19T10:09:08.4842783Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T10:09:08.4843284Z
2021-07-19T10:09:08.4843966Z To clean everthing up, just run: make clean-clusters
2021-07-19T10:09:08.4854662Z Successfully remade target file 'clusters'.
2021-07-19T10:09:08.4855500Z File 'bin/subctl' does not exist.
2021-07-19T10:09:08.4856406Z File 'bin/subctl-latest-linux-amd64' does not exist.
2021-07-19T10:09:08.4871399Z File 'generate-embeddedyamls' does not exist.
2021-07-19T10:09:08.4872445Z File 'generate' does not exist.
2021-07-19T10:09:08.4873606Z File '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen' does not exist.
2021-07-19T10:09:08.4874715Z File 'vendor/modules.txt' does not exist.
2021-07-19T10:09:08.4885522Z Must remake target 'vendor/modules.txt'.
2021-07-19T10:09:08.4886094Z go mod download
2021-07-19T10:10:01.4653132Z go mod vendor
2021-07-19T10:10:03.4101634Z go mod tidy
2021-07-19T10:10:04.0844683Z Successfully remade target file 'vendor/modules.txt'.
2021-07-19T10:10:04.0846008Z Must remake target '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T10:10:04.0847643Z mkdir -p /go/src/github.com/submariner-io/submariner-operator/bin
2021-07-19T10:10:04.0883658Z go build -o /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen sigs.k8s.io/controller-tools/cmd/controller-gen
2021-07-19T10:10:24.5480905Z Successfully remade target file '/go/src/github.com/submariner-io/submariner-operator/bin/controller-gen'.
2021-07-19T10:10:24.5482131Z Must remake target 'generate'.
2021-07-19T10:10:24.5520002Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-19T10:10:37.7685790Z Successfully remade target file 'generate'.
2021-07-19T10:10:37.7688753Z File 'pkg/subctl/operator/common/embeddedyamls/yamls.go' does not exist.
2021-07-19T10:10:37.7700857Z File 'deploy/crds/submariner.io_servicediscoveries.yaml' does not exist.
2021-07-19T10:10:37.7766993Z Must remake target 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T10:10:37.7768866Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=deploy/crds
2021-07-19T10:10:40.0064862Z Successfully remade target file 'deploy/crds/submariner.io_servicediscoveries.yaml'.
2021-07-19T10:10:40.0068055Z File 'deploy/submariner/crds/submariner.io_clusters.yaml' does not exist.
2021-07-19T10:10:40.0071254Z Must remake target 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T10:10:40.0078720Z cd vendor/github.com/submariner-io/submariner && /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen "crd:crdVersions=v1,trivialVersions=false" paths="./..." output:crd:artifacts:config=../../../../deploy/submariner/crds
2021-07-19T10:10:41.3169392Z Successfully remade target file 'deploy/submariner/crds/submariner.io_clusters.yaml'.
2021-07-19T10:10:41.3275552Z Must remake target 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T10:10:41.3276632Z go generate pkg/subctl/operator/common/embeddedyamls/generate.go
2021-07-19T10:10:42.0351273Z Generating yamls.go
2021-07-19T10:10:42.0358267Z deploy/crds/submariner.io_brokers.yaml
2021-07-19T10:10:42.0363830Z deploy/crds/submariner.io_submariners.yaml
2021-07-19T10:10:42.0396406Z deploy/crds/submariner.io_servicediscoveries.yaml
2021-07-19T10:10:42.0413077Z deploy/submariner/crds/submariner.io_clusters.yaml
2021-07-19T10:10:42.0414087Z deploy/submariner/crds/submariner.io_endpoints.yaml
2021-07-19T10:10:42.0415061Z deploy/submariner/crds/submariner.io_gateways.yaml
2021-07-19T10:10:42.0422593Z deploy/submariner/crds/submariner.io_clusterglobalegressips.yaml
2021-07-19T10:10:42.0429503Z deploy/submariner/crds/submariner.io_globalegressips.yaml
2021-07-19T10:10:42.0439900Z deploy/submariner/crds/submariner.io_globalingressips.yaml
2021-07-19T10:10:42.0449558Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceexports.yaml
2021-07-19T10:10:42.0457898Z deploy/mcsapi/crds/multicluster.x_k8s.io_serviceimports.yaml
2021-07-19T10:10:42.0472842Z config/broker/broker-admin/service_account.yaml
2021-07-19T10:10:42.0486731Z config/broker/broker-admin/role.yaml
2021-07-19T10:10:42.0490383Z config/broker/broker-admin/role_binding.yaml
2021-07-19T10:10:42.0498145Z config/broker/broker-client/service_account.yaml
2021-07-19T10:10:42.0499304Z config/broker/broker-client/role.yaml
2021-07-19T10:10:42.0504556Z config/broker/broker-client/role_binding.yaml
2021-07-19T10:10:42.0505527Z config/rbac/submariner-operator/service_account.yaml
2021-07-19T10:10:42.0513725Z config/rbac/submariner-operator/role.yaml
2021-07-19T10:10:42.0516917Z config/rbac/submariner-operator/role_binding.yaml
2021-07-19T10:10:42.0518066Z config/rbac/submariner-operator/cluster_role.yaml
2021-07-19T10:10:42.0524200Z config/rbac/submariner-operator/cluster_role_binding.yaml
2021-07-19T10:10:42.0528151Z config/rbac/submariner-gateway/service_account.yaml
2021-07-19T10:10:42.0531187Z config/rbac/submariner-gateway/role.yaml
2021-07-19T10:10:42.0533877Z config/rbac/submariner-gateway/role_binding.yaml
2021-07-19T10:10:42.0534970Z config/rbac/submariner-gateway/cluster_role.yaml
2021-07-19T10:10:42.0542746Z config/rbac/submariner-gateway/cluster_role_binding.yaml
2021-07-19T10:10:42.0545939Z config/rbac/submariner-route-agent/service_account.yaml
2021-07-19T10:10:42.0553477Z config/rbac/submariner-route-agent/role.yaml
2021-07-19T10:10:42.0556430Z config/rbac/submariner-route-agent/role_binding.yaml
2021-07-19T10:10:42.0558799Z config/rbac/submariner-route-agent/cluster_role.yaml
2021-07-19T10:10:42.0562396Z config/rbac/submariner-route-agent/cluster_role_binding.yaml
2021-07-19T10:10:42.0563704Z config/rbac/submariner-globalnet/service_account.yaml
2021-07-19T10:10:42.0565600Z config/rbac/submariner-globalnet/role.yaml
2021-07-19T10:10:42.0567439Z config/rbac/submariner-globalnet/role_binding.yaml
2021-07-19T10:10:42.0571401Z config/rbac/submariner-globalnet/cluster_role.yaml
2021-07-19T10:10:42.0574957Z config/rbac/submariner-globalnet/cluster_role_binding.yaml
2021-07-19T10:10:42.0577461Z config/rbac/lighthouse-agent/service_account.yaml
2021-07-19T10:10:42.0579947Z config/rbac/lighthouse-agent/cluster_role.yaml
2021-07-19T10:10:42.0585204Z config/rbac/lighthouse-agent/cluster_role_binding.yaml
2021-07-19T10:10:42.0587674Z config/rbac/lighthouse-coredns/service_account.yaml
2021-07-19T10:10:42.0591144Z config/rbac/lighthouse-coredns/cluster_role.yaml
2021-07-19T10:10:42.0595768Z config/rbac/lighthouse-coredns/cluster_role_binding.yaml
2021-07-19T10:10:42.0600250Z config/rbac/networkplugin_syncer/service_account.yaml
2021-07-19T10:10:42.0602088Z config/rbac/networkplugin_syncer/cluster_role.yaml
2021-07-19T10:10:42.0608113Z config/rbac/networkplugin_syncer/cluster_role_binding.yaml
2021-07-19T10:10:42.0610759Z config/rbac/submariner-metrics-reader/role.yaml
2021-07-19T10:10:42.0612040Z config/rbac/submariner-metrics-reader/role_binding.yaml
2021-07-19T10:10:42.0647417Z Successfully remade target file 'pkg/subctl/operator/common/embeddedyamls/yamls.go'.
2021-07-19T10:10:42.0648646Z Must remake target 'generate-embeddedyamls'.
2021-07-19T10:10:42.0649742Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-19T10:10:42.0883164Z Must remake target 'bin/subctl-latest-linux-amd64'.
2021-07-19T10:10:42.0883992Z mkdir -p bin
2021-07-19T10:10:42.0922412Z target=bin/subctl-latest-linux-amd64; \
2021-07-19T10:10:42.0923115Z target=${target%.exe}; \
2021-07-19T10:10:42.0923803Z components=($(echo ${target//-/ })); \
2021-07-19T10:10:42.0924470Z GOOS=${components[-2]}; \
2021-07-19T10:10:42.0925103Z GOARCH=${components[-1]}; \
2021-07-19T10:10:42.0925577Z export GOARCH GOOS; \
2021-07-19T10:10:42.0926114Z /opt/shipyard/scripts/compile.sh \
2021-07-19T10:10:42.0927438Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \
2021-07-19T10:10:42.0929546Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-19T10:10:42.0931284Z --noupx bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-19T10:10:42.1601072Z [submariner-operator]$ mkdir -p bin
2021-07-19T10:10:42.1618781Z Building 'bin/subctl-latest-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=latest \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-19T10:10:42.1629457Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-19T10:10:42.1642896Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=latest -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-latest-linux-amd64 ./pkg/subctl/main.go
2021-07-19T10:12:39.8116386Z Successfully remade target file 'bin/subctl-latest-linux-amd64'.
2021-07-19T10:12:39.8117416Z Must remake target 'bin/subctl'.
2021-07-19T10:12:39.8118270Z ln -sf subctl-latest-linux-amd64 bin/subctl
2021-07-19T10:12:39.8141381Z Successfully remade target file 'bin/subctl'.
2021-07-19T10:12:39.8142379Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-19T10:12:39.8143334Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-19T10:12:39.8144100Z Must remake target 'deploy'.
2021-07-19T10:12:39.8148031Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings --image_tag=subctl --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:12:39.9052626Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=subctl, cable_driver=libreswan, service_discovery=false
2021-07-19T10:12:39.9082156Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T10:12:39.9100169Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:12:39.9115408Z [submariner-operator]$ script_name=utils
2021-07-19T10:12:39.9129915Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:12:39.9151172Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-19T10:12:39.9168460Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:12:39.9181338Z [submariner-operator]$ script_name=deploy_funcs
2021-07-19T10:12:39.9195044Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:12:39.9213404Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T10:12:39.9232641Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:12:39.9243200Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:12:39.9255985Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:12:39.9286845Z [submariner-operator]$ broker=cluster1
2021-07-19T10:12:39.9301526Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T10:12:39.9316365Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T10:12:39.9329853Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T10:12:39.9343430Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T10:12:39.9356351Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T10:12:39.9368709Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T10:12:39.9381874Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T10:12:39.9395308Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T10:12:39.9409933Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T10:12:39.9421187Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T10:12:39.9435847Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T10:12:39.9447748Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:12:39.9462324Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:12:39.9476077Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:12:39.9489759Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:12:39.9512556Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T10:12:39.9526593Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T10:12:39.9560189Z [submariner-operator]$ declare_cidrs
2021-07-19T10:12:39.9573612Z [submariner-operator]$ declare_cidrs
2021-07-19T10:12:39.9586926Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T10:12:39.9600841Z [submariner-operator]$ i=1
2021-07-19T10:12:39.9616281Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:12:39.9630679Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:12:39.9647613Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-19T10:12:39.9661864Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-19T10:12:39.9678846Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T10:12:39.9694186Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:12:39.9707871Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:12:39.9724564Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-19T10:12:39.9739574Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-19T10:12:39.9754873Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T10:12:39.9766739Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T10:12:39.9780676Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T10:12:39.9794646Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-19T10:12:39.9809394Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-19T10:12:39.9821391Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-19T10:12:39.9839732Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-19T10:12:39.9879252Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=latest DESTDIR=/go/bin bash
2021-07-19T10:12:40.2404433Z Installing subctl version latest
2021-07-19T10:12:40.2409359Z OS detected: linux
2021-07-19T10:12:40.2410109Z Architecture detected: amd64
2021-07-19T10:12:40.2415096Z Download URL: https://github.com/submariner-io/releases/releases/download/v0.9.1/subctl-v0.9.1-linux-amd64.tar.xz
2021-07-19T10:12:40.2418293Z
2021-07-19T10:12:40.2421468Z Downloading...
2021-07-19T10:12:41.6569826Z subctl-v0.9.1-linux-amd64 has been installed as /go/bin/subctl
2021-07-19T10:12:41.7003205Z This provides subctl version: v0.9.1
2021-07-19T10:12:41.7029133Z
2021-07-19T10:12:41.7029916Z please update your path (and consider adding it to ~/.profile):
2021-07-19T10:12:41.7030549Z export PATH=$PATH:/go/bin
2021-07-19T10:12:41.7031004Z
2021-07-19T10:12:41.7147796Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T10:12:41.7162703Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T10:12:41.7170169Z Will deploy submariner using operator
2021-07-19T10:12:41.7183622Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-19T10:12:41.7197982Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:12:41.7211186Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-19T10:12:41.7226978Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-19T10:12:41.7250026Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T10:12:41.7265254Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T10:12:41.7279888Z 
2021-07-19T10:12:41.7296362Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl version
2021-07-19T10:12:41.8881585Z subctl version: v0.9.1
2021-07-19T10:12:41.8910432Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T10:12:41.8925970Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T10:12:41.8941562Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-19T10:12:41.8961015Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T10:12:41.8990866Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:12:41.9006265Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T10:12:41.9020643Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T10:12:41.9036106Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T10:12:41.9073083Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-19T10:12:41.9088143Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-19T10:12:41.9105074Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:12:41.9125029Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:12:41.9149030Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:12:41.9150021Z [submariner-operator]$ [cluster1] pids[cluster1]=6313
2021-07-19T10:12:41.9165373Z [submariner-operator]$ [cluster2] pids[cluster2]=6316
2021-07-19T10:12:41.9170687Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T10:12:41.9185186Z [submariner-operator]$ [cluster2] wait 6316
2021-07-19T10:12:41.9195547Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:12:41.9241173Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:12:41.9266454Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T10:12:41.9283227Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:12:42.3372921Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T10:12:42.3374046Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T10:12:42.3375098Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T10:12:42.3376450Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3378328Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3380237Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3381527Z [cluster2] node/cluster2-worker labeled
2021-07-19T10:12:42.3395680Z [submariner-operator]$ [cluster2] wait 6313
2021-07-19T10:12:42.3641069Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T10:12:42.3642190Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T10:12:42.3643235Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T10:12:42.3644599Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3646230Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3647981Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:12:42.3649288Z [cluster1] node/cluster1-worker labeled
2021-07-19T10:12:42.3683694Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T10:12:42.3697761Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T10:12:42.3715223Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T10:12:42.3726038Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T10:12:42.3734265Z Installing broker...
2021-07-19T10:12:42.3748157Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T10:12:42.3771413Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-19T10:12:42.3783809Z [output]$ [cluster1] /root/.local/bin/subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:12:42.4293614Z • Setting up broker RBAC ...
2021-07-19T10:12:42.5184440Z ✓ Setting up broker RBAC
2021-07-19T10:12:42.5185257Z • Deploying the Submariner operator ...
2021-07-19T10:12:52.9355691Z ✓ Deploying the Submariner operator
2021-07-19T10:12:52.9356559Z ✓ Created operator CRDs
2021-07-19T10:12:52.9361918Z ✓ Created operator namespace: submariner-operator
2021-07-19T10:12:52.9366785Z ✓ Created operator service account and role
2021-07-19T10:12:52.9372456Z ✓ Created lighthouse service account and role
2021-07-19T10:12:52.9377012Z ✓ Created Lighthouse service accounts and roles
2021-07-19T10:12:52.9381403Z ✓ Deployed the operator successfully
2021-07-19T10:12:52.9385653Z • Deploying the broker ...
2021-07-19T10:12:52.9475326Z ✓ Deploying the broker
2021-07-19T10:12:52.9479938Z ✓ The broker has been deployed
2021-07-19T10:12:52.9484306Z • Creating broker-info.subm file ...
2021-07-19T10:12:52.9572619Z ✓ Creating broker-info.subm file
2021-07-19T10:12:52.9577521Z ✓ A new IPsec PSK will be generated for broker-info.subm
2021-07-19T10:12:52.9625236Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T10:12:52.9644402Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T10:12:52.9660885Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T10:12:52.9677349Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T10:12:52.9689043Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T10:12:52.9725739Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-19T10:12:52.9737229Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-19T10:12:52.9749369Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:12:52.9767551Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:12:52.9786910Z [submariner-operator]$ [cluster1] pids[cluster1]=6378
2021-07-19T10:12:52.9814187Z [submariner-operator]$ [cluster2] pids[cluster2]=6380
2021-07-19T10:12:52.9826388Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:12:52.9841566Z [submariner-operator]$ [cluster2] wait 6380
2021-07-19T10:12:52.9842622Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:12:52.9853878Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T10:12:52.9868702Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T10:12:52.9884584Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:12:52.9894124Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:12:58.7355403Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T10:12:58.7356660Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T10:12:58.7357793Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-19T10:12:58.7360854Z [submariner-operator]$ [cluster1] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T10:12:58.7364121Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T10:12:58.7365563Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-19T10:12:58.7366471Z [cluster1] - cluster1-worker
2021-07-19T10:12:58.7367319Z [cluster1] • Discovering network details ...
2021-07-19T10:12:58.7368096Z [cluster1] Discovered network details:
2021-07-19T10:12:58.7369017Z [cluster1] Network plugin: weave-net
2021-07-19T10:12:58.7369712Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-19T10:12:58.7370292Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-19T10:12:58.7371149Z [cluster1] ✓ Discovering network details
2021-07-19T10:12:58.7372125Z [cluster1] • Discovering multi cluster details ...
2021-07-19T10:12:58.7373067Z [cluster1] • Validating Globalnet configurations ...
2021-07-19T10:12:58.7374073Z [cluster1] ✓ Validating Globalnet configurations
2021-07-19T10:12:58.7375010Z [cluster1] ✓ Discovering multi cluster details
2021-07-19T10:12:58.7375964Z [cluster1] • Deploying the Submariner operator ...
2021-07-19T10:12:58.7376885Z [cluster1] ✓ Deploying the Submariner operator
2021-07-19T10:12:58.7377906Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-19T10:12:58.7378788Z [cluster1] • Creating SA for cluster ...
2021-07-19T10:12:58.7379606Z [cluster1] ✓ Creating SA for cluster
2021-07-19T10:12:58.7380398Z [cluster1] • Deploying Submariner ...
2021-07-19T10:12:58.7381273Z [cluster1] ✓ Deploying Submariner
2021-07-19T10:12:58.7382126Z [cluster1] ✓ Submariner is up and running
2021-07-19T10:13:04.5202594Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T10:13:04.5203701Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-19T10:13:04.5204739Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-19T10:13:04.5207973Z [submariner-operator]$ [cluster2] /root/.local/bin/subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T10:13:04.5212973Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T10:13:04.5214892Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-19T10:13:04.5215744Z [cluster2] - cluster2-worker
2021-07-19T10:13:04.5216568Z [cluster2] • Discovering network details ...
2021-07-19T10:13:04.5217215Z [cluster2] Discovered network details:
2021-07-19T10:13:04.5218014Z [cluster2] Network plugin: weave-net
2021-07-19T10:13:04.5218601Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-19T10:13:04.5219156Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-19T10:13:04.5219916Z [cluster2] ✓ Discovering network details
2021-07-19T10:13:04.5220759Z [cluster2] • Discovering multi cluster details ...
2021-07-19T10:13:04.5221662Z [cluster2] • Validating Globalnet configurations ...
2021-07-19T10:13:04.5222574Z [cluster2] ✓ Validating Globalnet configurations
2021-07-19T10:13:04.5223900Z [cluster2] ✓ Discovering multi cluster details
2021-07-19T10:13:04.5224756Z [cluster2] • Deploying the Submariner operator ...
2021-07-19T10:13:04.5225646Z [cluster2] ✓ Deploying the Submariner operator
2021-07-19T10:13:04.5226427Z [cluster2] ✓ Created operator CRDs
2021-07-19T10:13:04.5227369Z [cluster2] ✓ Created operator namespace: submariner-operator
2021-07-19T10:13:04.5228361Z [cluster2] ✓ Created operator service account and role
2021-07-19T10:13:04.5229492Z [cluster2] ✓ Created lighthouse service account and role
2021-07-19T10:13:04.5230690Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-19T10:13:04.5231609Z [cluster2] ✓ Deployed the operator successfully
2021-07-19T10:13:04.5233246Z [cluster2] • Creating SA for cluster ...
2021-07-19T10:13:04.5233967Z [cluster2] ✓ Creating SA for cluster
2021-07-19T10:13:04.5234716Z [cluster2] • Deploying Submariner ...
2021-07-19T10:13:04.5235454Z [cluster2] ✓ Deploying Submariner
2021-07-19T10:13:04.5236218Z [cluster2] ✓ Submariner is up and running
2021-07-19T10:13:04.5264152Z [submariner-operator]$ [cluster2] wait 6378
2021-07-19T10:13:04.5284651Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T10:13:04.5298745Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T10:13:04.5315616Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-19T10:13:04.5419282Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T10:13:04.5445840Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:13:04.5517685Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:04.5535946Z [submariner-operator]$ [cluster2] wait 6419
2021-07-19T10:13:04.5546567Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:04.5565889Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:04.5635079Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:04.5702838Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:04.8370776Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:04.8388539Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:05.1194185Z • Showing Connections ...
2021-07-19T10:13:05.3575677Z ✗ Showing Connections
2021-07-19T10:13:05.3576450Z ✗ There are no gateways detected
2021-07-19T10:13:05.4158437Z • Showing Connections ...
2021-07-19T10:13:05.4433683Z ✗ Showing Connections
2021-07-19T10:13:05.4434483Z ✗ There are no gateways detected
2021-07-19T10:13:05.4481212Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:05.4496542Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:11.4540911Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:11.4583504Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:11.4587594Z [submariner-operator]$ [cluster2] wait 6445
2021-07-19T10:13:11.4596070Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:11.4628418Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:11.4640672Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:11.4678394Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:11.6239855Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:11.6257839Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:11.7568508Z • Showing Connections ...
2021-07-19T10:13:11.7658700Z ✗ Showing Connections
2021-07-19T10:13:11.7659698Z ✗ There are no gateways detected
2021-07-19T10:13:11.7736352Z • Showing Connections ...
2021-07-19T10:13:11.7826759Z ✗ Showing Connections
2021-07-19T10:13:11.7827476Z ✗ There are no gateways detected
2021-07-19T10:13:11.7854390Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:11.7866552Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:17.7902014Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:17.7945583Z [submariner-operator]$ [cluster2] wait 6471
2021-07-19T10:13:17.7969852Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:17.8083979Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:17.8132560Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:17.8176973Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:17.8328146Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:18.7318064Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:18.7334151Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:19.2497707Z • Showing Connections ...
2021-07-19T10:13:19.5357679Z ✗ Showing Connections
2021-07-19T10:13:19.5358442Z ✗ There are no gateways detected
2021-07-19T10:13:19.5670976Z • Showing Connections ...
2021-07-19T10:13:19.5857480Z ✗ Showing Connections
2021-07-19T10:13:19.5858251Z ✗ There are no gateways detected
2021-07-19T10:13:19.5885012Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:19.5911201Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:25.5940469Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:25.6006092Z [submariner-operator]$ [cluster2] wait 6499
2021-07-19T10:13:25.6019494Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:25.6131027Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:25.6181827Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:25.6228012Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:25.6260925Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:27.3181723Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:27.3201094Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:27.8356775Z • Showing Connections ...
2021-07-19T10:13:27.8998246Z ✗ Showing Connections
2021-07-19T10:13:27.9008737Z ✗ There are no gateways detected
2021-07-19T10:13:28.0257797Z • Showing Connections ...
2021-07-19T10:13:28.0289327Z ✗ Showing Connections
2021-07-19T10:13:28.0294353Z ✗ There are no gateways detected
2021-07-19T10:13:28.0330272Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:28.0346802Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:34.0384069Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:34.0451162Z [submariner-operator]$ [cluster2] wait 6526
2021-07-19T10:13:34.0477313Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:34.0489883Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:34.0571113Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:34.0608091Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:34.0632710Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:34.2679150Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:34.2700052Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:34.4505968Z • Showing Connections ...
2021-07-19T10:13:34.4571052Z ✗ Showing Connections
2021-07-19T10:13:34.4571735Z ✗ No connections found
2021-07-19T10:13:34.4987731Z • Showing Connections ...
2021-07-19T10:13:34.5178007Z ✗ Showing Connections
2021-07-19T10:13:34.5178771Z ✗ There are no gateways detected
2021-07-19T10:13:34.5204720Z iter: 5. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:34.5217679Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:40.5244335Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:40.5294072Z [submariner-operator]$ [cluster2] wait 6553
2021-07-19T10:13:40.5326767Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:40.5365201Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:40.5381178Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:40.5438590Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:40.5495051Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:40.7791781Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:40.7828060Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:41.0698464Z • Showing Connections ...
2021-07-19T10:13:41.1292581Z ✗ Showing Connections
2021-07-19T10:13:41.1300092Z ✗ There are no gateways detected
2021-07-19T10:13:41.1336231Z • Showing Connections ...
2021-07-19T10:13:41.1364468Z ✗ Showing Connections
2021-07-19T10:13:41.1365177Z ✗ No connections found
2021-07-19T10:13:41.1392752Z iter: 6. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:41.1422077Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:47.1451855Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:47.1513822Z [submariner-operator]$ [cluster2] wait 6580
2021-07-19T10:13:47.1525920Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:47.1541536Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:47.1561140Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:47.1584458Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:47.1603717Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:47.2342019Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:47.2356573Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:47.2770362Z • Showing Connections ...
2021-07-19T10:13:47.2797315Z ✗ Showing Connections
2021-07-19T10:13:47.2798010Z ✗ No connections found
2021-07-19T10:13:47.2905449Z • Showing Connections ...
2021-07-19T10:13:47.2927551Z ✗ Showing Connections
2021-07-19T10:13:47.2928087Z ✗ No connections found
2021-07-19T10:13:47.2962352Z iter: 7. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:47.2975274Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:53.3002951Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:53.3062662Z [submariner-operator]$ [cluster2] wait 6606
2021-07-19T10:13:53.3085620Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:53.3101243Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:53.3116314Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:53.3126897Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:53.3142917Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:53.3965461Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:53.3979023Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:53.4533279Z • Showing Connections ...
2021-07-19T10:13:53.4607443Z ✗ Showing Connections
2021-07-19T10:13:53.4608178Z ✗ No connections found
2021-07-19T10:13:53.4647356Z • Showing Connections ...
2021-07-19T10:13:53.4674415Z ✗ Showing Connections
2021-07-19T10:13:53.4675087Z ✗ No connections found
2021-07-19T10:13:53.4701274Z iter: 8. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:13:53.4737532Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:13:59.4774665Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:13:59.4816208Z [submariner-operator]$ [cluster2] wait 6632
2021-07-19T10:13:59.4833958Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:59.4850914Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:13:59.4864399Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:13:59.4878152Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:59.4922330Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:13:59.5696809Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:13:59.5712858Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:13:59.6162882Z • Showing Connections ...
2021-07-19T10:13:59.6195280Z ✓ Showing Connections
2021-07-19T10:13:59.6307231Z • Showing Connections ...
2021-07-19T10:13:59.6328526Z ✓ Showing Connections
2021-07-19T10:13:59.6348106Z cluster2-worker cluster2 172.18.0.5 no libreswan 100.2.0.0/16, 10.2.0.0/16 connected 183.467µs
2021-07-19T10:13:59.6349324Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 146.301µs
2021-07-19T10:13:59.6368135Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:13:59.6384120Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:13:59.6398880Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T10:13:59.6412677Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T10:13:59.6430326Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-19T10:13:59.6445512Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-19T10:13:59.6460375Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-19T10:13:59.6472097Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T10:13:59.6486722Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T10:13:59.6505172Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-19T10:13:59.9502378Z Error response from daemon: No such image: quay.io/submariner/nettest:latest
2021-07-19T10:13:59.9550700Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:latest
2021-07-19T10:14:00.5234792Z latest: Pulling from submariner/nettest
2021-07-19T10:14:00.5264805Z df20fa9351a1: Pulling fs layer
2021-07-19T10:14:00.5278598Z 741138c6c583: Pulling fs layer
2021-07-19T10:14:00.5281595Z d34ea735672c: Pulling fs layer
2021-07-19T10:14:00.5284502Z c91acd455ec9: Pulling fs layer
2021-07-19T10:14:00.5287516Z c91acd455ec9: Waiting
2021-07-19T10:14:00.6039071Z 741138c6c583: Verifying Checksum
2021-07-19T10:14:00.6042074Z 741138c6c583: Download complete
2021-07-19T10:14:00.6670232Z df20fa9351a1: Verifying Checksum
2021-07-19T10:14:00.6670895Z df20fa9351a1: Download complete
2021-07-19T10:14:00.7012581Z d34ea735672c: Verifying Checksum
2021-07-19T10:14:00.7013429Z d34ea735672c: Download complete
2021-07-19T10:14:00.7195446Z c91acd455ec9: Verifying Checksum
2021-07-19T10:14:00.7196088Z c91acd455ec9: Download complete
2021-07-19T10:14:01.1357379Z df20fa9351a1: Pull complete
2021-07-19T10:14:01.2697825Z 741138c6c583: Pull complete
2021-07-19T10:14:01.7160249Z d34ea735672c: Pull complete
2021-07-19T10:14:01.8156182Z c91acd455ec9: Pull complete
2021-07-19T10:14:01.8259375Z Digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d
2021-07-19T10:14:01.8271263Z Status: Downloaded newer image for quay.io/submariner/nettest:latest
2021-07-19T10:14:01.8364235Z quay.io/submariner/nettest:latest
2021-07-19T10:14:01.8399961Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest quay.io/submariner/nettest:latest
2021-07-19T10:14:02.1596699Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:latest localhost:5000/nettest:local
2021-07-19T10:14:02.4738282Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-19T10:14:02.7768196Z The push refers to repository [localhost:5000/nettest]
2021-07-19T10:14:02.8124611Z 7497bfb0ae54: Preparing
2021-07-19T10:14:02.8125209Z 17de069c349e: Preparing
2021-07-19T10:14:02.8125789Z b85398c91342: Preparing
2021-07-19T10:14:02.8126337Z 50644c29ef5a: Preparing
2021-07-19T10:14:03.3709347Z b85398c91342: Pushed
2021-07-19T10:14:03.3868066Z 7497bfb0ae54: Pushed
2021-07-19T10:14:03.3981498Z 50644c29ef5a: Pushed
2021-07-19T10:14:04.3336471Z 17de069c349e: Pushed
2021-07-19T10:14:04.3533474Z local: digest: sha256:63f21b9d8065d60870c2bca980dbc4dc6358edf669661576b8cbee39e3024a2d size: 1155
2021-07-19T10:14:04.3602519Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:04.3620361Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:04.3633153Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T10:14:04.3651912Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-19T10:14:04.3673533Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:04.3695503Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:04.3715259Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:04.9487794Z deployment.apps/netshoot created
2021-07-19T10:14:04.9552267Z Waiting for netshoot pods to be ready.
2021-07-19T10:14:04.9568243Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T10:14:04.9581659Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T10:14:04.9595573Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-19T10:14:05.2887056Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-19T10:14:06.4623121Z deployment "netshoot" successfully rolled out
2021-07-19T10:14:06.4686806Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:06.4705156Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:06.4759597Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:06.4776265Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-19T10:14:06.4792200Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T10:14:06.4813142Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-19T10:14:06.4851804Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:06.4867328Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:06.4882979Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:07.1389133Z deployment.apps/nginx-demo created
2021-07-19T10:14:07.1941019Z service/nginx-demo created
2021-07-19T10:14:07.3198303Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-19T10:14:07.3255026Z Waiting for nginx-demo pods to be ready.
2021-07-19T10:14:07.3270382Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:14:07.3285748Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:14:07.3303719Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:14:07.9330120Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T10:14:13.6303037Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T10:14:13.6646320Z deployment "nginx-demo" successfully rolled out
2021-07-19T10:14:13.6712430Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-19T10:14:13.6736021Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T10:14:13.6757535Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T10:14:13.6770360Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-19T10:14:13.6784153Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-19T10:14:14.2392410Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-19T10:14:14.2394036Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T10:14:14.2395331Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T10:14:14.2396490Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-19T10:14:14.2397514Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-19T10:14:14.2398778Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-19T10:14:14.2400169Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:14:14.2401317Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-19T10:14:14.2402517Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:14:14.2403905Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:14:14.3724667Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-vt28k 100.1.99.254
2021-07-19T10:14:14.3741258Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-vt28k 100.1.99.254
2021-07-19T10:14:14.3759014Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:14:14.3794812Z [submariner-operator]$ [cluster2] wait 6783
2021-07-19T10:14:14.3802219Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-vt28k 100.1.99.254
2021-07-19T10:14:14.3813308Z [submariner-operator]$ [cluster2] test_connection
2021-07-19T10:14:14.3817784Z Attempting connectivity between clusters - netshoot-57677568b8-vt28k --> 100.1.99.254
2021-07-19T10:14:14.3836160Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-19T10:14:14.3850795Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-19T10:14:14.3868286Z [submariner-operator]$ [cluster2] date +%s
2021-07-19T10:14:14.3902799Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-vt28k -- curl --output /dev/null -m 30 --silent --head --fail 100.1.99.254
2021-07-19T10:14:14.3915920Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-vt28k -- curl --output /dev/null -m 30 --silent --head --fail 100.1.99.254
2021-07-19T10:14:14.3931717Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-vt28k -- curl --output /dev/null -m 30 --silent --head --fail 100.1.99.254
2021-07-19T10:14:14.8327018Z Connection test was successful!
2021-07-19T10:14:14.8343329Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:14:14.8361504Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:14.8374458Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:14.8389170Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:14.8404101Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:14.8423103Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:14:15.1575167Z deployment.apps "netshoot" deleted
2021-07-19T10:14:15.1729842Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.1745068Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.1761222Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.1775441Z [submariner-operator]$ [cluster1] remove_resource
2021-07-19T10:14:15.1794353Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.1810321Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.1822032Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:14:15.4694395Z deployment.apps "nginx-demo" deleted
2021-07-19T10:14:15.5313923Z service "nginx-demo" deleted
2021-07-19T10:14:15.5553937Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-19T10:14:15.6379169Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T10:14:15.6394862Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T10:14:15.6421578Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-19T10:14:15.6440862Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T10:14:15.6510156Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:14:15.6530117Z Successfully remade target file 'deploy'.
2021-07-19T10:14:15.6551276Z make[1]: Leaving directory '/go/src/github.com/submariner-io/submariner-operator'
2021-07-19T10:14:15.6619061Z Successfully remade target file 'deploy-latest'.
2021-07-19T10:14:15.6620057Z File 'clusters' does not exist.
2021-07-19T10:14:15.6620770Z Must remake target 'clusters'.
2021-07-19T10:14:15.6622147Z /opt/shipyard/scripts/clusters.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:14:15.8854103Z Running with: k8s_version=1.20.7, olm_version=0.14.1, olm=false, globalnet=false, registry_inmemory=true, cluster_settings=/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings, timeout=5m
2021-07-19T10:14:15.8904225Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T10:14:15.8977479Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:14:15.9009387Z [submariner-operator]$ script_name=utils
2021-07-19T10:14:15.9030739Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:14:15.9075213Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T10:14:15.9109720Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:14:15.9133740Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:14:15.9144570Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:14:15.9174895Z [submariner-operator]$ broker=cluster1
2021-07-19T10:14:15.9314605Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T10:14:15.9329171Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T10:14:15.9340725Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T10:14:15.9422469Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T10:14:15.9434099Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T10:14:15.9477549Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T10:14:15.9499091Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T10:14:15.9514109Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T10:14:15.9530438Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T10:14:15.9547235Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T10:14:15.9563021Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T10:14:15.9610790Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:14:15.9647037Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:14:15.9666299Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:14:15.9694347Z [submariner-operator]$ exec_name=clusters.sh
2021-07-19T10:14:15.9710754Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T10:14:15.9731941Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T10:14:15.9906836Z [submariner-operator]$ cat <<EOM
2021-07-19T10:14:15.9915184Z Cluster settings::
2021-07-19T10:14:15.9916088Z broker - ${broker@Q}
2021-07-19T10:14:15.9916712Z clusters - ${clusters[*]@Q}
2021-07-19T10:14:15.9917445Z cni - $(typeset -p cluster_cni | cut -f 2- -d=)
2021-07-19T10:14:15.9918290Z nodes per cluster - $(typeset -p cluster_nodes | cut -f 2- -d=)
2021-07-19T10:14:15.9919233Z install submariner - $(typeset -p cluster_subm | cut -f 2- -d=)
2021-07-19T10:14:15.9919901Z EOM
2021-07-19T10:14:15.9950572Z [submariner-operator]$ typeset -p cluster_cni
2021-07-19T10:14:16.0056351Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:14:16.0124222Z [submariner-operator]$ typeset -p cluster_nodes
2021-07-19T10:14:16.0197028Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:14:16.0228765Z [submariner-operator]$ typeset -p cluster_subm
2021-07-19T10:14:16.0306410Z [submariner-operator]$ cut -f 2- -d=
2021-07-19T10:14:16.0345741Z Cluster settings::
2021-07-19T10:14:16.0346608Z broker - 'cluster1'
2021-07-19T10:14:16.0347298Z clusters - 'cluster1' 'cluster2'
2021-07-19T10:14:16.0348056Z cni - ([cluster2]="weave" [cluster1]="weave" )
2021-07-19T10:14:16.0349418Z nodes per cluster - ([cluster3]="control-plane worker worker" [cluster2]="control-plane worker worker" [cluster1]="control-plane worker worker" )
2021-07-19T10:14:16.0350921Z install submariner - ([cluster2]="true" [cluster1]="true" )
2021-07-19T10:14:16.0374978Z [submariner-operator]$ rm -rf /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T10:14:16.0415912Z [submariner-operator]$ mkdir -p /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs
2021-07-19T10:14:16.0451638Z [submariner-operator]$ run_local_registry
2021-07-19T10:14:16.0465820Z [submariner-operator]$ run_local_registry
2021-07-19T10:14:16.0478191Z [submariner-operator]$ registry_running
2021-07-19T10:14:16.0490159Z [submariner-operator]$ registry_running
2021-07-19T10:14:16.0502965Z [submariner-operator]$ docker ps --filter name=^/?kind-registry$
2021-07-19T10:14:16.0517256Z [submariner-operator]$ grep kind-registry
2021-07-19T10:14:16.3957977Z 42ce52aeb99a registry:2 "/entrypoint.sh /etc…" 7 minutes ago Up 7 minutes 127.0.0.1:5000->5000/tcp kind-registry
2021-07-19T10:14:16.3975807Z [submariner-operator]$ return 0
2021-07-19T10:14:16.3982416Z Local registry kind-registry already running.
2021-07-19T10:14:16.3996235Z [submariner-operator]$ declare_cidrs
2021-07-19T10:14:16.4015639Z [submariner-operator]$ declare_cidrs
2021-07-19T10:14:16.4030223Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T10:14:16.4044227Z [submariner-operator]$ i=1
2021-07-19T10:14:16.4059443Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:14:16.4074495Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:14:16.4090878Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-19T10:14:16.4107318Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-19T10:14:16.4129807Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T10:14:16.4145920Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:14:16.4160516Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:14:16.4177539Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-19T10:14:16.4194647Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-19T10:14:16.4212074Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T10:14:16.4229142Z [submariner-operator]$ [cluster2] wait 6994
2021-07-19T10:14:16.4235632Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4250561Z [submariner-operator]$ [cluster2] run_all_clusters with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4265165Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4281234Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4293131Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:14:16.4312855Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:14:16.4333564Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:14:16.4334653Z [submariner-operator]$ [cluster1] pids[cluster1]=7003
2021-07-19T10:14:16.4345061Z [submariner-operator]$ [cluster1] with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4358945Z [submariner-operator]$ [cluster2] pids[cluster2]=7007
2021-07-19T10:14:16.4375374Z [submariner-operator]$ [cluster2] wait 7007
2021-07-19T10:14:16.4385506Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:14:16.4386551Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:14:16.4396983Z [submariner-operator]$ [cluster2] with_retries 3 create_kind_cluster
2021-07-19T10:14:16.4411583Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:14:23.9435733Z [submariner-operator]$ [cluster1] with_retries
2021-07-19T10:14:23.9436880Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T10:14:23.9437914Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T10:14:23.9438876Z [submariner-operator]$ [cluster1] wait 7022
2021-07-19T10:14:23.9439943Z [submariner-operator]$ [cluster1] create_kind_cluster
2021-07-19T10:14:23.9441649Z [submariner-operator]$ [cluster1] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9443740Z [submariner-operator]$ [cluster1] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9445228Z [submariner-operator]$ [cluster1] kind get clusters
2021-07-19T10:14:23.9446240Z [submariner-operator]$ [cluster1] grep -q ^cluster1$
2021-07-19T10:14:23.9447105Z [cluster1] KIND cluster already exists, skipping its creation...
2021-07-19T10:14:23.9448254Z [submariner-operator]$ [cluster1] kind export kubeconfig --name=cluster1
2021-07-19T10:14:23.9449288Z [cluster1] Set kubectl context to "kind-cluster1"
2021-07-19T10:14:23.9450249Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T10:14:23.9451241Z [submariner-operator]$ [cluster1] kind_fixup_config
2021-07-19T10:14:23.9452827Z [submariner-operator]$ [cluster1] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster1-control-plane
2021-07-19T10:14:23.9454493Z [submariner-operator]$ [cluster1] head -n 1
2021-07-19T10:14:23.9456221Z [submariner-operator]$ [cluster1] sed -i -- s/server: .*/server: https:\/\/172.18.0.6:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9458528Z [submariner-operator]$ [cluster1] sed -i -- s/user: kind-.*/user: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9460813Z [submariner-operator]$ [cluster1] sed -i -- s/name: kind-.*/name: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9463161Z [submariner-operator]$ [cluster1] sed -i -- s/cluster: kind-.*/cluster: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9465645Z [submariner-operator]$ [cluster1] sed -i -- s/current-context: .*/current-context: cluster1/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9467930Z [submariner-operator]$ [cluster1] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1
2021-07-19T10:14:23.9469357Z [submariner-operator]$ [cluster1] return
2021-07-19T10:14:23.9470297Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:14:24.2598587Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T10:14:24.2599757Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:14:24.2600719Z [submariner-operator]$ [cluster2] wait 7030
2021-07-19T10:14:24.2601696Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T10:14:24.2602736Z [submariner-operator]$ [cluster2] create_kind_cluster
2021-07-19T10:14:24.2604625Z [submariner-operator]$ [cluster2] export KUBECONFIG=/go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2606744Z [submariner-operator]$ [cluster2] rm -f /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2608234Z [submariner-operator]$ [cluster2] kind get clusters
2021-07-19T10:14:24.2609450Z [submariner-operator]$ [cluster2] grep -q ^cluster2$
2021-07-19T10:14:24.2610318Z [cluster2] KIND cluster already exists, skipping its creation...
2021-07-19T10:14:24.2611465Z [submariner-operator]$ [cluster2] kind export kubeconfig --name=cluster2
2021-07-19T10:14:24.2612518Z [cluster2] Set kubectl context to "kind-cluster2"
2021-07-19T10:14:24.2613463Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T10:14:24.2614470Z [submariner-operator]$ [cluster2] kind_fixup_config
2021-07-19T10:14:24.2616038Z [submariner-operator]$ [cluster2] docker inspect -f {{range .NetworkSettings.Networks}}{{.IPAddress}}{{end}} cluster2-control-plane
2021-07-19T10:14:24.2617602Z [submariner-operator]$ [cluster2] head -n 1
2021-07-19T10:14:24.2619328Z [submariner-operator]$ [cluster2] sed -i -- s/server: .*/server: https:\/\/172.18.0.9:6443/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2621619Z [submariner-operator]$ [cluster2] sed -i -- s/user: kind-.*/user: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2623928Z [submariner-operator]$ [cluster2] sed -i -- s/name: kind-.*/name: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2626263Z [submariner-operator]$ [cluster2] sed -i -- s/cluster: kind-.*/cluster: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2628843Z [submariner-operator]$ [cluster2] sed -i -- s/current-context: .*/current-context: cluster2/g /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2631127Z [submariner-operator]$ [cluster2] chmod a+r /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2
2021-07-19T10:14:24.2633122Z [submariner-operator]$ [cluster2] return
2021-07-19T10:14:24.2634070Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:14:24.2652919Z [submariner-operator]$ [cluster2] wait 7003
2021-07-19T10:14:24.2670291Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T10:14:24.2682031Z [submariner-operator]$ [cluster2] print_clusters_message
2021-07-19T10:14:24.2698432Z [submariner-operator]$ [cluster2] cat <<EOM
2021-07-19T10:14:24.2699311Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T10:14:24.2699844Z
2021-07-19T10:14:24.2700747Z export KUBECONFIG=\$(find \$(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T10:14:24.2701352Z
2021-07-19T10:14:24.2702060Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T10:14:24.2702514Z
2021-07-19T10:14:24.2703152Z To clean everthing up, just run: make clean-clusters
2021-07-19T10:14:24.2703781Z EOM
2021-07-19T10:14:24.2718601Z Your virtual cluster(s) are deployed and working properly and can be accessed with:
2021-07-19T10:14:24.2719212Z
2021-07-19T10:14:24.2720355Z export KUBECONFIG=$(find $(git rev-parse --show-toplevel)/output/kubeconfigs/ -type f -printf %p:)
2021-07-19T10:14:24.2721000Z
2021-07-19T10:14:24.2721753Z $ kubectl config use-context cluster1 # or cluster2, cluster3..
2021-07-19T10:14:24.2722240Z
2021-07-19T10:14:24.2723032Z To clean everthing up, just run: make clean-clusters
2021-07-19T10:14:24.2731427Z Successfully remade target file 'clusters'.
2021-07-19T10:14:24.2733178Z File 'preload-images' does not exist.
2021-07-19T10:14:24.2733956Z File 'images' does not exist.
2021-07-19T10:14:24.2739087Z File 'package/.image.submariner-operator' does not exist.
2021-07-19T10:14:24.2796478Z find: 'bin/submariner-operator': No such file or directory
2021-07-19T10:14:24.6000938Z File 'bin/submariner-operator' does not exist.
2021-07-19T10:14:24.6006872Z File 'generate-embeddedyamls' does not exist.
2021-07-19T10:14:24.6007828Z File 'generate' does not exist.
2021-07-19T10:14:24.6008556Z Must remake target 'generate'.
2021-07-19T10:14:24.6031208Z /go/src/github.com/submariner-io/submariner-operator/bin/controller-gen object:headerFile="hack/boilerplate.go.txt,year=2021" paths="./..."
2021-07-19T10:14:28.2546881Z Successfully remade target file 'generate'.
2021-07-19T10:14:28.2660542Z Must remake target 'generate-embeddedyamls'.
2021-07-19T10:14:28.2661733Z Successfully remade target file 'generate-embeddedyamls'.
2021-07-19T10:14:28.2662809Z Must remake target 'bin/submariner-operator'.
2021-07-19T10:14:28.2663505Z /opt/shipyard/scripts/compile.sh \
2021-07-19T10:14:28.2664712Z --ldflags "-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d" \
2021-07-19T10:14:28.2665921Z bin/submariner-operator main.go
2021-07-19T10:14:28.3243253Z [submariner-operator]$ mkdir -p bin
2021-07-19T10:14:28.3257905Z Building 'bin/submariner-operator' (ldflags: '-X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d')
2021-07-19T10:14:28.3267001Z [submariner-operator]$ ldflags=-s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d
2021-07-19T10:14:28.3276850Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X=github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -o bin/submariner-operator main.go
2021-07-19T10:14:45.3052947Z [submariner-operator]$ upx bin/submariner-operator
2021-07-19T10:14:51.2278318Z Ultimate Packer for eXecutables
2021-07-19T10:14:51.2279897Z Copyright (C) 1996 - 2020
2021-07-19T10:14:51.2280549Z UPX 3.96 Markus Oberhumer, Laszlo Molnar & John Reiser Jan 23rd 2020
2021-07-19T10:14:51.2281011Z
2021-07-19T10:14:51.2281485Z File size Ratio Format Name
2021-07-19T10:14:51.2282245Z -------------------- ------ ----------- -----------
2021-07-19T10:14:51.2283273Z 34459648 -> 9933112 28.83% linux/amd64 submariner-operator
2021-07-19T10:14:51.2283714Z
2021-07-19T10:14:51.2284072Z Packed 1 file.
2021-07-19T10:14:51.2301432Z Successfully remade target file 'bin/submariner-operator'.
2021-07-19T10:14:51.2302978Z Prerequisite 'bin/submariner-operator' is newer than target 'package/Dockerfile.submariner-operator'.
2021-07-19T10:14:51.2304573Z Must remake target 'package/Dockerfile.submariner-operator'.
2021-07-19T10:14:51.2305992Z Successfully remade target file 'package/Dockerfile.submariner-operator'.
2021-07-19T10:14:51.2307077Z File 'FORCE_IMAGE' does not exist.
2021-07-19T10:14:51.2307807Z Must remake target 'FORCE_IMAGE'.
2021-07-19T10:14:51.2308601Z Successfully remade target file 'FORCE_IMAGE'.
2021-07-19T10:14:51.2309639Z Must remake target 'package/.image.submariner-operator'.
2021-07-19T10:14:51.2311451Z /opt/shipyard/scripts/build_image.sh -i submariner-operator -f package/Dockerfile.submariner-operator -h package/.image.submariner-operator
2021-07-19T10:14:51.2885721Z flags:WARN flag short name (h) already defined
2021-07-19T10:14:51.3532361Z [submariner-operator]$ set -e
2021-07-19T10:14:51.3547547Z [submariner-operator]$ cache_image=quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:51.3562210Z [submariner-operator]$ cache_flag=
2021-07-19T10:14:51.3578947Z [submariner-operator]$ cache_flag=--cache-from quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:51.3599363Z [submariner-operator]$ docker image ls -q quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:51.6780122Z [submariner-operator]$ docker pull quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:52.2209205Z devel: Pulling from submariner/submariner-operator
2021-07-19T10:14:52.2210248Z 9aabc6bb514c: Pulling fs layer
2021-07-19T10:14:52.4117370Z 9aabc6bb514c: Verifying Checksum
2021-07-19T10:14:52.4118839Z 9aabc6bb514c: Download complete
2021-07-19T10:14:52.6835114Z 9aabc6bb514c: Pull complete
2021-07-19T10:14:52.6871614Z Digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b
2021-07-19T10:14:52.6945086Z Status: Downloaded newer image for quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:52.6981437Z quay.io/submariner/submariner-operator:devel
2021-07-19T10:14:52.7007681Z [submariner-operator]$ grep FROM package/Dockerfile.submariner-operator
2021-07-19T10:14:52.7022315Z [submariner-operator]$ cut -f2 -d 
2021-07-19T10:14:52.7038894Z [submariner-operator]$ grep -v scratch
2021-07-19T10:14:52.7067000Z [submariner-operator]$ buildargs_flag=--build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel
2021-07-19T10:14:52.7082027Z 
2021-07-19T10:14:53.5775140Z [submariner-operator]$ docker buildx use buildx_builder
2021-07-19T10:14:54.4179462Z error: failed to find instance "buildx_builder": open /root/.docker/buildx/instances/buildx_builder: no such file or directory
2021-07-19T10:14:54.4253601Z [submariner-operator]$ docker buildx create --name buildx_builder --use
2021-07-19T10:14:55.3058540Z buildx_builder
2021-07-19T10:14:55.3164984Z [submariner-operator]$ docker buildx build --load -t quay.io/submariner/submariner-operator:dev --cache-from quay.io/submariner/submariner-operator:devel -f package/Dockerfile.submariner-operator --iidfile package/.image.submariner-operator --platform linux/amd64 --build-arg BUILDKIT_INLINE_CACHE=1 --build-arg BASE_BRANCH=devel .
2021-07-19T10:14:56.1861933Z #1 [internal] booting buildkit
2021-07-19T10:14:56.1863854Z #1 sha256:a2232d4eaafb3ed0dc497a4c04247091e59adfea2c50cccd7efd23b008d295be
2021-07-19T10:14:56.3369780Z #1 pulling image moby/buildkit:buildx-stable-1
2021-07-19T10:15:00.5420625Z #1 pulling image moby/buildkit:buildx-stable-1 4.4s done
2021-07-19T10:15:00.6945811Z #1 creating container buildx_buildkit_buildx_builder0
2021-07-19T10:15:01.1427035Z #1 creating container buildx_buildkit_buildx_builder0 0.5s done
2021-07-19T10:15:01.1427620Z #1 DONE 4.9s
2021-07-19T10:15:01.3961662Z
2021-07-19T10:15:01.3963441Z #2 [internal] load build definition from Dockerfile.submariner-operator
2021-07-19T10:15:01.3968681Z #2 sha256:cc0c4249847f48a8c6e95ff775f8f18882a59cb7bcfe2b9b572a31b16a50147a
2021-07-19T10:15:01.3973690Z #2 transferring dockerfile: 230B done
2021-07-19T10:15:01.3976837Z #2 DONE 0.0s
2021-07-19T10:15:01.5479864Z
2021-07-19T10:15:01.5482500Z #3 [internal] load .dockerignore
2021-07-19T10:15:01.5485493Z #3 sha256:dd4a2f55325c9754628aac485d0e75ebb8c6d543cea937ac4fce98227e659d40
2021-07-19T10:15:01.5487079Z #3 transferring context: 2B done
2021-07-19T10:15:01.5489333Z #3 DONE 0.0s
2021-07-19T10:15:01.5491117Z
2021-07-19T10:15:01.5493213Z #4 [internal] load build context
2021-07-19T10:15:01.5495688Z #4 sha256:c0b1c31c918c117140fe18ab3b517afef058d9586a34ade5009564c8f9567acf
2021-07-19T10:15:01.5498146Z #4 DONE 0.0s
2021-07-19T10:15:01.5500209Z
2021-07-19T10:15:01.5503388Z #6 importing cache manifest from quay.io/submariner/submariner-operator:devel
2021-07-19T10:15:01.5505067Z #6 sha256:db6e513456d7d63fd9e86cca8d8a83f1eb0b2eaefc7f50d06048094c1b3ec182
2021-07-19T10:15:01.8511012Z #6 DONE 0.3s
2021-07-19T10:15:01.8511423Z
2021-07-19T10:15:01.8511957Z #4 [internal] load build context
2021-07-19T10:15:01.8512952Z #4 sha256:c0b1c31c918c117140fe18ab3b517afef058d9586a34ade5009564c8f9567acf
2021-07-19T10:15:02.1020371Z #4 transferring context: 9.94MB 0.3s done
2021-07-19T10:15:02.1021125Z #4 DONE 0.3s
2021-07-19T10:15:02.1021371Z
2021-07-19T10:15:02.1022747Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T10:15:02.1024250Z #5 sha256:d8a96f212aedf24cf50dfb9dec6ab9cb253f47870aeeb51e323f7ed85c6e8991
2021-07-19T10:15:02.1025372Z #5 CACHED
2021-07-19T10:15:02.1025625Z
2021-07-19T10:15:02.1026041Z #7 exporting to oci image format
2021-07-19T10:15:02.1027342Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T10:15:02.1028350Z #7 exporting layers done
2021-07-19T10:15:02.1029645Z #7 exporting manifest sha256:de9bbdc497e579259a39507af2f25bbb63c3b0a7ac43576fa382f07e1dd99e1f done
2021-07-19T10:15:02.1031399Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7
2021-07-19T10:15:02.2527442Z #7 exporting config sha256:2d7e862e7c9a7cf6d0fff86d715882397631fcc6b1ba617b2d8a8d78322e83b7 done
2021-07-19T10:15:02.4035771Z #7 ...
2021-07-19T10:15:02.4040849Z
2021-07-19T10:15:02.4044446Z #5 [1/1] COPY bin/submariner-operator /submariner-operator
2021-07-19T10:15:02.4047926Z #5 sha256:d8a96f212aedf24cf50dfb9dec6ab9cb253f47870aeeb51e323f7ed85c6e8991
2021-07-19T10:15:02.4052228Z #5 sha256:9aabc6bb514c8021810110e5fb3bafd3f119cb23f253d128b1b53e2bf65b8a9a 9.62MB / 9.62MB 0.2s done
2021-07-19T10:15:02.4059628Z #5 CACHED
2021-07-19T10:15:02.4060402Z
2021-07-19T10:15:02.4061511Z #7 exporting to oci image format
2021-07-19T10:15:02.4062564Z #7 sha256:69a2560eef4d3ece902c3b5149d142e9bd132f25db0bc9e35b94201534c415d2
2021-07-19T10:15:02.4063548Z #7 sending tarball
2021-07-19T10:15:02.5629818Z #7 sending tarball 0.3s done
2021-07-19T10:15:02.5630477Z #7 DONE 0.5s
2021-07-19T10:15:02.5630737Z
2021-07-19T10:15:02.5631118Z #9 exporting cache
2021-07-19T10:15:02.5632428Z #9 sha256:2700d4ef94dee473593c5c614b55b2dedcca7893909811a8f2b48291a1f581e4
2021-07-19T10:15:02.5633447Z #9 preparing build cache for export done
2021-07-19T10:15:02.5634218Z #9 DONE 0.0s
2021-07-19T10:15:02.5634469Z
2021-07-19T10:15:02.5634850Z #8 importing to docker
2021-07-19T10:15:02.5635799Z #8 sha256:f5166b0b82dbb6f5322aa54ca14c76d8452629372d97a0d203c09faa78a1690e
2021-07-19T10:15:02.5636665Z #8 DONE 0.0s
2021-07-19T10:15:02.5756799Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev quay.io/submariner/submariner-operator:devel
2021-07-19T10:15:02.8800113Z Successfully remade target file 'package/.image.submariner-operator'.
2021-07-19T10:15:02.8801334Z File 'build' does not exist.
2021-07-19T10:15:02.8802352Z File 'bin/subctl-devel-0105e4d-linux-amd64' does not exist.
2021-07-19T10:15:02.9044212Z Must remake target 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T10:15:02.9046885Z mkdir -p bin
2021-07-19T10:15:02.9071440Z target=bin/subctl-devel-0105e4d-linux-amd64; \
2021-07-19T10:15:02.9072706Z target=${target%.exe}; \
2021-07-19T10:15:02.9073424Z components=($(echo ${target//-/ })); \
2021-07-19T10:15:02.9074186Z GOOS=${components[-2]}; \
2021-07-19T10:15:02.9074944Z GOARCH=${components[-1]}; \
2021-07-19T10:15:02.9075434Z export GOARCH GOOS; \
2021-07-19T10:15:02.9075961Z /opt/shipyard/scripts/compile.sh \
2021-07-19T10:15:02.9077399Z --ldflags "-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \
2021-07-19T10:15:02.9079502Z -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=${DEFAULT_IMAGE_VERSION#v}" \
2021-07-19T10:15:02.9081316Z --noupx bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-19T10:15:02.9676331Z [submariner-operator]$ mkdir -p bin
2021-07-19T10:15:02.9694155Z Building 'bin/subctl-devel-0105e4d-linux-amd64' (ldflags: $'-X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d \t\t -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel')
2021-07-19T10:15:02.9710005Z [submariner-operator]$ ldflags=-s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel
2021-07-19T10:15:02.9729584Z [submariner-operator]$ CGO_ENABLED=0 go build -trimpath -ldflags -s -w -X github.com/submariner-io/submariner-operator/pkg/version.Version=devel-0105e4d -X=github.com/submariner-io/submariner-operator/pkg/versions.DefaultSubmarinerOperatorVersion=devel -o bin/subctl-devel-0105e4d-linux-amd64 ./pkg/subctl/main.go
2021-07-19T10:15:06.3278025Z Successfully remade target file 'bin/subctl-devel-0105e4d-linux-amd64'.
2021-07-19T10:15:06.3279542Z Prerequisite 'bin/subctl-devel-0105e4d-linux-amd64' is newer than target 'bin/subctl'.
2021-07-19T10:15:06.3280532Z Must remake target 'bin/subctl'.
2021-07-19T10:15:06.3281404Z ln -sf subctl-devel-0105e4d-linux-amd64 bin/subctl
2021-07-19T10:15:06.3324236Z Successfully remade target file 'bin/subctl'.
2021-07-19T10:15:06.3325055Z Must remake target 'build'.
2021-07-19T10:15:06.3325755Z Successfully remade target file 'build'.
2021-07-19T10:15:06.3326421Z Must remake target 'images'.
2021-07-19T10:15:06.3327119Z Successfully remade target file 'images'.
2021-07-19T10:15:06.3327856Z Must remake target 'preload-images'.
2021-07-19T10:15:06.3328445Z set -e;\
2021-07-19T10:15:06.3328911Z . /opt/shipyard/scripts/lib/deploy_funcs;\
2021-07-19T10:15:06.3329505Z . /opt/shipyard/scripts/lib/debug_functions;\
2021-07-19T10:15:06.3330836Z for image in submariner-operator submariner-gateway submariner-route-agent lighthouse-agent lighthouse-coredns; do\
2021-07-19T10:15:06.3331967Z import_image quay.io/submariner/${image};\
2021-07-19T10:15:06.3332429Z done
2021-07-19T10:15:06.3383486Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-19T10:15:06.3396383Z [submariner-operator]$ import_image quay.io/submariner/submariner-operator
2021-07-19T10:15:06.3412749Z [submariner-operator]$ docker tag quay.io/submariner/submariner-operator:dev localhost:5000/submariner-operator:local
2021-07-19T10:15:06.6375068Z [submariner-operator]$ docker push localhost:5000/submariner-operator:local
2021-07-19T10:15:06.9228209Z The push refers to repository [localhost:5000/submariner-operator]
2021-07-19T10:15:06.9280543Z f9269f9cee12: Preparing
2021-07-19T10:15:07.5627918Z f9269f9cee12: Pushed
2021-07-19T10:15:07.5829329Z local: digest: sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b size: 528
2021-07-19T10:15:07.5869090Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-19T10:15:07.5883635Z [submariner-operator]$ import_image quay.io/submariner/submariner-gateway
2021-07-19T10:15:07.5896510Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-19T10:15:07.8833173Z Error response from daemon: No such image: quay.io/submariner/submariner-gateway:dev
2021-07-19T10:15:07.8861383Z [submariner-operator]$ docker pull quay.io/submariner/submariner-gateway:devel
2021-07-19T10:15:08.4271151Z devel: Pulling from submariner/submariner-gateway
2021-07-19T10:15:08.4273201Z 8c741e919b67: Pulling fs layer
2021-07-19T10:15:08.4276805Z 13495efbbac4: Pulling fs layer
2021-07-19T10:15:08.4277565Z 6df6df193f2d: Pulling fs layer
2021-07-19T10:15:08.4278349Z 3afbe9ee7387: Pulling fs layer
2021-07-19T10:15:08.4278971Z 3afbe9ee7387: Waiting
2021-07-19T10:15:08.5140417Z 13495efbbac4: Verifying Checksum
2021-07-19T10:15:08.5141224Z 13495efbbac4: Download complete
2021-07-19T10:15:08.7762069Z 6df6df193f2d: Verifying Checksum
2021-07-19T10:15:08.7762747Z 6df6df193f2d: Download complete
2021-07-19T10:15:08.8809053Z 3afbe9ee7387: Verifying Checksum
2021-07-19T10:15:08.8809747Z 3afbe9ee7387: Download complete
2021-07-19T10:15:09.0474220Z 8c741e919b67: Verifying Checksum
2021-07-19T10:15:09.0474844Z 8c741e919b67: Download complete
2021-07-19T10:15:12.4626522Z 8c741e919b67: Pull complete
2021-07-19T10:15:13.5798491Z 13495efbbac4: Pull complete
2021-07-19T10:15:15.2497843Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:devel quay.io/submariner/submariner-gateway:dev
2021-07-19T10:15:15.2498986Z 6df6df193f2d: Pull complete
2021-07-19T10:15:15.2499607Z 3afbe9ee7387: Pull complete
2021-07-19T10:15:15.2500867Z Digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895
2021-07-19T10:15:15.2502348Z Status: Downloaded newer image for quay.io/submariner/submariner-gateway:devel
2021-07-19T10:15:15.2503436Z quay.io/submariner/submariner-gateway:devel
2021-07-19T10:15:15.2863224Z [submariner-operator]$ docker tag quay.io/submariner/submariner-gateway:dev localhost:5000/submariner-gateway:local
2021-07-19T10:15:15.5684841Z [submariner-operator]$ docker push localhost:5000/submariner-gateway:local
2021-07-19T10:15:15.8819543Z The push refers to repository [localhost:5000/submariner-gateway]
2021-07-19T10:15:15.8871187Z 71972a942ed4: Preparing
2021-07-19T10:15:15.8872526Z 3c7f2d60eacb: Preparing
2021-07-19T10:15:15.8873503Z 00c5f6897675: Preparing
2021-07-19T10:15:15.8874051Z b3b62c837788: Preparing
2021-07-19T10:15:16.6706806Z 00c5f6897675: Pushed
2021-07-19T10:15:17.2463458Z 71972a942ed4: Pushed
2021-07-19T10:15:20.7294181Z 3c7f2d60eacb: Pushed
2021-07-19T10:15:28.8661643Z b3b62c837788: Pushed
2021-07-19T10:15:28.8846929Z local: digest: sha256:16252ca036cdc08183e3368d617ba5b424b6b2c09a9103dce35a0044453bf895 size: 1159
2021-07-19T10:15:28.8882172Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-19T10:15:28.8898901Z [submariner-operator]$ import_image quay.io/submariner/submariner-route-agent
2021-07-19T10:15:28.8910519Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-19T10:15:29.1701343Z Error response from daemon: No such image: quay.io/submariner/submariner-route-agent:dev
2021-07-19T10:15:29.1734190Z [submariner-operator]$ docker pull quay.io/submariner/submariner-route-agent:devel
2021-07-19T10:15:29.7247248Z devel: Pulling from submariner/submariner-route-agent
2021-07-19T10:15:29.7248100Z 8c741e919b67: Already exists
2021-07-19T10:15:29.7260015Z 13495efbbac4: Already exists
2021-07-19T10:15:29.7286314Z 70cc6422093d: Pulling fs layer
2021-07-19T10:15:29.7286872Z 7ba74d821748: Pulling fs layer
2021-07-19T10:15:29.7287382Z 62b0802bcf90: Pulling fs layer
2021-07-19T10:15:29.7287888Z 3e9c83283ee4: Pulling fs layer
2021-07-19T10:15:29.7288356Z 3e9c83283ee4: Waiting
2021-07-19T10:15:29.8143011Z 62b0802bcf90: Verifying Checksum
2021-07-19T10:15:29.8149577Z 62b0802bcf90: Download complete
2021-07-19T10:15:29.8955031Z 7ba74d821748: Verifying Checksum
2021-07-19T10:15:29.8955636Z 7ba74d821748: Download complete
2021-07-19T10:15:29.9132703Z 3e9c83283ee4: Verifying Checksum
2021-07-19T10:15:29.9133424Z 3e9c83283ee4: Download complete
2021-07-19T10:15:30.0268330Z 70cc6422093d: Verifying Checksum
2021-07-19T10:15:30.0269281Z 70cc6422093d: Download complete
2021-07-19T10:15:31.5248939Z 70cc6422093d: Pull complete
2021-07-19T10:15:31.7895454Z 7ba74d821748: Pull complete
2021-07-19T10:15:31.8719294Z 62b0802bcf90: Pull complete
2021-07-19T10:15:31.9761886Z 3e9c83283ee4: Pull complete
2021-07-19T10:15:31.9803033Z Digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c
2021-07-19T10:15:31.9815257Z Status: Downloaded newer image for quay.io/submariner/submariner-route-agent:devel
2021-07-19T10:15:31.9859272Z quay.io/submariner/submariner-route-agent:devel
2021-07-19T10:15:31.9915999Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:devel quay.io/submariner/submariner-route-agent:dev
2021-07-19T10:15:32.2832621Z [submariner-operator]$ docker tag quay.io/submariner/submariner-route-agent:dev localhost:5000/submariner-route-agent:local
2021-07-19T10:15:32.5765819Z [submariner-operator]$ docker push localhost:5000/submariner-route-agent:local
2021-07-19T10:15:32.8691023Z The push refers to repository [localhost:5000/submariner-route-agent]
2021-07-19T10:15:32.8797208Z 1d810a4c0610: Preparing
2021-07-19T10:15:32.8802157Z 7a86b74623fc: Preparing
2021-07-19T10:15:32.8802652Z 26de773c4486: Preparing
2021-07-19T10:15:32.8803140Z 6931e591f8e2: Preparing
2021-07-19T10:15:32.8805962Z 00c5f6897675: Preparing
2021-07-19T10:15:32.8808845Z b3b62c837788: Preparing
2021-07-19T10:15:32.8812563Z b3b62c837788: Waiting
2021-07-19T10:15:33.1120698Z 00c5f6897675: Mounted from submariner-gateway
2021-07-19T10:15:33.5941133Z 1d810a4c0610: Pushed
2021-07-19T10:15:33.6401001Z b3b62c837788: Mounted from submariner-gateway
2021-07-19T10:15:33.6401656Z 7a86b74623fc: Pushed
2021-07-19T10:15:33.6463777Z 26de773c4486: Pushed
2021-07-19T10:15:37.7720320Z 6931e591f8e2: Pushed
2021-07-19T10:15:37.7962548Z local: digest: sha256:1b9fb51c2e4e74ff6e1f02bef98d8998d772ad01e73ece5e247462590d8c8c4c size: 1575
2021-07-19T10:15:37.8005265Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-19T10:15:37.8013067Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-agent
2021-07-19T10:15:37.8025246Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-19T10:15:38.0867703Z Error response from daemon: No such image: quay.io/submariner/lighthouse-agent:dev
2021-07-19T10:15:38.0890274Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-agent:devel
2021-07-19T10:15:38.6154244Z devel: Pulling from submariner/lighthouse-agent
2021-07-19T10:15:38.6156396Z ecd69139dc76: Pulling fs layer
2021-07-19T10:15:38.6160447Z 8261c1767de3: Pulling fs layer
2021-07-19T10:15:38.7003544Z ecd69139dc76: Verifying Checksum
2021-07-19T10:15:38.7004203Z ecd69139dc76: Download complete
2021-07-19T10:15:38.8085435Z ecd69139dc76: Pull complete
2021-07-19T10:15:38.8575850Z 8261c1767de3: Verifying Checksum
2021-07-19T10:15:38.8576473Z 8261c1767de3: Download complete
2021-07-19T10:15:39.0329728Z 8261c1767de3: Pull complete
2021-07-19T10:15:39.0365441Z Digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f
2021-07-19T10:15:39.0384985Z Status: Downloaded newer image for quay.io/submariner/lighthouse-agent:devel
2021-07-19T10:15:39.0412200Z quay.io/submariner/lighthouse-agent:devel
2021-07-19T10:15:39.0475146Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:devel quay.io/submariner/lighthouse-agent:dev
2021-07-19T10:15:39.3366756Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-agent:dev localhost:5000/lighthouse-agent:local
2021-07-19T10:15:39.6479675Z [submariner-operator]$ docker push localhost:5000/lighthouse-agent:local
2021-07-19T10:15:39.9368795Z The push refers to repository [localhost:5000/lighthouse-agent]
2021-07-19T10:15:39.9474640Z 83c79e393e11: Preparing
2021-07-19T10:15:39.9477949Z 0026d2f62bbf: Preparing
2021-07-19T10:15:39.9940687Z 0026d2f62bbf: Pushed
2021-07-19T10:15:40.4801133Z 83c79e393e11: Pushed
2021-07-19T10:15:40.4981365Z local: digest: sha256:93957d5e6a2d72de099dcf9f589a4321618b426900e681d3837a17c64c38d69f size: 735
2021-07-19T10:15:40.5015794Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-19T10:15:40.5029092Z [submariner-operator]$ import_image quay.io/submariner/lighthouse-coredns
2021-07-19T10:15:40.5045730Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-19T10:15:40.7996640Z Error response from daemon: No such image: quay.io/submariner/lighthouse-coredns:dev
2021-07-19T10:15:40.8021374Z [submariner-operator]$ docker pull quay.io/submariner/lighthouse-coredns:devel
2021-07-19T10:15:41.3353169Z devel: Pulling from submariner/lighthouse-coredns
2021-07-19T10:15:41.3354000Z 088e56360f76: Pulling fs layer
2021-07-19T10:15:41.3354550Z 18aed70882d2: Pulling fs layer
2021-07-19T10:15:41.4258930Z 088e56360f76: Verifying Checksum
2021-07-19T10:15:41.4259528Z 088e56360f76: Download complete
2021-07-19T10:15:41.5519482Z 18aed70882d2: Verifying Checksum
2021-07-19T10:15:41.5520149Z 18aed70882d2: Download complete
2021-07-19T10:15:41.6251427Z 088e56360f76: Pull complete
2021-07-19T10:15:41.9109165Z 18aed70882d2: Pull complete
2021-07-19T10:15:41.9150168Z Digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595
2021-07-19T10:15:41.9190795Z Status: Downloaded newer image for quay.io/submariner/lighthouse-coredns:devel
2021-07-19T10:15:41.9192728Z quay.io/submariner/lighthouse-coredns:devel
2021-07-19T10:15:41.9201729Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:devel quay.io/submariner/lighthouse-coredns:dev
2021-07-19T10:15:42.2136340Z [submariner-operator]$ docker tag quay.io/submariner/lighthouse-coredns:dev localhost:5000/lighthouse-coredns:local
2021-07-19T10:15:42.5106624Z [submariner-operator]$ docker push localhost:5000/lighthouse-coredns:local
2021-07-19T10:15:42.7969134Z The push refers to repository [localhost:5000/lighthouse-coredns]
2021-07-19T10:15:42.8081042Z 7fca351e51be: Preparing
2021-07-19T10:15:42.8081621Z 4fa0ece06e25: Preparing
2021-07-19T10:15:42.8659961Z 4fa0ece06e25: Pushed
2021-07-19T10:15:43.5600624Z 7fca351e51be: Pushed
2021-07-19T10:15:43.5817718Z local: digest: sha256:d7e32908d5d6c680b813e0444db977c5b7578f7480fc650826c6dc993bbce595 size: 739
2021-07-19T10:15:43.5847710Z Successfully remade target file 'preload-images'.
2021-07-19T10:15:43.5848741Z Prerequisite 'clusters' of target 'deploy' does not exist.
2021-07-19T10:15:43.5849789Z Prerequisite 'preload-images' of target 'deploy' does not exist.
2021-07-19T10:15:43.5850890Z Prerequisite 'bin/subctl' is newer than target 'deploy'.
2021-07-19T10:15:43.5851665Z Must remake target 'deploy'.
2021-07-19T10:15:43.5853006Z /opt/shipyard/scripts/deploy.sh --cluster_settings /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:15:43.6937659Z Running with: globalnet='false', deploytool='operator', deploytool_broker_args='', deploytool_submariner_args='', cluster_settings='/go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings', timeout=5m, image_tag=local, cable_driver=libreswan, service_discovery=false
2021-07-19T10:15:43.6968929Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T10:15:43.6980758Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:15:43.6994094Z [submariner-operator]$ script_name=utils
2021-07-19T10:15:43.7005374Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:15:43.7028625Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-19T10:15:43.7043760Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:15:43.7057621Z [submariner-operator]$ script_name=deploy_funcs
2021-07-19T10:15:43.7071128Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:15:43.7095961Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T10:15:43.7107845Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:15:43.7122677Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:15:43.7136391Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:15:43.7160012Z [submariner-operator]$ broker=cluster1
2021-07-19T10:15:43.7174614Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T10:15:43.7186827Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T10:15:43.7197238Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T10:15:43.7212446Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T10:15:43.7226657Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T10:15:43.7238493Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T10:15:43.7252706Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T10:15:43.7266443Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T10:15:43.7280313Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T10:15:43.7294568Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T10:15:43.7308370Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T10:15:43.7323869Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:15:43.7343495Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:15:43.7354377Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:15:43.7367591Z [submariner-operator]$ exec_name=deploy.sh
2021-07-19T10:15:43.7392854Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T10:15:43.7404756Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T10:15:43.7436396Z [submariner-operator]$ declare_cidrs
2021-07-19T10:15:43.7450231Z [submariner-operator]$ declare_cidrs
2021-07-19T10:15:43.7463435Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T10:15:43.7479389Z [submariner-operator]$ i=1
2021-07-19T10:15:43.7494711Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:15:43.7508564Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:15:43.7528371Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-19T10:15:43.7541873Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-19T10:15:43.7553737Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T10:15:43.7562239Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:15:43.7575470Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:15:43.7592072Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-19T10:15:43.7611432Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-19T10:15:43.7627083Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T10:15:43.7643092Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T10:15:43.7659616Z [submariner-operator]$ [cluster2] declare_kubeconfig
2021-07-19T10:15:43.7672391Z [submariner-operator]$ [cluster2] source /opt/shipyard/scripts/lib/kubecfg
2021-07-19T10:15:43.7693969Z [submariner-operator]$ [cluster2] export KUBECONFIG
2021-07-19T10:15:43.7710044Z [submariner-operator]$ [cluster2] KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-19T10:15:43.7745096Z [submariner-operator]$ [cluster2] find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-19T10:15:43.7775793Z [submariner-operator]$ [cluster2] bash -c curl -Ls https://get.submariner.io | VERSION=devel DESTDIR=/go/bin bash
2021-07-19T10:15:43.8910564Z Installing subctl version devel
2021-07-19T10:15:43.8911287Z OS detected: linux
2021-07-19T10:15:43.8916084Z Architecture detected: amd64
2021-07-19T10:15:43.8918095Z Download URL: https://github.com/submariner-io/submariner-operator/releases/download/subctl-devel/subctl-devel-linux-amd64.tar.xz
2021-07-19T10:15:43.8921666Z
2021-07-19T10:15:43.8922658Z Downloading...
2021-07-19T10:15:45.1629393Z subctl-devel-linux-amd64 has been installed as /go/bin/subctl
2021-07-19T10:15:45.1837276Z This provides subctl version: devel
2021-07-19T10:15:45.1855625Z
2021-07-19T10:15:45.1858636Z please update your path (and consider adding it to ~/.profile):
2021-07-19T10:15:45.1859288Z export PATH=$PATH:/go/bin
2021-07-19T10:15:45.1859693Z
2021-07-19T10:15:45.1963669Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T10:15:45.1977787Z [submariner-operator]$ [cluster2] load_deploytool operator
2021-07-19T10:15:45.1982647Z Will deploy submariner using operator
2021-07-19T10:15:45.1995892Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/deploy_operator
2021-07-19T10:15:45.2014534Z [submariner-operator]$ [cluster2] . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:15:45.2026477Z [submariner-operator]$ [cluster2] script_name=deploy_operator
2021-07-19T10:15:45.2040595Z [submariner-operator]$ [cluster2] exec_name=deploy.sh
2021-07-19T10:15:45.2065140Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T10:15:45.2075635Z [submariner-operator]$ [cluster2] deploytool_prereqs
2021-07-19T10:15:45.2097670Z 
2021-07-19T10:15:45.2112590Z [submariner-operator]$ [cluster2] subctl version
2021-07-19T10:15:45.2386969Z subctl version: devel-0105e4d
2021-07-19T10:15:45.2423919Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T10:15:45.2436742Z [submariner-operator]$ [cluster2] run_if_defined pre_deploy
2021-07-19T10:15:45.2451147Z [submariner-operator]$ [cluster2] type -t pre_deploy
2021-07-19T10:15:45.2466799Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T10:15:45.2529989Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:15:45.2597286Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T10:15:45.2615059Z [submariner-operator]$ [cluster2] run_subm_clusters prepare_cluster
2021-07-19T10:15:45.2633062Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T10:15:45.2705476Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 prepare_cluster
2021-07-19T10:15:45.2730173Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 prepare_cluster
2021-07-19T10:15:45.2740813Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:15:45.2757099Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:15:45.2783923Z [submariner-operator]$ [cluster1] pids[cluster1]=8637
2021-07-19T10:15:45.2801285Z [submariner-operator]$ [cluster2] pids[cluster2]=8639
2021-07-19T10:15:45.2816633Z [submariner-operator]$ [cluster2] wait 8639
2021-07-19T10:15:45.2834794Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:15:45.2846004Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:15:45.2859482Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T10:15:45.2870766Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T10:15:45.2890595Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:15:45.2916093Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:15:45.7173544Z [submariner-operator]$ [cluster2] prepare_cluster
2021-07-19T10:15:45.7174708Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T10:15:45.7175750Z [submariner-operator]$ [cluster2] add_subm_gateway_label
2021-07-19T10:15:45.7177154Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7178796Z [submariner-operator]$ [cluster2] kubectl label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7180561Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 label node cluster2-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7181894Z [cluster2] node/cluster2-worker not labeled
2021-07-19T10:15:45.7250658Z [submariner-operator]$ [cluster2] wait 8637
2021-07-19T10:15:45.7478337Z [submariner-operator]$ [cluster1] prepare_cluster
2021-07-19T10:15:45.7480027Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T10:15:45.7481254Z [submariner-operator]$ [cluster1] add_subm_gateway_label
2021-07-19T10:15:45.7482776Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7484774Z [submariner-operator]$ [cluster1] kubectl label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7486735Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 label node cluster1-worker submariner.io/gateway=true --overwrite
2021-07-19T10:15:45.7488838Z [cluster1] node/cluster1-worker not labeled
2021-07-19T10:15:45.7511517Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T10:15:45.7538207Z [submariner-operator]$ [cluster2] with_context cluster1 setup_broker
2021-07-19T10:15:45.7563201Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T10:15:45.7578216Z [submariner-operator]$ [cluster1] setup_broker
2021-07-19T10:15:45.7587175Z Installing broker...
2021-07-19T10:15:45.7602553Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T10:15:45.7619363Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-19T10:15:45.7641182Z [submariner-operator]$ [cluster1] cd /go/src/github.com/submariner-io/submariner-operator/output
2021-07-19T10:15:45.7660290Z [output]$ [cluster1] subctl deploy-broker --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --repository localhost:5000 --version local
2021-07-19T10:15:45.7875018Z • Setting up broker RBAC ...
2021-07-19T10:15:45.8534592Z ✓ Setting up broker RBAC
2021-07-19T10:15:45.8535391Z • Deploying the Submariner operator ...
2021-07-19T10:15:52.0503319Z ✓ Deploying the Submariner operator
2021-07-19T10:15:52.0504383Z ✓ Created operator service account and role
2021-07-19T10:15:52.0505261Z ✓ Created Lighthouse service accounts and roles
2021-07-19T10:15:52.0506029Z • Deploying the broker ...
2021-07-19T10:15:53.1670285Z ✓ Deploying the broker
2021-07-19T10:15:53.1671199Z ✓ The broker has been deployed
2021-07-19T10:15:53.1672435Z • Creating broker-info.subm file ...
2021-07-19T10:15:53.1787151Z ✓ Creating broker-info.subm file
2021-07-19T10:15:53.1788481Z ✓ Backed up previous broker-info.subm to broker-info.subm.2021-07-19T10_15_53Z
2021-07-19T10:15:53.1802661Z ⚠ Reusing IPsec PSK from existing broker-info.subm
2021-07-19T10:15:53.1851270Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T10:15:53.1869188Z [submariner-operator]$ [cluster2] install_subm_all_clusters
2021-07-19T10:15:53.1887847Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T10:15:53.1905264Z [submariner-operator]$ [cluster2] run_subm_clusters subctl_install_subm
2021-07-19T10:15:53.1922819Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T10:15:53.1991611Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 subctl_install_subm
2021-07-19T10:15:53.2009262Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 subctl_install_subm
2021-07-19T10:15:53.2023251Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:15:53.2042148Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:15:53.2075603Z [submariner-operator]$ [cluster1] pids[cluster1]=8703
2021-07-19T10:15:53.2099467Z [submariner-operator]$ [cluster2] pids[cluster2]=8706
2021-07-19T10:15:53.2109434Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:15:53.2121934Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:15:53.2134706Z [submariner-operator]$ [cluster2] wait 8706
2021-07-19T10:15:53.2144181Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T10:15:53.2150733Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T10:15:53.2173389Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:15:53.2189993Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:16:12.6817781Z [submariner-operator]$ [cluster2] subctl_install_subm
2021-07-19T10:16:12.6818993Z [submariner-operator]$ [cluster2] subctlrepver=
2021-07-19T10:16:12.6820268Z [submariner-operator]$ [cluster2] subctlrepver=--repository localhost:5000 --version local
2021-07-19T10:16:12.6821468Z [submariner-operator]$ [cluster2] PASS_CIDR_ARGS=false
2021-07-19T10:16:12.6824475Z [submariner-operator]$ [cluster2] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster2 --clusterid cluster2 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T10:16:12.6827538Z [cluster2] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T10:16:12.6828620Z [cluster2] * There are 1 labeled nodes in the cluster:
2021-07-19T10:16:12.6829356Z [cluster2] - cluster2-worker
2021-07-19T10:16:12.6830121Z [cluster2] • Discovering network details ...
2021-07-19T10:16:12.6831036Z [cluster2] Network plugin: weave-net
2021-07-19T10:16:12.6831602Z [cluster2] Service CIDRs: [100.2.0.0/16]
2021-07-19T10:16:12.6832437Z [cluster2] Cluster CIDRs: [10.2.0.0/16]
2021-07-19T10:16:12.6833219Z [cluster2] ✓ Discovering network details
2021-07-19T10:16:12.6834212Z [cluster2] • Discovering multi cluster details ...
2021-07-19T10:16:12.6835124Z [cluster2] • Validating Globalnet configurations ...
2021-07-19T10:16:12.6836053Z [cluster2] ✓ Validating Globalnet configurations
2021-07-19T10:16:12.6836927Z [cluster2] ✓ Discovering multi cluster details
2021-07-19T10:16:12.6837798Z [cluster2] • Deploying the Submariner operator ...
2021-07-19T10:16:12.6838664Z [cluster2] ✓ Deploying the Submariner operator
2021-07-19T10:16:12.6839566Z [cluster2] ✓ Created operator service account and role
2021-07-19T10:16:12.6840498Z [cluster2] ✓ Created Lighthouse service accounts and roles
2021-07-19T10:16:12.6841342Z [cluster2] • Creating SA for cluster ...
2021-07-19T10:16:12.6842068Z [cluster2] ✓ Creating SA for cluster
2021-07-19T10:16:12.6842821Z [cluster2] • Deploying Submariner ...
2021-07-19T10:16:12.6843579Z [cluster2] ✓ Deploying Submariner
2021-07-19T10:16:12.6844333Z [cluster2] ✓ Submariner is up and running
2021-07-19T10:16:12.6867616Z [submariner-operator]$ [cluster2] wait 8703
2021-07-19T10:16:17.4760684Z [submariner-operator]$ [cluster1] subctl_install_subm
2021-07-19T10:16:17.4761726Z [submariner-operator]$ [cluster1] subctlrepver=
2021-07-19T10:16:17.4762885Z [submariner-operator]$ [cluster1] subctlrepver=--repository localhost:5000 --version local
2021-07-19T10:16:17.4764012Z [submariner-operator]$ [cluster1] PASS_CIDR_ARGS=false
2021-07-19T10:16:17.4766831Z [submariner-operator]$ [cluster1] subctl join --kubeconfig /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs/kind-config-cluster1 --clusterid cluster1 --repository localhost:5000 --version local --nattport 4500 --ikeport 500 --colorcodes blue --globalnet-cidr --natt=false --cable-driver libreswan /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm
2021-07-19T10:16:17.4769788Z [cluster1] * /go/src/github.com/submariner-io/submariner-operator/output/broker-info.subm says broker is at: https://172.18.0.6:6443
2021-07-19T10:16:17.4770879Z [cluster1] * There are 1 labeled nodes in the cluster:
2021-07-19T10:16:17.4771626Z [cluster1] - cluster1-worker
2021-07-19T10:16:17.4772373Z [cluster1] • Discovering network details ...
2021-07-19T10:16:17.4773130Z [cluster1] Network plugin: weave-net
2021-07-19T10:16:17.4773677Z [cluster1] Service CIDRs: [100.1.0.0/16]
2021-07-19T10:16:17.4774195Z [cluster1] Cluster CIDRs: [10.1.0.0/16]
2021-07-19T10:16:17.4775074Z [cluster1] ✓ Discovering network details
2021-07-19T10:16:17.4775879Z [cluster1] • Discovering multi cluster details ...
2021-07-19T10:16:17.4776707Z [cluster1] • Validating Globalnet configurations ...
2021-07-19T10:16:17.4777566Z [cluster1] ✓ Validating Globalnet configurations
2021-07-19T10:16:17.4778383Z [cluster1] ✓ Discovering multi cluster details
2021-07-19T10:16:17.4779175Z [cluster1] • Deploying the Submariner operator ...
2021-07-19T10:16:17.4779990Z [cluster1] ✓ Deploying the Submariner operator
2021-07-19T10:16:17.4780839Z [cluster1] ✓ Created Lighthouse service accounts and roles
2021-07-19T10:16:17.4781623Z [cluster1] • Creating SA for cluster ...
2021-07-19T10:16:17.4782292Z [cluster1] ✓ Creating SA for cluster
2021-07-19T10:16:17.4782989Z [cluster1] • Deploying Submariner ...
2021-07-19T10:16:17.4783672Z [cluster1] ✓ Deploying Submariner
2021-07-19T10:16:17.4784380Z [cluster1] ✓ Submariner is up and running
2021-07-19T10:16:17.4846370Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T10:16:17.4862208Z [submariner-operator]$ [cluster2] with_context cluster2 with_retries 30 verify_gw_status
2021-07-19T10:16:17.4881244Z [submariner-operator]$ [cluster2] with_retries 30 verify_gw_status
2021-07-19T10:16:17.4899414Z [submariner-operator]$ [cluster2] with_retries
2021-07-19T10:16:17.4930387Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:16:17.4960854Z [submariner-operator]$ [cluster2] wait 8747
2021-07-19T10:16:17.4979437Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:17.4994732Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:17.5009901Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:16:17.5024949Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:17.5044382Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:16:17.5944868Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:17.5974221Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:16:17.6901244Z • Showing Connections ...
2021-07-19T10:16:17.7137359Z ✗ Showing Connections
2021-07-19T10:16:17.7138184Z ✗ There are no gateways detected
2021-07-19T10:16:17.7282901Z • Showing Connections ...
2021-07-19T10:16:17.7301084Z ✗ Showing Connections
2021-07-19T10:16:17.7301759Z ✗ There are no gateways detected
2021-07-19T10:16:17.7330111Z iter: 1. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:16:17.7343664Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:16:23.7389554Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:16:23.7464024Z [submariner-operator]$ [cluster2] wait 8774
2021-07-19T10:16:23.7481558Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:23.7516757Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:23.7562208Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:16:23.7598482Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:23.7628325Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:16:23.9490250Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:23.9536887Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:16:24.1349639Z • Showing Connections ...
2021-07-19T10:16:24.1388630Z ✗ Showing Connections
2021-07-19T10:16:24.1393428Z ✗ There are no gateways detected
2021-07-19T10:16:24.3179019Z • Showing Connections ...
2021-07-19T10:16:24.3826082Z ✗ Showing Connections
2021-07-19T10:16:24.3832013Z ✗ There are no gateways detected
2021-07-19T10:16:24.3862331Z iter: 2. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:16:24.3878017Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:16:30.3908482Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:16:30.3975300Z [submariner-operator]$ [cluster2] wait 8801
2021-07-19T10:16:30.3996852Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:30.4034380Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:30.4091994Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:16:30.4149586Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:30.4224890Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:16:31.0447569Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:31.0462051Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:16:31.3267451Z • Showing Connections ...
2021-07-19T10:16:31.3663150Z ✗ Showing Connections
2021-07-19T10:16:31.3663922Z ✗ There are no gateways detected
2021-07-19T10:16:31.4743168Z • Showing Connections ...
2021-07-19T10:16:31.5061274Z ✗ Showing Connections
2021-07-19T10:16:31.5062120Z ✗ There are no gateways detected
2021-07-19T10:16:31.5092314Z iter: 3. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:16:31.5105510Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:16:37.5133402Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:16:38.2760726Z [submariner-operator]$ [cluster2] wait 8828
2021-07-19T10:16:38.2761557Z iter: 4. Clusters not yet connected. sleeping for 6 secs
2021-07-19T10:16:38.2769388Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:38.2770598Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:38.2771748Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:16:38.2773102Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:38.2774494Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:16:38.2775824Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:38.2777011Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:16:38.2777976Z • Showing Connections ...
2021-07-19T10:16:38.2778745Z ✗ Showing Connections
2021-07-19T10:16:38.2779622Z ✗ No connections found
2021-07-19T10:16:38.2783191Z • Showing Connections ...
2021-07-19T10:16:38.2783839Z ✗ Showing Connections
2021-07-19T10:16:38.2784456Z ✗ No connections found
2021-07-19T10:16:38.2785273Z [submariner-operator]$ [cluster2] sleep 6
2021-07-19T10:16:44.1724506Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:16:44.1767363Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:44.1773632Z [submariner-operator]$ [cluster2] wait 8855
2021-07-19T10:16:44.1777672Z [submariner-operator]$ [cluster2] verify_gw_status
2021-07-19T10:16:44.1787161Z [submariner-operator]$ [cluster2] sleep_duration=6
2021-07-19T10:16:44.1802166Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:44.1817727Z [submariner-operator]$ [cluster2] grep the server could not find the requested resource
2021-07-19T10:16:44.2474653Z [submariner-operator]$ [cluster2] subctl show connections
2021-07-19T10:16:44.2496057Z [submariner-operator]$ [cluster2] grep connected
2021-07-19T10:16:44.2904847Z • Showing Connections ...
2021-07-19T10:16:44.2945084Z ✓ Showing Connections
2021-07-19T10:16:44.3093347Z • Showing Connections ...
2021-07-19T10:16:44.3126093Z ✓ Showing Connections
2021-07-19T10:16:44.3149147Z cluster1-worker cluster1 172.18.0.8 no libreswan 100.1.0.0/16, 10.1.0.0/16 connected 0s
2021-07-19T10:16:44.3165840Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:16:44.3180664Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:16:44.3195283Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T10:16:44.3208762Z [submariner-operator]$ [cluster2] with_context cluster2 connectivity_tests cluster1
2021-07-19T10:16:44.3223765Z [submariner-operator]$ [cluster2] connectivity_tests cluster1
2021-07-19T10:16:44.3237050Z [submariner-operator]$ [cluster2] connectivity_tests
2021-07-19T10:16:44.3250439Z [submariner-operator]$ [cluster2] target_cluster=cluster1
2021-07-19T10:16:44.3263051Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T10:16:44.3278239Z [submariner-operator]$ [cluster2] import_image quay.io/submariner/nettest
2021-07-19T10:16:44.3295941Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-19T10:16:44.6616964Z Error response from daemon: No such image: quay.io/submariner/nettest:dev
2021-07-19T10:16:44.6678252Z [submariner-operator]$ [cluster2] docker pull quay.io/submariner/nettest:devel
2021-07-19T10:16:45.2585310Z devel: Pulling from submariner/nettest
2021-07-19T10:16:45.2586155Z 5843afab3874: Already exists
2021-07-19T10:16:45.2602857Z 9565bb92f43f: Pulling fs layer
2021-07-19T10:16:45.2603949Z a31c0d5b4ad6: Pulling fs layer
2021-07-19T10:16:45.2606833Z dc3d13650205: Pulling fs layer
2021-07-19T10:16:45.3467433Z 9565bb92f43f: Download complete
2021-07-19T10:16:45.3627615Z dc3d13650205: Verifying Checksum
2021-07-19T10:16:45.3628256Z dc3d13650205: Download complete
2021-07-19T10:16:45.4526679Z a31c0d5b4ad6: Verifying Checksum
2021-07-19T10:16:45.4527533Z a31c0d5b4ad6: Download complete
2021-07-19T10:16:45.4855762Z 9565bb92f43f: Pull complete
2021-07-19T10:16:45.9302967Z a31c0d5b4ad6: Pull complete
2021-07-19T10:16:46.0280031Z dc3d13650205: Pull complete
2021-07-19T10:16:46.0322382Z Digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f
2021-07-19T10:16:46.0339989Z Status: Downloaded newer image for quay.io/submariner/nettest:devel
2021-07-19T10:16:46.0436038Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:devel quay.io/submariner/nettest:dev
2021-07-19T10:16:46.0437063Z quay.io/submariner/nettest:devel
2021-07-19T10:16:46.3640591Z [submariner-operator]$ [cluster2] docker tag quay.io/submariner/nettest:dev localhost:5000/nettest:local
2021-07-19T10:16:46.6715697Z [submariner-operator]$ [cluster2] docker push localhost:5000/nettest:local
2021-07-19T10:16:46.9656962Z The push refers to repository [localhost:5000/nettest]
2021-07-19T10:16:46.9810327Z 4f2cdf68c81d: Preparing
2021-07-19T10:16:46.9810862Z 1f803d62c8b3: Preparing
2021-07-19T10:16:46.9815836Z 80c9eaab4c9e: Preparing
2021-07-19T10:16:46.9821158Z 72e830a4dff5: Preparing
2021-07-19T10:16:47.6061799Z 4f2cdf68c81d: Pushed
2021-07-19T10:16:47.6102559Z 80c9eaab4c9e: Pushed
2021-07-19T10:16:47.6227783Z 72e830a4dff5: Pushed
2021-07-19T10:16:48.2325962Z 1f803d62c8b3: Pushed
2021-07-19T10:16:48.2543683Z local: digest: sha256:ef019e5e56af44d25e621cd556d8f40edcd641d0acd17c307486b4f4047b848f size: 1155
2021-07-19T10:16:48.2622178Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:16:48.2639226Z [submariner-operator]$ [cluster2] deploy_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:16:48.2656489Z [submariner-operator]$ [cluster2] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T10:16:48.2677679Z [submariner-operator]$ [cluster2] basename /opt/shipyard/scripts/resources/netshoot.yaml .yaml
2021-07-19T10:16:48.2697562Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:16:48.2712667Z [submariner-operator]$ [cluster2] kubectl apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:16:48.2728331Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 apply -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:16:48.8054432Z deployment.apps/netshoot created
2021-07-19T10:16:48.8206463Z Waiting for netshoot pods to be ready.
2021-07-19T10:16:48.8217949Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T10:16:48.8229182Z [submariner-operator]$ [cluster2] kubectl rollout status deploy/netshoot --timeout=5m
2021-07-19T10:16:48.8241441Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 rollout status deploy/netshoot --timeout=5m
2021-07-19T10:16:49.1498492Z Waiting for deployment "netshoot" rollout to finish: 0 of 1 updated replicas are available...
2021-07-19T10:16:50.8558791Z deployment "netshoot" successfully rolled out
2021-07-19T10:16:50.8615800Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:50.8628818Z [submariner-operator]$ [cluster2] with_context cluster1 deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:50.8648380Z [submariner-operator]$ [cluster1] deploy_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:50.8663457Z [submariner-operator]$ [cluster1] deploy_resource
2021-07-19T10:16:50.8682343Z [submariner-operator]$ [cluster1] resource_name=$(basename "$resource_file" ".yaml")
2021-07-19T10:16:50.8700855Z [submariner-operator]$ [cluster1] basename /opt/shipyard/scripts/resources/nginx-demo.yaml .yaml
2021-07-19T10:16:50.8721810Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:50.8733918Z [submariner-operator]$ [cluster1] kubectl apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:50.8750096Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 apply -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:16:51.4805251Z deployment.apps/nginx-demo created
2021-07-19T10:16:51.5097526Z service/nginx-demo created
2021-07-19T10:16:51.6125297Z serviceexport.multicluster.x-k8s.io/nginx-demo created
2021-07-19T10:16:51.6202909Z Waiting for nginx-demo pods to be ready.
2021-07-19T10:16:51.6220720Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:16:51.6255604Z [submariner-operator]$ [cluster1] kubectl rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:16:51.6304560Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 rollout status deploy/nginx-demo --timeout=5m
2021-07-19T10:16:52.0511151Z Waiting for deployment "nginx-demo" rollout to finish: 0 of 2 updated replicas are available...
2021-07-19T10:16:53.0293897Z Waiting for deployment "nginx-demo" rollout to finish: 1 of 2 updated replicas are available...
2021-07-19T10:16:54.1227279Z deployment "nginx-demo" successfully rolled out
2021-07-19T10:16:54.1284990Z [submariner-operator]$ [cluster2] netshoot_pod=$(kubectl get pods -l app=netshoot | awk 'FNR == 2 {print $1}')
2021-07-19T10:16:54.1315432Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T10:16:54.1333108Z [submariner-operator]$ [cluster2] kubectl get pods -l app=netshoot
2021-07-19T10:16:54.1348731Z [submariner-operator]$ [cluster2] awk FNR == 2 {print $1}
2021-07-19T10:16:54.1360007Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods -l app=netshoot
2021-07-19T10:16:54.4834745Z [submariner-operator]$ [cluster2] nginx_svc_ip=$(with_context "$target_cluster" get_svc_ip nginx-demo)
2021-07-19T10:16:54.4850344Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T10:16:54.4863835Z [submariner-operator]$ [cluster2] with_context cluster1 get_svc_ip nginx-demo
2021-07-19T10:16:54.4878813Z [submariner-operator]$ [cluster1] get_svc_ip nginx-demo
2021-07-19T10:16:54.4890749Z [submariner-operator]$ [cluster1] get_svc_ip
2021-07-19T10:16:54.4905962Z [submariner-operator]$ [cluster1] svc_ip=$(kubectl --context="$cluster" get svc -l "app=${svc_name}" | awk 'FNR == 2 {print $3}')
2021-07-19T10:16:54.4926889Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:16:54.4944042Z [submariner-operator]$ [cluster1] awk FNR == 2 {print $3}
2021-07-19T10:16:54.4954287Z [submariner-operator]$ [cluster1] kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:16:54.4969375Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get svc -l app=nginx-demo
2021-07-19T10:16:54.7962902Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-lgngt 100.1.71.250
2021-07-19T10:16:54.7976819Z [submariner-operator]$ [cluster2] with_retries 5 test_connection netshoot-57677568b8-lgngt 100.1.71.250
2021-07-19T10:16:54.7989102Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:16:54.8019495Z [submariner-operator]$ [cluster2] wait 9004
2021-07-19T10:16:54.8020941Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-lgngt 100.1.71.250
2021-07-19T10:16:54.8045575Z [submariner-operator]$ [cluster2] test_connection
2021-07-19T10:16:54.8050176Z Attempting connectivity between clusters - netshoot-57677568b8-lgngt --> 100.1.71.250
2021-07-19T10:16:54.8060322Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-19T10:16:54.8074252Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-19T10:16:54.8091246Z [submariner-operator]$ [cluster2] date +%s
2021-07-19T10:16:54.8121877Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:16:54.8135908Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:16:54.8147960Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:17:25.2339310Z command terminated with exit code 28
2021-07-19T10:17:25.2391337Z [submariner-operator]$ [cluster2] end_time=$(date +%s)
2021-07-19T10:17:25.2412529Z [submariner-operator]$ [cluster2] date +%s
2021-07-19T10:17:25.2436756Z [submariner-operator]$ [cluster2] execution_time=$(( end_time - start_time))
2021-07-19T10:17:25.2446581Z [submariner-operator]$ [cluster2] return 1
2021-07-19T10:17:25.2486377Z [submariner-operator]$ [cluster2] wait 9027
2021-07-19T10:17:25.2498699Z [submariner-operator]$ [cluster2] test_connection netshoot-57677568b8-lgngt 100.1.71.250
2021-07-19T10:17:25.2513792Z [submariner-operator]$ [cluster2] test_connection
2021-07-19T10:17:25.2518966Z Attempting connectivity between clusters - netshoot-57677568b8-lgngt --> 100.1.71.250
2021-07-19T10:17:25.2530957Z [submariner-operator]$ [cluster2] wait_time=30
2021-07-19T10:17:25.2541625Z [submariner-operator]$ [cluster2] start_time=$(date +%s)
2021-07-19T10:17:25.2578736Z [submariner-operator]$ [cluster2] date +%s
2021-07-19T10:17:25.2612351Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:17:25.2627217Z [submariner-operator]$ [cluster2] kubectl exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:17:25.2649886Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 exec netshoot-57677568b8-lgngt -- curl --output /dev/null -m 30 --silent --head --fail 100.1.71.250
2021-07-19T10:17:25.6855557Z Connection test was successful!
2021-07-19T10:17:25.6872938Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:17:25.6889908Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:17:25.6941662Z [submariner-operator]$ [cluster2] remove_resource /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:17:25.6968431Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:17:25.6984300Z [submariner-operator]$ [cluster2] kubectl delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:17:25.7001303Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 delete -f /opt/shipyard/scripts/resources/netshoot.yaml
2021-07-19T10:17:25.9971706Z deployment.apps "netshoot" deleted
2021-07-19T10:17:26.0123796Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.0137725Z [submariner-operator]$ [cluster2] with_context cluster1 remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.0153846Z [submariner-operator]$ [cluster1] remove_resource /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.0165898Z [submariner-operator]$ [cluster1] remove_resource
2021-07-19T10:17:26.0183162Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.0198565Z [submariner-operator]$ [cluster1] kubectl delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.0214838Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 delete -f /opt/shipyard/scripts/resources/nginx-demo.yaml
2021-07-19T10:17:26.3196144Z deployment.apps "nginx-demo" deleted
2021-07-19T10:17:26.3516754Z service "nginx-demo" deleted
2021-07-19T10:17:26.3596423Z serviceexport.multicluster.x-k8s.io "nginx-demo" deleted
2021-07-19T10:17:26.3731673Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T10:17:26.3746475Z [submariner-operator]$ [cluster2] run_if_defined post_deploy
2021-07-19T10:17:26.3780384Z [submariner-operator]$ [cluster2] type -t post_deploy
2021-07-19T10:17:26.3812256Z [submariner-operator]$ [cluster2] grep -q function
2021-07-19T10:17:26.3864192Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:17:26.3869819Z Successfully remade target file 'deploy'.
2021-07-19T10:17:26.3870583Z File 'e2e' does not exist.
2021-07-19T10:17:26.3871172Z Must remake target 'e2e'.
2021-07-19T10:17:26.3871927Z scripts/kind-e2e/e2e.sh
2021-07-19T10:17:26.3962078Z [submariner-operator]$ source /opt/shipyard/scripts/lib/utils
2021-07-19T10:17:26.4002662Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:17:26.4013354Z [submariner-operator]$ script_name=utils
2021-07-19T10:17:26.4025395Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T10:17:26.4046124Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_funcs
2021-07-19T10:17:26.4059437Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:17:26.4082246Z [submariner-operator]$ script_name=deploy_funcs
2021-07-19T10:17:26.4107887Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T10:17:26.4164378Z [submariner-operator]$ source /opt/shipyard/scripts/lib/deploy_operator
2021-07-19T10:17:26.4194636Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:17:26.4225413Z [submariner-operator]$ script_name=deploy_operator
2021-07-19T10:17:26.4292858Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T10:17:26.4336900Z [submariner-operator]$ source /opt/shipyard/scripts/lib/cluster_settings
2021-07-19T10:17:26.4385488Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:17:26.4402073Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:17:26.4415666Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T10:17:26.4469517Z [submariner-operator]$ broker=cluster1
2021-07-19T10:17:26.4502588Z [submariner-operator]$ declare -gA cluster_nodes
2021-07-19T10:17:26.4531995Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker
2021-07-19T10:17:26.4594994Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker
2021-07-19T10:17:26.4621845Z [submariner-operator]$ cluster_nodes[cluster3]=control-plane worker worker
2021-07-19T10:17:26.4691297Z [submariner-operator]$ declare -gA cluster_subm
2021-07-19T10:17:26.4737536Z [submariner-operator]$ cluster_subm[cluster1]=true
2021-07-19T10:17:26.4802587Z [submariner-operator]$ cluster_subm[cluster2]=true
2021-07-19T10:17:26.4824766Z [submariner-operator]$ cluster_subm[cluster3]=true
2021-07-19T10:17:26.4845698Z [submariner-operator]$ declare -gA cluster_cni
2021-07-19T10:17:26.4869400Z [submariner-operator]$ cluster_cni[cluster2]=weave
2021-07-19T10:17:26.4947547Z [submariner-operator]$ cluster_cni[cluster3]=weave
2021-07-19T10:17:26.4971230Z [submariner-operator]$ source /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/cluster_settings
2021-07-19T10:17:26.4999030Z [submariner-operator]$ . /opt/shipyard/scripts/lib/source_only
2021-07-19T10:17:26.5009563Z [submariner-operator]$ script_name=cluster_settings
2021-07-19T10:17:26.5020163Z [submariner-operator]$ exec_name=e2e.sh
2021-07-19T10:17:26.5040274Z [submariner-operator]$ cluster_nodes[cluster1]=control-plane worker worker
2021-07-19T10:17:26.5052201Z [submariner-operator]$ cluster_nodes[cluster2]=control-plane worker worker
2021-07-19T10:17:26.5099898Z [submariner-operator]$ timeout=2m
2021-07-19T10:17:26.5122547Z [submariner-operator]$ declare_kubeconfig
2021-07-19T10:17:26.5141466Z [submariner-operator]$ declare_kubeconfig
2021-07-19T10:17:26.5197873Z [submariner-operator]$ source /opt/shipyard/scripts/lib/kubecfg
2021-07-19T10:17:26.5273583Z [submariner-operator]$ export KUBECONFIG
2021-07-19T10:17:26.5286522Z [submariner-operator]$ KUBECONFIG=$(find "${DAPPER_OUTPUT:-output}"/kubeconfigs -type f -printf %p: || :)
2021-07-19T10:17:26.5317394Z [submariner-operator]$ find /go/src/github.com/submariner-io/submariner-operator/output/kubeconfigs -type f -printf %p:
2021-07-19T10:17:26.5402338Z [submariner-operator]$ . /go/src/github.com/submariner-io/submariner-operator/scripts/kind-e2e/lib_operator_verify_subm.sh
2021-07-19T10:17:26.5505345Z [submariner-operator]$ create_subm_vars
2021-07-19T10:17:26.5519094Z [submariner-operator]$ create_subm_vars
2021-07-19T10:17:26.5540643Z [submariner-operator]$ deployment_name=submariner
2021-07-19T10:17:26.5558844Z [submariner-operator]$ operator_deployment_name=submariner-operator
2021-07-19T10:17:26.5577826Z [submariner-operator]$ gateway_deployment_name=submariner-gateway
2021-07-19T10:17:26.5643140Z [submariner-operator]$ routeagent_deployment_name=submariner-routeagent
2021-07-19T10:17:26.5666664Z [submariner-operator]$ broker_deployment_name=submariner-k8s-broker
2021-07-19T10:17:26.5739488Z [submariner-operator]$ globalnet_deployment_name=submariner-globalnet
2021-07-19T10:17:26.5773488Z [submariner-operator]$ declare_cidrs
2021-07-19T10:17:26.5797127Z [submariner-operator]$ declare_cidrs
2021-07-19T10:17:26.5822194Z [submariner-operator]$ declare -gA cluster_CIDRs service_CIDRs global_CIDRs
2021-07-19T10:17:26.5866911Z [submariner-operator]$ i=1
2021-07-19T10:17:26.5882355Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:17:26.5909605Z [submariner-operator]$ [cluster1] add_cluster_cidrs 1 cluster1
2021-07-19T10:17:26.5925862Z [submariner-operator]$ [cluster1] cluster_CIDRs[cluster1]=10.1.0.0/16
2021-07-19T10:17:26.5936962Z [submariner-operator]$ [cluster1] service_CIDRs[cluster1]=100.1.0.0/16
2021-07-19T10:17:26.5952414Z [submariner-operator]$ [cluster1] i=$(("$i"+1))
2021-07-19T10:17:26.6077319Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:17:26.6090565Z [submariner-operator]$ [cluster2] add_cluster_cidrs 2 cluster2
2021-07-19T10:17:26.6117102Z [submariner-operator]$ [cluster2] cluster_CIDRs[cluster2]=10.2.0.0/16
2021-07-19T10:17:26.6156922Z [submariner-operator]$ [cluster2] service_CIDRs[cluster2]=100.2.0.0/16
2021-07-19T10:17:26.6169033Z [submariner-operator]$ [cluster2] i=$(("$i"+1))
2021-07-19T10:17:26.6190216Z [submariner-operator]$ [cluster2] natEnabled=false
2021-07-19T10:17:26.6204821Z [submariner-operator]$ [cluster2] subm_gateway_image_repo=localhost:5000
2021-07-19T10:17:26.6363066Z [submariner-operator]$ [cluster2] subm_gateway_image_tag=local
2021-07-19T10:17:26.6421175Z [submariner-operator]$ [cluster2] subm_gateway_size=3
2021-07-19T10:17:26.6433781Z [submariner-operator]$ [cluster2] subm_colorcodes=blue
2021-07-19T10:17:26.6448413Z [submariner-operator]$ [cluster2] subm_debug=false
2021-07-19T10:17:26.6477187Z [submariner-operator]$ [cluster2] subm_broker=k8s
2021-07-19T10:17:26.6492835Z [submariner-operator]$ [cluster2] ce_ipsec_debug=false
2021-07-19T10:17:26.6510272Z [submariner-operator]$ [cluster2] ce_ipsec_ikeport=500
2021-07-19T10:17:26.6528352Z [submariner-operator]$ [cluster2] ce_ipsec_nattport=4500
2021-07-19T10:17:26.6594409Z [submariner-operator]$ [cluster2] subm_ns=submariner-operator
2021-07-19T10:17:26.6615968Z [submariner-operator]$ [cluster2] SUBMARINER_BROKER_NS=submariner-k8s-broker
2021-07-19T10:17:26.6637355Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-19T10:17:26.6652425Z [submariner-operator]$ [cluster2] with_context cluster1 broker_vars
2021-07-19T10:17:26.6670983Z [submariner-operator]$ [cluster1] broker_vars
2021-07-19T10:17:26.6710928Z [submariner-operator]$ [cluster1] broker_vars
2021-07-19T10:17:26.6727004Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_URL=$(kubectl -n default get endpoints kubernetes -o jsonpath="{.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}")
2021-07-19T10:17:26.6743515Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T10:17:26.6756562Z [submariner-operator]$ [cluster1] kubectl -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T10:17:26.6771719Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n default get endpoints kubernetes -o jsonpath={.subsets[0].addresses[0].ip}:{.subsets[0].ports[?(@.name=='https')].port}
2021-07-19T10:17:27.1781338Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_CA=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data['ca\.crt']}")
2021-07-19T10:17:27.1811190Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T10:17:27.1824689Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T10:17:27.1852745Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data['ca\.crt']}
2021-07-19T10:17:27.5401064Z [submariner-operator]$ [cluster1] SUBMARINER_BROKER_TOKEN=$(kubectl -n ${SUBMARINER_BROKER_NS} get secrets -o jsonpath="{.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='${SUBMARINER_BROKER_NS}-client')].data.token}"|base64 --decode)
2021-07-19T10:17:27.5424485Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T10:17:27.5439625Z [submariner-operator]$ [cluster1] base64 --decode
2021-07-19T10:17:27.5447280Z [submariner-operator]$ [cluster1] kubectl -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T10:17:27.5459304Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 -n submariner-k8s-broker get secrets -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].data.token}
2021-07-19T10:17:27.8454130Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-19T10:17:27.8465564Z [submariner-operator]$ [cluster2] with_context cluster1 verify_subm_broker_secrets
2021-07-19T10:17:27.8480923Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-19T10:17:27.8496701Z [submariner-operator]$ [cluster1] verify_subm_broker_secrets
2021-07-19T10:17:27.9202188Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:28.0728893Z [submariner-operator]$ [cluster1] verify_secrets submariner-k8s-broker submariner-k8s-broker-client LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:28.2046134Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-19T10:17:28.2047610Z [submariner-operator]$ [cluster1] wait_for_secrets submariner-k8s-broker
2021-07-19T10:17:28.2062096Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-19T10:17:28.2063734Z [submariner-operator]$ [cluster1] grep -q submariner-
2021-07-19T10:17:28.2064999Z [submariner-operator]$ [cluster1] kubectl get secret -n submariner-k8s-broker
2021-07-19T10:17:28.2066529Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret -n submariner-k8s-broker
2021-07-19T10:17:28.3177940Z [submariner-operator]$ [cluster1] return
2021-07-19T10:17:28.3195590Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-19T10:17:28.3211783Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker
2021-07-19T10:17:28.3228577Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker
2021-07-19T10:17:28.6125708Z NAME TYPE DATA AGE
2021-07-19T10:17:28.6254403Z cluster-cluster1-token-9ptb8 kubernetes.io/service-account-token 3 4m30s
2021-07-19T10:17:28.6265336Z cluster-cluster2-token-98vdn kubernetes.io/service-account-token 3 4m24s
2021-07-19T10:17:28.6276681Z default-token-8kp2f kubernetes.io/service-account-token 3 4m46s
2021-07-19T10:17:28.6281838Z submariner-k8s-broker-admin-token-24dx6 kubernetes.io/service-account-token 3 4m46s
2021-07-19T10:17:28.6283834Z submariner-k8s-broker-client-token-dx4xp kubernetes.io/service-account-token 3 4m46s
2021-07-19T10:17:28.6359936Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T10:17:28.6373082Z [submariner-operator]$ [cluster1] kubectl get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T10:17:28.6390268Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secrets -n submariner-k8s-broker -o jsonpath={.items[?(@.metadata.annotations['kubernetes\.io/service-account\.name']=='submariner-k8s-broker-client')].metadata.name}
2021-07-19T10:17:28.9487297Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:28.9502480Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-dx4xp -n submariner-k8s-broker -o json
2021-07-19T10:17:28.9518038Z [submariner-operator]$ [cluster1] tee /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:28.9540916Z [submariner-operator]$ [cluster1] kubectl get secret submariner-k8s-broker-client-token-dx4xp -n submariner-k8s-broker -o json
2021-07-19T10:17:28.9555737Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get secret submariner-k8s-broker-client-token-dx4xp -n submariner-k8s-broker -o json
2021-07-19T10:17:29.2900581Z {
2021-07-19T10:17:29.2901366Z "apiVersion": "v1",
2021-07-19T10:17:29.2901811Z "data": {
2021-07-19T10:17:29.3465430Z "ca.crt": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T10:17:29.4028453Z "namespace": "c3VibWFyaW5lci1rOHMtYnJva2Vy",
2021-07-19T10:17:29.4509102Z "token": "ZXlKaGJHY2lPaUpTVXpJMU5pSXNJbXRwWkNJNkltSXRWM1JUZUZWb1JWUmhlSFZ2VlVaalpFMU5jR3N4ZVRSMmRXZDBXRmRZYlc1d0xUTmZUek5sVm1NaWZRLmV5SnBjM01pT2lKcmRXSmxjbTVsZEdWekwzTmxjblpwWTJWaFkyTnZkVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXVZVzFsYzNCaFkyVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJaUxDSnJkV0psY201bGRHVnpMbWx2TDNObGNuWnBZMlZoWTJOdmRXNTBMM05sWTNKbGRDNXVZVzFsSWpvaWMzVmliV0Z5YVc1bGNpMXJPSE10WW5KdmEyVnlMV05zYVdWdWRDMTBiMnRsYmkxa2VEUjRjQ0lzSW10MVltVnlibVYwWlhNdWFXOHZjMlZ5ZG1salpXRmpZMjkxYm5RdmMyVnlkbWxqWlMxaFkyTnZkVzUwTG01aGJXVWlPaUp6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSWl3aWEzVmlaWEp1WlhSbGN5NXBieTl6WlhKMmFXTmxZV05qYjNWdWRDOXpaWEoyYVdObExXRmpZMjkxYm5RdWRXbGtJam9pTmpVNE9EaGxPVGN0WkdVM1pTMDBNbUl4TFRsaFkyTXRZbVpqWWpRM1kyUmxaRGhtSWl3aWMzVmlJam9pYzNsemRHVnRPbk5sY25acFkyVmhZMk52ZFc1ME9uTjFZbTFoY21sdVpYSXRhemh6TFdKeWIydGxjanB6ZFdKdFlYSnBibVZ5TFdzNGN5MWljbTlyWlhJdFkyeHBaVzUwSW4wLkdHZVM3X1dZTDJscHZEUGN1MFhoZXhoVUpWSGU3a1dmQjNnUmtQZGdOblI4V3V3UkJPV2lRbDhidVdjMW5GYXVUcS1PcmJMMGtTVFlDNlhnTUJ0dzd1WWJJSUpaeDhwQnJZcEtLeExrSnBTR0RIUUNQT1I4OFpYNzQ3Y09lTnNYX2dOZ0pza0owVm1nSUtZUUt4LXQ0eFotbHRKMEhJdW4yTW1JdVpzNzNJZkthQm1VR1RfS0VzRkV0ci1FQk5YenZRX2VQTXV0ZGRMNzg5X0lsSXVtQzY0QW5WTF9vYnhOTXR0MzJHTlBrcnNCcEFfeWF2Rm5sU1dQWXdGT0V4SGhtUXh1NjJOenhYZVNHTkVjOHRwUkdxNk5IZTJrWHBJNXhXbm13VlVnTUppMjhQRWFqY084cjNhWmNDdDdlbXFOTW5FcEFtY2ZrWlRqRWpvNUVQTWtfUQ=="
2021-07-19T10:17:29.4982271Z },
2021-07-19T10:17:29.4982720Z "kind": "Secret",
2021-07-19T10:17:29.4983138Z "metadata": {
2021-07-19T10:17:29.4983589Z "annotations": {
2021-07-19T10:17:29.4985123Z "kubernetes.io/service-account.name": "submariner-k8s-broker-client",
2021-07-19T10:17:29.4986599Z "kubernetes.io/service-account.uid": "65888e97-de7e-42b1-9acc-bfcb47cded8f"
2021-07-19T10:17:29.4987375Z },
2021-07-19T10:17:29.4988066Z "creationTimestamp": "2021-07-19T10:12:42Z",
2021-07-19T10:17:29.4988649Z "managedFields": [
2021-07-19T10:17:29.4989059Z {
2021-07-19T10:17:29.4989473Z "apiVersion": "v1",
2021-07-19T10:17:29.4989983Z "fieldsType": "FieldsV1",
2021-07-19T10:17:29.4990476Z "fieldsV1": {
2021-07-19T10:17:29.4990890Z "f:data": {
2021-07-19T10:17:29.4991258Z ".": {},
2021-07-19T10:17:29.4993144Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-19T10:17:29.4994297Z [submariner-operator]$ [cluster1] validate_equals .kind Secret
2021-07-19T10:17:29.4996180Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:29.4998244Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-19T10:17:29.4999823Z [submariner-operator]$ [cluster1] validate_equals .type kubernetes.io/service-account-token
2021-07-19T10:17:29.5001930Z [submariner-operator]$ [cluster1] jq -r -M .type /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:29.5004270Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-dx4xp
2021-07-19T10:17:29.5006400Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner-k8s-broker-client-token-dx4xp
2021-07-19T10:17:29.5008810Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:29.5010942Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-19T10:17:29.5012568Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-k8s-broker
2021-07-19T10:17:29.5014789Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:29.5017203Z "f:ca.crt": {},
2021-07-19T10:17:29.5017649Z "f:namespace": {},
2021-07-19T10:17:29.5018101Z "f:token": {}
2021-07-19T10:17:29.5018489Z },
2021-07-19T10:17:29.5018878Z "f:metadata": {
2021-07-19T10:17:29.5019347Z "f:annotations": {
2021-07-19T10:17:29.5019762Z ".": {},
2021-07-19T10:17:29.5020616Z "f:kubernetes.io/service-account.name": {},
2021-07-19T10:17:29.5021621Z "f:kubernetes.io/service-account.uid": {}
2021-07-19T10:17:29.5022216Z }
2021-07-19T10:17:29.5022561Z },
2021-07-19T10:17:29.5022945Z "f:type": {}
2021-07-19T10:17:29.5023304Z },
2021-07-19T10:17:29.5024043Z "manager": "kube-controller-manager",
2021-07-19T10:17:29.5024702Z "operation": "Update",
2021-07-19T10:17:29.5025336Z "time": "2021-07-19T10:12:42Z"
2021-07-19T10:17:29.5025733Z }
2021-07-19T10:17:29.5026059Z ],
2021-07-19T10:17:29.5027048Z "name": "submariner-k8s-broker-client-token-dx4xp",
2021-07-19T10:17:29.5028217Z "namespace": "submariner-k8s-broker",
2021-07-19T10:17:29.5028883Z "resourceVersion": "1178",
2021-07-19T10:17:29.5029637Z "uid": "93d11e67-0838-466c-97b8-9e1150a04777"
2021-07-19T10:17:29.5030291Z },
2021-07-19T10:17:29.5031053Z "type": "kubernetes.io/service-account-token"
2021-07-19T10:17:29.5031648Z }
2021-07-19T10:17:29.5256784Z [submariner-operator]$ [cluster1] jq -r -M .data["ca.crt"] /tmp/submariner-k8s-broker-client-token-dx4xp.cluster1.json
2021-07-19T10:17:29.5638233Z [submariner-operator]$ [cluster1] one_ca_crt_ok=true
2021-07-19T10:17:29.5654301Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-19T10:17:29.5670511Z [submariner-operator]$ [cluster2] run_subm_clusters verify_subm_deployed
2021-07-19T10:17:29.5682743Z [submariner-operator]$ [cluster2] declare -a subm_clusters
2021-07-19T10:17:29.5718972Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 verify_subm_deployed
2021-07-19T10:17:29.5734340Z [submariner-operator]$ [cluster2] run_parallel cluster1 cluster2 cluster1 cluster2 verify_subm_deployed
2021-07-19T10:17:29.5747367Z [submariner-operator]$ [cluster2] declare -A pids
2021-07-19T10:17:29.5765188Z [submariner-operator]$ [cluster2] eval echo cluster1 cluster2
2021-07-19T10:17:29.5787279Z [submariner-operator]$ [cluster1] pids[cluster1]=9275
2021-07-19T10:17:29.5799475Z [submariner-operator]$ [cluster1] set -o pipefail
2021-07-19T10:17:29.5813860Z [submariner-operator]$ [cluster2] set -o pipefail
2021-07-19T10:17:29.5827500Z [submariner-operator]$ [cluster2] pids[cluster2]=9278
2021-07-19T10:17:29.5828586Z [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-19T10:17:29.5841123Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-19T10:17:29.5847650Z [submariner-operator]$ [cluster2] sed /\[cluster2]/!s/^/[cluster2] /
2021-07-19T10:17:29.5864499Z [submariner-operator]$ [cluster2] wait 9278
2021-07-19T10:17:29.5881060Z [submariner-operator]$ [cluster1] sed /\[cluster1]/!s/^/[cluster1] /
2021-07-19T10:17:30.4322958Z [submariner-operator]$ [cluster1] verify_subm_deployed
2021-07-19T10:17:30.4324363Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-19T10:17:30.4325466Z [submariner-operator]$ [cluster1] verify_endpoints_crd
2021-07-19T10:17:30.4326821Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T10:17:30.4328317Z [submariner-operator]$ [cluster1] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T10:17:30.4329989Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-19T10:17:30.4331714Z [submariner-operator]$ [cluster1] kubectl get crds endpoints.submariner.io
2021-07-19T10:17:30.4333412Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds endpoints.submariner.io
2021-07-19T10:17:30.4334516Z [cluster1] NAME CREATED AT
2021-07-19T10:17:30.4335530Z [cluster1] endpoints.submariner.io 2021-07-19T10:12:52Z
2021-07-19T10:17:30.4337093Z [submariner-operator]$ [cluster1] json_file=/tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:30.4338863Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.4340612Z [submariner-operator]$ [cluster1] tee /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:30.4342467Z [submariner-operator]$ [cluster1] kubectl get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.4344200Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.4345324Z [cluster1] {
2021-07-19T10:17:30.4346064Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:30.4347006Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-19T10:17:30.4347792Z [cluster1] "metadata": {
2021-07-19T10:17:30.4348471Z [cluster1] "annotations": {
2021-07-19T10:17:30.4349597Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:30.4350450Z [cluster1] },
2021-07-19T10:17:30.4351310Z [cluster1] "creationTimestamp": "2021-07-19T10:12:52Z",
2021-07-19T10:17:30.4352531Z [cluster1] "generation": 1,
2021-07-19T10:17:30.4353198Z [cluster1] "managedFields": [
2021-07-19T10:17:30.4353783Z [cluster1] {
2021-07-19T10:17:30.4354519Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:30.4355360Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:30.4356029Z [cluster1] "fieldsV1": {
2021-07-19T10:17:30.4356648Z [cluster1] "f:metadata": {
2021-07-19T10:17:30.4357355Z [cluster1] "f:annotations": {
2021-07-19T10:17:30.4357926Z [cluster1] ".": {},
2021-07-19T10:17:30.4359163Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:30.4360202Z [cluster1] }
2021-07-19T10:17:30.4360754Z [cluster1] },
2021-07-19T10:17:30.4361300Z [cluster1] "f:spec": {
2021-07-19T10:17:30.4361926Z [cluster1] "f:conversion": {
2021-07-19T10:17:30.4362517Z [cluster1] ".": {},
2021-07-19T10:17:30.4363115Z [cluster1] "f:strategy": {}
2021-07-19T10:17:30.4363707Z [cluster1] },
2021-07-19T10:17:30.4364264Z [cluster1] "f:group": {},
2021-07-19T10:17:30.4364874Z [cluster1] "f:names": {
2021-07-19T10:17:30.4365456Z [cluster1] "f:kind": {},
2021-07-19T10:17:30.4366077Z [cluster1] "f:listKind": {},
2021-07-19T10:17:30.4366708Z [cluster1] "f:plural": {},
2021-07-19T10:17:30.4367320Z [cluster1] "f:singular": {}
2021-07-19T10:17:30.4367909Z [cluster1] },
2021-07-19T10:17:30.4368483Z [cluster1] "f:scope": {},
2021-07-19T10:17:30.4369090Z [cluster1] "f:versions": {}
2021-07-19T10:17:30.4369662Z [cluster1] },
2021-07-19T10:17:30.4370217Z [cluster1] "f:status": {
2021-07-19T10:17:30.4370876Z [cluster1] "f:acceptedNames": {
2021-07-19T10:17:30.4371531Z [cluster1] "f:kind": {},
2021-07-19T10:17:30.4372116Z [cluster1] "f:plural": {}
2021-07-19T10:17:30.4372802Z [cluster1] },
2021-07-19T10:17:30.4373389Z [cluster1] "f:conditions": {},
2021-07-19T10:17:30.4374096Z [cluster1] "f:storedVersions": {}
2021-07-19T10:17:30.4388215Z [cluster1] }
2021-07-19T10:17:30.4388770Z [cluster1] },
2021-07-19T10:17:30.4389816Z [cluster1] "manager": "submariner-operator",
2021-07-19T10:17:30.4390615Z [cluster1] "operation": "Update",
2021-07-19T10:17:30.4391382Z [cluster1] "time": "2021-07-19T10:12:58Z"
2021-07-19T10:17:30.4392257Z [cluster1] }
2021-07-19T10:17:30.4392681Z [cluster1] ],
2021-07-19T10:17:30.4393369Z [cluster1] "name": "endpoints.submariner.io",
2021-07-19T10:17:30.4394190Z [cluster1] "resourceVersion": "1370",
2021-07-19T10:17:30.4395147Z [cluster1] "uid": "e19d5263-295b-4ec3-9f3a-5767e2f7aecc"
2021-07-19T10:17:30.4395751Z [cluster1] },
2021-07-19T10:17:30.4396185Z [cluster1] "spec": {
2021-07-19T10:17:30.4396737Z [cluster1] "conversion": {
2021-07-19T10:17:30.4397270Z [cluster1] "strategy": "None"
2021-07-19T10:17:30.4397734Z [cluster1] },
2021-07-19T10:17:30.4398256Z [cluster1] "group": "submariner.io",
2021-07-19T10:17:30.4398781Z [cluster1] "names": {
2021-07-19T10:17:30.4399284Z [cluster1] "kind": "Endpoint",
2021-07-19T10:17:30.4399871Z [cluster1] "listKind": "EndpointList",
2021-07-19T10:17:30.4400495Z [cluster1] "plural": "endpoints",
2021-07-19T10:17:30.4401499Z [cluster1] "singular": "endpoint"
2021-07-19T10:17:30.4402099Z [cluster1] },
2021-07-19T10:17:30.4402790Z [cluster1] "scope": "Namespaced",
2021-07-19T10:17:30.4403420Z [cluster1] "versions": [
2021-07-19T10:17:30.4403976Z [cluster1] {
2021-07-19T10:17:30.4404523Z [cluster1] "name": "v1",
2021-07-19T10:17:30.4405093Z [cluster1] "schema": {
2021-07-19T10:17:30.4405764Z [cluster1] "openAPIV3Schema": {
2021-07-19T10:17:30.4406456Z [cluster1] "properties": {
2021-07-19T10:17:30.4424464Z [cluster1] "apiVersion": {
2021-07-19T10:17:30.4427384Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:30.4429386Z [cluster1] "type": "string"
2021-07-19T10:17:30.4430027Z [cluster1] },
2021-07-19T10:17:30.4430611Z [cluster1] "kind": {
2021-07-19T10:17:30.4433373Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:30.4435342Z [cluster1] "type": "string"
2021-07-19T10:17:30.4435950Z [cluster1] },
2021-07-19T10:17:30.4436561Z [cluster1] "metadata": {
2021-07-19T10:17:30.4437193Z [cluster1] "type": "object"
2021-07-19T10:17:30.4437790Z [cluster1] },
2021-07-19T10:17:30.4438351Z [cluster1] "spec": {
2021-07-19T10:17:30.4438996Z [cluster1] "properties": {
2021-07-19T10:17:30.4439650Z [cluster1] "backend": {
2021-07-19T10:17:30.4440286Z [cluster1] "type": "string"
2021-07-19T10:17:30.4441136Z [cluster1] },
2021-07-19T10:17:30.4441848Z [cluster1] "backend_config": {
2021-07-19T10:17:30.4442628Z [cluster1] "additionalProperties": {
2021-07-19T10:17:30.4443422Z [cluster1] "type": "string"
2021-07-19T10:17:30.4444028Z [cluster1] },
2021-07-19T10:17:30.4444667Z [cluster1] "type": "object"
2021-07-19T10:17:30.4445285Z [cluster1] },
2021-07-19T10:17:30.4445881Z [cluster1] "cable_name": {
2021-07-19T10:17:30.4446533Z [cluster1] "type": "string"
2021-07-19T10:17:30.4447128Z [cluster1] },
2021-07-19T10:17:30.4447737Z [cluster1] "cluster_id": {
2021-07-19T10:17:30.4448397Z [cluster1] "type": "string"
2021-07-19T10:17:30.4448989Z [cluster1] },
2021-07-19T10:17:30.4449649Z [cluster1] "healthCheckIP": {
2021-07-19T10:17:30.4450359Z [cluster1] "type": "string"
2021-07-19T10:17:30.4450954Z [cluster1] },
2021-07-19T10:17:30.4451558Z [cluster1] "hostname": {
2021-07-19T10:17:30.4452202Z [cluster1] "type": "string"
2021-07-19T10:17:30.4452804Z [cluster1] },
2021-07-19T10:17:30.4453416Z [cluster1] "nat_enabled": {
2021-07-19T10:17:30.4454080Z [cluster1] "type": "boolean"
2021-07-19T10:17:30.4454696Z [cluster1] },
2021-07-19T10:17:30.4455296Z [cluster1] "private_ip": {
2021-07-19T10:17:30.4455963Z [cluster1] "type": "string"
2021-07-19T10:17:30.4456574Z [cluster1] },
2021-07-19T10:17:30.4457163Z [cluster1] "public_ip": {
2021-07-19T10:17:30.4457818Z [cluster1] "type": "string"
2021-07-19T10:17:30.4458428Z [cluster1] },
2021-07-19T10:17:30.4459111Z [cluster1] "subnets": {
2021-07-19T10:17:30.4459764Z [cluster1] "items": {
2021-07-19T10:17:30.4460386Z [cluster1] "type": "string"
2021-07-19T10:17:30.4461004Z [cluster1] },
2021-07-19T10:17:30.4461625Z [cluster1] "type": "array"
2021-07-19T10:17:30.4462216Z [cluster1] }
2021-07-19T10:17:30.4462780Z [cluster1] },
2021-07-19T10:17:30.4463362Z [cluster1] "required": [
2021-07-19T10:17:30.4463995Z [cluster1] "backend",
2021-07-19T10:17:30.4464628Z [cluster1] "cable_name",
2021-07-19T10:17:30.4465254Z [cluster1] "cluster_id",
2021-07-19T10:17:30.5001314Z [cluster1] [submariner-operator]$ [cluster2] verify_subm_deployed
2021-07-19T10:17:30.5002513Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-19T10:17:30.5003565Z [submariner-operator]$ [cluster2] verify_endpoints_crd
2021-07-19T10:17:30.5004972Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T10:17:30.5006443Z [submariner-operator]$ [cluster2] validate_crd endpoints.submariner.io v1 Endpoint
2021-07-19T10:17:30.5007979Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-19T10:17:30.5009607Z [submariner-operator]$ [cluster2] kubectl get crds endpoints.submariner.io
2021-07-19T10:17:30.5011294Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds endpoints.submariner.io
2021-07-19T10:17:30.5012295Z [cluster2] NAME CREATED AT
2021-07-19T10:17:30.5013164Z [cluster2] endpoints.submariner.io 2021-07-19T10:13:02Z
2021-07-19T10:17:30.5014632Z [submariner-operator]$ [cluster2] json_file=/tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:30.5016363Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.5017805Z [submariner-operator]$ [cluster2] kubectl get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.5019382Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd endpoints.submariner.io -o json
2021-07-19T10:17:30.5021117Z [submariner-operator]$ [cluster2] tee /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:30.5022121Z [cluster2] {
2021-07-19T10:17:30.5022741Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:30.5023609Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-19T10:17:30.5024281Z [cluster2] "metadata": {
2021-07-19T10:17:30.5025097Z [cluster2] "annotations": {
2021-07-19T10:17:30.5026114Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:30.5029672Z [cluster2] },
2021-07-19T10:17:30.5030865Z [cluster2] "creationTimestamp": "2021-07-19T10:13:02Z",
2021-07-19T10:17:30.5031607Z [cluster2] "generation": 1,
2021-07-19T10:17:30.5032397Z [cluster2] "managedFields": [
2021-07-19T10:17:30.5032996Z [cluster2] {
2021-07-19T10:17:30.5033749Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:30.5034612Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:30.5035296Z [cluster2] "fieldsV1": {
2021-07-19T10:17:30.5035934Z [cluster2] "f:metadata": {
2021-07-19T10:17:30.5036574Z [cluster2] "f:annotations": {
2021-07-19T10:17:30.5037191Z [cluster2] ".": {},
2021-07-19T10:17:30.5038282Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:30.5039649Z [cluster2] }
2021-07-19T10:17:30.5040268Z [cluster2] },
2021-07-19T10:17:30.5040729Z [cluster2] "f:spec": {
2021-07-19T10:17:30.5041388Z [cluster2] "f:conversion": {
2021-07-19T10:17:30.5041903Z [cluster2] ".": {},
2021-07-19T10:17:30.5042512Z [cluster2] "f:strategy": {}
2021-07-19T10:17:30.5043118Z [cluster2] },
2021-07-19T10:17:30.5043679Z [cluster2] "f:group": {},
2021-07-19T10:17:30.5044303Z [cluster2] "f:names": {
2021-07-19T10:17:30.5044898Z [cluster2] "f:kind": {},
2021-07-19T10:17:30.5045511Z [cluster2] "f:listKind": {},
2021-07-19T10:17:30.5046142Z [cluster2] "f:plural": {},
2021-07-19T10:17:30.5046765Z [cluster2] "f:singular": {}
2021-07-19T10:17:30.5047380Z [cluster2] },
2021-07-19T10:17:30.5047962Z [cluster2] "f:scope": {},
2021-07-19T10:17:30.5048581Z [cluster2] "f:versions": {}
2021-07-19T10:17:30.5049153Z [cluster2] },
2021-07-19T10:17:30.5049708Z [cluster2] "f:status": {
2021-07-19T10:17:30.5050357Z [cluster2] "f:acceptedNames": {
2021-07-19T10:17:30.5051020Z [cluster2] "f:kind": {},
2021-07-19T10:17:30.5051623Z [cluster2] "f:plural": {}
2021-07-19T10:17:30.5052336Z [cluster2] },
2021-07-19T10:17:30.5052927Z [cluster2] "f:conditions": {},
2021-07-19T10:17:30.5053642Z [cluster2] "f:storedVersions": {}
2021-07-19T10:17:30.5054280Z [cluster2] }
2021-07-19T10:17:30.5054798Z [cluster2] },
2021-07-19T10:17:30.5055784Z [cluster2] "manager": "submariner-operator",
2021-07-19T10:17:30.5056599Z [cluster2] "operation": "Update",
2021-07-19T10:17:30.5057458Z [cluster2] "time": "2021-07-19T10:13:10Z"
2021-07-19T10:17:30.5058043Z [cluster2] }
2021-07-19T10:17:30.5058554Z [cluster2] ],
2021-07-19T10:17:30.5059302Z [cluster2] "name": "endpoints.submariner.io",
2021-07-19T10:17:30.5060135Z [cluster2] "resourceVersion": "1355",
2021-07-19T10:17:30.5061188Z [cluster2] "uid": "bdd7360e-ac81-4a02-9d98-92ed47412916"
2021-07-19T10:17:30.5061931Z [cluster2] },
2021-07-19T10:17:30.5062458Z [cluster2] "spec": {
2021-07-19T10:17:30.5063058Z [cluster2] "conversion": {
2021-07-19T10:17:30.5063692Z [cluster2] "strategy": "None"
2021-07-19T10:17:30.5064235Z [cluster2] },
2021-07-19T10:17:30.5064979Z [cluster2] "group": "submariner.io",
2021-07-19T10:17:30.5065608Z [cluster2] "names": {
2021-07-19T10:17:30.5066206Z [cluster2] "kind": "Endpoint",
2021-07-19T10:17:30.5066908Z [cluster2] "listKind": "EndpointList",
2021-07-19T10:17:30.5067629Z [cluster2] "plural": "endpoints",
2021-07-19T10:17:30.5068327Z [cluster2] "singular": "endpoint"
2021-07-19T10:17:30.5068913Z [cluster2] },
2021-07-19T10:17:30.5069539Z [cluster2] "scope": "Namespaced",
2021-07-19T10:17:30.5070177Z [cluster2] "versions": [
2021-07-19T10:17:30.5070719Z [cluster2] {
2021-07-19T10:17:30.5071266Z [cluster2] "name": "v1",
2021-07-19T10:17:30.5071915Z [cluster2] "schema": {
2021-07-19T10:17:30.5112735Z [cluster2] "openAPIV3Schema": {
2021-07-19T10:17:30.5113435Z [cluster2] "properties": {
2021-07-19T10:17:30.5114056Z [cluster2] "apiVersion": {
2021-07-19T10:17:30.5116869Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:30.5118721Z [cluster2] "type": "string"
2021-07-19T10:17:30.5119296Z [cluster2] },
2021-07-19T10:17:30.5119844Z [cluster2] "kind": {
2021-07-19T10:17:30.5122342Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:30.5124298Z [cluster2] "type": "string"
2021-07-19T10:17:30.5124911Z [cluster2] },
2021-07-19T10:17:30.5125506Z [cluster2] "metadata": {
2021-07-19T10:17:30.5126461Z [cluster2] "type": "object"
2021-07-19T10:17:30.5127108Z [cluster2] },
2021-07-19T10:17:30.5128264Z [cluster2] "spec": {
2021-07-19T10:17:30.5130858Z [cluster2] "properties": {
2021-07-19T10:17:30.5131667Z [cluster2] "backend": {
2021-07-19T10:17:30.5132496Z [cluster2] "type": "string"
2021-07-19T10:17:30.5133708Z [cluster2] },
2021-07-19T10:17:30.5135386Z [cluster2] "backend_config": {
2021-07-19T10:17:30.5136465Z [cluster2] "additionalProperties": {
2021-07-19T10:17:30.5138770Z [cluster2] "type": "string"
2021-07-19T10:17:30.5139516Z [cluster2] },
2021-07-19T10:17:30.5140585Z [cluster2] "type": "object"
2021-07-19T10:17:30.5151023Z [cluster2] },
2021-07-19T10:17:30.5151928Z [cluster2] "cable_name": {
2021-07-19T10:17:30.5152722Z [cluster2] "type": "string"
2021-07-19T10:17:30.5153411Z [cluster2] },
2021-07-19T10:17:30.5154132Z [cluster2] "cluster_id": {
2021-07-19T10:17:30.5154879Z [cluster2] "type": "string"
2021-07-19T10:17:30.5382161Z [cluster2] },
2021-07-19T10:17:30.5382700Z [cluster2] "healthCheckIP": {
2021-07-19T10:17:30.5383250Z [cluster2] "type": "string"
2021-07-19T10:17:30.5383718Z [cluster2] },
2021-07-19T10:17:30.5384283Z [cluster2] "hostname": {
2021-07-19T10:17:30.5393626Z [cluster2] "type": "string"
2021-07-19T10:17:30.5394146Z [cluster2] },
2021-07-19T10:17:30.5394656Z [cluster2] "nat_enabled": {
2021-07-19T10:17:30.5395230Z [cluster2] "type": "boolean"
2021-07-19T10:17:30.5395739Z [cluster2] },
2021-07-19T10:17:30.5396255Z [cluster2] "private_ip": {
2021-07-19T10:17:30.5396929Z [cluster2] "type": "string"
2021-07-19T10:17:30.5397439Z [cluster2] },
2021-07-19T10:17:30.5397935Z [cluster2] "public_ip": {
2021-07-19T10:17:30.5398486Z [cluster2] "type": "string"
2021-07-19T10:17:30.5398986Z [cluster2] },
2021-07-19T10:17:30.5399664Z [cluster2] "subnets": {
2021-07-19T10:17:30.5400185Z [cluster2] "items": {
2021-07-19T10:17:30.5400721Z [cluster2] "type": "string"
2021-07-19T10:17:30.5401246Z [cluster2] },
2021-07-19T10:17:30.5401740Z [cluster2] "type": "array"
2021-07-19T10:17:30.5402253Z [cluster2] }
2021-07-19T10:17:30.5402700Z [cluster2] },
2021-07-19T10:17:30.5403209Z [cluster2] "required": [
2021-07-19T10:17:30.5403739Z [cluster2] "backend",
2021-07-19T10:17:30.5404274Z [cluster2] "cable_name",
2021-07-19T10:17:30.5404815Z [cluster2] "cluster_id",
2021-07-19T10:17:31.1355665Z [cluster2] "hostname",
2021-07-19T10:17:31.1356480Z [cluster1] "nat_enabled",
2021-07-19T10:17:31.1357051Z [cluster1] "private_ip",
2021-07-19T10:17:31.1357614Z [cluster1] "public_ip",
2021-07-19T10:17:31.1358141Z [cluster1] "subnets"
2021-07-19T10:17:31.1358646Z [cluster1] ],
2021-07-19T10:17:31.1359149Z [cluster1] "type": "object"
2021-07-19T10:17:31.1359853Z [cluster1] }
2021-07-19T10:17:31.1360291Z [cluster1] },
2021-07-19T10:17:31.1360790Z [cluster1] "required": [
2021-07-19T10:17:31.1361312Z [cluster1] "spec"
2021-07-19T10:17:31.1361770Z [cluster1] ],
2021-07-19T10:17:31.1362383Z [cluster1] "type": "object"
2021-07-19T10:17:31.1362910Z [cluster1] }
2021-07-19T10:17:31.1363320Z [cluster1] },
2021-07-19T10:17:31.1363757Z [cluster1] "served": true,
2021-07-19T10:17:31.1364249Z [cluster1] "storage": true
2021-07-19T10:17:31.1364676Z [cluster1] }
2021-07-19T10:17:31.1365066Z [cluster1] ]
2021-07-19T10:17:31.1365438Z [cluster1] },
2021-07-19T10:17:31.1365849Z [cluster1] "status": {
2021-07-19T10:17:31.1366331Z [cluster1] "acceptedNames": {
2021-07-19T10:17:31.1366867Z [cluster1] "kind": "Endpoint",
2021-07-19T10:17:31.1367430Z [cluster1] "listKind": "EndpointList",
2021-07-19T10:17:31.1367997Z [cluster1] "plural": "endpoints",
2021-07-19T10:17:31.1368552Z [cluster1] "singular": "endpoint"
2021-07-19T10:17:31.1369080Z [cluster1] },
2021-07-19T10:17:31.1369523Z [cluster1] "conditions": [
2021-07-19T10:17:31.1369947Z [cluster1] {
2021-07-19T10:17:31.1374413Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:52Z",
2021-07-19T10:17:31.1375090Z [cluster1] "message": "no conflicts found",
2021-07-19T10:17:31.1375684Z [cluster1] "reason": "NoConflicts",
2021-07-19T10:17:31.1376203Z [cluster1] "status": "True",
2021-07-19T10:17:31.1376762Z [cluster1] "type": "NamesAccepted"
2021-07-19T10:17:31.1377385Z [cluster1] },
2021-07-19T10:17:31.1377772Z [cluster1] {
2021-07-19T10:17:31.1378556Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:52Z",
2021-07-19T10:17:31.1379283Z [cluster1] "message": "the initial names have been accepted",
2021-07-19T10:17:31.1380037Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-19T10:17:31.1380648Z [cluster1] "status": "True",
2021-07-19T10:17:31.1381254Z [cluster1] "type": "Established"
2021-07-19T10:17:31.1381718Z [cluster1] }
2021-07-19T10:17:31.1382112Z [cluster1] ],
2021-07-19T10:17:31.1382753Z [cluster1] "storedVersions": [
2021-07-19T10:17:31.1383244Z [cluster1] "v1"
2021-07-19T10:17:31.1383642Z [cluster1] ]
2021-07-19T10:17:31.1384015Z [cluster1] }
2021-07-19T10:17:31.1384488Z [cluster1] }
2021-07-19T10:17:31.1385540Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T10:17:31.1387115Z [submariner-operator]$ [cluster1] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T10:17:31.1388866Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:31.1390367Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:31.1391552Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:31.1393490Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:31.1394993Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:31.1396208Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:31.1397783Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:31.1399275Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-19T10:17:31.1400471Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Endpoint
2021-07-19T10:17:31.1402412Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:31.1404183Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T10:17:31.1405743Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T10:17:31.1407685Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster1.json
2021-07-19T10:17:31.1409297Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-19T10:17:31.1410334Z [submariner-operator]$ [cluster1] verify_clusters_crd
2021-07-19T10:17:31.1411570Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T10:17:31.1413067Z [submariner-operator]$ [cluster1] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T10:17:31.1414383Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-19T10:17:31.1415666Z [submariner-operator]$ [cluster1] kubectl get crds clusters.submariner.io
2021-07-19T10:17:31.1417067Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds clusters.submariner.io
2021-07-19T10:17:31.1417958Z [cluster1] NAME CREATED AT
2021-07-19T10:17:31.2002542Z [cluster1] clusters.submariner.io 20 "hostname",
2021-07-19T10:17:31.2003532Z [cluster2] "nat_enabled",
2021-07-19T10:17:31.2004100Z [cluster2] "private_ip",
2021-07-19T10:17:31.2004659Z [cluster2] "public_ip",
2021-07-19T10:17:31.2005184Z [cluster2] "subnets"
2021-07-19T10:17:31.2005686Z [cluster2] ],
2021-07-19T10:17:31.2006290Z [cluster2] "type": "object"
2021-07-19T10:17:31.2006771Z [cluster2] }
2021-07-19T10:17:31.2007189Z [cluster2] },
2021-07-19T10:17:31.2007631Z [cluster2] "required": [
2021-07-19T10:17:31.2008113Z [cluster2] "spec"
2021-07-19T10:17:31.2008534Z [cluster2] ],
2021-07-19T10:17:31.2009001Z [cluster2] "type": "object"
2021-07-19T10:17:31.2009444Z [cluster2] }
2021-07-19T10:17:31.2010010Z [cluster2] },
2021-07-19T10:17:31.2010453Z [cluster2] "served": true,
2021-07-19T10:17:31.2010950Z [cluster2] "storage": true
2021-07-19T10:17:31.2011378Z [cluster2] }
2021-07-19T10:17:31.2011768Z [cluster2] ]
2021-07-19T10:17:31.2012155Z [cluster2] },
2021-07-19T10:17:31.2012637Z [cluster2] "status": {
2021-07-19T10:17:31.2013131Z [cluster2] "acceptedNames": {
2021-07-19T10:17:31.2013651Z [cluster2] "kind": "Endpoint",
2021-07-19T10:17:31.2014218Z [cluster2] "listKind": "EndpointList",
2021-07-19T10:17:31.2014791Z [cluster2] "plural": "endpoints",
2021-07-19T10:17:31.2015343Z [cluster2] "singular": "endpoint"
2021-07-19T10:17:31.2015800Z [cluster2] },
2021-07-19T10:17:31.2016240Z [cluster2] "conditions": [
2021-07-19T10:17:31.2016669Z [cluster2] {
2021-07-19T10:17:31.2017816Z [cluster2] "lastTransitionTime": "2021-07-19T10:13:02Z",
2021-07-19T10:17:31.2018472Z [cluster2] "message": "no conflicts found",
2021-07-19T10:17:31.2019060Z [cluster2] "reason": "NoConflicts",
2021-07-19T10:17:31.2019594Z [cluster2] "status": "True",
2021-07-19T10:17:31.2020205Z [cluster2] "type": "NamesAccepted"
2021-07-19T10:17:31.2020711Z [cluster2] },
2021-07-19T10:17:31.2021098Z [cluster2] {
2021-07-19T10:17:31.2021855Z [cluster2] "lastTransitionTime": "2021-07-19T10:13:02Z",
2021-07-19T10:17:31.2022683Z [cluster2] "message": "the initial names have been accepted",
2021-07-19T10:17:31.2023442Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-19T10:17:31.2024057Z [cluster2] "status": "True",
2021-07-19T10:17:31.2024580Z [cluster2] "type": "Established"
2021-07-19T10:17:31.2025058Z [cluster2] }
2021-07-19T10:17:31.2025448Z [cluster2] ],
2021-07-19T10:17:31.2025931Z [cluster2] "storedVersions": [
2021-07-19T10:17:31.2026404Z [cluster2] "v1"
2021-07-19T10:17:31.2026894Z [cluster2] ]
2021-07-19T10:17:31.2027268Z [cluster2] }
2021-07-19T10:17:31.2027650Z [cluster2] }
2021-07-19T10:17:31.2028702Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T10:17:31.2030461Z [submariner-operator]$ [cluster2] validate_equals .metadata.name endpoints.submariner.io
2021-07-19T10:17:31.2032379Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:31.2034012Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:31.2035367Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:31.2036987Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:31.2038613Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:31.2039915Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:31.2041548Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:31.2043241Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-19T10:17:31.2044556Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Endpoint
2021-07-19T10:17:31.2046242Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:31.2048011Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T10:17:31.2049654Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Endpoint
2021-07-19T10:17:31.2051694Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/endpoints.submariner.io.cluster2.json
2021-07-19T10:17:31.2053344Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-19T10:17:31.2054382Z [submariner-operator]$ [cluster2] verify_clusters_crd
2021-07-19T10:17:31.2055618Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T10:17:31.2057047Z [submariner-operator]$ [cluster2] validate_crd clusters.submariner.io v1 Cluster
2021-07-19T10:17:31.2058430Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-19T10:17:31.2059794Z [submariner-operator]$ [cluster2] kubectl get crds clusters.submariner.io
2021-07-19T10:17:31.2061281Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds clusters.submariner.io
2021-07-19T10:17:31.2062260Z [cluster2] NAME CREATED AT
2021-07-19T10:17:31.6315601Z [cluster2] clusters.submariner.io 2021-07-19T10:12:52Z
2021-07-19T10:17:31.6317518Z [submariner-operator]$ [cluster1] json_file=/tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:31.6319118Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6320706Z [submariner-operator]$ [cluster1] tee /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:31.6322279Z [submariner-operator]$ [cluster1] kubectl get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6323823Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6324956Z [cluster1] {
2021-07-19T10:17:31.6325588Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:31.6326451Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-19T10:17:31.6327133Z [cluster1] "metadata": {
2021-07-19T10:17:31.6327660Z [cluster1] "annotations": {
2021-07-19T10:17:31.6328837Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:31.6329576Z [cluster1] },
2021-07-19T10:17:31.6330355Z [cluster1] "creationTimestamp": "2021-07-19T10:12:52Z",
2021-07-19T10:17:31.6330979Z [cluster1] "generation": 1,
2021-07-19T10:17:31.6331542Z [cluster1] "managedFields": [
2021-07-19T10:17:31.6332041Z [cluster1] {
2021-07-19T10:17:31.6332687Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:31.6333428Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:31.6334106Z [cluster1] "fieldsV1": {
2021-07-19T10:17:31.6334618Z [cluster1] "f:metadata": {
2021-07-19T10:17:31.6335171Z [cluster1] "f:annotations": {
2021-07-19T10:17:31.6335692Z [cluster1] ".": {},
2021-07-19T10:17:31.6336739Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:31.6337507Z [cluster1] }
2021-07-19T10:17:31.6337945Z [cluster1] },
2021-07-19T10:17:31.6338415Z [cluster1] "f:spec": {
2021-07-19T10:17:31.6338931Z [cluster1] "f:conversion": {
2021-07-19T10:17:31.6339444Z [cluster1] ".": {},
2021-07-19T10:17:31.6339931Z [cluster1] "f:strategy": {}
2021-07-19T10:17:31.6340419Z [cluster1] },
2021-07-19T10:17:31.6340881Z [cluster1] "f:group": {},
2021-07-19T10:17:31.6341398Z [cluster1] "f:names": {
2021-07-19T10:17:31.6341897Z [cluster1] "f:kind": {},
2021-07-19T10:17:31.6342403Z [cluster1] "f:listKind": {},
2021-07-19T10:17:31.6342947Z [cluster1] "f:plural": {},
2021-07-19T10:17:31.6343467Z [cluster1] "f:singular": {}
2021-07-19T10:17:31.6343954Z [cluster1] },
2021-07-19T10:17:31.6344537Z [cluster1] "f:scope": {},
2021-07-19T10:17:31.6345066Z [cluster1] "f:versions": {}
2021-07-19T10:17:31.6345544Z [cluster1] },
2021-07-19T10:17:31.6346016Z [cluster1] "f:status": {
2021-07-19T10:17:31.6346593Z [cluster1] "f:acceptedNames": {
2021-07-19T10:17:31.6347144Z [cluster1] "f:kind": {},
2021-07-19T10:17:31.6347662Z [cluster1] "f:plural": {}
2021-07-19T10:17:31.6348135Z [cluster1] },
2021-07-19T10:17:31.6348642Z [cluster1] "f:conditions": {},
2021-07-19T10:17:31.6349386Z [cluster1] "f:storedVersions": {}
2021-07-19T10:17:31.6349922Z [cluster1] }
2021-07-19T10:17:31.6350344Z [cluster1] },
2021-07-19T10:17:31.6351186Z [cluster1] "manager": "submariner-operator",
2021-07-19T10:17:31.6352123Z [cluster1] "operation": "Update",
2021-07-19T10:17:31.6352887Z [cluster1] "time": "2021-07-19T10:12:58Z"
2021-07-19T10:17:31.6353370Z [cluster1] }
2021-07-19T10:17:31.6353778Z [cluster1] ],
2021-07-19T10:17:31.6354390Z [cluster1] "name": "clusters.submariner.io",
2021-07-19T10:17:31.6355101Z [cluster1] "resourceVersion": "1369",
2021-07-19T10:17:31.6356011Z [cluster1] "uid": "799e3259-623c-49c7-ace0-ca98c5ee7f9e"
2021-07-19T10:17:31.6356595Z [cluster1] },
2021-07-19T10:17:31.6357149Z [cluster1] "spec": {
2021-07-19T10:17:31.6357629Z [cluster1] "conversion": {
2021-07-19T10:17:31.6358166Z [cluster1] "strategy": "None"
2021-07-19T10:17:31.6358632Z [cluster1] },
2021-07-19T10:17:31.6359160Z [cluster1] "group": "submariner.io",
2021-07-19T10:17:31.6359814Z [cluster1] "names": {
2021-07-19T10:17:31.6360320Z [cluster1] "kind": "Cluster",
2021-07-19T10:17:31.6360906Z [cluster1] "listKind": "ClusterList",
2021-07-19T10:17:31.6361502Z [cluster1] "plural": "clusters",
2021-07-19T10:17:31.6362074Z [cluster1] "singular": "cluster"
2021-07-19T10:17:31.6362551Z [cluster1] },
2021-07-19T10:17:31.6363057Z [cluster1] "scope": "Namespaced",
2021-07-19T10:17:31.6363592Z [cluster1] "versions": [
2021-07-19T10:17:31.6364055Z [cluster1] {
2021-07-19T10:17:31.6364502Z [cluster1] "name": "v1",
2021-07-19T10:17:31.6364991Z [cluster1] "schema": {
2021-07-19T10:17:31.6365562Z [cluster1] "openAPIV3Schema": {
2021-07-19T10:17:31.6366176Z [cluster1] "properties": {
2021-07-19T10:17:31.6366750Z [cluster1] "apiVersion": {
2021-07-19T10:17:31.6369167Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:31.6371019Z [cluster1] "type": "string"
2021-07-19T10:17:31.6371526Z [cluster1] },
2021-07-19T10:17:31.6371986Z [cluster1] "kind": {
2021-07-19T10:17:31.6374271Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:31.6376110Z [cluster1] "type": "string"
2021-07-19T10:17:31.6376605Z [cluster1] },
2021-07-19T10:17:31.6377108Z [cluster1] "metadata": {
2021-07-19T10:17:31.6377771Z [cluster1] "type": "object"
2021-07-19T10:17:31.6378285Z [cluster1] },
2021-07-19T10:17:31.6378751Z [cluster1] "spec": {
2021-07-19T10:17:31.6379290Z [cluster1] "properties": {
2021-07-19T10:17:31.6379854Z [cluster1] "cluster_cidr": {
2021-07-19T10:17:31.6380407Z [cluster1] "items": {
2021-07-19T10:17:31.6380965Z [cluster1] "type": "string"
2021-07-19T10:17:31.6381484Z [cluster1] },
2021-07-19T10:17:31.6382007Z [cluster1] "type": "array"
2021-07-19T10:17:31.6382510Z [cluster1] },
2021-07-19T10:17:31.6383023Z [cluster1] "cluster_id": {
2021-07-19T10:17:31.6383567Z [cluster1] "type": "string"
2021-07-19T10:17:31.6384088Z [cluster1] },
2021-07-19T10:17:31.6384600Z [cluster1] "color_codes": {
2021-07-19T10:17:31.6385118Z [cluster1] "items": {
2021-07-19T10:17:31.6385665Z [cluster1] "type": "string"
2021-07-19T10:17:31.6386175Z [cluster1] },
2021-07-19T10:17:31.6386698Z [cluster1] "type": "array"
2021-07-19T10:17:31.6387256Z [cluster1] },
2021-07-19T10:17:31.6387766Z [cluster1] "global_cidr": {
2021-07-19T10:17:31.6388284Z [cluster1] "items": {
2021-07-19T10:17:31.6388835Z [cluster1] "type": "string"
2021-07-19T10:17:31.6389360Z [cluster1] },
2021-07-19T10:17:31.6389872Z [cluster1] "type": "array"
2021-07-19T10:17:31.6390381Z [cluster1] },
2021-07-19T10:17:31.6390888Z [cluster1] "service_cidr": {
2021-07-19T10:17:31.6391436Z [cluster1] "items": {
2021-07-19T10:17:31.6420092Z [cluster1] "type": "string"
2021-07-19T10:17:31.6420664Z [cluster1] },
2021-07-19T10:17:31.6421203Z [cluster1] "type": "array"
2021-07-19T10:17:31.6421729Z [cluster1] }
2021-07-19T10:17:31.6422201Z [cluster1] },
2021-07-19T10:17:31.6422701Z [cluster1] "required": [
2021-07-19T10:17:31.6423526Z [cluster1] "cluster_cidr",
2021-07-19T10:17:31.6424215Z [cluster1] "cluster_id",
2021-07-19T10:17:31.6424791Z [cluster1] "color_codes",
2021-07-19T10:17:31.6425333Z [cluster1] "global_cidr",
2021-07-19T10:17:31.6425971Z [cluster1] "service_cidr"
2021-07-19T10:17:31.6426475Z [cluster1] ],
2021-07-19T10:17:31.6426991Z [cluster1] "type": "object"
2021-07-19T10:17:31.6444843Z [cluster1] }
2021-07-19T10:17:31.6445315Z [cluster1] },
2021-07-19T10:17:31.6445818Z [cluster1] "required": [
2021-07-19T10:17:31.6446319Z [cluster1] "spec"
2021-07-19T10:17:31.6446786Z [cluster1] ],
2021-07-19T10:17:31.6447278Z [cluster1] "type": "object"
2021-07-19T10:17:31.6447773Z [cluster1] }
2021-07-19T10:17:31.6448196Z [cluster1] },
2021-07-19T10:17:31.6448833Z [cluster1] "served": true,
2021-07-19T10:17:31.6449355Z [cluster1] "storage": true
2021-07-19T10:17:31.6449835Z [cluster1] }
2021-07-19T10:17:31.6450258Z [cluster1] ]
2021-07-19T10:17:31.6450664Z [cluster1] },
2021-07-19T10:17:31.6451107Z [cluster1] "status": {
2021-07-19T10:17:31.6451626Z [cluster1] "acceptedNames": {
2021-07-19T10:17:31.6452195Z [cluster1] "kind": "Cluster",
2021-07-19T10:17:31.6452774Z [cluster1] "listKind": "ClusterList",
2021-07-19T10:17:31.6453388Z [cluster1] "plural": "clusters",
2021-07-19T10:17:31.6453950Z [cluster1] "singular": "cluster"
2021-07-19T10:17:31.6454451Z [cluster1] },
2021-07-19T10:17:31.6454909Z [cluster1] "conditions": [
2021-07-19T10:17:31.6455521Z [cluster1] {
2021-07-19T10:17:31.6456603Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:52Z",
2021-07-19T10:17:31.6457327Z [cluster1] "message": "no conflicts found",
2021-07-19T10:17:31.6457958Z [cluster1] "reason": "NoConflicts",
2021-07-19T10:17:31.6458516Z [cluster1] "status": "True",
2021-07-19T10:17:31.6459112Z [cluster1] "type": "NamesAccepted"
2021-07-19T10:17:31.6459968Z [cluste21-07-19T10:13:02Z
2021-07-19T10:17:31.6461226Z [submariner-operator]$ [cluster2] json_file=/tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:31.6462847Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6464572Z [submariner-operator]$ [cluster2] tee /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:31.6466145Z [submariner-operator]$ [cluster2] kubectl get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6467703Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd clusters.submariner.io -o json
2021-07-19T10:17:31.6468616Z [cluster2] {
2021-07-19T10:17:31.6469253Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:31.6470110Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-19T10:17:31.6470806Z [cluster2] "metadata": {
2021-07-19T10:17:31.6471313Z [cluster2] "annotations": {
2021-07-19T10:17:31.6473182Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:31.6473945Z [cluster2] },
2021-07-19T10:17:31.6474710Z [cluster2] "creationTimestamp": "2021-07-19T10:13:02Z",
2021-07-19T10:17:31.6475362Z [cluster2] "generation": 1,
2021-07-19T10:17:31.6475914Z [cluster2] "managedFields": [
2021-07-19T10:17:31.6476427Z [cluster2] {
2021-07-19T10:17:31.6477067Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:31.6477824Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:31.6478401Z [cluster2] "fieldsV1": {
2021-07-19T10:17:31.6478933Z [cluster2] "f:metadata": {
2021-07-19T10:17:31.6479483Z [cluster2] "f:annotations": {
2021-07-19T10:17:31.6480005Z [cluster2] ".": {},
2021-07-19T10:17:31.6481105Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:31.6481866Z [cluster2] }
2021-07-19T10:17:31.6482313Z [cluster2] },
2021-07-19T10:17:31.6482772Z [cluster2] "f:spec": {
2021-07-19T10:17:31.6483305Z [cluster2] "f:conversion": {
2021-07-19T10:17:31.6483815Z [cluster2] ".": {},
2021-07-19T10:17:31.6484330Z [cluster2] "f:strategy": {}
2021-07-19T10:17:31.6484812Z [cluster2] },
2021-07-19T10:17:31.6485294Z [cluster2] "f:group": {},
2021-07-19T10:17:31.6485877Z [cluster2] "f:names": {
2021-07-19T10:17:31.6486364Z [cluster2] "f:kind": {},
2021-07-19T10:17:31.6487035Z [cluster2] "f:listKind": {},
2021-07-19T10:17:31.6487567Z [cluster2] "f:plural": {},
2021-07-19T10:17:31.6488106Z [cluster2] "f:singular": {}
2021-07-19T10:17:31.6488584Z [cluster2] },
2021-07-19T10:17:31.6489068Z [cluster2] "f:scope": {},
2021-07-19T10:17:31.6489582Z [cluster2] "f:versions": {}
2021-07-19T10:17:31.6490077Z [cluster2] },
2021-07-19T10:17:31.6490542Z [cluster2] "f:status": {
2021-07-19T10:17:31.6491113Z [cluster2] "f:acceptedNames": {
2021-07-19T10:17:31.6491681Z [cluster2] "f:kind": {},
2021-07-19T10:17:31.6492181Z [cluster2] "f:plural": {}
2021-07-19T10:17:31.6492762Z [cluster2] },
2021-07-19T10:17:31.6493263Z [cluster2] "f:conditions": {},
2021-07-19T10:17:31.6493874Z [cluster2] "f:storedVersions": {}
2021-07-19T10:17:31.6494406Z [cluster2] }
2021-07-19T10:17:31.6494843Z [cluster2] },
2021-07-19T10:17:31.6495666Z [cluster2] "manager": "submariner-operator",
2021-07-19T10:17:31.6496364Z [cluster2] "operation": "Update",
2021-07-19T10:17:31.6497101Z [cluster2] "time": "2021-07-19T10:13:10Z"
2021-07-19T10:17:31.6497563Z [cluster2] }
2021-07-19T10:17:31.6498078Z [cluster2] ],
2021-07-19T10:17:31.6498682Z [cluster2] "name": "clusters.submariner.io",
2021-07-19T10:17:31.6499406Z [cluster2] "resourceVersion": "1353",
2021-07-19T10:17:31.6500313Z [cluster2] "uid": "c5d69306-6b1a-4571-b0f6-3ef18196f563"
2021-07-19T10:17:31.6500910Z [cluster2] },
2021-07-19T10:17:31.6501332Z [cluster2] "spec": {
2021-07-19T10:17:31.6501827Z [cluster2] "conversion": {
2021-07-19T10:17:31.6502357Z [cluster2] "strategy": "None"
2021-07-19T10:17:31.6502834Z [cluster2] },
2021-07-19T10:17:31.6503347Z [cluster2] "group": "submariner.io",
2021-07-19T10:17:31.6503891Z [cluster2] "names": {
2021-07-19T10:17:31.6504394Z [cluster2] "kind": "Cluster",
2021-07-19T10:17:31.6504967Z [cluster2] "listKind": "ClusterList",
2021-07-19T10:17:31.6505605Z [cluster2] "plural": "clusters",
2021-07-19T10:17:31.6506168Z [cluster2] "singular": "cluster"
2021-07-19T10:17:31.6506665Z [cluster2] },
2021-07-19T10:17:31.6507156Z [cluster2] "scope": "Namespaced",
2021-07-19T10:17:31.6507704Z [cluster2] "versions": [
2021-07-19T10:17:31.6508150Z [cluster2] {
2021-07-19T10:17:31.6508604Z [cluster2] "name": "v1",
2021-07-19T10:17:31.6509085Z [cluster2] "schema": {
2021-07-19T10:17:31.6509664Z [cluster2] "openAPIV3Schema": {
2021-07-19T10:17:31.6510284Z [cluster2] "properties": {
2021-07-19T10:17:31.6510841Z [cluster2] "apiVersion": {
2021-07-19T10:17:31.6513379Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:31.6515241Z [cluster2] "type": "string"
2021-07-19T10:17:31.6515764Z [cluster2] },
2021-07-19T10:17:31.6516246Z [cluster2] "kind": {
2021-07-19T10:17:31.6518614Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:31.6520456Z [cluster2] "type": "string"
2021-07-19T10:17:31.6520976Z [cluster2] },
2021-07-19T10:17:31.6521466Z [cluster2] "metadata": {
2021-07-19T10:17:31.6522024Z [cluster2] "type": "object"
2021-07-19T10:17:31.6522517Z [cluster2] },
2021-07-19T10:17:31.6522998Z [cluster2] "spec": {
2021-07-19T10:17:31.6523534Z [cluster2] "properties": {
2021-07-19T10:17:31.6524116Z [cluster2] "cluster_cidr": {
2021-07-19T10:17:31.6524666Z [cluster2] "items": {
2021-07-19T10:17:31.6546360Z [cluster2] "type": "string"
2021-07-19T10:17:31.6546922Z [cluster2] },
2021-07-19T10:17:31.6547457Z [cluster2] "type": "array"
2021-07-19T10:17:31.6547972Z [cluster2] },
2021-07-19T10:17:31.6548478Z [cluster2] "cluster_id": {
2021-07-19T10:17:31.6549041Z [cluster2] "type": "string"
2021-07-19T10:17:31.6549549Z [cluster2] },
2021-07-19T10:17:31.6550212Z [cluster2] "color_codes": {
2021-07-19T10:17:31.6550906Z [cluster2] "items": {
2021-07-19T10:17:31.6551447Z [cluster2] "type": "string"
2021-07-19T10:17:31.6552125Z [cluster2] },
2021-07-19T10:17:31.6552633Z [cluster2] "type": "array"
2021-07-19T10:17:31.6553148Z [cluster2] },
2021-07-19T10:17:31.6553649Z [cluster2] "global_cidr": {
2021-07-19T10:17:31.6554191Z [cluster2] "items": {
2021-07-19T10:17:31.6554741Z [cluster2] "type": "string"
2021-07-19T10:17:31.6555257Z [cluster2] },
2021-07-19T10:17:31.6555776Z [cluster2] "type": "array"
2021-07-19T10:17:31.6556275Z [cluster2] },
2021-07-19T10:17:31.6556799Z [cluster2] "service_cidr": {
2021-07-19T10:17:31.6557334Z [cluster2] "items": {
2021-07-19T10:17:31.6557883Z [cluster2] "type": "string"
2021-07-19T10:17:31.6558393Z [cluster2] },
2021-07-19T10:17:31.6558908Z [cluster2] "type": "array"
2021-07-19T10:17:31.6559424Z [cluster2] }
2021-07-19T10:17:31.6559882Z [cluster2] },
2021-07-19T10:17:31.6560391Z [cluster2] "required": [
2021-07-19T10:17:31.6560940Z [cluster2] "cluster_cidr",
2021-07-19T10:17:31.6561496Z [cluster2] "cluster_id",
2021-07-19T10:17:31.6562038Z [cluster2] "color_codes",
2021-07-19T10:17:31.6562591Z [cluster2] "global_cidr",
2021-07-19T10:17:31.6563141Z [cluster2] "service_cidr"
2021-07-19T10:17:31.6563652Z [cluster2] ],
2021-07-19T10:17:31.6564167Z [cluster2] "type": "object"
2021-07-19T10:17:31.6564655Z [cluster2] }
2021-07-19T10:17:31.6565107Z [cluster2] },
2021-07-19T10:17:31.6565585Z [cluster2] "required": [
2021-07-19T10:17:31.6566191Z [cluster2] "spec"
2021-07-19T10:17:31.6566649Z [cluster2] ],
2021-07-19T10:17:31.6567150Z [cluster2] "type": "object"
2021-07-19T10:17:31.6567634Z [cluster2] }
2021-07-19T10:17:31.6568071Z [cluster2] },
2021-07-19T10:17:31.6568549Z [cluster2] "served": true,
2021-07-19T10:17:31.6569084Z [cluster2] "storage": true
2021-07-19T10:17:31.6569568Z [cluster2] }
2021-07-19T10:17:31.6569982Z [cluster2] ]
2021-07-19T10:17:31.6570399Z [cluster2] },
2021-07-19T10:17:31.6570825Z [cluster2] "status": {
2021-07-19T10:17:31.6571357Z [cluster2] "acceptedNames": {
2021-07-19T10:17:31.6571912Z [cluster2] "kind": "Cluster",
2021-07-19T10:17:31.6572501Z [cluster2] "listKind": "ClusterList",
2021-07-19T10:17:31.6573097Z [cluster2] "plural": "clusters",
2021-07-19T10:17:31.6573679Z [cluster2] "singular": "cluster"
2021-07-19T10:17:31.6574160Z [cluster2] },
2021-07-19T10:17:31.6574640Z [cluster2] "conditions": [
2021-07-19T10:17:31.6575100Z [cluster2] {
2021-07-19T10:17:31.6576102Z [cluster2] "lastTransitionTime": "2021-07-19T10:13:02Z",
2021-07-19T10:17:31.6576820Z [cluster2] "message": "no conflicts found",
2021-07-19T10:17:31.6577441Z [cluster2] "reason": "NoConflicts",
2021-07-19T10:17:31.6578016Z [cluster2] "status": "True",
2021-07-19T10:17:31.6578683Z [cluster2] "type": "NamesAccepted"
2021-07-19T10:17:32.5850192Z [cluster2] },
2021-07-19T10:17:32.5850965Z [cluster2] {
2021-07-19T10:17:32.5852340Z [cluster2] "lastTransitionTime": "2021-07-19T10:13:02Z",
2021-07-19T10:17:32.5853259Z [cluster2] "message": "the initial names have been accepted",
2021-07-19T10:17:32.5854156Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-19T10:17:32.5854967Z [cluster2] "status": "True",
2021-07-19T10:17:32.5855740Z [cluster2] "type": "Established"
2021-07-19T10:17:32.5856423Z [cluster2] }
2021-07-19T10:17:32.5856939Z [cluster2] ],
2021-07-19T10:17:32.5857534Z [cluster2] "storedVersions": [
2021-07-19T10:17:32.5858144Z [cluster2] "v1"
2021-07-19T10:17:32.5858647Z [cluster2] ]
2021-07-19T10:17:32.5859183Z [cluster2] }
2021-07-19T10:17:32.5859683Z [cluster2] }
2021-07-19T10:17:32.5860908Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-19T10:17:32.5862594Z [submariner-operator]$ [cluster2] validate_equals .metadata.name clusters.submariner.io
2021-07-19T10:17:32.5864454Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:32.5866180Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:32.5867587Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:32.5869395Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:32.5871128Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:32.5888347Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:32.5890205Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:32.5891960Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-19T10:17:32.5893382Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Cluster
2021-07-19T10:17:32.5895252Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:32.5897315Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T10:17:32.5899102Z [submariner-operator]$ [cluster2] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T10:17:32.5901122Z [submariner-operator]$ [cluster2] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster2.json
2021-07-19T10:17:32.5902842Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-19T10:17:32.5903945Z [submariner-operator]$ [cluster2] verify_subm_crd
2021-07-19T10:17:32.5905407Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T10:17:32.5907253Z [submariner-operator]$ [cluster2] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T10:17:32.5908902Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T10:17:32.5910482Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T10:17:32.5912359Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-19T10:17:32.5913487Z [cluster2] NAME CREATED AT
2021-07-19T10:17:32.5914610Z [cluster2] submariners.submariner.io 2021-07-19T10:12:53Z
2021-07-19T10:17:32.5916246Z [submariner-operator]$ [cluster2] json_file=/tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:32.5918109Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-19T10:17:32.5920063Z [submariner-operator]$ [cluster2] tee /tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:32.5921853Z [submariner-operator]$ [cluster2] kubectl get crd submariners.submariner.io -o json
2021-07-19T10:17:32.5923622Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crd submariners.submariner.io -o json
2021-07-19T10:17:32.5924700Z [cluster2] {
2021-07-19T10:17:32.5925419Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:32.5926468Z [cluster2] "kind": "CustomResourceDefinition",
2021-07-19T10:17:32.5927247Z [cluster2] "metadata": {
2021-07-19T10:17:32.5927848Z [cluster2] "annotations": {
2021-07-19T10:17:32.5928961Z [cluster2] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:32.5929790Z [cluster2] },
2021-07-19T10:17:32.5930666Z [cluster2] "creationTimestamp": "2021-07-19T10:12:53Z",
2021-07-19T10:17:32.5931410Z [cluster2] "generation": 2,
2021-07-19T10:17:32.5932046Z [cluster2] "managedFields": [
2021-07-19T10:17:32.5932651Z [cluster2] {
2021-07-19T10:17:32.5933391Z [cluster2] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:32.5934243Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:32.5934922Z [cluster2] "fieldsV1": {
2021-07-19T10:17:32.5935523Z [cluster2] "f:metadata": {
2021-07-19T10:17:32.5936267Z [cluster2] "f:annotations": {
2021-07-19T10:17:32.5936824Z [cluster2] ".": {},
2021-07-19T10:17:32.5937838Z [cluster2] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:32.5938642Z [cluster2] }
2021-07-19T10:17:32.5939130Z [cluster2] },
2021-07-19T10:17:32.5939656Z [cluster2] "f:spec": {
2021-07-19T10:17:32.5940222Z [cluster2] "f:conversion": {
2021-07-19T10:17:32.5979522Z [cluster2] ".": {},
2021-07-19T10:17:32.6000570Z [cluster2] "f:strategy": {}
2021-07-19T10:17:32.6001073Z [cluster2] },
2021-07-19T10:17:32.6001517Z [cluster2] "f:group": {},
2021-07-19T10:17:32.6001995Z [cluster2] "f:names": {
2021-07-19T10:17:32.6002448Z [cluster2] "f:kind": {},
2021-07-19T10:17:32.6003097Z [cluster2] "f:listKind": {},
2021-07-19T10:17:32.6003597Z [cluster2] "f:plural": {},
2021-07-19T10:17:32.6004100Z [cluster2] "f:singular": {}
2021-07-19T10:17:32.6004546Z [cluster2] },
2021-07-19T10:17:32.6004996Z [cluster2] "f:scope": {},
2021-07-19T10:17:32.6005484Z [cluster2] "f:versions": {}
2021-07-19T10:17:32.6006085Z [cluster2] },
2021-07-19T10:17:32.6006539Z [cluster2] "f:status": {
2021-07-19T10:17:32.6007059Z [cluster2] "f:acceptedNames": {
2021-07-19T10:17:32.6007585Z [cluster2] "f:kind": {},
2021-07-19T10:17:32.6008052Z [cluster2] "f:plural": {}
2021-07-19T10:17:32.6008505Z [cluster2] },
2021-07-19T10:17:32.6008963Z [cluster2] "f:conditions": {},
2021-07-19T10:17:32.6009538Z [cluster2] "f:storedVersions": {}
2021-07-19T10:17:32.6010028Z [cluster2] }
2021-07-19T10:17:32.6010433Z [cluster2] },
2021-07-19T10:17:32.6011012Z [cluster2] "manager": "subctl",
2021-07-19T10:17:32.6011542Z [cluster2] "operation": "Update",
2021-07-19T10:17:32.6012450Z [cluster2] "time": "2021-07-19T10:15:53Z"
2021-07-19T10:17:32.6012884Z [cluster2] }
2021-07-19T10:17:32.6013280Z [cluster2] ],
2021-07-19T10:17:32.6013980Z [cluster2] "name": "submariners.submariner.io",
2021-07-19T10:17:32.6014815Z [cluster2] "resourceVersion": "1970",
2021-07-19T10:17:32.6015945Z [cluster2] "uid": "eefac931-f594-48ab-8e79-5d28c2b87e62"
2021-07-19T10:17:32.6016708Z [cluster2] },
2021-07-19T10:17:32.6017103Z [cluster2] "spec": {
2021-07-19T10:17:32.6017561Z [cluster2] "conversion": {
2021-07-19T10:17:32.6018064Z [cluster2] "strategy": "None"
2021-07-19T10:17:32.6018503Z [cluster2] },
2021-07-19T10:17:32.6018993Z [cluster2] "group": "submariner.io",
2021-07-19T10:17:32.6019597Z [cluster2] "names": {
2021-07-19T10:17:32.6020087Z [cluster2] "kind": "Submariner",
2021-07-19T10:17:32.6020661Z [cluster2] "listKind": "SubmarinerList",
2021-07-19T10:17:32.6021271Z [cluster2] "plural": "submariners",
2021-07-19T10:17:32.6021854Z [cluster2] "singular": "submariner"
2021-07-19T10:17:32.6022338Z [cluster2] },
2021-07-19T10:17:32.6022797Z [cluster2] "scope": "Namespaced",
2021-07-19T10:17:32.6023305Z [cluster2] "versions": [
2021-07-19T10:17:32.6023726Z [cluster2] {
2021-07-19T10:17:32.6024182Z [cluster2] "name": "v1alpha1",
2021-07-19T10:17:32.6024664Z [cluster2] "schema": {
2021-07-19T10:17:32.6025185Z [cluster2] "openAPIV3Schema": {
2021-07-19T10:17:32.6025943Z [cluster2] "description": "Submariner is the Schema for the submariners API",
2021-07-19T10:17:32.6026649Z [cluster2] "properties": {
2021-07-19T10:17:32.6027187Z [cluster2] "apiVersion": {
2021-07-19T10:17:32.6029403Z [cluster2] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:32.6031125Z [cluster2] "type": "string"
2021-07-19T10:17:32.6031598Z [cluster2] },
2021-07-19T10:17:32.6048697Z [cluster2] "kind": {
2021-07-19T10:17:32.6051121Z [cluster2] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:32.6053040Z [cluster2] "type": "string"
2021-07-19T10:17:32.6053544Z [cluster2] },
2021-07-19T10:17:32.6054050Z [cluster2] "metadata": {
2021-07-19T10:17:32.6054603Z [cluster2] "type": "object"
2021-07-19T10:17:32.6055109Z [cluster2] },
2021-07-19T10:17:32.6055591Z [cluster2] "spec": {
2021-07-19T10:17:32.6056382Z [cluster2] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T10:17:32.6057230Z [cluster2] "properties": {
2021-07-19T10:17:32.6057775Z [cluster2] "broker": {
2021-07-19T10:17:32.6058327Z [cluster2] "type": "string"
2021-07-19T10:17:32.6058849Z [cluster2] },
2021-07-19T10:17:32.6059447Z [cluster2] "brokerK8sApiServer": {
2021-07-19T10:17:32.6060111Z [cluster2] "type": "string"
2021-07-19T10:17:32.6060615Z [cluster2] },
2021-07-19T10:17:32.6061287Z [cluster2] "brokerK8sApiServerToken": {
2021-07-19T10:17:32.6062082Z [cluster2] "type": "string"
2021-07-19T10:17:32.6062604Z [cluster2] },
2021-07-19T10:17:32.6063127Z [cluster2] "brokerK8sCA": {
2021-07-19T10:17:32.6063712Z [cluster2] "type": "string"
2021-07-19T10:17:32.6064231Z [cluster2] },
2021-07-19T10:17:32.6064993Z [cluster2] "brokerK8sRemoteNamespace": {
2021-07-19T10:17:32.6065679Z [cluster2] "type": "string"
2021-07-19T10:17:32.6066146Z [cluster2] },
2021-07-19T10:17:32.6066647Z [cluster2] "cableDriver": {
2021-07-19T10:17:32.6067176Z [cluster2] "type": "string"
2021-07-19T10:17:32.6067656Z [cluster2] },
2021-07-19T10:17:32.6068175Z [cluster2] "ceIPSecDebug": {
2021-07-19T10:17:32.6068731Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6069222Z [cluster2] },
2021-07-19T10:17:32.6069819Z [cluster2] "ceIPSecForceUDPEncaps": {
2021-07-19T10:17:32.6070486Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6070966Z [cluster2] },
2021-07-19T10:17:32.6071504Z [cluster2] "ceIPSecIKEPort": {
2021-07-19T10:17:32.6152579Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6153147Z [cluster2] },
2021-07-19T10:17:32.6153744Z [cluster2] "ceIPSecNATTPort": {
2021-07-19T10:17:32.6154387Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6154943Z [cluster2] },
2021-07-19T10:17:32.6155467Z [cluster2] "ceIPSecPSK": {
2021-07-19T10:17:32.6156056Z [cluster2] "type": "string"
2021-07-19T10:17:32.6156566Z [cluster2] },
2021-07-19T10:17:32.6157245Z [cluster2] "ceIPSecPreferredServer": {
2021-07-19T10:17:32.6158281Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6158816Z [cluster2] },
2021-07-19T10:17:32.6207034Z [cluster2] "clusterCIDR": {
2021-07-19T10:17:32.6207642Z [cluster2] "type": "string"
2021-07-19T10:17:32.6208176Z [cluster2] },
2021-07-19T10:17:32.6208694Z [cluster2] "clusterID": {
2021-07-19T10:17:32.6209269Z [cluster2] "type": "string"
2021-07-19T10:17:32.6209791Z [cluster2] },
2021-07-19T10:17:32.6210316Z [cluster2] "colorCodes": {
2021-07-19T10:17:32.6210883Z [cluster2] "type": "string"
2021-07-19T10:17:32.6211408Z [cluster2] },
2021-07-19T10:17:32.6212170Z [cluster2] "connectionHealthCheck": {
2021-07-19T10:17:32.6212884Z [cluster2] "properties": {
2021-07-19T10:17:32.6213470Z [cluster2] "enabled": {
2021-07-19T10:17:32.6214038Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6214585Z [cluster2] },
2021-07-19T10:17:32.6215158Z [cluster2] "intervalSeconds": {
2021-07-19T10:17:32.6215991Z [cluster2] "description": "The interval at which health check pings are sent.",
2021-07-19T10:17:32.6216926Z [cluster2] "format": "int64",
2021-07-19T10:17:32.6217506Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6218057Z [cluster2] },
2021-07-19T10:17:32.6218669Z [cluster2] "maxPacketLossCount": {
2021-07-19T10:17:32.6219694Z [cluster2] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T10:17:32.6220618Z [cluster2] "format": "int64",
2021-07-19T10:17:32.6221201Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6221744Z [cluster2] }
2021-07-19T10:17:32.6222254Z [cluster2] },
2021-07-19T10:17:32.6222785Z [cluster2] "type": "object"
2021-07-19T10:17:32.6223297Z [cluster2] },
2021-07-19T10:17:32.6223924Z [cluster2] "coreDNSCustomConfig": {
2021-07-19T10:17:32.6224614Z [cluster2] "properties": {
2021-07-19T10:17:32.6225230Z [cluster2] "configMapName": {
2021-07-19T10:17:32.6225858Z [cluster2] "type": "string"
2021-07-19T10:17:32.6226379Z [cluster2] },
2021-07-19T10:17:32.6226925Z [cluster2] "namespace": {
2021-07-19T10:17:32.6227494Z [cluster2] "type": "string"
2021-07-19T10:17:32.6228029Z [cluster2] }
2021-07-19T10:17:32.6228499Z [cluster2] },
2021-07-19T10:17:32.6229028Z [cluster2] "type": "object"
2021-07-19T10:17:32.6229554Z [cluster2] },
2021-07-19T10:17:32.6230093Z [cluster2] "customDomains": {
2021-07-19T10:17:32.6230669Z [cluster2] "items": {
2021-07-19T10:17:32.6231284Z [cluster2] "type": "string"
2021-07-19T10:17:32.6259256Z [cluster2] },
2021-07-19T10:17:32.6259805Z [cluster2] "type": "array",
2021-07-19T10:17:32.6260981Z [cluster2] "x-kubernetes-list-type": "set"
2021-07-19T10:17:32.6261657Z [cluster2] },
2021-07-19T10:17:32.6262144Z [cluster2] "debug": {
2021-07-19T10:17:32.6262718Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6263238Z [cluster2] },
2021-07-19T10:17:32.6263771Z [cluster2] "globalCIDR": {
2021-07-19T10:17:32.6264330Z [cluster2] "type": "string"
2021-07-19T10:17:32.6264855Z [cluster2] },
2021-07-19T10:17:32.6265418Z [cluster2] "imageOverrides": {
2021-07-19T10:17:32.6266158Z [cluster2] "additionalProperties": {
2021-07-19T10:17:32.6266852Z [cluster2] "type": "string"
2021-07-19T10:17:32.6267369Z [cluster2] },
2021-07-19T10:17:32.6267895Z [cluster2] "type": "object"
2021-07-19T10:17:32.6268406Z [cluster2] },
2021-07-19T10:17:32.6269153Z [cluster2] "loadBalancerEnabled": {
2021-07-19T10:17:32.6269817Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6270347Z [cluster2] },
2021-07-19T10:17:32.6270860Z [cluster2] "namespace": {
2021-07-19T10:17:32.6271439Z [cluster2] "type": "string"
2021-07-19T10:17:32.6272152Z [cluster2] },
2021-07-19T10:17:32.6272669Z [cluster2] "natEnabled": {
2021-07-19T10:17:32.6273254Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6273773Z [cluster2] },
2021-07-19T10:17:32.6274304Z [cluster2] "repository": {
2021-07-19T10:17:32.6274875Z [cluster2] "type": "string"
2021-07-19T10:17:32.6275398Z [cluster2] },
2021-07-19T10:17:32.6275926Z [cluster2] "serviceCIDR": {
2021-07-19T10:17:32.6276520Z [cluster2] "type": "string"
2021-07-19T10:17:32.6277042Z [cluster2] },
2021-07-19T10:17:32.6277703Z [cluster2] "serviceDiscoveryEnabled": {
2021-07-19T10:17:32.6278436Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6278954Z [cluster2] },
2021-07-19T10:17:32.6279460Z [cluster2] "version": {
2021-07-19T10:17:32.6279999Z [cluster2] "type": "string"
2021-07-19T10:17:32.6280524Z [cluster2] }
2021-07-19T10:17:32.6280992Z [cluster2] },
2021-07-19T10:17:32.6281491Z [cluster2] "required": [
2021-07-19T10:17:32.6282035Z [cluster2] "broker",
2021-07-19T10:17:32.6282664Z [cluster2] "brokerK8sApiServer",
2021-07-19T10:17:32.6283468Z [cluster2] "brokerK8sApiServerToken",
2021-07-19T10:17:32.6284187Z [cluster2] "brokerK8sCA",
2021-07-19T10:17:32.6284932Z [cluster2] "brokerK8sRemoteNamespace",
2021-07-19T10:17:32.6285814Z [cluster2] "ceIPSecDebug",
2021-07-19T10:17:32.6286443Z [cluster2] "ceIPSecPSK",
2021-07-19T10:17:32.6287045Z [cluster2] "clusterCIDR",
2021-07-19T10:17:32.6287611Z [cluster2] "clusterID",
2021-07-19T10:17:32.6288156Z [cluster2] "debug",
2021-07-19T10:17:32.6288689Z [cluster2] "namespace",
2021-07-19T10:17:32.6289275Z [cluster2] "natEnabled",
2021-07-19T10:17:32.6289860Z [cluster2] "serviceCIDR"
2021-07-19T10:17:32.6290391Z [cluster2] ],
2021-07-19T10:17:32.6290893Z [cluster2] "type": "object"
2021-07-19T10:17:32.6291401Z [cluster2] },
2021-07-19T10:17:32.6291887Z [cluster2] "status": {
2021-07-19T10:17:32.6292712Z [cluster2] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T10:17:32.6293585Z [cluster2] "properties": {
2021-07-19T10:17:32.6294166Z [cluster2] "clusterCIDR": {
2021-07-19T10:17:32.6294758Z [cluster2] "type": "string"
2021-07-19T10:17:32.6295266Z [cluster2] },
2021-07-19T10:17:32.6295793Z [cluster2] "clusterID": {
2021-07-19T10:17:32.6296415Z [cluster2] "type": "string"
2021-07-19T10:17:32.6296931Z [cluster2] },
2021-07-19T10:17:32.6297460Z [cluster2] "colorCodes": {
2021-07-19T10:17:32.6298024Z [cluster2] "type": "string"
2021-07-19T10:17:32.6298550Z [cluster2] },
2021-07-19T10:17:32.6299106Z [cluster2] "deploymentInfo": {
2021-07-19T10:17:32.6301191Z [cluster2] "properties": {
2021-07-19T10:17:32.6301807Z [cluster2] "cloudProvider": {
2021-07-19T10:17:32.6302428Z [cluster2] "type": "string"
2021-07-19T10:17:32.6302968Z [cluster2] },
2021-07-19T10:17:32.6303542Z [cluster2] "kubernetesType": {
2021-07-19T10:17:32.6304178Z [cluster2] "type": "string"
2021-07-19T10:17:32.6304697Z [cluster2] },
2021-07-19T10:17:32.6305374Z [cluster2] "kubernetesTypeVersion": {
2021-07-19T10:17:32.6306075Z [cluster2] "type": "string"
2021-07-19T10:17:32.6306613Z [cluster2] },
2021-07-19T10:17:32.6307205Z [cluster2] "kubernetesVersion": {
2021-07-19T10:17:32.6307869Z [cluster2] "type": "string"
2021-07-19T10:17:32.6308405Z [cluster2] }
2021-07-19T10:17:32.6308871Z [cluster2] },
2021-07-19T10:17:32.6309401Z [cluster2] "type": "object"
2021-07-19T10:17:32.6309912Z [cluster2] },
2021-07-19T10:17:32.6310905Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-19T10:17:32.6311624Z [cluster2] "properties": {
2021-07-19T10:17:32.6312882Z [cluster2] "lastResourceVersion": {
2021-07-19T10:17:32.6313569Z [cluster2] "type": "string"
2021-07-19T10:17:32.6314192Z [cluster2] },
2021-07-19T10:17:32.6314916Z [cluster2] "mismatchedContainerImages": {
2021-07-19T10:17:32.6315675Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6316227Z [cluster2] },
2021-07-19T10:17:32.6316902Z [cluster2] "nonReadyContainerStates": {
2021-07-19T10:17:32.6317628Z [cluster2] "items": {
2021-07-19T10:17:32.6318933Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.6320257Z [cluster2] "properties": {
2021-07-19T10:17:32.6320862Z [cluster2] "running": {
2021-07-19T10:17:32.6321607Z [cluster2] "description": "Details about a running container",
2021-07-19T10:17:32.6322396Z [cluster2] "properties": {
2021-07-19T10:17:32.6323025Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6324254Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.6325401Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6326054Z [cluster2] "type": "string"
2021-07-19T10:17:32.6326604Z [cluster2] }
2021-07-19T10:17:32.6327127Z [cluster2] },
2021-07-19T10:17:32.6327679Z [cluster2] "type": "object"
2021-07-19T10:17:32.6335044Z [cluster2] },
2021-07-19T10:17:32.6336323Z [cluster2] "terminated": {
2021-07-19T10:17:32.6337509Z [cluster2] "description": "Details about a terminated container",
2021-07-19T10:17:32.6338708Z [cluster2] "properties": {
2021-07-19T10:17:32.6339341Z [cluster2] "containerID": {
2021-07-19T10:17:32.6340565Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.6341423Z [cluster2] "type": "string"
2021-07-19T10:17:32.6341975Z [cluster2] },
2021-07-19T10:17:32.6342543Z [cluster2] "exitCode": {
2021-07-19T10:17:32.6343352Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.6344180Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6344801Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6345363Z [cluster2] },
2021-07-19T10:17:32.6345937Z [cluster2] "finishedAt": {
2021-07-19T10:17:32.6346812Z [cluster2] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.6347871Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6348513Z [cluster2] "type": "string"
2021-07-19T10:17:32.6349146Z [cluster2] },
2021-07-19T10:17:32.6349663Z [cluster2] "message": {
2021-07-19T10:17:32.6350431Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.6351216Z [cluster2] "type": "string"
2021-07-19T10:17:32.6351851Z [cluster2] },
2021-07-19T10:17:32.6352347Z [cluster2] "reason": {
2021-07-19T10:17:32.6353108Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.6353863Z [cluster2] "type": "string"
2021-07-19T10:17:32.6354389Z [cluster2] },
2021-07-19T10:17:32.6354957Z [cluster2] "signal": {
2021-07-19T10:17:32.6355682Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.6356629Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6357240Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6357814Z [cluster2] },
2021-07-19T10:17:32.6358367Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6359213Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.6373651Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6374305Z [cluster2] "type": "string"
2021-07-19T10:17:32.6374875Z [cluster2] }
2021-07-19T10:17:32.6375380Z [cluster2] },
2021-07-19T10:17:32.6375932Z [cluster2] "required": [
2021-07-19T10:17:32.6376548Z [cluster2] "exitCode"
2021-07-19T10:17:32.6377100Z [cluster2] ],
2021-07-19T10:17:32.6377658Z [cluster2] "type": "object"
2021-07-19T10:17:32.6378206Z [cluster2] },
2021-07-19T10:17:32.6378753Z [cluster2] "waiting": {
2021-07-19T10:17:32.6379478Z [cluster2] "description": "Details about a waiting container",
2021-07-19T10:17:32.6380241Z [cluster2] "properties": {
2021-07-19T10:17:32.6380857Z [cluster2] "message": {
2021-07-19T10:17:32.6381773Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.6382603Z [cluster2] "type": "string"
2021-07-19T10:17:32.6383153Z [cluster2] },
2021-07-19T10:17:32.6383705Z [cluster2] "reason": {
2021-07-19T10:17:32.6384478Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.6385258Z [cluster2] "type": "string"
2021-07-19T10:17:32.6394840Z [cluster2] }
2021-07-19T10:17:32.6395874Z [cluster2] },
2021-07-19T10:17:32.6413300Z [cluster2] "type": "object"
2021-07-19T10:17:32.6414033Z [cluster2] }
2021-07-19T10:17:32.6414546Z [cluster2] },
2021-07-19T10:17:32.6415155Z [cluster2] "type": "object"
2021-07-19T10:17:32.6415694Z [cluster2] },
2021-07-19T10:17:32.6416229Z [cluster2] "type": "array"
2021-07-19T10:17:32.6416908Z [cluster2] },
2021-07-19T10:17:32.6417423Z [cluster2] "status": {
2021-07-19T10:17:32.6418256Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.6419149Z [cluster2] "properties": {
2021-07-19T10:17:32.6419800Z [cluster2] "collisionCount": {
2021-07-19T10:17:32.6421189Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.6422581Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6423268Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6423820Z [cluster2] },
2021-07-19T10:17:32.6424369Z [cluster2] "conditions": {
2021-07-19T10:17:32.6425744Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.6426651Z [cluster2] "items": {
2021-07-19T10:17:32.6427579Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.6428519Z [cluster2] "properties": {
2021-07-19T10:17:32.6429219Z [cluster2] "lastTransitionTime": {
2021-07-19T10:17:32.6430159Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.6431277Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6432039Z [cluster2] "type": "string"
2021-07-19T10:17:32.6432691Z [cluster2] },
2021-07-19T10:17:32.6433249Z [cluster2] "message": {
2021-07-19T10:17:32.6434110Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.6434991Z [cluster2] "type": "string"
2021-07-19T10:17:32.6435560Z [cluster2] },
2021-07-19T10:17:32.6436089Z [cluster2] "reason": {
2021-07-19T10:17:32.6437158Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.6437944Z [cluster2] "type": "string"
2021-07-19T10:17:32.6438512Z [cluster2] },
2021-07-19T10:17:32.6439037Z [cluster2] "status": {
2021-07-19T10:17:32.6439836Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.6440648Z [cluster2] "type": "string"
2021-07-19T10:17:32.6441267Z [cluster2] },
2021-07-19T10:17:32.6441802Z [cluster2] "type": {
2021-07-19T10:17:32.6442510Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.6443253Z [cluster2] "type": "string"
2021-07-19T10:17:32.6443820Z [cluster2] }
2021-07-19T10:17:32.6444315Z [cluster2] },
2021-07-19T10:17:32.6444872Z [cluster2] "required": [
2021-07-19T10:17:32.6445434Z [cluster2] "status",
2021-07-19T10:17:32.6445992Z [cluster2] "type"
2021-07-19T10:17:32.6446510Z [cluster2] ],
2021-07-19T10:17:32.6447074Z [cluster2] "type": "object"
2021-07-19T10:17:32.6447631Z [cluster2] },
2021-07-19T10:17:32.6448161Z [cluster2] "type": "array"
2021-07-19T10:17:32.6448698Z [cluster2] },
2021-07-19T10:17:32.6449367Z [cluster2] "currentNumberScheduled": {
2021-07-19T10:17:32.6457255Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6458648Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6459267Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6459907Z [cluster2] },
2021-07-19T10:17:32.6460579Z [cluster2] "desiredNumberScheduled": {
2021-07-19T10:17:32.6463638Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6465070Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6465684Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6466225Z [cluster2] },
2021-07-19T10:17:32.6466832Z [cluster2] "numberAvailable": {
2021-07-19T10:17:32.6468073Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.6469269Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6469869Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6470428Z [cluster2] },
2021-07-19T10:17:32.6471054Z [cluster2] "numberMisscheduled": {
2021-07-19T10:17:32.6472565Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6473973Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6474565Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6475124Z [cluster2] },
2021-07-19T10:17:32.6475695Z [cluster2] "numberReady": {
2021-07-19T10:17:32.6476680Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.6477646Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6478229Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6478784Z [cluster2] },
2021-07-19T10:17:32.6479399Z [cluster2] "numberUnavailable": {
2021-07-19T10:17:32.6480629Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.6481812Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6482399Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6482953Z [cluster2] },
2021-07-19T10:17:32.6483583Z [cluster2] "observedGeneration": {
2021-07-19T10:17:32.6484517Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.6485377Z [cluster2] "format": "int64",
2021-07-19T10:17:32.6485968Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6486519Z [cluster2] },
2021-07-19T10:17:32.6487189Z [cluster2] "updatedNumberScheduled": {
2021-07-19T10:17:32.6488216Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.6489026Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6489604Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6490167Z [cluster2] }
2021-07-19T10:17:32.6490640Z [cluster2] },
2021-07-19T10:17:32.6491181Z [cluster2] "required": [
2021-07-19T10:17:32.6491912Z [cluster2] "currentNumberScheduled",
2021-07-19T10:17:32.6492761Z [cluster2] "desiredNumberScheduled",
2021-07-19T10:17:32.6493569Z [cluster2] "numberMisscheduled",
2021-07-19T10:17:32.6494253Z [cluster2] "numberReady"
2021-07-19T10:17:32.6494818Z [cluster2] ],
2021-07-19T10:17:32.6495347Z [cluster2] "type": "object"
2021-07-19T10:17:32.6495884Z [cluster2] }
2021-07-19T10:17:32.6496352Z [cluster2] },
2021-07-19T10:17:32.6496876Z [cluster2] "required": [
2021-07-19T10:17:32.6497684Z [cluster2] "mismatchedContainerImages"
2021-07-19T10:17:32.6498376Z [cluster2] ],
2021-07-19T10:17:32.6498908Z [cluster2] "type": "object"
2021-07-19T10:17:32.6499421Z [cluster2] },
2021-07-19T10:17:32.6499929Z [cluster2] "gateways": {
2021-07-19T10:17:32.6500458Z [cluster2] "items": {
2021-07-19T10:17:32.6501027Z [cluster2] "properties": {
2021-07-19T10:17:32.6501630Z [cluster2] "connections": {
2021-07-19T10:17:32.6502195Z [cluster2] "items": {
2021-07-19T10:17:32.6502779Z [cluster2] "properties": {
2021-07-19T10:17:32.6503381Z [cluster2] "endpoint": {
2021-07-19T10:17:32.6503993Z [cluster2] "properties": {
2021-07-19T10:17:32.6504581Z [cluster2] "backend": {
2021-07-19T10:17:32.6505189Z [cluster2] "type": "string"
2021-07-19T10:17:32.6505759Z [cluster2] },
2021-07-19T10:17:32.6506326Z [cluster2] "backend_config": {
2021-07-19T10:17:32.6507069Z [cluster2] "additionalProperties": {
2021-07-19T10:17:32.6507788Z [cluster2] "type": "string"
2021-07-19T10:17:32.6508365Z [cluster2] },
2021-07-19T10:17:32.6508929Z [cluster2] "type": "object"
2021-07-19T10:17:32.6509502Z [cluster2] },
2021-07-19T10:17:32.6510061Z [cluster2] "cable_name": {
2021-07-19T10:17:32.6510704Z [cluster2] "type": "string"
2021-07-19T10:17:32.6511269Z [cluster2] },
2021-07-19T10:17:32.6559071Z [cluster2] "cluster_id": {
2021-07-19T10:17:32.6559915Z [cluster2] "type": "string"
2021-07-19T10:17:32.6560497Z [cluster2] },
2021-07-19T10:17:32.6561168Z [cluster2] "healthCheckIP": {
2021-07-19T10:17:32.6561951Z [cluster2] "type": "string"
2021-07-19T10:17:32.6562510Z [cluster2] },
2021-07-19T10:17:32.6563066Z [cluster2] "hostname": {
2021-07-19T10:17:32.6563664Z [cluster2] "type": "string"
2021-07-19T10:17:32.6564227Z [cluster2] },
2021-07-19T10:17:32.6564786Z [cluster2] "nat_enabled": {
2021-07-19T10:17:32.6565398Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6566130Z [cluster2] },
2021-07-19T10:17:32.6566758Z [cluster2] "private_ip": {
2021-07-19T10:17:32.6567374Z [cluster2] "type": "string"
2021-07-19T10:17:32.6567945Z [cluster2] },
2021-07-19T10:17:32.6568488Z [cluster2] "public_ip": {
2021-07-19T10:17:32.6569094Z [cluster2] "type": "string"
2021-07-19T10:17:32.6569733Z [cluster2] },
2021-07-19T10:17:32.6570288Z [cluster2] "subnets": {
2021-07-19T10:17:32.6570843Z [cluster2] "items": {
2021-07-19T10:17:32.6571440Z [cluster2] "type": "string"
2021-07-19T10:17:32.6572012Z [cluster2] },
2021-07-19T10:17:32.6572567Z [cluster2] "type": "array"
2021-07-19T10:17:32.6573210Z [cluster2] }
2021-07-19T10:17:32.6573721Z [cluster2] },
2021-07-19T10:17:32.6574278Z [cluster2] "required": [
2021-07-19T10:17:32.6574854Z [cluster2] "backend",
2021-07-19T10:17:32.6575437Z [cluster2] "cable_name",
2021-07-19T10:17:32.6576032Z [cluster2] "cluster_id",
2021-07-19T10:17:32.6576613Z [cluster2] "hostname",
2021-07-19T10:17:32.6577217Z [cluster2] "nat_enabled",
2021-07-19T10:17:32.6577804Z [cluster2] "private_ip",
2021-07-19T10:17:32.6578478Z [cluster2] "public_ip",
2021-07-19T10:17:32.6579070Z [cluster2] "subnets"
2021-07-19T10:17:32.6579602Z [cluster2] ],
2021-07-19T10:17:32.6580161Z [cluster2] "type": "object"
2021-07-19T10:17:32.6580700Z [cluster2] },
2021-07-19T10:17:32.6581283Z [cluster2] "latencyRTT": {
2021-07-19T10:17:32.6582328Z [cluster2] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T10:17:32.6583378Z [cluster2] "properties": {
2021-07-19T10:17:32.6583990Z [cluster2] "average": {
2021-07-19T10:17:32.6584575Z [cluster2] "type": "string"
2021-07-19T10:17:32.6585144Z [cluster2] },
2021-07-19T10:17:32.6585665Z [cluster2] "last": {
2021-07-19T10:17:32.6586240Z [cluster2] "type": "string"
2021-07-19T10:17:32.6586871Z [cluster2] },
2021-07-19T10:17:32.6587384Z [cluster2] "max": {
2021-07-19T10:17:32.6587964Z [cluster2] "type": "string"
2021-07-19T10:17:32.6588515Z [cluster2] },
2021-07-19T10:17:32.6589051Z [cluster2] "min": {
2021-07-19T10:17:32.6589607Z [cluster2] "type": "string"
2021-07-19T10:17:32.6590172Z [cluster2] },
2021-07-19T10:17:32.6590716Z [cluster2] "stdDev": {
2021-07-19T10:17:32.6591305Z [cluster2] "type": "string"
2021-07-19T10:17:32.6593575Z [cluster2] }
2021-07-19T10:17:32.6594084Z [cluster2] },
2021-07-19T10:17:32.6594647Z [cluster2] "type": "object"
2021-07-19T10:17:32.6595211Z [cluster2] },
2021-07-19T10:17:32.6595726Z [cluster2] "status": {
2021-07-19T10:17:32.6596312Z [cluster2] "type": "string"
2021-07-19T10:17:32.6597167Z [cluster2] },
2021-07-19T10:17:32.6598019Z [cluster2] "statusMessage": {
2021-07-19T10:17:32.6598906Z [cluster2] "type": "string"
2021-07-19T10:17:32.6599711Z [cluster2] },
2021-07-19T10:17:32.6600514Z [cluster2] "usingIP": {
2021-07-19T10:17:32.6601575Z [cluster2] "type": "string"
2021-07-19T10:17:32.6602488Z [cluster2] },
2021-07-19T10:17:32.6603281Z [cluster2] "usingNAT": {
2021-07-19T10:17:32.6604723Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6605287Z [cluster2] }
2021-07-19T10:17:32.6605795Z [cluster2] },
2021-07-19T10:17:32.6606336Z [cluster2] "required": [
2021-07-19T10:17:32.6606922Z [cluster2] "endpoint",
2021-07-19T10:17:32.6607498Z [cluster2] "status",
2021-07-19T10:17:32.6608100Z [cluster2] "statusMessage"
2021-07-19T10:17:32.6608686Z [cluster2] ],
2021-07-19T10:17:32.6609229Z [cluster2] "type": "object"
2021-07-19T10:17:32.6609779Z [cluster2] },
2021-07-19T10:17:32.6610322Z [cluster2] "type": "array"
2021-07-19T10:17:32.6610847Z [cluster2] },
2021-07-19T10:17:32.6611382Z [cluster2] "haStatus": {
2021-07-19T10:17:32.6612043Z [cluster2] "type": "string"
2021-07-19T10:17:32.6612582Z [cluster2] },
2021-07-19T10:17:32.6613136Z [cluster2] "localEndpoint": {
2021-07-19T10:17:32.6614166Z [cluster2] "properties": {
2021-07-19T10:17:32.6617784Z [cluster2] "backend": {
2021-07-19T10:17:32.6618370Z [cluster2] "type": "string"
2021-07-19T10:17:32.6618922Z [cluster2] },
2021-07-19T10:17:32.6619464Z [cluster2] "backend_config": {
2021-07-19T10:17:32.6620181Z [cluster2] "additionalProperties": {
2021-07-19T10:17:32.6620884Z [cluster2] "type": "string"
2021-07-19T10:17:32.6621448Z [cluster2] },
2021-07-19T10:17:32.6622041Z [cluster2] "type": "object"
2021-07-19T10:17:32.6622588Z [cluster2] },
2021-07-19T10:17:32.6623136Z [cluster2] "cable_name": {
2021-07-19T10:17:32.6623709Z [cluster2] "type": "string"
2021-07-19T10:17:32.6624260Z [cluster2] },
2021-07-19T10:17:32.6624782Z [cluster2] "cluster_id": {
2021-07-19T10:17:32.6625373Z [cluster2] "type": "string"
2021-07-19T10:17:32.6625922Z [cluster2] },
2021-07-19T10:17:32.6626497Z [cluster2] "healthCheckIP": {
2021-07-19T10:17:32.6627134Z [cluster2] "type": "string"
2021-07-19T10:17:32.6627664Z [cluster2] },
2021-07-19T10:17:32.6628204Z [cluster2] "hostname": {
2021-07-19T10:17:32.6628865Z [cluster2] "type": "string"
2021-07-19T10:17:32.6629414Z [cluster2] },
2021-07-19T10:17:32.6629961Z [cluster2] "nat_enabled": {
2021-07-19T10:17:32.6630549Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6631110Z [cluster2] },
2021-07-19T10:17:32.6631647Z [cluster2] "private_ip": {
2021-07-19T10:17:32.6632377Z [cluster2] "type": "string"
2021-07-19T10:17:32.6632910Z [cluster2] },
2021-07-19T10:17:32.6633450Z [cluster2] "public_ip": {
2021-07-19T10:17:32.6634038Z [cluster2] "type": "string"
2021-07-19T10:17:32.6634571Z [cluster2] },
2021-07-19T10:17:32.6644657Z [cluster2] "subnets": {
2021-07-19T10:17:32.6645207Z [cluster2] "items": {
2021-07-19T10:17:32.6645782Z [cluster2] "type": "string"
2021-07-19T10:17:32.6646324Z [cluster2] },
2021-07-19T10:17:32.6646973Z [cluster2] "type": "array"
2021-07-19T10:17:32.6647521Z [cluster2] }
2021-07-19T10:17:32.6648008Z [cluster2] },
2021-07-19T10:17:32.6648548Z [cluster2] "required": [
2021-07-19T10:17:32.6649109Z [cluster2] "backend",
2021-07-19T10:17:32.6649689Z [cluster2] "cable_name",
2021-07-19T10:17:32.6650252Z [cluster2] "cluster_id",
2021-07-19T10:17:32.6650834Z [cluster2] "hostname",
2021-07-19T10:17:32.6651417Z [cluster2] "nat_enabled",
2021-07-19T10:17:32.6651996Z [cluster2] "private_ip",
2021-07-19T10:17:32.6652574Z [cluster2] "public_ip",
2021-07-19T10:17:32.6653145Z [cluster2] "subnets"
2021-07-19T10:17:32.6653660Z [cluster2] ],
2021-07-19T10:17:32.6654196Z [cluster2] "type": "object"
2021-07-19T10:17:32.6654723Z [cluster2] },
2021-07-19T10:17:32.6655292Z [cluster2] "statusFailure": {
2021-07-19T10:17:32.6655909Z [cluster2] "type": "string"
2021-07-19T10:17:32.6656429Z [cluster2] },
2021-07-19T10:17:32.6656949Z [cluster2] "version": {
2021-07-19T10:17:32.6657503Z [cluster2] "type": "string"
2021-07-19T10:17:32.6658036Z [cluster2] }
2021-07-19T10:17:32.6658504Z [cluster2] },
2021-07-19T10:17:32.6659029Z [cluster2] "required": [
2021-07-19T10:17:32.6659602Z [cluster2] "connections",
2021-07-19T10:17:32.6660249Z [cluster2] "haStatus",
2021-07-19T10:17:32.6660863Z [cluster2] "localEndpoint",
2021-07-19T10:17:32.6661495Z [cluster2] "statusFailure",
2021-07-19T10:17:32.6662096Z [cluster2] "version"
2021-07-19T10:17:32.6662598Z [cluster2] ],
2021-07-19T10:17:32.6663127Z [cluster2] "type": "object"
2021-07-19T10:17:32.6663646Z [cluster2] },
2021-07-19T10:17:32.6664173Z [cluster2] "type": "array"
2021-07-19T10:17:32.6664685Z [cluster2] },
2021-07-19T10:17:32.6665201Z [cluster2] "globalCIDR": {
2021-07-19T10:17:32.6665776Z [cluster2] "type": "string"
2021-07-19T10:17:32.6666284Z [cluster2] },
2021-07-19T10:17:32.6666975Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-19T10:17:32.6667720Z [cluster2] "properties": {
2021-07-19T10:17:32.6668413Z [cluster2] "lastResourceVersion": {
2021-07-19T10:17:32.6669088Z [cluster2] "type": "string"
2021-07-19T10:17:32.6669614Z [cluster2] },
2021-07-19T10:17:32.6670383Z [cluster2] "mismatchedContainerImages": {
2021-07-19T10:17:32.6671137Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6686575Z [cluster2] },
2021-07-19T10:17:32.6687279Z [cluster2] "nonReadyContainerStates": {
2021-07-19T10:17:32.6688000Z [cluster2] "items": {
2021-07-19T10:17:32.6689299Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.6690621Z [cluster2] "properties": {
2021-07-19T10:17:32.6691211Z [cluster2] "running": {
2021-07-19T10:17:32.6691925Z [cluster2] "description": "Details about a running container",
2021-07-19T10:17:32.6692684Z [cluster2] "properties": {
2021-07-19T10:17:32.6693293Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6694548Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.6695589Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6696211Z [cluster2] "type": "string"
2021-07-19T10:17:32.6696776Z [cluster2] }
2021-07-19T10:17:32.6697428Z [cluster2] },
2021-07-19T10:17:32.6697992Z [cluster2] "type": "object"
2021-07-19T10:17:32.6698550Z [cluster2] },
2021-07-19T10:17:32.6699097Z [cluster2] "terminated": {
2021-07-19T10:17:32.6699961Z [cluster2] "description": "Details about a terminated container",
2021-07-19T10:17:32.6700733Z [cluster2] "properties": {
2021-07-19T10:17:32.6701371Z [cluster2] "containerID": {
2021-07-19T10:17:32.6702548Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.6703377Z [cluster2] "type": "string"
2021-07-19T10:17:32.6703950Z [cluster2] },
2021-07-19T10:17:32.6704498Z [cluster2] "exitCode": {
2021-07-19T10:17:32.6705316Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.6706133Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6706740Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6707308Z [cluster2] },
2021-07-19T10:17:32.6707862Z [cluster2] "finishedAt": {
2021-07-19T10:17:32.6708660Z [cluster2] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.6709766Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6710407Z [cluster2] "type": "string"
2021-07-19T10:17:32.6710974Z [cluster2] },
2021-07-19T10:17:32.6711511Z [cluster2] "message": {
2021-07-19T10:17:32.6736537Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.6737390Z [cluster2] "type": "string"
2021-07-19T10:17:32.6737957Z [cluster2] },
2021-07-19T10:17:32.6738505Z [cluster2] "reason": {
2021-07-19T10:17:32.6739318Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.6740138Z [cluster2] "type": "string"
2021-07-19T10:17:32.6740679Z [cluster2] },
2021-07-19T10:17:32.6741216Z [cluster2] "signal": {
2021-07-19T10:17:32.6741984Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.6742785Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6743400Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6743964Z [cluster2] },
2021-07-19T10:17:32.6744533Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6745374Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.6746755Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6747407Z [cluster2] "type": "string"
2021-07-19T10:17:32.6747951Z [cluster2] }
2021-07-19T10:17:32.6748469Z [cluster2] },
2021-07-19T10:17:32.6749007Z [cluster2] "required": [
2021-07-19T10:17:32.6749612Z [cluster2] "exitCode"
2021-07-19T10:17:32.6750170Z [cluster2] ],
2021-07-19T10:17:32.6750714Z [cluster2] "type": "object"
2021-07-19T10:17:32.6751267Z [cluster2] },
2021-07-19T10:17:32.6751926Z [cluster2] "waiting": {
2021-07-19T10:17:32.6752665Z [cluster2] "description": "Details about a waiting container",
2021-07-19T10:17:32.6753413Z [cluster2] "properties": {
2021-07-19T10:17:32.6754021Z [cluster2] "message": {
2021-07-19T10:17:32.6754839Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.6755727Z [cluster2] "type": "string"
2021-07-19T10:17:32.6756286Z [cluster2] },
2021-07-19T10:17:32.6756813Z [cluster2] "reason": {
2021-07-19T10:17:32.6757583Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.6758355Z [cluster2] "type": "string"
2021-07-19T10:17:32.6758902Z [cluster2] }
2021-07-19T10:17:32.6759413Z [cluster2] },
2021-07-19T10:17:32.6759956Z [cluster2] "type": "object"
2021-07-19T10:17:32.6760518Z [cluster2] }
2021-07-19T10:17:32.6761004Z [cluster2] },
2021-07-19T10:17:32.6761551Z [cluster2] "type": "object"
2021-07-19T10:17:32.6762094Z [cluster2] },
2021-07-19T10:17:32.6762612Z [cluster2] "type": "array"
2021-07-19T10:17:32.6763143Z [cluster2] },
2021-07-19T10:17:32.6763640Z [cluster2] "status": {
2021-07-19T10:17:32.6764482Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.6765354Z [cluster2] "properties": {
2021-07-19T10:17:32.6765998Z [cluster2] "collisionCount": {
2021-07-19T10:17:32.6767399Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.6768737Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6769401Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6769953Z [cluster2] },
2021-07-19T10:17:32.6770504Z [cluster2] "conditions": {
2021-07-19T10:17:32.6771765Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.6772651Z [cluster2] "items": {
2021-07-19T10:17:32.6773575Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.6774514Z [cluster2] "properties": {
2021-07-19T10:17:32.6775217Z [cluster2] "lastTransitionTime": {
2021-07-19T10:17:32.6776161Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.6777255Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6777895Z [cluster2] "type": "string"
2021-07-19T10:17:32.6778442Z [cluster2] },
2021-07-19T10:17:32.6779050Z [cluster2] "message": {
2021-07-19T10:17:32.6779920Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.6780786Z [cluster2] "type": "string"
2021-07-19T10:17:32.6781347Z [cluster2] },
2021-07-19T10:17:32.6781877Z [cluster2] "reason": {
2021-07-19T10:17:32.6782927Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.6783701Z [cluster2] "type": "string"
2021-07-19T10:17:32.6784264Z [cluster2] },
2021-07-19T10:17:32.6784802Z [cluster2] "status": {
2021-07-19T10:17:32.6785575Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.6786377Z [cluster2] "type": "string"
2021-07-19T10:17:32.6786925Z [cluster2] },
2021-07-19T10:17:32.6787460Z [cluster2] "type": {
2021-07-19T10:17:32.6788181Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.6788916Z [cluster2] "type": "string"
2021-07-19T10:17:32.6791490Z [cluster2] }
2021-07-19T10:17:32.6792160Z [cluster2] },
2021-07-19T10:17:32.6792718Z [cluster2] "required": [
2021-07-19T10:17:32.6793289Z [cluster2] "status",
2021-07-19T10:17:32.6793856Z [cluster2] "type"
2021-07-19T10:17:32.6794510Z [cluster2] ],
2021-07-19T10:17:32.6795059Z [cluster2] "type": "object"
2021-07-19T10:17:32.6795609Z [cluster2] },
2021-07-19T10:17:32.6796139Z [cluster2] "type": "array"
2021-07-19T10:17:32.6796679Z [cluster2] },
2021-07-19T10:17:32.6797348Z [cluster2] "currentNumberScheduled": {
2021-07-19T10:17:32.6798839Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6800158Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6800753Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6801312Z [cluster2] },
2021-07-19T10:17:32.6801982Z [cluster2] "desiredNumberScheduled": {
2021-07-19T10:17:32.6803523Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6804987Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6805576Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6806127Z [cluster2] },
2021-07-19T10:17:32.6806713Z [cluster2] "numberAvailable": {
2021-07-19T10:17:32.6807964Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.6809148Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6809737Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6810295Z [cluster2] },
2021-07-19T10:17:32.6810902Z [cluster2] "numberMisscheduled": {
2021-07-19T10:17:32.6812303Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6813613Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6814204Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6814758Z [cluster2] },
2021-07-19T10:17:32.6815306Z [cluster2] "numberReady": {
2021-07-19T10:17:32.6816304Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.6817269Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6817852Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6818453Z [cluster2] },
2021-07-19T10:17:32.6819057Z [cluster2] "numberUnavailable": {
2021-07-19T10:17:32.6820303Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.6821726Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6822356Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6822912Z [cluster2] },
2021-07-19T10:17:32.6823532Z [cluster2] "observedGeneration": {
2021-07-19T10:17:32.6824483Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.6825342Z [cluster2] "format": "int64",
2021-07-19T10:17:32.6825928Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6826475Z [cluster2] },
2021-07-19T10:17:32.6827148Z [cluster2] "updatedNumberScheduled": {
2021-07-19T10:17:32.6828103Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.6828996Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6829580Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6830134Z [cluster2] }
2021-07-19T10:17:32.6830614Z [cluster2] },
2021-07-19T10:17:32.6831145Z [cluster2] "required": [
2021-07-19T10:17:32.6832070Z [cluster2] "currentNumberScheduled",
2021-07-19T10:17:32.6832958Z [cluster2] "desiredNumberScheduled",
2021-07-19T10:17:32.6833777Z [cluster2] "numberMisscheduled",
2021-07-19T10:17:32.6834458Z [cluster2] "numberReady"
2021-07-19T10:17:32.6835023Z [cluster2] ],
2021-07-19T10:17:32.6835551Z [cluster2] "type": "object"
2021-07-19T10:17:32.6836087Z [cluster2] }
2021-07-19T10:17:32.6836554Z [cluster2] },
2021-07-19T10:17:32.6837072Z [cluster2] "required": [
2021-07-19T10:17:32.6837823Z [cluster2] "mismatchedContainerImages"
2021-07-19T10:17:32.6838508Z [cluster2] ],
2021-07-19T10:17:32.6839031Z [cluster2] "type": "object"
2021-07-19T10:17:32.6839540Z [cluster2] },
2021-07-19T10:17:32.6840143Z [cluster2] "loadBalancerStatus": {
2021-07-19T10:17:32.6840798Z [cluster2] "properties": {
2021-07-19T10:17:32.6841369Z [cluster2] "status": {
2021-07-19T10:17:32.6844161Z [cluster2] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T10:17:32.6845112Z [cluster2] "properties": {
2021-07-19T10:17:32.6845817Z [cluster2] "ingress": {
2021-07-19T10:17:32.6847349Z [cluster2] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T10:17:32.6848460Z [cluster2] "items": {
2021-07-19T10:17:32.6852919Z [cluster2] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T10:17:32.6854426Z [cluster2] "properties": {
2021-07-19T10:17:32.6875534Z [cluster2] "hostname": {
2021-07-19T10:17:32.6877052Z [cluster2] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T10:17:32.6878067Z [cluster2] "type": "string"
2021-07-19T10:17:32.6878620Z [cluster2] },
2021-07-19T10:17:32.6879151Z [cluster2] "ip": {
2021-07-19T10:17:32.6880481Z [cluster2] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T10:17:32.6881668Z [cluster2] "type": "string"
2021-07-19T10:17:32.6882227Z [cluster2] }
2021-07-19T10:17:32.6882729Z [cluster2] },
2021-07-19T10:17:32.6883667Z [cluster2] "type": "object"
2021-07-19T10:17:32.6884189Z [cluster2] },
2021-07-19T10:17:32.6884685Z [cluster2] "type": "array"
2021-07-19T10:17:32.6885184Z [cluster2] }
2021-07-19T10:17:32.6885631Z [cluster2] },
2021-07-19T10:17:32.6886140Z [cluster2] "type": "object"
2021-07-19T10:17:32.6886624Z [cluster2] }
2021-07-19T10:17:32.6887081Z [cluster2] },
2021-07-19T10:17:32.6887574Z [cluster2] "type": "object"
2021-07-19T10:17:32.6888046Z [cluster2] },
2021-07-19T10:17:32.6893176Z [cluster2] "natEnabled": {
2021-07-19T10:17:32.6893775Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6894315Z [cluster2] },
2021-07-19T10:17:32.6894858Z [cluster2] "networkPlugin": {
2021-07-19T10:17:32.6895463Z [cluster2] "type": "string"
2021-07-19T10:17:32.6895977Z [cluster2] },
2021-07-19T10:17:32.6896690Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-19T10:17:32.6897480Z [cluster2] "properties": {
2021-07-19T10:17:32.6898164Z [cluster2] "lastResourceVersion": {
2021-07-19T10:17:32.6898853Z [cluster2] "type": "string"
2021-07-19T10:17:32.6899377Z [cluster2] },
2021-07-19T10:17:32.6900232Z [cluster2] "mismatchedContainerImages": {
2021-07-19T10:17:32.6900992Z [cluster2] "type": "boolean"
2021-07-19T10:17:32.6901535Z [cluster2] },
2021-07-19T10:17:32.6902228Z [cluster2] "nonReadyContainerStates": {
2021-07-19T10:17:32.6902930Z [cluster2] "items": {
2021-07-19T10:17:32.6904224Z [cluster2] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.6905547Z [cluster2] "properties": {
2021-07-19T10:17:32.6906134Z [cluster2] "running": {
2021-07-19T10:17:32.6906871Z [cluster2] "description": "Details about a running container",
2021-07-19T10:17:32.6907617Z [cluster2] "properties": {
2021-07-19T10:17:32.6908239Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6909440Z [cluster2] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.6910473Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6911178Z [cluster2] "type": "string"
2021-07-19T10:17:32.6911881Z [cluster2] }
2021-07-19T10:17:32.6912391Z [cluster2] },
2021-07-19T10:17:32.6912946Z [cluster2] "type": "object"
2021-07-19T10:17:32.6913504Z [cluster2] },
2021-07-19T10:17:32.6914056Z [cluster2] "terminated": {
2021-07-19T10:17:32.6914834Z [cluster2] "description": "Details about a terminated container",
2021-07-19T10:17:32.6915622Z [cluster2] "properties": {
2021-07-19T10:17:32.6916252Z [cluster2] "containerID": {
2021-07-19T10:17:32.6917419Z [cluster2] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.6918246Z [cluster2] "type": "string"
2021-07-19T10:17:32.6918811Z [cluster2] },
2021-07-19T10:17:32.6919362Z [cluster2] "exitCode": {
2021-07-19T10:17:32.6920188Z [cluster2] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.6921008Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6921609Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6922226Z [cluster2] },
2021-07-19T10:17:32.6922784Z [cluster2] "finishedAt": {
2021-07-19T10:17:32.6923584Z [cluster2] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.6924701Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6925326Z [cluster2] "type": "string"
2021-07-19T10:17:32.6925897Z [cluster2] },
2021-07-19T10:17:32.6926436Z [cluster2] "message": {
2021-07-19T10:17:32.6927279Z [cluster2] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.6928121Z [cluster2] "type": "string"
2021-07-19T10:17:32.6928670Z [cluster2] },
2021-07-19T10:17:32.6929214Z [cluster2] "reason": {
2021-07-19T10:17:32.6930012Z [cluster2] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.6930840Z [cluster2] "type": "string"
2021-07-19T10:17:32.6931384Z [cluster2] },
2021-07-19T10:17:32.6931921Z [cluster2] "signal": {
2021-07-19T10:17:32.6932774Z [cluster2] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.6933557Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6934176Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6934729Z [cluster2] },
2021-07-19T10:17:32.6935299Z [cluster2] "startedAt": {
2021-07-19T10:17:32.6936483Z [cluster2] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.6937632Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6938256Z [cluster2] "type": "string"
2021-07-19T10:17:32.6938828Z [cluster2] }
2021-07-19T10:17:32.6939321Z [cluster2] },
2021-07-19T10:17:32.6939876Z [cluster2] "required": [
2021-07-19T10:17:32.6940473Z [cluster2] "exitCode"
2021-07-19T10:17:32.6941013Z [cluster2] ],
2021-07-19T10:17:32.6941571Z [cluster2] "type": "object"
2021-07-19T10:17:32.6942108Z [cluster2] },
2021-07-19T10:17:32.6942647Z [cluster2] "waiting": {
2021-07-19T10:17:32.6943359Z [cluster2] "description": "Details about a waiting container",
2021-07-19T10:17:32.6944113Z [cluster2] "properties": {
2021-07-19T10:17:32.6944715Z [cluster2] "message": {
2021-07-19T10:17:32.6945519Z [cluster2] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.6946430Z [cluster2] "type": "string"
2021-07-19T10:17:32.6946978Z [cluster2] },
2021-07-19T10:17:32.6947517Z [cluster2] "reason": {
2021-07-19T10:17:32.6948588Z [cluster2] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.6949522Z [cluster2] "type": "string"
2021-07-19T10:17:32.6950253Z [cluster2] }
2021-07-19T10:17:32.6950901Z [cluster2] },
2021-07-19T10:17:32.6951602Z [cluster2] "type": "object"
2021-07-19T10:17:32.6952368Z [cluster2] }
2021-07-19T10:17:32.6952871Z [cluster2] },
2021-07-19T10:17:32.6953419Z [cluster2] "type": "object"
2021-07-19T10:17:32.6953947Z [cluster2] },
2021-07-19T10:17:32.6954478Z [cluster2] "type": "array"
2021-07-19T10:17:32.6954995Z [cluster2] },
2021-07-19T10:17:32.6955504Z [cluster2] "status": {
2021-07-19T10:17:32.6956420Z [cluster2] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.6957301Z [cluster2] "properties": {
2021-07-19T10:17:32.6957937Z [cluster2] "collisionCount": {
2021-07-19T10:17:32.6959325Z [cluster2] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.6960674Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6961261Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6961818Z [cluster2] },
2021-07-19T10:17:32.6962368Z [cluster2] "conditions": {
2021-07-19T10:17:32.6963642Z [cluster2] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.6964540Z [cluster2] "items": {
2021-07-19T10:17:32.6965453Z [cluster2] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.6966415Z [cluster2] "properties": {
2021-07-19T10:17:32.6967118Z [cluster2] "lastTransitionTime": {
2021-07-19T10:17:32.6968043Z [cluster2] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.6969154Z [cluster2] "format": "date-time",
2021-07-19T10:17:32.6969777Z [cluster2] "type": "string"
2021-07-19T10:17:32.6970337Z [cluster2] },
2021-07-19T10:17:32.6970963Z [cluster2] "message": {
2021-07-19T10:17:32.6971828Z [cluster2] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.6972707Z [cluster2] "type": "string"
2021-07-19T10:17:32.6973255Z [cluster2] },
2021-07-19T10:17:32.6973798Z [cluster2] "reason": {
2021-07-19T10:17:32.6974843Z [cluster2] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.6975636Z [cluster2] "type": "string"
2021-07-19T10:17:32.6976192Z [cluster2] },
2021-07-19T10:17:32.6976722Z [cluster2] "status": {
2021-07-19T10:17:32.6977514Z [cluster2] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.6979219Z [cluster2] "type": "string"
2021-07-19T10:17:32.6979990Z [cluster2] },
2021-07-19T10:17:32.6980685Z [cluster2] "type": {
2021-07-19T10:17:32.6981658Z [cluster2] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.6982566Z [cluster2] "type": "string"
2021-07-19T10:17:32.6983269Z [cluster2] }
2021-07-19T10:17:32.6983953Z [cluster2] },
2021-07-19T10:17:32.6984492Z [cluster2] "required": [
2021-07-19T10:17:32.6985066Z [cluster2] "status",
2021-07-19T10:17:32.6985795Z [cluster2] "type"
2021-07-19T10:17:32.6986461Z [cluster2] ],
2021-07-19T10:17:32.6987025Z [cluster2] "type": "object"
2021-07-19T10:17:32.6987568Z [cluster2] },
2021-07-19T10:17:32.6988112Z [cluster2] "type": "array"
2021-07-19T10:17:32.6988633Z [cluster2] },
2021-07-19T10:17:32.6989312Z [cluster2] "currentNumberScheduled": {
2021-07-19T10:17:32.6990882Z [cluster2] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6992825Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6993443Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6994092Z [cluster2] },
2021-07-19T10:17:32.6994730Z [cluster2] "desiredNumberScheduled": {
2021-07-19T10:17:32.6996247Z [cluster2] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.6997517Z [cluster2] "format": "int32",
2021-07-19T10:17:32.6998682Z [cluster2] "type": "integer"
2021-07-19T10:17:32.6999363Z [cluster2] },
2021-07-19T10:17:32.6999910Z [cluster2] "numberAvailable": {
2021-07-19T10:17:32.7001081Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.7002342Z [cluster2] "format": "int32",
2021-07-19T10:17:32.7002916Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7003424Z [cluster2] },
2021-07-19T10:17:32.7004013Z [cluster2] "numberMisscheduled": {
2021-07-19T10:17:32.7005308Z [cluster2] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.7006508Z [cluster2] "format": "int32",
2021-07-19T10:17:32.7007154Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7007656Z [cluster2] },
2021-07-19T10:17:32.7008182Z [cluster2] "numberReady": {
2021-07-19T10:17:32.7009110Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.7010002Z [cluster2] "format": "int32",
2021-07-19T10:17:32.7010563Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7011066Z [cluster2] },
2021-07-19T10:17:32.7011636Z [cluster2] "numberUnavailable": {
2021-07-19T10:17:32.7013085Z [cluster2] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.7014241Z [cluster2] "format": "int32",
2021-07-19T10:17:32.7014835Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7015378Z [cluster2] },
2021-07-19T10:17:32.7016010Z [cluster2] "observedGeneration": {
2021-07-19T10:17:32.7016961Z [cluster2] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.7017805Z [cluster2] "format": "int64",
2021-07-19T10:17:32.7018410Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7018955Z [cluster2] },
2021-07-19T10:17:32.7019639Z [cluster2] "updatedNumberScheduled": {
2021-07-19T10:17:32.7020589Z [cluster2] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.7021474Z [cluster2] "format": "int32",
2021-07-19T10:17:32.7022103Z [cluster2] "type": "integer"
2021-07-19T10:17:32.7022647Z [cluster2] }
2021-07-19T10:17:32.7023139Z [cluster2] },
2021-07-19T10:17:32.7023739Z [cluster2] "required": [
2021-07-19T10:17:32.7024419Z [cluster2] "currentNumberScheduled",
2021-07-19T10:17:32.7025216Z [cluster2] "desiredNumberScheduled",
2021-07-19T10:17:32.7025962Z [cluster2] "numberMisscheduled",
2021-07-19T10:17:32.7026605Z [cluster2] "numberReady"
2021-07-19T10:17:32.7027114Z [cluster2] ],
2021-07-19T10:17:32.7027615Z [cluster2] "type": "object"
2021-07-19T10:17:32.7028101Z [cluster2] }
2021-07-19T10:17:32.7028553Z [cluster2] },
2021-07-19T10:17:32.7029022Z [cluster2] "required": [
2021-07-19T10:17:32.7029910Z [cluster2] "mismatchedContainerImages"
2021-07-19T10:17:32.7030670Z [cluster2] ],
2021-07-19T10:17:32.7031177Z [cluster2] "type": "object"
2021-07-19T10:17:32.7031839Z [cluster2] },
2021-07-19T10:17:32.7032368Z [cluster2] "serviceCIDR": {
2021-07-19T10:17:32.7032956Z [cluster2] "type": "string"
2021-07-19T10:17:32.7033458Z [cluster2] }
2021-07-19T10:17:32.7033928Z [cluster2] },
2021-07-19T10:17:32.7034423Z [cluster2] "required": [
2021-07-19T10:17:32.7034986Z [cluster2] "clusterID",
2021-07-19T10:17:32.7035558Z [cluster2] "natEnabled"
2021-07-19T10:17:32.7036061Z [cluster2] ],
2021-07-19T10:17:32.7036575Z [cluster2] "type": "object"
2021-07-19T10:17:32.7037071Z [cluster2] }
2021-07-19T10:17:32.7037532Z [cluster2] },
2021-07-19T10:17:32.7038014Z [cluster2] "type": "object"
2021-07-19T10:17:32.7038506Z [cluster2] }
2021-07-19T10:17:32.7038928Z [cluster2] },
2021-07-19T10:17:32.7039416Z [cluster2] "served": true,
2021-07-19T10:17:32.7039951Z [cluster2] "storage": true,
2021-07-19T10:17:32.7040499Z [cluster2] "subresources": {
2021-07-19T10:17:32.7041039Z [cluster2] "status": {}
2021-07-19T10:17:32.7041485Z [cluster2] }
2021-07-19T10:17:32.7041916Z [cluster2] }
2021-07-19T10:17:32.7042326Z [cluster2] ]
2021-07-19T10:17:32.7042742Z [cluster2] },
2021-07-19T10:17:32.7043170Z [cluster2] "status": {
2021-07-19T10:17:32.7043705Z [cluster2] "acceptedNames": {
2021-07-19T10:17:32.7044276Z [cluster2] "kind": "Submariner",
2021-07-19T10:17:32.7044912Z [cluster2] "listKind": "SubmarinerList",
2021-07-19T10:17:32.7045551Z [cluster2] "plural": "submariners",
2021-07-19T10:17:32.7046168Z [cluster2] "singular": "submariner"
2021-07-19T10:17:32.7046684Z [cluster2] },
2021-07-19T10:17:32.7047146Z [cluster2] "conditions": [
2021-07-19T10:17:32.7047623Z [cluster2] {
2021-07-19T10:17:32.7048554Z [cluster2] "lastTransitionTime": "2021-07-19T10:12:53Z",
2021-07-19T10:17:32.7454257Z [cluster2] "message": "nr1] },
2021-07-19T10:17:32.7454790Z [cluster1] {
2021-07-19T10:17:32.7455899Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:52Z",
2021-07-19T10:17:32.7456693Z [cluster1] "message": "the initial names have been accepted",
2021-07-19T10:17:32.7457500Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-19T10:17:32.7458180Z [cluster1] "status": "True",
2021-07-19T10:17:32.7459062Z [cluster1] "type": "Established"
2021-07-19T10:17:32.7459807Z [cluster1] }
2021-07-19T10:17:32.7460413Z [cluster1] ],
2021-07-19T10:17:32.7461061Z [cluster1] "storedVersions": [
2021-07-19T10:17:32.7461695Z [cluster1] "v1"
2021-07-19T10:17:32.7462138Z [cluster1] ]
2021-07-19T10:17:32.7463401Z [cluster1] }
2021-07-19T10:17:32.7464925Z [cluster1] }
2021-07-19T10:17:32.7466113Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-19T10:17:32.7468126Z [submariner-operator]$ [cluster1] validate_equals .metadata.name clusters.submariner.io
2021-07-19T10:17:32.7470397Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:32.7473644Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:32.7474914Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:32.7476675Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:32.7478275Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:32.7479843Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:32.7481842Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:32.7491932Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-19T10:17:32.7493389Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Cluster
2021-07-19T10:17:32.7497661Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:32.7499804Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T10:17:32.7501984Z [submariner-operator]$ [cluster1] validate_equals .status.acceptedNames.kind Cluster
2021-07-19T10:17:32.7504507Z [submariner-operator]$ [cluster1] jq -r -M .status.acceptedNames.kind /tmp/clusters.submariner.io.cluster1.json
2021-07-19T10:17:32.7506652Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-19T10:17:32.7507819Z [submariner-operator]$ [cluster1] verify_subm_crd
2021-07-19T10:17:32.7519784Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T10:17:32.7522391Z [submariner-operator]$ [cluster1] validate_crd submariners.submariner.io v1alpha1 Submariner
2021-07-19T10:17:32.7524456Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T10:17:32.7526361Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T10:17:32.7527960Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-19T10:17:32.7528989Z [cluster1] NAME CREATED AT
2021-07-19T10:17:32.7529902Z [cluster1] submariners.submariner.io 2021-07-19T10:12:42Z
2021-07-19T10:17:32.7531401Z [submariner-operator]$ [cluster1] json_file=/tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:32.7533099Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-19T10:17:32.7535497Z [submariner-operator]$ [cluster1] tee /tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:32.7537659Z [submariner-operator]$ [cluster1] kubectl get crd submariners.submariner.io -o json
2021-07-19T10:17:32.7539589Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crd submariners.submariner.io -o json
2021-07-19T10:17:32.7540782Z [cluster1] {
2021-07-19T10:17:32.7541549Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:32.7542547Z [cluster1] "kind": "CustomResourceDefinition",
2021-07-19T10:17:32.7543375Z [cluster1] "metadata": {
2021-07-19T10:17:32.7544030Z [cluster1] "annotations": {
2021-07-19T10:17:32.7545290Z [cluster1] "controller-gen.kubebuilder.io/version": "v0.4.1"
2021-07-19T10:17:32.7546235Z [cluster1] },
2021-07-19T10:17:32.7547179Z [cluster1] "creationTimestamp": "2021-07-19T10:12:42Z",
2021-07-19T10:17:32.7547971Z [cluster1] "generation": 2,
2021-07-19T10:17:32.7548663Z [cluster1] "managedFields": [
2021-07-19T10:17:32.7549307Z [cluster1] {
2021-07-19T10:17:32.7550067Z [cluster1] "apiVersion": "apiextensions.k8s.io/v1",
2021-07-19T10:17:32.7550964Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:32.7566367Z [cluster1] "fieldsV1": {
2021-07-19T10:17:32.7567000Z [cluster1] "f:metadata": {
2021-07-19T10:17:32.7567573Z [cluster1] "f:annotations": {
2021-07-19T10:17:32.7568257Z [cluster1] ".": {},
2021-07-19T10:17:32.7569405Z [cluster1] "f:controller-gen.kubebuilder.io/version": {}
2021-07-19T10:17:32.7570164Z [cluster1] }
2021-07-19T10:17:32.7570612Z [cluster1] },
2021-07-19T10:17:32.7571516Z [cluster1] "f:spec": {
2021-07-19T10:17:32.7572054Z [cluster1] "f:conversion": {
2021-07-19T10:17:32.7572569Z [cluster1] ".": {},
2021-07-19T10:17:32.7573078Z [cluster1] "f:strategy": {}
2021-07-19T10:17:32.7573577Z [cluster1] },
2021-07-19T10:17:32.7574046Z [cluster1] "f:group": {},
2021-07-19T10:17:32.7574556Z [cluster1] "f:names": {
2021-07-19T10:17:32.7575049Z [cluster1] "f:kind": {},
2021-07-19T10:17:32.7575579Z [cluster1] "f:listKind": {},
2021-07-19T10:17:32.7576216Z [cluster1] "f:plural": {},
2021-07-19T10:17:32.7576761Z [cluster1] "f:singular": {}
2021-07-19T10:17:32.7577249Z [cluster1] },
2021-07-19T10:17:32.7577731Z [cluster1] "f:scope": {},
2021-07-19T10:17:32.7578261Z [cluster1] "f:versions": {}
2021-07-19T10:17:32.7578736Z [cluster1] },
2021-07-19T10:17:32.7579216Z [cluster1] "f:status": {
2021-07-19T10:17:32.7579774Z [cluster1] "f:acceptedNames": {
2021-07-19T10:17:32.7580423Z [cluster1] "f:kind": {},
2021-07-19T10:17:32.7580927Z [cluster1] "f:plural": {}
2021-07-19T10:17:32.7581416Z [cluster1] },
2021-07-19T10:17:32.7581910Z [cluster1] "f:conditions": {},
2021-07-19T10:17:32.7582518Z [cluster1] "f:storedVersions": {}
2021-07-19T10:17:32.7583049Z [cluster1] }
2021-07-19T10:17:32.7583485Z [cluster1] },
2021-07-19T10:17:32.7583987Z [cluster1] "manager": "subctl",
2021-07-19T10:17:32.7584550Z [cluster1] "operation": "Update",
2021-07-19T10:17:32.7585339Z [cluster1] "time": "2021-07-19T10:12:53Z"
2021-07-19T10:17:32.7585807Z [cluster1] }
2021-07-19T10:17:32.7586232Z [cluster1] ],
2021-07-19T10:17:32.7586987Z [cluster1] "name": "submariners.submariner.io",
2021-07-19T10:17:32.7587792Z [cluster1] "resourceVersion": "2044",
2021-07-19T10:17:32.7588741Z [cluster1] "uid": "255a3c47-eea1-43dd-8931-f029a70cd40e"
2021-07-19T10:17:32.7635540Z [cluster1] },
2021-07-19T10:17:32.7636060Z [cluster1] "spec": {
2021-07-19T10:17:32.7636566Z [cluster1] "conversion": {
2021-07-19T10:17:32.7637183Z [cluster1] "strategy": "None"
2021-07-19T10:17:32.7637670Z [cluster1] },
2021-07-19T10:17:32.7638217Z [cluster1] "group": "submariner.io",
2021-07-19T10:17:32.7638750Z [cluster1] "names": {
2021-07-19T10:17:32.7639274Z [cluster1] "kind": "Submariner",
2021-07-19T10:17:32.7639898Z [cluster1] "listKind": "SubmarinerList",
2021-07-19T10:17:32.7640561Z [cluster1] "plural": "submariners",
2021-07-19T10:17:32.7641166Z [cluster1] "singular": "submariner"
2021-07-19T10:17:32.7641677Z [cluster1] },
2021-07-19T10:17:32.7642175Z [cluster1] "scope": "Namespaced",
2021-07-19T10:17:32.7642727Z [cluster1] "versions": [
2021-07-19T10:17:32.7643178Z [cluster1] {
2021-07-19T10:17:32.7643671Z [cluster1] "name": "v1alpha1",
2021-07-19T10:17:32.7644192Z [cluster1] "schema": {
2021-07-19T10:17:32.7644759Z [cluster1] "openAPIV3Schema": {
2021-07-19T10:17:32.7645571Z [cluster1] "description": "Submariner is the Schema for the submariners API",
2021-07-19T10:17:32.7646497Z [cluster1] "properties": {
2021-07-19T10:17:32.7647076Z [cluster1] "apiVersion": {
2021-07-19T10:17:32.7649591Z [cluster1] "description": "APIVersion defines the versioned schema of this representation of an object. Servers should convert recognized schemas to the latest internal value, and may reject unrecognized values. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#resources",
2021-07-19T10:17:32.7651455Z [cluster1] "type": "string"
2021-07-19T10:17:32.7651969Z [cluster1] },
2021-07-19T10:17:32.7652440Z [cluster1] "kind": {
2021-07-19T10:17:32.7654730Z [cluster1] "description": "Kind is a string value representing the REST resource this object represents. Servers may infer this from the endpoint the client submits requests to. Cannot be updated. In CamelCase. More info: https://git.k8s.io/community/contributors/devel/sig-architecture/api-conventions.md#types-kinds",
2021-07-19T10:17:32.7656700Z [cluster1] "type": "string"
2021-07-19T10:17:32.7657200Z [cluster1] },
2021-07-19T10:17:32.7657708Z [cluster1] "metadata": {
2021-07-19T10:17:32.7658250Z [cluster1] "type": "object"
2021-07-19T10:17:32.7658768Z [cluster1] },
2021-07-19T10:17:32.7659250Z [cluster1] "spec": {
2021-07-19T10:17:32.7660044Z [cluster1] "description": "SubmarinerSpec defines the desired state of Submariner",
2021-07-19T10:17:32.7660954Z [cluster1] "properties": {
2021-07-19T10:17:32.7661462Z [cluster1] "broker": {
2021-07-19T10:17:32.7661977Z [cluster1] "type": "string"
2021-07-19T10:17:32.7662657Z [cluster1] },
2021-07-19T10:17:32.7663276Z [cluster1] "brokerK8sApiServer": {
2021-07-19T10:17:32.7663936Z [cluster1] "type": "string"
2021-07-19T10:17:32.7664623Z [cluster1] },
2021-07-19T10:17:32.7665254Z [cluster1] "brokerK8sApiServerToken": {
2021-07-19T10:17:32.7666020Z [cluster1] "type": "string"
2021-07-19T10:17:32.7666510Z [cluster1] },
2021-07-19T10:17:32.7666996Z [cluster1] "brokerK8sCA": {
2021-07-19T10:17:32.7667586Z [cluster1] "type": "string"
2021-07-19T10:17:32.7668069Z [cluster1] },
2021-07-19T10:17:32.7668693Z [cluster1] "brokerK8sRemoteNamespace": {
2021-07-19T10:17:32.7669382Z [cluster1] "type": "string"
2021-07-19T10:17:32.7669852Z [cluster1] },
2021-07-19T10:17:32.7670353Z [cluster1] "cableDriver": {
2021-07-19T10:17:32.7670881Z [cluster1] "type": "string"
2021-07-19T10:17:32.7671365Z [cluster1] },
2021-07-19T10:17:32.7682849Z [cluster1] "ceIPSecDebug": {
2021-07-19T10:17:32.7683547Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7684088Z [cluster1] },
2021-07-19T10:17:32.7684740Z [cluster1] "ceIPSecForceUDPEncaps": {
2021-07-19T10:17:32.7685463Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7685978Z [cluster1] },
2021-07-19T10:17:32.7686709Z [cluster1] "ceIPSecIKEPort": {
2021-07-19T10:17:32.7687327Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7687905Z [cluster1] },
2021-07-19T10:17:32.7688481Z [cluster1] "ceIPSecNATTPort": {
2021-07-19T10:17:32.7689124Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7689653Z [cluster1] },
2021-07-19T10:17:32.7690185Z [cluster1] "ceIPSecPSK": {
2021-07-19T10:17:32.7690775Z [cluster1] "type": "string"
2021-07-19T10:17:32.7691285Z [cluster1] },
2021-07-19T10:17:32.7691963Z [cluster1] "ceIPSecPreferredServer": {
2021-07-19T10:17:32.7692680Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7693210Z [cluster1] },
2021-07-19T10:17:32.7693739Z [cluster1] "clusterCIDR": {
2021-07-19T10:17:32.7694332Z [cluster1] "type": "string"
2021-07-19T10:17:32.7694853Z [cluster1] },
2021-07-19T10:17:32.7695364Z [cluster1] "clusterID": {
2021-07-19T10:17:32.7695940Z [cluster1] "type": "string"
2021-07-19T10:17:32.7696449Z [cluster1] },
2021-07-19T10:17:32.7696984Z [cluster1] "colorCodes": {
2021-07-19T10:17:32.7697542Z [cluster1] "type": "string"
2021-07-19T10:17:32.7698056Z [cluster1] },
2021-07-19T10:17:32.7698706Z [cluster1] "connectionHealthCheck": {
2021-07-19T10:17:32.7699410Z [cluster1] "properties": {
2021-07-19T10:17:32.7699999Z [cluster1] "enabled": {
2021-07-19T10:17:32.7700565Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7701108Z [cluster1] },
2021-07-19T10:17:32.7701680Z [cluster1] "intervalSeconds": {
2021-07-19T10:17:32.7702583Z [cluster1] "description": "The interval at which health check pings are sent.",
2021-07-19T10:17:32.7703366Z [cluster1] "format": "int64",
2021-07-19T10:17:32.7725332Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7726113Z [cluster1] },
2021-07-19T10:17:32.7726734Z [cluster1] "maxPacketLossCount": {
2021-07-19T10:17:32.7727760Z [cluster1] "description": "The maximum number of packets lost at which the health checker will mark the connection as down.",
2021-07-19T10:17:32.7728694Z [cluster1] "format": "int64",
2021-07-19T10:17:32.7729300Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7729846Z [cluster1] }
2021-07-19T10:17:32.7730321Z [cluster1] },
2021-07-19T10:17:32.7730853Z [cluster1] "type": "object"
2021-07-19T10:17:32.7731364Z [cluster1] },
2021-07-19T10:17:32.7732068Z [cluster1] "coreDNSCustomConfig": {
2021-07-19T10:17:32.7732745Z [cluster1] "properties": {
2021-07-19T10:17:32.7733377Z [cluster1] "configMapName": {
2021-07-19T10:17:32.7734147Z [cluster1] "type": "string"
2021-07-19T10:17:32.7734673Z [cluster1] },
2021-07-19T10:17:32.7735218Z [cluster1] "namespace": {
2021-07-19T10:17:32.7735791Z [cluster1] "type": "string"
2021-07-19T10:17:32.7736320Z [cluster1] }
2021-07-19T10:17:32.7736794Z [cluster1] },
2021-07-19T10:17:32.7737323Z [cluster1] "type": "object"
2021-07-19T10:17:32.7737846Z [cluster1] },
2021-07-19T10:17:32.7738382Z [cluster1] "customDomains": {
2021-07-19T10:17:32.7738960Z [cluster1] "items": {
2021-07-19T10:17:32.7739496Z [cluster1] "type": "string"
2021-07-19T10:17:32.7740026Z [cluster1] },
2021-07-19T10:17:32.7740540Z [cluster1] "type": "array",
2021-07-19T10:17:32.7745299Z [cluster1] "x-kubernetes-list-type": "set"
2021-07-19T10:17:32.7746061Z [cluster1] },
2021-07-19T10:17:32.7746558Z [cluster1] "debug": {
2021-07-19T10:17:32.7747131Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7747655Z [cluster1] },
2021-07-19T10:17:32.7748189Z [cluster1] "globalCIDR": {
2021-07-19T10:17:32.7748760Z [cluster1] "type": "string"
2021-07-19T10:17:32.7749285Z [cluster1] },
2021-07-19T10:17:32.7749835Z [cluster1] "imageOverrides": {
2021-07-19T10:17:32.7750574Z [cluster1] "additionalProperties": {
2021-07-19T10:17:32.7751255Z [cluster1] "type": "string"
2021-07-19T10:17:32.7752370Z [cluster1] },
2021-07-19T10:17:32.7753029Z [cluster1] "type": "object"
2021-07-19T10:17:32.7753537Z [cluster1] },
2021-07-19T10:17:32.7754301Z [cluster1] "loadBalancerEnabled": {
2021-07-19T10:17:32.7755565Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7756476Z [cluster1] },
2021-07-19T10:17:32.7757314Z [cluster1] "namespace": {
2021-07-19T10:17:32.7757980Z [cluster1] "type": "string"
2021-07-19T10:17:32.7758504Z [cluster1] },
2021-07-19T10:17:32.7759023Z [cluster1] "natEnabled": {
2021-07-19T10:17:32.7759616Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7760131Z [cluster1] },
2021-07-19T10:17:32.7760664Z [cluster1] "repository": {
2021-07-19T10:17:32.7761231Z [cluster1] "type": "string"
2021-07-19T10:17:32.7761753Z [cluster1] },
2021-07-19T10:17:32.7762279Z [cluster1] "serviceCIDR": {
2021-07-19T10:17:32.7762861Z [cluster1] "type": "string"
2021-07-19T10:17:32.7763383Z [cluster1] },
2021-07-19T10:17:32.7764042Z [cluster1] "serviceDiscoveryEnabled": {
2021-07-19T10:17:32.7764773Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7765284Z [cluster1] },
2021-07-19T10:17:32.7765906Z [cluster1] "version": {
2021-07-19T10:17:32.7776562Z [cluster1] "type": "string"
2021-07-19T10:17:32.7777215Z [cluster1] }
2021-07-19T10:17:32.7777674Z [cluster1] },
2021-07-19T10:17:32.7778185Z [cluster1] "required": [
2021-07-19T10:17:32.7778739Z [cluster1] "broker",
2021-07-19T10:17:32.7779372Z [cluster1] "brokerK8sApiServer",
2021-07-19T10:17:32.7780182Z [cluster1] "brokerK8sApiServerToken",
2021-07-19T10:17:32.7781377Z [cluster1] "brokerK8sCA",
2021-07-19T10:17:32.7782404Z [cluster1] "brokerK8sRemoteNamespace",
2021-07-19T10:17:32.7810086Z [cluster1] "ceIPSecDebug",
2021-07-19T10:17:32.7810703Z [cluster1] "ceIPSecPSK",
2021-07-19T10:17:32.7811251Z [cluster1] "clusterCIDR",
2021-07-19T10:17:32.7811794Z [cluster1] "clusterID",
2021-07-19T10:17:32.7812486Z [cluster1] "debug",
2021-07-19T10:17:32.7813020Z [cluster1] "namespace",
2021-07-19T10:17:32.7813605Z [cluster1] "natEnabled",
2021-07-19T10:17:32.7814185Z [cluster1] "serviceCIDR"
2021-07-19T10:17:32.7814715Z [cluster1] ],
2021-07-19T10:17:32.7815220Z [cluster1] "type": "object"
2021-07-19T10:17:32.7815725Z [cluster1] },
2021-07-19T10:17:32.7816192Z [cluster1] "status": {
2021-07-19T10:17:32.7817027Z [cluster1] "description": "SubmarinerStatus defines the observed state of Submariner",
2021-07-19T10:17:32.7817899Z [cluster1] "properties": {
2021-07-19T10:17:32.7818488Z [cluster1] "clusterCIDR": {
2021-07-19T10:17:32.7819078Z [cluster1] "type": "string"
2021-07-19T10:17:32.7819591Z [cluster1] },
2021-07-19T10:17:32.7820114Z [cluster1] "clusterID": {
2021-07-19T10:17:32.7820819Z [cluster1] "type": "string"
2021-07-19T10:17:32.7821350Z [cluster1] },
2021-07-19T10:17:32.7821879Z [cluster1] "colorCodes": {
2021-07-19T10:17:32.7822446Z [cluster1] "type": "string"
2021-07-19T10:17:32.7822972Z [cluster1] },
2021-07-19T10:17:32.7823524Z [cluster1] "deploymentInfo": {
2021-07-19T10:17:32.7824160Z [cluster1] "properties": {
2021-07-19T10:17:32.7824772Z [cluster1] "cloudProvider": {
2021-07-19T10:17:32.7825394Z [cluster1] "type": "string"
2021-07-19T10:17:32.7826020Z [cluster1] },
2021-07-19T10:17:32.7826561Z [cluster1] "kubernetesType": {
2021-07-19T10:17:32.7827154Z [cluster1] "type": "string"
2021-07-19T10:17:32.7827638Z [cluster1] },
2021-07-19T10:17:32.7828260Z [cluster1] "kubernetesTypeVersion": {
2021-07-19T10:17:32.7829207Z [cluster1] "type": "string"
2021-07-19T10:17:32.7829748Z [cluster1] },
2021-07-19T10:17:32.7830430Z [cluster1] "kubernetesVersion": {
2021-07-19T10:17:32.7831090Z [cluster1] "type": "string"
2021-07-19T10:17:32.7831628Z [cluster1] }
2021-07-19T10:17:32.7832185Z [cluster1] },
2021-07-19T10:17:32.7832720Z [cluster1] "type": "object"
2021-07-19T10:17:32.7833239Z [cluster1] },
2021-07-19T10:17:32.7833902Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-19T10:17:32.7834620Z [cluster1] "properties": {
2021-07-19T10:17:32.7835316Z [cluster1] "lastResourceVersion": {
2021-07-19T10:17:32.7835979Z [cluster1] "type": "string"
2021-07-19T10:17:32.7836511Z [cluster1] },
2021-07-19T10:17:32.7837226Z [cluster1] "mismatchedContainerImages": {
2021-07-19T10:17:32.7837984Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.7838524Z [cluster1] },
2021-07-19T10:17:32.7839199Z [cluster1] "nonReadyContainerStates": {
2021-07-19T10:17:32.7839913Z [cluster1] "items": {
2021-07-19T10:17:32.7873482Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.7874749Z [cluster1] "properties": {
2021-07-19T10:17:32.7875311Z [cluster1] "running": {
2021-07-19T10:17:32.7875998Z [cluster1] "description": "Details about a running container",
2021-07-19T10:17:32.7876705Z [cluster1] "properties": {
2021-07-19T10:17:32.7877285Z [cluster1] "startedAt": {
2021-07-19T10:17:32.7878563Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.7879792Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.7880433Z [cluster1] "type": "string"
2021-07-19T10:17:32.7880986Z [cluster1] }
2021-07-19T10:17:32.7881500Z [cluster1] },
2021-07-19T10:17:32.7882052Z [cluster1] "type": "object"
2021-07-19T10:17:32.7882606Z [cluster1] },
2021-07-19T10:17:32.7883152Z [cluster1] "terminated": {
2021-07-19T10:17:32.7883942Z [cluster1] "description": "Details about a terminated container",
2021-07-19T10:17:32.7884731Z [cluster1] "properties": {
2021-07-19T10:17:32.7885356Z [cluster1] "containerID": {
2021-07-19T10:17:32.7886520Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.7887360Z [cluster1] "type": "string"
2021-07-19T10:17:32.7888055Z [cluster1] },
2021-07-19T10:17:32.7888628Z [cluster1] "exitCode": {
2021-07-19T10:17:32.7889437Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.7890266Z [cluster1] "format": "int32",
2021-07-19T10:17:32.7890894Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7891565Z [cluster1] },
2021-07-19T10:17:32.7892262Z [cluster1] "finishedAt": {
2021-07-19T10:17:32.7893048Z [cluster1] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.7894108Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.7894755Z [cluster1] "type": "string"
2021-07-19T10:17:32.7895307Z [cluster1] },
2021-07-19T10:17:32.7895863Z [cluster1] "message": {
2021-07-19T10:17:32.7896689Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.7931423Z [cluster1] "type": "string"
2021-07-19T10:17:32.7931964Z [cluster1] },
2021-07-19T10:17:32.7932477Z [cluster1] "reason": {
2021-07-19T10:17:32.7933253Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.7934009Z [cluster1] "type": "string"
2021-07-19T10:17:32.7934531Z [cluster1] },
2021-07-19T10:17:32.7935191Z [cluster1] "signal": {
2021-07-19T10:17:32.7935935Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.7936678Z [cluster1] "format": "int32",
2021-07-19T10:17:32.7937247Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7937780Z [cluster1] },
2021-07-19T10:17:32.7938293Z [cluster1] "startedAt": {
2021-07-19T10:17:32.7939085Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.7940255Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.7940838Z [cluster1] "type": "string"
2021-07-19T10:17:32.7941363Z [cluster1] }
2021-07-19T10:17:32.7941825Z [cluster1] },
2021-07-19T10:17:32.7942341Z [cluster1] "required": [
2021-07-19T10:17:32.7942888Z [cluster1] "exitCode"
2021-07-19T10:17:32.7943497Z [cluster1] ],
2021-07-19T10:17:32.7944019Z [cluster1] "type": "object"
2021-07-19T10:17:32.7945001Z [cluster1] },
2021-07-19T10:17:32.7945541Z [cluster1] "waiting": {
2021-07-19T10:17:32.7946258Z [cluster1] "description": "Details about a waiting container",
2021-07-19T10:17:32.7947016Z [cluster1] "properties": {
2021-07-19T10:17:32.7947610Z [cluster1] "message": {
2021-07-19T10:17:32.7948432Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.7949262Z [cluster1] "type": "string"
2021-07-19T10:17:32.7949808Z [cluster1] },
2021-07-19T10:17:32.7950349Z [cluster1] "reason": {
2021-07-19T10:17:32.7951102Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.7952129Z [cluster1] "type": "string"
2021-07-19T10:17:32.7952698Z [cluster1] }
2021-07-19T10:17:32.7953206Z [cluster1] },
2021-07-19T10:17:32.7953769Z [cluster1] "type": "object"
2021-07-19T10:17:32.7954320Z [cluster1] }
2021-07-19T10:17:32.7954818Z [cluster1] },
2021-07-19T10:17:32.7955350Z [cluster1] "type": "object"
2021-07-19T10:17:32.7955969Z [cluster1] },
2021-07-19T10:17:32.7956509Z [cluster1] "type": "array"
2021-07-19T10:17:32.7957106Z [cluster1] },
2021-07-19T10:17:32.7957626Z [cluster1] "status": {
2021-07-19T10:17:32.7958468Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.7959352Z [cluster1] "properties": {
2021-07-19T10:17:32.7959980Z [cluster1] "collisionCount": {
2021-07-19T10:17:32.7961388Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.7962747Z [cluster1] "format": "int32",
2021-07-19T10:17:32.7963346Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7963911Z [cluster1] },
2021-07-19T10:17:32.7964457Z [cluster1] "conditions": {
2021-07-19T10:17:32.7965730Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.7966630Z [cluster1] "items": {
2021-07-19T10:17:32.7967621Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.7968576Z [cluster1] "properties": {
2021-07-19T10:17:32.7969289Z [cluster1] "lastTransitionTime": {
2021-07-19T10:17:32.7970224Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.7971343Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.7971969Z [cluster1] "type": "string"
2021-07-19T10:17:32.7972529Z [cluster1] },
2021-07-19T10:17:32.7973090Z [cluster1] "message": {
2021-07-19T10:17:32.7973952Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.7974824Z [cluster1] "type": "string"
2021-07-19T10:17:32.7975370Z [cluster1] },
2021-07-19T10:17:32.7975915Z [cluster1] "reason": {
2021-07-19T10:17:32.7976964Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.7977751Z [cluster1] "type": "string"
2021-07-19T10:17:32.7978311Z [cluster1] },
2021-07-19T10:17:32.7978844Z [cluster1] "status": {
2021-07-19T10:17:32.7979640Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.7980448Z [cluster1] "type": "string"
2021-07-19T10:17:32.7981048Z [cluster1] },
2021-07-19T10:17:32.7981592Z [cluster1] "type": {
2021-07-19T10:17:32.7982307Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.7983052Z [cluster1] "type": "string"
2021-07-19T10:17:32.7983596Z [cluster1] }
2021-07-19T10:17:32.7984115Z [cluster1] },
2021-07-19T10:17:32.7984665Z [cluster1] "required": [
2021-07-19T10:17:32.7985232Z [cluster1] "status",
2021-07-19T10:17:32.7985790Z [cluster1] "type"
2021-07-19T10:17:32.7986309Z [cluster1] ],
2021-07-19T10:17:32.7986871Z [cluster1] "type": "object"
2021-07-19T10:17:32.7987415Z [cluster1] },
2021-07-19T10:17:32.7988001Z [cluster1] "type": "array"
2021-07-19T10:17:32.7988546Z [cluster1] },
2021-07-19T10:17:32.7989275Z [cluster1] "currentNumberScheduled": {
2021-07-19T10:17:32.7990766Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.7992270Z [cluster1] "format": "int32",
2021-07-19T10:17:32.7992881Z [cluster1] "type": "integer"
2021-07-19T10:17:32.7993447Z [cluster1] },
2021-07-19T10:17:32.7994121Z [cluster1] "desiredNumberScheduled": {
2021-07-19T10:17:32.8020014Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8021514Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8022122Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8022693Z [cluster1] },
2021-07-19T10:17:32.8023297Z [cluster1] "numberAvailable": {
2021-07-19T10:17:32.8024549Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8025747Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8026335Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8026901Z [cluster1] },
2021-07-19T10:17:32.8027534Z [cluster1] "numberMisscheduled": {
2021-07-19T10:17:32.8029078Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8030395Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8030991Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8031554Z [cluster1] },
2021-07-19T10:17:32.8032284Z [cluster1] "numberReady": {
2021-07-19T10:17:32.8033274Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.8034246Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8034832Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8035389Z [cluster1] },
2021-07-19T10:17:32.8035999Z [cluster1] "numberUnavailable": {
2021-07-19T10:17:32.8037253Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8038426Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8039092Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8039647Z [cluster1] },
2021-07-19T10:17:32.8040264Z [cluster1] "observedGeneration": {
2021-07-19T10:17:32.8041221Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.8042090Z [cluster1] "format": "int64",
2021-07-19T10:17:32.8042679Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8043234Z [cluster1] },
2021-07-19T10:17:32.8043911Z [cluster1] "updatedNumberScheduled": {
2021-07-19T10:17:32.8044874Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.8045686Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8046277Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8046837Z [cluster1] }
2021-07-19T10:17:32.8047313Z [cluster1] },
2021-07-19T10:17:32.8047857Z [cluster1] "required": [
2021-07-19T10:17:32.8048568Z [cluster1] "currentNumberScheduled",
2021-07-19T10:17:32.8049442Z [cluster1] "desiredNumberScheduled",
2021-07-19T10:17:32.8050255Z [cluster1] "numberMisscheduled",
2021-07-19T10:17:32.8050933Z [cluster1] "numberReady"
2021-07-19T10:17:32.8051500Z [cluster1] ],
2021-07-19T10:17:32.8052028Z [cluster1] "type": "object"
2021-07-19T10:17:32.8052565Z [cluster1] }
2021-07-19T10:17:32.8053038Z [cluster1] },
2021-07-19T10:17:32.8053560Z [cluster1] "required": [
2021-07-19T10:17:32.8054368Z [cluster1] "mismatchedContainerImages"
2021-07-19T10:17:32.8055073Z [cluster1] ],
2021-07-19T10:17:32.8055600Z [cluster1] "type": "object"
2021-07-19T10:17:32.8056112Z [cluster1] },
2021-07-19T10:17:32.8056633Z [cluster1] "gateways": {
2021-07-19T10:17:32.8057161Z [cluster1] "items": {
2021-07-19T10:17:32.8057730Z [cluster1] "properties": {
2021-07-19T10:17:32.8058331Z [cluster1] "connections": {
2021-07-19T10:17:32.8058906Z [cluster1] "items": {
2021-07-19T10:17:32.8059490Z [cluster1] "properties": {
2021-07-19T10:17:32.8060090Z [cluster1] "endpoint": {
2021-07-19T10:17:32.8060712Z [cluster1] "properties": {
2021-07-19T10:17:32.8061313Z [cluster1] "backend": {
2021-07-19T10:17:32.8061915Z [cluster1] "type": "string"
2021-07-19T10:17:32.8062463Z [cluster1] },
2021-07-19T10:17:32.8063091Z [cluster1] "backend_config": {
2021-07-19T10:17:32.8063830Z [cluster1] "additionalProperties": {
2021-07-19T10:17:32.8064552Z [cluster1] "type": "string"
2021-07-19T10:17:32.8065139Z [cluster1] },
2021-07-19T10:17:32.8065698Z [cluster1] "type": "object"
2021-07-19T10:17:32.8066264Z [cluster1] },
2021-07-19T10:17:32.8066828Z [cluster1] "cable_name": {
2021-07-19T10:17:32.8067413Z [cluster1] "type": "string"
2021-07-19T10:17:32.8067986Z [cluster1] },
2021-07-19T10:17:32.8068527Z [cluster1] "cluster_id": {
2021-07-19T10:17:32.8069135Z [cluster1] "type": "string"
2021-07-19T10:17:32.8069858Z [cluster1] },
2021-07-19T10:17:32.8070481Z [cluster1] "healthCheckIP": {
2021-07-19T10:17:32.8071140Z [cluster1] "type": "string"
2021-07-19T10:17:32.8071769Z [cluster1] },
2021-07-19T10:17:32.8072332Z [cluster1] "hostname": {
2021-07-19T10:17:32.8093134Z [cluster1] "type": "string"
2021-07-19T10:17:32.8093748Z [cluster1] },
2021-07-19T10:17:32.8094327Z [cluster1] "nat_enabled": {
2021-07-19T10:17:32.8095022Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8095694Z [cluster1] },
2021-07-19T10:17:32.8096206Z [cluster1] "private_ip": {
2021-07-19T10:17:32.8096775Z [cluster1] "type": "string"
2021-07-19T10:17:32.8097294Z [cluster1] },
2021-07-19T10:17:32.8097818Z [cluster1] "public_ip": {
2021-07-19T10:17:32.8098389Z [cluster1] "type": "string"
2021-07-19T10:17:32.8098899Z [cluster1] },
2021-07-19T10:17:32.8099407Z [cluster1] "subnets": {
2021-07-19T10:17:32.8099929Z [cluster1] "items": {
2021-07-19T10:17:32.8100486Z [cluster1] "type": "string"
2021-07-19T10:17:32.8101013Z [cluster1] },
2021-07-19T10:17:32.8101534Z [cluster1] "type": "array"
2021-07-19T10:17:32.8102061Z [cluster1] }
2021-07-19T10:17:32.8102524Z [cluster1] },
2021-07-19T10:17:32.8103105Z [cluster1] "required": [
2021-07-19T10:17:32.8103644Z [cluster1] "backend",
2021-07-19T10:17:32.8104189Z [cluster1] "cable_name",
2021-07-19T10:17:32.8104742Z [cluster1] "cluster_id",
2021-07-19T10:17:32.8105286Z [cluster1] "hostname",
2021-07-19T10:17:32.8105843Z [cluster1] "nat_enabled",
2021-07-19T10:17:32.8106389Z [cluster1] "private_ip",
2021-07-19T10:17:32.8106939Z [cluster1] "public_ip",
2021-07-19T10:17:32.8107477Z [cluster1] "subnets"
2021-07-19T10:17:32.8107988Z [cluster1] ],
2021-07-19T10:17:32.8108510Z [cluster1] "type": "object"
2021-07-19T10:17:32.8109013Z [cluster1] },
2021-07-19T10:17:32.8109547Z [cluster1] "latencyRTT": {
2021-07-19T10:17:32.8110518Z [cluster1] "description": "LatencySpec describes the round trip time information for a packet between the gateway pods of two clusters.",
2021-07-19T10:17:32.8111837Z [cluster1] "properties": {
2021-07-19T10:17:32.8112456Z [cluster1] "average": {
2021-07-19T10:17:32.8113045Z [cluster1] "type": "string"
2021-07-19T10:17:32.8113619Z [cluster1] },
2021-07-19T10:17:32.8114143Z [cluster1] "last": {
2021-07-19T10:17:32.8114731Z [cluster1] "type": "string"
2021-07-19T10:17:32.8115361Z [cluster1] },
2021-07-19T10:17:32.8115898Z [cluster1] "max": {
2021-07-19T10:17:32.8116470Z [cluster1] "type": "string"
2021-07-19T10:17:32.8117029Z [cluster1] },
2021-07-19T10:17:32.8117559Z [cluster1] "min": {
2021-07-19T10:17:32.8118132Z [cluster1] "type": "string"
2021-07-19T10:17:32.8118694Z [cluster1] },
2021-07-19T10:17:32.8119247Z [cluster1] "stdDev": {
2021-07-19T10:17:32.8119834Z [cluster1] "type": "string"
2021-07-19T10:17:32.8120396Z [cluster1] }
2021-07-19T10:17:32.8120900Z [cluster1] },
2021-07-19T10:17:32.8121457Z [cluster1] "type": "object"
2021-07-19T10:17:32.8121996Z [cluster1] },
2021-07-19T10:17:32.8122590Z [cluster1] "status": {
2021-07-19T10:17:32.8123173Z [cluster1] "type": "string"
2021-07-19T10:17:32.8123717Z [cluster1] },
2021-07-19T10:17:32.8124305Z [cluster1] "statusMessage": {
2021-07-19T10:17:32.8124938Z [cluster1] "type": "string"
2021-07-19T10:17:32.8125493Z [cluster1] },
2021-07-19T10:17:32.8126023Z [cluster1] "usingIP": {
2021-07-19T10:17:32.8126623Z [cluster1] "type": "string"
2021-07-19T10:17:32.8127178Z [cluster1] },
2021-07-19T10:17:32.8127714Z [cluster1] "usingNAT": {
2021-07-19T10:17:32.8128325Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8128978Z [cluster1] }
2021-07-19T10:17:32.8129579Z [cluster1] },
2021-07-19T10:17:32.8130109Z [cluster1] "required": [
2021-07-19T10:17:32.8130769Z [cluster1] "endpoint",
2021-07-19T10:17:32.8131351Z [cluster1] "status",
2021-07-19T10:17:32.8131946Z [cluster1] "statusMessage"
2021-07-19T10:17:32.8132597Z [cluster1] ],
2021-07-19T10:17:32.8133140Z [cluster1] "type": "object"
2021-07-19T10:17:32.8133691Z [cluster1] },
2021-07-19T10:17:32.8141088Z [cluster1] "type": "array"
2021-07-19T10:17:32.8141777Z [cluster1] },
2021-07-19T10:17:32.8142277Z [cluster1] "haStatus": {
2021-07-19T10:17:32.8142941Z [cluster1] "type": "string"
2021-07-19T10:17:32.8143456Z [cluster1] },
2021-07-19T10:17:32.8143971Z [cluster1] "localEndpoint": {
2021-07-19T10:17:32.8144568Z [cluster1] "properties": {
2021-07-19T10:17:32.8145111Z [cluster1] "backend": {
2021-07-19T10:17:32.8145660Z [cluster1] "type": "string"
2021-07-19T10:17:32.8146179Z [cluster1] },
2021-07-19T10:17:32.8146690Z [cluster1] "backend_config": {
2021-07-19T10:17:32.8147366Z [cluster1] "additionalProperties": {
2021-07-19T10:17:32.8148020Z [cluster1] "type": "string"
2021-07-19T10:17:32.8148540Z [cluster1] },
2021-07-19T10:17:32.8149040Z [cluster1] "type": "object"
2021-07-19T10:17:32.8149561Z [cluster1] },
2021-07-19T10:17:32.8150069Z [cluster1] "cable_name": {
2021-07-19T10:17:32.8150605Z [cluster1] "type": "string"
2021-07-19T10:17:32.8151198Z [cluster1] },
2021-07-19T10:17:32.8175423Z [cluster1] "cluster_id": {
2021-07-19T10:17:32.8176099Z [cluster1] "type": "string"
2021-07-19T10:17:32.8176609Z [cluster1] },
2021-07-19T10:17:32.8177184Z [cluster1] "healthCheckIP": {
2021-07-19T10:17:32.8177784Z [cluster1] "type": "string"
2021-07-19T10:17:32.8178283Z [cluster1] },
2021-07-19T10:17:32.8178792Z [cluster1] "hostname": {
2021-07-19T10:17:32.8179330Z [cluster1] "type": "string"
2021-07-19T10:17:32.8179849Z [cluster1] },
2021-07-19T10:17:32.8180351Z [cluster1] "nat_enabled": {
2021-07-19T10:17:32.8180921Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8181440Z [cluster1] },
2021-07-19T10:17:32.8181944Z [cluster1] "private_ip": {
2021-07-19T10:17:32.8182503Z [cluster1] "type": "string"
2021-07-19T10:17:32.8183006Z [cluster1] },
2021-07-19T10:17:32.8183673Z [cluster1] "public_ip": {
2021-07-19T10:17:32.8184241Z [cluster1] "type": "string"
2021-07-19T10:17:32.8184803Z [cluster1] },
2021-07-19T10:17:32.8185346Z [cluster1] "subnets": {
2021-07-19T10:17:32.8185893Z [cluster1] "items": {
2021-07-19T10:17:32.8186474Z [cluster1] "type": "string"
2021-07-19T10:17:32.8187017Z [cluster1] },
2021-07-19T10:17:32.8187753Z [cluster1] "type": "array"
2021-07-19T10:17:32.8188293Z [cluster1] }
2021-07-19T10:17:32.8188797Z [cluster1] },
2021-07-19T10:17:32.8189339Z [cluster1] "required": [
2021-07-19T10:17:32.8189900Z [cluster1] "backend",
2021-07-19T10:17:32.8190684Z [cluster1] "cable_name",
2021-07-19T10:17:32.8191248Z [cluster1] "cluster_id",
2021-07-19T10:17:32.8191934Z [cluster1] "hostname",
2021-07-19T10:17:32.8192525Z [cluster1] "nat_enabled",
2021-07-19T10:17:32.8193108Z [cluster1] "private_ip",
2021-07-19T10:17:32.8193691Z [cluster1] "public_ip",
2021-07-19T10:17:32.8194257Z [cluster1] "subnets"
2021-07-19T10:17:32.8194790Z [cluster1] ],
2021-07-19T10:17:32.8195323Z [cluster1] "type": "object"
2021-07-19T10:17:32.8195864Z [cluster1] },
2021-07-19T10:17:32.8196512Z [cluster1] "statusFailure": {
2021-07-19T10:17:32.8197137Z [cluster1] "type": "string"
2021-07-19T10:17:32.8197673Z [cluster1] },
2021-07-19T10:17:32.8198191Z [cluster1] "version": {
2021-07-19T10:17:32.8198779Z [cluster1] "type": "string"
2021-07-19T10:17:32.8199310Z [cluster1] }
2021-07-19T10:17:32.8199795Z [cluster1] },
2021-07-19T10:17:32.8200314Z [cluster1] "required": [
2021-07-19T10:17:32.8200907Z [cluster1] "connections",
2021-07-19T10:17:32.8201498Z [cluster1] "haStatus",
2021-07-19T10:17:32.8202098Z [cluster1] "localEndpoint",
2021-07-19T10:17:32.8202743Z [cluster1] "statusFailure",
2021-07-19T10:17:32.8203328Z [cluster1] "version"
2021-07-19T10:17:32.8203851Z [cluster1] ],
2021-07-19T10:17:32.8204457Z [cluster1] "type": "object"
2021-07-19T10:17:32.8204954Z [cluster1] },
2021-07-19T10:17:32.8205433Z [cluster1] "type": "array"
2021-07-19T10:17:32.8205895Z [cluster1] },
2021-07-19T10:17:32.8206389Z [cluster1] "globalCIDR": {
2021-07-19T10:17:32.8206907Z [cluster1] "type": "string"
2021-07-19T10:17:32.8207389Z [cluster1] },
2021-07-19T10:17:32.8208025Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-19T10:17:32.8208725Z [cluster1] "properties": {
2021-07-19T10:17:32.8209353Z [cluster1] "lastResourceVersion": {
2021-07-19T10:17:32.8209981Z [cluster1] "type": "string"
2021-07-19T10:17:32.8210472Z [cluster1] },
2021-07-19T10:17:32.8211179Z [cluster1] "mismatchedContainerImages": {
2021-07-19T10:17:32.8211899Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8212583Z [cluster1] },
2021-07-19T10:17:32.8213267Z [cluster1] "nonReadyContainerStates": {
2021-07-19T10:17:32.8213970Z [cluster1] "items": {
2021-07-19T10:17:32.8215274Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.8216604Z [cluster1] "properties": {
2021-07-19T10:17:32.8217174Z [cluster1] "running": {
2021-07-19T10:17:32.8217896Z [cluster1] "description": "Details about a running container",
2021-07-19T10:17:32.8218655Z [cluster1] "properties": {
2021-07-19T10:17:32.8219275Z [cluster1] "startedAt": {
2021-07-19T10:17:32.8220514Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.8221623Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8222266Z [cluster1] "type": "string"
2021-07-19T10:17:32.8222813Z [cluster1] }
2021-07-19T10:17:32.8223334Z [cluster1] },
2021-07-19T10:17:32.8223903Z [cluster1] "type": "object"
2021-07-19T10:17:32.8224452Z [cluster1] },
2021-07-19T10:17:32.8225014Z [cluster1] "terminated": {
2021-07-19T10:17:32.8225779Z [cluster1] "description": "Details about a terminated container",
2021-07-19T10:17:32.8226559Z [cluster1] "properties": {
2021-07-19T10:17:32.8227196Z [cluster1] "containerID": {
2021-07-19T10:17:32.8228350Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.8229189Z [cluster1] "type": "string"
2021-07-19T10:17:32.8229750Z [cluster1] },
2021-07-19T10:17:32.8230314Z [cluster1] "exitCode": {
2021-07-19T10:17:32.8231123Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.8232083Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8232715Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8233268Z [cluster1] },
2021-07-19T10:17:32.8233845Z [cluster1] "finishedAt": {
2021-07-19T10:17:32.8234707Z [cluster1] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.8235774Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8236419Z [cluster1] "type": "string"
2021-07-19T10:17:32.8236973Z [cluster1] },
2021-07-19T10:17:32.8237523Z [cluster1] "message": {
2021-07-19T10:17:32.8238354Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.8239200Z [cluster1] "type": "string"
2021-07-19T10:17:32.8239748Z [cluster1] },
2021-07-19T10:17:32.8240292Z [cluster1] "reason": {
2021-07-19T10:17:32.8241107Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.8241920Z [cluster1] "type": "string"
2021-07-19T10:17:32.8242473Z [cluster1] },
2021-07-19T10:17:32.8243004Z [cluster1] "signal": {
2021-07-19T10:17:32.8243862Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.8244663Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8245268Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8245841Z [cluster1] },
2021-07-19T10:17:32.8246384Z [cluster1] "startedAt": {
2021-07-19T10:17:32.8247233Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.8248337Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8249032Z [cluster1] "type": "string"
2021-07-19T10:17:32.8249549Z [cluster1] }
2021-07-19T10:17:32.8250007Z [cluster1] },
2021-07-19T10:17:32.8250517Z [cluster1] "required": [
2021-07-19T10:17:32.8251062Z [cluster1] "exitCode"
2021-07-19T10:17:32.8251574Z [cluster1] ],
2021-07-19T10:17:32.8252095Z [cluster1] "type": "object"
2021-07-19T10:17:32.8252585Z [cluster1] },
2021-07-19T10:17:32.8253078Z [cluster1] "waiting": {
2021-07-19T10:17:32.8253746Z [cluster1] "description": "Details about a waiting container",
2021-07-19T10:17:32.8254446Z [cluster1] "properties": {
2021-07-19T10:17:32.8254988Z [cluster1] "message": {
2021-07-19T10:17:32.8255743Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.8256563Z [cluster1] "type": "string"
2021-07-19T10:17:32.8257079Z [cluster1] },
2021-07-19T10:17:32.8257574Z [cluster1] "reason": {
2021-07-19T10:17:32.8258266Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.8258995Z [cluster1] "type": "string"
2021-07-19T10:17:32.8259509Z [cluster1] }
2021-07-19T10:17:32.8259969Z [cluster1] },
2021-07-19T10:17:32.8260480Z [cluster1] "type": "object"
2021-07-19T10:17:32.8260985Z [cluster1] }
2021-07-19T10:17:32.8261447Z [cluster1] },
2021-07-19T10:17:32.8261933Z [cluster1] "type": "object"
2021-07-19T10:17:32.8262438Z [cluster1] },
2021-07-19T10:17:32.8262931Z [cluster1] "type": "array"
2021-07-19T10:17:32.8263405Z [cluster1] },
2021-07-19T10:17:32.8263945Z [cluster1] "status": {
2021-07-19T10:17:32.8264718Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.8265536Z [cluster1] "properties": {
2021-07-19T10:17:32.8266118Z [cluster1] "collisionCount": {
2021-07-19T10:17:32.8267411Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.8268672Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8269214Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8269734Z [cluster1] },
2021-07-19T10:17:32.8270227Z [cluster1] "conditions": {
2021-07-19T10:17:32.8271378Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.8282347Z [cluster1] "items": {
2021-07-19T10:17:32.8300671Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.8301648Z [cluster1] "properties": {
2021-07-19T10:17:32.8302336Z [cluster1] "lastTransitionTime": {
2021-07-19T10:17:32.8303286Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.8304568Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8305345Z [cluster1] "type": "string"
2021-07-19T10:17:32.8305912Z [cluster1] },
2021-07-19T10:17:32.8306602Z [cluster1] "message": {
2021-07-19T10:17:32.8307489Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.8308366Z [cluster1] "type": "string"
2021-07-19T10:17:32.8308911Z [cluster1] },
2021-07-19T10:17:32.8309539Z [cluster1] "reason": {
2021-07-19T10:17:32.8310529Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.8311260Z [cluster1] "type": "string"
2021-07-19T10:17:32.8324635Z [cluster1] },
2021-07-19T10:17:32.8325274Z [cluster1] "status": {
2021-07-19T10:17:32.8326082Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.8326882Z [cluster1] "type": "string"
2021-07-19T10:17:32.8327445Z [cluster1] },
2021-07-19T10:17:32.8328119Z [cluster1] "type": {
2021-07-19T10:17:32.8328848Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.8329598Z [cluster1] "type": "string"
2021-07-19T10:17:32.8330148Z [cluster1] }
2021-07-19T10:17:32.8330824Z [cluster1] },
2021-07-19T10:17:32.8331367Z [cluster1] "required": [
2021-07-19T10:17:32.8331950Z [cluster1] "status",
2021-07-19T10:17:32.8332622Z [cluster1] "type"
2021-07-19T10:17:32.8333105Z [cluster1] ],
2021-07-19T10:17:32.8333630Z [cluster1] "type": "object"
2021-07-19T10:17:32.8334132Z [cluster1] },
2021-07-19T10:17:32.8334634Z [cluster1] "type": "array"
2021-07-19T10:17:32.8335125Z [cluster1] },
2021-07-19T10:17:32.8335765Z [cluster1] "currentNumberScheduled": {
2021-07-19T10:17:32.8337136Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8338338Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8338902Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8339401Z [cluster1] },
2021-07-19T10:17:32.8340037Z [cluster1] "desiredNumberScheduled": {
2021-07-19T10:17:32.8341531Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8342815Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8343375Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8343875Z [cluster1] },
2021-07-19T10:17:32.8344432Z [cluster1] "numberAvailable": {
2021-07-19T10:17:32.8345592Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8346675Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8347235Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8347739Z [cluster1] },
2021-07-19T10:17:32.8348327Z [cluster1] "numberMisscheduled": {
2021-07-19T10:17:32.8349628Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8350868Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8351426Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8352074Z [cluster1] },
2021-07-19T10:17:32.8352595Z [cluster1] "numberReady": {
2021-07-19T10:17:32.8353530Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.8354412Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8354964Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8355459Z [cluster1] },
2021-07-19T10:17:32.8356038Z [cluster1] "numberUnavailable": {
2021-07-19T10:17:32.8357195Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8358254Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8358807Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8359303Z [cluster1] },
2021-07-19T10:17:32.8359888Z [cluster1] "observedGeneration": {
2021-07-19T10:17:32.8360756Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.8361550Z [cluster1] "format": "int64",
2021-07-19T10:17:32.8362281Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8362907Z [cluster1] },
2021-07-19T10:17:32.8363539Z [cluster1] "updatedNumberScheduled": {
2021-07-19T10:17:32.8364477Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.8365225Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8365780Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8366272Z [cluster1] }
2021-07-19T10:17:32.8366727Z [cluster1] },
2021-07-19T10:17:32.8367208Z [cluster1] "required": [
2021-07-19T10:17:32.8367881Z [cluster1] "currentNumberScheduled",
2021-07-19T10:17:32.8368674Z [cluster1] "desiredNumberScheduled",
2021-07-19T10:17:32.8369424Z [cluster1] "numberMisscheduled",
2021-07-19T10:17:32.8370069Z [cluster1] "numberReady"
2021-07-19T10:17:32.8370575Z [cluster1] ],
2021-07-19T10:17:32.8371075Z [cluster1] "type": "object"
2021-07-19T10:17:32.8371550Z [cluster1] }
2021-07-19T10:17:32.8371992Z [cluster1] },
2021-07-19T10:17:32.8372460Z [cluster1] "required": [
2021-07-19T10:17:32.8374011Z [cluster1] "mismatchedContainerImages"
2021-07-19T10:17:32.8374756Z [cluster1] ],
2021-07-19T10:17:32.8375252Z [cluster1] "type": "object"
2021-07-19T10:17:32.8375738Z [cluster1] },
2021-07-19T10:17:32.8376285Z [cluster1] "loadBalancerStatus": {
2021-07-19T10:17:32.8376917Z [cluster1] "properties": {
2021-07-19T10:17:32.8377436Z [cluster1] "status": {
2021-07-19T10:17:32.8378660Z [cluster1] "description": "LoadBalancerStatus represents the status of a load-balancer.",
2021-07-19T10:17:32.8379512Z [cluster1] "properties": {
2021-07-19T10:17:32.8380066Z [cluster1] "ingress": {
2021-07-19T10:17:32.8381437Z [cluster1] "description": "Ingress is a list containing ingress points for the load-balancer. Traffic intended for the service should be sent to these ingress points.",
2021-07-19T10:17:32.8382456Z [cluster1] "items": {
2021-07-19T10:17:32.8383906Z [cluster1] "description": "LoadBalancerIngress represents the status of a load-balancer ingress point: traffic intended for the service should be sent to an ingress point.",
2021-07-19T10:17:32.8385051Z [cluster1] "properties": {
2021-07-19T10:17:32.8387508Z [cluster1] "hostname": {
2021-07-19T10:17:32.8389607Z [cluster1] "description": "Hostname is set for load-balancer ingress points that are DNS based (typically AWS load-balancers)",
2021-07-19T10:17:32.8390633Z [cluster1] "type": "string"
2021-07-19T10:17:32.8391194Z [cluster1] },
2021-07-19T10:17:32.8392090Z [cluster1] "ip": {
2021-07-19T10:17:32.8393582Z [cluster1] "description": "IP is set for load-balancer ingress points that are IP based (typically GCE or OpenStack load-balancers)",
2021-07-19T10:17:32.8394620Z [cluster1] "type": "string"
2021-07-19T10:17:32.8395172Z [cluster1] }
2021-07-19T10:17:32.8395692Z [cluster1] },
2021-07-19T10:17:32.8396241Z [cluster1] "type": "object"
2021-07-19T10:17:32.8410335Z [cluster1] },
2021-07-19T10:17:32.8410893Z [cluster1] "type": "array"
2021-07-19T10:17:32.8411424Z [cluster1] }
2021-07-19T10:17:32.8411919Z [cluster1] },
2021-07-19T10:17:32.8412448Z [cluster1] "type": "object"
2021-07-19T10:17:32.8412991Z [cluster1] }
2021-07-19T10:17:32.8413460Z [cluster1] },
2021-07-19T10:17:32.8413987Z [cluster1] "type": "object"
2021-07-19T10:17:32.8414514Z [cluster1] },
2021-07-19T10:17:32.8415030Z [cluster1] "natEnabled": {
2021-07-19T10:17:32.8415618Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8416285Z [cluster1] },
2021-07-19T10:17:32.8416848Z [cluster1] "networkPlugin": {
2021-07-19T10:17:32.8417444Z [cluster1] "type": "string"
2021-07-19T10:17:32.8418532Z [cluster1] },
2021-07-19T10:17:32.8419242Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-19T10:17:32.8420031Z [cluster1] "properties": {
2021-07-19T10:17:32.8420725Z [cluster1] "lastResourceVersion": {
2021-07-19T10:17:32.8421388Z [cluster1] "type": "string"
2021-07-19T10:17:32.8421919Z [cluster1] },
2021-07-19T10:17:32.8422620Z [cluster1] "mismatchedContainerImages": {
2021-07-19T10:17:32.8423394Z [cluster1] "type": "boolean"
2021-07-19T10:17:32.8423923Z [cluster1] },
2021-07-19T10:17:32.8424608Z [cluster1] "nonReadyContainerStates": {
2021-07-19T10:17:32.8425314Z [cluster1] "items": {
2021-07-19T10:17:32.8426599Z [cluster1] "description": "ContainerState holds a possible state of container. Only one of its members may be specified. If none of them is specified, the default one is ContainerStateWaiting.",
2021-07-19T10:17:32.8444068Z [cluster1] "properties": {
2021-07-19T10:17:32.8444657Z [cluster1] "running": {
2021-07-19T10:17:32.8445336Z [cluster1] "description": "Details about a running container",
2021-07-19T10:17:32.8446061Z [cluster1] "properties": {
2021-07-19T10:17:32.8446624Z [cluster1] "startedAt": {
2021-07-19T10:17:32.8447925Z [cluster1] "description": "Time at which the container was last (re-)started",
2021-07-19T10:17:32.8449026Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8449635Z [cluster1] "type": "string"
2021-07-19T10:17:32.8450153Z [cluster1] }
2021-07-19T10:17:32.8450612Z [cluster1] },
2021-07-19T10:17:32.8451135Z [cluster1] "type": "object"
2021-07-19T10:17:32.8451640Z [cluster1] },
2021-07-19T10:17:32.8452159Z [cluster1] "terminated": {
2021-07-19T10:17:32.8452862Z [cluster1] "description": "Details about a terminated container",
2021-07-19T10:17:32.8453587Z [cluster1] "properties": {
2021-07-19T10:17:32.8454189Z [cluster1] "containerID": {
2021-07-19T10:17:32.8455262Z [cluster1] "description": "Container's ID in the format 'docker://\u003ccontainer_id\u003e'",
2021-07-19T10:17:32.8456049Z [cluster1] "type": "string"
2021-07-19T10:17:32.8456549Z [cluster1] },
2021-07-19T10:17:32.8457142Z [cluster1] "exitCode": {
2021-07-19T10:17:32.8457906Z [cluster1] "description": "Exit status from the last termination of the container",
2021-07-19T10:17:32.8458648Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8459222Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8459748Z [cluster1] },
2021-07-19T10:17:32.8460274Z [cluster1] "finishedAt": {
2021-07-19T10:17:32.8461004Z [cluster1] "description": "Time at which the container last terminated",
2021-07-19T10:17:32.8461971Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8462569Z [cluster1] "type": "string"
2021-07-19T10:17:32.8463072Z [cluster1] },
2021-07-19T10:17:32.8463705Z [cluster1] "message": {
2021-07-19T10:17:32.8464474Z [cluster1] "description": "Message regarding the last termination of the container",
2021-07-19T10:17:32.8465555Z [cluster1] "type": "string"
2021-07-19T10:17:32.8466074Z [cluster1] },
2021-07-19T10:17:32.8466561Z [cluster1] "reason": {
2021-07-19T10:17:32.8467312Z [cluster1] "description": "(brief) reason from the last termination of the container",
2021-07-19T10:17:32.8468073Z [cluster1] "type": "string"
2021-07-19T10:17:32.8468590Z [cluster1] },
2021-07-19T10:17:32.8469087Z [cluster1] "signal": {
2021-07-19T10:17:32.8469862Z [cluster1] "description": "Signal from the last termination of the container",
2021-07-19T10:17:32.8470601Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8471157Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8473952Z [cluster1] },
2021-07-19T10:17:32.8474657Z [cluster1] "startedAt": {
2021-07-19T10:17:32.8475511Z [cluster1] "description": "Time at which previous execution of the container started",
2021-07-19T10:17:32.8476708Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8477333Z [cluster1] "type": "string"
2021-07-19T10:17:32.8477899Z [cluster1] }
2021-07-19T10:17:32.8478399Z [cluster1] },
2021-07-19T10:17:32.8478951Z [cluster1] "required": [
2021-07-19T10:17:32.8479551Z [cluster1] "exitCode"
2021-07-19T10:17:32.8480090Z [cluster1] ],
2021-07-19T10:17:32.8480764Z [cluster1] "type": "object"
2021-07-19T10:17:32.8481307Z [cluster1] },
2021-07-19T10:17:32.8481840Z [cluster1] "waiting": {
2021-07-19T10:17:32.8482556Z [cluster1] "description": "Details about a waiting container",
2021-07-19T10:17:32.8483326Z [cluster1] "properties": {
2021-07-19T10:17:32.8483933Z [cluster1] "message": {
2021-07-19T10:17:32.8484738Z [cluster1] "description": "Message regarding why the container is not yet running.",
2021-07-19T10:17:32.8485556Z [cluster1] "type": "string"
2021-07-19T10:17:32.8486104Z [cluster1] },
2021-07-19T10:17:32.8486648Z [cluster1] "reason": {
2021-07-19T10:17:32.8487414Z [cluster1] "description": "(brief) reason the container is not yet running.",
2021-07-19T10:17:32.8488223Z [cluster1] "type": "string"
2021-07-19T10:17:32.8488783Z [cluster1] }
2021-07-19T10:17:32.8489278Z [cluster1] },
2021-07-19T10:17:32.8489832Z [cluster1] "type": "object"
2021-07-19T10:17:32.8490378Z [cluster1] }
2021-07-19T10:17:32.8490879Z [cluster1] },
2021-07-19T10:17:32.8491407Z [cluster1] "type": "object"
2021-07-19T10:17:32.8491948Z [cluster1] },
2021-07-19T10:17:32.8492479Z [cluster1] "type": "array"
2021-07-19T10:17:32.8492991Z [cluster1] },
2021-07-19T10:17:32.8493498Z [cluster1] "status": {
2021-07-19T10:17:32.8494397Z [cluster1] "description": "DaemonSetStatus represents the current status of a daemon set.",
2021-07-19T10:17:32.8495289Z [cluster1] "properties": {
2021-07-19T10:17:32.8495926Z [cluster1] "collisionCount": {
2021-07-19T10:17:32.8497325Z [cluster1] "description": "Count of hash collisions for the DaemonSet. The DaemonSet controller uses this field as a collision avoidance mechanism when it needs to create the name for the newest ControllerRevision.",
2021-07-19T10:17:32.8498690Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8499274Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8499826Z [cluster1] },
2021-07-19T10:17:32.8500363Z [cluster1] "conditions": {
2021-07-19T10:17:32.8501616Z [cluster1] "description": "Represents the latest available observations of a DaemonSet's current state.",
2021-07-19T10:17:32.8502520Z [cluster1] "items": {
2021-07-19T10:17:32.8503429Z [cluster1] "description": "DaemonSetCondition describes the state of a DaemonSet at a certain point.",
2021-07-19T10:17:32.8504450Z [cluster1] "properties": {
2021-07-19T10:17:32.8505144Z [cluster1] "lastTransitionTime": {
2021-07-19T10:17:32.8506084Z [cluster1] "description": "Last time the condition transitioned from one status to another.",
2021-07-19T10:17:32.8507212Z [cluster1] "format": "date-time",
2021-07-19T10:17:32.8507835Z [cluster1] "type": "string"
2021-07-19T10:17:32.8508395Z [cluster1] },
2021-07-19T10:17:32.8508930Z [cluster1] "message": {
2021-07-19T10:17:32.8509794Z [cluster1] "description": "A human readable message indicating details about the transition.",
2021-07-19T10:17:32.8510673Z [cluster1] "type": "string"
2021-07-19T10:17:32.8511214Z [cluster1] },
2021-07-19T10:17:32.8512635Z [cluster1] "reason": {
2021-07-19T10:17:32.8513744Z [cluster1] "description": "The reason for the condition's last transition.",
2021-07-19T10:17:32.8514532Z [cluster1] "type": "string"
2021-07-19T10:17:32.8515089Z [cluster1] },
2021-07-19T10:17:32.8515612Z [cluster1] "status": {
2021-07-19T10:17:32.8523927Z [cluster1] "description": "Status of the condition, one of True, False, Unknown.",
2021-07-19T10:17:32.8524739Z [cluster1] "type": "string"
2021-07-19T10:17:32.8525300Z [cluster1] },
2021-07-19T10:17:32.8525978Z [cluster1] "type": {
2021-07-19T10:17:32.8526693Z [cluster1] "description": "Type of DaemonSet condition.",
2021-07-19T10:17:32.8527436Z [cluster1] "type": "string"
2021-07-19T10:17:32.8527987Z [cluster1] }
2021-07-19T10:17:32.8528495Z [cluster1] },
2021-07-19T10:17:32.8529033Z [cluster1] "required": [
2021-07-19T10:17:32.8529612Z [cluster1] "status",
2021-07-19T10:17:32.8530166Z [cluster1] "type"
2021-07-19T10:17:32.8530674Z [cluster1] ],
2021-07-19T10:17:32.8531233Z [cluster1] "type": "object"
2021-07-19T10:17:32.8546691Z [cluster1] },
2021-07-19T10:17:32.8547349Z [cluster1] "type": "array"
2021-07-19T10:17:32.8547890Z [cluster1] },
2021-07-19T10:17:32.8548578Z [cluster1] "currentNumberScheduled": {
2021-07-19T10:17:32.8550056Z [cluster1] "description": "The number of nodes that are running at least 1 daemon pod and are supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8551528Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8552266Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8552922Z [cluster1] },
2021-07-19T10:17:32.8553609Z [cluster1] "desiredNumberScheduled": {
2021-07-19T10:17:32.8555163Z [cluster1] "description": "The total number of nodes that should be running the daemon pod (including nodes correctly running the daemon pod). More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8556550Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8557159Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8557704Z [cluster1] },
2021-07-19T10:17:32.8558307Z [cluster1] "numberAvailable": {
2021-07-19T10:17:32.8559572Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8560753Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8561354Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8561898Z [cluster1] },
2021-07-19T10:17:32.8562534Z [cluster1] "numberMisscheduled": {
2021-07-19T10:17:32.8563944Z [cluster1] "description": "The number of nodes that are running the daemon pod, but are not supposed to run the daemon pod. More info: https://kubernetes.io/docs/concepts/workloads/controllers/daemonset/",
2021-07-19T10:17:32.8578133Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8578999Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8579561Z [cluster1] },
2021-07-19T10:17:32.8580127Z [cluster1] "numberReady": {
2021-07-19T10:17:32.8581134Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have one or more of the daemon pod running and ready.",
2021-07-19T10:17:32.8582105Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8582712Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8583260Z [cluster1] },
2021-07-19T10:17:32.8583868Z [cluster1] "numberUnavailable": {
2021-07-19T10:17:32.8585130Z [cluster1] "description": "The number of nodes that should be running the daemon pod and have none of the daemon pod running and available (ready for at least spec.minReadySeconds)",
2021-07-19T10:17:32.8586294Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8586888Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8587428Z [cluster1] },
2021-07-19T10:17:32.8588179Z [cluster1] "observedGeneration": {
2021-07-19T10:17:32.8589119Z [cluster1] "description": "The most recent generation observed by the daemon set controller.",
2021-07-19T10:17:32.8590105Z [cluster1] "format": "int64",
2021-07-19T10:17:32.8590795Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8591334Z [cluster1] },
2021-07-19T10:17:32.8592126Z [cluster1] "updatedNumberScheduled": {
2021-07-19T10:17:32.8593076Z [cluster1] "description": "The total number of nodes that are running updated daemon pod",
2021-07-19T10:17:32.8593880Z [cluster1] "format": "int32",
2021-07-19T10:17:32.8594484Z [cluster1] "type": "integer"
2021-07-19T10:17:32.8595023Z [cluster1] }
2021-07-19T10:17:32.8595517Z [cluster1] },
2021-07-19T10:17:32.8596039Z [cluster1] "required": [
2021-07-19T10:17:32.8596767Z [cluster1] "currentNumberScheduled",
2021-07-19T10:17:32.8597625Z [cluster1] "desiredNumberScheduled",
2021-07-19T10:17:32.8598432Z [cluster1] "numberMisscheduled",
2021-07-19T10:17:32.8599123Z [cluster1] "numberReady"
2021-07-19T10:17:32.8600674Z [cluster1] ],
2021-07-19T10:17:32.8601243Z [cluster1] "type": "object"
2021-07-19T10:17:32.8601922Z [cluster1] }
2021-07-19T10:17:32.8602753Z [cluster1] },
2021-07-19T10:17:32.8603519Z [cluster1] "required": [
2021-07-19T10:17:32.8604438Z [cluster1] "mismatchedContainerImages"
2021-07-19T10:17:32.8605838Z [cluster1] ],
2021-07-19T10:17:32.8606536Z [cluster1] "type": "object"
2021-07-19T10:17:32.8607214Z [cluster1] },
2021-07-19T10:17:32.8607882Z [cluster1] "serviceCIDR": {
2021-07-19T10:17:32.8608620Z [cluster1] "type": "string"
2021-07-19T10:17:32.8609390Z [cluster1] }
2021-07-19T10:17:32.8609874Z [cluster1] },
2021-07-19T10:17:32.8610527Z [cluster1] "required": [
2021-07-19T10:17:32.8611240Z [cluster1] "clusterID",
2021-07-19T10:17:32.8611970Z [cluster1] "natEnabled"
2021-07-19T10:17:32.8612473Z [cluster1] ],
2021-07-19T10:17:32.8612984Z [cluster1] "type": "object"
2021-07-19T10:17:32.8613476Z [cluster1] }
2021-07-19T10:17:32.8613927Z [cluster1] },
2021-07-19T10:17:32.8614412Z [cluster1] "type": "object"
2021-07-19T10:17:32.8614904Z [cluster1] }
2021-07-19T10:17:32.8615323Z [cluster1] },
2021-07-19T10:17:32.8615806Z [cluster1] "served": true,
2021-07-19T10:17:32.8616329Z [cluster1] "storage": true,
2021-07-19T10:17:32.8616886Z [cluster1] "subresources": {
2021-07-19T10:17:32.8617507Z [cluster1] "status": {}
2021-07-19T10:17:32.8617951Z [cluster1] }
2021-07-19T10:17:32.8618382Z [cluster1] }
2021-07-19T10:17:32.8618786Z [cluster1] ]
2021-07-19T10:17:32.8619201Z [cluster1] },
2021-07-19T10:17:32.8619629Z [cluster1] "status": {
2021-07-19T10:17:32.8620158Z [cluster1] "acceptedNames": {
2021-07-19T10:17:32.8620726Z [cluster1] "kind": "Submariner",
2021-07-19T10:17:32.8621358Z [cluster1] "listKind": "SubmarinerList",
2021-07-19T10:17:32.8621997Z [cluster1] "plural": "submariners",
2021-07-19T10:17:32.8622608Z [cluster1] "singular": "submariner"
2021-07-19T10:17:32.8623108Z [cluster1] },
2021-07-19T10:17:32.8623583Z [cluster1] "conditions": [
2021-07-19T10:17:32.8624056Z [cluster1] {
2021-07-19T10:17:32.8625449Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:42Z",
2021-07-19T10:17:34.8510739Z [cluster1] "message": "no conflicts found",
2021-07-19T10:17:34.8511440Z [cluster2] "reason": "NoConflicts",
2021-07-19T10:17:34.8512148Z [cluster2] "status": "True",
2021-07-19T10:17:34.8512739Z [cluster2] "type": "NamesAccepted"
2021-07-19T10:17:34.8513257Z [cluster2] },
2021-07-19T10:17:34.8513679Z [cluster2] {
2021-07-19T10:17:34.8515112Z [cluster2] "lastTransitionTime": "2021-07-19T10:12:53Z",
2021-07-19T10:17:34.8515917Z [cluster2] "message": "the initial names have been accepted",
2021-07-19T10:17:34.8516718Z [cluster2] "reason": "InitialNamesAccepted",
2021-07-19T10:17:34.8517389Z [cluster2] "status": "True",
2021-07-19T10:17:34.8517930Z [cluster2] "type": "Established"
2021-07-19T10:17:34.8518436Z [cluster2] }
2021-07-19T10:17:34.8518853Z [cluster2] ],
2021-07-19T10:17:34.8519350Z [cluster2] "storedVersions": [
2021-07-19T10:17:34.8519900Z [cluster2] "v1alpha1"
2021-07-19T10:17:34.8520336Z [cluster2] ]
2021-07-19T10:17:34.8520747Z [cluster2] }
2021-07-19T10:17:34.8521140Z [cluster2] }
2021-07-19T10:17:34.8522302Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-19T10:17:34.8523921Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariners.submariner.io
2021-07-19T10:17:34.8525985Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:34.8527781Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:34.8529430Z [submariner-operator]$ [cluster2] validate_equals .spec.scope Namespaced
2021-07-19T10:17:34.8531194Z [submariner-operator]$ [cluster2] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:34.8532986Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:34.8534556Z [submariner-operator]$ [cluster2] validate_equals .spec.group submariner.io
2021-07-19T10:17:34.8536451Z [submariner-operator]$ [cluster2] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:34.8538224Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-19T10:17:34.8539680Z [submariner-operator]$ [cluster2] validate_equals .spec.names.kind Submariner
2021-07-19T10:17:34.8541533Z [submariner-operator]$ [cluster2] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster2.json
2021-07-19T10:17:34.8545544Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-19T10:17:34.8546750Z [submariner-operator]$ [cluster2] verify_subm_operator
2021-07-19T10:17:34.8548058Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-19T10:17:34.8549457Z [submariner-operator]$ [cluster2] kubectl get ns submariner-operator
2021-07-19T10:17:34.8551213Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get ns submariner-operator
2021-07-19T10:17:34.8552855Z [cluster2] NAME STATUS AGE
2021-07-19T10:17:34.8553815Z [cluster2] submariner-operator Active 4m40s
2021-07-19T10:17:34.8555155Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T10:17:34.8556720Z [submariner-operator]$ [cluster2] kubectl get crds submariners.submariner.io
2021-07-19T10:17:34.8558428Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get crds submariners.submariner.io
2021-07-19T10:17:34.8559564Z [cluster2] NAME CREATED AT
2021-07-19T10:17:34.8560570Z [cluster2] submariners.submariner.io 2021-07-19T10:12:53Z
2021-07-19T10:17:34.8561789Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-19T10:17:34.8562972Z [submariner-operator]$ [cluster2] grep submariners
2021-07-19T10:17:34.8564262Z [submariner-operator]$ [cluster2] kubectl api-resources
2021-07-19T10:17:34.8565747Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 api-resources
2021-07-19T10:17:34.8566982Z [cluster2] submariners submariner.io/v1alpha1 true Submariner
2021-07-19T10:17:34.8568563Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8570388Z [submariner-operator]$ [cluster2] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8572349Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8573579Z [cluster2] NAME SECRETS AGE
2021-07-19T10:17:34.8574500Z [cluster2] submariner-operator 1 4m41s
2021-07-19T10:17:34.8575953Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8577807Z [submariner-operator]$ [cluster2] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8579845Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:34.8581016Z [cluster2] NAME CREATED AT
2021-07-19T10:17:34.8582002Z [cluster2] submariner-operator 2021-07-19T10:12:53Z
2021-07-19T10:17:35.1099013Z [submariner-operator]$ [cluster2] kubectl geto conflicts found",
2021-07-19T10:17:35.1099878Z [cluster1] "reason": "NoConflicts",
2021-07-19T10:17:35.1100448Z [cluster1] "status": "True",
2021-07-19T10:17:35.1101040Z [cluster1] "type": "NamesAccepted"
2021-07-19T10:17:35.1101583Z [cluster1] },
2021-07-19T10:17:35.1101992Z [cluster1] {
2021-07-19T10:17:35.1102839Z [cluster1] "lastTransitionTime": "2021-07-19T10:12:42Z",
2021-07-19T10:17:35.1103608Z [cluster1] "message": "the initial names have been accepted",
2021-07-19T10:17:35.1105106Z [cluster1] "reason": "InitialNamesAccepted",
2021-07-19T10:17:35.1106734Z [cluster1] "status": "True",
2021-07-19T10:17:35.1107601Z [cluster1] "type": "Established"
2021-07-19T10:17:35.1108265Z [cluster1] }
2021-07-19T10:17:35.1110736Z [cluster1] ],
2021-07-19T10:17:35.1111267Z [cluster1] "storedVersions": [
2021-07-19T10:17:35.1111951Z [cluster1] "v1alpha1"
2021-07-19T10:17:35.1112413Z [cluster1] ]
2021-07-19T10:17:35.1112835Z [cluster1] }
2021-07-19T10:17:35.1113229Z [cluster1] }
2021-07-19T10:17:35.1114732Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-19T10:17:35.1116378Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariners.submariner.io
2021-07-19T10:17:35.1118450Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:35.1120091Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:35.1121366Z [submariner-operator]$ [cluster1] validate_equals .spec.scope Namespaced
2021-07-19T10:17:35.1123036Z [submariner-operator]$ [cluster1] jq -r -M .spec.scope /tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:35.1124670Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:35.1125974Z [submariner-operator]$ [cluster1] validate_equals .spec.group submariner.io
2021-07-19T10:17:35.1127637Z [submariner-operator]$ [cluster1] jq -r -M .spec.group /tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:35.1129300Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-19T10:17:35.1130628Z [submariner-operator]$ [cluster1] validate_equals .spec.names.kind Submariner
2021-07-19T10:17:35.1132352Z [submariner-operator]$ [cluster1] jq -r -M .spec.names.kind /tmp/submariners.submariner.io.cluster1.json
2021-07-19T10:17:35.1133898Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-19T10:17:35.1134940Z [submariner-operator]$ [cluster1] verify_subm_operator
2021-07-19T10:17:35.1136118Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-19T10:17:35.1137390Z [submariner-operator]$ [cluster1] kubectl get ns submariner-operator
2021-07-19T10:17:35.1138824Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get ns submariner-operator
2021-07-19T10:17:35.1139755Z [cluster1] NAME STATUS AGE
2021-07-19T10:17:35.1140628Z [cluster1] submariner-operator Active 4m51s
2021-07-19T10:17:35.1141856Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T10:17:35.1143309Z [submariner-operator]$ [cluster1] kubectl get crds submariners.submariner.io
2021-07-19T10:17:35.1145045Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get crds submariners.submariner.io
2021-07-19T10:17:35.1146050Z [cluster1] NAME CREATED AT
2021-07-19T10:17:35.1147039Z [cluster1] submariners.submariner.io 2021-07-19T10:12:42Z
2021-07-19T10:17:35.1148263Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-19T10:17:35.1149366Z [submariner-operator]$ [cluster1] grep submariners
2021-07-19T10:17:35.1150443Z [submariner-operator]$ [cluster1] kubectl api-resources
2021-07-19T10:17:35.1159203Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 api-resources
2021-07-19T10:17:35.1160534Z [cluster1] submariners submariner.io/v1alpha1 true Submariner
2021-07-19T10:17:35.1162179Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1163980Z [submariner-operator]$ [cluster1] kubectl get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1165843Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get sa --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1166885Z [cluster1] NAME SECRETS AGE
2021-07-19T10:17:35.1167656Z [cluster1] submariner-operator 1 4m52s
2021-07-19T10:17:35.1168902Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1170513Z [submariner-operator]$ [cluster1] kubectl get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1172242Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get roles --namespace=submariner-operator submariner-operator
2021-07-19T10:17:35.1173465Z [cluster1] NAME CREATED AT
2021-07-19T10:17:35.1174239Z [cluster1] submariner-operator 2021-07-19T10:12:42Z
2021-07-19T10:17:36.5366066Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5367849Z [submariner-operator]$ [cluster2] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5369723Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5370835Z [cluster2] NAME ROLE AGE
2021-07-19T10:17:36.5371749Z [cluster2] submariner-operator Role/submariner-operator 4m42s
2021-07-19T10:17:36.5373172Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5374867Z [submariner-operator]$ [cluster2] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5376675Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.5378034Z [cluster2] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-19T10:17:36.5378898Z [cluster2] submariner-operator 1/1 1 1 4m37s
2021-07-19T10:17:36.5379972Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-19T10:17:36.5380920Z [submariner-operator]$ [cluster2] verify_subm_op_pod
2021-07-19T10:17:36.5382415Z [submariner-operator]$ [cluster2] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T10:17:36.5384400Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.5386522Z [submariner-operator]$ [cluster2] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.5388776Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.5391137Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o json
2021-07-19T10:17:36.5393681Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o json
2021-07-19T10:17:36.5396051Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o json
2021-07-19T10:17:36.5397286Z [cluster2] {
2021-07-19T10:17:36.5397745Z [cluster2] "apiVersion": "v1",
2021-07-19T10:17:36.5398212Z [cluster2] "kind": "Pod",
2021-07-19T10:17:36.5398667Z [cluster2] "metadata": {
2021-07-19T10:17:36.5399408Z [cluster2] "creationTimestamp": "2021-07-19T10:15:59Z",
2021-07-19T10:17:36.5400474Z [cluster2] "generateName": "submariner-operator-5bfdb87494-",
2021-07-19T10:17:36.5401235Z [cluster2] "labels": {
2021-07-19T10:17:36.5401966Z [cluster2] "name": "submariner-operator",
2021-07-19T10:17:36.5402811Z [cluster2] "pod-template-hash": "5bfdb87494"
2021-07-19T10:17:36.5403351Z [cluster2] },
2021-07-19T10:17:36.5403803Z [cluster2] "managedFields": [
2021-07-19T10:17:36.5404274Z [cluster2] {
2021-07-19T10:17:36.5404720Z [cluster2] "apiVersion": "v1",
2021-07-19T10:17:36.5405282Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:36.5405818Z [cluster2] "fieldsV1": {
2021-07-19T10:17:36.5406290Z [cluster2] "f:metadata": {
2021-07-19T10:17:36.5406957Z [cluster2] "f:generateName": {},
2021-07-19T10:17:36.5407471Z [cluster2] "f:labels": {
2021-07-19T10:17:36.5407928Z [cluster2] ".": {},
2021-07-19T10:17:36.5408368Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5409118Z [cluster2] "f:pod-template-hash": {}
2021-07-19T10:17:36.5409640Z [cluster2] },
2021-07-19T10:17:36.5410173Z [cluster2] "f:ownerReferences": {
2021-07-19T10:17:36.5410706Z [cluster2] ".": {},
2021-07-19T10:17:36.5411511Z [cluster2] "k:{\"uid\":\"6998bc38-a358-4792-9aa6-1bdaea143978\"}": {
2021-07-19T10:17:36.5412114Z [cluster2] ".": {},
2021-07-19T10:17:36.5412598Z [cluster2] "f:apiVersion": {},
2021-07-19T10:17:36.5413222Z [cluster2] "f:blockOwnerDeletion": {},
2021-07-19T10:17:36.5413831Z [cluster2] "f:controller": {},
2021-07-19T10:17:36.5414330Z [cluster2] "f:kind": {},
2021-07-19T10:17:36.5414788Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5415254Z [cluster2] "f:uid": {}
2021-07-19T10:17:36.5415694Z [cluster2] }
2021-07-19T10:17:36.5416105Z [cluster2] }
2021-07-19T10:17:36.5416516Z [cluster2] },
2021-07-19T10:17:36.5416933Z [cluster2] "f:spec": {
2021-07-19T10:17:36.5417523Z [cluster2] "f:containers": {
2021-07-19T10:17:36.5418340Z [cluster2] "k:{\"name\":\"submariner-operator\"}": {
2021-07-19T10:17:36.5418941Z [cluster2] ".": {},
2021-07-19T10:17:36.5419398Z [cluster2] "f:command": {},
2021-07-19T10:17:36.5420084Z [cluster2] "f:env": {
2021-07-19T10:17:36.5420573Z [cluster2] ".": {},
2021-07-19T10:17:36.5421131Z [cluster2] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-19T10:17:36.5421702Z [cluster2] ".": {},
2021-07-19T10:17:36.5422197Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5422820Z [cluster2] "f:value": {}
2021-07-19T10:17:36.5423309Z [cluster2] },
2021-07-19T10:17:36.5423850Z [cluster2] "k:{\"name\":\"POD_NAME\"}": {
2021-07-19T10:17:36.5424379Z [cluster2] ".": {},
2021-07-19T10:17:36.5424967Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5425518Z [cluster2] "f:valueFrom": {
2021-07-19T10:17:36.5426044Z [cluster2] ".": {},
2021-07-19T10:17:36.5426583Z [cluster2] "f:fieldRef": {
2021-07-19T10:17:36.5427105Z [cluster2] ".": {},
2021-07-19T10:17:36.5427665Z [cluster2] "f:apiVersion": {},
2021-07-19T10:17:36.5428259Z [cluster2] "f:fieldPath": {}
2021-07-19T10:17:36.5428806Z [cluster2] }
2021-07-19T10:17:36.5429287Z [cluster2] }
2021-07-19T10:17:36.5429741Z [cluster2] },
2021-07-19T10:17:36.5430314Z [cluster2] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-19T10:17:36.5430887Z [cluster2] ".": {},
2021-07-19T10:17:36.5431389Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5472490Z [cluster2] "f:valueFrom": {
2021-07-19T10:17:36.5473073Z [cluster2] ".": {},
2021-07-19T10:17:36.5473601Z [cluster2] "f:fieldRef": {
2021-07-19T10:17:36.5474145Z [cluster2] ".": {},
2021-07-19T10:17:36.5474813Z [cluster2] "f:apiVersion": {},
2021-07-19T10:17:36.5475501Z [cluster2] "f:fieldPath": {}
2021-07-19T10:17:36.5476047Z [cluster2] }
2021-07-19T10:17:36.5476513Z [cluster2] }
2021-07-19T10:17:36.5476987Z [cluster2] }
2021-07-19T10:17:36.5477439Z [cluster2] },
2021-07-19T10:17:36.5477933Z [cluster2] "f:image": {},
2021-07-19T10:17:36.5478531Z [cluster2] "f:imagePullPolicy": {},
2021-07-19T10:17:36.5479137Z [cluster2] "f:name": {},
2021-07-19T10:17:36.5479682Z [cluster2] "f:resources": {},
2021-07-19T10:17:36.5480376Z [cluster2] "f:terminationMessagePath": {},
2021-07-19T10:17:36.5481254Z [cluster2] "f:terminationMessagePolicy": {}
2021-07-19T10:17:36.5481922Z [cluster2] }
2021-07-19T10:17:36.5482377Z [cluster2] },
2021-07-19T10:17:36.5482928Z [cluster2] "f:dnsPolicy": {},
2021-07-19T10:17:36.5483588Z [cluster2] "f:enableServiceLinks": {},
2021-07-19T10:17:36.5484255Z [cluster2] "f:restartPolicy": {},
2021-07-19T10:17:36.5484881Z [cluster2] "f:schedulerName": {},
2021-07-19T10:17:36.5485524Z [cluster2] "f:securityContext": {},
2021-07-19T10:17:36.5486166Z [cluster2] "f:serviceAccount": {},
2021-07-19T10:17:36.5486857Z [cluster2] "f:serviceAccountName": {},
2021-07-19T10:17:36.5487736Z [cluster2] "f:terminationGracePeriodSeconds": {}
2021-07-19T10:17:36.5488481Z [cluster2] }
2021-07-19T10:17:36.5488904Z [cluster2] },
2021-07-19T10:17:36.5490170Z [cluster2] "manager": "kube-controller-manager",
2021-07-19T10:17:36.5490903Z [cluster2] "operation": "Update",
2021-07-19T10:17:36.5491674Z [cluster2] "time": "2021-07-19T10:15:59Z"
2021-07-19T10:17:36.5492160Z [cluster2] },
2021-07-19T10:17:36.5492570Z [cluster2] {
2021-07-19T10:17:36.5493071Z [cluster2] "apiVersion": "v1",
2021-07-19T10:17:36.5493660Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:36.5494241Z [cluster2] "fieldsV1": {
2021-07-19T10:17:36.5494743Z [cluster2] "f:status": {
2021-07-19T10:17:36.5495275Z [cluster2] "f:conditions": {
2021-07-19T10:17:36.5495910Z [cluster2] "k:{\"type\":\"ContainersReady\"}": {
2021-07-19T10:17:36.5496514Z [cluster2] ".": {},
2021-07-19T10:17:36.5497059Z [cluster2] "f:lastProbeTime": {},
2021-07-19T10:17:36.5497859Z [cluster2] "f:lastTransitionTime": {},
2021-07-19T10:17:36.5498492Z [cluster2] "f:status": {},
2021-07-19T10:17:36.5498999Z [cluster2] "f:type": {}
2021-07-19T10:17:36.5499481Z [cluster2] },
2021-07-19T10:17:36.5500030Z [cluster2] "k:{\"type\":\"Initialized\"}": {
2021-07-19T10:17:36.5500588Z [cluster2] ".": {},
2021-07-19T10:17:36.5501131Z [cluster2] "f:lastProbeTime": {},
2021-07-19T10:17:36.5501918Z [cluster2] "f:lastTransitionTime": {},
2021-07-19T10:17:36.5502546Z [cluster2] "f:status": {},
2021-07-19T10:17:36.5503051Z [cluster2] "f:type": {}
2021-07-19T10:17:36.5503530Z [cluster2] },
2021-07-19T10:17:36.5504026Z [cluster2] "k:{\"type\":\"Ready\"}": {
2021-07-19T10:17:36.5504561Z [cluster2] ".": {},
2021-07-19T10:17:36.5505109Z [cluster2] "f:lastProbeTime": {},
2021-07-19T10:17:36.5505885Z [cluster2] "f:lastTransitionTime": {},
2021-07-19T10:17:36.5506502Z [cluster2] "f:status": {},
2021-07-19T10:17:36.5507024Z [cluster2] "f:type": {}
2021-07-19T10:17:36.5507508Z [cluster2] }
2021-07-19T10:17:36.5507945Z [cluster2] },
2021-07-19T10:17:36.5508621Z [cluster2] "f:containerStatuses": {},
2021-07-19T10:17:36.5509175Z [cluster2] "f:hostIP": {},
2021-07-19T10:17:36.5509654Z [cluster2] "f:phase": {},
2021-07-19T10:17:36.5510118Z [cluster2] "f:podIP": {},
2021-07-19T10:17:36.5510601Z [cluster2] "f:podIPs": {
2021-07-19T10:17:36.5511052Z [cluster2] ".": {},
2021-07-19T10:17:36.5511515Z [cluster2] "k:{\"ip\":\"10.2.128.4\"}": {
2021-07-19T10:17:36.5519781Z [cluster2] ".": {},
2021-07-19T10:17:36.5520257Z [cluster2] "f:ip": {}
2021-07-19T10:17:36.5520701Z [cluster2] }
2021-07-19T10:17:36.5521103Z [cluster2] },
2021-07-19T10:17:36.5521576Z [cluster2] "f:startTime": {}
2021-07-19T10:17:36.5522225Z [cluster2] }
2021-07-19T10:17:36.5522664Z [cluster2] },
2021-07-19T10:17:36.5523161Z [cluster2] "manager": "kubelet",
2021-07-19T10:17:36.5523756Z [cluster2] "operation": "Update",
2021-07-19T10:17:36.5524755Z [cluster2] "time": "2021-07-19T10:16:01Z"
2021-07-19T10:17:36.5525232Z [cluster2] }
2021-07-19T10:17:36.5525642Z [cluster2] ],
2021-07-19T10:17:36.5526820Z [cluster2] "name": "submariner-operator-5bfdb87494-bpvkg",
2021-07-19T10:17:36.5528041Z [cluster2] "namespace": "submariner-operator",
2021-07-19T10:17:36.5528757Z [cluster2] "ownerReferences": [
2021-07-19T10:17:36.5529296Z [cluster2] {
2021-07-19T10:17:36.5529801Z [cluster2] "apiVersion": "apps/v1",
2021-07-19T10:17:36.5530486Z [cluster2] "blockOwnerDeletion": true,
2021-07-19T10:17:36.5531136Z [cluster2] "controller": true,
2021-07-19T10:17:36.5531725Z [cluster2] "kind": "ReplicaSet",
2021-07-19T10:17:36.5532724Z [cluster2] "name": "submariner-operator-5bfdb87494",
2021-07-19T10:17:36.5533848Z [cluster2] "uid": "6998bc38-a358-4792-9aa6-1bdaea143978"
2021-07-19T10:17:36.5534535Z [cluster2] }
2021-07-19T10:17:36.5534909Z [cluster2] ],
2021-07-19T10:17:36.5535408Z [cluster2] "resourceVersion": "2062",
2021-07-19T10:17:36.5536268Z [cluster2] "uid": "c26cf07a-2f18-4e21-a33a-db956c97d42a"
2021-07-19T10:17:36.5536862Z [cluster2] },
2021-07-19T10:17:36.5537256Z [cluster2] "spec": {
2021-07-19T10:17:36.5537714Z [cluster2] "containers": [
2021-07-19T10:17:36.5538144Z [cluster2] {
2021-07-19T10:17:36.5538572Z [cluster2] "command": [
2021-07-19T10:17:36.5539283Z [cluster2] "submariner-operator",
2021-07-19T10:17:36.5540063Z [cluster2] "-alsologtostderr",
2021-07-19T10:17:36.5540794Z [cluster2] "-v=1"
2021-07-19T10:17:36.5541216Z [cluster2] ],
2021-07-19T10:17:36.5541637Z [cluster2] "env": [
2021-07-19T10:17:36.5542042Z [cluster2] {
2021-07-19T10:17:36.5542547Z [cluster2] "name": "WATCH_NAMESPACE",
2021-07-19T10:17:36.5543830Z [cluster2] "valueFrom": {
2021-07-19T10:17:36.5544362Z [cluster2] "fieldRef": {
2021-07-19T10:17:36.5544889Z [cluster2] "apiVersion": "v1",
2021-07-19T10:17:36.5545546Z [cluster2] "fieldPath": "metadata.namespace"
2021-07-19T10:17:36.5546125Z [cluster2] }
2021-07-19T10:17:36.5546543Z [cluster2] }
2021-07-19T10:17:36.5546954Z [cluster2] },
2021-07-19T10:17:36.5547346Z [cluster2] {
2021-07-19T10:17:36.5548011Z [cluster2] "name": "POD_NAME",
2021-07-19T10:17:36.5548549Z [cluster2] "valueFrom": {
2021-07-19T10:17:36.5549093Z [cluster2] "fieldRef": {
2021-07-19T10:17:36.5549645Z [cluster2] "apiVersion": "v1",
2021-07-19T10:17:36.5550414Z [cluster2] "fieldPath": "metadata.name"
2021-07-19T10:17:36.5550982Z [cluster2] }
2021-07-19T10:17:36.5551426Z [cluster2] }
2021-07-19T10:17:36.5551946Z [cluster2] },
2021-07-19T10:17:36.5552385Z [cluster2] {
2021-07-19T10:17:36.5552915Z [cluster2] "name": "OPERATOR_NAME",
2021-07-19T10:17:36.5553853Z [cluster2] "value": "submariner-operator"
2021-07-19T10:17:36.5554463Z [cluster2] }
2021-07-19T10:17:36.5554885Z [cluster2] ],
2021-07-19T10:17:36.5555761Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-19T10:17:36.5556619Z [cluster2] "imagePullPolicy": "IfNotPresent",
2021-07-19T10:17:36.5557570Z [cluster2] "name": "submariner-operator",
2021-07-19T10:17:36.5558203Z [cluster2] "resources": {},
2021-07-19T10:17:36.5560344Z [cluster2] "terminationMessagePath": "/dev/termination-log",
2021-07-19T10:17:36.5561408Z [cluster2] "terminationMessagePolicy": "File",
2021-07-19T10:17:36.5562279Z [cluster2] "volumeMounts": [
2021-07-19T10:17:36.5562792Z [cluster2] {
2021-07-19T10:17:36.5563505Z [cluster2] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T10:17:36.5564829Z [cluster2] "name": "submariner-operator-token-sn4cf",
2021-07-19T10:17:36.5565659Z [cluster2] "readOnly": true
2021-07-19T10:17:36.5566606Z [cluster2] }
2021-07-19T10:17:36.5567046Z [cluster2] ]
2021-07-19T10:17:36.5567575Z [cluster2] }
2021-07-19T10:17:36.5567983Z [cluster2] ],
2021-07-19T10:17:36.5568531Z [cluster2] "dnsPolicy": "ClusterFirst",
2021-07-19T10:17:36.5569239Z [cluster2] "enableServiceLinks": true,
2021-07-19T10:17:36.5570156Z [cluster2] "nodeName": "cluster2-worker",
2021-07-19T10:17:36.5571016Z [cluster2] "preemptionPolicy": "PreemptLowerPriority",
2021-07-19T10:17:36.5571759Z [cluster2] "priority": 0,
2021-07-19T10:17:36.5572429Z [cluster2] "restartPolicy": "Always",
2021-07-19T10:17:36.5573559Z [cluster2] "schedulerName": "default-scheduler",
2021-07-19T10:17:36.5574408Z [cluster2] "securityContext": {},
2021-07-19T10:17:36.5575299Z [cluster2] "serviceAccount": "submariner-operator",
2021-07-19T10:17:36.5576870Z [cluster2] "serviceAccountName": "submariner-operator",
2021-07-19T10:17:36.5578556Z [cluster2] "terminationGracePeriodSeconds": 30,
2021-07-19T10:17:36.5580555Z [cluster2] "tolerations": [
2021-07-19T10:17:36.5582205Z [cluster2] {
2021-07-19T10:17:36.5582935Z [cluster2] "effect": "NoExecute",
2021-07-19T10:17:36.5585161Z [cluster2] "key": "node.kubernetes.io/not-ready",
2021-07-19T10:17:36.5586685Z [cluster2] "operator": "Exists",
2021-07-19T10:17:36.5587497Z [cluster2] "tolerationSeconds": 300
2021-07-19T10:17:36.5588354Z [cluster2] },
2021-07-19T10:17:36.5588924Z [cluster2] {
2021-07-19T10:17:36.5589441Z [cluster2] "effect": "NoExecute",
2021-07-19T10:17:36.5590568Z [cluster2] "key": "node.kubernetes.io/unreachable",
2021-07-19T10:17:36.5591296Z [cluster2] "operator": "Exists",
2021-07-19T10:17:36.5593126Z [cluster2] "tolerationSeconds": 300
2021-07-19T10:17:36.5593686Z [cluster2] }
2021-07-19T10:17:36.5594091Z [cluster2] ],
2021-07-19T10:17:36.5594545Z [cluster2] "volumes": [
2021-07-19T10:17:36.5594993Z [cluster2] {
2021-07-19T10:17:36.5596044Z [cluster2] "name": "submariner-operator-token-sn4cf",
2021-07-19T10:17:36.5596831Z [cluster2] "secret": {
2021-07-19T10:17:36.5597368Z [cluster2] "defaultMode": 420,
2021-07-19T10:17:36.5598432Z [cluster2] "secretName": "submariner-operator-token-sn4cf"
2021-07-19T10:17:36.5599889Z [cluster2] }
2021-07-19T10:17:36.5600309Z [cluster2] }
2021-07-19T10:17:36.5600688Z [cluster2] ]
2021-07-19T10:17:36.5601248Z [cluster2] },
2021-07-19T10:17:36.5601645Z [cluster2] "status": {
2021-07-19T10:17:36.5602106Z [cluster2] "conditions": [
2021-07-19T10:17:36.5602528Z [cluster2] {
2021-07-19T10:17:36.5603726Z [cluster2] "lastProbeTime": null,
2021-07-19T10:17:36.5604759Z [cluster2] "lastTransitionTime": "2021-07-19T10:15:59Z",
2021-07-19T10:17:36.5605365Z [cluster2] "status": "True",
2021-07-19T10:17:36.5605890Z [cluster2] "type": "Initialized"
2021-07-19T10:17:36.5606365Z [cluster2] },
2021-07-19T10:17:36.5606753Z [cluster2] {
2021-07-19T10:17:36.5607250Z [cluster2] "lastProbeTime": null,
2021-07-19T10:17:36.5627850Z [cluster2] "lastTransitionTime": "2021-07-19T10:16:01Z",
2021-07-19T10:17:36.5628535Z [cluster2] "status": "True",
2021-07-19T10:17:36.5629250Z [cluster2] "type": "Ready"
2021-07-19T10:17:36.5629719Z [cluster2] },
2021-07-19T10:17:36.5630144Z [cluster2] {
2021-07-19T10:17:36.5630666Z [cluster2] "lastProbeTime": null,
2021-07-19T10:17:36.5632077Z [cluster2] "lastTransitionTime": "2021-07-19T10:16:01Z",
2021-07-19T10:17:36.5632726Z [cluster2] "status": "True",
2021-07-19T10:17:36.5633339Z [cluster2] "type": "ContainersReady"
2021-07-19T10:17:36.5633877Z [cluster2] },
2021-07-19T10:17:36.5634311Z [cluster2] {
2021-07-19T10:17:36.5634851Z [cluster2] "lastProbeTime": null,
2021-07-19T10:17:36.5635761Z [cluster2] "lastTransitionTime": "2021-07-19T10:15:59Z",
2021-07-19T10:17:36.5636508Z [cluster2] "status": "True",
2021-07-19T10:17:36.5637039Z [cluster2] "type": "PodScheduled"
2021-07-19T10:17:36.5637692Z [cluster2] }
2021-07-19T10:17:36.5638103Z [cluster2] ],
2021-07-19T10:17:36.5638649Z [cluster2] "containerStatuses": [
2021-07-19T10:17:36.5639285Z [cluster2] {
2021-07-19T10:17:36.5641002Z [cluster2] "containerID": "containerd://9da9a8e5c7761613efc3bf302281a479bb5beee8eabd4cd45ab9bf9c5dd2d928",
2021-07-19T10:17:36.5643440Z [cluster2] "image": "localhost:5000/submariner-operator:local",
2021-07-19T10:17:36.5645074Z [cluster2] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T10:17:36.5646341Z [cluster2] "lastState": {},
2021-07-19T10:17:36.5648149Z [cluster2] "name": "submariner-operator",
2021-07-19T10:17:36.5648803Z [cluster2] "ready": true,
2021-07-19T10:17:36.5649780Z [cluster2] "restartCount": 0,
2021-07-19T10:17:36.5650325Z [cluster2] "started": true,
2021-07-19T10:17:36.5650848Z [cluster2] "state": {
2021-07-19T10:17:36.5651317Z [cluster2] "running": {
2021-07-19T10:17:36.7726734Z [cluster2] "startedAt": "2 rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7728614Z [submariner-operator]$ [cluster1] kubectl get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7730644Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get rolebindings --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7731880Z [cluster1] NAME ROLE AGE
2021-07-19T10:17:36.7732852Z [cluster1] submariner-operator Role/submariner-operator 4m53s
2021-07-19T10:17:36.7734408Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7736214Z [submariner-operator]$ [cluster1] kubectl get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7738184Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get deployments --namespace=submariner-operator submariner-operator
2021-07-19T10:17:36.7739787Z [cluster1] NAME READY UP-TO-DATE AVAILABLE AGE
2021-07-19T10:17:36.7740724Z [cluster1] submariner-operator 1/1 1 1 4m48s
2021-07-19T10:17:36.7741794Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-19T10:17:36.7742810Z [submariner-operator]$ [cluster1] verify_subm_op_pod
2021-07-19T10:17:36.7744442Z [submariner-operator]$ [cluster1] subm_operator_pod_name=$(kubectl get pods --namespace=$subm_ns -l name=$operator_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T10:17:36.7746565Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.7748933Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.7751272Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l name=submariner-operator -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:36.7753819Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o json
2021-07-19T10:17:36.7756105Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o json
2021-07-19T10:17:36.7758527Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o json
2021-07-19T10:17:36.7759831Z [cluster1] {
2021-07-19T10:17:36.7760314Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:36.7760817Z [cluster1] "kind": "Pod",
2021-07-19T10:17:36.7761316Z [cluster1] "metadata": {
2021-07-19T10:17:36.7762110Z [cluster1] "creationTimestamp": "2021-07-19T10:15:52Z",
2021-07-19T10:17:36.7763262Z [cluster1] "generateName": "submariner-operator-5bfdb87494-",
2021-07-19T10:17:36.7764083Z [cluster1] "labels": {
2021-07-19T10:17:36.7764868Z [cluster1] "name": "submariner-operator",
2021-07-19T10:17:36.7765794Z [cluster1] "pod-template-hash": "5bfdb87494"
2021-07-19T10:17:36.7766361Z [cluster1] },
2021-07-19T10:17:36.7766972Z [cluster1] "managedFields": [
2021-07-19T10:17:36.7767464Z [cluster1] {
2021-07-19T10:17:36.7767962Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:36.7768556Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:36.7769133Z [cluster1] "fieldsV1": {
2021-07-19T10:17:36.7769645Z [cluster1] "f:metadata": {
2021-07-19T10:17:36.7770220Z [cluster1] "f:generateName": {},
2021-07-19T10:17:36.7770775Z [cluster1] "f:labels": {
2021-07-19T10:17:36.7771265Z [cluster1] ".": {},
2021-07-19T10:17:36.7771753Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7772546Z [cluster1] "f:pod-template-hash": {}
2021-07-19T10:17:36.7773124Z [cluster1] },
2021-07-19T10:17:36.7773676Z [cluster1] "f:ownerReferences": {
2021-07-19T10:17:36.7774240Z [cluster1] ".": {},
2021-07-19T10:17:36.7775121Z [cluster1] "k:{\"uid\":\"2f181157-5b3f-424a-a083-dd14cde0ced8\"}": {
2021-07-19T10:17:36.7775786Z [cluster1] ".": {},
2021-07-19T10:17:36.7776309Z [cluster1] "f:apiVersion": {},
2021-07-19T10:17:36.7776980Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-19T10:17:36.7777652Z [cluster1] "f:controller": {},
2021-07-19T10:17:36.7778176Z [cluster1] "f:kind": {},
2021-07-19T10:17:36.7778679Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7779165Z [cluster1] "f:uid": {}
2021-07-19T10:17:36.7779634Z [cluster1] }
2021-07-19T10:17:36.7780069Z [cluster1] }
2021-07-19T10:17:36.7780509Z [cluster1] },
2021-07-19T10:17:36.7780959Z [cluster1] "f:spec": {
2021-07-19T10:17:36.7781499Z [cluster1] "f:containers": {
2021-07-19T10:17:36.7807918Z [cluster1] "k:{\"name\":\"submariner-operator\"}": {
2021-07-19T10:17:36.7808572Z [cluster1] ".": {},
2021-07-19T10:17:36.7809036Z [cluster1] "f:command": {},
2021-07-19T10:17:36.7809522Z [cluster1] "f:env": {
2021-07-19T10:17:36.7810129Z [cluster1] ".": {},
2021-07-19T10:17:36.7810667Z [cluster1] "k:{\"name\":\"OPERATOR_NAME\"}": {
2021-07-19T10:17:36.7811189Z [cluster1] ".": {},
2021-07-19T10:17:36.7811664Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7812156Z [cluster1] "f:value": {}
2021-07-19T10:17:36.7812607Z [cluster1] },
2021-07-19T10:17:36.7813121Z [cluster1] "k:{\"name\":\"POD_NAME\"}": {
2021-07-19T10:17:36.7813610Z [cluster1] ".": {},
2021-07-19T10:17:36.7814077Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7814579Z [cluster1] "f:valueFrom": {
2021-07-19T10:17:36.7815083Z [cluster1] ".": {},
2021-07-19T10:17:36.7815566Z [cluster1] "f:fieldRef": {
2021-07-19T10:17:36.7816066Z [cluster1] ".": {},
2021-07-19T10:17:36.7816589Z [cluster1] "f:apiVersion": {},
2021-07-19T10:17:36.7817141Z [cluster1] "f:fieldPath": {}
2021-07-19T10:17:36.7817640Z [cluster1] }
2021-07-19T10:17:36.7818066Z [cluster1] }
2021-07-19T10:17:36.7818583Z [cluster1] },
2021-07-19T10:17:36.7819160Z [cluster1] "k:{\"name\":\"WATCH_NAMESPACE\"}": {
2021-07-19T10:17:36.7819700Z [cluster1] ".": {},
2021-07-19T10:17:36.7820167Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7820665Z [cluster1] "f:valueFrom": {
2021-07-19T10:17:36.7821166Z [cluster1] ".": {},
2021-07-19T10:17:36.7821651Z [cluster1] "f:fieldRef": {
2021-07-19T10:17:36.7822153Z [cluster1] ".": {},
2021-07-19T10:17:36.7822657Z [cluster1] "f:apiVersion": {},
2021-07-19T10:17:36.7823223Z [cluster1] "f:fieldPath": {}
2021-07-19T10:17:36.7823718Z [cluster1] }
2021-07-19T10:17:36.7824161Z [cluster1] }
2021-07-19T10:17:36.7824597Z [cluster1] }
2021-07-19T10:17:36.7825009Z [cluster1] },
2021-07-19T10:17:36.7825462Z [cluster1] "f:image": {},
2021-07-19T10:17:36.7826010Z [cluster1] "f:imagePullPolicy": {},
2021-07-19T10:17:36.7826563Z [cluster1] "f:name": {},
2021-07-19T10:17:36.7827051Z [cluster1] "f:resources": {},
2021-07-19T10:17:36.7827711Z [cluster1] "f:terminationMessagePath": {},
2021-07-19T10:17:36.7828513Z [cluster1] "f:terminationMessagePolicy": {}
2021-07-19T10:17:36.7829317Z [cluster1] }
2021-07-19T10:17:36.7829766Z [cluster1] },
2021-07-19T10:17:36.7830259Z [cluster1] "f:dnsPolicy": {},
2021-07-19T10:17:36.7830915Z [cluster1] "f:enableServiceLinks": {},
2021-07-19T10:17:36.7831588Z [cluster1] "f:restartPolicy": {},
2021-07-19T10:17:36.7832356Z [cluster1] "f:schedulerName": {},
2021-07-19T10:17:36.7832991Z [cluster1] "f:securityContext": {},
2021-07-19T10:17:36.7833716Z [cluster1] "f:serviceAccount": {},
2021-07-19T10:17:36.7834397Z [cluster1] "f:serviceAccountName": {},
2021-07-19T10:17:36.7835291Z [cluster1] "f:terminationGracePeriodSeconds": {}
2021-07-19T10:17:36.7836035Z [cluster1] }
2021-07-19T10:17:36.7836454Z [cluster1] },
2021-07-19T10:17:36.7837403Z [cluster1] "manager": "kube-controller-manager",
2021-07-19T10:17:36.7838133Z [cluster1] "operation": "Update",
2021-07-19T10:17:36.7838958Z [cluster1] "time": "2021-07-19T10:15:52Z"
2021-07-19T10:17:36.7839424Z [cluster1] },
2021-07-19T10:17:36.7839850Z [cluster1] {
2021-07-19T10:17:36.7840331Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:36.7841011Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:36.7841537Z [cluster1] "fieldsV1": {
2021-07-19T10:17:36.7842007Z [cluster1] "f:status": {
2021-07-19T10:17:36.7842509Z [cluster1] "f:conditions": {
2021-07-19T10:17:36.7843097Z [cluster1] "k:{\"type\":\"ContainersReady\"}": {
2021-07-19T10:17:36.7843652Z [cluster1] ".": {},
2021-07-19T10:17:36.7844162Z [cluster1] "f:lastProbeTime": {},
2021-07-19T10:17:36.7844802Z [cluster1] "f:lastTransitionTime": {},
2021-07-19T10:17:36.7845378Z [cluster1] "f:status": {},
2021-07-19T10:17:36.7845944Z [cluster1] "f:type": {}
2021-07-19T10:17:36.7846372Z [cluster1] },
2021-07-19T10:17:36.7846887Z [cluster1] "k:{\"type\":\"Initialized\"}": {
2021-07-19T10:17:36.7847403Z [cluster1] ".": {},
2021-07-19T10:17:36.7847905Z [cluster1] "f:lastProbeTime": {},
2021-07-19T10:17:36.7848660Z [cluster1] "f:lastTransitionTime": {},
2021-07-19T10:17:36.7849232Z [cluster1] "f:status": {},
2021-07-19T10:17:36.7849715Z [cluster1] "f:type": {}
2021-07-19T10:17:36.7850843Z [cluster1] },
2021-07-19T10:17:36.7851329Z [cluster1] "k:{\"type\":\"Ready\"}": {
2021-07-19T10:17:36.7851801Z [cluster1] ".": {},
2021-07-19T10:17:36.7852326Z [cluster1] "f:lastProbeTime": {},
2021-07-19T10:17:36.7852974Z [cluster1] "f:lastTransitionTime": {},
2021-07-19T10:17:36.7853548Z [cluster1] "f:status": {},
2021-07-19T10:17:36.7854032Z [cluster1] "f:type": {}
2021-07-19T10:17:36.7854467Z [cluster1] }
2021-07-19T10:17:36.7854882Z [cluster1] },
2021-07-19T10:17:36.7855411Z [cluster1] "f:containerStatuses": {},
2021-07-19T10:17:36.7856269Z [cluster1] "f:hostIP": {},
2021-07-19T10:17:36.7856784Z [cluster1] "f:phase": {},
2021-07-19T10:17:36.7857306Z [cluster1] "f:podIP": {},
2021-07-19T10:17:36.7857828Z [cluster1] "f:podIPs": {
2021-07-19T10:17:36.7858307Z [cluster1] ".": {},
2021-07-19T10:17:36.7858810Z [cluster1] "k:{\"ip\":\"10.1.128.4\"}": {
2021-07-19T10:17:36.7859303Z [cluster1] ".": {},
2021-07-19T10:17:36.7859788Z [cluster1] "f:ip": {}
2021-07-19T10:17:36.7860310Z [cluster1] }
2021-07-19T10:17:36.7860758Z [cluster1] },
2021-07-19T10:17:36.7861248Z [cluster1] "f:startTime": {}
2021-07-19T10:17:36.7861743Z [cluster1] }
2021-07-19T10:17:36.7862178Z [cluster1] },
2021-07-19T10:17:36.7862769Z [cluster1] "manager": "kubelet",
2021-07-19T10:17:36.7863361Z [cluster1] "operation": "Update",
2021-07-19T10:17:36.7864189Z [cluster1] "time": "2021-07-19T10:15:54Z"
2021-07-19T10:17:36.7864669Z [cluster1] }
2021-07-19T10:17:36.7865083Z [cluster1] ],
2021-07-19T10:17:36.7866097Z [cluster1] "name": "submariner-operator-5bfdb87494-bdsp5",
2021-07-19T10:17:36.7867272Z [cluster1] "namespace": "submariner-operator",
2021-07-19T10:17:36.7868008Z [cluster1] "ownerReferences": [
2021-07-19T10:17:36.7868524Z [cluster1] {
2021-07-19T10:17:36.7869041Z [cluster1] "apiVersion": "apps/v1",
2021-07-19T10:17:36.7869803Z [cluster1] "blockOwnerDeletion": true,
2021-07-19T10:17:36.7870404Z [cluster1] "controller": true,
2021-07-19T10:17:36.7870948Z [cluster1] "kind": "ReplicaSet",
2021-07-19T10:17:36.7893588Z [cluster1] "name": "submariner-operator-5bfdb87494",
2021-07-19T10:17:36.7895044Z [cluster1] "uid": "2f181157-5b3f-424a-a083-dd14cde0ced8"
2021-07-19T10:17:36.7895657Z [cluster1] }
2021-07-19T10:17:36.7896088Z [cluster1] ],
2021-07-19T10:17:36.7896615Z [cluster1] "resourceVersion": "2135",
2021-07-19T10:17:36.7897541Z [cluster1] "uid": "76b804e2-7522-41da-8bf1-e07eccd16f6f"
2021-07-19T10:17:36.7898201Z [cluster1] },
2021-07-19T10:17:36.7898609Z [cluster1] "spec": {
2021-07-19T10:17:36.7899228Z [cluster1] "containers": [
2021-07-19T10:17:36.7899658Z [cluster1] {
2021-07-19T10:17:36.7900090Z [cluster1] "command": [
2021-07-19T10:17:36.7900829Z [cluster1] "submariner-operator",
2021-07-19T10:17:36.7901613Z [cluster1] "-alsologtostderr",
2021-07-19T10:17:36.7902259Z [cluster1] "-v=1"
2021-07-19T10:17:36.7902676Z [cluster1] ],
2021-07-19T10:17:36.7903092Z [cluster1] "env": [
2021-07-19T10:17:36.7903518Z [cluster1] {
2021-07-19T10:17:36.7904016Z [cluster1] "name": "WATCH_NAMESPACE",
2021-07-19T10:17:36.7904728Z [cluster1] "valueFrom": {
2021-07-19T10:17:36.7905244Z [cluster1] "fieldRef": {
2021-07-19T10:17:36.7905763Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:36.7906430Z [cluster1] "fieldPath": "metadata.namespace"
2021-07-19T10:17:36.7907014Z [cluster1] }
2021-07-19T10:17:36.7907434Z [cluster1] }
2021-07-19T10:17:36.7907834Z [cluster1] },
2021-07-19T10:17:36.7908319Z [cluster1] {
2021-07-19T10:17:36.7908776Z [cluster1] "name": "POD_NAME",
2021-07-19T10:17:36.7909285Z [cluster1] "valueFrom": {
2021-07-19T10:17:36.7909783Z [cluster1] "fieldRef": {
2021-07-19T10:17:36.7910314Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:36.7910928Z [cluster1] "fieldPath": "metadata.name"
2021-07-19T10:17:36.7911460Z [cluster1] }
2021-07-19T10:17:36.7912324Z [cluster1] }
2021-07-19T10:17:36.7912761Z [cluster1] },
2021-07-19T10:17:36.7913196Z [cluster1] {
2021-07-19T10:17:36.7913719Z [cluster1] "name": "OPERATOR_NAME",
2021-07-19T10:17:36.7914733Z [cluster1] "value": "submariner-operator"
2021-07-19T10:17:36.7915336Z [cluster1] }
2021-07-19T10:17:36.7915771Z [cluster1] ],
2021-07-19T10:17:36.7916702Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-19T10:17:36.7917573Z [cluster1] "imagePullPolicy": "IfNotPresent",
2021-07-19T10:17:36.7918726Z [cluster1] "name": "submariner-operator",
2021-07-19T10:17:36.7919367Z [cluster1] "resources": {},
2021-07-19T10:17:36.7920361Z [cluster1] "terminationMessagePath": "/dev/termination-log",
2021-07-19T10:17:36.7921325Z [cluster1] "terminationMessagePolicy": "File",
2021-07-19T10:17:36.7922071Z [cluster1] "volumeMounts": [
2021-07-19T10:17:36.7922564Z [cluster1] {
2021-07-19T10:17:36.7923386Z [cluster1] "mountPath": "/var/run/secrets/kubernetes.io/serviceaccount",
2021-07-19T10:17:36.7924559Z [cluster1] "name": "submariner-operator-token-fhwmk",
2021-07-19T10:17:36.7925326Z [cluster1] "readOnly": true
2021-07-19T10:17:36.7925790Z [cluster1] }
2021-07-19T10:17:36.7926179Z [cluster1] ]
2021-07-19T10:17:36.7926577Z [cluster1] }
2021-07-19T10:17:36.7926952Z [cluster1] ],
2021-07-19T10:17:36.7927463Z [cluster1] "dnsPolicy": "ClusterFirst",
2021-07-19T10:17:36.7928102Z [cluster1] "enableServiceLinks": true,
2021-07-19T10:17:36.7928923Z [cluster1] "nodeName": "cluster1-worker",
2021-07-19T10:17:36.7929709Z [cluster1] "preemptionPolicy": "PreemptLowerPriority",
2021-07-19T10:17:36.7930405Z [cluster1] "priority": 0,
2021-07-19T10:17:36.7930939Z [cluster1] "restartPolicy": "Always",
2021-07-19T10:17:36.7931768Z [cluster1] "schedulerName": "default-scheduler",
2021-07-19T10:17:36.7932558Z [cluster1] "securityContext": {},
2021-07-19T10:17:36.7933422Z [cluster1] "serviceAccount": "submariner-operator",
2021-07-19T10:17:36.7934456Z [cluster1] "serviceAccountName": "submariner-operator",
2021-07-19T10:17:36.7935370Z [cluster1] "terminationGracePeriodSeconds": 30,
2021-07-19T10:17:36.7936098Z [cluster1] "tolerations": [
2021-07-19T10:17:36.7936540Z [cluster1] {
2021-07-19T10:17:36.7937025Z [cluster1] "effect": "NoExecute",
2021-07-19T10:17:36.7937831Z [cluster1] "key": "node.kubernetes.io/not-ready",
2021-07-19T10:17:36.7938481Z [cluster1] "operator": "Exists",
2021-07-19T10:17:36.7939063Z [cluster1] "tolerationSeconds": 300
2021-07-19T10:17:36.7939563Z [cluster1] },
2021-07-19T10:17:36.7939960Z [cluster1] {
2021-07-19T10:17:36.7940422Z [cluster1] "effect": "NoExecute",
2021-07-19T10:17:36.7941100Z [cluster1] "key": "node.kubernetes.io/unreachable",
2021-07-19T10:17:36.7941747Z [cluster1] "operator": "Exists",
2021-07-19T10:17:36.7942331Z [cluster1] "tolerationSeconds": 300
2021-07-19T10:17:36.7942830Z [cluster1] }
2021-07-19T10:17:36.7943220Z [cluster1] ],
2021-07-19T10:17:36.7943626Z [cluster1] "volumes": [
2021-07-19T10:17:36.7944047Z [cluster1] {
2021-07-19T10:17:36.7944935Z [cluster1] "name": "submariner-operator-token-fhwmk",
2021-07-19T10:17:36.7945664Z [cluster1] "secret": {
2021-07-19T10:17:36.7946165Z [cluster1] "defaultMode": 420,
2021-07-19T10:17:36.7947144Z [cluster1] "secretName": "submariner-operator-token-fhwmk"
2021-07-19T10:17:36.7947893Z [cluster1] }
2021-07-19T10:17:36.7948278Z [cluster1] }
2021-07-19T10:17:36.7948672Z [cluster1] ]
2021-07-19T10:17:36.7949042Z [cluster1] },
2021-07-19T10:17:36.7949458Z [cluster1] "status": {
2021-07-19T10:17:36.7949903Z [cluster1] "conditions": [
2021-07-19T10:17:36.7950344Z [cluster1] {
2021-07-19T10:17:36.7950823Z [cluster1] "lastProbeTime": null,
2021-07-19T10:17:36.7951654Z [cluster1] "lastTransitionTime": "2021-07-19T10:15:52Z",
2021-07-19T10:17:36.7961774Z [cluster1] "status": "True",
2021-07-19T10:17:36.7962355Z [cluster1] "type": "Initialized"
2021-07-19T10:17:36.7963164Z [cluster1] },
2021-07-19T10:17:36.7963591Z [cluster1] {
2021-07-19T10:17:36.7964127Z [cluster1] "lastProbeTime": null,
2021-07-19T10:17:36.7965189Z [cluster1] "lastTransitionTime": "2021-07-19T10:15:54Z",
2021-07-19T10:17:36.7965835Z [cluster1] "status": "True",
2021-07-19T10:17:36.7966348Z [cluster1] "type": "Ready"
2021-07-19T10:17:36.7966822Z [cluster1] },
2021-07-19T10:17:36.7967230Z [cluster1] {
2021-07-19T10:17:36.7967785Z [cluster1] "lastProbeTime": null,
2021-07-19T10:17:36.7968685Z [cluster1] "lastTransitionTime": "2021-07-19T10:15:54Z",
2021-07-19T10:17:36.7969311Z [cluster1] "status": "True",
2021-07-19T10:17:36.7969919Z [cluster1] "type": "ContainersReady"
2021-07-19T10:17:36.7970461Z [cluster1] },
2021-07-19T10:17:36.7970886Z [cluster1] {
2021-07-19T10:17:36.7971409Z [cluster1] "lastProbeTime": null,
2021-07-19T10:17:36.7972298Z [cluster1] "lastTransitionTime": "2021-07-19T10:15:52Z",
2021-07-19T10:17:36.7972930Z [cluster1] "status": "True",
2021-07-19T10:17:36.7973513Z [cluster1] "type": "PodScheduled"
2021-07-19T10:17:36.7974025Z [cluster1] }
2021-07-19T10:17:36.7974448Z [cluster1] ],
2021-07-19T10:17:36.7974988Z [cluster1] "containerStatuses": [
2021-07-19T10:17:36.7975515Z [cluster1] {
2021-07-19T10:17:36.7977135Z [cluster1] "containerID": "containerd://61236b5762620656d1c37a459e0509946266037447beb8ceefa864c166b2b0ed",
2021-07-19T10:17:36.7979100Z [cluster1] "image": "localhost:5000/submariner-operator:local",
2021-07-19T10:17:36.7980742Z [cluster1] "imageID": "localhost:5000/submariner-operator@sha256:4fc688208e3986e77644027577c7d3896e83b320cc64da4dcdbe1f94adcbda8b",
2021-07-19T10:17:36.7981885Z [cluster1] "lastState": {},
2021-07-19T10:17:36.7982723Z [cluster1] "name": "submariner-operator",
2021-07-19T10:17:36.7983368Z [cluster1] "ready": true,
2021-07-19T10:17:36.7983903Z [cluster1] "restartCount": 0,
2021-07-19T10:17:36.7984463Z [cluster1] "started": true,
2021-07-19T10:17:36.7984957Z [cluster1] "state": {
2021-07-19T10:17:36.7985447Z [cluster1] "running": {
2021-07-19T10:17:37.4226414Z [cluster1] "startedAt": "2021-07-19T10:16:00Z"
2021-07-19T10:17:37.4227020Z [cluster2] }
2021-07-19T10:17:37.4227449Z [cluster2] }
2021-07-19T10:17:37.4227879Z [cluster2] }
2021-07-19T10:17:37.4228303Z [cluster2] ],
2021-07-19T10:17:37.4228756Z [cluster2] "hostIP": "172.18.0.5",
2021-07-19T10:17:37.4229281Z [cluster2] "phase": "Running",
2021-07-19T10:17:37.4229787Z [cluster2] "podIP": "10.2.128.4",
2021-07-19T10:17:37.4230288Z [cluster2] "podIPs": [
2021-07-19T10:17:37.4230733Z [cluster2] {
2021-07-19T10:17:37.4231186Z [cluster2] "ip": "10.2.128.4"
2021-07-19T10:17:37.4231623Z [cluster2] }
2021-07-19T10:17:37.4232184Z [cluster2] ],
2021-07-19T10:17:37.4232688Z [cluster2] "qosClass": "BestEffort",
2021-07-19T10:17:37.4233498Z [cluster2] "startTime": "2021-07-19T10:15:59Z"
2021-07-19T10:17:37.4234077Z [cluster2] }
2021-07-19T10:17:37.4234458Z [cluster2] }
2021-07-19T10:17:37.4236188Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.4238687Z [submariner-operator]$ [cluster2] kubectl get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.4241556Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get pod submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.4243936Z [submariner-operator]$ [cluster2] grep Running
2021-07-19T10:17:37.4244574Z [cluster2] Running
2021-07-19T10:17:37.4246065Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator
2021-07-19T10:17:37.4248261Z [submariner-operator]$ [cluster2] kubectl logs submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator
2021-07-19T10:17:37.4250619Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 logs submariner-operator-5bfdb87494-bpvkg --namespace=submariner-operator
2021-07-19T10:17:37.4252052Z [cluster2] I0719 10:16:00.973203 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-19T10:17:37.4252776Z [cluster2] I0719 10:16:00.973305 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-19T10:17:37.4253788Z [cluster2] I0719 10:16:00.973348 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-19T10:17:37.4254921Z [cluster2] I0719 10:16:00.973366 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-19T10:17:37.4255836Z [cluster2] I0719 10:16:00.973566 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-19T10:17:37.4257332Z [cluster2] I0719 10:16:01.619739 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-cxgjt"
2021-07-19T10:17:37.4258562Z [cluster2] I0719 10:16:01.868462 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.4259540Z [cluster2] I0719 10:16:02.998700 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.4260354Z [cluster2] I0719 10:16:05.388006 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.4261183Z [cluster2] I0719 10:16:09.932751 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.4261985Z [cluster2] I0719 10:16:18.638712 1 leader.go:149] leader "msg"="Became the leader."
2021-07-19T10:17:37.4263318Z [cluster2] I0719 10:16:19.242165 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-19T10:17:37.4264367Z [cluster2] I0719 10:16:19.242671 1 main.go:129] cmd "msg"="Registering Components."
2021-07-19T10:17:37.4265187Z [cluster2] I0719 10:16:19.242856 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-19T10:17:37.4266275Z [cluster2] I0719 10:16:23.633209 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4268125Z [cluster2] I0719 10:16:23.633297 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4269367Z [cluster2] I0719 10:16:23.633376 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-19T10:17:37.4270609Z [cluster2] I0719 10:16:23.633635 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-19T10:17:37.4314803Z [cluster2] I0719 10:16:23.634191 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T10:17:37.4322167Z [cluster2] I0719 10:16:23.634421 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T10:17:37.4327493Z [cluster2] I0719 10:16:23.634613 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T10:17:37.4331525Z [cluster2] I0719 10:16:23.634783 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T10:17:37.4335068Z [cluster2] I0719 10:16:23.634941 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T10:17:37.4337288Z [cluster2] I0719 10:16:23.735808 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.4339277Z [cluster2] I0719 10:16:23.736136 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T10:17:37.4341432Z [cluster2] I0719 10:16:23.736055 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.4343734Z [cluster2] I0719 10:16:23.736183 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T10:17:37.4346636Z [cluster2] I0719 10:16:23.737033 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T10:17:37.4350949Z [cluster2] I0719 10:16:23.737038 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T10:17:37.4355347Z [cluster2] I0719 10:16:23.742239 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T10:17:37.4359302Z [cluster2] I0719 10:16:23.842886 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T10:17:37.4362035Z [cluster2] I0719 10:16:23.843234 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T10:17:37.4363975Z [cluster2] I0719 10:16:23.846294 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-19T10:17:37.4365758Z [cluster2] I0719 10:16:23.946118 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-19T10:17:37.4367497Z [cluster2] I0719 10:16:23.947132 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-19T10:17:37.4369442Z [cluster2] I0719 10:16:23.947397 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T10:17:37.4371727Z [cluster2] I0719 10:16:23.947601 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4373741Z [cluster2] I0719 10:16:23.947621 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-19T10:17:37.4375747Z [cluster2] I0719 10:16:23.949677 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4377252Z [cluster2] I0719 10:16:24.123473 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T10:17:37.4378883Z [cluster2] I0719 10:16:24.123518 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-19T10:17:37.4380512Z [cluster2] I0719 10:16:24.124247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4381906Z [cluster2] I0719 10:16:24.124270 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4383254Z [cluster2] I0719 10:16:24.125273 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T10:17:37.4384992Z [cluster2] I0719 10:16:24.125448 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.2.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.2.0.0/16"]
2021-07-19T10:17:37.4386465Z [cluster2] I0719 10:16:24.125468 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4387976Z [cluster2] I0719 10:16:24.128066 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4390449Z [cluster2] I0719 10:16:24.319580 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4418300Z [cluster2] E0719 10:16:24.321262 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: DaemonSet.apps \"submariner-gateway\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T10:17:37.4421270Z [cluster2] I0719 10:16:24.322143 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4422831Z [cluster2] I0719 10:16:24.322247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4424136Z [cluster2] I0719 10:16:24.322263 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4426468Z [cluster2] I0719 10:16:24.384342 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4430018Z [cluster2] E0719 10:16:24.390234 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-gateway: daemonsets.apps \"submariner-gateway\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T10:17:37.4433454Z [cluster2] I0719 10:16:24.395972 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4435122Z [cluster2] I0719 10:16:24.396080 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4436505Z [cluster2] I0719 10:16:24.396880 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4438994Z [cluster2] I0719 10:16:24.415625 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4442245Z [cluster2] I0719 10:16:24.993182 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4446037Z [cluster2] E0719 10:16:25.171533 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T10:17:37.4449225Z [cluster2] I0719 10:16:25.185385 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4450891Z [cluster2] I0719 10:16:25.185566 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4452291Z [cluster2] I0719 10:16:25.185643 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4454857Z [cluster2] I0719 10:16:25.212794 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4458092Z [cluster2] I0719 10:16:25.216729 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4461321Z [cluster2] I0719 10:16:25.606438 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4464497Z [cluster2] I0719 10:16:25.623537 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4468394Z [cluster2] E0719 10:16:25.623592 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating DaemonSet submariner-operator/submariner-routeagent: DaemonSet.apps \"submariner-routeagent\" not found" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T10:17:37.4471605Z [cluster2] I0719 10:16:25.638890 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4473416Z [cluster2] I0719 10:16:25.638949 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4474811Z [cluster2] I0719 10:16:25.638960 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4477320Z [cluster2] I0719 10:16:25.802864 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4480498Z [cluster2] I0719 10:16:25.885294 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4483759Z [cluster2] I0719 10:16:26.127428 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4487045Z [cluster2] I0719 10:16:26.238700 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4490018Z [cluster2] I0719 10:16:26.449073 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4492930Z [cluster2] I0719 10:16:26.449802 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T10:17:37.4495812Z [cluster2] I0719 10:16:26.505791 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4498850Z [cluster2] I0719 10:16:26.916881 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4502293Z [cluster2] I0719 10:16:26.948677 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4505227Z [cluster2] I0719 10:16:27.042517 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4506884Z [cluster2] I0719 10:16:27.042560 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4508272Z [cluster2] I0719 10:16:27.042571 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4511631Z [cluster2] E0719 10:16:27.071281 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-19T10:17:37.4551655Z [cluster2] I0719 10:16:27.071338 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4555123Z [cluster2] I0719 10:16:27.151355 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4559887Z [cluster2] E0719 10:16:27.151418 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-agent-metrics: Service \"submariner-lighthouse-agent-metrics\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.4564050Z [cluster2] I0719 10:16:27.157334 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4567421Z [cluster2] I0719 10:16:27.234384 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4570879Z [cluster2] I0719 10:16:27.234851 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4574091Z [cluster2] I0719 10:16:27.235418 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4577607Z [cluster2] I0719 10:16:27.587604 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4581660Z [cluster2] E0719 10:16:27.588041 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4584706Z [cluster2] I0719 10:16:27.588080 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4586266Z [cluster2] I0719 10:16:27.588110 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4587792Z [cluster2] I0719 10:16:27.588119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4590622Z [cluster2] I0719 10:16:27.705942 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4594243Z [cluster2] I0719 10:16:27.731677 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4597572Z [cluster2] I0719 10:16:27.744535 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4608493Z [cluster2] I0719 10:16:27.747014 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4612289Z [cluster2] I0719 10:16:27.856879 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4615735Z [cluster2] I0719 10:16:28.315628 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4619149Z [cluster2] I0719 10:16:28.359310 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4622425Z [cluster2] I0719 10:16:28.359695 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4625964Z [cluster2] I0719 10:16:28.471301 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T10:17:37.4629553Z [cluster2] I0719 10:16:28.489314 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4632944Z [cluster2] I0719 10:16:28.524449 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4636558Z [cluster2] I0719 10:16:28.525372 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4640065Z [cluster2] I0719 10:16:28.587048 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4643882Z [cluster2] E0719 10:16:28.613757 1 servicediscovery_controller.go:151] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS configMap" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists"
2021-07-19T10:17:37.4648016Z [cluster2] E0719 10:16:28.623329 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating ConfigMap submariner-operator/submariner-lighthouse-coredns: configmaps \"submariner-lighthouse-coredns\" already exists" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-19T10:17:37.4660311Z [cluster2] I0719 10:16:28.623370 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4666850Z [cluster2] I0719 10:16:28.763881 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4670734Z [cluster2] I0719 10:16:28.765990 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4672878Z [cluster2] I0719 10:16:28.766021 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4674269Z [cluster2] I0719 10:16:28.766031 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4678064Z [cluster2] I0719 10:16:28.828768 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4681783Z [cluster2] I0719 10:16:28.881084 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4687167Z [cluster2] E0719 10:16:28.881132 1 servicediscovery_controller.go:169] controller_servicediscovery "msg"="Error creating the lighthouseCoreDNS service" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found"
2021-07-19T10:17:37.4691798Z [cluster2] E0719 10:16:28.881188 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns: Service \"submariner-lighthouse-coredns\" not found" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.4697252Z [cluster2] E0719 10:16:28.888418 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4700352Z [cluster2] I0719 10:16:28.888460 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4701910Z [cluster2] I0719 10:16:28.888491 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.4703205Z [cluster2] I0719 10:16:28.888508 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.4706387Z [cluster2] I0719 10:16:28.891275 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4710621Z [cluster2] I0719 10:16:28.930424 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4714831Z [cluster2] I0719 10:16:29.083488 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4785612Z [cluster2] I0719 10:16:29.098050 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4788870Z [cluster2] I0719 10:16:29.286903 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4792428Z [cluster2] I0719 10:16:29.570698 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4795826Z [cluster2] I0719 10:16:29.650136 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4798854Z [cluster2] I0719 10:16:29.757260 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4801838Z [cluster2] I0719 10:16:29.892880 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4805400Z [cluster2] I0719 10:16:29.940840 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4808933Z [cluster2] I0719 10:16:30.167071 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4812532Z [cluster2] I0719 10:16:30.207738 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4816055Z [cluster2] I0719 10:16:30.276642 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4863104Z [cluster2] I0719 10:16:30.502810 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4866613Z [cluster2] I0719 10:16:30.597638 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4871002Z [cluster2] E0719 10:16:30.866550 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.4876035Z [cluster2] I0719 10:16:30.866876 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.4879134Z [cluster2] I0719 10:16:30.886601 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4882413Z [cluster2] I0719 10:16:31.043412 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4886176Z [cluster2] I0719 10:16:31.166932 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4889629Z [cluster2] I0719 10:16:31.348746 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4892708Z [cluster2] I0719 10:16:31.377371 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4912307Z [cluster2] I0719 10:16:31.377425 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.4916142Z [cluster2] I0719 10:16:31.445987 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.4919284Z [cluster2] I0719 10:16:31.514048 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4922908Z [cluster2] I0719 10:16:31.583378 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4926261Z [cluster2] I0719 10:16:32.162046 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4954058Z [cluster2] I0719 10:16:32.286490 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4958020Z [cluster2] I0719 10:16:32.426777 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4961922Z [cluster2] I0719 10:16:32.647866 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.4965822Z [cluster2] I0719 10:16:32.660899 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4969725Z [cluster2] I0719 10:16:32.886332 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.4974658Z [cluster2] I0719 10:16:33.266082 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.4977973Z [cluster2] I0719 10:16:33.318921 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5027657Z [cluster2] I0719 10:16:33.318965 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.5031764Z [cluster2] I0719 10:16:33.523681 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5034876Z [cluster2] I0719 10:16:33.548370 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5038969Z [cluster2] I0719 10:16:33.548419 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.5042509Z [cluster2] I0719 10:16:34.140316 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5044132Z [cluster2] I0719 10:16:34.140357 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5045422Z [cluster2] I0719 10:16:34.140366 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5047714Z [cluster2] I0719 10:16:34.237243 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5050721Z [cluster2] I0719 10:16:34.268611 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5053702Z [cluster2] I0719 10:16:34.898754 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5057024Z [cluster2] I0719 10:16:34.917038 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5059862Z [cluster2] I0719 10:16:34.965491 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5061583Z [cluster2] I0719 10:16:34.965562 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5063051Z [cluster2] I0719 10:16:34.965573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5082827Z [cluster2] I0719 10:16:34.978250 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5084684Z [cluster2] I0719 10:16:34.978591 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5086173Z [cluster2] I0719 10:16:34.978604 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5088964Z [cluster2] I0719 10:16:35.015855 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5092139Z [cluster2] I0719 10:16:35.076791 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5095383Z [cluster2] I0719 10:16:35.091039 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5098963Z [cluster2] I0719 10:16:35.098375 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5102198Z [cluster2] I0719 10:16:35.694681 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5105386Z [cluster2] I0719 10:16:35.703133 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5108348Z [cluster2] I0719 10:16:35.725692 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5110804Z [cluster2] I0719 10:16:35.731492 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5152775Z [cluster2] I0719 10:16:35.731530 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5154240Z [cluster2] I0719 10:16:35.731542 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5157161Z [cluster2] I0719 10:16:36.128890 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5160718Z [cluster2] I0719 10:16:36.130817 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5163984Z [cluster2] I0719 10:16:36.144430 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5167678Z [cluster2] E0719 10:16:36.173254 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5170687Z [cluster2] I0719 10:16:36.173297 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5172351Z [cluster2] I0719 10:16:36.173334 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5173728Z [cluster2] I0719 10:16:36.173343 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5176197Z [cluster2] I0719 10:16:36.227496 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5179272Z [cluster2] I0719 10:16:36.251570 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5182244Z [cluster2] I0719 10:16:36.748279 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5185190Z [cluster2] I0719 10:16:36.759731 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5188583Z [cluster2] E0719 10:16:36.766861 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5224924Z [cluster2] I0719 10:16:36.766896 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5226579Z [cluster2] I0719 10:16:36.766928 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5227867Z [cluster2] I0719 10:16:36.766937 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5230317Z [cluster2] I0719 10:16:36.783611 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5233749Z [cluster2] I0719 10:16:36.800923 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5236783Z [cluster2] I0719 10:16:36.855031 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5239738Z [cluster2] I0719 10:16:36.878568 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5242797Z [cluster2] I0719 10:16:37.444456 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5245746Z [cluster2] I0719 10:16:37.478586 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5248267Z [cluster2] I0719 10:16:37.615553 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5249889Z [cluster2] I0719 10:16:37.615698 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5251169Z [cluster2] I0719 10:16:37.615709 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5252995Z [cluster2] I0719 10:16:37.616742 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5254629Z [cluster2] I0719 10:16:37.618436 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5255908Z [cluster2] I0719 10:16:37.618452 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5258479Z [cluster2] I0719 10:16:37.690291 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5261907Z [cluster2] I0719 10:16:37.707987 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5265131Z [cluster2] I0719 10:16:37.721422 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5268393Z [cluster2] I0719 10:16:37.866833 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5271375Z [cluster2] I0719 10:16:38.169075 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5274881Z [cluster2] I0719 10:16:38.189142 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5278407Z [cluster2] I0719 10:16:38.202894 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5281646Z [cluster2] I0719 10:16:38.326014 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5284606Z [cluster2] I0719 10:16:38.414469 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5287568Z [cluster2] I0719 10:16:38.479826 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5290517Z [cluster2] I0719 10:16:38.545525 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5293094Z [cluster2] I0719 10:16:38.602653 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5294642Z [cluster2] I0719 10:16:38.602703 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5295925Z [cluster2] I0719 10:16:38.602713 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5298191Z [cluster2] I0719 10:16:38.640076 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5301185Z [cluster2] I0719 10:16:38.674806 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5370325Z [cluster2] I0719 10:16:38.805303 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5374003Z [cluster2] I0719 10:16:38.950377 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5377623Z [cluster2] I0719 10:16:39.042728 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5381224Z [cluster2] I0719 10:16:39.280780 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5384192Z [cluster2] I0719 10:16:39.305463 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5387267Z [cluster2] I0719 10:16:39.647447 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5390183Z [cluster2] I0719 10:16:39.664799 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5394622Z [cluster2] I0719 10:16:39.664994 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.5397228Z [cluster2] I0719 10:16:39.996323 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5398401Z [cluster2] I0719 10:16:39.996372 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5399375Z [cluster2] I0719 10:16:39.996381 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5401303Z [cluster2] I0719 10:16:40.038164 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5404928Z [cluster2] I0719 10:16:40.191413 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5407930Z [cluster2] I0719 10:16:40.245436 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5411227Z [cluster2] I0719 10:16:40.295119 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5415010Z [cluster2] I0719 10:16:40.320412 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5430649Z [cluster2] I0719 10:16:40.792494 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5434119Z [cluster2] I0719 10:16:40.807786 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5436640Z [cluster2] I0719 10:16:40.823230 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5438261Z [cluster2] I0719 10:16:40.823273 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5439551Z [cluster2] I0719 10:16:40.823283 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5441389Z [cluster2] I0719 10:16:40.826742 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5442912Z [cluster2] I0719 10:16:40.826788 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5444191Z [cluster2] I0719 10:16:40.826797 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5446595Z [cluster2] I0719 10:16:40.849380 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5449726Z [cluster2] I0719 10:16:40.853724 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5452951Z [cluster2] I0719 10:16:40.859141 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5456259Z [cluster2] I0719 10:16:40.860344 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5459602Z [cluster2] I0719 10:16:40.930579 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5463197Z [cluster2] I0719 10:16:40.948307 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5467061Z [cluster2] I0719 10:16:40.959543 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5470584Z [cluster2] I0719 10:16:41.461757 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5536208Z [cluster2] I0719 10:16:41.466857 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5539562Z [cluster2] I0719 10:16:41.468516 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5542847Z [cluster2] I0719 10:16:41.476142 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5546521Z [cluster2] E0719 10:16:41.476794 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5549643Z [cluster2] I0719 10:16:41.476883 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5551332Z [cluster2] I0719 10:16:41.476950 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5552878Z [cluster2] I0719 10:16:41.476966 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5555210Z [cluster2] I0719 10:16:41.492921 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5557906Z [cluster2] I0719 10:16:41.493241 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5559551Z [cluster2] I0719 10:16:41.493292 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5561031Z [cluster2] I0719 10:16:41.493306 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5563949Z [cluster2] I0719 10:16:41.499678 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5567225Z [cluster2] I0719 10:16:41.502730 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5570653Z [cluster2] I0719 10:16:41.508314 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5574167Z [cluster2] I0719 10:16:41.563909 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5577284Z [cluster2] I0719 10:16:41.565802 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5581481Z [cluster2] I0719 10:16:41.565925 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.5585101Z [cluster2] I0719 10:16:41.568582 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5593444Z [cluster2] I0719 10:16:41.572895 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5597496Z [cluster2] I0719 10:16:41.576330 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5601349Z [cluster2] I0719 10:16:42.103902 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5604553Z [cluster2] I0719 10:16:42.109679 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5607788Z [cluster2] I0719 10:16:42.110480 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5621113Z [cluster2] I0719 10:16:42.115788 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5625229Z [cluster2] E0719 10:16:42.118360 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5628271Z [cluster2] I0719 10:16:42.118397 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5629947Z [cluster2] I0719 10:16:42.118429 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5631335Z [cluster2] I0719 10:16:42.118438 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5640650Z [cluster2] I0719 10:16:42.132833 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5643943Z [cluster2] I0719 10:16:42.135998 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5647303Z [cluster2] I0719 10:16:42.177771 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5650929Z [cluster2] I0719 10:16:42.182253 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.5654916Z [cluster2] I0719 10:16:42.185784 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5658565Z [cluster2] I0719 10:16:42.738383 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5663042Z [cluster2] I0719 10:16:42.744071 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5668659Z [cluster2] I0719 10:16:42.787245 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5672520Z [cluster2] I0719 10:16:42.789737 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5678906Z [cluster2] I0719 10:16:42.789841 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.2.74.217\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster2.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.5682612Z [cluster2] I0719 10:16:45.015843 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5711903Z [cluster2] I0719 10:16:45.015892 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5713546Z [cluster2] I0719 10:16:45.015904 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5716352Z [cluster2] I0719 10:16:45.025189 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5719695Z [cluster2] I0719 10:16:45.029262 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5722924Z [cluster2] I0719 10:16:45.631875 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5726112Z [cluster2] I0719 10:16:45.637575 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5728830Z [cluster2] I0719 10:16:45.648973 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5730479Z [cluster2] I0719 10:16:45.649086 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5731868Z [cluster2] I0719 10:16:45.649151 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5733944Z [cluster2] I0719 10:16:45.650336 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5735598Z [cluster2] I0719 10:16:45.650396 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5737071Z [cluster2] I0719 10:16:45.650413 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5739558Z [cluster2] I0719 10:16:45.662474 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5742729Z [cluster2] I0719 10:16:45.663911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5745955Z [cluster2] I0719 10:16:45.667913 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5749226Z [cluster2] I0719 10:16:45.668962 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5752502Z [cluster2] I0719 10:16:46.269953 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5755644Z [cluster2] I0719 10:16:46.274205 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5759014Z [cluster2] I0719 10:16:46.283042 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5762280Z [cluster2] I0719 10:16:46.287990 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5765117Z [cluster2] I0719 10:16:50.036056 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5766836Z [cluster2] I0719 10:16:50.036119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5768230Z [cluster2] I0719 10:16:50.036130 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5770696Z [cluster2] I0719 10:16:50.046809 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5773923Z [cluster2] I0719 10:16:50.050275 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5777243Z [cluster2] I0719 10:16:50.651826 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5804908Z [cluster2] I0719 10:16:50.657431 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5807626Z [cluster2] I0719 10:16:50.666718 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5809309Z [cluster2] I0719 10:16:50.666774 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5810693Z [cluster2] I0719 10:16:50.666793 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5812756Z [cluster2] I0719 10:16:50.667747 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5814410Z [cluster2] I0719 10:16:50.667820 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5815786Z [cluster2] I0719 10:16:50.667847 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5818251Z [cluster2] I0719 10:16:50.683555 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5821582Z [cluster2] I0719 10:16:50.691884 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5824837Z [cluster2] I0719 10:16:50.695394 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5828122Z [cluster2] I0719 10:16:50.710613 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5831351Z [cluster2] I0719 10:16:51.297278 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5834651Z [cluster2] I0719 10:16:51.307337 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5837830Z [cluster2] I0719 10:16:51.312959 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5841206Z [cluster2] I0719 10:16:51.323629 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5843918Z [cluster2] I0719 10:16:55.053185 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5845659Z [cluster2] I0719 10:16:55.053247 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5847036Z [cluster2] I0719 10:16:55.053260 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5849521Z [cluster2] I0719 10:16:55.067723 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5852731Z [cluster2] I0719 10:16:55.074469 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5878478Z [cluster2] I0719 10:16:55.675972 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5882037Z [cluster2] I0719 10:16:55.682119 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5884881Z [cluster2] I0719 10:16:55.695438 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5886799Z [cluster2] I0719 10:16:55.695519 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5888199Z [cluster2] I0719 10:16:55.695573 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5890195Z [cluster2] I0719 10:16:55.697530 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5891839Z [cluster2] I0719 10:16:55.698256 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5893216Z [cluster2] I0719 10:16:55.698277 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5895691Z [cluster2] I0719 10:16:55.705484 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5898924Z [cluster2] I0719 10:16:55.709558 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5902156Z [cluster2] I0719 10:16:55.714550 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5905529Z [cluster2] I0719 10:16:55.717285 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5908713Z [cluster2] I0719 10:16:56.315907 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5912016Z [cluster2] I0719 10:16:56.323348 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5915245Z [cluster2] I0719 10:16:56.324147 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5918424Z [cluster2] I0719 10:16:56.333409 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5921119Z [cluster2] I0719 10:17:00.074380 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5922772Z [cluster2] I0719 10:17:00.074436 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5924144Z [cluster2] I0719 10:17:00.074446 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5926709Z [cluster2] I0719 10:17:00.086699 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5929947Z [cluster2] I0719 10:17:00.095443 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5933200Z [cluster2] I0719 10:17:00.697214 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5936131Z [cluster2] I0719 10:17:00.703252 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5938627Z [cluster2] I0719 10:17:00.712067 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5940171Z [cluster2] I0719 10:17:00.712141 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5941443Z [cluster2] I0719 10:17:00.712158 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5943344Z [cluster2] I0719 10:17:00.720343 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5944883Z [cluster2] I0719 10:17:00.720441 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5946146Z [cluster2] I0719 10:17:00.720460 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5948437Z [cluster2] I0719 10:17:00.724578 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5951417Z [cluster2] I0719 10:17:00.728352 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5966035Z [cluster2] I0719 10:17:00.729744 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5971304Z [cluster2] I0719 10:17:00.757059 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.5974682Z [cluster2] I0719 10:17:01.330448 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5977879Z [cluster2] I0719 10:17:01.335669 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5981173Z [cluster2] I0719 10:17:01.358980 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.5985437Z [cluster2] I0719 10:17:01.364356 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5988154Z [cluster2] I0719 10:17:05.102865 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.5989674Z [cluster2] I0719 10:17:05.102930 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.5991554Z [cluster2] I0719 10:17:05.102942 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.5994441Z [cluster2] I0719 10:17:05.112219 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.5997614Z [cluster2] I0719 10:17:05.116124 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6000760Z [cluster2] I0719 10:17:05.717671 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6003924Z [cluster2] I0719 10:17:05.723474 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6006451Z [cluster2] I0719 10:17:05.732681 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6007989Z [cluster2] I0719 10:17:05.732726 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6009275Z [cluster2] I0719 10:17:05.732737 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6011734Z [cluster2] I0719 10:17:05.734561 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6013276Z [cluster2] I0719 10:17:05.734601 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6014727Z [cluster2] I0719 10:17:05.734612 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6017052Z [cluster2] I0719 10:17:05.743721 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6020096Z [cluster2] I0719 10:17:05.744381 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6023766Z [cluster2] I0719 10:17:05.762579 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6027024Z [cluster2] I0719 10:17:05.764596 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6030457Z [cluster2] I0719 10:17:06.364690 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6033562Z [cluster2] I0719 10:17:06.365813 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6036662Z [cluster2] I0719 10:17:06.373193 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6039815Z [cluster2] I0719 10:17:06.382621 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6042508Z [cluster2] I0719 10:17:10.123628 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6044074Z [cluster2] I0719 10:17:10.123679 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6045914Z [cluster2] I0719 10:17:10.123690 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6049092Z [cluster2] I0719 10:17:10.131875 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6052733Z [cluster2] I0719 10:17:10.139773 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6056978Z [cluster2] I0719 10:17:10.741066 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6060663Z [cluster2] I0719 10:17:10.748049 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6063592Z [cluster2] I0719 10:17:10.756470 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6065272Z [cluster2] I0719 10:17:10.756587 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6066634Z [cluster2] I0719 10:17:10.756691 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6069192Z [cluster2] I0719 10:17:10.756593 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6071124Z [cluster2] I0719 10:17:10.756882 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6073423Z [cluster2] I0719 10:17:10.756949 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6079256Z [cluster2] I0719 10:17:10.766842 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6082884Z [cluster2] I0719 10:17:10.769323 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6086843Z [cluster2] I0719 10:17:10.770321 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6090395Z [cluster2] I0719 10:17:10.777918 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6094760Z [cluster2] I0719 10:17:11.371979 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6099202Z [cluster2] I0719 10:17:11.376827 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6103713Z [cluster2] I0719 10:17:11.380755 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6108514Z [cluster2] I0719 10:17:11.385688 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6111410Z [cluster2] I0719 10:17:15.141419 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6113958Z [cluster2] I0719 10:17:15.141467 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6115583Z [cluster2] I0719 10:17:15.141478 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6119756Z [cluster2] I0719 10:17:15.149784 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6123363Z [cluster2] I0719 10:17:15.152820 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6126809Z [cluster2] I0719 10:17:15.755003 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6130729Z [cluster2] I0719 10:17:15.760534 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6134553Z [cluster2] I0719 10:17:15.769507 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6149627Z [cluster2] I0719 10:17:15.769551 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6151116Z [cluster2] I0719 10:17:15.769562 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6153553Z [cluster2] I0719 10:17:15.771057 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6155215Z [cluster2] I0719 10:17:15.771100 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6156639Z [cluster2] I0719 10:17:15.771117 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6159442Z [cluster2] I0719 10:17:15.780882 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6163208Z [cluster2] I0719 10:17:15.783745 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6166471Z [cluster2] I0719 10:17:15.785239 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6169924Z [cluster2] I0719 10:17:15.790382 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6173186Z [cluster2] I0719 10:17:16.387026 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6176613Z [cluster2] I0719 10:17:16.392380 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6179886Z [cluster2] I0719 10:17:16.395650 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6183136Z [cluster2] I0719 10:17:16.402576 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6186050Z [cluster2] I0719 10:17:20.160386 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6187716Z [cluster2] I0719 10:17:20.160498 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6189085Z [cluster2] I0719 10:17:20.160518 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6192518Z [cluster2] I0719 10:17:20.168866 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6196609Z [cluster2] I0719 10:17:20.171722 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6200005Z [cluster2] I0719 10:17:20.773293 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6203409Z [cluster2] I0719 10:17:20.778953 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6206730Z [cluster2] I0719 10:17:20.788548 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6208413Z [cluster2] I0719 10:17:20.788781 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6211166Z [cluster2] I0719 10:17:20.788880 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6213231Z [cluster2] I0719 10:17:20.789934 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6214899Z [cluster2] I0719 10:17:20.789974 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6216890Z [cluster2] I0719 10:17:20.789991 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6219635Z [cluster2] I0719 10:17:20.800308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6222942Z [cluster2] I0719 10:17:20.801824 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6226169Z [cluster2] I0719 10:17:20.807605 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6229674Z [cluster2] I0719 10:17:20.827083 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6232987Z [cluster2] I0719 10:17:21.408818 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6236168Z [cluster2] I0719 10:17:21.414457 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6239284Z [cluster2] I0719 10:17:21.428335 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6242315Z [cluster2] I0719 10:17:21.433133 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6244802Z [cluster2] I0719 10:17:25.178124 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6246332Z [cluster2] I0719 10:17:25.178176 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6247610Z [cluster2] I0719 10:17:25.178186 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6249872Z [cluster2] I0719 10:17:25.185452 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6253138Z [cluster2] I0719 10:17:25.190806 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6256377Z [cluster2] I0719 10:17:25.793381 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6259555Z [cluster2] I0719 10:17:25.800640 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6262242Z [cluster2] I0719 10:17:25.818027 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6264158Z [cluster2] I0719 10:17:25.818154 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6265954Z [cluster2] I0719 10:17:25.818209 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6268421Z [cluster2] I0719 10:17:25.821715 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6270388Z [cluster2] I0719 10:17:25.821845 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6272205Z [cluster2] I0719 10:17:25.821902 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6275567Z [cluster2] I0719 10:17:25.836465 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6278790Z [cluster2] I0719 10:17:25.837407 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6282015Z [cluster2] I0719 10:17:25.856095 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6285395Z [cluster2] I0719 10:17:25.878015 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6288604Z [cluster2] I0719 10:17:26.475349 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6291722Z [cluster2] I0719 10:17:26.484867 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6294874Z [cluster2] I0719 10:17:26.508970 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6298123Z [cluster2] I0719 10:17:26.524791 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6301145Z [cluster2] I0719 10:17:30.197375 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6302790Z [cluster2] I0719 10:17:30.197439 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6304174Z [cluster2] I0719 10:17:30.197449 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6306642Z [cluster2] I0719 10:17:30.209913 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6310623Z [cluster2] I0719 10:17:30.239091 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6315708Z [cluster2] I0719 10:17:30.840925 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6319015Z [cluster2] I0719 10:17:30.848082 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6321913Z [cluster2] I0719 10:17:30.865089 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6323569Z [cluster2] I0719 10:17:30.865255 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6324945Z [cluster2] I0719 10:17:30.865334 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6327089Z [cluster2] I0719 10:17:30.865095 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6329159Z [cluster2] I0719 10:17:30.865501 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6330553Z [cluster2] I0719 10:17:30.865519 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6333045Z [cluster2] I0719 10:17:30.888591 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6336218Z [cluster2] I0719 10:17:30.896161 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6339651Z [cluster2] I0719 10:17:30.899564 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6343353Z [cluster2] I0719 10:17:30.907314 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6346553Z [cluster2] I0719 10:17:31.511427 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6350353Z [cluster2] I0719 10:17:31.516807 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6354686Z [cluster2] I0719 10:17:31.523747 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6358688Z [cluster2] I0719 10:17:31.532454 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6363156Z [cluster2] I0719 10:17:35.218996 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6364833Z [cluster2] I0719 10:17:35.219373 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6366206Z [cluster2] I0719 10:17:35.219393 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6368699Z [cluster2] I0719 10:17:35.230193 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6372168Z [cluster2] I0719 10:17:35.235946 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6375636Z [cluster2] I0719 10:17:35.838515 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6379071Z [cluster2] I0719 10:17:35.844680 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6382043Z [cluster2] I0719 10:17:35.857738 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6383702Z [cluster2] I0719 10:17:35.857928 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6385661Z [cluster2] I0719 10:17:35.857999 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6387699Z [cluster2] I0719 10:17:35.860585 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.6389586Z [cluster2] I0719 10:17:35.860739 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.2.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.6391031Z [cluster2] I0719 10:17:35.863000 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.2.0.0/16" "type"="Service"
2021-07-19T10:17:37.6393852Z [cluster2] I0719 10:17:35.868655 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6397599Z [cluster2] I0719 10:17:35.870624 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6401937Z [cluster2] I0719 10:17:35.876702 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6406616Z [cluster2] I0719 10:17:35.877587 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.6409896Z [cluster2] I0719 10:17:36.478387 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6413254Z [cluster2] I0719 10:17:36.486972 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.6416475Z [cluster2] I0719 10:17:36.492121 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6420145Z [cluster2] I0719 10:17:36.493466 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.6422657Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-19T10:17:37.6423878Z [submariner-operator]$ [cluster2] verify_subm_cr
2021-07-19T10:17:37.6425061Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-19T10:17:37.6426207Z [submariner-operator]$ [cluster2] grep submariner
2021-07-19T10:17:37.6427396Z [submariner-operator]$ [cluster2] kubectl get submariner --namespace=submariner-operator
2021-07-19T10:17:37.7557623Z [submariner-operator]$ [cluster2] command kubectl --context=021-07-19T10:15:54Z"
2021-07-19T10:17:37.7558531Z [cluster1] }
2021-07-19T10:17:37.7558981Z [cluster1] }
2021-07-19T10:17:37.7559423Z [cluster1] }
2021-07-19T10:17:37.7559845Z [cluster1] ],
2021-07-19T10:17:37.7560298Z [cluster1] "hostIP": "172.18.0.8",
2021-07-19T10:17:37.7560927Z [cluster1] "phase": "Running",
2021-07-19T10:17:37.7561436Z [cluster1] "podIP": "10.1.128.4",
2021-07-19T10:17:37.7561926Z [cluster1] "podIPs": [
2021-07-19T10:17:37.7562365Z [cluster1] {
2021-07-19T10:17:37.7562816Z [cluster1] "ip": "10.1.128.4"
2021-07-19T10:17:37.7563270Z [cluster1] }
2021-07-19T10:17:37.7563677Z [cluster1] ],
2021-07-19T10:17:37.7564189Z [cluster1] "qosClass": "BestEffort",
2021-07-19T10:17:37.7565034Z [cluster1] "startTime": "2021-07-19T10:15:52Z"
2021-07-19T10:17:37.7565528Z [cluster1] }
2021-07-19T10:17:37.7565918Z [cluster1] }
2021-07-19T10:17:37.7567638Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.7569341Z [submariner-operator]$ [cluster1] grep Running
2021-07-19T10:17:37.7571237Z [submariner-operator]$ [cluster1] kubectl get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.7573795Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator -o jsonpath={.status.phase}
2021-07-19T10:17:37.7575277Z [cluster1] Running
2021-07-19T10:17:37.7576663Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator
2021-07-19T10:17:37.7578682Z [submariner-operator]$ [cluster1] kubectl logs submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator
2021-07-19T10:17:37.7580843Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 logs submariner-operator-5bfdb87494-bdsp5 --namespace=submariner-operator
2021-07-19T10:17:37.7582189Z [cluster1] I0719 10:15:55.098823 1 main.go:77] cmd "msg"="Go Version: go1.16.5"
2021-07-19T10:17:37.7582840Z [cluster1] I0719 10:15:55.100098 1 main.go:78] cmd "msg"="Go OS/Arch: linux/amd64"
2021-07-19T10:17:37.7583783Z [cluster1] I0719 10:15:55.100166 1 main.go:79] cmd "msg"="Version of operator-sdk: v0.19.0"
2021-07-19T10:17:37.7584815Z [cluster1] I0719 10:15:55.100189 1 main.go:80] cmd "msg"="Submariner operator version: devel-0105e4d"
2021-07-19T10:17:37.7585667Z [cluster1] I0719 10:15:55.100426 1 leader.go:89] leader "msg"="Trying to become the leader."
2021-07-19T10:17:37.7587045Z [cluster1] I0719 10:15:55.711660 1 leader.go:126] leader "msg"="Found existing lock" "LockOwner"="submariner-operator-586cb56578-qns6j"
2021-07-19T10:17:37.7588178Z [cluster1] I0719 10:15:55.721989 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.7588951Z [cluster1] I0719 10:15:56.859422 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.7589799Z [cluster1] I0719 10:15:59.252709 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.7590759Z [cluster1] I0719 10:16:03.808538 1 leader.go:192] leader "msg"="Not the leader. Waiting."
2021-07-19T10:17:37.7591560Z [cluster1] I0719 10:16:12.517877 1 leader.go:149] leader "msg"="Became the leader."
2021-07-19T10:17:37.7598336Z [cluster1] I0719 10:16:13.121843 1 listener.go:44] controller-runtime/metrics "msg"="metrics server is starting to listen" "addr"="0.0.0.0:8383"
2021-07-19T10:17:37.7599491Z [cluster1] I0719 10:16:13.122660 1 main.go:129] cmd "msg"="Registering Components."
2021-07-19T10:17:37.7600314Z [cluster1] I0719 10:16:13.122822 1 main.go:137] cmd "msg"="Creating the Lighthouse CRDs"
2021-07-19T10:17:37.7601411Z [cluster1] I0719 10:16:16.846592 1 main.go:182] cmd "msg"="Could not create ServiceMonitor object" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7603375Z [cluster1] I0719 10:16:16.846621 1 main.go:186] cmd "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7604678Z [cluster1] I0719 10:16:16.846673 1 main.go:203] cmd "msg"="Starting the Cmd."
2021-07-19T10:17:37.7605932Z [cluster1] I0719 10:16:16.846834 1 internal.go:406] controller-runtime/manager "msg"="starting metrics server" "path"="/metrics"
2021-07-19T10:17:37.7623286Z [cluster1] I0719 10:16:16.847439 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T10:17:37.7641709Z [cluster1] I0719 10:16:16.847633 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"broker":"","brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","ceIPSecPSK":"","clusterCIDR":"","clusterID":"","serviceCIDR":"","namespace":"","ceIPSecDebug":false,"debug":false,"natEnabled":false},"status":{"natEnabled":false,"clusterID":"","gatewayDaemonSetStatus":{"mismatchedContainerImages":false},"routeAgentDaemonSetStatus":{"mismatchedContainerImages":false},"globalnetDaemonSetStatus":{"mismatchedContainerImages":false},"loadBalancerStatus":{},"deploymentInfo":{}}}}
2021-07-19T10:17:37.7653336Z [cluster1] I0719 10:16:16.851506 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T10:17:37.7659933Z [cluster1] I0719 10:16:16.856097 1 controller.go:158] controller-runtime/manager/controller/servicediscovery "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "source"={"Type":{"status":{"deploymentInfo":{}},"metadata":{"creationTimestamp":null},"spec":{"brokerK8sApiServer":"","brokerK8sApiServerToken":"","brokerK8sCA":"","brokerK8sRemoteNamespace":"","clusterID":"","namespace":"","debug":false}}}
2021-07-19T10:17:37.7672560Z [cluster1] I0719 10:16:16.858768 1 controller.go:158] controller-runtime/manager/controller/broker "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Broker" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{},"status":{}}}
2021-07-19T10:17:37.7679538Z [cluster1] I0719 10:16:16.950076 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"updateStrategy":{}},"status":{"currentNumberScheduled":0,"numberMisscheduled":0,"desiredNumberScheduled":0,"numberReady":0}}}
2021-07-19T10:17:37.7697237Z [cluster1] I0719 10:16:16.950220 1 controller.go:158] controller-runtime/manager/controller/submariner "msg"="Starting EventSource" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T10:17:37.7703638Z [cluster1] I0719 10:16:16.954388 1 controller.go:158] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"spec":{"selector":null,"template":{"metadata":{"creationTimestamp":null},"spec":{"containers":null}},"strategy":{}},"status":{}}}
2021-07-19T10:17:37.7706402Z [cluster1] I0719 10:16:16.954432 1 controller.go:165] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting Controller"
2021-07-19T10:17:37.7708455Z [cluster1] I0719 10:16:16.954451 1 controller.go:192] controller-runtime/manager/controller/servicediscovery-controller "msg"="Starting workers" "worker count"=1
2021-07-19T10:17:37.7710761Z [cluster1] I0719 10:16:16.958728 1 controller.go:165] controller-runtime/manager/controller/servicediscovery "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.7713561Z [cluster1] I0719 10:16:16.959013 1 controller.go:192] controller-runtime/manager/controller/servicediscovery "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery" "worker count"=1
2021-07-19T10:17:37.7715841Z [cluster1] I0719 10:16:16.959144 1 controller.go:165] controller-runtime/manager/controller/broker "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7717827Z [cluster1] I0719 10:16:16.959358 1 controller.go:192] controller-runtime/manager/controller/broker "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Broker" "worker count"=1
2021-07-19T10:17:37.7719847Z [cluster1] I0719 10:16:17.050438 1 controller.go:165] controller-runtime/manager/controller/submariner "msg"="Starting Controller" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T10:17:37.7721938Z [cluster1] I0719 10:16:17.050698 1 controller.go:192] controller-runtime/manager/controller/submariner "msg"="Starting workers" "reconciler group"="submariner.io" "reconciler kind"="Submariner" "worker count"=1
2021-07-19T10:17:37.7725018Z [cluster1] I0719 10:16:17.050539 1 controller.go:158] controller-runtime/manager/controller/submariner-controller "msg"="Starting EventSource" "source"={"Type":{"metadata":{"creationTimestamp":null},"status":{"version":"","haStatus":"","localEndpoint":{"cluster_id":"","cable_name":"","hostname":"","subnets":null,"private_ip":"","public_ip":"","nat_enabled":false,"backend":""},"statusFailure":"","connections":null}}}
2021-07-19T10:17:37.7728359Z [cluster1] E0719 10:16:17.125967 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7730893Z [cluster1] I0719 10:16:17.151971 1 controller.go:165] controller-runtime/manager/controller/submariner-controller "msg"="Starting Controller"
2021-07-19T10:17:37.7732633Z [cluster1] I0719 10:16:17.152033 1 controller.go:192] controller-runtime/manager/controller/submariner-controller "msg"="Starting workers" "worker count"=1
2021-07-19T10:17:37.7735150Z [cluster1] E0719 10:16:17.178433 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7738262Z [cluster1] E0719 10:16:17.230975 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7741338Z [cluster1] E0719 10:16:17.294398 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7744425Z [cluster1] E0719 10:16:17.379254 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7746966Z [cluster1] I0719 10:16:17.478596 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7749027Z [cluster1] I0719 10:16:17.479003 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7750529Z [cluster1] I0719 10:16:17.547928 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T10:17:37.7752282Z [cluster1] I0719 10:16:17.547956 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-19T10:17:37.7753660Z [cluster1] I0719 10:16:17.547966 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7755078Z [cluster1] I0719 10:16:17.547975 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7757362Z [cluster1] I0719 10:16:17.560975 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7759246Z [cluster1] I0719 10:16:17.561477 1 submariner_networkdiscovery.go:42] controller_submariner "msg"="Cluster network discovered"
2021-07-19T10:17:37.7761327Z [cluster1] I0719 10:16:17.561884 1 network.go:56] controller_submariner "msg"="Discovered K8s network details" "clusterCIDRs"=["10.1.0.0/16"] "plugin"="weave-net" "serviceCIDRs"=["100.1.0.0/16"]
2021-07-19T10:17:37.7793787Z [cluster1] I0719 10:16:17.561963 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7795215Z [cluster1] I0719 10:16:17.562016 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7798009Z [cluster1] I0719 10:16:17.577230 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7801232Z [cluster1] I0719 10:16:17.697309 1 helpers.go:231] controller_submariner "msg"="Created a new Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7804997Z [cluster1] E0719 10:16:17.697515 1 controller.go:267] controller-runtime/manager/controller/submariner-controller "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: Service \"submariner-gateway-metrics\" not found" "name"="submariner" "namespace"="submariner-operator"
2021-07-19T10:17:37.7808138Z [cluster1] I0719 10:16:17.697793 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7809793Z [cluster1] I0719 10:16:17.698119 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7811189Z [cluster1] I0719 10:16:17.698238 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7813786Z [cluster1] E0719 10:16:17.714658 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7817037Z [cluster1] I0719 10:16:17.719463 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7821098Z [cluster1] E0719 10:16:17.741916 1 controller.go:267] controller-runtime/manager/controller/submariner "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-gateway-metrics: services \"submariner-gateway-metrics\" already exists" "name"="submariner" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Submariner"
2021-07-19T10:17:37.7824997Z [cluster1] I0719 10:16:17.742165 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7827746Z [cluster1] I0719 10:16:17.748185 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7829404Z [cluster1] I0719 10:16:17.749336 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7830949Z [cluster1] I0719 10:16:17.749363 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7834023Z [cluster1] I0719 10:16:17.756773 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7837263Z [cluster1] I0719 10:16:17.795731 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7840710Z [cluster1] E0719 10:16:18.019607 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7844491Z [cluster1] I0719 10:16:18.344195 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7847684Z [cluster1] I0719 10:16:18.352700 1 helpers.go:83] controller_submariner "msg"="Created a new DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7850713Z [cluster1] I0719 10:16:18.361960 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7853420Z [cluster1] I0719 10:16:18.362114 1 servicediscovery_resources.go:66] controller_submariner "msg"="Created Service Discovery CR" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Name"="service-discovery" "Namespace"="submariner-operator"
2021-07-19T10:17:37.7856092Z [cluster1] I0719 10:16:18.362196 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7859277Z [cluster1] I0719 10:16:18.370454 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.7863258Z [cluster1] E0719 10:16:18.370503 1 controller.go:267] controller-runtime/manager/controller/servicediscovery-controller "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: Deployment.apps \"submariner-lighthouse-agent\" not found" "name"="service-discovery" "namespace"="submariner-operator"
2021-07-19T10:17:37.7866728Z [cluster1] I0719 10:16:18.371128 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7870566Z [cluster1] E0719 10:16:18.381663 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Deployment submariner-operator/submariner-lighthouse-agent: deployments.apps \"submariner-lighthouse-agent\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.7891610Z [cluster1] I0719 10:16:18.383542 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.7895426Z [cluster1] I0719 10:16:18.386911 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7898435Z [cluster1] I0719 10:16:18.421201 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7902079Z [cluster1] I0719 10:16:18.474722 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7905837Z [cluster1] I0719 10:16:18.481499 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7909439Z [cluster1] I0719 10:16:18.527282 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.7925574Z [cluster1] E0719 10:16:18.564943 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7928780Z [cluster1] I0719 10:16:18.576462 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7930452Z [cluster1] I0719 10:16:18.576520 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7931834Z [cluster1] I0719 10:16:18.576570 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7933819Z [cluster1] I0719 10:16:18.577613 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.7935487Z [cluster1] I0719 10:16:18.577707 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.7936856Z [cluster1] I0719 10:16:18.577823 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.7939974Z [cluster1] I0719 10:16:18.583935 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7943517Z [cluster1] I0719 10:16:18.604022 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7946699Z [cluster1] I0719 10:16:18.627434 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7949940Z [cluster1] I0719 10:16:18.629752 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7953431Z [cluster1] E0719 10:16:18.642764 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.7956834Z [cluster1] I0719 10:16:18.657375 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7960286Z [cluster1] I0719 10:16:19.081474 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7963571Z [cluster1] I0719 10:16:19.194904 1 helpers.go:175] controller_servicediscovery "msg"="Created a new ConfigMap" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "ConfigMap.Name"="submariner-lighthouse-coredns" "ConfigMap.Namespace"="submariner-operator"
2021-07-19T10:17:37.7967031Z [cluster1] I0719 10:16:19.198810 1 helpers.go:129] controller_servicediscovery "msg"="Created a new Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.7970679Z [cluster1] I0719 10:16:19.199153 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7973688Z [cluster1] I0719 10:16:19.251762 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7976794Z [cluster1] I0719 10:16:19.254175 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.7980084Z [cluster1] I0719 10:16:19.277530 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.7983497Z [cluster1] I0719 10:16:19.306840 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.7986756Z [cluster1] I0719 10:16:19.339061 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.7989915Z [cluster1] I0719 10:16:19.547734 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8015167Z [cluster1] I0719 10:16:19.588858 1 helpers.go:231] controller_servicediscovery "msg"="Created a new Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8018032Z [cluster1] I0719 10:16:19.589843 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8019563Z [cluster1] I0719 10:16:19.589881 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8021232Z [cluster1] I0719 10:16:19.589891 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8023726Z [cluster1] I0719 10:16:19.944641 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8027359Z [cluster1] E0719 10:16:19.945286 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8030456Z [cluster1] I0719 10:16:19.951339 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8032238Z [cluster1] I0719 10:16:19.951422 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8033531Z [cluster1] I0719 10:16:19.951466 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8037198Z [cluster1] E0719 10:16:20.007280 1 controller.go:267] controller-runtime/manager/controller/servicediscovery "msg"="Reconciler error" "error"="error creating or updating Service submariner-operator/submariner-lighthouse-coredns-metrics: services \"submariner-lighthouse-coredns-metrics\" already exists" "name"="service-discovery" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="ServiceDiscovery"
2021-07-19T10:17:37.8041056Z [cluster1] I0719 10:16:20.017908 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8043962Z [cluster1] I0719 10:16:20.259356 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8047256Z [cluster1] I0719 10:16:20.359451 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8050443Z [cluster1] I0719 10:16:20.528923 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8053500Z [cluster1] I0719 10:16:20.529711 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8056437Z [cluster1] I0719 10:16:20.708947 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8060603Z [cluster1] I0719 10:16:20.708986 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8064806Z [cluster1] I0719 10:16:20.763866 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8068636Z [cluster1] I0719 10:16:20.764377 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8094464Z [cluster1] I0719 10:16:20.819115 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8097984Z [cluster1] I0719 10:16:21.037246 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8101802Z [cluster1] I0719 10:16:21.098043 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8105297Z [cluster1] I0719 10:16:21.316300 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8108719Z [cluster1] E0719 10:16:21.317620 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.8112345Z [cluster1] I0719 10:16:21.343340 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8115565Z [cluster1] I0719 10:16:21.383593 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8118819Z [cluster1] I0719 10:16:21.384496 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8122116Z [cluster1] I0719 10:16:21.433442 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8125796Z [cluster1] I0719 10:16:21.446427 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8129789Z [cluster1] I0719 10:16:21.507487 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8133537Z [cluster1] I0719 10:16:21.699997 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8137126Z [cluster1] I0719 10:16:21.722579 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8140962Z [cluster1] I0719 10:16:21.736639 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8144630Z [cluster1] I0719 10:16:22.111522 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8147774Z [cluster1] I0719 10:16:22.118517 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8184292Z [cluster1] I0719 10:16:22.118560 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8188770Z [cluster1] I0719 10:16:22.339827 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8192079Z [cluster1] I0719 10:16:22.350693 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8196626Z [cluster1] I0719 10:16:22.350731 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8200847Z [cluster1] E0719 10:16:22.930771 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.8203702Z [cluster1] I0719 10:16:25.885878 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8205361Z [cluster1] I0719 10:16:25.885932 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8206751Z [cluster1] I0719 10:16:25.885941 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8209368Z [cluster1] I0719 10:16:25.952541 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8212596Z [cluster1] I0719 10:16:26.263410 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8215940Z [cluster1] E0719 10:16:26.528576 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.8219184Z [cluster1] I0719 10:16:27.003754 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8222367Z [cluster1] I0719 10:16:27.044850 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8225060Z [cluster1] I0719 10:16:27.075697 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8226799Z [cluster1] I0719 10:16:27.075738 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8228193Z [cluster1] I0719 10:16:27.075748 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8230665Z [cluster1] I0719 10:16:27.113060 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8264696Z [cluster1] I0719 10:16:27.122587 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8266392Z [cluster1] I0719 10:16:27.122645 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8267804Z [cluster1] I0719 10:16:27.122657 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8270353Z [cluster1] I0719 10:16:27.130000 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8273934Z [cluster1] I0719 10:16:27.141156 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8277160Z [cluster1] I0719 10:16:27.166169 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8280655Z [cluster1] I0719 10:16:27.874926 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8283785Z [cluster1] I0719 10:16:27.878081 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8286946Z [cluster1] I0719 10:16:27.989654 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8290195Z [cluster1] I0719 10:16:27.990193 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8293852Z [cluster1] E0719 10:16:28.029903 1 submariner_controller.go:204] controller_submariner "msg"="failed to update the Submariner status" "error"="Operation cannot be fulfilled on submariners.submariner.io \"submariner\": the object has been modified; please apply your changes to the latest version and try again" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8296865Z [cluster1] I0719 10:16:28.029949 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8298601Z [cluster1] I0719 10:16:28.029983 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8300007Z [cluster1] I0719 10:16:28.029996 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8302487Z [cluster1] I0719 10:16:28.117479 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8305725Z [cluster1] I0719 10:16:28.216009 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8308917Z [cluster1] I0719 10:16:28.817977 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8352650Z [cluster1] I0719 10:16:28.832604 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8356029Z [cluster1] I0719 10:16:29.220198 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8359341Z [cluster1] I0719 10:16:29.263505 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8363152Z [cluster1] I0719 10:16:29.301862 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8366762Z [cluster1] I0719 10:16:29.906968 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8370414Z [cluster1] I0719 10:16:29.925472 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8374279Z [cluster1] I0719 10:16:29.947420 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8377923Z [cluster1] I0719 10:16:30.686198 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8381092Z [cluster1] I0719 10:16:30.716966 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8385755Z [cluster1] I0719 10:16:30.717006 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8389652Z [cluster1] I0719 10:16:31.139524 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8393109Z [cluster1] I0719 10:16:31.216815 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8396891Z [cluster1] I0719 10:16:31.313039 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8400509Z [cluster1] I0719 10:16:32.050032 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8404327Z [cluster1] I0719 10:16:32.103418 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8408274Z [cluster1] I0719 10:16:32.142859 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8411931Z [cluster1] E0719 10:16:32.159951 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.8415464Z [cluster1] I0719 10:16:32.752585 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8418620Z [cluster1] I0719 10:16:32.766348 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8423042Z [cluster1] I0719 10:16:32.766389 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8427026Z [cluster1] I0719 10:16:32.771743 1 servicediscovery_controller.go:109] controller_servicediscovery "msg"="Reconciling ServiceDiscovery" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8430311Z [cluster1] I0719 10:16:32.789847 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-agent" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8469055Z [cluster1] I0719 10:16:32.796346 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-agent-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8472558Z [cluster1] I0719 10:16:33.408645 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8476004Z [cluster1] I0719 10:16:33.419396 1 helpers.go:131] controller_servicediscovery "msg"="Updated existing Deployment" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Deployment.Name"="submariner-lighthouse-coredns" "Deployment.Namespace"="submariner-operator"
2021-07-19T10:17:37.8479743Z [cluster1] I0719 10:16:33.426734 1 helpers.go:233] controller_servicediscovery "msg"="Updated existing Service" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-lighthouse-coredns-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8482548Z [cluster1] I0719 10:16:33.984937 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8484095Z [cluster1] I0719 10:16:33.994011 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8485385Z [cluster1] I0719 10:16:33.994082 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8487672Z [cluster1] I0719 10:16:34.009497 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8490668Z [cluster1] I0719 10:16:34.021648 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8493774Z [cluster1] I0719 10:16:34.195903 1 metrics.go:55] controller_servicediscovery "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8496695Z [cluster1] I0719 10:16:34.198888 1 servicediscovery_controller.go:471] controller_servicediscovery "msg"="coredns configmap has lighthouse configuration hence updating" "Request.Name"="service-discovery" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8500899Z [cluster1] I0719 10:16:34.199071 1 servicediscovery_controller.go:495] controller_servicediscovery "msg"="Updated coredns ConfigMap #lighthouse-start AUTO-GENERATED SECTION. DO NOT EDIT\nclusterset.local:53 {\n forward . 100.1.144.97\n}\n#lighthouse-end\n.:53 {\n errors\n health {\n lameduck 5s\n }\n ready\n kubernetes cluster1.local in-addr.arpa ip6.arpa {\n pods insecure\n fallthrough in-addr.arpa ip6.arpa\n ttl 30\n }\n prometheus :9153\n forward . /etc/resolv.conf {\n max_concurrent 1000\n }\n cache 30\n loop\n reload\n loadbalance\n}\n\n\n\n\n\n\n\n\n\n\n\n\n"
2021-07-19T10:17:37.8504841Z [cluster1] I0719 10:16:34.622999 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8508116Z [cluster1] I0719 10:16:34.646705 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8510855Z [cluster1] I0719 10:16:34.682526 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8513571Z [cluster1] I0719 10:16:34.685916 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8515217Z [cluster1] I0719 10:16:34.694778 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8516602Z [cluster1] I0719 10:16:34.694869 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8518072Z [cluster1] I0719 10:16:34.694727 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8519442Z [cluster1] I0719 10:16:34.694973 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8521942Z [cluster1] I0719 10:16:34.738665 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8525163Z [cluster1] I0719 10:16:34.747152 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8528377Z [cluster1] I0719 10:16:34.763407 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8531361Z [cluster1] I0719 10:16:34.782735 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8534662Z [cluster1] I0719 10:16:35.385480 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8537852Z [cluster1] I0719 10:16:35.404667 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8540902Z [cluster1] I0719 10:16:35.435225 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8543915Z [cluster1] I0719 10:16:35.437911 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8546412Z [cluster1] I0719 10:16:35.496733 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8547937Z [cluster1] I0719 10:16:35.496821 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8549401Z [cluster1] I0719 10:16:35.496846 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8551915Z [cluster1] I0719 10:16:35.544603 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8555352Z [cluster1] I0719 10:16:35.565289 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8558670Z [cluster1] I0719 10:16:36.167224 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8561842Z [cluster1] I0719 10:16:36.173025 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8564537Z [cluster1] I0719 10:16:39.397899 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8566198Z [cluster1] I0719 10:16:39.397982 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8567611Z [cluster1] I0719 10:16:39.397999 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8570079Z [cluster1] I0719 10:16:39.427841 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8573315Z [cluster1] I0719 10:16:39.432808 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8576528Z [cluster1] I0719 10:16:40.035237 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8579704Z [cluster1] I0719 10:16:40.044480 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8582447Z [cluster1] I0719 10:16:40.061663 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8583987Z [cluster1] I0719 10:16:40.061716 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8585260Z [cluster1] I0719 10:16:40.061726 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8587094Z [cluster1] I0719 10:16:40.063012 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8588636Z [cluster1] I0719 10:16:40.063042 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8590102Z [cluster1] I0719 10:16:40.063051 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8592514Z [cluster1] I0719 10:16:40.083103 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8596647Z [cluster1] I0719 10:16:40.085105 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8599950Z [cluster1] I0719 10:16:40.092579 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8603507Z [cluster1] I0719 10:16:40.092774 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8606727Z [cluster1] I0719 10:16:40.769547 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8609853Z [cluster1] I0719 10:16:40.771538 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8613233Z [cluster1] I0719 10:16:40.798060 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8616732Z [cluster1] I0719 10:16:40.802985 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8620093Z [cluster1] E0719 10:16:42.455798 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:37.8623047Z [cluster1] I0719 10:16:44.442732 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8624831Z [cluster1] I0719 10:16:44.442926 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8626225Z [cluster1] I0719 10:16:44.442945 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8628741Z [cluster1] I0719 10:16:44.458308 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8632055Z [cluster1] I0719 10:16:44.464302 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:37.8635698Z [cluster1] I0719 10:16:45.065631 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:37.8639079Z [cluster1] I0719 10:16:45.070838 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:37.8641903Z [cluster1] I0719 10:16:45.079948 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8643574Z [cluster1] I0719 10:16:45.080019 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:37.8644949Z [cluster1] I0719 10:16:45.080037 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:37.8646917Z [cluster1] I0719 10:16:45.081524 1 submariner_controller.go:103] controller_submariner "msg"="Reconciling Submariner" "Request.Name"="submariner" "Request.Namespace"="submariner-operator"
2021-07-19T10:17:37.8648558Z [cluster1] I0719 10:16:45.081592 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="10.1.0.0/16" "type"="Cluster"
2021-07-19T10:17:38.4666068Z [cluster1] I0719 1cluster2 get submariner --namespace=submariner-operator
2021-07-19T10:17:38.4667162Z [cluster2] submariner 86s
2021-07-19T10:17:38.4668482Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-19T10:17:38.4670041Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.4671575Z [submariner-operator]$ [cluster2] tee /tmp/submariner.cluster2.json
2021-07-19T10:17:38.4673477Z [submariner-operator]$ [cluster2] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.4675282Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.4676318Z [cluster2] {
2021-07-19T10:17:38.4677005Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.4677681Z [cluster2] "kind": "Submariner",
2021-07-19T10:17:38.4678199Z [cluster2] "metadata": {
2021-07-19T10:17:38.4679026Z [cluster2] "creationTimestamp": "2021-07-19T10:16:12Z",
2021-07-19T10:17:38.4679662Z [cluster2] "generation": 1,
2021-07-19T10:17:38.4680207Z [cluster2] "managedFields": [
2021-07-19T10:17:38.4680710Z [cluster2] {
2021-07-19T10:17:38.4681299Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.4682235Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:38.4682808Z [cluster2] "fieldsV1": {
2021-07-19T10:17:38.4683312Z [cluster2] "f:spec": {
2021-07-19T10:17:38.4683775Z [cluster2] ".": {},
2021-07-19T10:17:38.4684266Z [cluster2] "f:broker": {},
2021-07-19T10:17:38.4684971Z [cluster2] "f:brokerK8sApiServer": {},
2021-07-19T10:17:38.4685769Z [cluster2] "f:brokerK8sApiServerToken": {},
2021-07-19T10:17:38.4686500Z [cluster2] "f:brokerK8sCA": {},
2021-07-19T10:17:38.4687302Z [cluster2] "f:brokerK8sRemoteNamespace": {},
2021-07-19T10:17:38.4688046Z [cluster2] "f:cableDriver": {},
2021-07-19T10:17:38.4688642Z [cluster2] "f:ceIPSecDebug": {},
2021-07-19T10:17:38.4689293Z [cluster2] "f:ceIPSecIKEPort": {},
2021-07-19T10:17:38.4689951Z [cluster2] "f:ceIPSecNATTPort": {},
2021-07-19T10:17:38.4690586Z [cluster2] "f:ceIPSecPSK": {},
2021-07-19T10:17:38.4691206Z [cluster2] "f:clusterCIDR": {},
2021-07-19T10:17:38.4691765Z [cluster2] "f:clusterID": {},
2021-07-19T10:17:38.4692332Z [cluster2] "f:colorCodes": {},
2021-07-19T10:17:38.4693011Z [cluster2] "f:connectionHealthCheck": {
2021-07-19T10:17:38.4693761Z [cluster2] ".": {},
2021-07-19T10:17:38.4694253Z [cluster2] "f:enabled": {},
2021-07-19T10:17:38.4694857Z [cluster2] "f:intervalSeconds": {},
2021-07-19T10:17:38.4695551Z [cluster2] "f:maxPacketLossCount": {}
2021-07-19T10:17:38.4696148Z [cluster2] },
2021-07-19T10:17:38.4696611Z [cluster2] "f:debug": {},
2021-07-19T10:17:38.4697151Z [cluster2] "f:namespace": {},
2021-07-19T10:17:38.4697713Z [cluster2] "f:natEnabled": {},
2021-07-19T10:17:38.4698266Z [cluster2] "f:repository": {},
2021-07-19T10:17:38.4698847Z [cluster2] "f:serviceCIDR": {},
2021-07-19T10:17:38.4699562Z [cluster2] "f:serviceDiscoveryEnabled": {},
2021-07-19T10:17:38.4700256Z [cluster2] "f:version": {}
2021-07-19T10:17:38.4700729Z [cluster2] }
2021-07-19T10:17:38.4701163Z [cluster2] },
2021-07-19T10:17:38.4701647Z [cluster2] "manager": "subctl",
2021-07-19T10:17:38.4702220Z [cluster2] "operation": "Update",
2021-07-19T10:17:38.4703022Z [cluster2] "time": "2021-07-19T10:16:12Z"
2021-07-19T10:17:38.4703485Z [cluster2] },
2021-07-19T10:17:38.4703913Z [cluster2] {
2021-07-19T10:17:38.4704511Z [cluster2] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.4705218Z [cluster2] "fieldsType": "FieldsV1",
2021-07-19T10:17:38.4705784Z [cluster2] "fieldsV1": {
2021-07-19T10:17:38.4706293Z [cluster2] "f:status": {
2021-07-19T10:17:38.4706764Z [cluster2] ".": {},
2021-07-19T10:17:38.4707396Z [cluster2] "f:clusterCIDR": {},
2021-07-19T10:17:38.4707953Z [cluster2] "f:clusterID": {},
2021-07-19T10:17:38.4708635Z [cluster2] "f:colorCodes": {},
2021-07-19T10:17:38.4709208Z [cluster2] "f:deploymentInfo": {},
2021-07-19T10:17:38.4709885Z [cluster2] "f:gatewayDaemonSetStatus": {
2021-07-19T10:17:38.4710579Z [cluster2] ".": {},
2021-07-19T10:17:38.4711137Z [cluster2] "f:lastResourceVersion": {},
2021-07-19T10:17:38.4714491Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-19T10:17:38.4715363Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-19T10:17:38.4716008Z [cluster2] "f:status": {
2021-07-19T10:17:38.4716456Z [cluster2] ".": {},
2021-07-19T10:17:38.4717073Z [cluster2] "f:currentNumberScheduled": {},
2021-07-19T10:17:38.4717860Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-19T10:17:38.4718566Z [cluster2] "f:numberAvailable": {},
2021-07-19T10:17:38.4719336Z [cluster2] "f:numberMisscheduled": {},
2021-07-19T10:17:38.4719952Z [cluster2] "f:numberReady": {},
2021-07-19T10:17:38.4720580Z [cluster2] "f:observedGeneration": {},
2021-07-19T10:17:38.4721318Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-19T10:17:38.4721931Z [cluster2] }
2021-07-19T10:17:38.4722349Z [cluster2] },
2021-07-19T10:17:38.4722858Z [cluster2] "f:gateways": {},
2021-07-19T10:17:38.4723530Z [cluster2] "f:globalnetDaemonSetStatus": {
2021-07-19T10:17:38.4724199Z [cluster2] ".": {},
2021-07-19T10:17:38.4724848Z [cluster2] "f:mismatchedContainerImages": {}
2021-07-19T10:17:38.4725532Z [cluster2] },
2021-07-19T10:17:38.4726174Z [cluster2] "f:loadBalancerStatus": {},
2021-07-19T10:17:38.4726759Z [cluster2] "f:natEnabled": {},
2021-07-19T10:17:38.4727316Z [cluster2] "f:networkPlugin": {},
2021-07-19T10:17:38.4728041Z [cluster2] "f:routeAgentDaemonSetStatus": {
2021-07-19T10:17:38.4728734Z [cluster2] ".": {},
2021-07-19T10:17:38.4729321Z [cluster2] "f:lastResourceVersion": {},
2021-07-19T10:17:38.4730091Z [cluster2] "f:mismatchedContainerImages": {},
2021-07-19T10:17:38.4730923Z [cluster2] "f:nonReadyContainerStates": {},
2021-07-19T10:17:38.4731557Z [cluster2] "f:status": {
2021-07-19T10:17:38.4732015Z [cluster2] ".": {},
2021-07-19T10:17:38.4732616Z [cluster2] "f:currentNumberScheduled": {},
2021-07-19T10:17:38.4733402Z [cluster2] "f:desiredNumberScheduled": {},
2021-07-19T10:17:38.4734105Z [cluster2] "f:numberAvailable": {},
2021-07-19T10:17:38.4734746Z [cluster2] "f:numberMisscheduled": {},
2021-07-19T10:17:38.4735370Z [cluster2] "f:numberReady": {},
2021-07-19T10:17:38.4735979Z [cluster2] "f:observedGeneration": {},
2021-07-19T10:17:38.4736722Z [cluster2] "f:updatedNumberScheduled": {}
2021-07-19T10:17:38.4737311Z [cluster2] }
2021-07-19T10:17:38.4737728Z [cluster2] },
2021-07-19T10:17:38.4738202Z [cluster2] "f:serviceCIDR": {}
2021-07-19T10:17:38.4738679Z [cluster2] }
2021-07-19T10:17:38.4739081Z [cluster2] },
2021-07-19T10:17:38.4739997Z [cluster2] "manager": "submariner-operator",
2021-07-19T10:17:38.4740654Z [cluster2] "operation": "Update",
2021-07-19T10:17:38.4741337Z [cluster2] "time": "2021-07-19T10:16:41Z"
2021-07-19T10:17:38.4741782Z [cluster2] }
2021-07-19T10:17:38.4742161Z [cluster2] ],
2021-07-19T10:17:38.4742620Z [cluster2] "name": "submariner",
2021-07-19T10:17:38.4743401Z [cluster2] "namespace": "submariner-operator",
2021-07-19T10:17:38.4744079Z [cluster2] "resourceVersion": "2601",
2021-07-19T10:17:38.4745052Z [cluster2] "uid": "3febaa0a-9ec0-4693-9c94-c7011a26e20f"
2021-07-19T10:17:38.4745676Z [cluster2] },
2021-07-19T10:17:38.4794417Z [cluster2] "spec": {
2021-07-19T10:17:38.4794873Z [cluster2] "broker": "k8s",
2021-07-19T10:17:38.4795457Z [cluster2] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-19T10:17:38.5067780Z [cluster2] "brokerK8sApiServerToken": "***",
2021-07-19T10:17:38.5648678Z [cluster2] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T10:17:38.6233795Z [cluster2] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T10:17:38.6234787Z [cluster2] "cableDriver": "libreswan",
2021-07-19T10:17:38.6235459Z [cluster2] "ceIPSecDebug": false,
2021-07-19T10:17:38.6236092Z [cluster2] "ceIPSecIKEPort": 500,
2021-07-19T10:17:38.6236718Z [cluster2] "ceIPSecNATTPort": 4500,
2021-07-19T10:17:38.6237982Z [cluster2] "ceIPSecPSK": "czdwAxS8tlU3Oq9X1YPPzvsBfsf/+CmCaFhBIzhusHMbHL4cvAbKKvEgfvk1kAgo",
2021-07-19T10:17:38.6239171Z [cluster2] "clusterCIDR": "",
2021-07-19T10:17:38.6239750Z [cluster2] "clusterID": "cluster2",
2021-07-19T10:17:38.6240334Z [cluster2] "colorCodes": "blue",
2021-07-19T10:17:38.6241011Z [cluster2] "connectionHealthCheck": {
2021-07-19T10:17:38.6241667Z [cluster2] "enabled": true,
2021-07-19T10:17:38.6242243Z [cluster2] "intervalSeconds": 1,
2021-07-19T10:17:38.6242909Z [cluster2] "maxPacketLossCount": 5
2021-07-19T10:17:38.6243452Z [cluster2] },
2021-07-19T10:17:38.6243915Z [cluster2] "debug": false,
2021-07-19T10:17:38.6244778Z [cluster2] "namespace": "submariner-operator",
2021-07-19T10:17:38.6245473Z [cluster2] "natEnabled": false,
2021-07-19T10:17:38.6246069Z [cluster2] "repository": "localhost:5000",
2021-07-19T10:17:38.6246665Z [cluster2] "serviceCIDR": "",
2021-07-19T10:17:38.6247364Z [cluster2] "serviceDiscoveryEnabled": true,
2021-07-19T10:17:38.6248058Z [cluster2] "version": "local"
2021-07-19T10:17:38.6248525Z [cluster2] },
2021-07-19T10:17:38.6248949Z [cluster2] "status": {
2021-07-19T10:17:38.6249475Z [cluster2] "clusterCIDR": "10.2.0.0/16",
2021-07-19T10:17:38.6250049Z [cluster2] "clusterID": "cluster2",
2021-07-19T10:17:38.6250635Z [cluster2] "colorCodes": "blue",
2021-07-19T10:17:38.6251212Z [cluster2] "deploymentInfo": {},
2021-07-19T10:17:38.6251921Z [cluster2] "gatewayDaemonSetStatus": {
2021-07-19T10:17:38.6252673Z [cluster2] "lastResourceVersion": "2338",
2021-07-19T10:17:38.6253774Z [cluster2] "mismatchedContainerImages": false,
2021-07-19T10:17:38.6254646Z [cluster2] "nonReadyContainerStates": [],
2021-07-19T10:17:38.6255308Z [cluster2] "status": {
2021-07-19T10:17:38.6256006Z [cluster2] "currentNumberScheduled": 1,
2021-07-19T10:17:38.6256809Z [cluster2] "desiredNumberScheduled": 1,
2021-07-19T10:17:38.6257543Z [cluster2] "numberAvailable": 1,
2021-07-19T10:17:38.6258202Z [cluster2] "numberMisscheduled": 0,
2021-07-19T10:17:38.6258846Z [cluster2] "numberReady": 1,
2021-07-19T10:17:38.6259467Z [cluster2] "observedGeneration": 1,
2021-07-19T10:17:38.6260234Z [cluster2] "updatedNumberScheduled": 1
2021-07-19T10:17:38.6260843Z [cluster2] }
2021-07-19T10:17:38.6261268Z [cluster2] },
2021-07-19T10:17:38.6261718Z [cluster2] "gateways": [
2021-07-19T10:17:38.6262181Z [cluster2] {
2021-07-19T10:17:38.6262662Z [cluster2] "connections": [
2021-07-19T10:17:38.6263161Z [cluster2] {
2021-07-19T10:17:38.6263653Z [cluster2] "endpoint": {
2021-07-19T10:17:38.6264219Z [cluster2] "backend": "libreswan",
2021-07-19T10:17:38.6264818Z [cluster2] "backend_config": {
2021-07-19T10:17:38.6265700Z [cluster2] "natt-discovery-port": "4490",
2021-07-19T10:17:38.6266638Z [cluster2] "preferred-server": "false"
2021-07-19T10:17:38.6267348Z [cluster2] },
2021-07-19T10:17:38.6268451Z [cluster2] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-19T10:17:38.6269408Z [cluster2] "cluster_id": "cluster1",
2021-07-19T10:17:38.6270053Z [cluster2] "healthCheckIP": "10.1.128.0",
2021-07-19T10:17:38.6270943Z [cluster2] "hostname": "cluster1-worker",
2021-07-19T10:17:38.6271597Z [cluster2] "nat_enabled": false,
2021-07-19T10:17:38.6294289Z [cluster2] "private_ip": "172.18.0.8",
2021-07-19T10:17:38.6294836Z [cluster2] "public_ip": "52.254.6.73",
2021-07-19T10:17:38.6295344Z [cluster2] "subnets": [
2021-07-19T10:17:38.6295804Z [cluster2] "100.1.0.0/16",
2021-07-19T10:17:38.6296257Z [cluster2] "10.1.0.0/16"
2021-07-19T10:17:38.6296715Z [cluster2] ]
2021-07-19T10:17:38.6297122Z [cluster2] },
2021-07-19T10:17:38.6297593Z [cluster2] "latencyRTT": {
2021-07-19T10:17:38.6298538Z [cluster2] "average": "217.381µs",
2021-07-19T10:17:38.6449672Z [cluster2] 0:16:45.081611 1 submariner_networkdiscovery.go:77] controller_submariner "msg"="Using detected CIDR" "CIDR"="100.1.0.0/16" "type"="Service"
2021-07-19T10:17:38.6452437Z [cluster1] I0719 10:16:45.090152 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:38.6455709Z [cluster1] I0719 10:16:45.093461 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:38.6458970Z [cluster1] I0719 10:16:45.095674 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-gateway" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:38.6462348Z [cluster1] I0719 10:16:45.111514 1 helpers.go:233] controller_submariner "msg"="Updated existing Service" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "Service.Name"="submariner-gateway-metrics" "Service.Namespace"="submariner-operator"
2021-07-19T10:17:38.6465579Z [cluster1] I0719 10:16:45.695771 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:38.6468781Z [cluster1] I0719 10:16:45.705967 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:38.6472253Z [cluster1] I0719 10:16:45.721019 1 metrics.go:55] controller_submariner "msg"="Install prometheus-operator in your cluster to create ServiceMonitor objects" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "error"="no ServiceMonitor registered with the API"
2021-07-19T10:17:38.6475455Z [cluster1] I0719 10:16:45.737766 1 helpers.go:85] controller_submariner "msg"="Updated existing DaemonSet" "Request.Name"="submariner" "Request.Namespace"="submariner-operator" "DaemonSet.Name"="submariner-routeagent" "DaemonSet.Namespace"="submariner-operator"
2021-07-19T10:17:38.6478801Z [cluster1] E0719 10:17:02.982353 1 controller.go:267] controller-runtime/manager/controller/broker "msg"="Reconciler error" "error"="invalid GlobalnetCidrRange: invalid CIDR address: " "name"="submariner-broker" "namespace"="submariner-operator" "reconciler group"="submariner.io" "reconciler kind"="Broker"
2021-07-19T10:17:38.6481011Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-19T10:17:38.6481993Z [submariner-operator]$ [cluster1] verify_subm_cr
2021-07-19T10:17:38.6483265Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-19T10:17:38.6484761Z [submariner-operator]$ [cluster1] kubectl get submariner --namespace=submariner-operator
2021-07-19T10:17:38.6486012Z [submariner-operator]$ [cluster1] grep submariner
2021-07-19T10:17:38.6487451Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner --namespace=submariner-operator
2021-07-19T10:17:38.6488469Z [cluster1] submariner 81s
2021-07-19T10:17:38.6489538Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-19T10:17:38.6491083Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.6492575Z [submariner-operator]$ [cluster1] tee /tmp/submariner.cluster1.json
2021-07-19T10:17:38.6494110Z [submariner-operator]$ [cluster1] kubectl get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.6495909Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:38.6497064Z [cluster1] {
2021-07-19T10:17:38.6497641Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.6498303Z [cluster1] "kind": "Submariner",
2021-07-19T10:17:38.6498820Z [cluster1] "metadata": {
2021-07-19T10:17:38.6499638Z [cluster1] "creationTimestamp": "2021-07-19T10:16:17Z",
2021-07-19T10:17:38.6500256Z [cluster1] "generation": 1,
2021-07-19T10:17:38.6500822Z [cluster1] "managedFields": [
2021-07-19T10:17:38.6501327Z [cluster1] {
2021-07-19T10:17:38.6501913Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.6502625Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:38.6503187Z [cluster1] "fieldsV1": {
2021-07-19T10:17:38.6503693Z [cluster1] "f:spec": {
2021-07-19T10:17:38.6504244Z [cluster1] ".": {},
2021-07-19T10:17:38.6504739Z [cluster1] "f:broker": {},
2021-07-19T10:17:38.6505354Z [cluster1] "f:brokerK8sApiServer": {},
2021-07-19T10:17:38.6506153Z [cluster1] "f:brokerK8sApiServerToken": {},
2021-07-19T10:17:38.6506863Z [cluster1] "f:brokerK8sCA": {},
2021-07-19T10:17:38.6507602Z [cluster1] "f:brokerK8sRemoteNamespace": {},
2021-07-19T10:17:38.6508344Z [cluster1] "f:cableDriver": {},
2021-07-19T10:17:38.6508945Z [cluster1] "f:ceIPSecDebug": {},
2021-07-19T10:17:38.6509589Z [cluster1] "f:ceIPSecIKEPort": {},
2021-07-19T10:17:38.6510239Z [cluster1] "f:ceIPSecNATTPort": {},
2021-07-19T10:17:38.6510864Z [cluster1] "f:ceIPSecPSK": {},
2021-07-19T10:17:38.6511438Z [cluster1] "f:clusterCIDR": {},
2021-07-19T10:17:38.6536475Z [cluster1] "f:clusterID": {},
2021-07-19T10:17:38.6537217Z [cluster1] "f:colorCodes": {},
2021-07-19T10:17:38.6537914Z [cluster1] "f:connectionHealthCheck": {
2021-07-19T10:17:38.6538548Z [cluster1] ".": {},
2021-07-19T10:17:38.6539038Z [cluster1] "f:enabled": {},
2021-07-19T10:17:38.6539646Z [cluster1] "f:intervalSeconds": {},
2021-07-19T10:17:38.6540331Z [cluster1] "f:maxPacketLossCount": {}
2021-07-19T10:17:38.6541078Z [cluster1] },
2021-07-19T10:17:38.6541544Z [cluster1] "f:debug": {},
2021-07-19T10:17:38.6542074Z [cluster1] "f:namespace": {},
2021-07-19T10:17:38.6542627Z [cluster1] "f:natEnabled": {},
2021-07-19T10:17:38.6543200Z [cluster1] "f:repository": {},
2021-07-19T10:17:38.6543787Z [cluster1] "f:serviceCIDR": {},
2021-07-19T10:17:38.6544505Z [cluster1] "f:serviceDiscoveryEnabled": {},
2021-07-19T10:17:38.6545197Z [cluster1] "f:version": {}
2021-07-19T10:17:38.6545665Z [cluster1] }
2021-07-19T10:17:38.6546096Z [cluster1] },
2021-07-19T10:17:38.6546577Z [cluster1] "manager": "subctl",
2021-07-19T10:17:38.6547150Z [cluster1] "operation": "Update",
2021-07-19T10:17:38.6548041Z [cluster1] "time": "2021-07-19T10:16:17Z"
2021-07-19T10:17:38.6548523Z [cluster1] },
2021-07-19T10:17:38.6548938Z [cluster1] {
2021-07-19T10:17:38.6549548Z [cluster1] "apiVersion": "submariner.io/v1alpha1",
2021-07-19T10:17:38.6550262Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:38.6550825Z [cluster1] "fieldsV1": {
2021-07-19T10:17:38.6551338Z [cluster1] "f:status": {
2021-07-19T10:17:38.6551986Z [cluster1] ".": {},
2021-07-19T10:17:38.6552518Z [cluster1] "f:clusterCIDR": {},
2021-07-19T10:17:38.6553077Z [cluster1] "f:clusterID": {},
2021-07-19T10:17:38.6553645Z [cluster1] "f:colorCodes": {},
2021-07-19T10:17:38.6554237Z [cluster1] "f:deploymentInfo": {},
2021-07-19T10:17:38.6554981Z [cluster1] "f:gatewayDaemonSetStatus": {
2021-07-19T10:17:38.6555642Z [cluster1] ".": {},
2021-07-19T10:17:38.6556236Z [cluster1] "f:lastResourceVersion": {},
2021-07-19T10:17:38.6557081Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-19T10:17:38.6557968Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-19T10:17:38.6558663Z [cluster1] "f:status": {
2021-07-19T10:17:38.6559144Z [cluster1] ".": {},
2021-07-19T10:17:38.6559901Z [cluster1] "f:currentNumberScheduled": {},
2021-07-19T10:17:38.6560740Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-19T10:17:38.6561505Z [cluster1] "f:numberAvailable": {},
2021-07-19T10:17:38.6562224Z [cluster1] "f:numberMisscheduled": {},
2021-07-19T10:17:38.6562882Z [cluster1] "f:numberReady": {},
2021-07-19T10:17:38.6563563Z [cluster1] "f:observedGeneration": {},
2021-07-19T10:17:38.6564347Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-19T10:17:38.6564993Z [cluster1] }
2021-07-19T10:17:38.6565426Z [cluster1] },
2021-07-19T10:17:38.6565924Z [cluster1] "f:gateways": {},
2021-07-19T10:17:38.6566642Z [cluster1] "f:globalnetDaemonSetStatus": {
2021-07-19T10:17:38.6567306Z [cluster1] ".": {},
2021-07-19T10:17:38.6567997Z [cluster1] "f:mismatchedContainerImages": {}
2021-07-19T10:17:38.6568665Z [cluster1] },
2021-07-19T10:17:38.6569256Z [cluster1] "f:loadBalancerStatus": {},
2021-07-19T10:17:38.6569887Z [cluster1] "f:natEnabled": {},
2021-07-19T10:17:38.6570489Z [cluster1] "f:networkPlugin": {},
2021-07-19T10:17:38.6571313Z [cluster1] "f:routeAgentDaemonSetStatus": {
2021-07-19T10:17:38.6572004Z [cluster1] ".": {},
2021-07-19T10:17:38.6572611Z [cluster1] "f:lastResourceVersion": {},
2021-07-19T10:17:38.6573442Z [cluster1] "f:mismatchedContainerImages": {},
2021-07-19T10:17:38.6574336Z [cluster1] "f:nonReadyContainerStates": {},
2021-07-19T10:17:38.6575015Z [cluster1] "f:status": {
2021-07-19T10:17:38.6575507Z [cluster1] ".": {},
2021-07-19T10:17:38.6576156Z [cluster1] "f:currentNumberScheduled": {},
2021-07-19T10:17:38.6577006Z [cluster1] "f:desiredNumberScheduled": {},
2021-07-19T10:17:38.6577749Z [cluster1] "f:numberAvailable": {},
2021-07-19T10:17:38.6578456Z [cluster1] "f:numberMisscheduled": {},
2021-07-19T10:17:38.6579134Z [cluster1] "f:numberReady": {},
2021-07-19T10:17:38.6579786Z [cluster1] "f:observedGeneration": {},
2021-07-19T10:17:38.6580577Z [cluster1] "f:updatedNumberScheduled": {}
2021-07-19T10:17:38.6581251Z [cluster1] }
2021-07-19T10:17:38.6581696Z [cluster1] },
2021-07-19T10:17:38.6582201Z [cluster1] "f:serviceCIDR": {}
2021-07-19T10:17:38.6582716Z [cluster1] }
2021-07-19T10:17:38.6583133Z [cluster1] },
2021-07-19T10:17:38.6583997Z [cluster1] "manager": "submariner-operator",
2021-07-19T10:17:38.6584689Z [cluster1] "operation": "Update",
2021-07-19T10:17:38.6585410Z [cluster1] "time": "2021-07-19T10:16:34Z"
2021-07-19T10:17:38.6585886Z [cluster1] }
2021-07-19T10:17:38.6586289Z [cluster1] ],
2021-07-19T10:17:38.6586791Z [cluster1] "name": "submariner",
2021-07-19T10:17:38.6587637Z [cluster1] "namespace": "submariner-operator",
2021-07-19T10:17:38.6588366Z [cluster1] "resourceVersion": "2553",
2021-07-19T10:17:38.6589229Z [cluster1] "uid": "065221d8-9c57-4da7-936a-6478dee7bf8a"
2021-07-19T10:17:38.6589802Z [cluster1] },
2021-07-19T10:17:38.6590218Z [cluster1] "spec": {
2021-07-19T10:17:38.6590690Z [cluster1] "broker": "k8s",
2021-07-19T10:17:38.6591377Z [cluster1] "brokerK8sApiServer": "172.18.0.6:6443",
2021-07-19T10:17:38.6759712Z [cluster1] "brokerK8sApiServerToken": "***",
2021-07-19T10:17:38.7263675Z [cluster1] "brokerK8sCA": "LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==",
2021-07-19T10:17:38.7815460Z [cluster1] "brokerK8sRemoteNamespace": "submariner-k8s-broker",
2021-07-19T10:17:38.7816403Z [cluster1] "cableDriver": "libreswan",
2021-07-19T10:17:38.7817064Z [cluster1] "ceIPSecDebug": false,
2021-07-19T10:17:38.7817678Z [cluster1] "ceIPSecIKEPort": 500,
2021-07-19T10:17:38.7818313Z [cluster1] "ceIPSecNATTPort": 4500,
2021-07-19T10:17:38.7819597Z [cluster1] "ceIPSecPSK": "czdwAxS8tlU3Oq9X1YPPzvsBfsf/+CmCaFhBIzhusHMbHL4cvAbKKvEgfvk1kAgo",
2021-07-19T10:17:38.7821541Z [cluster1] "clusterCIDR": "",
2021-07-19T10:17:38.7822128Z [cluster1] "clusterID": "cluster1",
2021-07-19T10:17:38.7822700Z [cluster1] "colorCodes": "blue",
2021-07-19T10:17:38.7823370Z [cluster1] "connectionHealthCheck": {
2021-07-19T10:17:38.7824013Z [cluster1] "enabled": true,
2021-07-19T10:17:38.7824601Z [cluster1] "intervalSeconds": 1,
2021-07-19T10:17:38.7825264Z [cluster1] "maxPacketLossCount": 5
2021-07-19T10:17:38.7825821Z [cluster1] },
2021-07-19T10:17:38.7826289Z [cluster1] "debug": false,
2021-07-19T10:17:38.7827191Z [cluster1] "namespace": "submariner-operator",
2021-07-19T10:17:38.7827895Z [cluster1] "natEnabled": false,
2021-07-19T10:17:38.7828491Z [cluster1] "repository": "localhost:5000",
2021-07-19T10:17:38.7829085Z [cluster1] "serviceCIDR": "",
2021-07-19T10:17:38.7829788Z [cluster1] "serviceDiscoveryEnabled": true,
2021-07-19T10:17:38.7830487Z [cluster1] "version": "local"
2021-07-19T10:17:38.7830944Z [cluster1] },
2021-07-19T10:17:38.7831382Z [cluster1] "status": {
2021-07-19T10:17:38.7832174Z [cluster1] "clusterCIDR": "10.1.0.0/16",
2021-07-19T10:17:38.7832766Z [cluster1] "clusterID": "cluster1",
2021-07-19T10:17:38.7833358Z [cluster1] "colorCodes": "blue",
2021-07-19T10:17:38.7833938Z [cluster1] "deploymentInfo": {},
2021-07-19T10:17:38.7834655Z [cluster1] "gatewayDaemonSetStatus": {
2021-07-19T10:17:38.7835410Z [cluster1] "lastResourceVersion": "2506",
2021-07-19T10:17:38.7836246Z [cluster1] "mismatchedContainerImages": false,
2021-07-19T10:17:38.7837112Z [cluster1] "nonReadyContainerStates": [],
2021-07-19T10:17:38.7837778Z [cluster1] "status": {
2021-07-19T10:17:38.7838407Z [cluster1] "currentNumberScheduled": 1,
2021-07-19T10:17:38.7839431Z [cluster1] "desiredNumberScheduled": 1,
2021-07-19T10:17:38.7840156Z [cluster1] "numberAvailable": 1,
2021-07-19T10:17:38.7840830Z [cluster1] "numberMisscheduled": 0,
2021-07-19T10:17:38.7841470Z [cluster1] "numberReady": 1,
2021-07-19T10:17:38.7842089Z [cluster1] "observedGeneration": 1,
2021-07-19T10:17:38.7842865Z [cluster1] "updatedNumberScheduled": 1
2021-07-19T10:17:38.7843472Z [cluster1] }
2021-07-19T10:17:38.7843901Z [cluster1] },
2021-07-19T10:17:38.7844347Z [cluster1] "gateways": [
2021-07-19T10:17:38.7844808Z [cluster1] {
2021-07-19T10:17:38.7845284Z [cluster1] "connections": [
2021-07-19T10:17:38.7845781Z [cluster1] {
2021-07-19T10:17:38.7846252Z [cluster1] "endpoint": {
2021-07-19T10:17:38.7846828Z [cluster1] "backend": "libreswan",
2021-07-19T10:17:38.7847424Z [cluster1] "backend_config": {
2021-07-19T10:17:38.7848325Z [cluster1] "natt-discovery-port": "4490",
2021-07-19T10:17:38.7849262Z [cluster1] "preferred-server": "false"
2021-07-19T10:17:38.7849844Z [cluster1] },
2021-07-19T10:17:38.7850932Z [cluster1] "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-19T10:17:38.7852354Z [cluster1] "cluster_id": "cluster2",
2021-07-19T10:17:38.7853174Z [cluster1] "healthCheckIP": "10.2.128.0",
2021-07-19T10:17:38.7854096Z [cluster1] "hostname": "cluster2-worker",
2021-07-19T10:17:38.7854767Z [cluster1] "nat_enabled": false,
2021-07-19T10:17:38.7855350Z [cluster1] "private_ip": "172.18.0.5",
2021-07-19T10:17:38.7855893Z [cluster1] "public_ip": "52.254.6.73",
2021-07-19T10:17:38.7856436Z [cluster1] "subnets": [
2021-07-19T10:17:38.7856924Z [cluster1] "100.2.0.0/16",
2021-07-19T10:17:38.7857401Z [cluster1] "10.2.0.0/16"
2021-07-19T10:17:38.7857842Z [cluster1] ]
2021-07-19T10:17:38.7858286Z [cluster1] },
2021-07-19T10:17:38.7858781Z [cluster1] "latencyRTT": {
2021-07-19T10:17:38.7859333Z [cluster1] "average": "0s",
2021-07-19T10:17:38.7859851Z [cluster1] "last": "0s",
2021-07-19T10:17:38.7861376Z [cluster1] "max": "0s",
2021-07-19T10:17:38.7861879Z [cluster1] "min": "0s",
2021-07-19T10:17:38.7863300Z [cluster1] "stdDev": "0s"
2021-07-19T10:17:38.7864691Z [cluster1] },
2021-07-19T10:17:38.7865192Z [cluster1] "status": "error",
2021-07-19T10:17:38.7866006Z [cluster1] "statusMessage": "Failed to successfully ping the remote endpoint IP \"10.2.128.0\"",
2021-07-19T10:17:38.7866788Z [cluster1] "usingIP": "172.18.0.5"
2021-07-19T10:17:38.7867277Z [cluster1] }
2021-07-19T10:17:38.7867707Z [cluster1] ],
2021-07-19T10:17:38.7868197Z [cluster1] "haStatus": "active",
2021-07-19T10:17:38.7868777Z [cluster1] "localEndpoint": {
2021-07-19T10:17:38.7869368Z [cluster1] "backend": "libreswan",
2021-07-19T10:17:38.7869949Z [cluster1] "backend_config": {
2021-07-19T10:17:38.7870915Z [cluster1] "natt-discovery-port": "4490",
2021-07-19T10:17:38.7871948Z [cluster1] "preferred-server": "false"
2021-07-19T10:17:38.7872519Z [cluster1] },
2021-07-19T10:17:38.7873738Z [cluster1] "cable_name": "submariner-cable-cluster1-172-18-0-8",
2021-07-19T10:17:38.7874695Z [cluster1] "cluster_id": "cluster1",
2021-07-19T10:17:38.8735691Z [cluster1] "last": "163.401µs",
2021-07-19T10:17:38.8736217Z [cluster2] "max": "1.677511ms",
2021-07-19T10:17:38.8736875Z [cluster2] "min": "120.001µs",
2021-07-19T10:17:38.8737515Z [cluster2] "stdDev": "205.556µs"
2021-07-19T10:17:38.8737980Z [cluster2] },
2021-07-19T10:17:38.8738481Z [cluster2] "status": "connected",
2021-07-19T10:17:38.8739046Z [cluster2] "statusMessage": "",
2021-07-19T10:17:38.8739577Z [cluster2] "usingIP": "172.18.0.8"
2021-07-19T10:17:38.8740027Z [cluster2] }
2021-07-19T10:17:38.8740420Z [cluster2] ],
2021-07-19T10:17:38.8740889Z [cluster2] "haStatus": "active",
2021-07-19T10:17:38.8741438Z [cluster2] "localEndpoint": {
2021-07-19T10:17:38.8741984Z [cluster2] "backend": "libreswan",
2021-07-19T10:17:38.8742518Z [cluster2] "backend_config": {
2021-07-19T10:17:38.8743288Z [cluster2] "natt-discovery-port": "4490",
2021-07-19T10:17:38.8744134Z [cluster2] "preferred-server": "false"
2021-07-19T10:17:38.8744656Z [cluster2] },
2021-07-19T10:17:38.8745642Z [cluster2] "cable_name": "submariner-cable-cluster2-172-18-0-5",
2021-07-19T10:17:38.8746667Z [cluster2] "cluster_id": "cluster2",
2021-07-19T10:17:38.8747249Z [cluster2] "healthCheckIP": "10.2.128.0",
2021-07-19T10:17:38.8748054Z [cluster2] "hostname": "cluster2-worker",
2021-07-19T10:17:38.8748646Z [cluster2] "nat_enabled": false,
2021-07-19T10:17:38.8749176Z [cluster2] "private_ip": "172.18.0.5",
2021-07-19T10:17:38.8749674Z [cluster2] "public_ip": "52.254.6.73",
2021-07-19T10:17:38.8750166Z [cluster2] "subnets": [
2021-07-19T10:17:38.8750603Z [cluster2] "100.2.0.0/16",
2021-07-19T10:17:38.8751040Z [cluster2] "10.2.0.0/16"
2021-07-19T10:17:38.8751438Z [cluster2] ]
2021-07-19T10:17:38.8752037Z [cluster2] },
2021-07-19T10:17:38.8752505Z [cluster2] "statusFailure": "",
2021-07-19T10:17:38.8753267Z [cluster2] "version": "devel-1441a80"
2021-07-19T10:17:38.8754083Z [cluster2] }
2021-07-19T10:17:38.8754493Z [cluster2] ],
2021-07-19T10:17:38.8755129Z [cluster2] "globalnetDaemonSetStatus": {
2021-07-19T10:17:38.8756004Z [cluster2] "mismatchedContainerImages": false
2021-07-19T10:17:38.8756670Z [cluster2] },
2021-07-19T10:17:38.8757213Z [cluster2] "loadBalancerStatus": {},
2021-07-19T10:17:38.8757852Z [cluster2] "natEnabled": false,
2021-07-19T10:17:38.8758649Z [cluster2] "networkPlugin": "weave-net",
2021-07-19T10:17:38.8759443Z [cluster2] "routeAgentDaemonSetStatus": {
2021-07-19T10:17:38.8760279Z [cluster2] "lastResourceVersion": "2408",
2021-07-19T10:17:38.8761186Z [cluster2] "mismatchedContainerImages": false,
2021-07-19T10:17:38.8762071Z [cluster2] "nonReadyContainerStates": [],
2021-07-19T10:17:38.8762713Z [cluster2] "status": {
2021-07-19T10:17:38.8763464Z [cluster2] "currentNumberScheduled": 3,
2021-07-19T10:17:38.8764262Z [cluster2] "desiredNumberScheduled": 3,
2021-07-19T10:17:38.8764987Z [cluster2] "numberAvailable": 3,
2021-07-19T10:17:38.8765641Z [cluster2] "numberMisscheduled": 0,
2021-07-19T10:17:38.8766276Z [cluster2] "numberReady": 3,
2021-07-19T10:17:38.8766895Z [cluster2] "observedGeneration": 1,
2021-07-19T10:17:38.8767830Z [cluster2] "updatedNumberScheduled": 3
2021-07-19T10:17:38.8768573Z [cluster2] }
2021-07-19T10:17:38.8768999Z [cluster2] },
2021-07-19T10:17:38.8769499Z [cluster2] "serviceCIDR": "100.2.0.0/16"
2021-07-19T10:17:38.8769973Z [cluster2] }
2021-07-19T10:17:38.8770460Z [cluster2] }
2021-07-19T10:17:38.8771602Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-19T10:17:38.8773205Z [submariner-operator]$ [cluster2] validate_equals .metadata.namespace submariner-operator
2021-07-19T10:17:38.8774821Z [submariner-operator]$ [cluster2] jq -r -M .metadata.namespace /tmp/submariner.cluster2.json
2021-07-19T10:17:38.8776344Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T10:17:38.8777731Z [submariner-operator]$ [cluster2] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T10:17:38.8779169Z [submariner-operator]$ [cluster2] jq -r -M .apiVersion /tmp/submariner.cluster2.json
2021-07-19T10:17:38.8780586Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-19T10:17:38.8781760Z [submariner-operator]$ [cluster2] validate_equals .kind Submariner
2021-07-19T10:17:38.8783049Z [submariner-operator]$ [cluster2] jq -r -M .kind /tmp/submariner.cluster2.json
2021-07-19T10:17:38.8784378Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-19T10:17:38.8785676Z [submariner-operator]$ [cluster2] validate_equals .metadata.name submariner
2021-07-19T10:17:38.8787209Z [submariner-operator]$ [cluster2] jq -r -M .metadata.name /tmp/submariner.cluster2.json
2021-07-19T10:17:38.8788712Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-19T10:17:38.8790183Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-19T10:17:38.8796120Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster2.json
2021-07-19T10:17:38.9304551Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T10:17:38.9467396Z [submariner-operator]$ [cluster2] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T10:17:38.9469556Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster2.json
2021-07-19T10:17:39.0037787Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:39.0609706Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0 "healthCheckIP": "10.1.128.0",
2021-07-19T10:17:39.0625364Z [cluster1] "hostname": "cluster1-worker",
2021-07-19T10:17:39.0626407Z [cluster1] "nat_enabled": false,
2021-07-19T10:17:39.0627244Z [cluster1] "private_ip": "172.18.0.8",
2021-07-19T10:17:39.0627804Z [cluster1] "public_ip": "52.254.6.73",
2021-07-19T10:17:39.0628527Z [cluster1] "subnets": [
2021-07-19T10:17:39.0629183Z [cluster1] "100.1.0.0/16",
2021-07-19T10:17:39.0629811Z [cluster1] "10.1.0.0/16"
2021-07-19T10:17:39.0630400Z [cluster1] ]
2021-07-19T10:17:39.0631303Z [cluster1] },
2021-07-19T10:17:39.0632132Z [cluster1] "statusFailure": "",
2021-07-19T10:17:39.0633593Z [cluster1] "version": "devel-1441a80"
2021-07-19T10:17:39.0634142Z [cluster1] }
2021-07-19T10:17:39.0634969Z [cluster1] ],
2021-07-19T10:17:39.0635749Z [cluster1] "globalnetDaemonSetStatus": {
2021-07-19T10:17:39.0636635Z [cluster1] "mismatchedContainerImages": false
2021-07-19T10:17:39.0637310Z [cluster1] },
2021-07-19T10:17:39.0638000Z [cluster1] "loadBalancerStatus": {},
2021-07-19T10:17:39.0638634Z [cluster1] "natEnabled": false,
2021-07-19T10:17:39.0639483Z [cluster1] "networkPlugin": "weave-net",
2021-07-19T10:17:39.0640287Z [cluster1] "routeAgentDaemonSetStatus": {
2021-07-19T10:17:39.0641096Z [cluster1] "lastResourceVersion": "2452",
2021-07-19T10:17:39.0641911Z [cluster1] "mismatchedContainerImages": false,
2021-07-19T10:17:39.0642799Z [cluster1] "nonReadyContainerStates": [],
2021-07-19T10:17:39.0643442Z [cluster1] "status": {
2021-07-19T10:17:39.0644086Z [cluster1] "currentNumberScheduled": 3,
2021-07-19T10:17:39.0644886Z [cluster1] "desiredNumberScheduled": 3,
2021-07-19T10:17:39.0645615Z [cluster1] "numberAvailable": 3,
2021-07-19T10:17:39.0646263Z [cluster1] "numberMisscheduled": 0,
2021-07-19T10:17:39.0646894Z [cluster1] "numberReady": 3,
2021-07-19T10:17:39.0647529Z [cluster1] "observedGeneration": 1,
2021-07-19T10:17:39.0648275Z [cluster1] "updatedNumberScheduled": 3
2021-07-19T10:17:39.0648891Z [cluster1] }
2021-07-19T10:17:39.0649397Z [cluster1] },
2021-07-19T10:17:39.0649856Z [cluster1] "serviceCIDR": "100.1.0.0/16"
2021-07-19T10:17:39.0650294Z [cluster1] }
2021-07-19T10:17:39.0650666Z [cluster1] }
2021-07-19T10:17:39.0651704Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-19T10:17:39.0653194Z [submariner-operator]$ [cluster1] validate_equals .metadata.namespace submariner-operator
2021-07-19T10:17:39.0654699Z [submariner-operator]$ [cluster1] jq -r -M .metadata.namespace /tmp/submariner.cluster1.json
2021-07-19T10:17:39.0656086Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T10:17:39.0657368Z [submariner-operator]$ [cluster1] validate_equals .apiVersion submariner.io/v1alpha1
2021-07-19T10:17:39.0658693Z [submariner-operator]$ [cluster1] jq -r -M .apiVersion /tmp/submariner.cluster1.json
2021-07-19T10:17:39.0659927Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-19T10:17:39.0660999Z [submariner-operator]$ [cluster1] validate_equals .kind Submariner
2021-07-19T10:17:39.0662197Z [submariner-operator]$ [cluster1] jq -r -M .kind /tmp/submariner.cluster1.json
2021-07-19T10:17:39.0663597Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-19T10:17:39.0665038Z [submariner-operator]$ [cluster1] validate_equals .metadata.name submariner
2021-07-19T10:17:39.0666464Z [submariner-operator]$ [cluster1] jq -r -M .metadata.name /tmp/submariner.cluster1.json
2021-07-19T10:17:39.0667971Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-19T10:17:39.0669443Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sApiServer 172.18.0.6:6443
2021-07-19T10:17:39.0671079Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServer /tmp/submariner.cluster1.json
2021-07-19T10:17:39.1125743Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T10:17:39.1372767Z [submariner-operator]$ [cluster1] validate_not_equals .spec.brokerK8sApiServerToken ***
2021-07-19T10:17:39.1375079Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sApiServerToken /tmp/submariner.cluster1.json
2021-07-19T10:17:39.2101353Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:39.8513558Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sCA LS0tLS1CRUdJTiBDRVJUSUZJQ0FURS0tLS0tCk1JSUM1ekNDQWMrZ0F3SUJBZ0lCQURBTkJna3Foa2lHOXcwQkFRc0ZBREFWTVJNd0VRWURWUVFERXdwcmRXSmwKY201bGRHVnpNQjRYRFRJeE1EY3hPVEV3TURjeU9Gb1hEVE14TURjeE56RXdNRGN5T0Zvd0ZURVRNQkVHQTFVRQpBeE1LYTNWaVpYSnVaWFJsY3pDQ0FTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTFTSXdEUVlKS29aSWh2Y05BUUVCQlFBRGdnRVBBRENDQVFvQ2dnRUJBTlJGCk5rMHIrMW1YSnZYWjBEaWJiL3NBTUloVmxxRGpRRXhweEFlMEVlTTl0WnRPVUZXbWpBbytBUXYwWWs0Skl2bUsKdkQ3dzA4QkhVaXVxSjFkZisyL2Exelc4bGJhYktSMERlSkhZSGdvbUY1dzcrUEVQSENzdTB6SEcrdDQ4QXkzYQpwWmxGSHc2UmhIVFRTZXcvL0QwK0ovanNNblVuUFQwelZKQUlFM0VrSk5rL0hTazlUdGpqcFhyWEl3V1BlVVFzCkRrTURSNC8vTy80dGM4NkVkRUZOZklTQ1o1R0pxVFN0R0M0aVZPL2FCNTlzazVFMDlLdDI5WWhReUtNbUdpdXcKMUpKK05vLy8zUnlWeDg1WXcwNExzQURUclVMUEhrMm5PaEJLajg1aTRJOHM0MGF3Vm5yRzdjQm95bWIwVW5pawpGOG5ZN1BVYkZ6eXN1WUZ4SE5zQ0F3RUFBYU5DTUVBd0RnWURWUjBQQVFIL0JBUURBZ0trTUE4R0ExVWRFd0VCCi93UUZNQU1CQWY4d0hRWURWUjBPQkJZRUZMdjNWZklEV2hzNS9wWnRxQ0c1S0lBV3F0VHhNQTBHQ1NxR1NJYjMKRFFFQkN3VUFBNElCQVFCMnhSNVZvcmtzcm5PR0JnMmY0NU1qNDFmZ2pBdlJBWWNQYzJXb1ZHci9jWGdFMy9kNApBeTUxTUw2SGwvM0JCUmNGc3pjRjhQTVRpM25hYVJCSnJEUGpLbnltSHZwVzM5c1dVTlFhUVZ5UWJrUUFhUG1BCmdGNTEzQWFSdkVZZENjZjJHeSs1UWRQamlBYlZRNy95WkV4ekR2bmk5TEVKcVRBR1M4ZDFyRlhGcld2L1NYZGoKWXhqdTNBd0hkQVZnL216TlB1L1JJV05qT2NkZStUNzRudlNuUGptbGpkUkdDVjdqNmwyckp0Rnh5aTJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:40.0661976Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0712666Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T10:17:40.0715039Z [submariner-operator]$ [cluster2] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T10:17:40.0717030Z [submariner-operator]$ [cluster2] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0719043Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-19T10:17:40.0720366Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecDebug false
2021-07-19T10:17:40.0721874Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0723549Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T10:17:40.0724907Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T10:17:40.0726425Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0727961Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T10:17:40.0729329Z [submariner-operator]$ [cluster2] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T10:17:40.0730864Z [submariner-operator]$ [cluster2] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0732386Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-19T10:17:40.0733706Z [submariner-operator]$ [cluster2] validate_equals .spec.repository localhost:5000
2021-07-19T10:17:40.0735174Z [submariner-operator]$ [cluster2] jq -r -M .spec.repository /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0736558Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-19T10:17:40.0737749Z [submariner-operator]$ [cluster2] validate_equals .spec.version local
2021-07-19T10:17:40.0739128Z [submariner-operator]$ [cluster2] jq -r -M .spec.version /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0740441Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-19T10:17:40.0741610Z [submariner-operator]$ [cluster2] validate_equals .spec.broker k8s
2021-07-19T10:17:40.0742944Z [submariner-operator]$ [cluster2] jq -r -M .spec.broker /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0744562Z [submariner-operator]$ [cluster2] jq -r .spec.clusterID /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0745556Z [cluster2] Generated cluster id: cluster2
2021-07-19T10:17:40.0746605Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-19T10:17:40.0748000Z [submariner-operator]$ [cluster2] validate_equals .spec.colorCodes blue
2021-07-19T10:17:40.0749439Z [submariner-operator]$ [cluster2] jq -r -M .spec.colorCodes /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0750814Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-19T10:17:40.0785462Z [submariner-operator]$ [cluster2] validate_equals .spec.debug false
2021-07-19T10:17:40.0787066Z [submariner-operator]$ [cluster2] jq -r -M .spec.debug /tmp/submariner.cluster2.json
2021-07-19T10:17:40.0788501Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-19T10:17:40.0789891Z [submariner-operator]$ [cluster2] validate_equals .spec.namespace submariner-operator
2021-07-19T10:17:40.0800005Z [submariner-operator]$ [clustJUQjg4bApyTk5KTzhoLzhXNDlyeXJwWlE2cWU4cHFaMG9JV1BsQjVtenQ5Q0Vac3lJbGpQd0VOLzE2Rk4rUmM3YXpnTGYzCmVQckNPUWhUc0ZZSXpna2JtVmFMc3NRZmF1ZGVnS0JKR0tyRwotLS0tLUVORCBDRVJUSUZJQ0FURS0tLS0tCg==
2021-07-19T10:17:40.0809814Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sCA /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0811470Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T10:17:40.0813269Z [submariner-operator]$ [cluster1] validate_equals .spec.brokerK8sRemoteNamespace submariner-k8s-broker
2021-07-19T10:17:40.0815075Z [submariner-operator]$ [cluster1] jq -r -M .spec.brokerK8sRemoteNamespace /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0816782Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-19T10:17:40.0818018Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecDebug false
2021-07-19T10:17:40.0819666Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecDebug /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0821158Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T10:17:40.0822488Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecIKEPort 500
2021-07-19T10:17:40.0824013Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecIKEPort /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0825535Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T10:17:40.0826891Z [submariner-operator]$ [cluster1] validate_equals .spec.ceIPSecNATTPort 4500
2021-07-19T10:17:40.0828439Z [submariner-operator]$ [cluster1] jq -r -M .spec.ceIPSecNATTPort /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0829954Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-19T10:17:40.0831293Z [submariner-operator]$ [cluster1] validate_equals .spec.repository localhost:5000
2021-07-19T10:17:40.0874010Z [submariner-operator]$ [cluster1] jq -r -M .spec.repository /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0875569Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-19T10:17:40.0876788Z [submariner-operator]$ [cluster1] validate_equals .spec.version local
2021-07-19T10:17:40.0878154Z [submariner-operator]$ [cluster1] jq -r -M .spec.version /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0879486Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-19T10:17:40.0880641Z [submariner-operator]$ [cluster1] validate_equals .spec.broker k8s
2021-07-19T10:17:40.0881995Z [submariner-operator]$ [cluster1] jq -r -M .spec.broker /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0883523Z [submariner-operator]$ [cluster1] jq -r .spec.clusterID /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0884512Z [cluster1] Generated cluster id: cluster1
2021-07-19T10:17:40.0885573Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-19T10:17:40.0886822Z [submariner-operator]$ [cluster1] validate_equals .spec.colorCodes blue
2021-07-19T10:17:40.0888431Z [submariner-operator]$ [cluster1] jq -r -M .spec.colorCodes /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0889809Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-19T10:17:40.0890994Z [submariner-operator]$ [cluster1] validate_equals .spec.debug false
2021-07-19T10:17:40.0892337Z [submariner-operator]$ [cluster1] jq -r -M .spec.debug /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0893816Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-19T10:17:40.0895320Z [submariner-operator]$ [cluster1] validate_equals .spec.namespace submariner-operator
2021-07-19T10:17:40.0896878Z [submariner-operator]$ [cluster1] jq -r -M .spec.namespace /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0898283Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-19T10:17:40.0899539Z [submariner-operator]$ [cluster1] validate_equals .spec.natEnabled false
2021-07-19T10:17:40.0900980Z [submariner-operator]$ [cluster1] jq -r -M .spec.natEnabled /tmp/submariner.cluster1.json
2021-07-19T10:17:40.0902324Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-19T10:17:40.0903447Z [submariner-operator]$ [cluster1] verify_subm_cr_status_with_retries
2021-07-19T10:17:40.0904598Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-19T10:17:40.0905840Z [submariner-operator]$ [cluster1] with_retries 5 verify_subm_cr_status_
2021-07-19T10:17:40.0906882Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T10:17:40.0907809Z [submariner-operator]$ [cluster1] wait 9963
2021-07-19T10:17:40.0908791Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-19T10:17:40.0909823Z [submariner-operator]$ [cluster1] verify_subm_cr_status_
2021-07-19T10:17:40.0910846Z [submariner-operator]$ [cluster1] verify_subm_cr_status
2021-07-19T10:17:41.3651257Z [submariner-operator]$ [cluster1] verify_subm_cr_er2] jq -r -M .spec.namespace /tmp/submariner.cluster2.json
2021-07-19T10:17:41.3652830Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-19T10:17:41.3654100Z [submariner-operator]$ [cluster2] validate_equals .spec.natEnabled false
2021-07-19T10:17:41.3655539Z [submariner-operator]$ [cluster2] jq -r -M .spec.natEnabled /tmp/submariner.cluster2.json
2021-07-19T10:17:41.3656916Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-19T10:17:41.3658057Z [submariner-operator]$ [cluster2] verify_subm_cr_status_with_retries
2021-07-19T10:17:41.3659201Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-19T10:17:41.3660338Z [submariner-operator]$ [cluster2] with_retries 5 verify_subm_cr_status_
2021-07-19T10:17:41.3661381Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:17:41.3662376Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-19T10:17:41.3663346Z [submariner-operator]$ [cluster2] wait 9977
2021-07-19T10:17:41.3664308Z [submariner-operator]$ [cluster2] verify_subm_cr_status_
2021-07-19T10:17:41.3665335Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-19T10:17:41.3666343Z [submariner-operator]$ [cluster2] verify_subm_cr_status
2021-07-19T10:17:41.3667568Z [submariner-operator]$ [cluster2] json_file=/tmp/submariner.cluster2.json
2021-07-19T10:17:41.3668509Z [cluster2] 
2021-07-19T10:17:41.3669044Z [cluster2] 
2021-07-19T10:17:41.3670503Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:41.3673038Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-19T10:17:41.3674730Z [submariner-operator]$ [cluster2] validate_equals .status.serviceCIDR 100.2.0.0/16
2021-07-19T10:17:41.3676248Z [submariner-operator]$ [cluster2] jq -r -M .status.serviceCIDR /tmp/submariner.cluster2.json
2021-07-19T10:17:41.3677933Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-19T10:17:41.3679342Z [submariner-operator]$ [cluster2] validate_equals .status.clusterCIDR 10.2.0.0/16
2021-07-19T10:17:41.3680819Z [submariner-operator]$ [cluster2] jq -r -M .status.clusterCIDR /tmp/submariner.cluster2.json
2021-07-19T10:17:41.3682087Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:17:41.3683001Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:17:41.3684057Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-19T10:17:41.3685286Z [submariner-operator]$ [cluster2] verify_subm_gateway_deployment
2021-07-19T10:17:41.3686666Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T10:17:41.3688235Z [submariner-operator]$ [cluster2] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T10:17:41.3689638Z [submariner-operator]$ [cluster2] daemonset_app=submariner-gateway
2021-07-19T10:17:41.3690928Z [submariner-operator]$ [cluster2] daemonset_name=submariner-gateway
2021-07-19T10:17:41.3692135Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-19T10:17:41.3693438Z [submariner-operator]$ [cluster2] with_retries 60 daemonset_created
2021-07-19T10:17:41.3694476Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:17:41.3695490Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-19T10:17:41.3696534Z [submariner-operator]$ [cluster2] daemonset_created
2021-07-19T10:17:41.3697297Z [cluster2] 
2021-07-19T10:17:41.3698058Z [submariner-operator]$ [cluster2] wait 10027
2021-07-19T10:17:41.3698966Z [submariner-operator]$ [cluster2] return 0
2021-07-19T10:17:41.3700041Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-19T10:17:41.3701205Z [submariner-operator]$ [cluster2] with_retries 120 daemonset_deployed
2021-07-19T10:17:41.3702517Z [submariner-operator]$ [cluster2] iteration=1
2021-07-19T10:17:41.3703450Z [submariner-operator]$ [cluster2] wait 10071
2021-07-19T10:17:41.3704442Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-19T10:17:41.3705511Z [submariner-operator]$ [cluster2] daemonset_deployed
2021-07-19T10:17:41.3707130Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:41.3709224Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:41.3711440Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:41.3737280Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T10:17:41.3739108Z [submariner-operator]$ [cluster2] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T10:17:42.1560617Z [submariner-operator]$ [cluster2] command kubectl --context=cluster2 get DaemonSet -n submariner-operator -o jsonpathstatus
2021-07-19T10:17:42.1562434Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner.cluster1.json
2021-07-19T10:17:42.1563399Z [cluster1] 
2021-07-19T10:17:42.1563941Z [cluster1] 
2021-07-19T10:17:42.1565248Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get submariner submariner --namespace=submariner-operator -o json
2021-07-19T10:17:42.1567211Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-19T10:17:42.1568589Z [submariner-operator]$ [cluster1] validate_equals .status.serviceCIDR 100.1.0.0/16
2021-07-19T10:17:42.1570203Z [submariner-operator]$ [cluster1] jq -r -M .status.serviceCIDR /tmp/submariner.cluster1.json
2021-07-19T10:17:42.1571691Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-19T10:17:42.1573013Z [submariner-operator]$ [cluster1] validate_equals .status.clusterCIDR 10.1.0.0/16
2021-07-19T10:17:42.1574492Z [submariner-operator]$ [cluster1] jq -r -M .status.clusterCIDR /tmp/submariner.cluster1.json
2021-07-19T10:17:42.1575845Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:17:42.1576764Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:17:42.1577820Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-19T10:17:42.1578967Z [submariner-operator]$ [cluster1] verify_subm_gateway_deployment
2021-07-19T10:17:42.1580345Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T10:17:42.1581916Z [submariner-operator]$ [cluster1] verify_daemonset submariner-gateway submariner-gateway
2021-07-19T10:17:42.1583315Z [submariner-operator]$ [cluster1] daemonset_app=submariner-gateway
2021-07-19T10:17:42.1584596Z [submariner-operator]$ [cluster1] daemonset_name=submariner-gateway
2021-07-19T10:17:42.1585956Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-19T10:17:42.1587126Z [submariner-operator]$ [cluster1] with_retries 60 daemonset_created
2021-07-19T10:17:42.1588166Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T10:17:42.1589119Z [submariner-operator]$ [cluster1] wait 10047
2021-07-19T10:17:42.1590104Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-19T10:17:42.1591141Z [submariner-operator]$ [cluster1] daemonset_created
2021-07-19T10:17:42.1592107Z [cluster1] 
2021-07-19T10:17:42.1592854Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:17:42.1593931Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-19T10:17:42.1595205Z [submariner-operator]$ [cluster1] with_retries 120 daemonset_deployed
2021-07-19T10:17:42.1596273Z [submariner-operator]$ [cluster1] iteration=1
2021-07-19T10:17:42.1597276Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-19T10:17:42.1598273Z [submariner-operator]$ [cluster1] wait 10078
2021-07-19T10:17:42.1599264Z [submariner-operator]$ [cluster1] daemonset_deployed
2021-07-19T10:17:42.1600867Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:42.1603061Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:42.1605285Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.desiredNumberScheduled}
2021-07-19T10:17:42.1607332Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T10:17:42.1609105Z [submariner-operator]$ [cluster1] kubectl get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T10:17:42.1611004Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get DaemonSet -n submariner-operator -o jsonpath={.status.numberReady}
2021-07-19T10:17:42.1612433Z [submariner-operator]$ [cluster1] return 0
2021-07-19T10:17:42.1613427Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-19T10:17:42.1614494Z [submariner-operator]$ [cluster1] verify_subm_gateway_pod
2021-07-19T10:17:42.1616195Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T10:17:42.1618270Z [submariner-operator]$ [cluster1] kubectl wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T10:17:42.1620441Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 wait --for=condition=Ready pods -l app=submariner-gateway --timeout=120s --namespace=submariner-operator
2021-07-19T10:17:42.1622109Z [cluster1] pod/submariner-gateway-5x6p8 condition met
2021-07-19T10:17:42.1623871Z [submariner-operator]$ [cluster1] subm_gateway_pod_name=$(kubectl get pods --namespace=$subm_ns -l app=$gateway_deployment_name -o=jsonpath='{.items..metadata.name}')
2021-07-19T10:17:42.8483582Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:42.8485870Z [submariner-operator]$ [cluster1] kubectl get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:42.8488077Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pods --namespace=submariner-operator -l app=submariner-gateway -o=jsonpath={.items..metadata.name}
2021-07-19T10:17:42.8490099Z [submariner-operator]$ [cluster1] json_file=/tmp/submariner-gateway-5x6p8.cluster1.json
2021-07-19T10:17:42.8492101Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5x6p8 --namespace=submariner-operator -o json
2021-07-19T10:17:42.8493911Z [submariner-operator]$ [cluster1] tee /tmp/submariner-gateway-5x6p8.cluster1.json
2021-07-19T10:17:42.8495736Z [submariner-operator]$ [cluster1] kubectl get pod submariner-gateway-5x6p8 --namespace=submariner-operator -o json
2021-07-19T10:17:42.8497738Z [submariner-operator]$ [cluster1] command kubectl --context=cluster1 get pod submariner-gateway-5x6p8 --namespace=submariner-operator -o json
2021-07-19T10:17:42.8498878Z [cluster1] {
2021-07-19T10:17:42.8499350Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:42.8499907Z [cluster1] "kind": "Pod",
2021-07-19T10:17:42.8500399Z [cluster1] "metadata": {
2021-07-19T10:17:42.8501258Z [cluster1] "creationTimestamp": "2021-07-19T10:16:17Z",
2021-07-19T10:17:42.8502386Z [cluster1] "generateName": "submariner-gateway-",
2021-07-19T10:17:42.8503038Z [cluster1] "labels": {
2021-07-19T10:17:42.8503857Z [cluster1] "app": "submariner-gateway",
2021-07-19T10:17:42.8504812Z [cluster1] "controller-revision-hash": "6f4f5d4856",
2021-07-19T10:17:42.8505960Z [cluster1] "gateway.submariner.io/node": "cluster1-worker",
2021-07-19T10:17:42.8506837Z [cluster1] "gateway.submariner.io/status": "active",
2021-07-19T10:17:42.8507852Z [cluster1] "pod-template-generation": "1"
2021-07-19T10:17:42.8508458Z [cluster1] },
2021-07-19T10:17:42.8509013Z [cluster1] "managedFields": [
2021-07-19T10:17:42.8509509Z [cluster1] {
2021-07-19T10:17:42.8510066Z [cluster1] "apiVersion": "v1",
2021-07-19T10:17:42.8510699Z [cluster1] "fieldsType": "FieldsV1",
2021-07-19T10:17:42.8511274Z [cluster1] "fieldsV1": {
2021-07-19T10:17:42.8511981Z [cluster1] "f:metadata": {
2021-07-19T10:17:42.8512550Z [cluster1] "f:generateName": {},
2021-07-19T10:17:42.8513176Z [cluster1] "f:labels": {
2021-07-19T10:17:42.8513848Z [cluster1] ".": {},
2021-07-19T10:17:42.8514468Z [cluster1] "f:app": {},
2021-07-19T10:17:42.8515399Z [cluster1] "f:controller-revision-hash": {},
2021-07-19T10:17:42.8516532Z [cluster1] "f:pod-template-generation": {}
2021-07-19T10:17:42.8517250Z [cluster1] },
2021-07-19T10:17:42.8527149Z [cluster1] "f:ownerReferences": {
2021-07-19T10:17:42.8527759Z [cluster1] ".": {},
2021-07-19T10:17:42.8528917Z [cluster1] "k:{\"uid\":\"8d53e3bb-c168-4009-b03f-9a59d364ac22\"}": {
2021-07-19T10:17:42.8529770Z [cluster1] ".": {},
2021-07-19T10:17:42.8530291Z [cluster1] "f:apiVersion": {},
2021-07-19T10:17:42.8531156Z [cluster1] "f:blockOwnerDeletion": {},
2021-07-19T10:17:42.8531822Z [cluster1] "f:controller": {},
2021-07-19T10:17:42.8532363Z [cluster1] "f:kind": {},
2021-07-19T10:1
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment