Skip to content

Instantly share code, notes, and snippets.

@nerdalert
Created April 20, 2022 03:51
Show Gist options
  • Save nerdalert/fc43ed7cfeb485f8be8d275f7d12568f to your computer and use it in GitHub Desktop.
Save nerdalert/fc43ed7cfeb485f8be8d275f7d12568f to your computer and use it in GitHub Desktop.
[fedora@cluster2-ha1-perf-target-node ~]$ kubectl get nodes
NAME                            STATUS   ROLES                  AGE   VERSION
cluster2-worker1-node           Ready    <none>                 15m   v1.22.7+k3s1
cluster2-ha2-node               Ready    <none>                 18m   v1.22.7+k3s1
cluster2-ha1-perf-target-node   Ready    control-plane,master   21m   v1.22.7+k3s1
[fedora@cluster2-ha1-perf-target-node ~]$ kubectl get pods --all-namespaces -o wide
NAMESPACE             NAME                                             READY   STATUS             RESTARTS      AGE   IP            NODE                            NOMINATED NODE   READINESS GATES
kube-system           local-path-provisioner-84bb864455-hn6km          1/1     Running            0             21m   10.42.0.3     cluster2-ha1-perf-target-node   <none>           <none>
kube-system           coredns-96cc4f57d-j9ggn                          1/1     Running            0             21m   10.42.0.4     cluster2-ha1-perf-target-node   <none>           <none>
kube-system           metrics-server-ff9dbcb6c-vzkdp                   1/1     Running            0             21m   10.42.0.2     cluster2-ha1-perf-target-node   <none>           <none>
submariner-operator   submariner-operator-789c775b8-cd6p8              1/1     Running            1 (12m ago)   12m   10.42.3.2     cluster2-worker1-node           <none>           <none>
submariner-operator   submariner-lighthouse-coredns-5b56499d77-694m8   1/1     Running            0             11m   10.42.3.4     cluster2-worker1-node           <none>           <none>
submariner-operator   submariner-lighthouse-agent-865948555-m8shd      1/1     Running            0             11m   10.42.3.3     cluster2-worker1-node           <none>           <none>
submariner-operator   submariner-lighthouse-coredns-5b56499d77-fbqmh   1/1     Running            0             11m   10.42.1.3     cluster2-ha2-node               <none>           <none>
submariner-operator   submariner-routeagent-68zc2                      1/1     Running            0             11m   10.10.0.234   cluster2-worker1-node           <none>           <none>
submariner-operator   submariner-gateway-glb5c                         1/1     Running            0             11m   10.10.0.124   cluster2-ha1-perf-target-node   <none>           <none>
submariner-operator   submariner-routeagent-8khw2                      1/1     Running            1 (11m ago)   11m   10.10.0.124   cluster2-ha1-perf-target-node   <none>           <none>
submariner-operator   submariner-globalnet-849467f9bb-kmwqg            1/1     Running            0             11m   10.42.1.2     cluster2-ha2-node               <none>           <none>
submariner-operator   submariner-gateway-hrsh2                         1/1     Running            0             11m   10.10.0.94    cluster2-ha2-node               <none>           <none>
submariner-operator   submariner-routeagent-8vckr                      0/1     CrashLoopBackOff   7 (56s ago)   11m   10.10.0.94    cluster2-ha2-node               <none>           <none>
[fedora@cluster2-ha1-perf-target-node ~]$
[fedora@cluster2-ha1-perf-target-node ~]$
[fedora@cluster2-ha1-perf-target-node ~]$ subctl show all
Cluster "default"
 ✓ Detecting broker(s)

 ✓ Showing Connections
GATEWAY            CLUSTER            REMOTE IP      NAT  CABLE DRIVER  SUBNETS       STATUS     RTT avg.
cluster1-ha1-node  cluster1-ha1-node  10.10.0.76     no   vxlan         242.0.0.0/16  connected  664.962µs
cluster1-ha2-node  cluster1-ha1-node  44.203.56.170  yes  vxlan         242.0.0.0/16  connected  695.725µs
cluster1-ha2-node  cluster1-ha1-node  10.10.0.26     no   vxlan         242.0.0.0/16  connected  695.725µs
cluster1-ha1-node  cluster1-ha1-node  10.10.0.76     no   vxlan         242.0.0.0/16  connected  635.168µs
cluster1-ha2-node  cluster1-ha1-node  10.10.0.26     no   vxlan         242.0.0.0/16  connected  588.614µs

 ✓ Showing Endpoints
CLUSTER ID                    ENDPOINT IP     PUBLIC IP       CABLE DRIVER        TYPE
cluster2-ha1-perf-target-node 10.10.0.124     44.202.93.42    vxlan               local
cluster1-ha1-node             10.10.0.76      54.227.228.206  vxlan               remote
cluster1-ha1-node             10.10.0.26      44.203.56.170   vxlan               remote
cluster1-ha1-node             10.10.0.26      44.203.56.170   vxlan               remote
cluster2-ha1-perf-target-node 10.10.0.94      3.82.106.166    vxlan               local
cluster1-ha1-node             10.10.0.76      54.227.228.206  vxlan               remote
cluster1-ha1-node             10.10.0.26      44.203.56.170   vxlan               remote

 ✓ Showing Gateways
NODE                            HA STATUS       SUMMARY
cluster2-ha1-perf-target-node   active          All connections (3) are established
cluster2-ha2-node               active          All connections (2) are established

    Discovered network details via Submariner:
 ✓ Showing Network details
        Network plugin:  generic
        Service CIDRs:   [10.43.0.0/16]
        Cluster CIDRs:   [10.42.0.0/24]
        Global CIDR:     242.1.0.0/16

 ✓ Showing versions
COMPONENT                       REPOSITORY                                            VERSION
submariner                      quay.io/submariner                                    devel
submariner-operator             quay.io/networkstatic                                 devel
service-discovery               quay.io/submariner                                    devel

[fedora@cluster2-ha1-perf-target-node ~]$ k logs submariner-routeagent-8vckr -n submariner-operator
+ trap 'exit 1' SIGTERM SIGINT
+ SUBMARINER_VERBOSITY=2
+ '[' false == true ']'
+ DEBUG=-v=2
+ exec submariner-route-agent -v=2 -alsologtostderr
I0420 03:49:15.456131       1 main.go:55] Starting submariner-route-agent using the event framework
W0420 03:49:15.456577       1 client_config.go:608] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I0420 03:49:15.479521       1 registry.go:65] Event handler "logger" added to registry "routeagent_driver".
I0420 03:49:15.480436       1 cni_iface.go:72] Interface "lo" has "127.0.0.1" address
I0420 03:49:15.481163       1 cni_iface.go:72] Interface "eth0" has "10.10.0.94" address
I0420 03:49:15.481346       1 cni_iface.go:72] Interface "flannel.1" has "10.42.1.0" address
I0420 03:49:15.481506       1 cni_iface.go:72] Interface "cni0" has "10.42.1.1" address
I0420 03:49:15.481835       1 cni_iface.go:72] Interface "vxlan-tunnel" has "241.10.0.94" address
I0420 03:49:15.482007       1 cni_iface.go:72] Interface "vx-submariner" has "240.10.0.94" address
E0420 03:49:15.482108       1 kp_iptables.go:140] Error discovering the CNI interface unable to find CNI Interface on the host which has IP from "10.42.0.0/24"
I0420 03:49:15.484077       1 iptables.go:30] Install/ensure SUBMARINER-POSTROUTING chain exists
I0420 03:49:15.486071       1 iptables.go:36] Insert SUBMARINER-POSTROUTING rule that has rules for inter-cluster traffic
I0420 03:49:15.488254       1 iptables.go:135] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
I0420 03:49:15.488277       1 iptables.go:156] In nat table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
I0420 03:49:15.488286       1 iptables_iface.go:43] Install/ensure "SUBMARINER-INPUT" chain exists
I0420 03:49:15.492773       1 iptables_iface.go:54] Allow VxLAN incoming traffic in "SUBMARINER-INPUT" Chain
I0420 03:49:15.495155       1 iptables_iface.go:62] Insert rule to allow traffic over vx-submariner interface in FORWARDing Chain
I0420 03:49:15.497328       1 iptables.go:135] In filter table, iptables rule "-o vx-submariner -j ACCEPT", exists at index 2.
I0420 03:49:15.501446       1 registry.go:65] Event handler "kubeproxy-iptables-handler" added to registry "routeagent_driver".
I0420 03:49:15.501472       1 registry.go:67] Event handler "ovn-hostroutes-handler" ignored for registry "routeagent_driver".
I0420 03:49:15.501481       1 registry.go:65] Event handler "xfrm" added to registry "routeagent_driver".
I0420 03:49:15.501487       1 registry.go:65] Event handler "VXLAN cleanup handler" added to registry "routeagent_driver".
I0420 03:49:15.505330       1 ipset.go:349] Running ipset [create SUBMARINER-REMOTECIDRS hash:net -exist]
I0420 03:49:15.506548       1 ipset.go:349] Running ipset [create SUBMARINER-LOCALCIDRS hash:net -exist]
I0420 03:49:15.509304       1 iptables.go:135] In mangle table, iptables rule "-j SUBMARINER-POSTROUTING", exists at index 1.
I0420 03:49:15.509326       1 iptables.go:156] In mangle table, iptables rule "-j SUBMARINER-POSTROUTING", already exists.
I0420 03:49:15.513595       1 registry.go:65] Event handler "MTU handler" added to registry "routeagent_driver".
I0420 03:49:15.514962       1 cni_iface.go:72] Interface "lo" has "127.0.0.1" address
I0420 03:49:15.515074       1 cni_iface.go:72] Interface "eth0" has "10.10.0.94" address
I0420 03:49:15.515154       1 cni_iface.go:72] Interface "flannel.1" has "10.42.1.0" address
I0420 03:49:15.515252       1 cni_iface.go:72] Interface "cni0" has "10.42.1.1" address
I0420 03:49:15.515471       1 cni_iface.go:72] Interface "vxlan-tunnel" has "241.10.0.94" address
I0420 03:49:15.515541       1 cni_iface.go:72] Interface "vx-submariner" has "240.10.0.94" address
E0420 03:49:15.515574       1 main.go:107] Error while annotating the node: error annotating node with CNI interface IP: Error retrieving the CNI interface for 10.42.0.0/24: unable to find CNI Interface on the host which has IP from "10.42.0.0/24"
W0420 03:49:15.515700       1 client_config.go:608] Neither --kubeconfig nor --master was specified.  Using the inClusterConfig.  This might not work.
I0420 03:49:15.561650       1 controller.go:140] Starting the Event controller...
I0420 03:49:15.662584       1 handler.go:56] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster2-ha1-perf-target-node", CableName:"submariner-cable-cluster2-ha1-perf-target-node-10-10-0-124", HealthCheckIP:"242.1.255.254", Hostname:"cluster2-ha1-perf-target-node", Subnets:[]string{"242.1.0.0/16"}, PrivateIP:"10.10.0.124", PublicIP:"44.202.93.42", NATEnabled:false, Backend:"vxlan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false", "udp-port":"4500"}, AllocatedIPs:[]string{"242.1.0.1", "242.1.0.2", "242.1.0.3", "242.1.0.4", "242.1.0.5", "242.1.0.6", "242.1.0.7", "242.1.0.8"}}
I0420 03:49:15.662649       1 endpoint_handler.go:47] Updating the vxlan interface vx-submariner and fdb entries
I0420 03:49:15.663042       1 vxlan.go:92] VxLAN interface already exists with same configuration.
I0420 03:49:15.663185       1 vxlan.go:266] Successfully configured reverse path filter to loose mode on "vx-submariner"
I0420 03:49:15.663240       1 vxlan.go:274] Reconciling desired fdb entries [10.10.0.124] on "vx-submariner" for a Non-Gateway node
I0420 03:49:15.663347       1 vxlan.go:289] Existing fdb entries on vx-submariner: map[]
I0420 03:49:15.663403       1 vxlan.go:326] Successfully added the bridge fdb entry {8 7 192 1 2 10.10.0.124 00:00:00:00:00:00 <nil> 0 0 0}
I0420 03:49:15.663522       1 routes_iface.go:243] Reconciling existing routes map[] to gws [240.10.0.124] on worker node
I0420 03:49:15.663547       1 ipset.go:349] Running ipset [add SUBMARINER-LOCALCIDRS 242.1.0.0/16 -exist]
I0420 03:49:15.665455       1 handler.go:71] A new Endpoint for remote cluster "cluster1-ha1-node" has been created: v1.EndpointSpec{ClusterID:"cluster1-ha1-node", CableName:"submariner-cable-cluster1-ha1-node-10-10-0-26", HealthCheckIP:"242.0.255.253", Hostname:"cluster1-ha2-node", Subnets:[]string{"242.0.0.0/16"}, PrivateIP:"10.10.0.26", PublicIP:"44.203.56.170", NATEnabled:false, Backend:"vxlan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false", "udp-port":"4500"}, AllocatedIPs:[]string{"242.0.0.1", "242.0.0.2", "242.0.0.3", "242.0.0.4", "242.0.0.5", "242.0.0.6", "242.0.0.7", "242.0.0.8"}}
I0420 03:49:15.665751       1 routes_iface.go:243] Reconciling existing routes map[] to gws [240.10.0.124] on worker node
I0420 03:49:15.665864       1 routes_iface.go:273] Adding new route {Dst: 242.0.0.0/16 Src: <nil> Gw: [{Ifindex: 8 Weight: 1 Gw: 240.10.0.124 Flags: []}] Flags: [] Table: 0}
E0420 03:49:15.666000       1 routes_iface.go:277] Error adding route {Dst: 242.0.0.0/16 Src: <nil> Gw: [{Ifindex: 8 Weight: 1 Gw: 240.10.0.124 Flags: []}] Flags: [] Table: 0}: network is unreachable
I0420 03:49:15.667879       1 iptables_iface.go:104] Installing iptables rule for outgoing traffic: -s 10.42.0.0/24 -d 242.0.0.0/16 -j ACCEPT
I0420 03:49:15.669774       1 iptables_iface.go:110] Installing iptables rule for incoming traffic: -s 242.0.0.0/16 -d 10.42.0.0/24 -j ACCEPT
I0420 03:49:15.671488       1 ipset.go:349] Running ipset [add SUBMARINER-REMOTECIDRS 242.0.0.0/16 -exist]
I0420 03:49:15.672625       1 handler.go:71] A new Endpoint for remote cluster "cluster1-ha1-node" has been created: v1.EndpointSpec{ClusterID:"cluster1-ha1-node", CableName:"submariner-cable-cluster1-ha1-node-10-10-0-76", HealthCheckIP:"242.0.255.254", Hostname:"cluster1-ha1-node", Subnets:[]string{"242.0.0.0/16"}, PrivateIP:"10.10.0.76", PublicIP:"54.227.228.206", NATEnabled:false, Backend:"vxlan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false", "udp-port":"4500"}, AllocatedIPs:[]string{"242.0.0.9", "242.0.0.10", "242.0.0.11", "242.0.0.12", "242.0.0.13", "242.0.0.14", "242.0.0.15", "242.0.0.16"}}
I0420 03:49:15.672746       1 routes_iface.go:243] Reconciling existing routes map[] to gws [240.10.0.124] on worker node
I0420 03:49:15.672768       1 routes_iface.go:273] Adding new route {Dst: 242.0.0.0/16 Src: <nil> Gw: [{Ifindex: 8 Weight: 1 Gw: 240.10.0.124 Flags: []}] Flags: [] Table: 0}
E0420 03:49:15.672826       1 routes_iface.go:277] Error adding route {Dst: 242.0.0.0/16 Src: <nil> Gw: [{Ifindex: 8 Weight: 1 Gw: 240.10.0.124 Flags: []}] Flags: [] Table: 0}: network is unreachable
I0420 03:49:15.674366       1 iptables_iface.go:104] Installing iptables rule for outgoing traffic: -s 10.42.0.0/24 -d 242.0.0.0/16 -j ACCEPT
I0420 03:49:15.676116       1 iptables_iface.go:110] Installing iptables rule for incoming traffic: -s 242.0.0.0/16 -d 10.42.0.0/24 -j ACCEPT
I0420 03:49:15.678382       1 ipset.go:349] Running ipset [add SUBMARINER-REMOTECIDRS 242.0.0.0/16 -exist]
I0420 03:49:15.679546       1 handler.go:56] A new Endpoint for the local cluster has been created: v1.EndpointSpec{ClusterID:"cluster2-ha1-perf-target-node", CableName:"submariner-cable-cluster2-ha1-perf-target-node-10-10-0-94", HealthCheckIP:"", Hostname:"cluster2-ha2-node", Subnets:[]string{"242.1.0.0/16"}, PrivateIP:"10.10.0.94", PublicIP:"3.82.106.166", NATEnabled:false, Backend:"vxlan", BackendConfig:map[string]string{"natt-discovery-port":"4490", "preferred-server":"false", "udp-port":"4500"}, AllocatedIPs:[]string{"242.1.0.9", "242.1.0.10", "242.1.0.11", "242.1.0.12", "242.1.0.13", "242.1.0.14", "242.1.0.15", "242.1.0.16"}}
I0420 03:49:15.679597       1 endpoint_handler.go:47] Updating the vxlan interface vx-submariner and fdb entries
I0420 03:49:15.679730       1 vxlan.go:274] Reconciling desired fdb entries [] on "vx-submariner" for a Gateway node
I0420 03:49:15.679861       1 vxlan.go:289] Existing fdb entries on vx-submariner: map[10.10.0.124:{8 7 192 1 2 10.10.0.124 00:00:00:00:00:00 <nil> 0 0 0}]
I0420 03:49:15.679944       1 vxlan.go:311] Successfully deleted the bridge fdb entry {8 7 192 1 2 10.10.0.124 00:00:00:00:00:00 <nil> 0 0 0}
W0420 03:49:15.679994       1 vxlan.go:169] invalid ipAddresses ([]) supplied
I0420 03:49:15.680086       1 routes_iface.go:228] Node is a GW, delete all intra cluster Routes on vx-submariner
I0420 03:49:15.680106       1 ipset.go:349] Running ipset [add SUBMARINER-LOCALCIDRS 242.1.0.0/16 -exist]
I0420 03:49:15.681115       1 handler.go:51] The current node has become a Gateway
I0420 03:49:15.681134       1 gw_transition.go:77] The current node has become a Gateway
I0420 03:49:15.681228       1 routes_iface.go:228] Node is a GW, delete all intra cluster Routes on vx-submariner
I0420 03:49:15.681335       1 gw_transition.go:96] Updating FDB entries on the vxlan interface: vx-submariner to include worker node IPs.
I0420 03:49:15.681425       1 vxlan.go:274] Reconciling desired fdb entries [] on "vx-submariner" for a Gateway node
I0420 03:49:15.681493       1 vxlan.go:289] Existing fdb entries on vx-submariner: map[]
W0420 03:49:15.681506       1 vxlan.go:169] invalid ipAddresses ([]) supplied
E0420 03:49:15.683347       1 runtime.go:78] Observed a panic: "invalid memory address or nil pointer dereference" (runtime error: invalid memory address or nil pointer dereference)
goroutine 288 [running]:
k8s.io/apimachinery/pkg/util/runtime.logPanic(0x14ff760, 0x21f20f0)
	k8s.io/[email protected]/pkg/util/runtime/runtime.go:74 +0xa6
k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
	k8s.io/[email protected]/pkg/util/runtime/runtime.go:48 +0x86
panic(0x14ff760, 0x21f20f0)
	runtime/panic.go:965 +0x1b9
github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy.(*SyncHandler).updateGWRules(0xc0003100f0, 0x0, 0x1, 0x1)
	github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy/iptables_iface.go:141 +0x183
github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy.(*SyncHandler).TransitionToGateway(0xc0003100f0, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy/gw_transition.go:112 +0x36d
github.com/submariner-io/submariner/pkg/event.(*Registry).TransitionToGateway.func1(0x18a0458, 0xc0003100f0, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/event/registry.go:100 +0x34
github.com/submariner-io/submariner/pkg/event.(*Registry).invokeHandlers(0xc000275980, 0x16ad3bb, 0x13, 0x174d408, 0x11e7280, 0xc000508000)
	github.com/submariner-io/submariner/pkg/event/registry.go:162 +0xba
github.com/submariner-io/submariner/pkg/event.(*Registry).TransitionToGateway(0xc000275980, 0xc000047998, 0x11)
	github.com/submariner-io/submariner/pkg/event/registry.go:99 +0x4c
github.com/submariner-io/submariner/pkg/event/controller.(*Controller).handleCreatedLocalEndpoint(0xc000191980, 0xc000508000, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/event/controller/endpoint_created.go:56 +0x132
github.com/submariner-io/submariner/pkg/event/controller.(*Controller).handleCreatedEndpoint(0xc000191980, 0x1863bd0, 0xc000508000, 0x1, 0x2)
	github.com/submariner-io/submariner/pkg/event/controller/endpoint_created.go:35 +0x145
github.com/submariner-io/admiral/pkg/watcher.EventHandlerFuncs.OnCreate(...)
	github.com/submariner-io/[email protected]/pkg/watcher/resource_watcher.go:191
github.com/submariner-io/admiral/pkg/watcher.New.func1(0x1863bd0, 0xc000508000, 0x1, 0x0, 0xc000508000, 0x0, 0x14a3560)
	github.com/submariner-io/[email protected]/pkg/watcher/resource_watcher.go:153 +0x10c
github.com/submariner-io/admiral/pkg/syncer.(*resourceSyncer).transform(0xc000576f00, 0xc0000c63f8, 0xc000128540, 0x6b, 0x0, 0x57, 0x0, 0x0, 0x757200)
	github.com/submariner-io/[email protected]/pkg/syncer/resource_syncer.go:533 +0x136
github.com/submariner-io/admiral/pkg/syncer.(*resourceSyncer).processNextWorkItem(0xc000576f00, 0xc000128540, 0x6b, 0xc000128554, 0x57, 0xc000128540, 0x13, 0x2, 0x10, 0x7f1cb7b13108)
	github.com/submariner-io/[email protected]/pkg/syncer/resource_syncer.go:417 +0x338
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).processNextWorkItem.func1(0xc000128540, 0x6b, 0xc00060df50, 0xc00016dd00, 0x0, 0x0)
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:103 +0x93
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).processNextWorkItem(0xc00007bd40, 0xc00060df50, 0x203000)
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:104 +0x129
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).Run.func1()
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:79 +0x49
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000344948)
	k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000344948, 0x185d200, 0xc000624390, 0x1, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0x9b
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000344948, 0x3b9aca00, 0x0, 0x174e801, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(0xc000344948, 0x3b9aca00, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x4d
created by github.com/submariner-io/admiral/pkg/workqueue.(*queueType).Run
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:78 +0x8b
panic: runtime error: invalid memory address or nil pointer dereference [recovered]
	panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x10 pc=0x13c2323]

goroutine 288 [running]:
k8s.io/apimachinery/pkg/util/runtime.HandleCrash(0x0, 0x0, 0x0)
	k8s.io/[email protected]/pkg/util/runtime/runtime.go:55 +0x109
panic(0x14ff760, 0x21f20f0)
	runtime/panic.go:965 +0x1b9
github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy.(*SyncHandler).updateGWRules(0xc0003100f0, 0x0, 0x1, 0x1)
	github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy/iptables_iface.go:141 +0x183
github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy.(*SyncHandler).TransitionToGateway(0xc0003100f0, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/routeagent_driver/handlers/kubeproxy/gw_transition.go:112 +0x36d
github.com/submariner-io/submariner/pkg/event.(*Registry).TransitionToGateway.func1(0x18a0458, 0xc0003100f0, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/event/registry.go:100 +0x34
github.com/submariner-io/submariner/pkg/event.(*Registry).invokeHandlers(0xc000275980, 0x16ad3bb, 0x13, 0x174d408, 0x11e7280, 0xc000508000)
	github.com/submariner-io/submariner/pkg/event/registry.go:162 +0xba
github.com/submariner-io/submariner/pkg/event.(*Registry).TransitionToGateway(0xc000275980, 0xc000047998, 0x11)
	github.com/submariner-io/submariner/pkg/event/registry.go:99 +0x4c
github.com/submariner-io/submariner/pkg/event/controller.(*Controller).handleCreatedLocalEndpoint(0xc000191980, 0xc000508000, 0x0, 0x0)
	github.com/submariner-io/submariner/pkg/event/controller/endpoint_created.go:56 +0x132
github.com/submariner-io/submariner/pkg/event/controller.(*Controller).handleCreatedEndpoint(0xc000191980, 0x1863bd0, 0xc000508000, 0x1, 0x2)
	github.com/submariner-io/submariner/pkg/event/controller/endpoint_created.go:35 +0x145
github.com/submariner-io/admiral/pkg/watcher.EventHandlerFuncs.OnCreate(...)
	github.com/submariner-io/[email protected]/pkg/watcher/resource_watcher.go:191
github.com/submariner-io/admiral/pkg/watcher.New.func1(0x1863bd0, 0xc000508000, 0x1, 0x0, 0xc000508000, 0x0, 0x14a3560)
	github.com/submariner-io/[email protected]/pkg/watcher/resource_watcher.go:153 +0x10c
github.com/submariner-io/admiral/pkg/syncer.(*resourceSyncer).transform(0xc000576f00, 0xc0000c63f8, 0xc000128540, 0x6b, 0x0, 0x57, 0x0, 0x0, 0x757200)
	github.com/submariner-io/[email protected]/pkg/syncer/resource_syncer.go:533 +0x136
github.com/submariner-io/admiral/pkg/syncer.(*resourceSyncer).processNextWorkItem(0xc000576f00, 0xc000128540, 0x6b, 0xc000128554, 0x57, 0xc000128540, 0x13, 0x2, 0x10, 0x7f1cb7b13108)
	github.com/submariner-io/[email protected]/pkg/syncer/resource_syncer.go:417 +0x338
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).processNextWorkItem.func1(0xc000128540, 0x6b, 0xc00060df50, 0xc00016dd00, 0x0, 0x0)
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:103 +0x93
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).processNextWorkItem(0xc00007bd40, 0xc00060df50, 0x203000)
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:104 +0x129
github.com/submariner-io/admiral/pkg/workqueue.(*queueType).Run.func1()
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:79 +0x49
k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1(0xc000344948)
	k8s.io/[email protected]/pkg/util/wait/wait.go:155 +0x5f
k8s.io/apimachinery/pkg/util/wait.BackoffUntil(0xc000344948, 0x185d200, 0xc000624390, 0x1, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:156 +0x9b
k8s.io/apimachinery/pkg/util/wait.JitterUntil(0xc000344948, 0x3b9aca00, 0x0, 0x174e801, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:133 +0x98
k8s.io/apimachinery/pkg/util/wait.Until(0xc000344948, 0x3b9aca00, 0xc00008ac00)
	k8s.io/[email protected]/pkg/util/wait/wait.go:90 +0x4d
created by github.com/submariner-io/admiral/pkg/workqueue.(*queueType).Run
	github.com/submariner-io/[email protected]/pkg/workqueue/queue.go:78 +0x8b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment