CILIUM_E2E_README.md

Create 3 nodes with the third node as outside cluster node:

sudo K8S_NODES=3 NO_CILIUM_ON_NODE=k8s3 NETNEXT=true ginkgo --focus "K8s.*fragments" -v -- --cilium.provision=true

Issues

cilium-agent failed to start

Mar 07 02:20:38 k8s1 cilium-agent[23140]: level=info msg="cilium-envoy  version: 1bfbbd9c85907c5667f1abd24b7a6c1b5d8bbf29/1.16.2/Modified/RELEASE/BoringSSL" subsys=daemon
Mar 07 02:20:38 k8s1 cilium-agent[23140]: level=fatal msg="Envoy version 1bfbbd9c85907c5667f1abd24b7a6c1b5d8bbf29/1.16.2/Modified/RELEASE/BoringSSL does not match with required version 1177896bebde79915fe5f9092409bf0254084b4e ,aborting." subsys=daemon

Fix

cilium_options+=" --disable-envoy-version-check"

debug-e2e-cilium.md

The e2e test failed because lstat issue on the shared file system.

sudo NFS=0 NETNEXT=true ginkgo --focus "K8s.*fragments" -v -- --cilium.provision=false
• Failure in Spec Setup (BeforeEach) [35.451 seconds]
K8sServicesTest
/home/anfernee/go/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:478
  Checks service across nodes [BeforeEach]
  /home/anfernee/go/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:478
    Supports IPv4 fragments
    /home/anfernee/go/src/github.com/cilium/cilium/test/ginkgo-ext/scopes.go:514

    Cilium cannot be installed
    Expected
        <*helpers.cmdError | 0xc00007fc00>: Unable to generate YAML (Process exited with status 1) output: cmd: helm template --validate /home/vagrant/go/src/github.com/cilium/cilium/install/kubernetes/cilium --namespace=kube-system  --set hubble.relay.image.tag=latest  --set k8s.requireIPv4PodCIDR=true  --set hubble.listenAddress=:4244  --set hubble.relay.image.repository=k8s1:5000/cilium/hubble-relay  --set ipv6.enabled=true  --set enableCnpStatusUpdates=true  --set logSystemLoad=true  --set preflight.image.repository=k8s1:5000/cilium/cilium-dev  --set operator.image.tag=latest  --set hubble.enabled=true  --set debug.verbose=flow  --set etcd.leaseTTL=30s  --set debug.enabled=true  --set bpf.preallocateMaps=false  --set preflight.image.tag=latest  --set operator.image.suffix=  --set image.tag=latest  --set operator.image.repository=k8s1:5000/cilium/operator  --set image.repository=k8s1:5000/cilium/cilium-dev  --set ipam.operator.clusterPoolIPv6PodCIDR=fd02::/112  --set ipv4.enabled=true  --set nativeRoutingCIDR=10.0.0.0/8  --set pprof.enabled=true  > cilium-1667fc8c4cc74654.yaml
    Exitcode: 1 
    Err: Process exited with status 1
    Stdout:
     	 
    Stderr:
     	 Error: error reading templates/hubble-relay-clusterrole.yaml: open /home/vagrant/go/src/github.com/cilium/cilium/install/kubernetes/cilium/templates/hubble-relay-clusterrole.yaml: interrupted system call
    	 
    
    to be nil

Tried NFS before, it has "no locked support" issue.

When not using NFS, it has "System call interrupt" in random places when building binary.