The AWS EKS team works extremely hard. We appreciate all of their effort.
But the aws-vpc-cni
requires fine-tuning of complex settings, and:
- Limits the number of pods you can run on an EC2, based on the number of ENIs that instance size (or type) can support. Pod density is valuable.
- Requires you to play with settings like
WARM_ENI_TARGET
,WARM_IP_TARGET
,WARM_PREFIX_TARGET
, etc... - Runs into conditions where Pods get stuck in "Creating," since IP management gets tricky based on cluster pod churn, and aws-vpc-cni...and
ENABLE_PREFIX_DELEGATION
+ branching can lead to a lot of wasted IPs