MaxRink

Proposal for a clusterctl-operator

Table of Contents

• Table of Contents
• Glossary
• Summary
• Motivation
  • Goals
• Non-Goals/Future Work

MaxRink

We have an N-Infa-Setup like this:

Management group: capi-system/cluster-api, latest release available for the v1alpha3 API Version of Cluster API (contract):

NAME                     NAMESPACE                           TYPE                     CURRENT VERSION   NEXT VERSION
bootstrap-kubeadm        capi-kubeadm-bootstrap-system       BootstrapProvider        v0.3.6            Already up to date
control-plane-kubeadm    capi-kubeadm-control-plane-system   ControlPlaneProvider     v0.3.6            Already up to date
cluster-api              capi-system                         CoreProvider             v0.3.6            Already up to date
infrastructure-vsphere capv-system-bremen InfrastructureProvider v0.6.5 Already up to date

MaxRink

#!/usr/bin/env bash
help () {
    local "${@}"
    echo
    if [ "${NO_CREDENTIALS_SPECIFIED}" ]; then
      echo
      echo "cat <path-to-credentials-file>/<file-name>"
      echo "[default]"
      echo "aws_access_key_id = yourIdHash"
      echo "aws_secret_access_key = yourSecretHash"

MaxRink

I0629 18:48:18.690990       1 haproxyloadbalancer_controller.go:156] capv-controller-manager/haproxyloadbalancer-controller "msg"="Starting reconciliation" "name"="demo-ref-1" "namespace"="demo"
I0629 18:48:18.691433       1 haproxyloadbalancer_controller.go:287] capv-controller-manager/haproxyloadbalancer-controller "msg"="Generating certificates" "api-version"="v1alpha3" "kind"="HAProxyLoadBalancer" "name"="demo-ref-1" "namespace"="demo"
I0629 18:48:19.150117       1 haproxyloadbalancer_controller.go:311] capv-controller-manager/haproxyloadbalancer-controller "msg"="HAProxy LoadBalancer not ready, reconciling network" "api-version"="v1alpha3" "kind"="HAProxyLoadBalancer" "name"="demo-ref-1" "namespace"="demo" "vm-name"="demo-ref-1-lb"
I0629 18:48:19.150163       1 haproxyloadbalancer_controller.go:605] capv-controller-manager/haproxyloadbalancer-controller "msg"="waiting on vm for ip address" "api-version"="v1alpha3" "kind"="HAProxyLoadBalancer" "name"="demo-ref-1" "namespace"="demo" "old-ip-address"="" "vm

MaxRink

{{- if .Values.ccm.external -}}
# Source: vsphere-cpi/templates/service-account.yaml
apiVersion: v1
kind: ServiceAccount
metadata:
  name: cloud-controller-manager-{{ .Values.tenant.environment }}-{{ .Values.tenant.name }}-{{ .Values.cluster.name }}
---
# Source: vsphere-cpi/templates/role.yaml
apiVersion: rbac.authorization.k8s.io/v1
kind: ClusterRole

MaxRink

apiVersion: kafka.strimzi.io/v1beta1
kind: Kafka
metadata:
  name: test-cluster
  namespace: kafka
spec:
  kafka:
    version: 2.6.0
    replicas: 3
    resources: 

MaxRink

I0701 19:55:37.401786       1 metal3labelsync_controller.go:141] controllers/Metal3LabelSync/metal3-label-sync-controller "msg"="Could not find Node Ref on Machine object, will retry" "metal3-label-sync"={"Namespace":"metal3-refsa2-bn","Name":"ilocz20300gcv.lom.refsa2.bn.schiff.telekom.de"} 
I0701 19:55:37.851825       1 metal3data_manager.go:130] controllers/Metal3Data/Metal3Data-controller "msg"="Fetched Metal3DataTemplate" "cluster"="testcluster" "metal3-data"={"Namespace":"metal3-refsa2-bn","Name":"testcluster-cp-metadata-0"} 
I0701 19:55:37.851887       1 metal3data_manager.go:140] controllers/Metal3Data/Metal3Data-controller "msg"="Fetched Metal3Machine" "cluster"="testcluster" "metal3-data"={"Namespace":"metal3-refsa2-bn","Name":"testcluster-cp-metadata-0"} 
I0701 19:55:37.851906       1 metal3data_manager.go:154] controllers/Metal3Data/Metal3Data-controller "msg"="Checking if secret exists" "cluster"="testcluster" "metal3-data"={"Namespace":"metal3-refsa2-bn","Name":"testcluster-cp-metadata-0"} "secre

MaxRink

## template: jinja
#cloud-config

write_files:
-   path: /etc/kubernetes/pki/ca.crt
    owner: root:root
    permissions: '0640'
    content: |
      -----BEGIN CERTIFICATE-----
      -----END CERTIFICATE-----

MaxRink

{
  "_index": "vector-2021-11-19",
  "_type": "_doc",
  "_id": "uJgoOH0Bo4wOgasZGfS0",
  "_version": 1,
  "_score": null,
  "_source": {
    "cluster_id": "aa-1.refsa2.bn",
    "file": "/var/log/pods/aa-aa-aa-aa-aa-gw-5ddf57fdc9-nsbqx_0d3ff80b-e2df-4ea1-9194-9392c98ced45/amf-gw/0.log",
    "kubernetes": {

MaxRink

I1130 16:14:05.175584       1 request.go:668] Waited for 1.038707568s due to client-side throttling, not priority and fairness, request: GET:https://10.96.0.1:443/apis/storage.k8s.io/v1?timeout=32s
I1130 16:14:06.782759       1 deleg.go:130] controller-runtime/metrics "msg"="metrics server is starting to listen"  "addr"="localhost:8080"
I1130 16:14:06.784241       1 deleg.go:130] controller-runtime/builder "msg"="Registering a mutating webhook"  "GVK"={"Group":"cluster.x-k8s.io","Version":"v1alpha4","Kind":"ClusterClass"} "path"="/mutate-cluster-x-k8s-io-v1alpha4-clusterclass"
I1130 16:14:06.784351       1 server.go:145] controller-runtime/webhook "msg"="registering webhook" "path"="/mutate-cluster-x-k8s-io-v1alpha4-clusterclass" 
I1130 16:14:06.784415       1 deleg.go:130] controller-runtime/builder "msg"="Registering a validating webhook"  "GVK"={"Group":"cluster.x-k8s.io","Version":"v1alpha4","Kind":"ClusterClass"} "path"="/validate-cluster-x-k8s-io-v1alpha4-clusterclass"
I1130 16:14:06.784467       1 serv