Skip to content

Instantly share code, notes, and snippets.

@sub-mod
Forked from songbinliu/Reflector.md
Created December 29, 2019 23:45
Show Gist options
  • Save sub-mod/fe29ed45e89afdfdbf55613ac120ea0c to your computer and use it in GitHub Desktop.
Save sub-mod/fe29ed45e89afdfdbf55613ac120ea0c to your computer and use it in GitHub Desktop.
description the implementation and usage of kubernetes reflector.

Kubernetes Reflector

Reflector is a key component for Kubernetes clients, kube-scheduler and Replication Controller. Reflector is in the middle between client and Kubernetes API-server. It provides a framework to monitor the changes of the Kubernetes cluster.

Definition of Reflector

Here is the definition of Reflector. reflector define

As shown in the definition, there are two important compoents of a Reflector:

  • ListerWatcher

    It provides two functions: List and Watch. These two functions will talk with Kubernetes API-server, and get the Events.

  • Store

    It is usually a in-memory storage, such as HashMap, or Queue(for FIFO). Reflector will add the Events into this Store.

It should be noted that the reflect.Type is usually a Kind of Kubernetes Object, such as Pod, Node.

Toy Example Usage of Reflector

Before going deeper into the implementation of Reflector, let's have a look at how Reflector can be used from a example. This example will watch the changes(including ADD, DELETE, MODIFY) of all the Pods in the Kubernetes cluster. According to the changes, it will add(or update) Pod object into the Store if a Pod is created(or updated), and delete a Pod object from the Store if the Pod is killed in the Kubernetes. In addition, it will also print all the Pod names every 30 seconds: If a Pod is deleted, then its name won't appear; if a Pod is created, its name will appear.

func main() {
	client := getKubeClient()
	if client == nil {
		fmt.Println("failed to get kubeclient")
		return
	}

	stopCh := make(chan struct{})
	store := cache.NewStore(cache.MetaNamespaceKeyFunc)

	selector := fields.Everything()
	namespaceAll := ""
	listWatch := cache.NewListWatchFromClient(client.CoreV1Client.RESTClient(),
		"pods",
		namespaceAll,
		selector)

	r := cache.NewReflector(listWatch, &v1.Pod{}, store, 0)

	r.RunUntil(stopCh)

	for i := 1; i < 20; i++ {
		time.Sleep(30 * time.Second)
		printContent(store.ListKeys())
	}

	time.Sleep(10 * time.Second)
	printContent(store.ListKeys())
	close(stopCh)
}
 

From this example, we can see that Reflector uses Kube-client to list and watch all the Pods, and store the changes in the Store. reflector

Implementation of Reflector

The implementation of Reflector is in Kubernetes Go Client tools/cache/ package. Reflector.RunUntil() function will periodly call Reflector.ListAndWatch() function.

As the name suggests, Reflector.ListAndWatch() will first list all the Objects and store them in the Store; then it will watch the changes and handle the changes with Reflector.watchHandler() function.Following is the skech of the Reflector.ListAndWatch() and Reflector.watchHandler() functions.

Reflctor.ListAndWatch() listwatch

As shown in the definition of Reflctor.ListAndWatch(), Reflector first call kubeclient.List() to get all the Objects (in the previous example, they are Pods), and add all these Objects into the Store by Reflector.syncWith(). Second, the Reflector will call kubeclient.Watch(). As this Watch() call has timeout, it will call kubeclient.Watch() repeatedly.

Reflector.watchHandler() handlewatch

As shown in the definition of Reflector.watchHandler(), Reflector keeps a connection to the APIserver, and receives changes(Events) from this connection. It will update the content of the Store according to the Event.Type. The content of the Store will be consumed by other components.

Usage of Reflector

Reflector provides an efficient framework to monitor the changes of the Kubernetes cluster. Many other tools are build base on Reflector, by consuming the content of the Reflector.Store. For example, ReplicationController will watch the number of living Pods, and create or kill Pod as necessary.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment