rssnyder

problem statement: scale a kubernetes delegate not based on cpu or memory, but on the number of tasks assigned to the delegates

what we need:

• a delegate deployed to a cluster
• a prometheus server running
  • delegate metrics should be getting scraped and sent to promethes
• the prometheus adapter should be installed in the cluster
  • this allows us to use prometheus metrics as scaling metrics

1. validate that our prometheus metrics can be used by the cluster for scaling:

rssnyder

terraform {
  required_providers {
    aws = {
      source  = "hashicorp/aws"
      version = "~> 5.0"
    }
    harness = {
      source = "harness/harness"
    }
  }

rssnyder

terraform {
  required_providers {
    harness = {
      source = "harness/harness"
    }
  }
}

provider "harness" {}

rssnyder

from os import getenv

from requests import post


HEADERS = {"x-api-key": getenv("HARNESS_PLATFORM_API_KEY")}

PARAMS = {
    "routingId": getenv("HARNESS_ACCOUNT_ID"),
    "accountIdentifier": getenv("HARNESS_ACCOUNT_ID"),

rssnyder

get all harness projects using python

setup

set the following in your environment

HARNESS_ACCOUNT_ID: your harness account id

HARNESS_PLATFORM_API_KEY: a harness token with orgs and projects read

rssnyder

Installing the Harness Delegate for CCM

A Harness Delegate is a service you run in your kubernetes cluster that monitors usage and gathers metrics.

To install the delegate, we can use Helm with a values file.

Add the Harness Helm repository: helm repo add harness-delegate https://app.harness.io/storage/harness-download/delegate-helm-chart/

Make sure the repo is updated: helm repo update harness-delegate

rssnyder

resource "harness_platform_connector_awscc" "master" {
  identifier = "master"
  name       = "master"

  account_id  = "759984737373"
  report_name = "harnessccm"
  s3_bucket   = "harnessccm"
  features_enabled = [
    "BILLING",
  ]

rssnyder

resource "harness_platform_connector_azure_cloud_cost" "billing" {
  identifier = "billing"
  name       = "billing"

  features_enabled = ["BILLING", "VISIBILITY", "OPTIMIZATION"]
  tenant_id        = "b229b2bb-5f33-4d22-bce0-730f6474e906"
  subscription_id  = "e8389fc5-0cb8-44ab-947b-c6cf62552be0"
  billing_export_spec {
    storage_account_name = "harnesscostexport"
    container_name       = "harness"

rssnyder

resource "harness_platform_connector_kubernetes" "cluster-a" {
  identifier  = "cluster_a"
  name        = "cluster-a"

  inherit_from_delegate {
    delegate_selectors = ["cluster-a"]
  }
}

resource "harness_platform_connector_kubernetes_cloud_cost" "cluster-a-ccm" {

rssnyder

apiVersion: v1
kind: Namespace
metadata:
  name: harness-delegate-ng

---
apiVersion: v1
kind: ServiceAccount
metadata:
  name: harness-delegate-ng