yuvalif

Usecases

• general intro, and the "why"
• ransomware detection
• ad-hoc bucket notification target
• in tape storage solution
• dynamic storage class

Code

• user docs
• code walkthrough

yuvalif

• start a vstart cluster

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• create two tenanted users:

bin/radosgw-admin user create --display-name "Hello World" --tenant world --uid hello --access_key hello --secret_key world
bin/radosgw-admin user create --display-name "Ka Boom" --tenant boom --uid ka --access_key ka --secret_key boom

• create topic, bucket and notification for one of the users:

yuvalif

• start a vstart cluster with tracing enabled:

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d \
  -o "jaeger_tracing_enable=true" -o "jaeger_agent_port=6831" -o "debug-trace=20"

• start jaeger in its own terminal:

podman run \
  -e COLLECTOR_OTLP_ENABLED=true \
 -p 6831:6831/udp \

yuvalif

Setup

• start cluster:

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• create 2 tenanted users:

bin/radosgw-admin user create --display-name "Hello World" --tenant world --uid hello --access_key hello --secret_key world
bin/radosgw-admin user create --display-name "Ka Boom" --tenant boom --uid ka --access_key ka --secret_key boom

yuvalif

Setup

• start the cluster

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• create 2 tenanted users:

bin/radosgw-admin user create --display-name "Hello World" --tenant world --uid hello --access_key hello --secret_key world
bin/radosgw-admin user create --display-name "Ka Boom" --tenant boom --uid ka --access_key ka --secret_key boom

yuvalif

Setup

• start the cluster

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• create an http topic:

aws --endpoint-url http://localhost:8000 sns create-topic --name=fishtopic \
  --attributes='{"push-endpoint": "http://localhost:10900"}'

yuvalif

#!/usr/bin/env python3
"""
License: MIT License
Copyright (c) 2023 Miel Donkers

Very simple HTTP server in python for logging requests
Usage::
    ./server.py [<port>]
"""
from http.server import BaseHTTPRequestHandler, HTTPServer

yuvalif

notification retries

phase 0

• limit number of reties (ephemeral)
• notification TTL (persistent)
• spacing the retries (ephemeral)
• global config via options

phase 1

• per topic config via REST
• notification TTL migration
• documentation

yuvalif

• start a vstart cluster

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• create a lua file that implemets access log and depends on cjson and socket packages

  if Request.RGWOp == "get_obj" then
    local json = require("cjson")
    local socket = require("socket")
    local unix = require("socket.unix")

yuvalif

set -e

name=$1
id=$2

mkdir -p "$name"
cd "$name" ||exit 

wget "http://qa-proxy.ceph.com/teuthology/$name/$id/teuthology.log" -O "teuthology$id.log"