9401adarsh

on folio07, ran s3vector test suite on my local version of remote branch wip-s3vector and my feature branch after changes.

1. started vstart with MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d --rgw_port 12000
2. under src/test/rgw/s3vector, changed port to 12000 in the conf file and ran S3VTESTS_CONF=s3vtests.conf.SAMPLE pytest after setup.
3. got the same errors in both branches (i don't know if there's anything wrong in how i am running tests)

pytest error sumary - first failure in test_put_vectors (consistent across both wip_s3vector and my feature branch)

-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html

9401adarsh

title	Improving Persistent Bucket Notifications
date	2025-08-20
author	Adarsh Ashokan
tags	ceph rgw notifications

9401adarsh

start vstart using the following command under build/

MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d --rgw_port 12000

on aws-cli - set aws-creds based on vstart.sh output.

do the following:

9401adarsh

Sharded Queue Creation Testing Plan

New Code Tests

Test Case	Description	Steps	Expected Result	Pass/Fail
Create Sharded Topic	Verify sharded topic creation	1. Create topic with sharding enabled 2. Specify shard count 3. Validate creation	Topic created with correct shard count	Pass
Delete Sharded Topic	Verify sharded topic deletion	1. Create sharded topic 2. Delete topic 3. Verify cleanup	Topic and all shards deleted completely	Pass
Modify Persistent to Non-Persistent	Convert topic persistence type	1. Create persistent topic 2. Modify to non-persistent 3. Verify behavior	Topic converted successfully	Pass
Change Shard Count	Modify number of shards	1. Create topic with N shards2. Change config to M shards3. Apply changes	Shard count updated correctly	Pass

9401adarsh

Sharding Config, Queue - Creation and Deletion on Topic Operations

Configuration Decisions

Sharding Level

• Config level rather than topic level
• Provides consistency across all topics

Number of Shards

• Keep num_shards configurable at config level

9401adarsh

Steps to follow:

• start vstart cluster

$ MON=1 OSD=1 MDS=0 MGR=0 RGW=1 ../src/vstart.sh -n -d

• on a separate terminal start an HTTP endpoint:

$ wget https://gist.githubusercontent.com/mdonkers/63e115cc0c79b4f6b8b3a6b797e485c7/raw/a6a1d090ac8549dac8f2bd607bd64925de997d40/server.py
$ python server.py 10900