cbodley

iam accounts

what is IAM? from https://docs.aws.amazon.com/IAM/latest/APIReference/welcome.html:

AWS Identity and Access Management (IAM) is a web service for securely controlling access to AWS services. With IAM, you can centrally manage users, security credentials such as access keys, and permissions that control which AWS resources users and applications can access.

each aws account has its own set of users and policies. when you log into the aws website, there's an iam dashboard where you can view/manage all of the account's resources and policies. aws also provides a rest api with all of the same functionality

it's that iam rest api that we implement here for ceph. someday the ceph dashboard might expose this stuff too

$ aws iam create-user --user-name Alice

cbodley

#pragma once

#include <set>
#include <string>
#include <vector>
#include "common/ceph_time.h"

namespace data_changes {

// A data change event signals the presence of new entries in a bucket index log

cbodley

{
  "Version": "2012-10-17",
  "Id": "FixDirACLs",
  "Statement": [
    {
      "Sid": "AllowBucketOwner",
      "Principal": {"AWS": "arn:aws:iam:::user/bucket-owner-uid"},
      "Effect": "Allow",
      "Action": "*"
    },

cbodley

Running main() from gmock_main.cc

Repeating all tests (iteration 1) . . .

Note: Google Test filter = isal_md5.batch_thread_pool
[==========] Running 1 test from 1 test suite.
[----------] Global test environment set-up.
[----------] 1 test from isal_md5
[ RUN      ] isal_md5.batch_thread_pool
[       OK ] isal_md5.batch_thread_pool (23 ms)

cbodley

when GetObj returns a fake ETag from md5sum /dev/null:

diff --git a/src/rgw/rgw_rest_s3.cc b/src/rgw/rgw_rest_s3.cc
index ccb8a397aec..dbb8576ebbc 100644
--- a/src/rgw/rgw_rest_s3.cc
+++ b/src/rgw/rgw_rest_s3.cc
@@ -445,7 +445,7 @@ int RGWGetObj_ObjStore_S3::send_response_data(bufferlist& bl, off_t bl_ofs,
     } else {
       auto iter = attrs.find(RGW_ATTR_ETAG);
       if (iter != attrs.end()) {

cbodley

when GetObj returns no ETag header:

diff --git a/src/rgw/rgw_rest_s3.cc b/src/rgw/rgw_rest_s3.cc
index ccb8a397aec..dbb8576ebbc 100644
--- a/src/rgw/rgw_rest_s3.cc
+++ b/src/rgw/rgw_rest_s3.cc
@@ -445,7 +445,7 @@ int RGWGetObj_ObjStore_S3::send_response_data(bufferlist& bl, off_t bl_ofs,
     } else {
       auto iter = attrs.find(RGW_ATTR_ETAG);
       if (iter != attrs.end()) {

cbodley

cbodley@localhost ~/ceph/build $ LD_PRELOAD=/usr/lib64/libasan.so.8 python3.8 -m radossss
/usr/bin/python3.8: No module named radossss

=================================================================
==166101==ERROR: LeakSanitizer: detected memory leaks

Direct leak of 108160 byte(s) in 83 object(s) allocated from:
    #0 0x7f26cb8ba6af in __interceptor_malloc (/usr/lib64/libasan.so.8+0xba6af)
    #1 0x7f26cb503419 in PyObject_Malloc (/lib64/libpython3.8.so.1.0+0x103419)

cbodley

contents

1. what is asio?
2. asio::io_context as a work queue
3. CompletionToken concept
4. Executor concept
5. c++20 coroutines
6. asio in ceph

what is asio?

cbodley

$ ASAN_OPTIONS="detect_stack_use_after_return=true" LSAN_OPTIONS="suppressions=../qa/lsan.supp" MON=1 OSD=1 RGW=1 MGR=0 MDS=0 ../src/vstart.sh -n -d
     0> 2023-03-05T11:23:04.897-0500 7fcf2463fa40 -1 *** Caught signal (Segmentation fault) **
 in thread 7fcf2463fa40 thread_name:radosgw-admin

 ceph version Development (no_version) reef (dev)
 1: (ceph::ClibBackTrace::ClibBackTrace(int)+0x17f) [0x55df2d7587b3]
 2: /home/cbodley/ceph/build/bin/radosgw-admin(+0x13414f84) [0x55df2ed5bf84]
 3: /lib64/libc.so.6(+0x3cb20) [0x7fcf23a5fb20]
 4: (boost::asio::detail::timer_queue<boost::asio::detail::chrono_time_traits<ceph::coarse_mono_clock, boost::asio::wait_traits<ceph::coarse_mono_clock> > >::get_all_timers(boost::asio::detail::op_queue<boost::asio::detail::scheduler_operation>&)+0x385) [0x55df2d491a9b]
 5: (boost::asio::detail::timer_queue_set::get_all_timers(boost::asio::detail::op_queue<boost::asio::detail::scheduler_operation>&)+0x113) [0x55df2b749f6f]

cbodley

setting up user testid                                                                                                                                        
==139529==WARNING: ASan doesn't fully support makecontext/swapcontext functions and may produce false positives in some cases!                                
=================================================================                                                                                             
==139529==ERROR: AddressSanitizer: heap-buffer-overflow on address 0x6190000a04a8 at pc 0x5558ab885f43 bp 0x7fb8534d2e70 sp 0x7fb8534d2e68                    
READ of size 8 at 0x6190000a04a8 thread T80                                                                                                                   
    #0 0x5558ab885f42 in boost::context::detail::activation_record::resume() /home/cbodley/ceph/build/boost/include/boost/context/continuation_ucontext.hpp:12
6
    #1 0x5558ab893393 in boost::context::continuation::resume() && /