August 2nd - 8th : Yi directed me to document the observable performance metrics of AWS S3 using the fio utility. I have converted the logs that were output by fio into the following gist:
- AWS S3 random-read performance with block_size equal to 4k, 8k, 16k, up to 1M.
- AWS S3 sequential-write performance for block_size=1M , with number of concurrent jobs 1,2,4 and 8.
Most of the rest of this week went into crafring a TiKV config file that can be used with S3, one must be able to make the convenient addition of the following configurations to their regular TiKV config to access the feature on a build that has cloud enabled for engine_rocksdb:
[rocksdb.s3]
enabled = true
src-cloud-bucket = "{aws_bucket_name}"
src-cloud-object = "{aws_object_name}"
src-cloud-region = "{aws_region_name}"
dest-cloud-bucket = "{aws_bucket_name}"
dest-cloud-object = "{aws_object_name}"
dest-cloud-region = "{aws_region_name}"
And then using the TiUP utility to setup and operate a TiKV cluster of one node and test the cloud integration.