Skip to content

Instantly share code, notes, and snippets.

@de-sh
Last active July 19, 2020 18:04
Show Gist options
  • Save de-sh/03c9e02aebbe7af0c6f7ac9df48cc9ee to your computer and use it in GitHub Desktop.
Save de-sh/03c9e02aebbe7af0c6f7ac9df48cc9ee to your computer and use it in GitHub Desktop.
Cloud Native Database Storage Engines

In the cloud native world, databases are more than just stores of data, they act as data exchanges, transporters and in some form as data processors. In this scheme of things, a database is in effect composed of micro-services to make it truly cloud native. Log Structured Merge Trees are a datastructure standard that fits well for use in this realm of high volume, high velocity 'data-engines' as I like to call them.

One of the databases that many people refer to in this field is Google's BigTable, infamous in the space for having started a conversation. But we are not going to be talking about that and infact refer to a product born out of Facebook, rocksdb. MyRocks is a database that works at scale and is distributed, building on top of the standards set by MySQL, with a core written in CPP known as rocksdb. Rocksdb-Cloud is a set of tools that were added on top of this engine that exponentially increases the ability of this database as well as add the ability for it to work on a public cloud setting, making it in effect a bit more cloud agnostic than the regular rocksdb engine that was built at facebook. Rockset, the company that has been building a product from the opensource project that is rocksdb-cloud has some articles that can be referred to for a better understanding of the concepts being discussed here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment