Skip to content

Instantly share code, notes, and snippets.

@ross-humphrey
Created January 14, 2020 14:36
Show Gist options
  • Save ross-humphrey/91b54b0a84aa33f05b323dcdc42a077c to your computer and use it in GitHub Desktop.
Save ross-humphrey/91b54b0a84aa33f05b323dcdc42a077c to your computer and use it in GitHub Desktop.
πŸͺ AWS Storage
Amazon S3
> Object storage
> Industry leading - scalability, availability, security, performance
> Easy to use management features
> Easy to organize data and configure finely tuned access controls
> 11 9's of durability
Amazon Elastic Block Store
> Persistent block storage volumes for use with EC2
> Each EBS volume is automatically replicated within its AZ to protect from failure
> Offers high availability and durability
> Offers consistent and low latency performance to run workloads
> Scale usage up and down within minutes
Amazon Elastic File System
> Simple scalable elastic file system for Linux based workloads for use with AWS cloud and on prem.
> Built to scale to petabytes without disrupting applications, growing and shrinking automatically.
> Provides massively parallel shared access to thousands of EC2s
> Enabled apps to achieve high levels of aggregate throughput and IOPS with consistent latency
> Fully managed
> Regional service storing data within and across AZs
> Access file systems across AZs and regions and share files in cloud and on-prem using AWS Direct connect or AWS VPN
Suited to use cases:
> Highly parallelized
> Scale out workloads
> High throughput -> single threaded workloads
> Latency sensitive workloads
> Lift and shift apps
> Big Data,
> Web and content management
> App dev and testing
> Media and entertainment
> DB backups
> Container storage
Amazon FSx for Lustre (dedicated for Windows file server too)
> Fully managed file system
> Optimized for compute intensive workloads usch as ML or mediata processing
> High perforamnce - low latency, scale out, parallele file system
> Looks after the overhead
> Integrated with S3 making it easy to link to long term data sets with high performance file systems
> Automatically copy from S3->FSx.
S3 Glacier
> Secure, durable and low cost storage
> Suitable for back up and archiving
> 9, 9's durability
> Comprehensive security and compliance
> Significant storage over on prem
> Different access SLAs from few minutes to several hours
AWS Storage gateway
> Hybrid allowing you to use onprem applications to use AWS cloud storage.
> Allows for NFS, SMB and iSCSI
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment