Distributed System Topics Mindmap

DistributedSystem.md

Distributed Systems and Cloud Computation

References:

Cloud Computation Coursera https://www.coursera.org/learn/cloud-computing-2?specialization=cloud-computing Distributed Systems Course from MIT: https://pdos.csail.mit.edu/6.824/schedule.html Design Data Intensive Applications: book

Cloud Systems and Infrastructure

Containers and Virtualization

• Docker

• Xen

• Resource Management

  • Kubernetes
  • Mesos

Storage

• HDFS
• Ceph
• AWS S3, EBS, Glacier
• SWIFT
• HIVE

Database Systems

• Cassandra
• Redis
• HBase

MapReduce

• Hortonworks

Streaming Processing

• Spark
• RDD
• Kafka
• Storm

Graph Processing

Deep Learning Frameworks

Language in the Cloud: Golang

Basic Concepts

MapReduce

• Example

  • Hadoop

Resource Management

• Example

  • Borg
  • Mesos

Consistency, CAP theorem

• CAP
• BASE
• ACID

Election, Consensus, Paxos, Raft

• Example

  • Zookeeper
  • Etcd

Fault Tolerance and Replication

• Two phase Commit

• Example

  • Spinnaker
  • Cassandra
  • Dynamo

Gossip (Flood Protocol)

Database Systems

• B+Tree

• SSTable and KeyValue Store

• Example

  • BBolt
  • BigTable
  • Leveldb

Storage and Distributed File Systems (GFS)

• Example

  • GFS
  • NFS
  • HDFS

Concurrency and Replication

Web Service

• Remote Procedural Call

  • Example

    • Protobuf

• Data Format

  • JSON
  • Protobuf

• REST

• Load Balancer

  • Example

    • Nginx

• Microservice

P2P Systems, DHT

• Example

  • BitTorrent

XMind: ZEN - Trial Version