System Design Primer

Design a random ID generation system · blog.twitter.com github.com

Design Google docs · code.google.com neil.fraser.name

Design a key-value store like Redis · codecapsule.com allthingsdistributed.com

Return the top k requests during a time interval · cs.ucsb.edu wpi.edu

Design the Facebook chat function · erlang-factory.com facebook.com

Design the Facebook timeline function · facebook.com highscalability.com

Design a graph search function like Facebook's · facebook.com facebook.com facebook.com

Design a content delivery network like CloudFlare

Design a chat app like WhatsApp

Design a system that serves data from multiple data centers

Design a picture sharing system like Instagram · highscalability.com highscalability.com

Design an API rate limiter

Design a recommendation system like Amazon's · hulu.com ijcai13.org

Design an online multiplayer card game · indieflashblog.com buildnewgames.com

Design a Stock Exchange (like NASDAQ or Binance) · Jane Street Golang Implementation Go Implementation

Design a trending topic system like Twitter's · michael-noll.com snikolov .wordpress.com

Design a tinyurl system like Bitly

Design a search engine like Google · queue.acm.org stackexchange.com ardendertat.com stanford.edu

Design a scalable web crawler like Google

Design the Facebook news feed function · quora.com quora.com slideshare.net

Design a cache system like Memcached

Design a garbage collection system · stuffwithstuff.com washington.edu

Design a file sync service like Dropbox

Instagram · 14 million users, terabytes of photos What powers Instagram

Tumblr

TripAdvisor

Playfish

Netflix · A 360 Degree View Of The Entire Netflix Stack Netflix: What Happens When You Press Play?

Amazon

Flickr

Pinterest · From 0 To 10s of billions of page views a month 18 million visitors, 10x growth, 12 employees

Mailbox

Google

Salesforce

Uber · How Uber scales their real-time market platform Lessons Learned From Scaling Uber To 2000 Engineers, 1000 Services, And 8000 Git Repositories

Dropbox

Justin.tv

Twitter · Making Twitter 10000 percent faster Storing 250 million tweets a day using MySQL 150M active users, 300K QPS, a 22 MB/S firehose Timelines at scale Big and small data at Twitter Operations at Twitter: scaling beyond 100 million users How Twitter Handles 3,000 Images Per Second

ESPN

PlentyOfFish

Cinchcast

DataSift

Facebook · Scaling memcached at Facebook TAO: Facebook’s distributed data store for the social graph Facebook’s photo storage How Facebook Live Streams To 800,000 Simultaneous Viewers

Stack Overflow

WhatsApp

YouTube · YouTube scalability YouTube architecture

, preventing users from accessing websites such as Twitter without knowing Twitter's IP address(es).

.

on caching servers such as Squid.

.

.

) further increases complexity.

can reduce the amount of transferred data.

on each server

File system · Hadoop File System (HDFS) - Open source implementation of GFS

Data store · Bigtable - Distributed column-oriented database from Google

Data store · DynamoDB - Document-oriented database from Amazon

File system · Google File System (GFS) - Distributed file system

Data store · Spanner - Globally-distributed database from Google

Misc · Chubby - Lock service for loosely-coupled distributed systems from Google

Misc · Dapper - Distributed systems tracing infrastructure

Data processing · MapReduce - Distributed data processing from Google

Data processing · Spark - Distributed data processing from Databricks

Data store · Redis - Distributed memory caching system with persistence and value types

Data store · Cassandra - Distributed column-oriented database from Facebook

Misc · Zookeeper - Centralized infrastructure and services enabling synchronization

Data store · HBase - Open source implementation of Bigtable

Data processing · Storm - Distributed data processing from Twitter

Data store · MongoDB - Document-oriented database

Misc · Kafka - Pub/sub message queue from LinkedIn

(HTML interface for HTTP) - your web service should be fully accessible in a browser.

.

to help track performance issues.

.

and SQL injection.

.aspx)

)

)

)

.

) packets and automatic retransmission

for each packet

could lead to performance issues.

that keeps data sorted and allows searches, sequential access, insertions, and deletions in logarithmic time.