The Curious Engineer

High Scalability

2008–2024

165 posts

2024 4

May 2024

  1. Kafka 101

March 2024

  1. Capturing A Billion Emo(j)i-ons
  2. Brief History of Scaling Uber
  3. Behind AWS S3’s Massive Scale

2023 4

August 2023

  1. The Swedbank Outage shows that Change Controls don't work

July 2023

  1. Lessons Learned Running Presto at Meta Scale
  2. Gossip Protocol Explained

February 2023

  1. Consistent hashing algorithm

2022 7

December 2022

  1. What is Cloud Computing? According to ChatGPT.
  2. Stuff The Internet Says On Scalability For December 2nd, 2022

October 2022

  1. The Cloud is Not a Railroad - An Argument Against the Vertical Separation of Cloud Providers

July 2022

  1. Sponsored Post: G-Core Labs, Close, Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte
  2. Stuff The Internet Says On Scalability For July 11th, 2022

June 2022

  1. Sponsored Post: G-Core Labs, Close, Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

May 2022

  1. Sponsored Post: Close, Wynter, Pinecone, Kinsta, Bridgecrew, IP2Location, StackHawk, InterviewCamp.io, Educative, Stream, Fauna, Triplebyte

2020 1

January 2020

  1. Stuff The Internet Says On Scalability For January 10th, 2020 - High Scalability -

2019 1

February 2019

  1. Design Of A Modern Cache—Part Deux - High Scalability -

2018 1

August 2018

  1. Stuff The Internet Says On Scalability For August 17th, 2018 - High Scalability -

2011 45

May 2011

  1. Stuff The Internet Says On Scalability For May 6th, 2011 - High Scalability -
  2. The Updated Big List of Articles on the Amazon Outage - High Scalability -
  3. Stack Overflow Makes Slow Pages 100x Faster by Simple SQL Tuning - High Scalability -

April 2011

  1. Heroku Emergency Strategy: Incident Command System and 8 Hour Ops Rotations for Fresh Minds - High Scalability -
  2. The Big List of Articles on the Amazon Outage - High Scalability -
  3. Stuff The Internet Says On Scalability For April 22, 2011 - High Scalability -
  4. Packet Pushers: How to Build a Low Cost Data Center - High Scalability -
  5. Stuff The Internet Says On Scalability For April 15, 2011 - High Scalability -
  6. Strategy: Cache Application Start State to Reduce Spin-up Times - High Scalability -
  7. Stuff The Internet Says On Scalability For April 8, 2011 - High Scalability -
  8. Netflix: Run Consistency Checkers All the time to Fixup Transactions - High Scalability -
  9. Stuff The Internet Says On Scalability For April 1, 2011 - High Scalability -

March 2011

  1. 8 Lessons We Can Learn from the MySpace Incident - Balance, Vision, Fearlessness - High Scalability -
  2. Aztec Empire Strategy: Use Dual Pipes in Your Aqueduct for High Availability - High Scalability -
  3. Did the Microsoft Stack Kill MySpace? - High Scalability -
  4. Strategy: Disk Backup for Speed, Tape Backup to Save Your Bacon, Just Ask Google - High Scalability -
  5. Facebook's New Realtime Analytics System: HBase to Process 20 Billion Events Per Day - High Scalability -
  6. Stuff The Internet Says On Scalability For March 18, 2011 - High Scalability -
  7. Are long VM instance spin-up times in the cloud costing you money? - High Scalability -
  8. 6 Lessons from Dropbox - One Million Files Saved Every 15 minutes - High Scalability -
  9. Google and Netflix Strategy: Use Partial Responses to Reduce Request Sizes - High Scalability -
  10. Medialets Architecture - Defeating the Daunting Mobile Device Data Deluge - High Scalability -
  11. Stuff The Internet Says On Scalability For March 4, 2011 - High Scalability -
  12. Stack Overflow Architecture Update - Now at 95 Million Page Views a Month - High Scalability -

February 2011

  1. A Practical Guide to Varnish - Why Varnish Matters - High Scalability -
  2. Strategy: Eliminate Unnecessary SQL - High Scalability -
  3. This stuff isn't taught, you learn it bit by bit as you solve each problem. - High Scalability -
  4. Is Node.js Becoming a Part of the Stack? SimpleGeo Says Yes. - High Scalability -
  5. Stuff The Internet Says On Scalability For February 18, 2011 - High Scalability -
  6. Wordnik - 10 million API Requests a Day on MongoDB and Scala - High Scalability -
  7. Stuff The Internet Says On Scalability For February 11, 2011 - High Scalability -
  8. Mollom Architecture - Killing Over 373 Million Spams at 100 Requests Per Second - High Scalability -
  9. Stuff The Internet Says On Scalability For February 4, 2011 - High Scalability -
  10. Piccolo - Building Distributed Programs that are 11x Faster than Hadoop - High Scalability -
  11. Google Strategy: Tree Distribution of Requests and Responses - High Scalability -

January 2011

  1. Stuff The Internet Says On Scalability For January 28, 2011 - High Scalability -
  2. Comet - An Example of the New Key-Code Databases - High Scalability -
  3. Google Pro Tip: Use Back-of-the-envelope-calculations to Choose the Best Design - High Scalability -
  4. 75% Chance of Scale - Leveraging the New Scaleogenic Environment for Growth - High Scalability -
  5. Paper: Relational Cloud: A Database-as-a-Service for the Cloud - High Scalability -
  6. Stuff The Internet Says On Scalability For January 14, 2011 - High Scalability -
  7. Google Megastore - 3 Billion Writes and 20 Billion Read Transactions Daily - High Scalability -
  8. Riak's Bitcask - A Log-Structured Hash Table for Fast Key/Value Data - High Scalability -
  9. BankSimple Mini-Architecture - Using a Next Generation Toolchain - High Scalability -
  10. Stuff The Internet Says On Scalability For January 3, 2010 - High Scalability -

2010 96

December 2010

  1. Facebook in 20 Minutes: 2.7M Photos, 10.2M Comments, 4.6M Messages - High Scalability -
  2. Pinboard.in Architecture - Pay to Play to Keep a System Small - High Scalability -
  3. Netflix: Continually Test by Failing Servers with Chaos Monkey - High Scalability -
  4. Paper: CRDTs: Consistency without concurrency control - High Scalability -
  5. Netflix: Use Less Chatty Protocols in the Cloud - Plus 26 Fixes - High Scalability -
  6. Stuff the Internet Says on Scalability For December 17th, 2010 - High Scalability -
  7. Still Time to Attend My Webinar Tomorrow: What Should I Do? Choosing SQL, NoSQL or Both for Scalable Web Applications - High Scalability -
  8. How To Get Experience Working With Large Datasets - High Scalability -
  9. What the heck are you actually using NoSQL for? - High Scalability -
  10. GPU vs CPU Smackdown : The Rise of Throughput-Oriented Architectures - High Scalability -

November 2010

  1. Stuff the Internet Says on Scalability For November 29th, 2010 - High Scalability -
  2. Strategy: Google Sends Canary Requests into the Data Mine - High Scalability -
  3. Announcing My Webinar on December 14th: What Should I Do? Choosing SQL, NoSQL or Both for Scalable Web Applications - High Scalability -
  4. Facebook's New Real-time Messaging System: HBase to Store 135+ Billion Messages a Month - High Scalability -
  5. How Google's Instant Previews Reduces HTTP Requests - High Scalability -
  6. Strategy: Biggest Performance Impact is to Reduce the Number of HTTP Requests - High Scalability -
  7. Stuff the Internet Says on Scalability For November 12th, 2010 - High Scalability -
  8. Paper: Hyder - Scaling Out without Partitioning - High Scalability -
  9. Facebook Uses Non-Stored Procedures to Update Social Graphs - High Scalability -
  10. Hot Scalability Links For November 5th, 2010 - High Scalability -
  11. Facebook at 13 Million Queries Per Second Recommends: Minimize Request Variance - High Scalability -
  12. Hot Trend: Move Behavior to Data for a New Interactive Application Architecture - High Scalability -

October 2010

  1. Hot Scalability Links For Oct 24, 2010 - High Scalability -
  2. Paper: Netflix’s Transition to High-Availability Storage Systems - High Scalability -
  3. Machine VM + Cloud API - Rewriting the Cloud from Scratch - High Scalability -
  4. Troubles with Sharding - What can we learn from the Foursquare Incident? - High Scalability -
  5. Hot Scalability Links For Oct 8, 2010 - High Scalability -
  6. Paper: An Analysis of Linux Scalability to Many Cores - High Scalability -
  7. Hot Scalability Links For Oct 1, 2010 - High Scalability -

September 2010

  1. More Troubles with Caching - High Scalability -
  2. Facebook and Site Failures Caused by Complex, Weakly Interacting, Layered Systems - High Scalability -
  3. Playfish's Social Gaming Architecture - 50 Million Monthly Users and Growing - High Scalability -
  4. Hot Scalability Links For Sep 17, 2010 - High Scalability -
  5. How Can the Large Hadron Collider Withstand One Petabyte of Data a Second? - High Scalability -
  6. Hot Scalability Links For Sep 3, 2010 - High Scalability -

August 2010

  1. Pomegranate - Storing Billions and Billions of Tiny Little Files - High Scalability -
  2. OpenStack - The Answer to: How do We Compete with Amazon? - High Scalability -
  3. 21 Quality Screencasts on Scaling Rails - High Scalability -
  4. 6 Ways to Kill Your Servers - Learning How to Scale the Hard Way - High Scalability -
  5. Hot Scalability Links For Aug 20, 2010 - High Scalability -
  6. Misco: A MapReduce Framework for Mobile Systems - Start of the Ambient Cloud? - High Scalability -
  7. Scaling an AWS infrastructure - Tools and Patterns - High Scalability -
  8. Hot Scalability Links for Aug 13, 2010 - High Scalability -
  9. Strategy: Terminate SSL Connections in Hardware and Reduce Server Count by 40% - High Scalability -
  10. Think of Latency as a Pseudo-permanent Network Partition - High Scalability -
  11. Hot Scalability Links for Aug 6, 2010 - High Scalability -
  12. Dremel: Interactive Analysis of Web-Scale Datasets - Data as a Programming Paradigm - High Scalability -
  13. 7 Scaling Strategies Facebook Used to Grow to 500 Million Users - High Scalability -

July 2010

  1. Hot Scalability Links for July 30, 2010 - High Scalability -
  2. A Metric A$$-Ton of Joe Stump: The Cloud is Cheaper than Bare Metal - High Scalability -
  3. 4 New Podcasts for Scalable Summertime Reading - High Scalability -
  4. How can we spark the movement of research out of the Ivory Tower and into production? - High Scalability -
  5. Strategy: Consider When a Service Starts Billing in Your Algorithm Cost - High Scalability -
  6. Hot Scalability Links for July 17, 2010 - High Scalability -
  7. DbShards Part Deux - The Internals - High Scalability -
  8. So, Why is Twitter Really Not Using Cassandra to Store Tweets? - High Scalability -
  9. Hot Scalability Links for July 9, 2010 - High Scalability -
  10. Cloud AWS Infrastructure vs. Physical Infrastructure - High Scalability -
  11. Strategy: Recompute Instead of Remember Big Data - High Scalability -
  12. Hot Scalability Links for July 2, 2010 - High Scalability -

June 2010

  1. VoltDB Decapitates Six SQL Urban Myths and Delivers Internet Scale OLTP in the Process - High Scalability -
  2. Hot Scalability Links for June 25, 2010 - High Scalability -
  3. Hot Scalability Links for June 16, 2010 - High Scalability -
  4. Six Ways Twitter May Reach its Big Hairy Audacious Goal of One Billion Users - High Scalability -
  5. Hot Scalability Links for June 3, 2010 - High Scalability -

May 2010

  1. Strategy: Rule of 3 Admins to Save Your Sanity - High Scalability -
  2. 7 Lessons Learned While Building Reddit to 270 Million Page Views a Month - High Scalability -
  3. Hot Scalability Links for May 14, 2010 - High Scalability -
  4. The Rise of the Virtual Cellular Machines - High Scalability -
  5. How will memristors change everything? - High Scalability -

April 2010

  1. Hot Scalability Links for April 30, 2010 - High Scalability -
  2. Paper: Dapper, Google's Large-Scale Distributed Systems Tracing Infrastructure - High Scalability -
  3. Sponsored Post: Event - Social Developer Summit - High Scalability -
  4. Hot Scalability Links for April 16, 2010 - High Scalability -
  5. Hot Scalability Links for April 8, 2010 - High Scalability -
  6. Strategy: Make it Really Fast vs Do the Work Up Front - High Scalability -
  7. Sponsored Post: Event - Social Developer Summit - High Scalability -
  8. Intercloud: How Will We Scale Across Multiple Clouds? - High Scalability -
  9. Hot Scalability Links for April 1, 2010 - High Scalability -

March 2010

  1. Running Large Graph Algorithms - Evaluation of Current State-of-the-Art and Lessons Learned - High Scalability -
  2. Strategy: Caching 404s Saved the Onion 66% on Server Time - High Scalability -
  3. Hot Scalability Links for March 19, 2010 - High Scalability -
  4. Justin.tv's Live Video Broadcasting Architecture - High Scalability -
  5. How FarmVille Scales - The Follow-up - High Scalability -
  6. Applications as Virtual States - High Scalability -
  7. How MySpace Tested Their Live Site with 1 Million Concurrent Users - High Scalability -
  8. Using the Ambient Cloud as an Application Runtime - High Scalability -

February 2010

  1. MySQL and Memcached: End of an Era? - High Scalability -
  2. Twitter’s Plan to Analyze 100 Billion Tweets - High Scalability -
  3. Seven Signs You May Need a NoSQL Database - High Scalability -
  4. The Amazing Collective Compute Power of the Ambient Cloud - High Scalability -
  5. How FarmVille Scales to Harvest 75 Million Players a Month - High Scalability -
  6. What Will Kill the Cloud? - High Scalability -

January 2010

  1. Let's Welcome our Neo-Feudal Overlords - High Scalability -
  2. Applications Become Black Boxes Using Markets to Scale and Control Costs - High Scalability -
  3. Have We Reached the End of Scaling? - High Scalability -

2009 3

December 2009

  1. Building Super Scalable Systems: Blade Runner Meets Autonomic Computing in the Ambient Cloud - High Scalability -

August 2009

  1. Yahoo!'s PNUTS Database: Too Hot, Too Cold or Just Right? - High Scalability -

June 2009

  1. Neo4j - a Graph Database that Kicks Buttox - High Scalability -

2008 3

December 2008

  1. Paper: Spamalytics: An Empirical Analysisof Spam Marketing Conversion - High Scalability -

October 2008

  1. Scaling Spam Eradication Using Purposeful Games: Die Spammer Die! - High Scalability -

July 2008

  1. Five Ways to Stop Framework Fixation from Crashing Your Scaling Strategy - High Scalability -