All blogs / Distributed systems / cloud
Metadata
On distributed systems broadly defined and other curiosities. The opinions on this site are my own.
Distributed systems / cloudDatabasesAI / MLEssays / personal
- Posts
- 848 from 3 Aug 2007 to 27 Oct 2026
- Posting
- weekly (80 in the last year)
- Kind
- personal blog
- Feed
- https://muratbuffalo.blogspot.com/feeds/posts/default?alt=rss
2026 68
- TLA-Verus: LLM agents prove temporal properties of TLA+ specs
- The Man from the Future: Why Johnny Can't Stop Abstracting
- What Do the Frontier Labs Actually Believe?
- HPTS 2026 (Day 2 and Day 3)
- HPTS 2026 (Day 1)
- Atlas Infinite: MongoDB's Disaggregated Architecture
- What Happens When the Model Eats the Stack? Rethinking the Research Agenda for Data Agents to Withstand the Bitter Lesson
- In Search of a Compositional Theory of Self-Stabilization
- Academic Doomerism
- Jetpack: Consensus Made Generally Fast (OSDI '26)
- Metastability as a failed conditional discharge of rely-guarantee composition
- The Safest Job from AI may be Writing
- Composition and Modular Verification of TLA+ specs
- Thoughts on LLMs
- Specula: Scaling formal specifications for autonomous model checking of system code
- Towards Designing an Execution Control System with Metastability Resilience
- Aurora DSQL: Scalable, Multi-Region OLTP
- Characterizing Metastable Faults and Failures
- Leaving Buffalo: A Move-ing Story
- 5 Lessons at 50
- Our Collective Bike Shed Moment
- Our Italy trip
- Our MongoDB TLA+ Workshop
- Writing Code vs. Shipping Code: Productivity Effects Across Generations of AI Coding Tools
- A Case for Simulation-Driven Resilience in Agentic Data Systems
- ACM CAIS: Conference on AI and Agentic Systems
- Chess invariants
- OSTEP Chapter 15: Address Translation
- Book review: The Thinking Machine
- The Two Abstractions of System Design: Hide or Reduce
- BugBash'26: Day 2
- BugBash'26 Afternoon of Day 1
- BugBash'26 Morning of Day 1
- BugBash'26 Keynote: We won, what now?
- OSTEP Chapter 14: Interlude -- Memory API
- PolitePaxos: A New Consensus Variant Where the Proposer Just Asks Nicely
- Measuring AI Ability to Complete Long Software Tasks
- OSTEP Chapter 13: The Abstraction of Address Spaces
- SysMoBench: Evaluating AI on Formally Modeling Complex Real-World Systems
- TLA+ mental models
- Beat Paxos
- Claude Code experiment: Visualizing Hybrid Logical Clocks
- OSTEP Chapter 10: MultiProcessor Scheduling
- Measuring Agents in Production
- Modeling Token Buckets in PlusCal and TLA+
- The Serial Safety Net: Efficient Concurrency Control on Modern Hardware
- TLA+ as a Design Accelerator: Lessons from the Industry
- Building a Database on S3
- 800th blog post: Write that Blog!
- Writing Away From the Screen
- End of Productivity Theater
- OSTEP Chapter 9: Proportional Share Scheduling
- Are We Becoming Architects or Butlers to LLMs?
- How LLMs may affect academic writing
- OSTEP Chapter 8
- Towards a Standard for JSON Document Databases
- OSTEP Chapters 6,7
- The F word
- OSTEP Chapters 4,5
- CockroachDB Serverless: Sub-second Scaling from Zero with Multi-region Cluster Virtualization
- Welcome to Town Al-Gasr
- Agentic AI and The Mythical Agent-Month
- Rethinking the University in the Age of AI
- Cloudspecs: Cloud Hardware Evolution Through the Looking Glass
- The Sauna Algorithm: Surviving Asynchrony Without a Clock
- Are Database System Researchers Making Correct Assumptions about Transaction Workloads?
- Too Close to Our Own Image?
- The Agentic Self: Parallels Between AI and Self-Improvement
2025 62
- Rethinking the Cost of Distributed Caches for Datacenter Services
- Randomer Things
- LeaseGuard: Raft Leases Done Right!
- TLA+ modeling tips
- Brainrot
- Best of metadata in 2025
- Optimize for momentum
- Mitigating Application Resource Overload with Targeted Task Cancellation
- Disaggregated Database Management Systems
- Taurus MM: A Cloud-Native Shared-Storage Multi-Master Database
- Taurus Database: How to be Fast, Available, and Frugal in the Cloud
- TLA+ Modeling of AWS outage DNS race condition
- Barbarians at the Gate: How AI is Upending Systems Research
- Academic chat: On PhD
- Tiga: Accelerating Geo-Distributed Transactions with Synchronized Clocks
- The Invisible Curriculum of Research
- Four Ivies. Two days.
- Supporting our AI overlords: Redesigning data systems to be Agent-first
- Disaggregation: A New Architecture for Cloud Databases
- Our Myrtle Beach vacation
- Recent Reads (September 25)
- Asymmetric Linearizable Local Reads
- Cabinet: Dynamically Weighted Consensus Made Fast
- Vive la Difference: Practical Diff Testing of Stateful Applications
- Towards Optimal Transaction Scheduling
- Neurosymbolic AI: The 3rd Wave
- Neurosymbolic AI: Why, What, and How
- Can a Client–Server Cache Tango Accelerate Disaggregated Storage?
- Transaction Healing: Scaling Optimistic Concurrency Control on Multicores
- Analysing Snapshot Isolation
- Recent reads (July 2025)
- Real Life Is Uncertain. Consensus Should Be Too!
- Morty: Scaling Concurrency Control with Re-Execution
- Serializable Isolation for Snapshot Databases
- ATC/OSDI’25 Technical Sessions
- ATC/OSDI 2025 impressions
- Chapter 7: Distributed Recovery (Concurrency Control Book)
- Analyzing Metastable Failures in Distributed Systems
- Chapter 6: Centralized Recovery (Concurrency Control Book)
- Chapter 5: Multiversion Concurrency Control (Concurrency Control Book)
- Chapter 4: Non-Locking Schedulers (Concurrency Control Book)
- Chapter 3: Two Phase Locking (Concurrency Control Book)
- Chapter 2: Serializability Theory (Concurrency Control Book)
- Modular verification of MongoDB Transactions using TLA+
- Concurrency Control and Recovery in Database Systems: Preface and Chapter 1
- Notes from the TLA+ Community Event
- TLA+ Community Event at ETAPS 2025
- Multi-Grained Specifications for Distributed System Model Checking and Verification
- What I'd do as a College Freshman in 2025
- Cedar: A New Language for Expressive, Fast, Safe, and Analyzable Authorization
- ParallelRaft: Out-of-Order Executions in PolarFS
- Publish and Perish: Why Ponder Stibbons Left the Ivory Tower
- Our K-Drama Journey
- Smart Casual Verification of the Confidential Consortium Framework
- What makes entrepreneurs entrepreneurial?
- My Time at MIT
- Hanging in there
- Intelligence wants to be everywhere
- GaussDB-Global: A Geographically Distributed Database System
- Use of Time in Distributed Databases (part 5): Lessons learned
- Use of Time in Distributed Databases (part 4): Synchronized clocks in production databases
- I Can’t Believe It’s Not Causal! Scalable Causal Consistency with No Slowdown Cascades
2024 78
- Use of Time in Distributed Databases (part 3): Synchronized clocks in databases
- Use of Time in Distributed Databases (part 2): Use of logical clocks in databases
- Use of Time in Distributed Databases (part 1)
- Utilizing highly synchronized clocks in distributed databases
- Best of Metadata in 2024
- Index for Designing Data Intensive Applications (DDIA) book
- DDIA: Chapter 11 - Stream Processing
- Exploring the NaiadClock TLA+ model in TLA-Web
- Blood draw
- Everything is a Transaction: Unifying Logical Concurrency Control and Physical Data Structure Maintenance in Database Management Systems
- DDIA: Chp 10. Batch Processing
- DBSP: Automatic Incremental View Maintenance for Rich Query Languages
- UB Hacking 2024
- DDIA: Chp 9. Consistency and Consensus
- Auto-WLM: machine learning enhanced workload management in Amazon Redshift
- DDIA: Chp 8. The Trouble with Distributed Systems
- DDIA: Chp 7. Transactions (Part 2): Serializability
- DDIA: Chp 7. Transactions (Part 1)
- 700
- SRDS Day 2
- SRDS Day 1
- DDIA: Chp 6. Partitioning
- HPTS day 2, part 2
- HPTS day 2, part 1
- Transactional storage for geo-replicated systems
- HPTS'24 day 1, part 2
- HPTS'24 Day 1, part 1
- DDIA: Chp 5. Replication (Part 2)
- DDIA: Chp 5. Replication (Part 1)
- FlexiRaft: Flexible Quorums with Raft
- DDIA: Chp 4. Encoding and Evolution (Part 2)
- Taming Consensus in the Wild (with the Shared Log Abstraction)
- DDIA: Chp 4. Encoding and Evolution (Part 1)
- Looming Liability Machines (LLMs)
- DDIA: Chp 3. Storage and Retrieval (Part 2)
- DDIA: Chp 3. Storage and Retrieval (Part 1)
- Making database systems usable
- Linearizability: A Correctness Condition for Concurrent Objects
- Designing Data Intensive Applications (DDIA) Book
- Index for the Transaction Processing Book
- Advice to the young
- Understanding the Performance Implications of Storage-Disaggregated Databases
- Unanimous 2PC: Fault-tolerant Distributed Transactions Can be Fast and Simple
- Optimizing Distributed Protocols with Query Rewrites
- Always Measure One Level Deeper
- TLA+ modeling of a single replicaset transaction modeling
- Know Yourself
- Understanding Inconsistency in Azure Cosmos DB with TLA+
- Amazon MemoryDB: A Fast and Durable Memory-First Cloud Database
- Recent reads (Mar-Apr 2024)
- Linux OSSNA'24
- TLA+ conference 2024
- OLTP Through the Looking Glass, and What We Found There
- Chardonnay: Fast and General Datacenter Transactions for On-Disk Databases (OSDI'23)
- A critique of ANSI SQL Isolation layers (Transaction Processing Book followup)
- Implementation of Cluster-wide Logical Clock and Causal Consistency in MongoDB
- Isolation Concepts (Chp. 7, part 2, Transaction processing book)
- Isolation Concepts (Chp 7: Transaction processing book)
- The demise of coding is greatly exaggerated
- Checking Causal Consistency of MongoDB
- Transaction Processing Monitors (Chapter 5. Transaction processing book)
- Why I blog
- Transaction models (Chapter 4. Transaction processing book)
- Recent reads (Feb 2024)
- TLA+ modeling of MongoDB logless reconfiguration
- Adapting TPC-C Benchmark to Measure Performance of Multi-Document Transactions in MongoDB
- Fault tolerance (Transaction processing book)
- Transaction Processing Book, Gray/Reuter 1992
- Verifying Transactional Consistency of MongoDB
- Tunable Consistency in MongoDB
- Design and Analysis of a Logless Dynamic Reconfiguration Protocol
- Fault-Tolerant Replication with Pull-Based Consensus in MongoDB
- Looking Back at Postgres
- Scalable OLTP in the Cloud: What’s the BIG DEAL?
- Oblivious Paxos: Privacy-Preserving Consensus Over Secret-Shares
- Dude, where's my Emacs?
- Recent reads
- The checklist manifesto (Dr. Atul Gawande, 2009)
2023 43
- Nezha: Deployable and High-Performance Consensus Using Synchronized Clocks
- Best of Metadata in 2023
- Lifting the veil on Meta’s microservice architecture: Analyses of topology and request workflows
- Our Florida vacation
- Towards Modern Development of Cloud Applications
- Epoxy: ACID Transactions Across Diverse Data Stores
- PolarDB-SCC: A Cloud-Native Database Ensuring Low Latency for Strongly Consistent Reads
- Cabbage, Goat, and Wolf Puzzle in TLA+
- Kora: A Cloud-Native Event Streaming Platform For Kafka
- TiDB: A Raft-based HTAP Database
- Hints for Distributed Systems Design
- Beyond the Code: TLA+ and the Art of Abstraction
- Metastable failures in the wild
- Review: Performance Modeling and Design of Computer Systems: Queueing Theory in Action
- A snapshot isolated database modeling in TLA+
- Model Checking Guided Testing for Distributed Systems
- Take Out the TraChe: Maximizing (Tra)nsactional Ca(che) Hit Rate
- Distributed Transactions at Scale in Amazon DynamoDB
- Going Beyond an Incident Report with TLA+
- Spanner: Becoming a SQL system
- F1: A Distributed SQL Database That Scales
- Detock: High Performance Multi-region Transactions at Scale (Sigmod 2023)
- SIGMOD'23: Industry talks, and Ted Codd Innovation Award
- SIGMOD panel: Future of Database System Architectures
- SIGMOD/PODS Day 2
- SIGMOD/PODS Day 1
- New directions in cloud programming
- Keep CALM and CRDT On
- Open Versus Closed: A Cautionary Tale
- Empowering Azure Storage with RDMA
- The end of a myth: Distributed transactions can scale
- ARIES: A Transaction Recovery Method Supporting Fine-Granularity Locking and Partial Rollbacks
- Getting schooled by AI, colleges must evolve
- Characterizing Microservice Dependency and Performance: Alibaba Trace Analysis
- Aria: A Fast and Practical Deterministic OLTP Database
- Speedy Transactions in Multicore In-Memory Databases
- Polyjuice: High-Performance Transactions via Learned Concurrency Control (OSDI'21)
- Books I read recently
- Designing Access Methods: The RUM Conjecture
- A Study of Database Performance Sensitivity to Experiment Settings
- TPC-E vs. TPC-C: Characterizing the New TPC-E Benchmark via an I/O Comparison Study
- Is Scalable OLTP in the Cloud a Solved Problem? (CIDR 2023)
- Reconfiguring Replicated Atomic Storage
2022 43
- Best of Metadata in 2022
- Noria: dynamic, partially-stateful dataflow for high-performance web applications
- NoSQL: The Hangover of Dropping ACID
- Vertical Paxos and Primary-Backup Replication
- OceanBase: A 707 Million tpmC Distributed Relational Database System
- Highly Available Transactions: Virtues and Limitations
- Practical uses of synchronized clocks in distributed systems
- Timestamp-based Algorithms for Concurrency Control in Distributed Database Systems
- Checking statistical properties of protocols using TLA+
- TLA+ Conference and StrangeLoop 2022
- Amazon Redshift Re-invented
- SQLite: Past, Present, and Future
- Memory-Optimized Multi-Version Concurrency Control for Disk-Based Database Systems
- Socrates: The New SQL Server in the Cloud (Sigmod 2019)
- Fast Serializable Multi-Version Concurrency Control for Main-Memory Database Systems
- Hekaton: SQL Server’s Memory-Optimized OLTP Engine
- The Seattle Report on Database Research (2022)
- Strict-serializability, but at what cost, for what purpose?
- TAOBench: An End-to-End Benchmark for Social Network Workloads
- Automated Validation of State-Based Client-Centric Isolation with TLA+ (2021)
- Amazon DynamoDB: A Scalable, Predictably Performant, and Fully Managed NoSQL Database Service (USENIX ATC 2022)
- High Throughput Replication with Integrated Membership Management (USENIX ATC 2022)
- OSDI2022, continued
- OSDI 2022: nature is healing
- Seeing is Believing: A Client-Centric Specification of Database Isolation
- Enabling the Next Generation of Multi-Region Applications with CockroachDB (Sigmod 22)
- Consus: Taming the Paxi
- Why should this paper be published?
- Feral Concurrency Control: An Empirical Investigation of Modern Application Integrity
- Warp: Lightweight Multi-Key Transactions for Key-Value Stores
- Anna: A Key-Value Store For Any Scale
- An Empirical Evaluation of In-Memory MultiVersion Concurrency Control
- An Evaluation of Distributed Concurrency Control
- Calvin: Fast Distributed Transactions for Partitioned Database Systems
- Amazon Aurora: Design Considerations + On Avoiding Distributed Consensus for I/Os, Commits, and Membership Changes
- FoundationDB: A Distributed Unbundled Transactional Key Value Store (Sigmod 2021)
- CockroachDB: The Resilient Geo-Distributed SQL Database
- Efficient Replication via Timestamp Stability (EuroSys 2021)
- Deep reading
- RAMP-TAO: Layering Atomic Transactions on Facebook’s Online TAO Data Store (VLDB'21)
- Decoupled Transactions: Low Tail Latency Online Transactions Atop Jittery Servers (CIDR 2022)
- Clear communication
- Reasons I hate conferences, and suggestions for fixing them
2021 47
- Best of metadata in 2021
- Learning a technical subject
- A read-only transaction anomaly under snapshot isolation
- Humans of Computer Systems: Ted
- Graviton2 and Graviton3
- Chess
- What’s Really New with NewSQL?
- Rabia: Simplifying State-Machine Replication Through Randomization (SOSP'21)
- Log structured protocols in Delos (SOSP21)
- David G. Andersen AMA (SOSP Day 3)
- Jon Howell AMA at SOSP21 (Day 2)
- SOSP21 conference (Day 1)
- Linearizability
- Using Lightweight Formal Methods to Validate a Key-Value Storage Node in Amazon S3 (SOSP21)
- Book review: Fountainhead
- Matchmaker Paxos: A Reconfigurable Consensus Protocol
- There is plenty of room at the bottom
- Do tightly synchronized clocks help consensus?
- Progress beats perfect
- Humans of Computer Systems: Frenchie
- Humans of Computer Systems: Goku
- Humans of Computer Systems: IndianDev
- Humans of Computer Systems: Dalecooper
- Humans of Computer Systems: Obdurodon
- Humans of Computer Systems: A. Jesse Jiryu Davis
- Humans of Computer Systems: afk
- Humans of Computer Systems: Rafael
- Humans of Computer Systems: Arcot
- Humans of computer systems
- FoundationDB Record Layer: A Multi-Tenant Structured Datastore
- Genius: The Life and Science of Richard Feynman
- Silent data corruptions at scale
- Cores that don't count
- Tale of two cities
- Building Distributed Systems With Stateright
- Book review. Storyworthy: Engage, Teach, Persuade, and Change Your Life through the Power of Storytelling
- Sundial: Fault-tolerant Clock Synchronization for Datacenters
- Your attitude determines your success
- Defending Computer Science & Engineering in a life raft debate
- Foundational distributed systems papers
- Read papers, Not too much, Mostly foundational ones
- How to make Zoom teaching suck less
- How I lost 20 pounds
- A chair named Cherry
- Virtual Consensus in Delos
- Trial and error
- Facebook: The Inside Story (2020) by Steven Levy
2020 76
- Year in Review: Best of Metadata in 2020
- Hybrid clocks crate in Rust
- Compositional Programming and Testing of Dynamic Distributed Systems
- The Everything Store: Jeff Bezos and the Age of Amazon (Brad Stone 2013)
- How innovation works and why it flourishes in freedom (2020, by Matt Ridley)
- High availability in cheap distributed key value storage
- Consolidating concurrency control and consensus for commits under conflicts
- The Rational Optimist: How Prosperity Evolves
- Mathematics for human flourishing (book review)
- Ocean Vista: Gossip-Based Visibility Control for Speedy Geo-Distributed Transactions
- Armada: Low-Effort Verification of High-Performance Concurrent Programs
- Designing Distributed Systems Using Approximate Synchrony in Data Center Networks
- Scalable state machine replication
- Book review. Consider this: moments in my writing life after which everything was different (Chuck Palahniuk, 2020)
- Zoom, zoom, zoom
- My Distributed Systems Seminar's reading list for Fall 2020
- In the Plex: How Google Thinks, Works, and Shapes Our Lives (Steven Levy, 2011)
- The Impact of RDMA on Agreement
- The great work of your life, by Stephen Cope
- Modeling Streamlet (take two)
- Modeling Streamlet in TLA+
- Streamlet: textbook streamlined blockchains
- Masters of Doom: How Two Guys Created an Empire and Transformed Pop Culture (book review)
- Misc links edition July 3rd
- Enlightenment Now (2019) by Steven Pinker
- The FuzzyLog: A partially ordered shared log (OSDI'18)
- State-Machine Replication for Planet-Scale Systems (Eurosys 2020)
- Paxos unpacked
- Misc dist-links edition June 17th
- Research, writing, and career advice
- Enabling lightweight transactions with precision time (ASPLOS 2017)
- Learning about distributed systems: where to start?
- Exploiting Commutativity For Practical Fast Replication (NSDI'19)
- Book review. Ra (novel) 2018
- Forty book recommendations
- Vincent Van Gogh, Lust for Life
- Curiosity-driven research
- SLOG: serializable, low-latency, geo-replicated transactions
- Clash of civilizations: Medical versus the World edition
- Ahmet's Unity project
- Mergeable Replicated Data Types
- Stable and Consistent Membership at Scale with Rapid
- Our Europe trip
- Unifying Consensus and Atomic Commitment for Effective Cloud Data Management (VLDB19)
- Scalog: Seamless Reconfiguration and Total Order in a Scalable Shared Log
- Elle: Inferring Isolation Anomalies from Experimental Observations
- Fine-Grained Replicated State Machines for a Cluster Storage System
- DistSys Reading Group second meeting: Wormspace
- What Pasha taught me about life
- WormSpace: A modular foundation for simple, verifiable distributed systems
- Gryff: Unifying consensus and shared registers
- Our first Zoom DistSys reading group meeting
- Zoom Distributed Systems Reading Group
- Hermes: A fast fault-tolerant and linearizable replication protocol
- My Emacs setup
- PigPaxos: Devouring the communication bottlenecks in distributed consensus
- Millions of tiny databases
- Recent Media diet: Breakfast of the champions, and The Messiah
- Blockchain podcasts
- I have seen things
- MacBook Pro 16: the good, the bad, and the ugly
- The art of powerful questions: catalyzing insight, innovation, and action
- Book review. Tiny Habits (2020)
- Canopus: A scalable and massively parallel consensus protocol
- Traveling across the US
- Book Review. Made to stick: why some ideas survive and others die
- How to write papers so they get accepted
- Future of work
- CSE 610 Distributed Consensus, Decentralized Ledgers, and Blockchains
- Future of Work (MSFT Faculty Summit 2019)
- Book review. Every tool is a hammer: Life is what you make it (by Adam Savage)
- Distributed systems analogies
- Practical Byzantine Fault Tolerance
- Death's End (by Liu Cixin) and the Swordholder problem
- State Machine Replication in Facebook's Libra Blockchain
- How to speak (by Patrick Winston)
2019 65
- HotStuff: BFT Consensus in the Lens of Blockchain
- Cross-chain Deals and Adversarial Commerce
- Decade in Review
- My Distributed Systems Seminar's reading list for Spring 2020
- The Ben-Or decentralized consensus algorithm
- How to ask better questions
- Moneyball, but for academia
- I am looking for PhD students
- On the advisor-mentee relationship
- Year in Review: Best of Metadata
- Book Review. The Dark Forest (2008)
- Paper review. Threshold Logical Clocks for Asynchronous Distributed Coordination and Consensus
- SOSP19 File Systems Unfit as Distributed Storage Backends: Lessons from 10 Years of Ceph Evolution
- Book diet Oct-Nov 2019
- Seventh grade openhouse
- Book Review. Digital minimalism: Choosing a Focused Life in a Noisy World
- SOSP19. I4: Incremental Inference of Inductive Invariants for Verification of Distributed Protocols
- SOSP19 Lineage Stash: Fault Tolerance Off the Critical Path
- SOSP19 Verifying Concurrent, Crash-safe Systems with Perennial
- SOSP19 Day 2, Scaling Symbolic Evaluation for Automated Verification of Systems Code with Serval
- SOSP19 Day 1 wrap up
- SOSP19 Day 1, Debugging session
- SOSP19 Day 1, Blockchain session
- SOSP19 Day 1, machine learning session
- SOSP'19 Day 0
- Book review. A Mind at Play: How Claude Shannon Invented the Information Age
- Recent book diet
- Paper review: Comprehensive and efficient runtime checking in system software through watchdogs
- Book review: Three body problem
- Frugal computing
- Do leases buy us anything?
- Some of my peculiarities
- Teaching Paxi
- Avalanche is a descendent of Texel
- Modeling a read-write version of Texel: an asynchronous consensus algorithm without rounds
- Modeling an atomic version of Texel: an asynchronous consensus algorithm without rounds
- Paper review. Gray Failure: The Achilles' Heel of Cloud-Scale Systems
- Paper review. Asynchronous consensus without rounds
- Paper review. A generalized solution to distributed consensus
- Linearizable Quorum Reads in Paxos
- On becoming a researcher
- Reading list for our distributed systems class
- Distributed systems course revamped
- Paper summary. CORFU: A shared log design for flash clusters
- Dissecting performance bottlenecks of strongly-consistent replication protocols
- Paxos jokes
- Book review. Range: Why Generalists Triumph in a Specialized World
- Is this consensus?
- Book review. Loonshots: How to nurture the crazy ideas that win wars, cure diseases, and transform industries
- Paper summary. Cloud programming simplified: A Berkeley view on Serverless Computing
- Paper summary. Scalable Consistency in Scatter
- Book Notes. Steal Like an Artist: 10 Things Nobody Told You About Being Creative
- Book Notes. Creativity, Inc.: Overcoming the Unseen Forces That Stand in the Way of True Inspiration
- Azure Cosmos DB: Microsoft's Cloud-Born Globally Distributed Database
- Book Notes. Show Your Work! 10 Ways to Share Your Creativity and Get Discovered, by Austin Kleon
- How I pulled the fire alarm in my apartment complex
- The aging puzzle
- Timely Algorithms
- Hacking the simulation
- A life well lived
- Book review Draft No. 4 by John McPhee
- Paper review. Sharding the Shards: Managing Datastore Locality at Scale with Akkio
- Paper review: Probabilistically Bounded Staleness for Practical Partial Quorums
- Paper review. An Empirical Study on Crash Recovery Bugs in Large-Scale Distributed Systems
- Paper review. Serverless computing: One step forward, two steps back
2018 71
- Two-phase commit and beyond
- Master your questioning skills
- Year in Review
- How to fix scholarly peer review
- HotNets'18: Networking in Space
- My Emacs journey
- Is Twitter causally-consistent?
- How to be a good machine learning product manager
- SDPaxos: Building efficient semi-decentralized geo-replicated state machines
- An unexpected phone call at the elevator
- Judoing the Dunning-Kruger effect: the "surprisingly-popular option" strategy for crowdsourcing
- Everything is broken
- Debugging designs with TLA+
- The last mile problem in trust
- Book review. Ignorance: How it drives science
- TLA+ specification of the bounded staleness and strong consistency guarantees
- TLA+ specification of the consistent prefix guarantee
- Mind Your State for Your State of Mind
- Logical index organization in Cosmos DB
- Replicated Data Consistency Explained Through Baseball
- Schema-Agnostic Indexing with Azure Cosmos DB
- The many faces of consistency
- Azure Cosmos DB
- If You’re Not Writing a Program, Don't Use a Programming Language
- Blockchain consensus and ubiquitous computing: match made in heaven?
- Academic/research impact
- About self-stabilization and blockchain consensus
- Book Review. Endurance: A year in space, a lifetime of discovery
- Snowflake to Avalanche: A Novel Metastable Consensus Protocol Family for Cryptocurrencies
- Some blockchain applications and Reviewcoin
- TUX2: Distributed Graph Computation for Machine Learning
- SoK Cryptocurrencies and the Bitcoin Lightning Network
- Book Review -- Accidental Genius: Using Writing to Generate Your Best Ideas, Insight, and Content
- Paper summary. Decoupling the Control Plane from Program Control Flow for Flexibility and Performance in Cloud Computing
- Misc rambling
- Transmitting your message over a lossy channel
- Truth is Multidimensional
- Research and climbing
- Book review. How to write a lot: A practical guide to productive academic writing
- Paper summary. Step by Step Towards Creating a Safe Smart Contract: Lessons and Insights from a Cryptocurrency Lab
- Book review. Crypto: How the code rebels beat the government---saving privacy in the digital age.
- Notes from USENIX NSDI Days 2 & 3
- Notes from USENIX NSDI 18 First Day
- The Stellar Consensus Protocol: A Federated Model for Internet-level Consensus
- Book review: Last lecture by Randy Pausch
- Master your tools
- Replying to why decentralization matters
- Blockchain applications in Supply Chain Management
- Anatomical similarities and differences between Paxos and blockchain consensus protocols
- Leveraging data and people to accelerate data science (Dr. Laura Haas)
- Paper review. Enhancing Bitcoin Security and Performance with Strong Consistency via Collective Signing.
- Paper review. A secure sharding protocol for open blockchains.
- Paper review. Service-oriented sharding with Aspen
- Paper summary: Bitcoin-NG -- A scalable Blockchain Protocol
- Paper review. IPFS: Content addressed, versioned, P2P file system
- Paper summary. SnailTrail: Generalizing critical paths for online analysis of distributed dataflows
- Think before you code
- Paper review. Blockchains from a distributed computing perspective
- Paxos derived
- Modeling the DAO attack in PlusCal
- Spring 18 Distributed Systems Seminar
- Erasable pens for editing papers
- Remember peer-to-peer systems?
- Paper summary. A Berkeley view of systems challenges for AI
- The Lambda and the Kappa Architectures
- Paper summary. TFX: A TensorFlow-Based Production-Scale Machine Learning Platform
- Why you should use modeling [with TLA+/PlusCal]
- Salute to Prof. Mohamed Gouda: Elegance in computing
- How to find your advisor
- Logical clocks and Vector clocks modeling in TLA+/PlusCal
- Mad questions
2017 77
- Best of 2017 in MuratBuffalo
- Paper summary. Real-Time Machine Learning: The Missing Pieces
- TensorFlow-Serving: Flexible, High-Performance ML Serving
- WPaxos: a wide area network Paxos protocol (Part 1)
- Retroscope: Retrospective cut-monitoring of distributed systems (part 3)
- Useful podcasts update
- Upgrade your personal operating system
- Distributed system exams
- TLA+/Pluscal solution for modeling of 2-phase commit transactions
- Paper writing woes
- Reasoning compositionally about security
- TLA+/Pluscal modeling of 2-phase commit transactions
- Paper Summary. The Case for Learned Index Structures
- Enabling API Virtualization on Android for Platform Openness
- Opencl
- What I learn from teaching
- Paper summary. Blazes: Coordination analysis and placement for distributed programs
- On dataflow systems, Naiad and Tensorflow
- Two paper summaries on scheduling in heterogenous computing
- Paper summary: A Computational Model for TensorFlow
- The YouTube clips I show in my distributed systems class
- Paper summary. Dynet: The Dynamic Neural Network Toolkit
- Spring 18 seminar, "blast from the past" edition
- Book review: The Growth mindset
- Book review. The Undoing Project: A friendship that changed our minds
- Paper summary. Towards distributed machine learning in shared clusters: a dynamically partitioned approach
- TLA+/PlusCal modeling of Synchronized Round Consensus Algorithm: Solution
- Paper summary. SLAQ Quality-driven scheduling for distributed machine learning
- TLA+/PlusCal modeling of Synchronized Round Consensus Algorithm
- HPTS'17 day 2
- HPTS'17 day 1
- HPTS'17 day 0
- What does authentic mean?
- UB CSE 50 celebrations, Alumni Symposium
- UB CSE 50 celebrations, The Graduate Research Conference
- Paper Summary. Proteus: agile ML elasticity through tiered reliability in dynamic resource markets
- Paper summary. Distributed Deep Neural Networks over the Cloud, the Edge, and End Devices
- Paper summary. Gaia: Geo-Distributed Machine Learning Approaching LAN Speeds
- Paper summary. OpenCL Caffe: Accelerating and enabling a cross platform machine learning framework
- Retroscope: Retrospective Monitoring of Distributed Systems (part 2)
- Web Data Management in RDF Age
- Gratitude
- Paper summary. Untangling Blockchain: A Data Processing View of Blockchain Systems
- Retrospective Lightweight Distributed Snapshots Using Loosely Synchronized Clocks
- Paper summary: Performance clarity as a first-class design principle (HOTOS'17)
- Dhalion: self-regulating stream processing in Heron (VLDB'17)
- Cloud fault-tolerance
- Paper Summary: Twitter Heron
- On presenting well
- Paper summary " Encoding, Fast and Slow: Low-Latency Video Processing Using Thousands of Tiny Threads"
- Paper summary: Occupy the Cloud: Distributed Computing for the 99%
- ICCCN'17 trip notes, days 2 and 3
- ICCCN'17 trip notes
- A Comparison of Distributed Machine Learning Platforms
- Paper summary: Zorua: A holistic approach to resource virtualization in GPU
- Paper Summary: Two decades of recommender systems at Amazon.com
- Paper Summary: DeepXplore, Automated Whitebox Testing of Deep Learning Systems
- Scalability, but at what COST
- Paper Summary: Neurosurgeon, collaborative intelligence between the cloud and mobile edge
- Paper summary: Making sense of Performance in Data Analytics Frameworks (NSDI 15)
- Paper review: Prioritizing attention in fast data
- Paper Review: Serverless computation with OpenLambda
- Setting up a new Mac laptop
- DARPA: Delivering Disruption
- Book Review: The Story of Your Life (by Ted Chiang)
- Paper summary: Federated Learning
- 1 million pageviews
- Bowling your way to the top
- Mesos: A platform for fine-grained resource sharing in the data center
- Large-scale cluster management at Google with Borg
- Deep Learning With Dynamic Computation Graphs (ICLR 2017)
- My first impressions after a week of using TensorFlow
- Google DistBelief paper: Large Scale Distributed Deep Networks
- Learning Machine Learning: Deep Neural Networks
- Learning Machine Learning: Multinomial Logistic Classification
- Learning Machine Learning: Logistic Regression
- Learning Machine Learning: Introduction and Linear Regression
2016 42
- Selected blog posts from 2016
- Learning Machine Learning: A beginner's journey
- Book review: Intuition pumps and other tools for thinking
- TLA+ project2 solution (2016)
- Feedback from my distributed systems class
- Modeling a Replicated Storage System in TLA+, Project 2
- Emerging trends in big data software
- How does one get motivated for teaching?
- My Distributed Systems Seminar's reading list for Spring 2017
- Modeling a Replicated Storage System in TLA+, Project 1
- Book Review: Einstein (by Walter Isaacson)
- How Complex Systems Fail
- Modeling Paxos and Flexible Paxos in Pluscal and TLA+
- [Paper review] TaxDC: A Taxonomy of nondeterministic concurrency bugs in datacenter distributed systems
- Paper Review: Why Does the Cloud Stop Computing? Lessons from Hundreds of Service Outages
- Modeling the hygienic dining philosophers algorithm in TLA+
- Modeling the Dining Philosophers Algorithm in TLA+
- It is about time
- Book Review: Smarter Faster Better (2016)
- Sonification for monitoring and debugging distributed systems
- Kafka, Samza, and the Unix Philosophy of Distributed Data
- Realtime Data Processing at Facebook
- Efficient Replication of Large Data Objects
- Replex: A Scalable, Highly Available Multi-Index Data Store
- Modular Composition of Coordination Services
- How to package your ideas using the Winston star
- Nobody wants to read your shit
- Progress by impossibility proofs
- TensorFlow: A system for large-scale machine learning
- Useful podcasts
- Paper review. GraphLab: A new Framework for Parallel Machine Learning
- Book review: The War Of Art by Steven Pressfield
- Consensus in the Cloud: Paxos Systems Demystified
- Paper Review. Petuum: A new platform for distributed machine learning on big data
- Paper review: Building Consistent Transactions with Inconsistent Replication (SOSP'15)
- Paper review: Measuring and Understanding Consistency at Facebook
- Paper review: Implementing Linearizability at Large Scale and Low Latency (SOSP'15)
- Holistic Configuration Management at Facebook
- Fool yourself
- Paper review: TensorFlow, Large-Scale Machine Learning on Heterogeneous Distributed Systems
- Book Review: "Zero to One", Peter Thiel, 2014
- My new pomodoro workflow
2015 34
- What technological advancements will the next decade bring?
- My Distributed Systems Seminar's reading list for Spring 2016
- Paper summary: Detecting global predicates in distributed systems with clocks
- Energy Approach to Life
- HPTS trip report (day 2)
- HPTS trip report (days 0 and 1)
- Consensus in the wild
- Analysis of Bounds on Hybrid Vector Clocks
- Serving at NSF panels and what it teaches about how to pitch the perfect proposal
- paper summary: One Trillion Edges, Graph Processing at Facebook-Scale
- New directions for distributed systems research in cloud computing
- How to go for 10X
- A distributed systems research agenda for cloud computing
- Book Review: "Rework", 2010, Jason Fried & David Heinemeier Hansson
- How to run effective paper reading groups
- Arrakis: The OS is the control plane
- Large-scale cluster management at Google with Borg
- Paper Summary: On the use of Clocks to Enforce Consistency in the Cloud
- Paper summary: A Taxonomy of Partitioned Replicated Cloud-based Database Systems
- GraphX: Graph processing in a distributed dataflow framework
- All file systems are not created equal: On the complexity of crafting crash-consistent applications
- Facebook's Mystery Machine: End-to-end Performance Analysis of Large-scale Internet Services
- Paper review: "Simple Testing Can Prevent Most Critical Failures: An Analysis of Production Failures in Distributed Data-Intensive Systems"
- My crazy proposal for achieving lightweight distributed consensus
- Eidetic systems
- Extracting more concurrency from Distributed Transactions
- My trick for coordinating Dropbox collaborations
- Salt: Combining ACID and BASE in a Distributed Database
- Book report: "Good Prose" and "How to write a lot"
- Paper summary: Perspectives on the CAP theorem
- How to present your work
- Dijkstra's stabilizing token ring algorithm
- My Distributed Systems Seminar reading list for Spring 2015
- My experience with using TLA+ in distributed systems class
2014 29
- Google Cloud Messaging (GCM): An evaluation
- Paper Summary: Granola, Low overhead distributed transaction coordination
- Paper Summary: Calvin, Distributed transactions for database systems
- Paper Summary: Coordination Avoidance in Database Systems
- Clock-SI: Snapshot Isolation for Partitioned Data Stores Using Loosely Synchronized Clocks
- Facebook's software architecture
- Paper Summary: A self-configurable geo-replicated cloud storage system
- Consistent snapshot analogies
- Paper Summary: High-availability distributed logging with BookKeeper
- Paper summary: Tango: Distributed Data Structures over a Shared Log
- Revisiting the EWDs
- Paper summary: Can a decentralized metadata service layer benefit parallel filesystems?
- Distributed system seminar talk: Data grouping framework for energy-efficiency in distributed storage systems
- Paper summary: ZooKeeper: Wait-free coordination for Internet-scale systems
- Sudoku and research
- Using TLA+ for teaching distributed systems
- Hybrid Logical Clocks
- Distributed is not necessarily more scalable than centralized
- Management
- Targeted crowdsourcing using app/interest categories of users
- Writing versus Typing
- How to write your research paper
- Dapper, a Large-Scale Distributed Systems Tracing Infrastructure
- Naiad: A timely dataflow system
- Energy approach to life, the universe, and everything
- Consistency-Based Service Level Agreements for Cloud Storage
- The scalable commutativity rule: Designing scalable software for multicore processors
- Black sheep
- Bionic Cyber Physical Systems
2013 25
- Research is a capricious mistress
- My notes from SOSP13 welcome and awards
- LADIS 2013 keynotes
- Beyond TrueTime: Using AugmentedTime for Improving Google Spanner
- How I write
- How I read a research paper
- Apps are selfish parasites! How can we get truly collaborative apps on smartphones?
- Ramblings on serializability
- Spanner: Google's Globally-Distributed Database
- Antifragility from an engineering perspective
- RAMCloud reloaded: Log-structured Memory for DRAM-based Storage
- IPDPS'13 day1 graph algorithms
- Mobile Sensing Revolution keynote by Hari Balakrishnan
- Scaling Memcache at Facebook
- One Pomodoro, two pomodoro, three pomodoro, four
- Android reverse-scooped us with the proximity alert service
- My Advice To My Graduate Students
- Fault Tolerance via Idempotence (paper summary)
- Attacking Generals and Buridan's Ass, or How did the chicken cross the road?
- Key-CRDT Stores
- Conflict-free Replicated Data Types
- AWS Summit NYC, the rest of Day 2
- AWS Summit NYC, Day 2, keynote
- AWS summit NYC, day 1
- Spring 2013 seminar class on cloud computing
2012 18
- Our brains are radios
- From Clarity to Efficiency for Distributed Algorithms
- Making Geo-Replicated Systems Fast as Possible, Consistent when Necessary
- Sensys'12 (day2)
- Sensys'12 (day 1)
- An abundance of solutions
- MDCC: Multi-Data Center Consistency
- Auto-dropboxify all web-downloaded documents
- Building fault-tolerant applications on AWS
- Don’t Settle for Eventual: Scalable Causal Consistency for Wide-Area Storage with COPS
- Scalable distributed data structures for internet service construction
- Crowdsourced line wait-time forecasting using smartphones
- My advice to the 2012 class
- Replicated/Fault-tolerant atomic storage
- Talk on innovation
- CAP 12 years later: How the rules have changed (by Eric Brewer)
- Tell me about your thought-process, not just your results
- On Sabbatical
2011 38
- Pregel: a system for large-scale graph processing
- Reverse-scooping
- Scalable SPARQL Querying of Large RDF Graphs
- Let's go back to the fountain pen
- Privacy through lies
- Trip notes from Mobicom 2011
- Tenure advice to new faculty
- Rapid prototyping FTW
- I must be a sellout. My research is hot
- Online migration for geodistributed storage systems, Usenix ATC 2011
- Refuse to Crash with Re-FUSE
- Sabbatical help
- Why are algorithms not scalable?
- On designing and deploying Internet scale services
- Centrifuge: Integrated Lease Management and Partitioning for Cloud Services
- Smoke and Mirrors: Reflecting Files at a Geographically Remote Location Without Loss of Performance
- Consistency analysis in Bloom: a CALM and collected approach
- Life beyond Distributed Transactions: an Apostate's Opinion
- Tempest and Deutronomy reviews
- Megastore: Providing scalable, highly available storage for interactive services
- Flexible, Wide-Area Storage for Distributed Systems with WheelFS
- Ceph: A Scalable, High-Performance Distributed File System
- Sinfonia: A New Paradigm for Building Scalable Distributed Systems
- PetaShare: A reliable, efficient and transparent distributed storage management system
- Volley: Automated Data Placement for Geo-Distributed Cloud Services
- PNUTS: Yahoo!'s hosted data serving platform
- Chain replication for supporting high throughput and availability
- Pond: The Oceanstore prototype
- SEDA: An architecture for well-conditioned scalable internet services
- A comparison of filesystem workloads
- Panache: a parallel filesystem cache for global file access
- GPFS: A shared disk file system for large computing clusters
- Serverless Network Filesystems (xFS)
- Lessons from giant-scale services
- Hints for computer system design, ACM-OS'83
- Crash-only software, HOTOS'03
- My Spring'11 Seminar on Cloud Computing
- CRDTs: Consistency without concurrency control
2010 31
- Case for RAMClouds: Scalable High-Performance Storage Entirely in DRAM
- Finding a Needle in Haystack: Facebook's Photo Storage
- Boxwood: Abstractions as the foundation for storage infrastructure
- Globecom, WSN forum, Urban-scale sensing talk by Ed Knightly (Rice U)
- Globecom, wireless networking forum, talk on smartphones by Roy Want
- Onix: A Distributed Control Platform for Large-scale Production Networks
- Dynamo: Amazon's highly available key-value store
- Crowdsourced sensing and collaboration using Twitter
- VL2: A Scalable and Flexible Data Center Network
- PortLand: A Scalable Fault-Tolerant Layer 2 Data Center Network Fabric
- Availability in Globally Distributed Storage Systems
- My iPhone 4 has a transparent screen
- Optimistic Replication
- A presentation tip (brought to you by a weary audience)
- The role of distributed state
- Paxos taught
- Speculative Execution in a Distributed File System
- Live migration of virtual machines
- Xen and the art of virtualization
- Mencius: building efficient replicated state machines for Wide-Area-Networks (WANs)
- Future of powerpoint presentations
- Rethinking Enterprise Network Control
- The Chubby Lock Service for Loosely-Coupled Distributed Systems, Burrows, OSDI 2006
- The Google File System, Ghemawat et al., SOSP 2003
- The Design and Implementation of a Log-Structured File System
- Pig Latin: A Not-So-Foreign Language for Data Processing
- MapReduce Online
- Twitter, open the firehose!
- Intermediate storage support for mapreduce for improved fault-tolerance
- MapReduce: Simplified Data Processing on Large Clusters
- Writing advice