The Curious Engineer

All blogs / Distributed systems / cloud

WarpStream Blog

warpstream.com/blog

Read engineering deep dives, customer case studies, product updates, and integration guides from the WarpStream team. Kafka streaming insights.

Distributed systems / cloudDatabasesStorage / filesystems

Posts
67 from 4 Aug 2025 to 23 Oct 2026
Posting
weekly (66 in the last year)
Kind
company blog

2026 66

  1. Cloud Disks are (Really!) Expensive
  2. Your WarpStream Questions, Answered
  3. Kafka Isn’t a Database, But We Gave It a Query Engine Anyway
  4. Boring by Design: How Character.AI Runs 5 GiB/s on WarpStream and Cut Costs ~90%
  5. Cost-Effective Logging at Scale: ShareChat’s Journey to WarpStream
  6. Eternal Saves 60+%, Simplifies Ops, and Logs 25 GiB/s With WarpStream
  7. Character.AI's Transition to WarpStream
  8. How Superwall Uses WarpStream and ClickHouse Cloud to Scale Subscription Monetization
  9. Kafka Is Dead, Long Live Kafka: The Case for Diskless, S3-Native Streaming
  10. Kafka Transactions Explained, Including Two Protocol Hacks
  11. How Knock Saved $87K a Year by Migrating Off Kinesis to WarpStream
  12. Minimizing S3 API Costs with Distributed mmap
  13. No record left behind: How WarpStream can withstand cloud provider regional outages
  14. Pixel Federation Powers Mobile Analytics Platform with WarpStream
  15. Robinhood Swaps Kafka for WarpStream to Tame Logging Workloads and Costs
  16. S3 Express is All You Need
  17. Taking out the Trash: Garbage Collection of Object Storage at Massive Scale
  18. The Art of Being Lazy(log): Lower Latency and Higher Availability With Delayed Sequencing
  19. The Case for Shared Storage
  20. The Future of Coding: How Cursor and WarpStream Power AI Productivity
  21. The Original Sin of Cloud Infrastructure
  22. Tiered Storage Won’t Fix Kafka
  23. How WarpStream Reduces Kafka Infrastructure Costs: A TCO Breakdown
  24. WarpStream is Dead, Long Live WarpStream
  25. WarpStream S3 Express One Zone Benchmark and Total Cost of Ownership
  26. Zero Disks Is Better for Kafka: Simpler Ops and Zero-Access BYOC
  27. How WarpStream Powers Grafana Labs’ Redesigned Architecture
  28. Introducing WarpStream BYOC Schema Registry
  29. Secure by default: How WarpStream’s BYOC deployment model secures the most sensitive workloads
  30. The Road to 100PiBs and Hundreds of Thousands of Partitions: Goldsky Case Study
  31. Case Studies
  32. A Brief Rant About the New Product Development Lifecycle
  33. A Trip Down Memory Lane: How We Resolved a Memory Leak When pprof Failed Us
  34. Anatomy of a serverless usage based billing system
  35. Announcing Bento, the open source fork of the project formerly known as Benthos
  36. Announcing Schema Validation with AWS Glue Schema Registry
  37. Announcing WarpStream Schema Validation
  38. Ask Your Cluster Anything: The WarpStream MCP Server
  39. Audit Logs for WarpStream: Full Visibility Into Every Action on Your Clusters
  40. Dealing with rejection (in distributed systems)
  41. Deterministic Simulation Testing for Our Entire SaaS
  42. Fancy Stream Processing Made (even more) Operationally Mundane
  43. Getting Rid of (Kafka) Noisy Neighbors Without Having to Buy a Mansion
  44. Getting started with WarpStream on Tigris
  45. Going All in on Protobuf With Schema Registry and Tableflow
  46. Hacking the Kafka PRoTocOL
  47. How We Scaled Change Management to 30+ Environments Without a DevOps Team
  48. Introducing WarpStream Managed Data Pipelines for BYOC clusters
  49. Kafka as a KV Store: deduplicating millions of keys with just 128 MiB of RAM
  50. Kafka Replication Without the (Offset) Gaps
  51. Multiple Regions, Single Pane of Glass
  52. One Weird Trick to Make Rapid Storage 40x Faster
  53. Real-Time Website Security Monitoring with WarpStream, RisingWave, and Grafana
  54. Shadowing Kafka ACLs: A Safer Path to Authorization
  55. The Case for an Iceberg-Native Database: Why Spark Jobs and Zero-Copy Kafka Won’t Cut It
  56. The Hitchhiker's Guide to Disaster Recovery and Multi-Region Kafka
  57. Kafka Consumer Lag Is the Wrong Metric — Measure This Instead
  58. Unlocking Idempotency with Retroactive Tombstones
  59. WarpStream Diagnostics: Keep Your Data Stream Clean and Cost-Effective
  60. WarpStream + Materialize: Simpler Streaming for Operational Data Products
  61. WarpStream Tableflow Is Now Generally Available
  62. What React and Apache Iceberg Have in Common: Scaling Iceberg with Virtual Metadata
  63. Zero Ops Schema Migration: WarpStream Schema Linking
  64. Engineering
  65. Move Fast And Don’t Break Things: Automatic Apache Kafka® Migrations With Orbit
  66. News

2025 1

  1. Integrations