The Curious Engineer

All blogs / Databases

Shayon Mukherjee

shayon.dev/post

Everything, everywhere - always in progress

DatabasesLinux / UnixStorage / filesystemsAI / ML

’17’18’19’20’21’22’23’24’25’26
Posts
39 from 29 Dec 2017 to 10 Oct 2026
Posting
monthly (9 in the last year)
Kind
personal blog
Feed
https://www.shayon.dev/post/index.xml

2026 8

  1. A versioned filesystem for disposable sandboxes
  2. Every fast write moves work somewhere else
  3. Building a tiny FUSE filesystem
  4. I am not leaving GitHub any time soon
  5. Linux Page Faults, mmap, and userfaultfd
  6. Let's discuss sandbox isolation
  7. Understanding how GIL Affects Checkpoint Performance in PyTorch Training
  8. Software engineering when machine writes the code

2025 13

  1. A hypothetical search engine on S3 with Tantivy and warm cache on NVMe
  2. Diwali
  3. Mutable atomic deletes with Parquet backed columnar tables on S3
  4. An MVCC-like columnar table on S3 with constant-time deletes
  5. Exploring PostgreSQL to Parquet archival for JSON data with S3 range reads
  6. Bypass PostgreSQL catalog overhead with direct partition hash calculations
  7. Is AGI paradoxical?
  8. Pitfalls of premature closure with LLM assisted coding
  9. Another look into PostgreSQL CTE materialization and non-idempotent subqueries
  10. A PostgreSQL planner gotcha with CTEs DELETE and LIMIT
  11. Selective asynchronous commits in PostgreSQL - balancing durability and performance
  12. Challenging AI generated code from first principles
  13. Scaling with PostgreSQL without boiling the ocean

2024 12

  1. Database mocks are just not worth it
  2. Using CTID Based Pagination for Data Cleanups in PostgreSQL
  3. pg_easy_replicate Supports Schema Change Tracking During Logical Replication
  4. Stop Relying on IF NOT EXISTS for Concurrent Index Creation in PostgreSQL
  5. The Tech Industry's Moral Vacuum
  6. Use pg_easy_replicate for setting up Logical Replication and Switchover in PostgreSQL
  7. Fast, Simple and Metered Concurrency in Ruby with Concurrent::Semaphore
  8. The value of sitting on an idea
  9. Incidents and the requirement of slowing down
  10. Embracing the weeds
  11. 100x Faster Query in Aurora Postgres with a lower random_page_cost
  12. Shipping Fast Requires a High Degree of Trust

2023 2

  1. Introducing pg_easy_replicate 2.0
  2. Do you really need Foreign Keys?

2022 2

  1. pg-osc: Zero downtime schema changes in PostgreSQL
  2. Why I enjoy PostgreSQL - Infrastructure Engineer's Perspective

2020 1

  1. Handling Network Failures in the Cloud

2017 1

  1. Fetch current signal handlers without overriding in Ruby