The Cloud Playbook

The Cloud Playbook

TCP# 105: The Multi-Tenant Architecture I'd Never Build Again

Nine tenants. Eleven services. One pooled model. This is what we got wrong.

Amrut Patil's avatar
Amrut Patil
Mar 04, 2026
∙ Paid

You can also read my newsletters from the Substack mobile app and be notified when a new issue is available.

Get more from Amrut Patil in the Substack app
Available for iOS and Android

We built a shared-everything multi-tenant platform on AWS.

One database per service. Tenant data separated by row-level filters. One deployment pipeline. One observability stack. One set of IAM roles scoped to the service, not the tenant.

It looked clean on a whiteboard.

It did not survive contact with production.

This is what we got wrong, what it cost us, and what I would build instead.


THE INCIDENT THAT EXPOSED EVERYTHING

Eighteen months after launch, a single tenant’s batch job consumed enough database connection pool capacity to degrade response times for every other tenant on the platform.

No data breach. No data loss.

Just one tenant’s workload bleeding into every other tenant’s experience.

Leadership called it a performance issue.

User's avatar

Continue reading this post for free, courtesy of Amrut Patil.

Or purchase a paid subscription.
© 2026 Amrut Patil · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture