Tobias Petry

Scaling Databases

Stop over-engineering your database. Learn the simple scaling patterns that can handle massive traffic before you ever need to shard.

Scaling Databases
#1about 2 minutes

The database is the real bottleneck in scaling applications

Your programming language or framework is rarely the performance problem; the database is almost always the component that limits growth.

#2about 1 minute

Optimize queries and add caching before scaling out

Before distributing your database across multiple servers, you must first fix slow queries, add proper indexes, and implement caching to avoid amplifying existing problems.

#3about 1 minute

Scaling up is the simplest and most effective first step

Instead of immediately adding complexity with multiple servers, simply upgrading your existing database server with more memory and CPU cores is a cost-effective solution.

#4about 4 minutes

Understanding the trade-offs of multi-master replication

While multi-master replication allows writes to any server and guarantees read-after-write consistency, it often suffers from performance degradation due to write conflicts on the same data.

#5about 5 minutes

Using read replication to scale read-heavy workloads

Read replication uses a single primary for writes and multiple secondaries for reads, but requires careful application design to handle asynchronous replication lag and potential stale data.

#6about 5 minutes

The power and complexity of database sharding

Sharding provides near-infinite scalability by distributing data across multiple independent databases, but introduces significant complexity like cross-shard joins and managing multiple database systems.

#7about 2 minutes

Keep your database scaling strategy as simple as possible

Avoid premature optimization by choosing the simplest scaling solution that meets your current needs, as overly complex systems are difficult to manage and can lead to costly rewrites.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Adnan Rahic who teaches the audience how to make data warehouses.About the Speaker: Adnan is senior developers advocate at Cube. His passion lie...
Making Data Warehouses Fast: A Developer’s Story
CH
Chris Heilmann
Dev Digest 139 - Soft and hard queries
News and ArticlesLet's start with Amelia Wattenberger's excellent essay Bridging the hard and the soft talking about humans and data. Do you sometimes also miss aspects of the early web like a lack of big data and freedom to create without numeric go...
Dev Digest 139 - Soft and hard queries
DC
Daniel Cranney
Dev Digest 168: Hacking Postgres, Blocking Meta and Fixing CSS
Inside last week’s Dev Digest 168 . 📊 The state of OpenAI’s GPT models 🤖 20% of Salesforce code written by AI 👩‍💻 Hacking Postgres 🙅‍♂️ How to block Meta AI from your Instagram 🔧 How to fix common CSS mistakes 💻 Make your GitHub profile stand out 🥱 ...
Dev Digest 168: Hacking Postgres, Blocking Meta and Fixing CSS

From learning to earning

Jobs that call for the skills explored in this talk.

Multi-platform DBA

Multi-platform DBA

Optimadata B.V.
Naarden, Netherlands

Remote
3-5K
MariaDB
MongoDB
Microsoft SQL Server
+1