Tobias Petry
Scaling Databases
#1about 2 minutes
The database is the real bottleneck in scaling applications
Your programming language or framework is rarely the performance problem; the database is almost always the component that limits growth.
#2about 1 minute
Optimize queries and add caching before scaling out
Before distributing your database across multiple servers, you must first fix slow queries, add proper indexes, and implement caching to avoid amplifying existing problems.
#3about 1 minute
Scaling up is the simplest and most effective first step
Instead of immediately adding complexity with multiple servers, simply upgrading your existing database server with more memory and CPU cores is a cost-effective solution.
#4about 4 minutes
Understanding the trade-offs of multi-master replication
While multi-master replication allows writes to any server and guarantees read-after-write consistency, it often suffers from performance degradation due to write conflicts on the same data.
#5about 5 minutes
Using read replication to scale read-heavy workloads
Read replication uses a single primary for writes and multiple secondaries for reads, but requires careful application design to handle asynchronous replication lag and potential stale data.
#6about 5 minutes
The power and complexity of database sharding
Sharding provides near-infinite scalability by distributing data across multiple independent databases, but introduces significant complexity like cross-shard joins and managing multiple database systems.
#7about 2 minutes
Keep your database scaling strategy as simple as possible
Avoid premature optimization by choosing the simplest scaling solution that meets your current needs, as overly complex systems are difficult to manage and can lead to costly rewrites.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
00:04 MIN
An overview of scaling a sports app to millions of users
Scaling: from 0 to 20 million users
24:06 MIN
Optimizing costs with multi-dimensional scaling
Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)
25:34 MIN
Key design patterns for distributed database applications
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
07:36 MIN
Scaling and ensuring high availability with Couchbase architecture
Database Magic behind 40 Million operations/s
00:05 MIN
Understanding the fundamentals of distributed SQL databases
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
23:57 MIN
Summarizing key takeaways for building hyperscale systems
From 0 to 1.000.000: How to build a serverless raffle service for hyperscale
03:08 MIN
How distributed databases abstract complexity from applications
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
21:27 MIN
Scaling SSE applications for thousands of concurrent users
Streaming AI Responses in Real-Time with SSE in Next.js & NestJS
Featured Partners
Related Videos
Scaling: from 0 to 20 million users
Josip Stuhli
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
Wei Hu
Database Magic behind 40 Million operations/s
Jürgen Pilz
Fault Tolerance and Consistency at Scale: Harnessing the Power of Distributed SQL Databases
Wei Hu
Single Server, Global Reach: Running a Worldwide Marketplace on Bare Metal in a Cloud-Dominated World
Jens Happe
How building an industry DBMS differs from building a research one
Markus Dreseler
Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming
Hartmut Armbruster
Branch your database like your code: How schema changes and pull requests go hand in hand
Johannes Nicolai & Lilli Seyther-Besecke
Related Articles
View all articles.gif?w=240&auto=compress,format)



From learning to earning
Jobs that call for the skills explored in this talk.
![Senior Software Engineer [TypeScript] (Prisma Postgres)](https://wearedevelopers.imgix.net/company/283ba9dbbab3649de02b9b49e6284fd9/cover/oKWz2s90Z218LE8pFthP.png?w=400&ar=3.55&fit=crop&crop=entropy&auto=compress,format)
Senior Software Engineer [TypeScript] (Prisma Postgres)
Prisma
Remote
Senior
Node.js
TypeScript
PostgreSQL

DevOps Engineer – Kubernetes & Cloud (m/w/d)
epostbox epb GmbH
Berlin, Germany
Intermediate
Senior
DevOps
Kubernetes
Cloud (AWS/Google/Azure)

Consultant - Business Intelligence / Data Warehousing
Scalefree
Scalefree
Köln, Germany

Senior Software Engineer - Database Internals
Localstack
Hoofddorp, Netherlands
Remote
€5K
Senior
API
Java
Azure
+9

Database Reliability Engineer - Core Team
Clickhouse Gmbh
Redruth, United Kingdom
Remote
Senior
C++
Azure
Python
Gitlab
+3

Multi-platform DBA
Optimadata B.V.
Naarden, Netherlands
Remote
€3-5K
MariaDB
MongoDB
Microsoft SQL Server
+1

Database Reliability Engineer - Core Team
Clickhouse
Remote
Senior
C++
Azure
Python
Google Cloud Platform
+2

Database Reliability Engineer - Core Team
Clickhouse
Remote
Senior
C++
Azure
Python
Google Cloud Platform
+2

Professional SQL / PostgreSQL Administrator - optimieren, stabilisieren, weiterentwickeln
Rocken AG
Sursee, Switzerland
Remote
CHF90-110K
Linux
PostgreSQL
Microsoft SQL Server