Daniel Raniz Raneland

CI/CD Patterns and Antipatterns - Things your Pipeline Should (Not) Do

Is your CI pipeline a slow, frustrating ritual? Learn the patterns to eliminate flaky builds, reduce developer wait times, and ship code faster.

CI/CD Patterns and Antipatterns - Things your Pipeline Should (Not) Do
#1about 2 minutes

The hidden costs of slow and frustrating CI/CD pipelines

Slow, frustrating, and wasteful CI/CD pipelines interrupt developer flow and have a negative environmental impact.

#2about 3 minutes

Antipattern: Running the same pipeline for every trigger

The 'ritual' antipattern involves wastefully running identical, comprehensive pipelines for pull requests, merges, and nightly schedules.

#3about 3 minutes

Use conditional logic to run only necessary steps

Create context-specific pipelines for different triggers and use path filtering to run only the jobs relevant to the code that has changed.

#4about 2 minutes

Antipattern: Stop hoarding unnecessary build artifacts

The 'hoarding' antipattern wastes storage and makes navigation difficult by keeping every build artifact indefinitely instead of using automated cleanup.

#5about 2 minutes

Antipattern: Order pipeline steps for the fastest feedback

Prioritize tests that are most likely to fail, such as integration tests, to get feedback faster instead of following a conventional testing pyramid order.

#6about 3 minutes

Antipattern: Break monolithic pipelines into parallel jobs

Replace a single, long-running sequential pipeline with multiple parallel jobs for independent components like frontend and backend to significantly reduce wall-clock time.

#7about 7 minutes

Antipattern: Use caching and tooling images to avoid redundant work

Leverage caching for dependencies, build outputs, and Docker layers, and use pre-built tooling images to avoid starting from scratch on every run.

#8about 2 minutes

Antipattern: Prevent pipeline interference with unique identifiers

Avoid race conditions where concurrent pipelines overwrite shared resources like a 'latest' tag by using unique identifiers like the Git SHA for artifacts.

#9about 4 minutes

Antipattern: Properly size your build agents and runners

Ensure build agents are at least as powerful as developer machines to prevent resource-related failures, and consider self-hosted runners for full control over hardware.

#10about 1 minute

Recap of key CI/CD patterns and antipatterns

A summary of common pipeline pitfalls and the corresponding best practices for creating faster, more reliable, and efficient CI/CD workflows.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles
DC
Daniel Cranney
Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview
Inside last week’s Dev Digest 159 . πŸ€– How to use LLMs to help you write code ⚑ How much electricity does AI need? πŸ”’ Is your API secure? Learn all about hardening it… 🟦 TypeScript switches to go and gets 10 times faster πŸ–ΌοΈ An image cropper in your ap...
Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview
DC
Daniel Cranney
Dev Digest 188: CfP time, the risks of NPM and IKEA algorithms
Inside last week’s Dev Digest 188 . πŸ€– GitHub Copilot CLI is now in public review πŸ’» Microsoft is bringing β€˜vibe working’ to office apps 🎣 Attackers abuse AI tools to generate captchas in fishing attacks ⚠️ When LLMs autonomously attack 🧠 Common cause...
Dev Digest 188: CfP time, the risks of NPM and IKEA algorithms
DC
Daniel Cranney
Dev Digest 194: AI vs. Version Control, Password Louvre & Cursed Webdev
Inside last week’s Dev Digest 194 . 🧠 Learn how to become an AI-native software engineer πŸ€·β€β™‚οΈ How can you stand out when anyone can build anything? πŸ‘‚ Whisper Leak allows listening to encrypted chats 🐝 What’s new the OWASP2025 Top Ten List πŸ™…β€β™€οΈ Curse...
Dev Digest 194: AI vs. Version Control, Password Louvre & Cursed Webdev
DC
Daniel Cranney
Dev Digest 166: Sycophancy, Zip bombs and AI Native Development
Inside last week’s Dev Digest 166 . πŸ”₯ The hottest AI job of 2023 is already obsolete πŸ™Œ Sycophancy as an AI dark pattern πŸ‘¨β€πŸ’» The hidden cost of AI coding πŸ” 2025’s Top OSINT Tools 🐞 Bugs in AI chatbot apps πŸ™…β€β™‚οΈ Saying β€œno” to abstract code πŸ–ΌοΈ Image en...
Dev Digest 166: Sycophancy, Zip bombs and AI Native Development

From learning to earning

Jobs that call for the skills explored in this talk.

Rust and GoLang

Rust and GoLang

NHe4a GmbH
Karlsruhe, Germany

Remote
€55-65K
Intermediate
Senior
Go
Rust