Lukas Kölbl

Anomaly Detection - Using unsupervised Machine Learning for detecting anomalies in customer base

What happens when your labeled data is unusable? See how this team pivoted to an unsupervised model that successfully detected 84% of true customer outliers.

Anomaly Detection - Using unsupervised Machine Learning for detecting anomalies in customer base
#1about 5 minutes

The essential skills of a modern data scientist

A data scientist needs a blend of math, statistics, and technology skills, but business knowledge and communication are the most crucial for success.

#2about 2 minutes

Understanding the real data science project workflow

The majority of a data scientist's time is spent on data cleansing and feature engineering, not just model training, requiring close collaboration with business stakeholders.

#3about 3 minutes

Defining the customer anomaly detection use case

An insurance company sought to automate the detection of customer outliers to improve user experience, moving from a manual, time-consuming process to an unbiased, data-driven one.

#4about 4 minutes

Building the analytical record for the model

The project's core effort involved creating a master data table, or analytical record, which consumed 70% of the time and required shifting from a supervised to an unsupervised approach due to data quality issues.

#5about 3 minutes

Using robust PCA for explainable anomaly detection

A robust Principal Component Analysis (PCA) model was chosen to identify outliers by measuring reconstruction error after dimensionality reduction, offering a simple and explainable solution.

#6about 4 minutes

Analyzing model results and business impact

The model successfully detected 84% of true outliers, as shown by a confusion matrix and a traffic light visualization, significantly improving efficiency over manual processes.

Related jobs
Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Picnic Technologies B.V.

Picnic Technologies B.V.
Amsterdam, Netherlands

Intermediate
Senior
Python
Structured Query Language (SQL)
+1

Matching moments

The evolving role of the machine learning engineer
02:20 MIN

The evolving role of the machine learning engineer

AI in the Open and in Browsers - Tarek Ziadé

The growing importance of data and technology in HR
01:54 MIN

The growing importance of data and technology in HR

From Data Keeper to Culture Shaper: The Evolution of HR Across Growth Stages

Shifting HR from standard products to AI-powered platforms
04:04 MIN

Shifting HR from standard products to AI-powered platforms

Turning People Strategy into a Transformation Engine

Moving beyond headcount to solve business problems
04:27 MIN

Moving beyond headcount to solve business problems

What 2025 Taught Us: A Year-End Special with Hung Lee

Moving from gut feelings to data-driven decisions
02:46 MIN

Moving from gut feelings to data-driven decisions

Retention Over Attraction: A New Employer Branding Mindset

Crypto crime, EU regulation, and working while you sleep
01:15 MIN

Crypto crime, EU regulation, and working while you sleep

Fake or News: Self-Driving Cars on Subscription, Crypto Attacks Rising and Working While You Sleep - Théodore Lefèvre

Using AI to enable human connection in recruiting
04:06 MIN

Using AI to enable human connection in recruiting

Retention Over Attraction: A New Employer Branding Mindset

The business case for sustainable high performance
03:34 MIN

The business case for sustainable high performance

Sustainable High Performance: Build It or Pay the Price

Featured Partners

Related Videos

See all videos
Detecting Money Laundering with AI29:37

Detecting Money Laundering with AI

Stefan Donsa & Lukas Alber

Overview of Machine Learning in Python57:46

Overview of Machine Learning in Python

Adrian Schmitt

Data Science in Retail58:21

Data Science in Retail

Julian Joseph

Is my AI alive but brain-dead? How monitoring can tell you if your machine learning stack is still performing48:07

Is my AI alive but brain-dead? How monitoring can tell you if your machine learning stack is still performing

Lina Weichbrodt

Empowering Retail Through Applied Machine Learning22:41

Empowering Retail Through Applied Machine Learning

Christoph Fassbach & Daniel Rohr

How Machine Learning is turning the Automotive Industry upside down26:55

How Machine Learning is turning the Automotive Industry upside down

Jan Zawadzki

Unleashing the power of AI to prevent financial crime29:40

Unleashing the power of AI to prevent financial crime

Finding the unknown unknowns: intelligent data collection for autonomous driving development19:24

Finding the unknown unknowns: intelligent data collection for autonomous driving development

Liang Yu

Related Articles

View all articles

From learning to earning

Jobs that call for the skills explored in this talk.