Dubravko Dolic & Hüdaverdi Cakir
Industrializing your Data Science capabilities
#1about 2 minutes
The challenge of industrializing data science models
A tire recall incident highlights the gap between a data scientist's local Python script and a scalable, production-ready solution.
#2about 3 minutes
Building the initial concept for a data science factory
The journey began with a demand forecasting use case, leading to the concept of a lab for experimentation and a factory for industrialization.
#3about 5 minutes
Establishing processes and a cloud-agnostic tool stack
A standardized process with dev, QA, and prod stages was created, supported by a cloud-agnostic tool stack including Git, Jenkins, and Kubernetes.
#4about 5 minutes
Technical architecture for a multi-stage deployment environment
The architecture uses Kubernetes and containerization to create reproducible dev, QA, and prod environments with immutable builds and stage-specific configurations.
#5about 11 minutes
Live demo of deploying and promoting application versions
A command-line interface is used to deploy a new version of a Shiny application to the dev environment and promote an existing build from dev to QA.
#6about 5 minutes
Monitoring applications with logs and metrics
The platform provides developers with access to Elastic Stack for log aggregation and Prometheus with Grafana for metrics to monitor application performance.
#7about 2 minutes
Providing a simplified lab environment for data scientists
A web-based frontend offers pre-configured templates for RStudio and Python, abstracting away infrastructure complexity for data scientists.
#8about 4 minutes
Real-world use cases from tire manufacturing
Several applications are showcased, including real-time tire monitoring for mining trucks, optimizing material mixing, and deploying scrap prediction models to edge devices.
#9about 6 minutes
Integrating the factory into a larger analytics ecosystem
The Data Science Factory is part of a broader ecosystem that includes a telemetry backbone, image recognition pipelines, and predictive maintenance platforms.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
18:10 MIN
Managing massive data scales with the Robotic Drive platform
How to develop an autonomous car end-to-end: Robotic Drive and the mobility revolution
12:06 MIN
A platform for self-service infrastructure and environments
Let developers develop again
04:43 MIN
Core concepts of continuous delivery for data
Implementing continuous delivery in a data processing pipeline
39:32 MIN
Implementing a CI/CD pipeline for your NLP model
Multilingual NLP pipeline up and running from scratch
29:33 MIN
Applying software engineering discipline to AI development
Navigating the AI Revolution in Software Development
02:48 MIN
Merging data engineering and DevOps for scalability
Software Engineering Social Connection: Yubo’s lean approach to scaling an 80M-user infrastructure
17:33 MIN
Bridging gaps with DevOps and containerization
From Punch Cards to AI-assisted Development
18:06 MIN
Using data management and open source tools for MLOps
MLOps - What’s the deal behind it?
Featured Partners
Related Videos
DevOps for Machine Learning
Hauke Brammer
Empowering Retail Through Applied Machine Learning
Christoph Fassbach & Daniel Rohr
AI beyond the code: Master your organisational AI implementation.
Marin Niehues
From Factory Floor to Kubernetes Core: Building an Edge Platform One Step at a Time
Dean Oren & Stefan Belsch
DataForce Studio
Iryna Kondrashchenko & Oleh Kostromin
Big Business, Big Barriers? Stress-Testing AI Initiatives.
Marin Niehues
Empowering Thousands of Developers: Our Journey to an Internal Developer Platform
Bastian Heilemann & Bruno Margula
Developer Experience, Platform Engineering and AI powered Apps
Ignacio Riesgo & Natale Vinto
Related Articles
View all articles

.gif?w=240&auto=compress,format)

From learning to earning
Jobs that call for the skills explored in this talk.

DevOps Engineer – Kubernetes & Cloud (m/w/d)
epostbox epb GmbH
Berlin, Germany
Intermediate
Senior
DevOps
Kubernetes
Cloud (AWS/Google/Azure)

AI Systems and MLOps Engineer for Earth Observation
Forschungszentrum Jülich GmbH
Jülich, Germany
Intermediate
Senior
Linux
Docker
AI Frameworks
Machine Learning



Team Lead and Senior Software Engineer with focus on AI
Dynatrace
Linz, Austria
Senior
Java
Team Leadership



DevOps Engineer - Data Science Plattformen
ITech Consult AG
Zürich, Switzerland
€166-208K
Azure
DevOps
Docker
Grafana
+6

Data Scientist im Bereich Conversational AI
DHL
Bonn, Germany
Remote
Python
Tableau
Data analysis
Machine Learning