Thomas Endres & Martin Förtsch & Jonas Mayer

Deepfakes in Realtime - How Neural Networks Are Changing Our World

Go beyond simple face swaps. Learn to build a real-time deepfake pipeline using GANs for photorealistic results.

Deepfakes in Realtime - How Neural Networks Are Changing Our World
#1about 4 minutes

The danger and deception of deepfake technology

An introductory example using a fake Obama video highlights the potential for misinformation and the importance of public awareness.

#2about 4 minutes

Differentiating fakes from true deepfakes

A breakdown of related but distinct technologies like lip syncing, face swapping, and real-time reenactment clarifies what constitutes a genuine deepfake.

#3about 13 minutes

How traditional deepfakes are made with Deep Face Lab

The original deepfake workflow involves preparing a dataset with FaceNet, training a shared autoencoder, and then running inference to generate the final video.

#4about 10 minutes

Building a real-time deepfake pipeline

To achieve real-time performance, the original pipeline is modified with faster face segmentation using MobileNet and U-Net, and image inpainting to remove the original head.

#5about 8 minutes

Using GANs to improve deepfake image quality

Generative Adversarial Networks (GANs) are introduced to the training process, where a generator and a discriminator compete to produce more realistic and artifact-free faces.

#6about 2 minutes

Live demo and limitations of data-driven models

A live demonstration shows the real-time head replacement and reveals a key limitation where the model can only reproduce expressions seen in its training data.

#7about 4 minutes

Applications in entertainment and detecting fake news

Deepfakes offer a cost-effective alternative to CGI in the movie industry and can also be used to train discriminator models for detecting fake news.

#8about 2 minutes

The future of deepfakes beyond face swapping

The next evolution of deepfake technology will likely involve higher resolutions, full-body manipulation, and real-time voice cloning to create more comprehensive fakes.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

GenAI amplifies disinformation and online manipulation
13:01 MIN

GenAI amplifies disinformation and online manipulation

Fireside Chat: AI and Sustainability - Thorsten Jonas

The technical process behind creating real-time deepfakes
08:49 MIN

The technical process behind creating real-time deepfakes

The AI Elections: How Technology Could Shape Public Sentiment

Addressing the societal risks of deepfakes and misinformation
31:01 MIN

Addressing the societal risks of deepfakes and misinformation

Building Your Own Classification Model with JavaScript - Coffee with Developers - Carly Richmond

Demonstrating deepfake attacks and social engineering
13:23 MIN

Demonstrating deepfake attacks and social engineering

The AI Elections: How Technology Could Shape Public Sentiment

The danger of deepfakes and the liar's dividend
20:04 MIN

The danger of deepfakes and the liar's dividend

The Four Horsemen of the Information Apocalypse: Taming the Wild West of Information Overload

Why automated detection tools and shallow fakes fail
21:33 MIN

Why automated detection tools and shallow fakes fail

The AI Elections: How Technology Could Shape Public Sentiment

Understanding the rapid evolution of generative AI tools
00:09 MIN

Understanding the rapid evolution of generative AI tools

HR ROBO SAPIENS: Decoding AI Agents and Workflow Automation for Modern Recruitment

The threat of AI-generated deepfakes and voice cloning
02:32 MIN

The threat of AI-generated deepfakes and voice cloning

Skynet wants your Passwords! The Role of AI in Automating Social Engineering

Featured Partners

Related Videos

See all videos
The AI Elections: How Technology Could Shape Public Sentiment30:02

The AI Elections: How Technology Could Shape Public Sentiment

Martin Förtsch & Thomas Endres

Deep Fakes: The Lies We Can’t See24:49

Deep Fakes: The Lies We Can’t See

George Proorocu

In the Dawn of the AI: Understanding and implementing AI-generated images30:38

In the Dawn of the AI: Understanding and implementing AI-generated images

Timo Zander

AI'll Be Back: Generative AI in Image, Video, and Audio Production29:54

AI'll Be Back: Generative AI in Image, Video, and Audio Production

Fabian Pottbäcker, Thomas Endres & Martin Foertsch

Skynet wants your Passwords! The Role of AI in Automating Social Engineering31:19

Skynet wants your Passwords! The Role of AI in Automating Social Engineering

Wolfgang Ettlinger & Alexander Hurbean

Multimodal Generative AI Demystified56:55

Multimodal Generative AI Demystified

Ekaterina Sirazitdinova

Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative29:27

Your imaginations is (no longer) the limit: how Generative AI empowers people to be creative

David Estevez

Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Better AI and True Anonymity27:34

Confuse, Obfuscate, Disrupt: Using Adversarial Techniques for Better AI and True Anonymity

David vonThenen

Related Articles

View all articles
DC
Daniel Cranney
The Rise of Disinformation on the Web
In recent years, the digital landscape has transformed dramatically, propelled by the rapid evolution of AI-generated content and the proliferation of disinformation, as well as a greater focus paid to its role in elections (see: Cambridge analytica ...
The Rise of Disinformation on the Web
BB
Benedikt Bischof
What’s in The box? – Unboxing The DeepFace
Welcome to this issue of the WeAreDevelopers Live Talk series. This article recaps an interesting talk by Sefik Ilkin Serengil who introduced the audience to his python package called DeepFace.‍About the speaker:‍Sefik Ilkin Serengil received his MSc...
What’s in The box? – Unboxing The DeepFace
AB
Adrien Book
How AI Will Eat The World 🤖
Of generative-AI-for-everything and synthetic pleasuresRemember the web3 hype? Tech bros with easy access to cheap liquidity wanted to create a decentralised, peer-to-peer internet powered by blockchain technology. Spoiler alert, it did not work. And...
How AI Will Eat The World 🤖

From learning to earning

Jobs that call for the skills explored in this talk.