Maxim Salnikov

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based

What if you could run powerful AI in a web app with total user privacy, completely offline? New browser APIs make it possible.

Privacy-first in-browser Generative AI web apps: offline-ready, future-proof, standards-based
#1about 3 minutes

A demo of client-side AI using the NPU

A computer vision application performs image classification directly in the browser without any backend calls by leveraging the device's Neural Processing Unit (NPU).

#2about 3 minutes

The case for privacy-first, on-device AI

On-device AI meets user demands for performance, privacy, and offline access while satisfying developer needs for a unified codebase and helpful abstractions.

#3about 3 minutes

Introducing the Web Neural Network (WebNN) standard

The emerging WebNN standard provides a model-agnostic, unified abstraction for near-native AI execution in the browser, designed around practical use cases.

#4about 4 minutes

Leveraging hardware like the CPU, GPU, and NPU

WebNN can access all available hardware, with the NPU offering a power-efficient alternative to the GPU for sustained AI workloads on mobile devices.

#5about 6 minutes

Getting started with the low-level WebNN API

To experiment with the emerging WebNN standard, developers must use canary browser versions and enable specific flags, but its low-level API can be complex.

#6about 7 minutes

Simplifying development with high-level AI frameworks

Frameworks like ONNX Runtime Web and Transformers.js provide higher-level, task-based abstractions over WebNN, making it easier for app developers to build AI features.

#7about 3 minutes

Best practices and the future of browser AI

Focus on user experience by providing fallbacks and progress indicators, and look ahead to upcoming built-in browser APIs like the Prompt API that abstract away model management.

#8about 2 minutes

Demo code and using web workers for performance

The demo applications are built as offline-ready Progressive Web Apps and use Web Workers to run intensive AI computations without freezing the main UI thread.

Related jobs
Jobs that call for the skills explored in this talk.

Machine Learning Engineer

Picnic Technologies B.V.

Picnic Technologies B.V.
Amsterdam, Netherlands

Intermediate
Senior
Python
Structured Query Language (SQL)
+1

Matching moments

Using Chrome's built-in AI for on-device features
06:44 MIN

Using Chrome's built-in AI for on-device features

Devs vs. Marketers, COBOL and Copilot, Make Live Coding Easy and more - The Best of LIVE 2025 - Part 3

Integrating AI into Firefox while respecting user privacy
08:40 MIN

Integrating AI into Firefox while respecting user privacy

AI in the Open and in Browsers - Tarek Ziadé

The security challenges of building AI browser agents
06:33 MIN

The security challenges of building AI browser agents

AI in the Open and in Browsers - Tarek Ziadé

The importance of client-side encryption for AI features
03:16 MIN

The importance of client-side encryption for AI features

AI in the Open and in Browsers - Tarek Ziadé

The shift to on-device AI models in smartphones
00:48 MIN

The shift to on-device AI models in smartphones

Fake or News: Coding on a Phone, Emotional Support Toasters, ChatGPT Weddings and more - Anselm Hannemann

The value of progressive enhancement and semantic HTML
03:31 MIN

The value of progressive enhancement and semantic HTML

WeAreDevelopers LIVE – You Don’t Need JavaScript, Modern CSS and More

Using AI to overcome challenges in systems programming
02:49 MIN

Using AI to overcome challenges in systems programming

AI in the Open and in Browsers - Tarek Ziadé

Building an open source community around AI models
04:28 MIN

Building an open source community around AI models

AI in the Open and in Browsers - Tarek Ziadé

Featured Partners

Related Videos

See all videos
Generative AI power on the web: making web apps smarter with WebGPU and WebNN32:27

Generative AI power on the web: making web apps smarter with WebGPU and WebNN

Christian Liebel

Prompt API & WebNN: The AI Revolution Right in Your Browser30:36

Prompt API & WebNN: The AI Revolution Right in Your Browser

Christian Liebel

Exploring the Future of Web AI with Google33:51

Exploring the Future of Web AI with Google

Thomas Steiner

From ML to LLM: On-device AI in the Browser27:23

From ML to LLM: On-device AI in the Browser

Nico Martin

Performant Architecture for a Fast Gen AI User Experience25:47

Performant Architecture for a Fast Gen AI User Experience

Nathaniel Okenwa

Generate AI in the Browser with Chrome AI - Raymond Camden36:41

Generate AI in the Browser with Chrome AI - Raymond Camden

Raymond Camden

Making neural networks portable with ONNX54:49

Making neural networks portable with ONNX

Ron Dagdag

AI: Superhero or Supervillain? How and Why with Scott Hanselman25:17

AI: Superhero or Supervillain? How and Why with Scott Hanselman

Scott Hanselman

Related Articles

View all articles
DC
Daniel Cranney
Dev Digest 198: 30 years of JS, In-Browser AI, How Attackers Abuse GenAI
Inside last week’s Dev Digest 198 . 🎂 30 years of JavaScript ⏰ How long is a JavaScript second 💻 Clean code in Angular 🤦‍♂️ AI makes different mistakes than humans 👨‍💻 In-browser and offline AI 🟠 Undocumented Hacker News features 🐋 DeepSeek censored...
Dev Digest 198: 30 years of JS, In-Browser AI, How Attackers Abuse GenAI
AB
Adrien Book
How AI Will Eat The World 🤖
Of generative-AI-for-everything and synthetic pleasuresRemember the web3 hype? Tech bros with easy access to cheap liquidity wanted to create a decentralised, peer-to-peer internet powered by blockchain technology. Spoiler alert, it did not work. And...
How AI Will Eat The World 🤖

From learning to earning

Jobs that call for the skills explored in this talk.