Browsing Tag
ai-on-device
4 posts
On-Device RAG for App Developers: Embeddings, Vector Search, and Beyond
Giving your Offline AI agent memory — the ability to search and retrieve your private data We’ve explored why offline AI…
Architectural Evolution and Implementation Strategy of the LiteRT CompiledModel API
Executive Summary The proliferation of high-performance machine learning (ML) on edge devices has precipitated a fundamental shift in…
On-Device Function Calling with FunctionGemma
A Practical Guide to preparing and using Google’s smallest function calling model for Mobile and Web Developers Why…
From Zero to Hero: Running Google’s Gemma 3n on Android with LiteRT & Qualcomm QNN
A complete journey from “What is On-Device AI?” to deploying a state-of-the-art 2B LLM on your phone using…
