Google AI Edge provides the tools to run AI features on-device, and its new LiteRT-LM runtime is a significant leap forward for generative AI. LiteRT-LM is an open-source C++ API, cross-platform compatibility, and hardware acceleration designed to efficiently run large language models like Gemma and Gemini Nano across a vast range of hardware. Its key innovation is a flexible, modular architecture that can scale to power complex, multi-task features in Chrome and Chromebook Plus, while also being lean enough for resource-constrained devices like the Pixel Watch. This versatility is already enabling a new wave of on-device generative AI, bringing capabilities like WebAI and smart replies to users.
On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM
Related Posts
🧠Why Most Developers Burn Out (And How I Learned to Avoid It)
Burnout isn’t just about overwork — it’s about emptiness. Here’s how I nearly lost my spark — and…
TUGAS DPK-TJKT SEJARAH PERKEMBANGAN TEKNOLOGI TEMA 1-9
NAMA: TSANIA KHILYATIN NADA KELAS: X TJKT 2 NO ABSEN: 32 *#Tema 1 : Jenis teknologi perkembangan prosesor…
On-Device Function Calling in Google AI Edge Gallery
Google has introduced FunctionGemma, a specialized 270M parameter model designed to bring efficient, action-oriented AI experiences directly to…