Google AI Edge provides the tools to run AI features on-device, and its new LiteRT-LM runtime is a significant leap forward for generative AI. LiteRT-LM is an open-source C++ API, cross-platform compatibility, and hardware acceleration designed to efficiently run large language models like Gemma and Gemini Nano across a vast range of hardware. Its key innovation is a flexible, modular architecture that can scale to power complex, multi-task features in Chrome and Chromebook Plus, while also being lean enough for resource-constrained devices like the Pixel Watch. This versatility is already enabling a new wave of on-device generative AI, bringing capabilities like WebAI and smart replies to users.
On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM
Related Posts
Your First AI Cloud Project with AWS: Start with Real-Time Data Ingestion
The Big Picture: Why This Project Matters In the age of AI-driven decisions, retail businesses are sitting on…
Using Web Workers for Parallel Processing in JavaScript
Ever felt your website slow down to a crawl when you’re performing a heavy task like processing a…
Sistemas Operacionais: FIFO
Os sistemas operacionais são a espinha dorsal de qualquer computador, gerenciando hardware e software para garantir que tudo…
