Google AI Edge provides the tools to run AI features on-device, and its new LiteRT-LM runtime is a significant leap forward for generative AI. LiteRT-LM is an open-source C++ API, cross-platform compatibility, and hardware acceleration designed to efficiently run large language models like Gemma and Gemini Nano across a vast range of hardware. Its key innovation is a flexible, modular architecture that can scale to power complex, multi-task features in Chrome and Chromebook Plus, while also being lean enough for resource-constrained devices like the Pixel Watch. This versatility is already enabling a new wave of on-device generative AI, bringing capabilities like WebAI and smart replies to users.
On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM
Related Posts
How to build a budget, self-hosted video surveillance system on a Raspberry Pi
Video surveillance is no longer something reserved for the wealthy or for large corporations. In one form or…
No need to learn Class Names of CSS libraries
Ok it’s a short post So , do you know about Tailwind or Bootstrap , probably yes that’s…
💅 💔 100 Days CSS in 10 Days — Because Who Needs a Girlfriend When You Have border-radius?
Intro Ever doomscroll your way into developer rage? Yeah, me too. So yesterday I was minding my own…
