Google AI Edge provides the tools to run AI features on-device, and its new LiteRT-LM runtime is a significant leap forward for generative AI. LiteRT-LM is an open-source C++ API, cross-platform compatibility, and hardware acceleration designed to efficiently run large language models like Gemma and Gemini Nano across a vast range of hardware. Its key innovation is a flexible, modular architecture that can scale to power complex, multi-task features in Chrome and Chromebook Plus, while also being lean enough for resource-constrained devices like the Pixel Watch. This versatility is already enabling a new wave of on-device generative AI, bringing capabilities like WebAI and smart replies to users.
On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM
Related Posts
Convert a dd/mm/yyyy string to a Date object in JavaScript
✋ Update: This post was originally published on my blog decodingweb.dev, where you can read the latest version…
The Allure of the Internet Computer Protocol (ICP): A Deep Dive
The blockchain landscape is constantly evolving, with new platforms emerging to address the limitations of their predecessors. Among…
Sota Image Captioning Model Kosmos-2 Added To Our Image Captioning Scripts Arsenal
Sota Image Captioning Model Kosmos-2 Added To Our Image Captioning Scripts Arsenal You can download them at here…
