Google AI Edge provides the tools to run AI features on-device, and its new LiteRT-LM runtime is a significant leap forward for generative AI. LiteRT-LM is an open-source C++ API, cross-platform compatibility, and hardware acceleration designed to efficiently run large language models like Gemma and Gemini Nano across a vast range of hardware. Its key innovation is a flexible, modular architecture that can scale to power complex, multi-task features in Chrome and Chromebook Plus, while also being lean enough for resource-constrained devices like the Pixel Watch. This versatility is already enabling a new wave of on-device generative AI, bringing capabilities like WebAI and smart replies to users.
On-device GenAI in Chrome, Chromebook Plus, and Pixel Watch with LiteRT-LM
Related Posts
Full Stack Application Hosting in AWS
Todo Application Documentation Table of Contents Introduction Architecture Overview Backend Setup Frontend Setup AWS Configuration Deployment Troubleshooting Maintenance…
Understanding :has() selector in CSS.
While working on CSS problems I have come across a situation multiple times where I need to apply…
Manual testing, Benefits and drawbacks of manual testing and also a example
Manual testing: It is a vital quality assurance process in software development that relies on human testers to…
