Tiny LLMs and Agents on Edge Devices with LiteRT-LM
· 4 min read
Cormac Brick from Google explains how LiteRT-LM brings language models to edge devices, covering Gemma models, agent skills, performance benchmarks, and the real engineering tradeoffs of running LLM workflows on phones and constrained hardware.