Tag
PrismML showcases its tiny 1-bit Bonsai LLM at Qualcomm's Snapdragon Summit, which can run locally on smart glasses powered by the Snapdragon AR1 Gen 1 Platform, enabling real-time vision and language processing.
PrismML, a Caltech-founded startup, released Bonsai 2, a highly compressed LLM that reduces memory usage by 9-10x with minimal performance loss, aiming to enable AI on consumer devices like PCs and smartphones.
A tiny ~10K parameter router called tinyrouter learns which open model to use per question on MMLU, outperforming individual models by optimizing allocation.