@seclink: 收录看一看.
Summary
Liquid AI introduces Pipette, an on-device model evaluation suite created with ArtificialAnlys to improve benchmarking for edge intelligence.
View Cached Full Text
Cached at: 08/24/26, 07:57 PM
收录看一看.
Liquid AI (@liquidai): Today we release Pipette, a model evaluation suite for on-device intelligence, in partnership with @ArtificialAnlys
Most benchmarking platforms are optimized to measure core capabilities and speed profile of foundation models served in the cloud. Pipette gives the field a
Similar Articles
@QuixiAI: Pipette is brilliant @liquidai @maximelabonne Thank you for making this open source.
Liquid AI has released Pipette, an open-source model evaluation suite for on-device AI, developed in partnership with ArtificialAnlys.
d1 (2 minute read)
Liquid AI and Artificial Analysis release Pipette, an open-source benchmarking suite for on-device AI that measures quality, speed, latency, and memory use across models, quantizations, runtimes, and devices, shipping with 10k+ verified results and clients for macOS, Windows, iOS, and Android.
@seclink: 又一个 benchmark ， 收录一下 样本和标注。
PatronusAI releases SpeedrunBench, the first benchmark that measures how fast AI agents can speedrun video games across multiple titles.
@onloglogn: Introducing RSI-Inference Bench from Apple ML Research http://rsi-inference.com https://github.com/apple-aiml-research/…
Apple ML Research introduces RSI-Inference Bench, a benchmark and environments built from real-world vLLM and SGLang inference-engineering tasks to test whether AI agents can improve the systems that run AI, reporting a best-agent pass@1 of just 26.7% after spending $100K in API tokens and 50K GPU hours.
@seclink: https://x.com/seclink/status/2057086514975404108
Anthropic engineer shared development experience of long-duration AI agents, including multi-role division and independent evaluators, enabling AI to automatically generate complete applications within 3-5 hours, with a 12x improvement in continuous operation capability.