@steeve: another 5 days later, zml/llmd runs fully on Metal, serving 8 simultaneous requests at full bf16 zml/llmd is our LLM se…
Summary
zml/llmd now runs fully on Apple's Metal API, serving 8 simultaneous requests at full bf16 precision, with continuous batching and other modern features.
View Cached Full Text
Cached at: 06/13/26, 02:17 PM
another 5 days later, zml/llmd runs fully on Metal, serving 8 simultaneous requests at full bf16
zml/llmd is our LLM serving software that all the modern niceties (continuous batching etc..)
ps: “full bf16”, what a time to be alive https://t.co/UtSae5UvNj
Similar Articles
Apple restricts dating apps and AI companions to users 18 and up
Apple is updating App Store policies to require an 18+ rating for dating apps and AI companion apps featuring sexual or romantic content, alongside new content descriptors for location-sharing features starting November 16.
Apple is all in on AI — its own and everyone else’s
Apple 的最新财报显示其在 AI 领域采取轻资本策略，依托 25 亿活跃设备销售 AI 设备与订阅服务，而非像竞争对手那样大举投入基础设施，同时 Siri AI 采用 Gemini 技术并计划支持第三方模型选择。
The 2026 iPad Mini is a terrific tiny tablet — for a big price
The Verge reviews the 2026 iPad Mini, praising its new 8.5-inch OLED display, A20 Pro chip, and waterproofing while noting its steep $699+ starting price and missing features like 120Hz and FaceID.
Apple iPad Mini (2026) Review: A Dream Device, but Who Is It For?
Apple's eighth-generation iPad Mini (2026) brings an OLED display, faster chip, more memory, waterproofing and a thinner chassis, making it the best small tablet yet—though its higher price and missing Face ID and ProMotion raise questions about who it's for.
Apple is restricting dating apps and romanceable chatbots to over 18s
Apple is introducing new App Store content descriptors requiring developers to declare dating, relationship, and location-sharing features, with dating and romanceable AI companion apps getting a minimum 18+ age rating. The new questionnaire requirements roll out November 16th and must be completed by January 12th, 2027.