Tag
Fun fact: you can use agents combined with CreateML to convert any HuggingFace model into an iOS-compatible CoreML model and make it roughly 3x faster.
Tinkerbox 是一个可将 LiquidAI d1-3B 等决策模型高效运行在 Apple Neural Engine 上的应用，支持通过 macOS Shortcuts 触发器实现无代码自动化，延迟低至约 40ms，并计划集成 vLLM/Qwen3.5 系列模型。
The Laya model runs offline on Apple's M4 chip using CoreML, achieving 45 decisions per second in inference.
Audiobookify is an EPUB reader app for iPhone that features local offline TTS with optimized AI models for efficiency in battery life and narration quality.
The author turned PP-OCRv6 into a local workstation and open-sourced it for free, supporting Mac CoreML acceleration, providing three models: Tiny/Small/Medium, with image upload, batch processing, and multiple export formats, running locally to protect privacy.
WaveRNN and FastSpeech2 models were discovered in the iOS 27 Simulator files, indicating their use for Siri's text-to-speech, alongside a logistic regression model for concert ranking.
This paper presents a systematic optimization study of real-time diffusion model inference on the Apple M3 Ultra, achieving 22.7 FPS at 512x512 resolution using CoreML conversion and a distillation model, revealing that CUDA-optimized techniques do not directly transfer to Apple's unified memory architecture.