Lemonade v10.7 release and project organization update

Reddit r/LocalLLaMA Tools

Summary

Lemonade v10.7 release introduces LMX-Omni virtual models for omni-modal chat, a bench CLI tool for LLM performance comparison across backends, and expanded GPU support on AMD, Apple Silicon, Nvidia, and Intel systems.

Today's [v10.7 release](https://github.com/lemonade-sdk/lemonade/releases/tag/v10.7.0) is the start of an exciting new chapter for the Lemonade project, so I thought I should share an project-level update. Lemonade's roadmap and development is now driven by 6 [working groups](https://lemonade-server.ai/docs/dev/working-groups/), 4 of which are led by non-AMDers. Here are highlights from 3 of the groups in the v10.7 release, which had 19 contributors. ## Local Omni Models True omni-modal chat, including image gen/editing, by seamlessly combining multiple backends and models. v10.7 makes these [LMX-Omni](https://huggingface.co/lemonade-sdk/LMX-Omni-52B-Halo) virtual models compatible with Open WebUI and other OpenAI clients that support multimedia rendering. ## Auto Tuning Every system should get the best performance, without users worrying about optimizing flags. v10.7 kicks this off by adding the `lemonade bench` CLI tool, which collects apples-to-apples LLM performance data across llama.cpp, FastFlowLM, and vLLM. ## Cross-Vendor Support Lemonade has its best chance at its mission of advancing local AI if it gives a great experience on every platform. v10.7 adds CUDA backends for llama.cpp and stable-diffusion.cpp, as well as Vulkan for sd-cpp, with more to come. As of v10.7, the LMX-Omni virtual models are now GPU accelerated on AMD, Apple Silicon, Nvidia, and Intel systems. ## What's Next You can check out the [working group roadmaps here](https://lemonade-server.ai/docs/dev/working-groups/). If you like what we're up to, please give me your feedback here, star the repo, and join the bi-weekly public meetings on the [Lemonade Discord](https://discord.gg/5xXzkMu8Zk)!
Original Article

Similar Articles

macOS support in Lemonade has graduated out of beta!

Reddit r/LocalLLaMA

Lemonade, an open-source local AI solution, has graduated macOS support from beta, now offering all major capabilities including OmniRouter, coding, image/speech generation and transcription on macOS.

AMD's Lemonade SDK for local AI adds NVIDIA CUDA support

Reddit r/artificial

AMD's Lemonade SDK for local AI adds NVIDIA CUDA support in version 10.7, enabling the same local AI server experience on competitor GPUs. The release also introduces lemonade bench for cross-backend LLM benchmarking and broader Vulkan support.