machine-learning-inference

Apple researchers present Minions, a system that aggregates idle Apple Silicon GPUs across macOS devices into a dynamic, fault-tolerant distributed virtual GPU cloud for large-scale ML inference, offering a cost-effective alternative to centralized GPU infrastructure.

This pull request adds missing AMD GCN MMQ configuration to ggml-cuda for HIP, enhancing prefill performance for RDNA2 GPUs such as MI50 and MI60 in the llama.cpp inference library.