async-copy

Tag

Cards List
#async-copy

Another big tensor fix b9820

Reddit r/LocalLLaMA · 2026-06-27

Introduces performance improvements by reducing synchronizations during split compute in the ggml backend, adds async CUDA copy capability, and makes sync relaxation more general across backends.

0 favorites 0 likes
← Back to home

Submit Feedback