hardware-tip

Tag

Cards List
#hardware-tip

Got an old slow low vram GPU laying around? Might be worth it to use for Just Vision mmproj llama.cpp

Reddit r/LocalLLaMA · 6d ago

The article suggests using an old GPU to offload the mmproj component in llama.cpp, which improves speed for multimodal processing without affecting inference, as an alternative to the slow --no-mmproj-offload option.

0 favorites 0 likes
← Back to home

Submit Feedback