5090: Windows or Linux for Qwen3.8.27b

Reddit r/LocalLLaMA News

Summary

User seeks advice on the best operating system (Windows or Linux) and inference server to run the Qwen3.8.27b model on a dedicated AI rig with RTX 5090 and 96GB RAM for optimal performance.

I've got a dedicated AI rig sitting here with a RTX 5090 and 96GB RAM and for the past few years have been using Windows 11 and primarily LM Studio, but have also used vLLM, llama.cpp and Ollama. With Qwen3.8.27b I want to get the most out of this model. I get the feeling from the community that LM Studio on Windows might not be the best way to go. If you had this rig sitting on your desk and wanted the best environment to host Qwen3.8-27b, what would you use for it? (Intel i9-14900K, RTX 5090, 96GB DDR5) Windows 11 + which inference server Linux + which OS (Ubuntu?) & inference server I'm happy to replace Windows 11 with Linux if that's the best way to get the maximum performance out of this model. I'm not tied to Win11 if this is holding me up. I don't use it for anything else.
Original Article

Similar Articles

I have just moved from MacBook M5 pro 48 GB to RTX3090

Reddit r/LocalLLaMA

A software developer shares their experience switching from a MacBook to an RTX3090 Linux setup for running AI models, achieving significantly higher inference speeds with Qwen 3.8 27B and potentially replacing their Claude subscription.