I have just moved from MacBook M5 pro 48 GB to RTX3090

Reddit r/LocalLLaMA News
hardware-upgrade ai-inference linux rtx3090 qwen-model vllm productivity

Summary

A software developer shares their experience switching from a MacBook to an RTX3090 Linux setup for running AI models, achieving significantly higher inference speeds with Qwen 3.8 27B and potentially replacing their Claude subscription.

Using the RTX3090 on a linux machine I built for it and running Qwen 3.8 27B getting average 100t/s compared to my MacBook 20t/s I think I can finally get rid of my Claude subscription, this is good enough for me. I am a software dev and I can get what I need from this set up and be more productive. I am using the linux machine serving the model over an Open AI endpoint and using a custom build desktop app with pi behind it all. Regarding speeds average 20t/s on Mac with llama.cpp with mtp Unsloth Q6, Q4 on Mac didnt make much difference in speed for me. Linux running https://github.com/syv-ai/qwen38-27b-rtx3090 which is vLLM and a Q4 model I believe. Tool calls definitely fail more but qwen3.8 seems smart enough to fix and correct itself
Original Article

Similar Articles

The RTX 5000 PRO (48GB) arrived and it is better than I expected.

Reddit r/LocalLLaMA

A user shares their experience purchasing and setting up an RTX 5000 Pro (48GB) GPU for local LLM inference, achieving impressive prompt processing speeds and token generation with Qwen3.6-27B-FP8, and compares it to alternatives like the Mac Studio and RTX 5090.

Upgraded my local setup with 2 rtx pros and it's amazing.

Reddit r/LocalLLaMA

A software developer shares their experience upgrading a local setup with two RTX Pro GPUs, troubleshooting power issues, and achieving high performance for running LLMs like Qwen and Deepseek. They discuss configuration details and seek advice on optimizations and model suggestions.