Tag
A developer achieved up to 381 tok/s inference speed on a single RTX 3090 with the Qwen3.8-27B model using optimized techniques like DFlash2 and prefix caching, particularly effective for document-based tasks like RAG and coding assistants.
The author expresses concern about the ease of accessing uncensored AI models like Qwen 3.8 27B and questions the effectiveness of safety regulations in the face of open source advancements.
An experiment tested the Qwen 3.8 27B AI model on ACT practice exams using vision capabilities, achieving high composite scores of 34-36, showcasing strong performance in standardized testing.
The user tested scaling local AI agents with a Qwen 27B model, finding that adding more agents increases throughput only up to a point due to memory bandwidth limits, with long prompts benefiting more from parallelism.
The author experimented with two local agents running in parallel on a MacBook Pro M3Max using the QWEN 3.8 27B 4bit model, finding that batching enables concurrent execution but increases latency, with an optimal agent count around 4.
A user demonstrates running the Qwen 27b AI model quantized to Q3_K_M on two RX 580 GPUs, achieving 7.39 tokens per second using old DDR3 hardware for under $100.
The author discusses the low adoption of the qwen 3.8 27b model based on download counts and estimates that very few users have the high-VRAM GPUs needed for productive local LLM development.
A community poll seeking specific harness tool recommendations for local coding with the Qwen 3.8 27b AI model.
This article details the improvements to the Jinja chat template for Qwen 3.8 models, correcting issues from previous versions to ensure consistent output quality and benchmark performance.
This paper examines how the underrepresentation of elderly riders in mobility datasets introduces systematic bias into mobility modeling, using Citi Bike data from Jersey City. It shows that models trained on majority-dominated populations misrepresent elderly mobility behavior, and that higher-capability models do not necessarily improve subgroup fidelity under limited demographic data.
A guide on optimizing VRAM usage on an AMD 7900XTX to run a 27B Qwen model with Q6K quantization and 131k context by compiling llama.cpp with OpenBLAS and CUDA_FA_ALL_QUANTS, and using kvcache quantization at q5_0/q4_0.
MachinaCheck is a multi-agent AI system built on AMD MI300X hardware that automates CNC manufacturability analysis for STEP files using Qwen 2.5 7B models.