I created code-review runs on 5090. Its scores F1 22.7 on Martian

Reddit r/AI_Agents Tools

Summary

A developer created a code-review tool running on a consumer RTX 5090 GPU using open-weight models, achieving F1 22.7 on the Martian code-review benchmark, and is considering turning it into a product or open-sourcing it.

Hi guys. I was playing lots with consumer-ready solutions and almost suddenly create a code reviewer who can compete with commercial products It’s achieved P 19.2/R 27.7 and F1 22.7 on Martian code-review bench Its runs completely on consumer 5090 , do not use any paid API - only open weight models .. double checked benchmarks few times Now i am confused. Should I turn it into a product? Should I open-sourced it? Is it a real achievement? Or it’s not worth time There is room for improvements for sure , probably I can achieve like F1 30 Maybe if I’ll swap open weight for paid api it will be near leaders . What did you think?
Original Article

Similar Articles

Open Code Review – An AI-powered code review CLI tool

Hacker News Top

Alibaba has open-sourced Open Code Review, an AI-powered CLI tool for code review that combines deterministic engineering with LLM agent capabilities. Originally an internal tool serving tens of thousands of developers and identifying millions of defects, it reads Git diffs and produces structured, line-level review comments using a configurable model endpoint.

Shipping code faster with o3, o4-mini, and GPT-4.1

OpenAI Blog

CodeRabbit launches enhanced code review capabilities using OpenAI's o3, o4-mini, and GPT-4.1 models, enabling developers to ship 4x faster and reduce production bugs by 50%. The tool now includes VS Code integration and uses multi-step reasoning to catch bugs, refactors, and architecture issues across codebases.

4090 + 5060 Ti + 64GB RAM: 206 t/s on a 35B-A3B, and a 122B at 37 t/s

Reddit r/LocalLLaMA

A user shares benchmark results for running large language models (Qwen 27B-122B) on a dual-GPU setup with RTX 4090 and RTX 5060 Ti, achieving high token generation speeds (e.g., 206 t/s on 35B-A3B, 37-41 t/s on 122B). The post includes setup details and a link to a GitHub repo with scripts and raw data.