@rasbt: Cool new open-weight model by Cohere: a new lightweight 30B open-weight model for agentic coding tasks. This one builds…
Summary
Cohere released a new lightweight 30B open-weight model for agentic coding tasks, built on Command A+ with parallel transformer design, showing strong performance on agentic benchmarks like Terminal-Bench and SWE-Bench.
Similar Articles
IFCMemoryBench: Evaluating Long-Term Memory of LLM-Based Agents in BIM Information Retrieval
This paper introduces IFCMemoryBench, a human-validated benchmark for evaluating long-term memory in LLM-based agents for BIM information retrieval. It shows that current memory systems achieve only 32.4% answer accuracy, revealing a domain-transfer gap in agent memory.
SimpleWikiSearch: A Clean Offline Wikipedia Environment for Agentic Search
SimpleWikiSearch 是一个可复现的离线 Wikipedia 环境,用于评估基于 LLM 的 agentic 搜索系统,明确规定了语料构建、检索栈和工具接口。
Forensic Reproducibility Audit of a Radiology Vision-Language Model Benchmark: From Intended Protocol to Released Artifact
This paper performs a forensic reproducibility audit of a radiology vision-language model benchmark, finding divergences between the intended protocol and released artifacts that invalidate the original claims. The authors propose a benchmark contract to expose such failure classes.
Setoka: A Benchmark for Hierarchical User Understanding in Personalized Agents over Heterogeneous Data
Setoka is a benchmark for evaluating memory-augmented personalized agents' ability to understand users hierarchically (semantic memory, episodic memory, behavior patterns, personality traits) from heterogeneous data, revealing that current memory systems struggle with tasks requiring cross-source integration and abstraction.
UrbanDS: A Graph-Guided LLM Multi-Agent System for Data-Intensive Urban Tasks
This paper introduces UrbanDS, a graph-guided LLM multi-agent system designed for data-intensive urban tasks, along with UrbanDS-Bench, a benchmark for evaluating such systems. Experiments show it outperforms existing data science agents and has been deployed in a real-world urban operations platform.