cost-optimization

Tag

Cards List
#cost-optimization

Revolut moves to self-hosted GLM

Hacker News Top ↗ · 2026-11-03 Cached

Revolut moved ~2,000 engineers onto self-hosted GLM models for coding, retiring Claude Code and Codex to an exception list — running on 56 Nvidia B200s at a blended 30 cents per million tokens (about a tenth of prior Anthropic/OpenAI spend), with engineering lead time improving 70%.

0 favorites 0 likes
#cost-optimization

Harness 2: executing agent code as it streams (6 minute read)

TLDR AI ↗ · 2026-11-03

Framer's Harness 2 upgrades agent code execution by running JavaScript as it streams, cutting costs by up to 33% and speeding up execution by 20% while reducing tool steps and cached token usage significantly.

0 favorites 0 likes
#cost-optimization

Model swap came back 59% cheaper and 75% faster. I still wouldn’t ship it.

Reddit r/AI_Agents ↗ · 2026-11-02

The founder of EvalShift shares a model swap case where cost dropped 59% and latency improved 75%, yet agent behavior regressions like fake tool completions and 25% tool-selection divergence would still block the ship, arguing cost/latency alone can't certify a migration.

0 favorites 0 likes
#cost-optimization

Stop counting tokens, start counting what ships

MIT Technology Review ↗ · 2026-11-02 Cached

MIT Technology Review argues teams should measure AI development by cost per merged pull request instead of per-token spend, recommending model routing and owned open-weight capacity to curb the rising economics of agentic coding.

0 favorites 0 likes
#cost-optimization

@OpenHandsDev: The cheapest LLM isn’t always the cheapest way to complete a task. New analysis shows how switching models mid-session …

X AI KOLs Following ↗ · 2026-10-27 Cached

新分析指出,最便宜的 LLM 并不总是完成任务的最便宜方式:在会话中途切换模型可能因丢失上下文缓存而抵消成本节省,智能路由应优化整个工作流而非仅看模型价格。

0 favorites 0 likes
#cost-optimization

Propasafe-Hybrid: A Text-Based Hybrid Propaganda Detection Tool

arXiv cs.CL ↗ · 2026-10-27 Cached

Propasafe-Hybrid 是一个句子级的混合式宣传检测系统,将微调的 Transformer 分类器与 LLM 技术分类相结合,并通过成本感知的预过滤阶段减少 token 消耗,同时提供可解释的标注和理由。

0 favorites 0 likes
#cost-optimization

Stop burning tokens on solved problems: How my 12-year-old Office PC handles Email, OCR, and TTS for $0

Reddit r/openclaw ↗ · 2026-10-23

作者分享如何用一台12年前的办公PC运行本地脚本(IMAP邮件轮询、Tesseract OCR、Piper TTS),把Telegram机器人例行任务从昂贵的LLM API调用转为零token的本地处理,显著降低成本。

0 favorites 0 likes
#cost-optimization

AI’s hidden storage bill: What inference leaves behind

MIT Technology Review ↗ · 2026-10-22 Cached

MIT Technology Review examines the overlooked data storage costs of AI inference, noting that a single 8-second AI-generated video can leave behind 500MB of back-end data (130x the user-visible file) and citing IDC/McKinsey forecasts of 35% CAGR inference demand growth through 2030.

0 favorites 0 likes
#cost-optimization

for research agents, do you let a deep research api run the whole loop or build your own on top of search + extract?

Reddit r/AI_Agents ↗ · 2026-10-21

作者探讨构建研究型 AI 智能体时的两种架构选择:直接调用一体化 deep research API(Gemini Deep Research、OpenAI、Tavily Research 等),或基于搜索/抓取原语(Firecrawl、Exa、Tavily)自建规划与合成循环,并就质量、可观测性、扩展性与成本估算向生产环境实践者提问。

0 favorites 0 likes
#cost-optimization

I exported 10 hours of my Grok Bot usage to CSV: 89% went to background subtasks, and 5 rules should cut it by ~25-30%

Reddit r/AI_Agents ↗ · 2026-10-21

作者导出10小时Grok Bot使用数据发现89%消耗来自后台子任务、96%输入token用于重读旧上下文,并总结出5条规则,预计可节省25-30%的用量。

0 favorites 0 likes
#cost-optimization

OpenAI is shutting down GPT-4o and GPT-4.1 on Jan 14. We tested the cheaper Luna models task by task first. Results were mixed.

Reddit r/AI_Agents ↗ · 2026-10-21

BotsCrew reports benchmark results comparing GPT-5.6 Luna to GPT-5.2 ahead of OpenAI's January 14 shutdown of GPT-4o and GPT-4.1, finding the cheaper Luna models win on cost but perform worse on long tool-heavy conversations and guardrails.

0 favorites 0 likes
#cost-optimization

Combining multiple team priorities in agent evaluation

Reddit r/AI_Agents ↗ · 2026-10-20

The author shares a Towards Data Science article on combining cost, quality, and latency into a single convex score for evaluating AI agents, turning business constraints into math that guides agent optimization instead of ad-hoc prompt tweaking.

0 favorites 0 likes
#cost-optimization

Gave 3 research agents a shared memory to cut cost. It saved nothing!!

Reddit r/AI_Agents ↗ · 2026-10-20

A practitioner ran a cost benchmark on three parallel research agents sharing a memory of page digests and prefix caching, finding essentially no savings ($1.11 vs $1.09) because concurrent starts caused empty recalls, prefix cache misses, and digest overhead in output tokens.

0 favorites 0 likes
#cost-optimization

MiniMax M3.1 Flash

Product Hunt ↗ · 2026-10-19

MiniMax 发布 M3.1 Flash 模型,速度提升 3 倍、成本降低 70%,专为智能体(agents)场景优化。

0 favorites 0 likes
#cost-optimization

@rohanpaul_ai: AI agents that hunt security bugs spend 60.4% of their tokens understanding code and reasoning about how to trigger the…

X AI KOLs Timeline ↗ · 2026-10-19 Cached

研究发现安全漏洞挖掘AI代理60.4%的token用于理解代码与推理触发方式,并提出AVRI工具复用代码关系知识,在Codex和OpenCode上分别降低18.0%和23.7%成本且不损失成功率。

0 favorites 0 likes
#cost-optimization

TokenEconomizer: Experience-Driven Black-Box Cost Control for Coding Agents

arXiv cs.CL ↗ · 2026-10-19 Cached

The paper introduces TokenEconomizer, an experience-driven external controller that reduces token costs of coding agents by injecting micro-skills, pruning irrelevant tools, and interrupting failure loops, achieving 18.4–30.9% savings across Claude Code, Codex, and GitHub Copilot CLI with comparable task success.

0 favorites 0 likes
#cost-optimization

Chance-Constrained Personalized LLM Routing with Online Preference Learning

arXiv cs.LG ↗ · 2026-10-19 Cached

该论文提出一种基于约束上下文老虎机的个性化 LLM 路由框架,通过 primal-dual GLM-UCB 算法在线学习用户偏好,在最小化推理成本的同时以高概率保证响应质量满意度。

0 favorites 0 likes
#cost-optimization

To Make, or to Buy: The Economics of Decision Models

Hacker News Top ↗ · 2026-10-18 Cached

一篇博客文章系统分析了决策模型(如 Jev)的经济学,探讨其 choice/score/noul 输出类型、几乎免费的输出 token 成本,以及由此衍生的"决策层级"内存层级类比。

0 favorites 0 likes
#cost-optimization

Where does your local vs cloud cost line sit? (3 presets, 3 API rates, the cached-token gap most calculators guess at) :)

Reddit r/LocalLLaMA ↗ · 2026-10-17

A free browser-based LLM cost calculator lets you compare local GPU inference (with RTX 4070 Ti Super / 5090 presets) against cloud API pricing, highlighting that cached-input token rates — often guessed at by other calculators — most determine where the local-vs-cloud crossover sits.

0 favorites 0 likes
#cost-optimization

@heyshrutimishra: Your app doesn’t need a cloud bill for every image. If every upload calls a paid vision API, usage becomes a running co…

X AI KOLs Timeline ↗ · 2026-10-16 Cached

推文讨论用开源的 MiniCPM-V 4.7 在自有硬件上做图像理解,避免每次上传图片都调用付费视觉 API 产生持续云成本,并介绍如何将其集成到 agent 工作流中。

0 favorites 0 likes
Next →
← Back to home

Submit Feedback