Tag
A commentator shares thoughts on a VC-funded experiment pushing state-of-the-art AI to ship code directly to production in a game environment where failures are tolerable.
A discussion on securing action-taking AI agents against prompt injection, arguing that backend controls, tool restrictions, transaction limits, and human approval matter more than prompt-level defenses. The author invites practitioners to share their real-world mitigation strategies.
A community discussion asking whether companies have actually shipped custom AI agents to production or are still relying on ChatGPT/Claude and POCs, exploring frameworks, blockers, access management, and POC-to-production surprises.
该文探讨了AI智能体从演示环境走向真实企业生产环境所面临的工程挑战,涵盖数据接入、人机协作分级、系统集成、可靠性评估与安全架构等关键方面。
该论文比较了经LLM蒸馏的生成式与判别式学生模型在多标签主题分类任务上的表现,发现数据类型决定了架构选择:判别式模型在结构化评论上更优,而即使最小的1B生成式模型在多轮对话数据上也能超越判别式基线,并在大规模长尾标签下保持稳健,最终成功部署于eBay生产环境。
The article discusses the growing disparity between AI agent capabilities and the necessary control mechanisms for production use, highlighting challenges in permissions, escalation, and accountability.
The article explores the key challenges in transitioning LLM application ideas to production in the EU, covering legal compliance, traceability, abuse prevention, and accountability, and seeks concrete examples from practitioners.
This post discusses common challenges with unattended AI agents, such as looping, overspending, and incorrect task completion, and asks how practitioners handle issues like verification, stall detection, and hard limits in production.
The article discusses the need for re-checking permissions and actions immediately before an AI agent executes a task in production, due to potential changes in conditions like record states or approvals.
The author questions why tiny AI models with fewer than 50M parameters or swarms of specialized micro-models are rarely deployed in production, speculating on reasons like tooling biases or the convenience of generalist models.
This paper reports on a production migration for a customer support conversational assistant, replacing a monolithic AI model with an agentic orchestration system to improve precision, reduce hallucinations, and lower serving costs.
Mercury 2.5 is announced as the most capable diffusion language model, with a 40% increase in intelligence over Mercury 2, operating at over 1,100 tokens/sec on NVIDIA GPUs, and optimized for production with low latency and cost.
A post soliciting feedback on the pain points of deploying AI agents in real workplace settings, highlighting issues like security reviews and operational challenges.
The article explains why AI demos are not suitable for production use and outlines key engineering practices needed to build reliable AI systems.
An inquiry into the real-world effectiveness of AI agents, highlighting challenges in production such as inefficiency and error rates, and inviting community experiences.
The author shares three unexpected learnings from running a language-learning product with per-user persistent AI agents, including benefits in memory handling and scalability, and challenges with proactive engagement and security.
The article discusses challenges and asks for community experiences regarding the breakdown of AI agent memory systems after months in production use.
The article warns about the limitations of free-tier vector databases, highlighting issues like data deletion and deployment constraints, and advises choosing based on where your AI agent runs.
The article discusses considerations for integrating vision capabilities like screenshots and documents into AI agent workflows, referencing the DeepSeek-V4-Flash-Vision-Exp experimental API and suggesting evaluation steps before production use.
Two talks and a blog post argue that the feedback loop and harness engineering are more important than model weights for owning AI intelligence in production, highlighting context management and cost considerations.