production-lessons

Tag

Cards List
#production-lessons

Why I stopped using semantic embeddings for tool selection and switched back to BM25 [D]

Reddit r/MachineLearning · 4d ago

The author shares their experience switching from semantic embeddings to BM25 for tool selection in agents, finding that BM25 achieves 81% top-1 accuracy vs. 64% for embeddings on a corpus of 200 query-tool pairs, because tool descriptions are short and keyword-driven rather than semantically rich like documents.

0 favorites 0 likes
#production-lessons

What actually breaks when you ship AI agents for real service businesses (a year in)

Reddit r/AI_Agents · 2026-06-01

A year-long reflection on the hard parts of shipping AI agents for real service businesses, highlighting that infrastructure and edge cases matter more than the AI layer.

0 favorites 0 likes
#production-lessons

Most of our “agent” problems turned out to be workflow/state problems

Reddit r/AI_Agents · 2026-05-12

A developer recounts how many challenges in building AI agents actually stem from workflow and state management issues, not model intelligence, emphasizing the need for robust state handling and observability.

0 favorites 0 likes
← Back to home

Submit Feedback