preprocessing

Tag

Cards List
#preprocessing

Hermes got expensive when I let every profile think like a senior engineer.

Reddit r/AI_Agents · 2026-05-19

The author shares how running multiple persistent AI agent profiles under Hermes led to high API costs, solved by implementing tiered model policies per profile, pre-processing inputs, and using an API gateway for cost visibility, reducing daily costs from $14-18 to $7-10.

0 favorites 0 likes
#preprocessing

A Triadic Suffix Tokenization Scheme for Numerical Reasoning

arXiv cs.CL · 2026-04-20 Cached

This paper introduces Triadic Suffix Tokenization (TST), a deterministic tokenization scheme that partitions digits into three-digit triads with explicit magnitude markers to improve numerical reasoning in large language models. The method addresses inconsistent number fragmentation in standard tokenizers by providing transparent order-of-magnitude relationships at the token level, with two implementation variants offering scalable vocabulary expansion.

0 favorites 0 likes
← Back to home

Submit Feedback