Tag
Matt Pocock shares a heuristic for splitting programming tasks into tickets, estimating token cost and dividing by 150k to determine ticket count.
Marcos Hernanz shares his full AGENTS.md file after processing roughly 60 billion tokens, providing a reference for AI agent configuration.
A developer introduces TMDD/TTMDD, a pattern where code measures its own time and tokens to distinguish a working AI agent from a hung one.
This paper compares subword tokens, raw bytes, and rendered pixels as text encodings for language models under controlled linguistic content across 13 languages. It traces rate–utility frontiers and finds that no encoding dominates across tasks, with pixels preserving surface form best, bytes preserving cross-lingual alignment best, and tokens supporting topic prediction best.
Comparison of AI search APIs SERPdive and Tavily, showing SERPdive wins ~60% of comparisons with 20% fewer tokens and similar latency.
A follow-up project visualizing GPT-2's 32,070 tokens as an interactive hyperbolic tree in a Poincaré ball, allowing users to fly through the embedding space.
The author shares that short prompts work better when building Agents, emphasizing the need to clarify results, constraints, and autonomy, which reduces token consumption and rework costs.
Andrew Chen observes that agentic coding tools use a subscription model with a gas pedal, charging for tokens as usage increases.
A Twitter thread explaining seven essential AI terms (LLM, tokens, etc.) for creators and founders, aiming to provide practical vocabulary for 2026.
This article explains why AI tokens are expensive: the autoregressive generation process requires predicting token by token and repeatedly computing the entire context, causing computational cost to grow linearly with context length; coding agents, due to multi-turn interactions and file reads, quickly accumulate very long contexts, further increasing token costs.
Palantir CEO Alex Karp questions the security and value of prompts, suggesting that if prompts were so valuable, the provider would demand a share of profits rather than charging per token.
Danshipper announces Fable, a personal iOS app that leverages large token counts for clearing bug backlogs and responding to messages.
The article discusses the problem of authentication token theft by infostealer malware and explores a 15-year-old proposal by Dirk Balfanz to use self-signed client certificates for TLS mutual authentication to bind tokens to a specific device, preventing token reuse even if stolen.
Google has significantly increased the free tier limit of the Gemini API on Google AI Studio to 1,000,000 free tokens per minute, with no thresholds or restrictions, providing developers with massive free computing resources.
Matt Pocock comments on the phenomenon of 'token anxiety,' where developers worry too much about the cost of AI tokens instead of focusing on the value delivered per token, likening current pricing to below-minimum-wage rates for development.
An essay arguing that the AI ecosystem is undergoing modularization similar to the PC revolution, with standardized interfaces like transformers, inference APIs, and agentic harnesses enabling specialization and rapid innovation, and that open-weights models are a direct economic consequence.
Google is offering developers up to 1M tokens per minute for free on Gemini 2.5 Flash and Pro via Google AI Studio, with no credit card required, enabling easy experimentation.
A discussion about Grok handling nearly 8 million tokens over a year in a single chat, showcasing impressive long-context capabilities.
Sam Altman hints at working on a subscription model that is not quite all-you-can-eat tokens but moving in that direction.
Introduces an open-source project that aggregates free quotas (totaling about 1.7 billion tokens per month) from 16 LLM providers for unified usage, and mentions Google AI Studio's free API tier, aiming to help developers save costs.