A $40M model is being sold on calibrated confidence, and no calibration data has been published

TypeSafe AI came out of stealth on September 15 with $40M led by DCVC, reportedly at a $200M valuation, founded by Diogo Almeida, an ex-OpenAI researcher who worked on InstructGPT, ChatGPT and GPT-4. Their model, Jev, does not generate text. It takes program state plus typed questions and returns typed answers with a probability on each. The framing is Kahneman's System One: fast intuitive judgment rather than deliberation. The product claim is that those probabilities are calibrated, meaning 70% should be right about 70% of the time. TypeSafe calls the training method Reinforcement Learning for Calibrated Decisions. Here is what bothers me about the coverage so far. Calibration is the whole product and there is no public measurement of it No expected calibration error. No reliability diagrams. No results on any standard public benchmark. No architecture paper. For a company whose pitch is fixing AI overconfidence, the overconfidence-fixing property is the one thing with nothing published behind it. What has been published is a company-designed eval over four workflow tasks where the correct answer is defined as the average of GPT-6 Astra and Claude Fable 5.1 at high thinking. That measures agreement with two competitor models, not correctness. A model could match the reference on every case and be wrong on every case. Competing models in the same harness run at default reasoning settings, so the 193.6x speed and 444.6x cost multipliers are measured against reasoning-off configurations while the accuracy target comes from reasoning-on ones. "Cannot hallucinate" is true in a narrow sense The output space is fixed before decoding, so it cannot emit an option that is not on the list. That eliminates fabricated output. It does not make the chosen option correct. The Register made the same point: absence of hallucination does not preclude being incorrect. Constrained decoding is also not new, OpenAI has guaranteed JSON Schema conformance since August 2024. Where I think the skepticism should stop The adoption number is third-party and it is striking. Vercel reported Jev as the fastest-adopted model in AI Gateway history: a tenth of paid teams within 18 hours, nearly 13% by hour 24, roughly six times Fable 5.1's first-day share. And TypeSafe's own documentation is unusually honest. It publishes a model jaggedness page stating that Jev does not count reliably, underperforms on hex and RGB values, cannot judge whether two values are near each other, and reads dates as text. It also states there is no guaranteed mathematical relationship between semantically related outputs, so the probability of a statement and its negation need not sum to 1. That is a genuinely awkward admission to sit next to a calibration pitch, and they published it anyway. So: real product, real adoption, and a headline property nobody outside the company has measured. What would you want to see before trusting the confidence numbers in production?