I thought we had a product problem. Seems like we had a trust problem.

For 2 months earlier this year I kept improving an AI feature that one of my most active customers refused to touch. (Three rounds of upgrades) I swapped the model, rewrote the prompts and the outputs got visibly better. The usage graph didn't have the decency to even wobble and I took it personally. Well I was halfway into planning round 4 when I finally did the thing I should have done first and got on a call to watch her work. She ran the feature, got her 40 outputs in about 30 second and then re checked every one of them by hand. It saved her half a minute of doing and charged her 20 minutes of checking and she stopped opening it. That was indeed a right call and tbh i would have stopped sooner. My accuracy upgrades had changed nothing for her either because 96 good outputs out of 100 still means checking all 100 when you cant tell WHICH 4 went wrong. She didn't need the outputs to be better rather she needed to know which ones to check. I have spent 8 years building products and the "we" in that title is me and a model. That's the entire org chart. My first fix was wrong one tho... I made the model explain itself. Every output now arrived with a tidy paragraph of reasoning and usage stayed at zero. It makes sense once you say it out loud becoz an explanation is more words from the same source you already don't trust. The suspect writing his own police report. Yk this from your own tools anyway... you run the AI thing and quietly redo the work and no reasoning paragraph has ever talked you out of it. The fix that actually worked never touched the model. Every output got a link to the exact source row it came from and the feature started flagging the 3 or 4 outputs per batch it was least sure about (so now she checks 4 things instead of 40). The daily usage went from zero to daily inside 2 weeks and the trust once it showed up was mostly trust in her own ability to catch the thing lying. So I'm done treating trust as a feeling my product has to earn. Its a cost...her checking time basically and my job is to lower it.