How do you do OOD detection on a closed LLM API with no latent access?

Reddit r/artificial News
ood-detection closed-llm-api hallucination sampling-consistency token-entropy proxy-embeddings

Summary

Discusses methods for out-of-distribution detection on closed LLM APIs without latent access, highlighting techniques like SelfCheckGPT, token-level entropy, proxy embeddings, and verifier models, and notes the collapse of OOD and hallucination detection.

Classical OOD detection assumes you can see the model. Mahalanobis on features and energy on logits are typical, and both require cracking the model open. With closed LLM APIs you get text in, text out, and maybe top K logprobs per token if you are lucky. The methods that survive that constraint are sampling consistency like SelfCheckGPT, token level entropy on whatever logprobs the API exposes, proxy embeddings from your own encoder, or a separate verifier model on the output. What is bothering me is that classical OOD and hallucination detection collapse into the same problem in that setting, because both manifest as the model producing unreliable text. If you are running closed LLMs in production right now, what is your actual OOD signal and how do you decide when to trust the output.
Original Article

Similar Articles

Hallucination Detection via Activations of Open-Weight Proxy Analyzers

arXiv cs.CL

This paper introduces a proxy-analyzer framework that detects hallucinations in large language models by analyzing internal activations of small, open-weight models rather than the generator itself. The method achieves superior performance on benchmarks like RAGTruth compared to existing methods like ReDeEP, demonstrating that model size is less critical than the analysis approach.