occupation-knowledge

ORQA is a framework for generating occupation-realistic question-answer pairs from trusted sources to evaluate LLMs' professional knowledge, covering 116 occupations and testing 15 models, with top performers like Claude Opus 4.6 and GPT-5.4 achieving around 58-62% accuracy.