Tag
Introduces DrawingVQA, the first benchmark for evaluating multimodal large language models on real-world construction drawings, with 33 drawings and 92 QA pairs across three reasoning depths, revealing a gap between model and expert performance.
Harvey, a generative AI platform for legal professionals, partnered with OpenAI to create a custom-trained case law model that reduces hallucinations and improves reasoning for complex legal tasks like document drafting and contract analysis. The custom model, trained on 10 billion tokens of U.S. case law, achieved 97% lawyer preference over standard foundation models.