out-of-context

MMOOC is a large-scale benchmark with over 41K image-question pairs that evaluates how well multimodal large language models refuse out-of-context questions while answering shifted in-context questions, revealing current models struggle to balance these abilities.