IndustryBench-MIPU: Benchmarking Multi-Image Attribute Value Extraction for Industrial Products

Hugging Face Daily Papers Papers

Summary

IndustryBench-MIPU is a large-scale benchmark for multi-image industrial product understanding, evaluating 9 MLLMs and revealing a completeness gap where precision is high but attribute recovery is low.

Industrial products such as valves and circuit breakers are defined by dense technical specifications that govern procurement, compatibility, and safety across supply chains. These specifications are scattered across multiple heterogeneous product images, including specification tables, nameplates, and technical drawings, yet whether Multimodal Large Language Models (MLLMs) can reliably recover them remains underexplored. To fill this gap, we introduce IndustryBench-MIPU, the first large-scale benchmark for multi-image industrial product understanding, built around structured attribute extraction -- recovering property-value pairs from product images. This task jointly probes text recognition on specification tables and nameplates, visual reasoning over technical drawings, domain knowledge to decode industrial terminology, and cross-image evidence integration to assemble scattered specifications. Concretely, the benchmark comprises 4,559 products across 27,652 images with 103,703 annotations spanning 18 industrial categories, constructed through multi-model consensus and three-tier quality assurance. Evaluating nine MLLMs under both single-image and product-level multi-image settings reveals a stark completeness gap: models achieve high precision (86--94%) but the best recovers only 49.9% of product-level attributes; moving from single-image to multi-image extraction costs 15--34 percentage points of recall. Multi-image completeness, not single-image accuracy, is the core bottleneck. Dataset and code are publicly available.
Original Article
View Cached Full Text

Cached at: 06/18/26, 03:55 AM

Paper page - IndustryBench-MIPU: Benchmarking Multi-Image Attribute Value Extraction for Industrial Products

Source: https://huggingface.co/papers/2606.14383 Hi everyone! We are excited to share our team’s latest work from Alibaba:IndustryBench-MIPU.

While MLLMs are increasingly deployed for general visual tasks, understanding complex industrial products requires assembling dense technical specifications scattered across multiple heterogeneous images, including specification tables, nameplates, and technical drawings. To bridge this gap, we built the first large-scale benchmark for multi-image industrial product understanding.

Key Highlights of our Benchmark:

**Massive Scale:**4,559 products across 27,652 images with 103,703 annotations spanning 18 industrial categories.

**Complex Challenges:**The task requires models to jointly perform text recognition, visual reasoning over technical drawings, domain knowledge interpretation, and cross-image evidence integration.

**Core Findings:**We evaluated 9 MLLMs and uncovered a stark completeness gap. While current models achieve high precision (86-94%), the absolute best model recovers only 49.9% of product-level attributes.

Our evaluation proves that multi-image completeness, rather than single-image accuracy, is the true bottleneck for real-world industrial AI. As we continue to push the boundaries of multimodal and industrial intelligence, we hope this dataset and benchmark serve as a valuable testbed for the community.

We would love to hear your thoughts, feedback, and see how your models perform!

**Paper:**arxiv.org/abs/2606.14383

**Dataset:**huggingface.co/datasets/alibaba-multimodal-industrial-ai/IndustryBench-MIPU

Code:github.com/alibaba-multimodal-industrial-ai/IndustryBench-MIPU

Similar Articles

IMCBench: A benchmark for multimodal LLMs in Image-grounded Medical Conversations

arXiv cs.AI

IMCBench is a new benchmark for evaluating multimodal LLMs on image-grounded medical conversations, pairing clinical images with synthetic patient profiles. Evaluations across safety, accuracy, and uncertainty show that even strong models like Claude Opus 4.6 have safety issues, highlighting the need for multi-dimensional evaluation.