Tag
RRS-10K is a benchmark dataset for evaluating vision-language models on rare remote sensing image interpretation, containing over 10,000 military-related images and multiple task formats. Evaluation of 52 models reveals moderate zero-shot performance and weaknesses in visual grounding and complex reasoning.
UniSE is a unified, prompt-free, autoregressive speech enhancement model based on a decoder-only language model, supporting multiple tasks like speech restoration, target speaker extraction, and speech separation in a single model.
MMAE is a comprehensive benchmark for multitask audio editing that evaluates AI's ability to precisely modify existing audio clips via natural language instructions, with current models achieving under 5% exact match rate.
MMAE is a comprehensive benchmark for instruction-based audio editing across multiple modalities and complexity levels, revealing significant gaps in current model capabilities.