Tag
Eidon AI, a startup that shut down, open-sourced 1,274 hours of egocentric robotics data with 13,451 recordings, making it freely available under a CC-BY-4.0 license for the robotics community.
OpenBMB releases UltraData-SFT-Agent-2609, a dataset of 500,000 samples for agent instruction-tuning, used in the post-training of the MiniCPM5-2B model.
This paper introduces a novel framework for evaluating second-order social norm reasoning in large language models, releases the NormReact dataset, and reveals that current LLMs overpredict punitive social sanctions compared to human judgments.
This paper introduces a joint argument and entity detection method for political debates, using a generative framework with decoder-only LLMs to improve performance over sequential pipelines.
VidaForge is an open research infrastructure that models video data recipes as executable workflows to study their impact on video foundation model pretraining, releasing a dataset of 3.14 million scene-level clips for research.
This paper introduces WinoQueer-NL, a Dutch dataset for evaluating bias in language models toward LGBTQ+ identities, and finds significant disparities in model outputs, particularly favoring stereotypes for transgender and non-binary identities.
The paper introduces OBJECTION, an inference-time pipeline using adversarial lawyer agents to mitigate guilty bias in legal judgment prediction models, demonstrating a significant reduction in false guilty rates and releasing a new 'Natural Innocent' dataset.
Sesame releases TurnBench, a benchmark for evaluating real-time conversational turn-taking, with a leaderboard and labeled dataset to assess model performance in detecting speech events.
This paper introduces MTDiag, a multi-turn diagnostic dialogue dataset for evaluating Large Language Models in realistic clinical diagnostic scenarios, addressing limitations of static QA benchmarks.
This paper introduces Strategic 16K, a leakage-controlled dataset for document sensitivity classification, and benchmarks classical and transformer-based models, with BERT achieving top performance while addressing label leakage issues.
SupraLabs releases reasoning-corpus-4K-5M-v1, a 5M-sample reasoning dataset for training small language models (SLMs), featuring chain-of-thought traces and ChatML format, hosted on Hugging Face.
Researchers introduce a new multimodal benchmark derived from Japan's National Assessment of Academic Ability, featuring 900K aggregated student responses to evaluate MLLM performance in authentic K-12 educational contexts.
This paper introduces Checkup2Action, a multimodal dataset and benchmark for generating patient-oriented action cards from clinical check-up reports, addressing the interpretability gap for laypersons.
PianoCoRe is a large-scale piano MIDI dataset unifying and refining open-source corpora with 250,046 performances of 5,625 pieces by 483 composers, featuring note-level alignments for music information retrieval and including a MIDI quality classifier and alignment refinement pipeline.