QG-MIL: A Gated Transformer Aggregator for Domain-Agnostic Multiple Instance Learning in Medical Imaging
Summary
This paper introduces QG-MIL, a gated transformer aggregator that mitigates attention concentration in multiple instance learning for medical imaging, achieving domain-agnostic performance without auxiliary losses.
View Cached Full Text
Cached at: 06/24/26, 09:47 AM
Paper page - QG-MIL: A Gated Transformer Aggregator for Domain-Agnostic Multiple Instance Learning in Medical Imaging
Source: https://huggingface.co/papers/2606.20027 Hi everyone, thanks for checking out our paper!
In QG-MIL, we study the attention concentration problem in medical Multiple Instance Learning, where attention-based aggregators can collapse onto a small subset of instances and produce unstable or overconfident predictions.
Our goal was to design a simple drop-in MIL aggregator that mitigates this behavior architecturally, without auxiliary losses, masking strategies, or multi-stage training. QG-MIL combines RMSNorm pre-normalization, per-head QK normalization, attention-output gating, and SwiGLU-style feed-forward layers, and we evaluate it across pathology and hematology benchmarks with different bag sizes and feature extractors.
Happy to discuss the method, limitations, ablations, or possible extensions!
Similar Articles
Learning from Lost Provenance: Multiple Instance Learning for Cancer Registry Tumor Group Classification
This paper presents an Attention-Based Multiple Instance Learning (ABMIL) framework that leverages patient-level labels from cancer registries to train deep learning classifiers for tumor group classification without requiring per-report annotations, achieving a macro F1 of 0.83 on tasks at the BC Cancer Registry.
MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion
Proposes M2GDT, a novel MKGC framework that uses an MLLM-guided diffusion transformer with relation-adaptive mixture-of-experts to align and denoise multimodal features, outperforming baselines on three benchmark datasets.
GQA-{\mu}P: The maximal parameterization update for grouped query attention
This paper extends the maximal update parameterization (μP) framework to grouped-query attention (GQA), deriving scaling laws for hyperparameter transfer across model architectures. It introduces spectral norm conditions for feature learning and addresses issues with low-rank weight matrices in GQA.
GQLA: Group-Query Latent Attention for Hardware-Adaptive Large Language Model Decoding
GQLA proposes a minimal modification to Multi-head Latent Attention (MLA) that exposes both an MQA-absorb path and a GQA path over the same trained weights, enabling hardware-adaptive decoding without retraining. The method compresses KV cache and supports tensor parallelism, demonstrated by converting LLaMA-3-8B from GQA to GQLA.
An A.I. Aggregator?
A user shares their experience using ChatGPT for complex medical caregiving and proposes the idea of aggregating multiple AI models to improve reliability by seeking consensus among different LLMs.