Tag
IV-CoT decomposes visual conditioning into structural and semantic cascades for improved structure-aware image generation, using training-only sketch supervision to guide structural queries. It achieves state-of-the-art results on GenEval and T2I-CompBench.
ChartWalker introduces a novel framework for cross-chart retrieval-augmented generation (RAG) using hierarchical knowledge graph construction and structure-aware sampling. It releases a challenging benchmark (ChartWalker-Bench) and an agentic baseline (ChartWalker-Agent), revealing significant performance gaps in current RAG paradigms.
Merve (@mervenoyann) shares day two findings of a pipeline using multiple small VLMs as judges for road sign detection, achieving map@50=0.8028 with only 1.3k examples. The thread compares model rejection rates and discusses dataset shrinking, super-specific prompts, and plans to generalize the library.
This research paper proposes a framework for fair token allocation and private data valuation in decentralized multi-modal agentic systems, using differentially private prototypes to balance privacy and utility while scheduling limited edge AI resources.
Mistral AI releases Mistral Medium 3.5, an open-source 128B dense model with 256k context, multimodal input, configurable reasoning, and agentic capabilities.
LLM Gateway Chat is a platform that provides access to multiple AI models for chat, image, video, and audio generation.
PermaVid introduces a multi-modal context memory that disentangles appearance and geometric structure to maintain long-term video consistency after editing operations, outperforming prior methods.
At PyTorch Conference Europe 2026, Mistral AI's Patrick von Platen explains why real-world AI interaction requires streaming architectures that process continuous input and produce continuous output, using Vox Real Time as a live transcription example.
This paper introduces a Multi-Modal Agent framework for power distribution defect detection, evaluating foundation models on perception, reasoning, and tool usage capabilities, with a new domain-specific dataset and benchmark.
ProcessThinker introduces a practical post-training pipeline that provides step-level process rewards without training an explicit process reward model. It uses rollout-based rewards to give dense credit assignment for multi-step reasoning in multimodal LLMs, consistently improving performance on video benchmarks.
This paper from Meta and Carnegie Mellon presents a multi-modal vision-language model pipeline for detecting AI-generated content on social media, achieving state-of-the-art performance and positive downstream impacts on user engagement.
This paper presents a unified multi-modal framework integrating reinforcement learning, high-frequency trading, game-theoretic approaches, and cross-modal sentiment analysis for intelligent financial systems, claiming significant improvements over single-domain systems.
PathPocket is a multimodal AI agentic co-pilot for evidence-grounded pathology, utilizing a comprehensive evidence corpus and hypergraph to outperform existing state-of-the-art methods on over 200,000 real-world cases.
This paper proposes a large-scale multi-modal dataset (MMIO) for zero-shot industrial defect detection and introduces the Refined Text-Visual Prompt (RTVP) method, achieving state-of-the-art results on the benchmark.
Introduces MMIOC-1M, a large-scale multi-modal benchmark for industrial defect detection, and proposes RTVPNet, a refined text-visual prompt network achieving state-of-the-art performance.
PathoSage introduces a three-stage framework for pathology multimodal reasoning that separates knowledge retrieval, evidence collection, and evidence adjudication to reduce hallucinations and handle conflicting evidence, featuring a training-free Beta-Bernoulli experience system for modeling tool reliability.
Az8 Studio is an infinite canvas with interconnected nodes for multi-modal AI video pipelines, enabling contextual memory across nodes, parallel multi-model orchestration, and persistent asset-to-agent workflows. It represents a shift from linear AI tools to spatial agentic environments.
This paper presents a vision for integrating multi-modal multi-task federated foundation models (M3T FedFMs) into vehicular networks, discussing training principles, use cases, challenges, and a case study on the Waymo Open Dataset.
Open Notebook is an open-source, privacy-focused alternative to Google's NotebookLM that runs locally and supports multiple AI models for research assistance.
Introduces OmniCap-IF, the first comprehensive benchmark for evaluating instruction-following in omni-modal video captioning, revealing a format-content tradeoff and proposing improved models and datasets.