multi-modal

Tag

Cards List
#multi-modal

IV-CoT: Implicit Visual Chain-of-Thought for Structure-Aware Text-to-Image Generation

Hugging Face Daily Papers ↗ · 2026-06-23 Cached

IV-CoT decomposes visual conditioning into structural and semantic cascades for improved structure-aware image generation, using training-only sketch supervision to guide structural queries. It achieves state-of-the-art results on GenEval and T2I-CompBench.

0 favorites 0 likes
#multi-modal

ChartWalker: Benchmarking the Cross-Chart RAG Task

Hugging Face Daily Papers ↗ · 2026-06-22 Cached

ChartWalker introduces a novel framework for cross-chart retrieval-augmented generation (RAG) using hierarchical knowledge graph construction and structure-aware sampling. It releases a challenging benchmark (ChartWalker-Bench) and an agentic baseline (ChartWalker-Agent), revealing significant performance gaps in current RAG paradigms.

0 favorites 0 likes
#multi-modal

@mervenoyann: day 2 findings on this pipeline > it works, got map@50=0.8028 on road sign detection against human annotations, with on…

X AI KOLs Timeline ↗ · 2026-06-17 Cached

Merve (@mervenoyann) shares day two findings of a pipeline using multiple small VLMs as judges for road sign detection, achieving map@50=0.8028 with only 1.3k examples. The thread compares model rejection rates and discusses dataset shrinking, super-specific prompts, and plans to generalize the library.

0 favorites 0 likes
#multi-modal

QoS-Aware Token Scheduling and Private Data Valuation for Multi-Modal Agentic Networks

arXiv cs.AI ↗ · 2026-06-16 Cached

This research paper proposes a framework for fair token allocation and private data valuation in decentralized multi-modal agentic systems, using differentially private prototypes to balance privacy and utility while scheduling limited edge AI resources.

0 favorites 0 likes
#multi-modal

@mishig25: Open source is so back http://hf.co/mistralai/Mistral-Medium-3.5-128B…

X AI KOLs Following ↗ · 2026-06-15 Cached

Mistral AI releases Mistral Medium 3.5, an open-source 128B dense model with 256k context, multimodal input, configurable reasoning, and agentic capabilities.

0 favorites 0 likes
#multi-modal

LLM Gateway Chat

Product Hunt ↗ · 2026-06-15

LLM Gateway Chat is a platform that provides access to multiple AI models for chat, image, video, and audio generation.

0 favorites 0 likes
#multi-modal

PermaVid: Consistent Video Generation Across Edits via Disentangled Context Memory

Hugging Face Daily Papers ↗ · 2026-06-15 Cached

PermaVid introduces a multi-modal context memory that disentangles appearance and geometric structure to maintain long-term video consistency after editing operations, outperforming prior methods.

0 favorites 0 likes
#multi-modal

@PyTorch: In this clip from his PyTorch Conference Europe 2026 keynote, Patrick von Platen (@MistralAI) discusses why real-world …

X AI KOLs Following ↗ · 2026-06-12 Cached

At PyTorch Conference Europe 2026, Mistral AI's Patrick von Platen explains why real-world AI interaction requires streaming architectures that process continuous input and produce continuous output, using Vox Real Time as a live transcription example.

0 favorites 0 likes
#multi-modal

Multi-Modal Agents for Power Distribution Defect Detection: An Evaluation of Foundation Models

arXiv cs.AI ↗ · 2026-06-12 Cached

This paper introduces a Multi-Modal Agent framework for power distribution defect detection, evaluating foundation models on perception, reasoning, and tool usage capabilities, with a new domain-specific dataset and benchmark.

0 favorites 0 likes
#multi-modal

ProcessThinker: Enhancing Multi-modal Large Language Models Reasoning via Rollout-based Process Reward

arXiv cs.CL ↗ · 2026-06-11 Cached

ProcessThinker introduces a practical post-training pipeline that provides step-level process rewards without training an explicit process reward model. It uses rollout-based rewards to give dense credit assignment for multi-step reasoning in multimodal LLMs, consistently improving performance on video benchmarks.

0 favorites 0 likes
#multi-modal

Detecting AI-Generated Content on Social Media with Multi-modal Language Models

arXiv cs.CL ↗ · 2026-06-11 Cached

This paper from Meta and Carnegie Mellon presents a multi-modal vision-language model pipeline for detecting AI-generated content on social media, achieving state-of-the-art performance and positive downstream impacts on user engagement.

0 favorites 0 likes
#multi-modal

A Unified Multi-Modal Framework for Intelligent Financial Systems: Integrating Reinforcement Learning, High-Frequency Trading, and Game-Theoretic Approaches with Cross-Modal Sentiment Analysis

arXiv cs.AI ↗ · 2026-06-10 Cached

This paper presents a unified multi-modal framework integrating reinforcement learning, high-frequency trading, game-theoretic approaches, and cross-modal sentiment analysis for intelligent financial systems, claiming significant improvements over single-domain systems.

0 favorites 0 likes
#multi-modal

A Multi-modal Agentic Co-pilot for Evidence Grounded Computational Pathology

arXiv cs.AI ↗ · 2026-06-09 Cached

PathPocket is a multimodal AI agentic co-pilot for evidence-grounded pathology, utilizing a comprehensive evidence corpus and hypergraph to outperform existing state-of-the-art methods on over 200,000 real-world cases.

0 favorites 0 likes
#multi-modal

Zero-Shot Learning in Industrial Scenarios: New Large-Scale Benchmark, Challenges and Baseline

arXiv cs.AI ↗ · 2026-06-09 Cached

This paper proposes a large-scale multi-modal dataset (MMIO) for zero-shot industrial defect detection and introduces the Refined Text-Visual Prompt (RTVP) method, achieving state-of-the-art results on the benchmark.

0 favorites 0 likes
#multi-modal

Unification of Closed-Open Industrial Detection Scenarios: New Large-Scale Benchmarks,Challenges and Baselines

arXiv cs.AI ↗ · 2026-06-09 Cached

Introduces MMIOC-1M, a large-scale multi-modal benchmark for industrial defect detection, and proposes RTVPNet, a refined text-visual prompt network achieving state-of-the-art performance.

0 favorites 0 likes
#multi-modal

PathoSage: Towards Multi-Source Evidence Adjudication in Pathology via Experience-Aware Agentic Workflow

arXiv cs.AI ↗ · 2026-06-09 Cached

PathoSage introduces a three-stage framework for pathology multimodal reasoning that separates knowledge retrieval, evidence collection, and evidence adjudication to reduce hallucinations and handle conflicting evidence, featuring a training-free Beta-Bernoulli experience system for modeling tool reliability.

0 favorites 0 likes
#multi-modal

Az8 Studio: The closest thing we have to a multi-modal "Agentic" canvas for video pipelines? (First impressions)

Reddit r/AI_Agents ↗ · 2026-06-08

Az8 Studio is an infinite canvas with interconnected nodes for multi-modal AI video pipelines, enabling contextual memory across nodes, parallel multi-model orchestration, and persistent asset-to-agent workflows. It represents a shift from linear AI tools to spatial agentic environments.

0 favorites 0 likes
#multi-modal

Federated Foundation Models over Vehicular Networks

arXiv cs.LG ↗ · 2026-06-08 Cached

This paper presents a vision for integrating multi-modal multi-task federated foundation models (M3T FedFMs) into vehicular networks, discussing training principles, use cases, challenges, and a case study on the Waymo Open Dataset.

0 favorites 0 likes
#multi-modal

@hasantoxr: Google built NotebookLM. Now a developer built a better version that turn your own files into a private AI research ass…

X AI KOLs Timeline ↗ · 2026-06-07 Cached

Open Notebook is an open-source, privacy-focused alternative to Google's NotebookLM that runs locally and supports multiple AI models for research assistance.

0 favorites 0 likes
#multi-modal

OmniCap-IF: Benchmarking and Improving Instruction Following Abilities for Omni-Video Captioning

Hugging Face Daily Papers ↗ · 2026-06-07 Cached

Introduces OmniCap-IF, the first comprehensive benchmark for evaluating instruction-following in omni-modal video captioning, revealing a format-content tradeoff and proposing improved models and datasets.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback