multi-modal

Tag

Cards List
#multi-modal

MULTI3IR: A Benchmark for Multi-perspective Multi-domain Multi-modal Information Retrieval

Hugging Face Daily Papers ↗ · 2026-08-31 Cached

The paper introduces Multi3IR, a benchmark for multi-perspective, multi-domain, multi-modal information retrieval, and proposes SPIN, a method to improve perspective coverage in retrieval systems.

0 favorites 0 likes
#multi-modal

DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection

Hugging Face Daily Papers ↗ · 2026-08-31 Cached

DICS introduces a self-scoring metric for visual instruction data selection that enhances vision-language model performance with significantly less data by ensuring intra-sample consistency, outperforming state-of-the-art methods.

0 favorites 0 likes
#multi-modal

Poly-InstructTTS: Learning In-the-Wild Expressive Speech Synthesis from Open-Ended Instructions

arXiv cs.CL ↗ · 2026-08-24 Cached

Poly-InstructTTS is a text-to-speech system that learns expressive speech from open-ended natural language instructions using a large-scale multi-modal dataset, improving instruction adherence and expressiveness in TTS models.

0 favorites 0 likes
#multi-modal

@DevAdventur3s: Ox Alpha = Gemini 4.0 has anyone tried it on @opencode or @OpenRouter ?

X AI KOLs Timeline ↗ · 2026-08-22 Cached

The tweet announces that Ox Alpha, equivalent to Gemini 4.0, is available for free on OpenCode for a week, featuring 1M context, multi-modal capabilities, and zero data retention.

0 favorites 0 likes
#multi-modal

A stealth model called Ox-Alpha has been released, outperforming Fable on SWE.

Reddit r/singularity ↗ · 2026-08-21 Cached

A stealth AI model named Ox-Alpha has been released, reportedly outperforming Fable on SWE benchmarks, and is available for free with features like multi-modal support and zero data retention.

0 favorites 0 likes
#multi-modal

@thegenioo: Why the fuck is this stealth model so good at frontend?

X AI KOLs Timeline ↗ · 2026-08-20 Cached

OpenRouter has released a new stealth AI model named Ox Alpha, optimized for efficient coding and agentic tasks with a 1M token context window and support for text, image, and video inputs.

0 favorites 0 likes
#multi-modal

Diagnosing and Mitigating Perception-Decision Misalignment in Omni-LLMs via Modality Subspace Activation

arXiv cs.LG ↗ · 2026-08-18 Cached

This paper diagnoses perceptual-decision misalignment in Omni-LLMs and proposes a training-free inference-time framework called Modality Subspace Activation to mitigate it by dynamically balancing modality strengths.

0 favorites 0 likes
#multi-modal

Multi-Modal Generative Fuzzy System: Fuzzy Inference Guided Large Model Interactive Question Answering Framework

arXiv cs.CL ↗ · 2026-08-18 Cached

This paper proposes a Multi-Modal Generative Fuzzy System (MMGFS) to enhance multimodal question answering by addressing modality bias and uncertainty through fuzzy inference and multi-hop reasoning, demonstrating improved performance on multiple benchmarks.

0 favorites 0 likes
#multi-modal

MAG: MAnifold Guided Semi-Supervised Multi-modal In-Context Learning

arXiv cs.LG ↗ · 2026-08-14 Cached

This paper introduces MAG, a manifold-guided framework for semi-supervised multi-modal in-context demonstration selection, leveraging unlabeled data to improve few-shot ICL for MLLMs. Experiments on eight benchmarks show consistent gains in label-scarce regimes.

0 favorites 0 likes
#multi-modal

@AdinaYakup: More players are joining the open source summer RedNote just released dots3-note preview The first open weight model in…

X AI KOLs Following ↗ · 2026-08-14 Cached

RedNote has released dots3-note preview, the first open-weight model in the dots3 family, featuring 280B parameters with 16B active, multi-modal understanding (text, image, video, audio), 512K context length, and Apache 2.0 license, with strong agent capabilities.

0 favorites 0 likes
#multi-modal

Evolving Safety Landscape of Multi-modal Large Language Models: A Survey of Emerging Threats and Safeguards

arXiv cs.LG ↗ · 2026-08-11 Cached

A survey paper systematically analyzing the evolving safety landscape of multi-modal large language models, covering emerging threats such as adversarial attacks, data poisoning, jailbreaks, and hallucinations, and reviewing updated safety strategies.

0 favorites 0 likes
#multi-modal

GEOID-Flood: A Large-Scale Multi-Modal Benchmark Dataset for Flood Segmentation

Hugging Face Daily Papers ↗ · 2026-08-03 Cached

Introduces GEOID-Flood, a large-scale multi-modal benchmark dataset for flood segmentation with over 14,000 tiles from 219 events across 65 countries, evaluating foundation models against conventional encoders across single-image, multi-temporal, and multi-modal protocols.

0 favorites 0 likes
#multi-modal

@tom_doerr: VideoAgent is an all-in-one open-source framework for comprehensive video intelligence, combining understanding, editin…

X AI KOLs Timeline ↗ · 2026-08-02 Cached

VideoAgent is an all-in-one open-source framework for comprehensive video intelligence, combining understanding, editing, and creative generation through a unified agentic workflow.

0 favorites 0 likes
#multi-modal

Show HN: Local text, image, video, music and 3D from one CLI, no Python

Hacker News Top ↗ · 2026-07-30 Cached

mere.run is a local-first inference runtime for Apple Silicon and headless Linux that provides a single CLI for text, image, video, music, 3D, and more without requiring Python.

0 favorites 0 likes
#multi-modal

Where Detectors Fail: Closing the Tail-Domain Gap with Expert-Guided Mutual Distillation

arXiv cs.CL ↗ · 2026-07-30 Cached

This paper proposes Expert-Guided Mutual Distillation (EGMD) to address domain bias and semantic misalignment in multimodal fake news detection, achieving state-of-the-art accuracy and reducing domain bias by up to 57.3% across four datasets.

0 favorites 0 likes
#multi-modal

Explorative Modeling: Unlocking a Third Pretraining Axis and End-to-End Generation

Hugging Face Daily Papers ↗ · 2026-07-29 Cached

This paper introduces Explorative Modeling, a new generative modeling paradigm that factors the training loop by exploring candidate matches between model generations and data. It establishes a third pretraining axis beyond parameters and data, improves scaling efficiency across images, video, and language, and enables end-to-end generative modeling with far fewer inference steps.

0 favorites 0 likes
#multi-modal

StatePlay: State-Aware Game World Models for Mechanics-Consistent Generation

Hugging Face Daily Papers ↗ · 2026-07-29 Cached

StatePlay proposes a state-aware game world model that jointly predicts visual content and game states to generate mechanics-consistent game rollouts, achieving 18.6% improvement in mechanics fidelity.

0 favorites 0 likes
#multi-modal

VlogReward: Learning Multi-Dimensional Evaluation for Vlog Editing

arXiv cs.AI ↗ · 2026-07-28 Cached

Introduces VlogReward, a reward model for evaluating vlog editing plans across six dimensions, along with a large-scale dataset and benchmark, achieving state-of-the-art results against GPT-5 and Gemini-3-Pro.

0 favorites 0 likes
#multi-modal

GLI-AL: A Multi-Modal Glioma MRI Label Resource with Unified Anatomy-Lesion Labels

Hugging Face Daily Papers ↗ · 2026-07-27 Cached

GLI-AL is a new label resource for glioma MRI that unifies anatomy and lesion labels, expanding supervision to include healthy tissues and previously unlabeled abnormalities. It provides 1,251 label sets aligned with BraTS-GLI cases.

0 favorites 0 likes
#multi-modal

Bitcoin Price Direction Prediction via Regime-Aware Multi-Modal Fusion of Social Sentiment and Technical Features

Hugging Face Daily Papers ↗ · 2026-07-25 Cached

The paper proposes a Regime-Aware Multi-Modal Learning (RAML) method for Bitcoin price direction prediction that adaptively fuses social sentiment and technical features based on market volatility. Evaluated on hourly data from July 2024 to September 2025, RAML achieves moderate improvements over static fusion baselines.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback