multimodal-generation

Tag

Cards List
#multimodal-generation

@FinanceYF5: What's actually the difference between what GPT-6.2 Astra and Sol produce? Someone put the two models side by side and compared them across a range of tasks — 3D scenes, games, slideshows, data visualization, websites, and interactive apps. The comparison showed both Astra's strengths in detail and precision, and Sol's highlights in motion and design…

X AI KOLs Following ↗ · yesterday Cached

Someone compared GPT-6.2 Astra and Sol across tasks including 3D scenes, games, slideshows, data visualization, websites, and interactive apps, highlighting Astra's advantages in detail and precision alongside Sol's strengths in motion design, with the cost of each run during the recording included.

0 favorites 0 likes
#multimodal-generation

Variable Length Diffuse Everything: Arbitrary Length Generative Modeling on Arbitrary State Spaces

arXiv cs.LG ↗ · 2d ago Cached

The paper proposes Variable Length Diffuse Everything (VL-DE), a general framework for variable-length multimodal generation on arbitrary state spaces using an insertion-based mechanism instead of padding, along with a higher-order sampler, demonstrating effectiveness on layout generation.

0 favorites 0 likes
#multimodal-generation

DySENSE: Dynamic Spatiotemporal ENergy Synthesis and Emulation with Satellite Imagery

Hugging Face Daily Papers ↗ · 2026-11-13 Cached

DySENSE is a joint multimodal GenAI framework that synthesizes static urban satellite imagery alongside spatially aligned, dynamic monthly building energy consumption maps, decoupling long-term urban morphology from short-term energy dynamics. Evaluated on four cities, it achieves strong downstream performance with less than 25% labeled data.

0 favorites 0 likes
#multimodal-generation

WorldCast: Exploring Intelligent Visual Generation in World State Prediction

Hugging Face Daily Papers ↗ · 2026-10-14 Cached

本文提出四层级多模态生成模型能力框架,并推出 WorldCast 基准(320 个案例、8 类任务),评测 12 个代表性模型的多步世界状态预测能力,发现前沿模型(如 GPT-Image-2.5)进展迅速,而开源模型在推理密集型视觉预测上差距明显。

0 favorites 0 likes
#multimodal-generation

Intern Lumina U2: A Multi-Codebook Diffusion Large Language Model for Omni-Visual Understanding and Image Generation

Hugging Face Daily Papers ↗ · 2026-10-14 Cached

Intern Lumina U2 is presented as the first diffusion language model using multi-codebook discrete visual tokens to unify image, video, and 3D generation with text in a single backbone, achieving leading performance and 4.45x faster image generation via stability-aware sampling.

0 favorites 0 likes
#multimodal-generation

Entropy Can Flow, or It Can Guide. Be Entropy. LEDFlow: Introducing Entropy-guided Generation Order into Uniform Discrete Flow

arXiv cs.LG ↗ · 2026-09-23 Cached

This paper introduces LEDFlow, an entropy-guided sampler for uniform discrete flow that improves generation accuracy by adaptively ordering predictions based on local entropy, with gains on reasoning, image generation, and multimodal tasks.

0 favorites 0 likes
#multimodal-generation

@radixark: SGLang-Diffusion enables fast, scalable inference for multimodal generation. The latest work with VDN-H3 brings @MiniMa…

X AI KOLs Timeline ↗ · 2026-09-14 Cached

SGLang-Diffusion with VDN-H3 from MiniMax enables fast and scalable video generation, achieving 14.4s of 768p video in just 9.0s on 8× B200 GPUs for faster-than-real-time inference.

0 favorites 0 likes
#multimodal-generation

GenFirst: Generation Before Reconstruction for Stable End-to-End Latent Generative Modeling

Hugging Face Daily Papers ↗ · 2026-08-29 Cached

GenFirst proposes a generation-before-reconstruction strategy to enable stable end-to-end training of latent generative models, avoiding latent collapse and achieving state-of-the-art results in image synthesis and multimodal generation.

0 favorites 0 likes
#multimodal-generation

G-CARL: Grounded Checklist-Aligned Reward Learning for Patient-Oriented Medical Report Interpretation

arXiv cs.CL ↗ · 2026-08-21 Cached

This paper introduces G-CARL, a grounded checklist-aligned reinforcement learning framework for patient-oriented medical report interpretation, along with the MMedReport benchmark, demonstrating improved factuality and alignment with patient needs.

0 favorites 0 likes
#multimodal-generation

SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation

Hugging Face Daily Papers ↗ · 2026-08-14 Cached

SPARGen introduces a unified multimodal framework that casts 3D reconstruction, dense correspondence, and spatial reasoning as instruction-conditioned generation tasks, enabling shared spatial representations.

0 favorites 0 likes
#multimodal-generation

Monte Carlo Tree Search for Table-to-Multimodal Report Generation

arXiv cs.AI ↗ · 2026-08-06 Cached

Introduces MCTS-Report, a Monte Carlo Tree Search framework for generating multimodal reports from tabular data, along with the MMRBench benchmark. It outperforms strong baselines across structural completeness, numerical accuracy, chart-text alignment, and insight novelty.

0 favorites 0 likes
#multimodal-generation

Vision as Unified Multimodal Generation

Hugging Face Daily Papers ↗ · 2026-07-07 Cached

This paper presents SenseNova-Vision, a unified multimodal model that formulates computer vision tasks as generation problems, achieving performance comparable to specialized systems across diverse vision tasks. It introduces a large-scale instruction-response corpus and publicly releases the model and datasets.

0 favorites 0 likes
#multimodal-generation

PairCoder++: Pair Programming as a Universal Paradigm for Verified Code-Driven Multimodal and Structured-Artifact Generation

arXiv cs.CL ↗ · 2026-07-03 Cached

PairCoder++ introduces a pair programming paradigm where a Driver agent writes code and a Navigator agent reviews it using toolchain verification, achieving significant improvements across 17 benchmarks for generating charts, scientific figures, CAD models, 3D scenes, and other structured artifacts.

0 favorites 0 likes
#multimodal-generation

Navigating User Behavior toward Personalized Multimodal Generation

arXiv cs.AI ↗ · 2026-06-24 Cached

This paper proposes NaviGen, a framework for personalized multimodal content generation that encodes user behavior into executable instructions using a dual identifier and a two-stage SFT+RL pipeline, improving personalization across product, game, and short-video domains.

0 favorites 0 likes
#multimodal-generation

TIGER: Traceable Inference with Graph-Based Evidence Routing for Mitigating Hallucinations in Multimodal Generation

arXiv cs.AI ↗ · 2026-06-02 Cached

TIGER is an inference-time framework that mitigates hallucinations in multimodal generation by extracting observation and claim graphs and assigning risk scores to repair unsupported facts. It reduces unsupported content across image-to-text, image+text-to-text, audio-to-text, and video-to-text tasks.

0 favorites 0 likes
#multimodal-generation

AlphaGRPO: Unlocking Self-Reflective Multimodal Generation in UMMs via Decompositional Verifiable Reward

Hugging Face Daily Papers ↗ · 2026-05-12 Cached

AlphaGRPO is a new framework that applies Group Relative Policy Optimization to Unified Multimodal Models, enhancing generation through self-reflective refinement and decompositional verifiable rewards.

0 favorites 0 likes
#multimodal-generation

STARFlow2: Bridging Language Models and Normalizing Flows for Unified Multimodal Generation

Hugging Face Daily Papers ↗ · 2026-05-08 Cached

STARFlow2 is a new research paper introducing an architecture that bridges language models and autoregressive normalizing flows for unified multimodal generation. It addresses structural mismatches in existing systems by using a shared causal masking mechanism for interleaved text-image sequences.

0 favorites 0 likes
#multimodal-generation

MM-WebAgent: A Hierarchical Multimodal Web Agent for Webpage Generation

Hugging Face Daily Papers ↗ · 2026-04-16 Cached

MM-WebAgent is a hierarchical agentic framework that generates coherent and visually consistent webpages by coordinating AIGC-based element generation through joint optimization of layout and multimodal content. The paper introduces a benchmark and multi-level evaluation protocol, demonstrating improvements over code-generation and agent-based baselines.

0 favorites 0 likes
← Back to home

Submit Feedback