video-diffusion

Tag

Cards List
#video-diffusion

Beyond Pixels: From Video Priors to 4D Worlds

Hugging Face Daily Papers ↗ · 2026-08-11 Cached

This paper introduces Latent-to-4D, a method for direct 4D scene generation from video diffusion latents without retraining across generators, achieving better geometry and temporal stability than cascaded approaches.

0 favorites 0 likes
#video-diffusion

MirrorWorld: Taming Video Diffusion Models for Mirror Reflection Generation

Hugging Face Daily Papers ↗ · 2026-08-07 Cached

MirrorWorld is a reflection-aware video inpainting framework that improves mirror reflection generation in videos by separately modeling semantic content (SRD) and geometric spatial arrangements (GTA), achieving better reflection reconstruction than existing image-based and video inpainting baselines.

0 favorites 0 likes
#video-diffusion

UniWorld-View: Large-Baseline View Synthesis via Video Diffusion Models

Hugging Face Daily Papers ↗ · 2026-08-05 Cached

Introduces UniWorld-View, a unified framework for large-baseline novel view synthesis from monocular inputs, integrating occlusion-aware point cloud rendering with video diffusion models for precise camera control and geometric consistency.

0 favorites 0 likes
#video-diffusion

TenStrip/10Eros-Max

Hugging Face Models Trending ↗ · 2026-08-04 Cached

TenStrip/10Eros-Max is an experimental AI model that modifies the MiniMax H3 base model by transferring learned patterns from LTX 2.3, Wan 2.2, and Krea 2 video and image diffusion models using orthogonal projection, enhancing aesthetic and motion character while preserving core video and audio capabilities.

0 favorites 0 likes
#video-diffusion

Mirror Learning

arXiv cs.LG ↗ · 2026-08-03 Cached

This paper proposes 'Mirror Learning', a framework for imitation learning from third-person observation that uses a fine-tuned video diffusion model for perspective transformation and an inverse dynamics model to synthesize pseudo first-person expert data, showing that this mirror data alone can train effective policies and improve behavior cloning.

0 favorites 0 likes
#video-diffusion

DreamTraj: Generating 6-DoF Object Trajectories by Reading Unrendered Video Diffusion Latents

Hugging Face Daily Papers ↗ · 2026-08-01 Cached

DreamTraj predicts 6-DoF object trajectories from a single RGB image and a language instruction by decoding internal video diffusion latents, eliminating the need for video, depth, or CAD models at inference. It introduces the MOVEdataset with fine-grained language-to-motion annotations and achieves state-of-the-art performance while running 4.6x faster than generate-then-extract pipelines.

0 favorites 0 likes
#video-diffusion

Articulated Object Reconstruction from Rest-State Observation

Hugging Face Daily Papers ↗ · 2026-07-30 Cached

This paper introduces a rest-state framework that reconstructs articulated objects from a single closed configuration, using explicit meshes, vision-language outputs, and video diffusion models to generate and validate articulation hypotheses without observed motion.

0 favorites 0 likes
#video-diffusion

Streaming Multi-Agent Autoregressive Diffusion Model with World State Registers

Hugging Face Daily Papers ↗ · 2026-07-23 Cached

WorldWeaver (W²) introduces cross-agent world state registers to multi-agent video diffusion models, enabling shared world state persistence across agents and views, improving logical consistency in two-agent Minecraft video generation.

0 favorites 0 likes
#video-diffusion

@songhan_mit: Speed-of-light block sparse attention :

X AI KOLs Following ↗ · 2026-07-21 Cached

Sol-Engine weekly update announces integration of Sol Attention, a training-free sparse attention method for video diffusion, with full paper coming next week.

0 favorites 0 likes
#video-diffusion

AlayaWorld: Interactive Long-Horizon World Modeling -- Full Technical Report

Hugging Face Daily Papers ↗ · 2026-07-20 Cached

AlayaWorld is a 15B-parameter interactive video world model that generates 24-fps video at 540p and 720p, using autoregressive latent chunk generation with bounded visual context and distillation to reduce inference steps. It achieves state-of-the-art performance on the iWorld-Bench for long-horizon generation.

0 favorites 0 likes
#video-diffusion

4D Human-Scene Reconstruction from Low-Overlap Captures

Hugging Face Daily Papers ↗ · 2026-07-10 Cached

Proposes StudioRecon, a method for 4D human-scene reconstruction from low-overlap camera captures, using separate priors for backgrounds (video diffusion) and humans (SMPL), with a recursive enhancement module. Accepted to SIGGRAPH 2026, outperforming prior methods by +1.5 to +5.0 dB PSNR.

0 favorites 0 likes
#video-diffusion

Flexible Video Diffusion (3 minute read)

TLDR AI ↗ · 2026-07-10 Cached

Flex-Forcing introduces a unified framework for video diffusion that supports both autoregressive and bidirectional generation modes, offering flexible control for video generation tasks.

0 favorites 0 likes
#video-diffusion

LongE2V: Long-Horizon Event-based Video Reconstruction, Prediction, and Frame Interpolation with Video Diffusion Models

Hugging Face Daily Papers ↗ · 2026-07-09 Cached

LongE2V leverages pre-trained video diffusion priors and introduces Autoregressive Unrolling, Adaptive Context Switching, Reencoding Alignment, and Event Voxel Density Augmentation to achieve high-quality video reconstruction, prediction, and frame interpolation from sparse event streams, outperforming state-of-the-art methods.

0 favorites 0 likes
#video-diffusion

LingBot-Video: sparse-MoE video diffusion transformer (13B total, 1.4B active) post-trained as an action-conditioned world model[R]

Reddit r/MachineLearning ↗ · 2026-07-08

LingBot-Video is a 13B sparse-MoE video diffusion transformer (1.4B active) post-trained with RL as an action-conditioned world model, open-sourced with weights and code. It includes a physical-plausibility reward graded by a VLM and frames itself as a policy evaluator and action planner, though closed-loop robot results are absent.

0 favorites 0 likes
#video-diffusion

MV-Forcing: Long Multi-View Video Generation via 4D-Grounded Spatio-Temporal Self-Forcing

Hugging Face Daily Papers ↗ · 2026-07-06 Cached

MV-Forcing introduces a diffusion framework that combines temporal and view-wise autoregression to generate long, multi-view consistent videos of dynamic scenes, using a 4D geometric bridge and spatio-temporal distillation to enable arbitrary-length generation from a few-step student model.

0 favorites 0 likes
#video-diffusion

The Surprising Effectiveness of Video Diffusion Models for Hand Motion Reconstruction

Hugging Face Daily Papers ↗ · 2026-06-29 Cached

ViDiHand leverages pretrained video diffusion model representations to reconstruct 4D hand motion directly from egocentric video frames, outperforming existing methods on ARCTIC, HOT3D, and HOI4D without detectors or optimization.

0 favorites 0 likes
#video-diffusion

@songhan_mit: We develop an agent-native approach to accelerate genAI, continuing the success of KDA (Kernel Design Agent) at a highe…

X AI KOLs Following ↗ · 2026-06-25 Cached

Enze Xie announces Sol Video Inference Engine, an agent-native, training-free full-stack accelerator for video diffusion that auto-tunes cache, sparse attention, token pruning, quantization, and kernel fusion, achieving >2× end-to-end speedup on large models like 64B Cosmos3-Super and 22B LTX-2.3.

0 favorites 0 likes
#video-diffusion

Triangle Splats from Video Diffusion Latents (5 minute read)

TLDR AI ↗ · 2026-06-25 Cached

FLAT is a method that directly decodes explicit triangle splats from compressed video diffusion latents in a single forward pass, improving geometric accuracy while enabling fast rasterization and physics-based interaction.

0 favorites 0 likes
#video-diffusion

World Model Self-Distillation: Training World Models to Solve General Tasks

Hugging Face Daily Papers ↗ · 2026-06-10 Cached

A scalable framework combines self-distillation and reinforcement learning to transfer task-solving abilities from vision-language models to video diffusion models without requiring labeled task-video data.

0 favorites 0 likes
#video-diffusion

FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion

Hugging Face Daily Papers ↗ · 2026-06-09 Cached

FadeMem introduces a distance-aware key-value memory consolidation mechanism that organizes historical video data into a temporal hierarchy, improving long-video generation under fixed cache constraints.

0 favorites 0 likes
← Previous
Next →
← Back to home

Submit Feedback