Helix4D: Complex 4D Mesh Generation
Summary
Helix4D introduces a framework for high-quality dynamic 4D mesh generation from video by extending Trellis2 with cross-frame attention and a 4D temporal encoding that repurposes redundant spatial RoPE bands without adding parameters.
View Cached Full Text
Cached at: 05/26/26, 06:42 AM
Paper page - Helix4D: Complex 4D Mesh Generation
Source: https://huggingface.co/papers/2605.26109
Abstract
Helix4D enables high-quality dynamic mesh generation by adapting Trellis2’s frame-local attention across frames and extending 3D positional encoding with 4D temporal information.
Current video-to-4D methods struggle with complex topology changes, transparent materials, thin structures, and inner surfaces. We present Helix4D, adynamic mesh generationframework by inheriting the expressive representation ofTrellis2, adapting it from image-to-3D to video-conditioned 4D generation. Our design arises from two key questions: (a) how to enableTrellis2’sframe-local attentionto share information across frames while preserving its pretrained quality on rare cases such as transparent objects and inner surfaces, and (b) how to inject temporal information into a purely 3Dpositional encodingwithout breaking pretrained capabilities. We address (a) with a sliding-windowcross-frame attentionand anchor on the first frame. The first frame is generated by the baseTrellis2model and injected into our model, letting it inheritTrellis2’s quality in rare cases throughcross-frame attention. We address (b) with a4D temporal encodingthat repurposes redundant low-frequency spatialRoPE bandsfor time, extending the encoding from 3D with no additional parameters. Extensive experiments show the effectiveness of Helix4D for high-qualitydynamic mesh generationonActionBenchand our own challengingcomplex dynamics set.
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2605\.26109
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.26109 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.26109 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.26109 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Fast 4D Mesh Generation by Spatio-Temporal Attention Chains
A training-free 4D mesh generation approach using Spatio-Temporal Attention Chains accelerates creation to 9 seconds (13x speedup) while improving temporal consistency and scaling to longer sequences, with zero-shot capabilities for tracking and camera estimation.
4DAnyone: Create Anyone in 4D from a Casual Monocular Video
4DAnyone reconstructs 4D humans from monocular video by generating multiview-consistent videos and lifting them into 4D Gaussian Splatting, using reference and target context designs to address scaling bottlenecks.
Lift4D: Harmonizing Single-View 3D Estimation for 4D Reconstruction In-the-Wild
Lift4D is a test-time optimization framework that reconstructs complete 4D geometry, appearance, and deformation of dynamic objects from a single monocular in-the-wild video, improving over prior methods on challenging sequences with occlusions and non-rigid motion.
Pantheon360: Taming Digital Twin Generation via 3D-Aware 360° Video Diffusion
Pantheon360 introduces a 3D-aware 360° video diffusion framework that uses an explicit 3D cache to enforce geometric consistency, enabling high-fidelity digital twin generation from sparse 360° inputs.
Beyond Pixels: From Video Priors to 4D Worlds
This paper introduces Latent-to-4D, a method for direct 4D scene generation from video diffusion latents without retraining across generators, achieving better geometry and temporal stability than cascaded approaches.