Paper page - OneHOI: Unifying Human-Object Interaction Generation and Editing Source: https://huggingface.co/papers/2604.14062 ## Abstract A unified diffusion transformer framework for human-object interaction generation and editing that uses relational modeling and structured attention mechanisms to handle complex interaction scenarios. Human-Object Interaction (HOI) modelling captures how humans act upon and relate to objects, typically expressed as triplets. Existing approaches split into two disjoint families: HOI generation synthesises scenes from structured triplets and layout, but fails to integrate mixed conditions like HOI and object-only entities; and HOI editing modifies interactions via text, yet struggles to decouple pose from physical contact and scale to multiple interactions. We introduce OneHOI, a unified diffusion transformer framework that consolidates HOI generation and editing into a single conditional denoising process driven by shared structured interaction representations. At its core, the Relational Diffusion Transformer (R-DiT) models verb-mediated relations through role- and instance-aware HOI tokens, layout-based spatial Action Grounding, a Structured HOI Attention to enforce interaction topology, and HOI RoPE to disentangle multi-HOI scenes. Trained jointly with modality dropout on our HOI-Edit-44K, along with HOI and object-centric datasets, OneHOI supports layout-guided, layout-free, arbitrary-mask, and mixed-condition control, achieving state-of-the-art results across both HOI generation and editing. Code is available at https://jiuntian.github.io/OneHOI/. View arXiv page View PDF Project page GitHub Add to collection Get this paper in your agent: hf papers read 2604.14062 Don’t have the latest CLI? curl -LsSf https://hf.co/cli/install.sh | bash ## Models citing this paper 0 No model linking this paper Cite arxiv.org/abs/2604.14062 in a model README.md to link it from this page. ## Datasets citing this paper 2 #### jiuntian/hoiedit44k Viewer • Updated 3 days ago • 38.9k • 1.13k • 2 #### jiuntian/IEBench Viewer • Updated 3 days ago • 224 • 18 ### Spaces citing this paper 0 No Space linking this paper Cite arxiv.org/abs/2604.14062 in a Space README.md to link it from this page. ## Collections including this paper 0 No Collection including this paper Add this paper to a collection to link it from this page.