Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior
Summary
This paper introduces a neuro-symbolic Hierarchical Planning Decoder (HPD) for anticipating human intentions from multimodal episodes. It demonstrates improved performance in goal inference and logic constraint satisfaction on a benchmark dataset.
View Cached Full Text
Cached at: 09/16/26, 09:07 AM
# Neuro-Symbolic Hierarchical Intention Anticipation in Human Behavior Source: [https://arxiv.org/abs/2609.17064](https://arxiv.org/abs/2609.17064) [View PDF](https://arxiv.org/pdf/2609.17064) > Abstract:Assistive autonomous systems must anticipate human goals before an observed behavior is complete\. This article formulates anticipation as goal inference from a partially observed multimodal episode together with structured prediction of the remaining behavior, rather than exact motor forecasting\. A compact Hierarchical Planning Decoder \(HPD\) is attached to a frozen neuro\-symbolic recognition encoder and predicts, at four ontological levels, the next actions, the remaining activities and low\-level intentions, and the episode high\-level intention\(HLI\)\. The decoder is trained with soft neuro\-symbolic regularization combining transition\-coherence and hierarchical continuity losses, and is decoded with hard reachability masks that enforce ontological validity at inference\. On a compositional four\-level benchmark of 15,002 multimodal episodes built over NTU RGB\+D 120 features, three headline properties are observed together\. The advantage over the strongest sequential baseline grows with the anticipation horizon, from \+1\.7 points at step 1 to \+7\.3 points at step 3 \(top\-5\)\. Under compositional generalization, where one parent association per multi\-parent low level intention is held out, this advantage widens to \+4\.9 points at step 1\. At the episode level, 96\.8% of anticipated trajectories satisfy the joint logic constraints, above the 88\.1% strongest\-baseline value and the 73\.9% ground\-truth floor; soft logic terms alone account for a 59\.8 to 71\.1% relative reduction of HLI\-reachability violations, and the hard masks then eliminate them entirely\. Neural generation supplies predictive ranking, symbolic constraints supply onto logical validity, and their combination yields coherent hierarchical anticipation while exposing remaining challenges in compositional goal generalization and unordered set prediction\. ## Submission history From: Farnaz SOLEIMANI \[[view email](https://arxiv.org/show-email/e06a014a/2609.17064)\] \[via CCSD proxy\] **\[v1\]**Tue, 15 Sep 2026 12:09:03 UTC \(96 KB\)
Similar Articles
Neurosymbolic Reasoning with Incremental Knowledge for Sample Efficient Hierarchical Reinforcement Learning
This paper proposes InK, a neurosymbolic hierarchical reinforcement learning approach that uses incremental knowledge for symbolic planning and reward-shaped low-level neural modules, achieving improved sample efficiency in navigation tasks.
A Neurosymbolic Approach for Constructing Planning Domain Models from Clinical Narratives
The paper introduces NSPIN, a neurosymbolic framework that uses a pretrained LLM to extract structured event sequences from clinical narratives and induces probabilistic planning domain models for surgical procedures. Evaluated on laparoscopic appendectomy notes, it shows generalization and alignment with surgical practice.
From Hybrid Mechanistic--Data-Driven Modeling Toward Neuro-Symbolic AI: What, Why, and How
This paper introduces the Hybrid-to-NeSy (H2N) framework, which systematically translates hybrid mechanistic-data-driven models into neuro-symbolic AI designs, enabling the derivation of metrics for structural violation and belief dispersion as measures of epistemic uncertainty in the mechanistic part.
PACE: A Neuro-Symbolic Framework for Plausible and Actionable Counterfactual Explanations
This paper introduces PACE, a modular neuro-symbolic framework that combines a neural predictive model with symbolic reasoning to generate counterfactual explanations that respect domain-specific feasibility constraints. A case study on the Adult Income dataset demonstrates that incorporating symbolic rules yields more plausible and actionable explanations.
NSF-HRPT: Neural Semantic Field meets Hierarchical Risk Perception Tree for Safety-Critical Scenario Assessment
The paper presents NSF-HRPT, a framework that combines a Neural Semantic Field with a Hierarchical Risk Perception Tree for quantitative risk assessment in safety-critical autonomous driving scenarios, achieving state-of-the-art performance on synthetic benchmarks and near-state-of-the-art results on real-world datasets.