SuperNav: An Agentic Navigation System for Any Task in Any Scene

Hugging Face Daily Papers Papers

Summary

SuperNav is a navigation framework that equips a pretrained multimodal LLM with an agent harness and navigation tools—without navigation-specific fine-tuning—allowing the model to interpret requests and specify visual destination points while delegating motion execution. It outperforms four baselines on instance-level, multi-object, and demand-driven tasks and is demonstrated on a real quadruped robot.

General-purpose service robots need navigation systems that can handle diverse human requests in unfamiliar environments, combining task generality with scene generality. Some existing methods fine-tune multimodal large language models (MLLMs) to predict navigation actions, making their behavior dependent on the coverage of navigation training data and potentially limiting generalization to new requests and environments. Our key insight is to let the MLLM focus on interpreting requests, understanding scenes, and making decisions while preserving its general-purpose capabilities and delegating motion execution to navigation tools. To realize this idea, we introduce SuperNav, which equips a pretrained MLLM with a specialized agent harness without navigation-specific fine-tuning of the MLLM. Our harness supports these decisions with Navigation Skills, agent-oriented Tools for physical interaction, and task-progress and context management. A unified visual-point interface connects decision-making to motion by allowing the model to specify destinations directly in images and revise its decisions from execution feedback. Together, these components support sustained navigation across different task requirements and environments. SuperNav outperforms four evaluated baselines on instance-level, multi-object, and demand-driven tasks. Category-level evaluation on HM3D and deployment on a real quadruped robot further demonstrate its applicability across environments. Project Page: https://zju3dv.github.io/SuperNav/
Original Article
View Cached Full Text

Cached at: 10/09/26, 06:27 AM

Paper page - SuperNav: An Agentic Navigation System for Any Task in Any Scene

Source: https://huggingface.co/papers/2610.12126

Abstract

General-purposeservicerobotsneednavigationsystemsthatcanhandlediversehumanrequestsinunfamiliarenvironments,combiningtaskgeneralitywithscenegenerality.Someexistingmethodsfine-tunemultimodallargelanguagemodels(MLLMs)topredictnavigationactions,makingtheirbehaviordependentonthecoverageofnavigationtrainingdataandpotentiallylimitinggeneralizationtonewrequestsandenvironments.OurkeyinsightistolettheMLLMfocusoninterpretingrequests,understandingscenes,andmakingdecisionswhilepreservingitsgeneral-purposecapabilitiesanddelegatingmotionexecutiontonavigationtools.Torealizethisidea,weintroduceSuperNav,whichequipsapretrainedMLLMwithaspecializedagentharnesswithoutnavigation-specificfine-tuningoftheMLLM.OurharnesssupportsthesedecisionswithNavigationSkills,agent-orientedToolsforphysicalinteraction,andtask-progressandcontextmanagement.Aunifiedvisual-pointinterfaceconnectsdecision-makingtomotionbyallowingthemodeltospecifydestinationsdirectlyinimagesandreviseitsdecisionsfromexecutionfeedback.Together,thesecomponentssupportsustainednavigationacrossdifferenttaskrequirementsandenvironments.SuperNavoutperformsfourevaluatedbaselinesoninstance-level,multi-object,anddemand-driventasks.Category-levelevaluationonHM3Danddeploymentonarealquadrupedrobotfurtherdemonstrateitsapplicabilityacrossenvironments.ProjectPage:https://zju3dv.github.io/SuperNav/

View arXiv pageView PDFProject pageGitHub10Add to collection

Get this paper in your agent:

hf papers read 2610\.12126

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2610.12126 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2610.12126 in a dataset README.md to link it from this page.

Spaces citing this paper1

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

NavHarness: Towards Lifelong Embodied Navigation

Hugging Face Daily Papers

The paper introduces NavHarness, a training-free embodied navigation harness that integrates memory processing into the navigation loop, enabling agents to carry experience across sessions for lifelong navigation. On GOAT-Bench, it improves success rate by up to 22.6 points over context-only sessions and achieves state-of-the-art results with GPT-6/Astra.