PAANI : On Device Visual Evidence Fusion and Explainable Guidance for River Robot Simulation

arXiv cs.AI Papers

Summary

PAANI is an on-device perception-to-guidance architecture for river-robot simulation that combines YOLO11n and MobileNetV3-Small models with evidence fusion on Arduino UNO Q to provide explainable advisories for navigation, evaluated with promising results for edge AI applications.

arXiv:2609.22353v1 Announce Type: new Abstract: Mobile river monitoring robots must interpret obstacles and water boundaries that geographic waypoints alone cannot describe. On resource constrained platforms, converting imperfect visual predictions into timely and inspectable guidance is a distinct challenge. An object label or steering command does not explain which evidence supports a decision or when that evidence is unreliable. We present PAANI, an on-device perception to guidance architecture that combines a project trained YOLO11n detector and a custom MobileNetV3 Small semantic segmenter with timestamp aligned evidence fusion on Arduino UNO Q. Bounded tracking supplies object persistence, while an explicit corridor policy combines surface labels, accepted detections, urgency and mask uncertainty. Each final advisory exposes its contributing evidence and policy reasons. ROS 2 interfaces connect the local AI pipeline to a separate Gazebo vessel, localization and control testbed. Training uses 10,000 WaterScenes images for four-class detection and 1,127 MaSTr1325 images for segmentation, including 198 segmentation validation images. The selected FP32 ONNX models occupy 14.817 MB. Detector checkpoint test mAP at 0.5 IoU is 0.7388, while the separately evaluated rectangular ONNX export achieves validation mAP at 0.5 IoU of 0.7367. Segmentation ONNX validation mIoU is 0.9750. A five-minute UNO Q recording produced median and 95th percentile pipeline latencies of 467.8 ms and 580.3 ms at a configured 0.5 Hz cadence. The evaluation also identifies black input misclassification and a sampling rate mismatch that prevents the diagnostic apparent motion estimator from collecting sufficient evidence. These results support an inspectable and reusable edge robotics foundation while clearly distinguishing model accuracy and on-board execution from validated on-water collision avoidance.
Original Article
View Cached Full Text

Cached at: 09/23/26, 09:05 AM

# PAANI: On-Device Visual Evidence Fusion and Explainable Guidance for River-Robot Simulation
Source: [https://arxiv.org/html/2609.22353](https://arxiv.org/html/2609.22353)
Santhiya Rajan††thanks:This project was undertaken by both authors in their personal capacities, outside their professional employment\. Affiliations are provided for identification only and do not imply institutional involvement, sponsorship or endorsement\.Affiliation:Multiverse Computing, SpainAffiliation:Ph\.D\. \(Part\-time\) Research ScholarPSG College of Technology, Coimbatore, India

###### Abstract

Mobile river\-monitoring robots must interpret obstacles and water boundaries that geographic waypoints alone cannot describe\. On resource\-constrained platforms, converting imperfect visual predictions into timely, inspectable guidance is a distinct challenge: an object label or steering command does not explain which evidence supports a decision or when that evidence is unreliable\. We present PAANI, an on\-device perception\-to\-guidance architecture that combines a project\-fine\-tuned YOLO11n detector and a custom MobileNetV3\-Small semantic segmenter with timestamp\-aligned evidence fusion on Arduino UNO Q\. Bounded tracking supplies object persistence, while an explicit corridor policy blends surface labels, accepted detections, legacy urgency and mask uncertainty\. Each final advisory exposes its contributing evidence and policy reasons\. ROS 2 interfaces connect this local AI pipeline to a separate Gazebo vessel, localization and control testbed\. Training uses 10,000 WaterScenes images for four\-class detection and 1,127 MaSTr1325 images for segmentation, with 198 segmentation validation images\. The selected FP32 ONNX pair occupies 14\.817 MB\. Detector checkpoint test mAP@0\.5 is 0\.7388; the separately evaluated rectangular ONNX export reaches validation mAP@0\.5 of 0\.7367\. Segmentation ONNX validation mIoU is 0\.9750\. A five\-minute UNO Q recording yields median/p95 pipeline latency of 467\.8/580\.3 ms at a configured 0\.5 Hz cadence\. The evaluation also exposes black\-input misclassification and a sampling\-rate mismatch that prevents the diagnostic apparent\-motion estimator from collecting sufficient evidence\. These results support an inspectable, reusable edge\-robotics foundation, while distinguishing model accuracy and on\-board execution from validated on\-water collision avoidance\.

Keywords:edge AI; unmanned surface vehicles; semantic segmentation; object detection; temporal evidence; explainable guidance; ROS 2; Arduino UNO Q\.

## 1Introduction

Mobile river observations are useful only when the platform carrying the instruments can operate within a defensible sensing and control envelope\. Reliable guidance, navigation, collision avoidance and fault handling remain recurring barriers to higher USV autonomy\[[6](https://arxiv.org/html/2609.22353#bib.bib10),[17](https://arxiv.org/html/2609.22353#bib.bib11)\]\. A geographic waypoint identifies a desired location, but says little about a vessel crossing the view, a pier extending into a channel, or a reflection obscuring the water boundary\. The robotics problem is consequently not solved by attaching a camera to a route follower\. It requires an interface between visual interpretation, uncertainty, temporal consistency and downstream control\.

This work addresses that interface\. A generic detector supplies object labels but not a complete representation of the water surface\. A color threshold supplies surface evidence but is sensitive to appearance\. A single\-frame decision can flicker, while a steering arrow without provenance provides little help when diagnosing a mistake\. These observations motivate complementary learned perception, bounded history, and explanations tied to the implemented policy rather than a post\-hoc narrative detached from it\.

PAANI combines two project\-trained models with explicit tracking and advisory logic on the Linux side of Arduino UNO Q\. The microcontroller provides indication and a communication watchdog, while an external host runs the simulator\. The current demonstration uses river imagery that is independent of the simulated vehicle pose\. This is a useful integration boundary: it permits exercising the board\-side perception and ROS interfaces, but it does not close the visual feedback loop through scene geometry\.

The contribution is an engineering research prototype, not a new foundational neural architecture\. Specifically, we present: \(i\) a compact, versioned two\-model RGB pipeline adapted to river\-navigation labels; \(ii\) frame\-aligned evidence fusion with inspectable risk components, temporal acceptance and final\-decision explanations; \(iii\) a split edge/simulation robotics architecture that separates advice from actuator interfaces; and \(iv\) a documented analysis of model fitting, export quality, operational timing, diagnostic behavior and known failures\. The central thesis is that reusable local robotics intelligence should expose evidence that developers can understand, test and improve\.

## 2Related work and positioning

WaterScenes provides multimodal water\-surface perception data and multiple annotation tasks, including object and free\-space interpretation\[[24](https://arxiv.org/html/2609.22353#bib.bib1)\]\. PAANI uses its RGB images and detection labels, not its radar modality; it therefore cannot inherit radar\-derived range or velocity claims\. MaSTr1325 targets maritime semantic segmentation and contains coastal USV imagery with water, sky and obstacle/environment labels\[[4](https://arxiv.org/html/2609.22353#bib.bib2)\]\. LaRS extends maritime evaluation to diverse lakes, rivers and seas, panoptic labels, scene attributes and temporal context\[[27](https://arxiv.org/html/2609.22353#bib.bib12)\]\. SeaDronesSee instead addresses aerial detection and tracking over open water\[[23](https://arxiv.org/html/2609.22353#bib.bib13)\]; its viewpoint illustrates why a maritime label set alone does not make datasets interchangeable\. PAANI’s completed training uses WaterScenes and MaSTr1325, so neither the broader LaRS coverage nor aerial\-view results are claimed\.

MODS emphasizes obstacle\-oriented evaluation rather than treating high aggregate pixel accuracy as sufficient for USV navigation\[[5](https://arxiv.org/html/2609.22353#bib.bib5)\]\. WaSR combines visual and inertial cues for water\-obstacle separation\[[3](https://arxiv.org/html/2609.22353#bib.bib14)\]; weak\-annotation scaffolding addresses the cost of dense maritime masks\[[25](https://arxiv.org/html/2609.22353#bib.bib15)\]; and WaSR\-T uses temporal appearance to suppress reflection and glitter false positives\[[26](https://arxiv.org/html/2609.22353#bib.bib16)\]\. Embedded maritime networks such as eWaSR address deployment\-oriented perception\[[21](https://arxiv.org/html/2609.22353#bib.bib6)\], while the MaCVi challenges explicitly evaluate both obstacle quality and embedded operation\[[11](https://arxiv.org/html/2609.22353#bib.bib17)\]\. These works motivate boundary\-sensitive, deployment\-aware evaluation, but PAANI does not reproduce their architectures or report a shared\-benchmark comparison\.

PAANI’s selected segmenter is a custom lightweight MobileNetV3\-Small encoder with an FPN\-style decoder\. MobileNetV3 provides an efficient pretrained representation\[[10](https://arxiv.org/html/2609.22353#bib.bib3)\], top\-down feature\-pyramid fusion supplies multi\-scale structure\[[13](https://arxiv.org/html/2609.22353#bib.bib4)\], and encoder\-decoder segmentation literature highlights the importance of recovering boundary detail\[[7](https://arxiv.org/html/2609.22353#bib.bib18)\]\. The detector uses the Ultralytics YOLO11 nano implementation\[[22](https://arxiv.org/html/2609.22353#bib.bib8)\]\. Its lightweight tracker is also deliberately narrower than established tracking\-by\-detection systems such as SORT\[[2](https://arxiv.org/html/2609.22353#bib.bib19)\]: it uses greedy IoU association and bounded history, without a motion filter or learned re\-identification\. These choices favor inspectability and bounded CPU work, not state\-of\-the\-art tracking accuracy\.

Confidence and explanation require equally careful scope\. Modern neural\-network confidence can be miscalibrated\[[8](https://arxiv.org/html/2609.22353#bib.bib20)\], and high softmax scores do not by themselves solve misclassification or distribution\-shift detection\[[9](https://arxiv.org/html/2609.22353#bib.bib21)\]\. Explainable\-robotics literature distinguishes the many audiences and forms of a robot explanation\[[20](https://arxiv.org/html/2609.22353#bib.bib22)\]\. Model\-agnostic methods such as LIME explain a prediction through a local surrogate\[[18](https://arxiv.org/html/2609.22353#bib.bib23)\], whereas critiques of post\-hoc explanation emphasize that an explanation should not be treated as a substitute for an interpretable or validated decision process\[[19](https://arxiv.org/html/2609.22353#bib.bib24)\]\. PAANI takes a narrower systems approach: it exposes the evidence and deterministic policy path after the learned perception stages\. This is a faithful trace of the implemented fusion logic, not a causal interpretation of neural features and not a guarantee that the source predictions are correct\.

ROS 2 supplies modular communication and common robotics interfaces\[[14](https://arxiv.org/html/2609.22353#bib.bib7)\]\. PAANI uses these interfaces to isolate perception, navigation and control, rather than to claim hard real\-time guarantees\. Gazebo has a long history as an open robotics simulation environment\[[12](https://arxiv.org/html/2609.22353#bib.bib25)\], and generalized ROS EKF implementations provide a standard pattern for heterogeneous state estimation\[[16](https://arxiv.org/html/2609.22353#bib.bib26)\]\. In PAANI, however, simulation fidelity and localization availability do not close the independent camera\-to\-world loop\. The cited platforms establish engineering context, not evidence of field autonomy\.

## 3System architecture and design

### 3\.1Compute partition and operational scope

Unless explicitly marked otherwise, the architecture describes the recorded trained\-model deployment\. Model selection, thread settings and simulation configuration are reported for the evaluated operating profile; historical measurements retain their own recorded configuration\.

The demonstrated hardware is the 4 GB Arduino UNO Q, combining a Qualcomm QRB2210 Linux microprocessor with an STM32U585 microcontroller\[[1](https://arxiv.org/html/2609.22353#bib.bib9)\]\. CPU\-based ONNX inference, ROS 2 Jazzy adapters, image\-space advisory, logging and a browser dashboard execute on the Linux side\. ONNX Runtime provides the cross\-platform inference interface used for the selected exports\[[15](https://arxiv.org/html/2609.22353#bib.bib27)\]\. Arduino App Lab supports the sketch/application workflow; Router Bridge transfers bounded guidance symbols to the MCU\. The implementation does not use App Lab AI Bricks and does not demonstrate GPU/NPU inference\.

Figure 1:UNO Q infrastructure mapping\. Linux inference and ROS communication are separate from the sketch’s indication role\. The App Lab workflow does not imply use of a managed AI Brick\.An Intel NUC runs Gazebo Harmonic, the vessel model, simulated GPS/IMU, localization and the final ROS\-to\-Gazebo thrust adapter\. Docker provides process/environment packaging on both hosts\. The selected graph uses ROS domain 43 and distinct simulation command topics\. Physical sensor and motor profiles are not interchangeable with this graph\. The camera is a Logitech C525 USB webcam; the current profile requests320×240320\\times 240acquisition and selects a newest frame once every two seconds\.

Figure 2:Overall compute and robotics partition\. The camera’s independent footage is not rendered from the simulated pose\. The board executes vision and guidance; the external host supplies simulation and sensor feedback\. MCU indication is distinct from propulsion control\.
### 3\.2Data contracts and separation of authority

The camera publishes an image with a ROS header and a matching frame\-timing record\. The perception worker rejects duplicate/old input and runs the detector followed by the segmenter on the same selected image\. Its JSON evidence packet includes image dimensions, source sequence, timestamps, detections, lane summaries, inference timing and freshness\. Pixel overlays use separate image topics\. The detector’s input shape and class order are explicitly specified\.

The visual\-advisor process associates boxes and publishes tracked evidence and an explained advisory\. Neither a neural model nor the visual advisor publishes motor PWM\. A separate navigator interprets permitted advisory directions against a route and fresh simulated state\. A separate controller produces normalized thrust commands, and a final adapter applies command checks and converts to simulated force\. This separation makes errors localizable, but cannot compensate for a confidently incorrect image interpretation\.

Table 1:Principal data interfaces in the selected graph\. JSON is carried in ROS String messages\.

## 4Visual perception and evidence fusion

### 4\.1Model contracts

Both learned exports use static batch\-one\[1,3,256,320\]\[1,3,256,320\]float32 input\. YOLO11n is fine\-tuned for person, vessel, pier and buoy\. Runtime preprocessing letterboxes while preserving aspect ratio, converts BGR to RGB and scales by1/2551/255\. Raw output has shape\[1,8,1680\]\[1,8,1680\]for four box coordinates and four class scores at 1,680 candidates\. Finite candidates above 0\.40 confidence are ranked, at most 256 enter class\-agnostic non\-maximum suppression at IoU 0\.45, and at most 24 boxes are retained\. Coordinates are mapped back to source pixels\. There is no instance\-mask output in the selected four\-class detector, even though the general decoder also supports older segmentation exports\.

The semantic model uses an ImageNet\-initialized MobileNetV3\-Small encoder with four scale taps\. A1×11\\times 1projection reduces the deepest representation to 64 channels\. Three top\-down blocks resize by nearest neighbor, add a lateral1×11\\times 1projection, and refine with3×33\\times 3convolution, batch normalization and ReLU\. A3×33\\times 3three\-class head and nearest\-neighbor final resize produce water/obstacle/sky logits\. This architectural upsampling is distinct from bilinear input resizing\. RGB preprocessing uses ImageNet means\(0\.485,0\.456,0\.406\)\(0\.485,0\.456,0\.406\)and standard deviations\(0\.229,0\.224,0\.225\)\(0\.229,0\.224,0\.225\)\.

Table 2:Selected learned models\. ONNX is a serialization format; ONNX Runtime is the board inference engine\. Decimal MB are file sizes, not RAM\.The host evaluation environment records ONNX Runtime 1\.30\.0\. An earlier UNO Q image records version 1\.20\.1, but the five\-minute benchmark metadata does not independently identify its runtime version\. The two\-thread setting in Table[2](https://arxiv.org/html/2609.22353#S4.T2)describes that benchmark, not all replay or board profiles\.

Figure 3:High\-level AI architecture\. The two learned branches express dependencies, not concurrent execution\. The new apparent\-motion states are a diagnostic side branch\. Legacy urgency remains an input to the existing risk model\. Detailed contracts appear in Tables[1](https://arxiv.org/html/2609.22353#S3.T1)and[2](https://arxiv.org/html/2609.22353#S4.T2)\.
### 4\.2Pixel\-to\-corridor reduction

Letpc​\(u,v\)p\_\{c\}\(u,v\)be the three\-class softmax probabilities\. The predicted label isy^=arg⁡maxc⁡pc\\hat\{y\}=\\arg\\max\_\{c\}p\_\{c\}and pixel confidence ismaxc⁡pc\\max\_\{c\}p\_\{c\}\. The evaluated region begins at normalized height 0\.30\. Overlapping horizontal intervals are left\[0\.03,0\.39\]\[0\.03,0\.39\], center\[0\.31,0\.69\]\[0\.31,0\.69\], and right\[0\.61,0\.97\]\[0\.61,0\.97\]\. For corridorjj, non\-water evidenceNjN\_\{j\}is the fraction of pixels not labeled water andUj=1−mean⁡\(maxc⁡pc\)U\_\{j\}=1\-\\operatorname\{mean\}\(\\max\_\{c\}p\_\{c\}\)is the uncertainty proxy\. Clear width is the longest contiguous run of columns containing at least 60% water, normalized by corridor width; it is logged but is not an independent metric clearance certificate\.

An HSV/corridor fallback can produce labeled visual output when the learned segmenter is unavailable\. It declares itself non\-learned and navigation\-ineligible\. The advisor then substitutes default water components rather than using its mask as validated free\-space evidence\. This fallback exclusion does not make the overall policy fail\-safe: low obstacle evidence can still allow STRAIGHT\.

### 4\.3Temporal association and legacy urgency

The tracker operates on normalized boxes with bounded work\. Greedy IoU association uses threshold 0\.25, a 3\.0\-s hold in the selected profile, and two\-hit confirmation\. A box in the immediate\-danger region can be accepted without waiting for confirmation\. Display\-box smoothing retains 0\.35 of the previous box; confidence smoothing retains 0\.65 of the previous score\. Labels are preserved for audit and mapped to a compact hazard vocabulary\. The currently trained ontology has no dedicated litter, log or vegetation class\.

The existing urgency path uses apparent growth of square\-root normalized box area and movement toward the image center\. Each positive rate is scaled and saturated, with full\-scale rates 0\.16 and 0\.20 s\-1respectively\. Urgency is the maximum of these scores\. Held observations decay and missed detections do not constitute new motion samples\. Confirmation, immediate\-danger acceptance and prediction status remain explicit fields rather than hidden changes to the detector score\.

### 4\.4Diagnostic apparent\-motion estimator

For source\-timed observations\(ti,bi\)\(t\_\{i\},b\_\{i\}\), letaia\_\{i\}be normalized box area andyi=log⁡aiy\_\{i\}=\\log\\sqrt\{a\_\{i\}\}\. The least\-squares apparent\-scale rate is

β^=∑i\(ti−t¯\)​\(yi−y¯\)St​t,St​t=∑i\(ti−t¯\)2\.\\hat\{\\beta\}=\\frac\{\\sum\_\{i\}\(t\_\{i\}\-\\bar\{t\}\)\(y\_\{i\}\-\\bar\{y\}\)\}\{S\_\{tt\}\},\\qquad S\_\{tt\}=\\sum\_\{i\}\(t\_\{i\}\-\\bar\{t\}\)^\{2\}\.\(1\)Its units are inverse seconds, not metric speed\. A heuristic margin is

m=max⁡\(0\.01,3​∑i\[yi−y¯−β^​\(ti−t¯\)\]2\(n−2\)​St​t\)\.m=\\max\\left\(0\.01,\\;3\\sqrt\{\\frac\{\\sum\_\{i\}\[y\_\{i\}\-\\bar\{y\}\-\\hat\{\\beta\}\(t\_\{i\}\-\\bar\{t\}\)\]^\{2\}\}\{\(n\-2\)S\_\{tt\}\}\}\\right\)\.\(2\)Approaching requiresβ^−m\>0\.04\\hat\{\\beta\}\-m\>0\.04; receding requiresβ^\+m<−0\.04\\hat\{\\beta\}\+m<\-0\.04; approximately steady requires the complete interval to lie in\[−0\.04,0\.04\]\[\-0\.04,0\.04\]\. Other cases are unknown\. The interval is not a statistically calibrated confidence interval\.

The estimator stores at most 24 samples over 1\.5 source seconds and requires at least five samples over 0\.4 s\. A confidence\-quality product combines duration, sample count, minimum detector confidence and residual margin\. Quality below 0\.25 yields unknown; reported non\-unknown confidence is capped at 0\.9\. Frame\-edge clipping, weak detections, ambiguous association, abrupt box\-shape changes, invalid/reversed time, replay epoch changes and gaps above 0\.75 s reset evidence\.

ROS stamps support freshness, while matched media timestamps or explicitly labeled frame\-index/FPS fallback support replay motion\. A webcam observing a monitor uses its capture clock and sees projected monitor changes; it cannot recover the original river range\. Camera translation, zoom, object pose and identity errors can imitate scale change\. No image stabilization or camera\-motion compensation is implemented\. The four new state labels are diagnostic only and cannot lower risk or authorize navigation\.

### 4\.5Late fusion, policy and explanation

For each accepted box, the advisor computes a bounded severity from confidence, normalized bottom\-edge proximity and vertical extent\. Corridor overlap weights its obstacle contribution\. Multiple contributions combine asℰ⁡\(a,b\)=1−\(1−a\)​\(1−b\)\\mathcal\{E\}\(a,b\)=1\-\(1\-a\)\(1\-b\), producing bounded obstacle evidenceOjO\_\{j\}and legacy urgency evidenceMjM\_\{j\}\. The lane score is

Rj=min⁡\(1,0\.55​Nj\+0\.65​Oj\+0\.20​Mj\+0\.15​Uj\)\.R\_\{j\}=\\min\(1,0\.55N\_\{j\}\+0\.65O\_\{j\}\+0\.20M\_\{j\}\+0\.15U\_\{j\}\)\.\(3\)The weights are engineering defaults, not learned probabilities or empirically optimized collision costs\. Center/side blocking thresholds are 0\.48/0\.58\. Persistent lower\-image occupancy, a center\-vessel area threshold of 0\.04, permitted\-side checks, and center\-edge versus center\-core incursion can override score\-only behavior\. A turn may be retained until two distinct clear frames occur, preventing timer republishes from being mistaken for fresh visual evidence\.

The final advisory contains direction, reason code, per\-lane components, thresholds, occupancy, contributing track IDs and age\. Explanations are regenerated after hysteresis and error overrides\. “Contributing” means overlap with an accepted lane ROI, not a counterfactual proof that an individual box caused the action\. Stale input yields STOP; malformed or missing evidence yields STOP or NO\_DATA according to the validation branch\. None of these checks identifies all visually unusable but syntactically valid images\.

## 5Robotics implementation

### 5\.1Simulation and state estimation

The evaluated simulation environment is an open approximately208\.699×126\.000208\.699\\times 126\.000m lake, with a 59\-waypoint repeating route of approximately 465\.443 m\. It contains no internal bank geometry corresponding to the independent footage\. The vehicle model is a provisional twin\-fan catamaran\. Its surface\-dynamics plugin applies body\-axis linear/quadratic drag

Fd​\(v\)=−c1​v−c2​\|v\|​v,F\_\{d\}\(v\)=\-c\_\{1\}v\-c\_\{2\}\|v\|v,\(4\)vertical buoyancy/restoring force

Fz=clip⁡\{m​g\+kz​\(ze−z\)−dz​z˙,0,Fmax\},F\_\{z\}=\\operatorname\{clip\}\\\{mg\+k\_\{z\}\(z\_\{e\}\-z\)\-d\_\{z\}\\dot\{z\},0,F\_\{\\max\}\\\},\(5\)and roll/pitch restoring and damping torques plus yaw drag\. The lumped mass is 12\.4 kg; the equilibrium height is 0\.177 m\. Coefficients are provisional, not fitted hydrodynamic parameters\. The simulator is not CFD and has no validated current, wave or wind model\.

A sensor adapter supplies ROS GPS and IMU messages\. A 20\-Hz local IMU\-oriented EKF, GPS\-to\-local\-frame transformation, and a 20\-Hz global GPS\-position/IMU\-heading EKF provide local ENU state\. These estimates are not Gazebo ground truth\. GPS\-derived horizontal velocity can remain nonzero while stationary; the controller includes a stopped\-speed guard rather than treating that estimate as evidence of actual motion\. The physical MPU6050 bridge marks orientation unavailable, so replacing simulated sensors with that bridge does not automatically supply absolute heading\.

### 5\.2Route\-conditioned guidance and control

The selected navigator is a camera\-simulation route follower, not the historical M10 YAML mission manager\. It retains the current waypoint during visual turns, advances within a 1\-m acceptance radius, and repeats the route\. STRAIGHT uses the waypoint bearingψw=atan2⁡\(yw−y,xw−x\)\\psi\_\{w\}=\\operatorname\{atan2\}\(y\_\{w\}\-y,x\_\{w\}\-x\)\. A LEFT/RIGHT advisory instead selects current yaw plus/minus25∘25^\{\\circ\}; slight turns use10∘10^\{\\circ\}\. Turn speed is half the configured 0\.15 m/s cruise\. Other advisory states disable motion\. Thus this interface is a heading heuristic, not a planned metric detour around the observed object\.

Navigation requires the simulation enable condition, domain 43, advancing simulation time and fresh pose/sensors/advice\. Visual age allowance is 3\.5 s in this low\-rate profile; the navigation freshness check also bounds time since advice receipt\. The command is atomic: heading, speed, enable, frame and validity are checked together\. Clock pause/reset, stale/future/replayed commands and nonfinite values are rejected by the applicable layers\.

Heading/speed control uses proportional speed feedback with feed\-forward and PD heading correction, then differential thrust mixing, saturation, reverse suppression and slew limiting\. In the selected profile it runs at 10 Hz with maximum target speed 0\.3 m/s, normalized forward limit 0\.08, steering limit 0\.04, and slew rate 0\.15 s\-1\. Gains are headingKp=0\.08K\_\{p\}=0\.08,Kd=0\.05K\_\{d\}=0\.05, speedKp=0\.08K\_\{p\}=0\.08and speed feed\-forward 0\.16\. The NUC adapter converts normalized commands using a configured software cap of 75 N per fan and zeros output after a 0\.5\-s wall\-clock timeout\. This is not a measured physical thrust capability\. These commands act on Gazebo; no physical ESC interface is demonstrated\.

### 5\.3MCU, observability and experimental extensions

The guidance server exposes camera/model evidence and decision explanations to a browser\. Perception has its own bounded observation journal\. Tracked detections and decisions remain ROS/dashboard telemetry; optional journal subscribers can record them with bounded queues and rotation, whose drop telemetry must be considered when interpreting completeness\. The selected camera\-simulation launch disables the optional survey and benchmark nodes, including the benchmark decision journal\. Collector CSVs and per\-process logs should therefore not be conflated with an always\-enabled event journal\. MCU LED guidance has a communication timeout after an established stream; it is an operator indicator, not an independent motor interlock\.

A separate metric prototype is outside the evaluated configuration\. With valid camera intrinsics and transforms, a rayr=R​K−1​\[u,v,1\]⊤r=RK^\{\-1\}\[u,v,1\]^\{\\top\}can intersect a measured water plane atp=o\+r⁡\(zw−oz\)/rzp=o\+r\(z\_\{w\}\-o\_\{z\}\)/r\_\{z\}, subject to horizon/range rejection\. Its local grid is100×100100\\times 100cells at 0\.2 m resolution; free and occupied evidence expire after 0\.8 and 2\.0 s\. Candidate motion is checked with swept hull footprints over a 3\-s horizon at 0\.2\-s increments\. This prototype requires calibrated geometry and navigation\-kernel dependencies; it is not the active image\-space advisor and is not demonstrated by the present metrics\. Sampling payload actuation and physical propulsion likewise remain outside the evaluated configuration\.

## 6Datasets and training

### 6\.1Data selection, ontology and split integrity

The detector experiment prepares 26,236 WaterScenes RGB images: 10,000 selected from the official training pool, all 10,824 official validation images, and all 5,412 official test images\. Selection uses seed 42 and prioritizes images containing buoy, sailor or kayak before filling the remainder\. All mapped boxes in selected images are retained\. Source sailor maps to person; ship, boat, vessel and kayak map to vessel; pier and buoy retain separate classes\. The evaluated ontology contains four navigation\-relevant classes\. It is intended for visible navigation\-relevant categories, not pollution identification or comprehensive person\-in\-water detection\.

Table 3:Prepared WaterScenes sample and annotation counts\. The selected subset is not the entire public dataset\.Preparation validates normalized boxes and rejects overlapping image IDs between splits\. These checks do not establish location independence or absence of near\-duplicate scenes\. MaSTr1325 supplies 1,127 training and 198 validation images from a seeded image\-level 0\.15 split\. Original obstacle label 0 maps to PAANI 1, water 1 to PAANI 0, sky remains 2, and unknown boundaries map to ignore label 255\. No independent segmentation test set or sequence\-held\-out guarantee exists\. The segmentation result therefore measures this split, not general river performance\. Other datasets listed in early project plans, including LaRS, were not used in the selected completed runs\.

### 6\.2Optimization and augmentation

Training used an NVIDIA RTX A2000 12 GB, Python 3\.12, PyTorch 2\.5\.1 with CUDA 12\.1, torchvision 0\.20\.1, Ultralytics 8\.4\.150 and Albumentations 2\.0\.8\. Both runs used CUDA automatic mixed precision; this is compatible with subsequently selecting FP32 deployment artifacts\.

YOLO11n began from pretrained weights and completed 60 epochs at square 320\-pixel input, batch 32, using AdamW with initial learning rate 0\.001 and weight decay 0\.0005\. The cosine schedule had final learning\-rate fraction 0\.01 and three warmup epochs\. Early stopping patience was 12 but the full 60 epochs completed\. Loss coefficients were box 7\.5, class 0\.5 and distribution focal 1\.5\. Augmentations included HSV perturbation, translation, scaling, horizontal flip and mosaic; mosaic was disabled for the last ten epochs\. The final deployment is rectangular320×256320\\times 256, so checkpoint and exported\-model results are reported separately\.

The segmenter completed 50 epochs, batch 16,320×256320\\times 256input, AdamW learning rate3×10−43\\times 10^\{\-4\}, weight decay10−410^\{\-4\}and a 50\-epoch cosine schedule\. The objective was cross\-entropy plus Dice with equal coefficient, ignoring label 255 in the loss/IoU path\. Training used horizontal flip, color jitter and synthetic glare\. The decoder width was 64\. The best checkpoint, selected by validation mIoU, occurred at one\-based epoch 31; the final epoch is not substituted for the selected best model\. Detailed hyperparameters appear in Appendix[A](https://arxiv.org/html/2609.22353#A1)\.

### 6\.3Training records and determinism limits

The saved detector CSV contains all 60 epochs, including training and validation box/class/DFL loss, precision, recall and mAP\. The segmenter JSONL contains all 50 epochs, training loss, class IoU, mIoU and edge F1\. A segmentation validation\-loss curve was not recorded\. Segmentation checkpoints contain model, optimizer and scheduler state plus arguments, but not every RNG/AMP state\. The distributed detector best/last checkpoints have stripped optimizer state and no scheduler entry, so they are not full training\-resume snapshots\. The glare augmentation creates an unseeded NumPy generator per call; a global seed therefore does not guarantee a bit\-identical rerun\. No multi\-seed confidence intervals or systematic hyperparameter search are available\.

Figure 4:Complete detector training history from 60 recorded epochs\. Accuracy and loss are dataset\-fitting diagnostics, not closed\-loop navigation metrics\. The evaluation geometry of the selected rectangular export is reported separately\.Figure 5:Complete 50\-epoch segmentation history, with epoch labels converted from zero\-based logs to one\-based display\. No validation\-loss series is inferred\. High water/sky IoU should be considered together with obstacle and boundary quality\.
### 6\.4Export and precision selection

Static ONNX opset 17 exports use float32 input/output\. Structural and numerical checks reported maximum absolute differences of approximately7\.63×10−47\.63\\times 10^\{\-4\}for the detector and4\.12×10−44\.12\\times 10^\{\-4\}for the segmenter, below the recorded10−310^\{\-3\}tolerance\. Such agreement checks test export consistency, not semantic accuracy\. The FP32 artifacts were evaluated separately on labeled data\.

The reported INT8 candidate uses training\-only calibration\. The procedure used 200 sorted training images, MinMax calibration, QDQ nodes and signed INT8 tensors\. The file shrank from approximately 4\.34 to 1\.44 MB, but mIoU fell from 0\.9750 to 0\.7303 and edge F1 from 0\.8769 to 0\.2318\. A host CPU microbenchmark also increased from approximately 6\.969 to 10\.651 ms\. Those host timings are not UNO Q power or latency measurements\. A separate candidate calibrated on 198 validation images is not the candidate reported in this table\. The tested training\-calibrated INT8 configuration was rejected; no quantization\-aware\-training result or complete detector/segmenter precision matrix is claimed\.

## 7Evaluation protocol

We separate four evidence classes\. First, labeled model evaluation measures prediction quality on the recorded splits\. Second, historical offline scenarios exercise model\-to\-advisory interfaces using four still images and a generated black image\. Each still is repeated eight times at controlled 10\-Hz source timestamps; these are not independent video observations\. Third, generated box trajectories and regression tests examine estimator state logic\. Fourth, recorded physical\-board integration logs measure timing and software health\. Results from these classes cannot be substituted for one another\.

Detector checkpoint mAP uses the official untouched test list; the rectangular ONNX validation report uses a separate 101\-point evaluator on the official validation list\. mAP@0\.5:0\.95 averages across IoU thresholds\. Segmentation mIoU averages water/obstacle/sky IoU over the 198\-image validation split\. The project’s water\-edge F1 uses a four\-neighbor boundary extraction and two\-pixel matching tolerance, not the MODS obstacle protocol; its ignore treatment differs from the IoU path\. Scores should therefore not be compared directly with literature leaderboards\.

The principal board run comprises 300 one\-second polls over five minutes and 151 distinct inference results\. Inference percentiles are computed from distinct results; other telemetry uses available polls\. Percentiles use nearest rank, while an even\-sample median averages the middle pair\. CPU is whole\-board utilization; cgroup memory includes charged cache/kernel memory and is not model\-only RSS\. No energy meter, battery\-endurance experiment or labeled motion dataset was used\. Historical tests have different scopes and operating configurations; their counts are not pooled as end\-to\-end system acceptance\.

## 8Results

### 8\.1Labeled perception performance

Table 4:Detection results\. Separate artifacts and evaluation splits are not interchangeable\.Table 5:Per\-class detector AP@0\.5:0\.95\. The results reveal category variation hidden by a single aggregate\.Table 6:Segmentation validation on 198 images\. INT8 is the rejected PTQ candidate\.The checkpoint test detector score is lower for person, pier and buoy than vessel \(Table[4](https://arxiv.org/html/2609.22353#S8.T4)and the class breakdown\)\. The semantic model’s aggregate is high, but the obstacle and boundary measures and the image\-level split limitation remain important\. The available evidence does not isolate the gain due to each augmentation, architecture choice or data\-selection rule\.

### 8\.2Stage outputs and qualitative behavior

Figure[6](https://arxiv.org/html/2609.22353#S8.F6)follows one saved scene through input, detection, segmentation, tracking, fusion and advice\. A vessel confidence of 0\.85723 coexists with unknown motion because its raw box extends beyond the frame edge\. This is an example of keeping detector confidence separate from validity of temporal evidence\. Center risk is 0\.5114, while the unoccupied right corridor has risk 0\.4573; the policy emits RIGHT\. These values come from the same final replay observation, not independently chosen outputs\.

![Refer to caption](https://arxiv.org/html/2609.22353v1/stage_outputs_1703.png)Figure 6:Per\-stage sample outputs for WaterScenes image 01703\. A–C are saved image/model outputs; D–F render matching recorded telemetry\. The mask is predicted, not ground truth\. The Windows\-host replay used threshold 0\.25, eight repeated still observations and controlled timestamps; the board uses threshold 0\.40\. Neither physical motion nor field generalization is established\.Table 7:Final historical offline decisions\. L/C/R are corridor scores, not probabilities\. All five stale probes produced STOP after the recorded 9\.3\-s age\.![Refer to caption](https://arxiv.org/html/2609.22353v1/qualitative_cases.png)Figure 7:Saved multi\-object, occupied\-corridor and black\-input examples\. Cyan denotes predicted water, orange obstacle/environment, and dark blue sky\. These selected illustrations are not a held\-out qualitative test set\. The last row exposes an invalid\-input failure rather than a successful negative control\.The black image was labeled approximately 97\.56% water in the evaluated ROI and produced STRAIGHT\. A syntactically valid, recent image can therefore pass freshness and tensor checks while containing no useful scene evidence\. This is consistent with the broader distinction between classifier confidence, calibration and explicit out\-of\-distribution detection\[[8](https://arxiv.org/html/2609.22353#bib.bib20),[9](https://arxiv.org/html/2609.22353#bib.bib21)\]\. The explanation faithfully reports the policy’s inputs, but faithfulness is not correctness\. This result rules out describing the current system as safe under arbitrary camera failure\.

### 8\.3Temporal diagnostics and cadence mismatch

Generated expansion/contraction/steady trajectories test the implemented state logic, while clipped boxes, timing gaps and ambiguity test rejection\. Such tests do not label physical approach/recession in river video\. At 0\.5 Hz, adjacent selected frames are approximately 2 s apart, exceeding the 0\.75\-s permitted source gap and the 1\.5\-s history window\. Thus at most one usable observation is retained per new update, below the minimum five\. Implementing the four\-state estimator is not the same as demonstrating it at the deployed cadence\. The recorded motion\-deployment session reported unknown labels throughout\.

The legacy tracker can still associate across the configured 3\-s hold and compute its older urgency scores\. Those signals and the new diagnostic state must not be merged in interpretation\. Increasing rate alone is also insufficient evidence of physical validity: camera motion, clipping and unmodeled changes remain confounders\.

### 8\.4UNO Q execution and robotics outputs

Table 8:Recorded five\-minute two\-thread UNO Q benchmark\. Timing and thermal observations do not constitute power or long\-duration qualification\.Figure 8:Replotted raw operational telemetry\. Inference/age use 151 distinct results; CPU and temperature use 300 polls\. Detector timing includes its runtime preprocessing/decoding, while segmenter timing is the recorded session execution interval; their medians need not sum to total pipeline median\.All 300 sampled API requests succeeded and reported learned segmentation\. No sampled stale advisory was present; this does not exclude transients between polls\. CPU quota\-throttling and OOM\-kill counters did not increase; quota counters are not a thermal\-throttling measurement\. Compared with the earlier trained one\-thread operational run, the two\-thread run’s median total latency decreased from 539\.6 to 467\.8 ms\. Scenes, warm\-up, background work and runtime configurations were not fully controlled, so this is not a causal ablation\. The model pair’s 14\.817168\-MB disk footprint is much smaller than the complete runtime memory charge\.

A recorded integration snapshot at 15:45:19\.863 UTC on September 13 shows SLIGHT\_LEFT, navigation enabled at waypoint index 12, and applied normalized left/right fan commands 0\.00000/0\.02611\. This is a Gazebo\-interface sample from a different session than Figure[6](https://arxiv.org/html/2609.22353#S8.F6)\. Earlier camera/simulation evidence recorded vessel displacement over about 27 s with zero physical motor publishers\. Neither record demonstrates a complete camera\-guided lap or avoidance of a visible real obstacle\. Historical M10 route acceptance is a separate baseline and is not pooled with these results\.

## 9Discussion and limitations

### 9\.1What is supported

The evidence supports task\-trained model execution on a constrained CPU, traceable conversion from pixel/box evidence to an advisory, and integration with a modular simulator/control stack\. The design permits a developer to distinguish a model error, temporal rejection, occupancy override or stale\-message condition\. Separating model contracts, risk components and control authority is useful even when a failure is discovered: it identifies a testable intervention rather than hiding the problem behind a confident instruction\.

### 9\.2What is not supported

No physical river deployment, water\-quality measurement, waste collection, rescue detection, battery\-endurance result or calibrated monocular distance is established\. The independent video/simulation geometry prevents a closed\-loop visual navigation claim\. High segmentation mIoU cannot establish small\-obstacle recall or collision avoidance\. The model confidence and motion\-quality fields are not calibrated probabilities, and the black\-frame result demonstrates that a strong\-looking confidence can be misleading\.

The evidence is also limited by selected demonstration scenes, image\-level segmentation splitting, lack of multi\-seed training, absent cross\-river tests and absence of matched ablations\. A rigorous next evaluation would hold out complete sequences/sites, include low light, reflections, rain, occlusion and camera disconnection, annotate physical motion with an appropriate reference, and measure coupled\-scene task success and failure recovery\. These are proposed experiments, not completed results\.

### 9\.3Reusability, sustainability and deployment implications

PAANI’s reusable element is the interface pattern: timestamped model evidence, bounded state, explicit policy and inspectable outputs\. Canal/reservoir inspection or aquaculture observation could retain the software boundaries while changing data and task rules\. Ground robotics requires a new traversability representation, not unchanged water labels\. Adding sensors or actuators requires calibration, driver integration, operating\-envelope tests and hardware safety controls\.

On\-device inference removes a mandatory cloud\-video dependency from the decision path\. It does not prove lower net energy consumption; the full demonstration includes an external simulator and power conversion\. Sustainability benefits such as broader measurement coverage, lower energy or reduced waste require an explicit operational baseline and measured outcomes\. Likewise, ROS modularity and container packaging facilitate adaptation but do not prove fleet\-scale reliability or hard real\-time behavior\.

Before physical actuation, unusable\-image rejection and a conservative navigation response must address the black\-frame failure, and motion features must be validated at the actual sampling rate\. Independent hardware stop paths, adequate range/velocity sensing and field\-calibrated dynamics are additional requirements\. Explainability is a debugging and accountability mechanism, not a substitute for those controls\.

## 10Conclusion

PAANI demonstrates an on\-device, project\-trained perception stack with transparent temporal and corridor\-based guidance integrated into a ROS 2/Gazebo robotics testbed\. The selected FP32 models provide compact deployment artifacts and recorded CPU execution below one second per sampled frame, while the explicit evidence chain makes both decisions and defects inspectable\. Its strongest present contribution is a local AI foundation for robotics development, not proven on\-water autonomy\. The results also illustrate why model quality, timing, diagnostic validity and system safety must be evaluated separately: a high validation score can coexist with a black\-image failure, and implemented motion logic can remain unusable at the deployed cadence\.

## Code availability

## Appendix ADetailed hyperparameters and bounded runtime constants

Table 9:Recorded detector optimization and augmentation configuration\. Numeric settings are not a claim of a tuned optimum\.Table 10:Recorded segmentation configuration and selected runtime thresholds\.Table 11:Provisional robotics parameters\. Metric\-prototype parameters are not active camera\-simulation evidence\.
## References

- \[1\]Arduino\(2026\)Arduino UNO Q: hardware documentation\.Note:Accessed September 14, 2026External Links:[Link](https://docs.arduino.cc/hardware/uno-q/)Cited by:[§3\.1](https://arxiv.org/html/2609.22353#S3.SS1.p2.1)\.
- \[2\]A\. Bewley, Z\. Ge, L\. Ott, F\. Ramos, and B\. Upcroft\(2016\)Simple online and realtime tracking\.InIEEE International Conference on Image Processing \(ICIP\),pp\. 3464–3468\.External Links:[Document](https://dx.doi.org/10.1109/ICIP.2016.7533003)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p3.1)\.
- \[3\]B\. Bovcon and M\. Kristan\(2020\)A water\-obstacle separation and refinement network for unmanned surface vehicles\.InIEEE International Conference on Robotics and Automation \(ICRA\),pp\. 9470–9476\.External Links:[Document](https://dx.doi.org/10.1109/ICRA40945.2020.9197194),[Link](https://arxiv.org/abs/2001.01921)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[4\]B\. Bovcon, J\. Muhovič, J\. Perš, and M\. Kristan\(2019\)The MaSTr1325 dataset for training deep USV obstacle detection models\.InIEEE/RSJ International Conference on Intelligent Robots and Systems \(IROS\),External Links:[Link](https://www.vicos.si/resources/mastr1325/)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p1.1)\.
- \[5\]B\. Bovcon, J\. Muhovič, D\. Vranac, D\. Mozetič, J\. Perš, and M\. Kristan\(2021\)MODS: a USV\-oriented object detection and obstacle segmentation benchmark\.arXiv preprint arXiv:2105\.02359\.External Links:[Link](https://arxiv.org/abs/2105.02359)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[6\]S\. Campbell, W\. Naeem, and G\. W\. Irwin\(2012\)A review on improving the autonomy of unmanned surface vehicles through intelligent collision avoidance manoeuvres\.Annual Reviews in Control36\(2\),pp\. 267–283\.External Links:[Document](https://dx.doi.org/10.1016/j.arcontrol.2012.09.008)Cited by:[§1](https://arxiv.org/html/2609.22353#S1.p1.1)\.
- \[7\]L\. Chen, Y\. Zhu, G\. Papandreou, F\. Schroff, and H\. Adam\(2018\)Encoder\-decoder with atrous separable convolution for semantic image segmentation\.InEuropean Conference on Computer Vision \(ECCV\),pp\. 801–818\.Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p3.1)\.
- \[8\]C\. Guo, G\. Pleiss, Y\. Sun, and K\. Q\. Weinberger\(2017\)On calibration of modern neural networks\.InInternational Conference on Machine Learning \(ICML\),Proceedings of Machine Learning Research, Vol\.70,pp\. 1321–1330\.Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p4.1),[§8\.2](https://arxiv.org/html/2609.22353#S8.SS2.p2.1)\.
- \[9\]D\. Hendrycks and K\. Gimpel\(2017\)A baseline for detecting misclassified and out\-of\-distribution examples in neural networks\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://arxiv.org/abs/1610.02136)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p4.1),[§8\.2](https://arxiv.org/html/2609.22353#S8.SS2.p2.1)\.
- \[10\]A\. Howard, M\. Sandler, G\. Chu,et al\.\(2019\)Searching for MobileNetV3\.InIEEE/CVF International Conference on Computer Vision \(ICCV\),External Links:[Link](https://arxiv.org/abs/1905.02244)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p3.1)\.
- \[11\]B\. Kiefer, L\. Žust, M\. Kristan, J\. Perš,et al\.\(2024\)2nd workshop on maritime computer vision \(MaCVi\) 2024: challenge results\.InIEEE/CVF Winter Conference on Applications of Computer Vision Workshops,pp\. 869–891\.Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[12\]N\. Koenig and A\. Howard\(2004\)Design and use paradigms for Gazebo, an open\-source multi\-robot simulator\.InIEEE/RSJ International Conference on Intelligent Robots and Systems \(IROS\),pp\. 2149–2154\.External Links:[Document](https://dx.doi.org/10.1109/IROS.2004.1389727)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p5.1)\.
- \[13\]T\. Lin, P\. Dollár, R\. Girshick, K\. He, B\. Hariharan, and S\. Belongie\(2017\)Feature pyramid networks for object detection\.InIEEE Conference on Computer Vision and Pattern Recognition \(CVPR\),External Links:[Link](https://arxiv.org/abs/1612.03144)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p3.1)\.
- \[14\]S\. Macenski, T\. Foote, B\. Gerkey, C\. Lalancette, and W\. Woodall\(2022\)Robot operating system 2: design, architecture, and uses in the wild\.Science Robotics7\(66\),pp\. eabm6074\.External Links:[Document](https://dx.doi.org/10.1126/scirobotics.abm6074),[Link](https://arxiv.org/abs/2211.07752)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p5.1)\.
- \[15\]Microsoft\(2026\)ONNX Runtime: cross\-platform machine\-learning inference\.Note:Accessed September 17, 2026External Links:[Link](https://onnxruntime.ai/docs/)Cited by:[§3\.1](https://arxiv.org/html/2609.22353#S3.SS1.p2.1)\.
- \[16\]T\. Moore and D\. Stouch\(2014\)A generalized extended kalman filter implementation for the robot operating system\.InInternational Conference on Intelligent Autonomous Systems \(IAS\-13\),Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p5.1)\.
- \[17\]Y\. Qiao, J\. Yin, W\. Wang, F\. Duarte, J\. Yang, and C\. Ratti\(2023\)Survey of deep learning for autonomous surface vehicles in marine environments\.IEEE Transactions on Intelligent Transportation Systems24\(4\),pp\. 3678–3701\.External Links:[Document](https://dx.doi.org/10.1109/TITS.2023.3235911)Cited by:[§1](https://arxiv.org/html/2609.22353#S1.p1.1)\.
- \[18\]M\. T\. Ribeiro, S\. Singh, and C\. Guestrin\(2016\)Why should I trust you?: explaining the predictions of any classifier\.InACM SIGKDD International Conference on Knowledge Discovery and Data Mining,pp\. 1135–1144\.External Links:[Document](https://dx.doi.org/10.1145/2939672.2939778)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p4.1)\.
- \[19\]C\. Rudin\(2019\)Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead\.Nature Machine Intelligence1\(5\),pp\. 206–215\.External Links:[Document](https://dx.doi.org/10.1038/s42256-019-0048-x)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p4.1)\.
- \[20\]T\. Sakai and T\. Nagai\(2022\)Explainable autonomous robots: a survey and perspective\.Advanced Robotics36\(5–6\),pp\. 219–238\.External Links:[Document](https://dx.doi.org/10.1080/01691864.2022.2029720)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p4.1)\.
- \[21\]M\. Teršek, L\. Žust, and M\. Kristan\(2023\)eWaSR: an embedded\-compute\-ready maritime obstacle detection network\.arXiv preprint arXiv:2304\.11249\.External Links:[Link](https://arxiv.org/abs/2304.11249)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[22\]Ultralytics\(2026\)Ultralytics YOLO11 documentation\.Note:Accessed September 14, 2026External Links:[Link](https://docs.ultralytics.com/models/yolo11/)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p3.1)\.
- \[23\]L\. A\. Varga, B\. Kiefer, M\. Messmer, and A\. Zell\(2022\)SeaDronesSee: a maritime benchmark for detecting humans in open water\.InIEEE/CVF Winter Conference on Applications of Computer Vision \(WACV\),pp\. 2260–2270\.Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p1.1)\.
- \[24\]S\. Yao R\. Guanet al\.\(2023\)WaterScenes: a multi\-task 4d radar\-camera fusion dataset and benchmarks for autonomous driving on water surfaces\.arXiv preprint arXiv:2307\.06505\.External Links:[Link](https://arxiv.org/abs/2307.06505)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p1.1)\.
- \[25\]L\. Žust and M\. Kristan\(2022\)Learning maritime obstacle detection from weak annotations by scaffolding\.InIEEE/CVF Winter Conference on Applications of Computer Vision \(WACV\),pp\. 955–964\.Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[26\]L\. Žust and M\. Kristan\(2022\)Temporal context for robust maritime obstacle detection\.InIEEE/RSJ International Conference on Intelligent Robots and Systems \(IROS\),pp\. 6340–6346\.External Links:[Document](https://dx.doi.org/10.1109/IROS47612.2022.9982043),[Link](https://arxiv.org/abs/2203.05352)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p2.1)\.
- \[27\]L\. Žust, J\. Perš, and M\. Kristan\(2023\)LaRS: a diverse panoptic maritime obstacle detection dataset and benchmark\.InIEEE/CVF International Conference on Computer Vision \(ICCV\),pp\. 20304–20314\.External Links:[Link](https://openaccess.thecvf.com/content/ICCV2023/html/Zust_LaRS_A_Diverse_Panoptic_Maritime_Obstacle_Detection_Dataset_and_Benchmark_ICCV_2023_paper.html)Cited by:[§2](https://arxiv.org/html/2609.22353#S2.p1.1)\.

Similar Articles

Co-GLANCE: Uncertainty-Aware Active Perception for Heterogeneous Robot Teaming

arXiv cs.LG

Co-GLANCE is a real-time onboard perception and decision-making system for heterogeneous robot teams that distills vision-language model capabilities into efficient models and uses conformal prediction with selective abstention to quantify and resolve perceptual uncertainty, outperforming cloud-based VLM baselines by 25-36% while achieving 350x lower latency.