SAM-MT: Real-Time Interactive Multi-Target Video Segmentation
Summary
This paper introduces SAM-MT, an extension of SAM2 for real-time interactive multi-target video segmentation, achieving high FPS independent of target count.
View Cached Full Text
Cached at: 07/10/26, 06:11 PM
Paper page - SAM-MT: Real-Time Interactive Multi-Target Video Segmentation
Source: https://huggingface.co/papers/2607.08688
Abstract
ModernVideoObjectSegmentation(VOS)involvestrackingandsegmentinguser-specifiedtargets.Whilerecentapproacheshaveachievedremarkableperformanceinsingle-targetscenarios,extendingthemtomulti-targetsettingstypicallyinvolvesreplicatingthesingle-targetprocessingforeachindividualobject,resultinginreducedframerates(FPS)withunboundedlatencyastargetcountincreases.BuiltuponSegmentAnything2(SAM2),weproposeSAM-MT,whichaddressesthisbytransformingthemodelintoaninteractiveframeworkforreal-timeMulti-Targetvideosegmentation.SAM-MTusesexplicitqueriestorepresentdifferentindividualtargets,inparallelwithasharedrepresentationforglobalcontext.Itemploysdecoupledmaskedattentiontokeepindividualidentitiesdistinctfromcross-targetinterference,andsparsememoryforstabletemporalevolution,alongwithspecializedstrategiesforocclusionhandlingandoverlapprevention.SAM-MTsuccessfullydecoupleslatencyfromthenumberoftargets,achievingreal-timespeedonparwithsingle-targetbaselines(>36FPSfor10targets)whilemaintainingSAM2’srobustvideosegmentationperformance.
View arXiv pageView PDFProject pageGitHub3Add to collection
Get this paper in your agent:
hf papers read 2607\.08688
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2607.08688 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2607.08688 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2607.08688 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
SAM 3.1: Faster and More Accessible Real-Time Video Detection and Tracking With Multiplexing and Global Reasoning
Meta AI releases SAM 3.1, an update to the Segment Anything Model that enhances real-time video detection and tracking through multiplexing and global reasoning capabilities.
Segment Anything Model (SAM) 3.1 (2 minute read)
SAM 3.1 can detect, segment, and track objects in images and video using text prompts on the Meta Model API, with specified inference costs.
SAM2Matting: Generalized Image and Video Matting
SAM2Matting introduces a tracker-to-matting framework that enhances foundational trackers like SAM2 with region-proposal bridges and matting heads, achieving state-of-the-art video matting performance even when trained only on images, with strong generalization across diverse scenarios.
SAM 3: Segment Anything with Concepts
SAM 3 introduces a unified model for promptable concept segmentation and tracking, achieving state-of-the-art performance with a decoupled recognition and localization architecture and a scalable data engine.
@MaximeRivest: this is a really cool and powerful trick for image segmentation with sam without prompting! > You can exploit the small…
A technique is shared for using the Segment Anything Model (SAM) to segment images without prompting by exploiting similarities in microscopy images, enabling zero-shot mask propagation similar to video.