Retention-Constrained Post-Training Quantization of Cellpose-SAM for Stem Cell Microscopy

Hugging Face Daily Papers Papers

Summary

The paper evaluates compression schemes for Cellpose-SAM in stem cell microscopy, demonstrating that mixed-precision quantization achieves 6.76x reduction without catastrophic failures while maintaining segmentation accuracy.

Induced pluripotent stem cell (iPSC) culture increasingly relies on segmentation foundation models, yet deployment on laboratory CPUs and edge hardware requires compression schemes that are both efficient and auditable. We present a deployment-oriented evaluation of compressed Cellpose-SAM using a pre-specified retention criterion: the 95% cluster-bootstrap interval of mean change from FP32 must remain above a fixed -0.02 margin for every imaging modality. On a stratified 176-field panel spanning BBBC038 nuclei, BBBC039 U2OS fluorescence, and NIST iPSC images across density regimes, weight-only W8A16 preserves instance F1 across all modalities. A sensitivity-guided mixed W4/W8 scheme, using four INT8 exceptions, achieves a 6.76x reduction in weight storage with no observed catastrophic failures (0/176 fields), matching W8A16 at this sample size. In contrast, ternary weight-only quantization achieves 12.08x compression but fails catastrophically on 169/176 fields. These results demonstrate that compression should be evaluated by modality-stratified downstream retention rather than single-number accuracy, and establish a reproducible protocol for auditing compressed foundation models in regulated stem-cell imaging.
Original Article
View Cached Full Text

Cached at: 09/21/26, 11:20 AM

Paper page - Retention-Constrained Post-Training Quantization of Cellpose-SAM for Stem Cell Microscopy

Source: https://huggingface.co/papers/2609.21038 https://huggingface.co/login?next=%2Fpapers%2F2609.21038-

Abstract

Inducedpluripotentstemcell(iPSC)cultureincreasinglyreliesonsegmentationfoundationmodels,yetdeploymentonlaboratoryCPUsandedgehardwarerequirescompressionschemesthatarebothefficientandauditable.Wepresentadeployment-orientedevaluationofcompressedCellpose-SAMusingapre-specifiedretentioncriterion:the95%cluster-bootstrapintervalofmeanchangefromFP32mustremainaboveafixed-0.02marginforeveryimagingmodality.Onastratified176-fieldpanelspanningBBBC038nuclei,BBBC039U2OSfluorescence,andNISTiPSCimagesacrossdensityregimes,weight-onlyW8A16preservesinstanceF1acrossallmodalities.Asensitivity-guidedmixedW4/W8scheme,usingfourINT8exceptions,achievesa6.76xreductioninweightstoragewithnoobservedcatastrophicfailures(0/176fields),matchingW8A16atthissamplesize.Incontrast,ternaryweight-onlyquantizationachieves12.08xcompressionbutfailscatastrophicallyon169/176fields.Theseresultsdemonstratethatcompressionshouldbeevaluatedbymodality-stratifieddownstreamretentionratherthansingle-numberaccuracy,andestablishareproducibleprotocolforauditingcompressedfoundationmodelsinregulatedstem-cellimaging.

View arXiv pageView PDFAdd to collection

Community

Paper author

Paper submitter

36 minutes ago

Cellpose-SAM is used for segmenting cells and nuclei in microscopy images. Deploying it directly on laboratory instruments would enable analysis at the point of acquisition, but these devices have limited compute and memory compared with specialized workstations.

We therefore asked whether Cellpose-SAM could be compressed for local deployment without compromising segmentation accuracy, and whether compression affected imaging conditions differently. Cellpose-SAM compressed 12-fold degraded on 169 of 176 image fields, while a conservative mixed-precision scheme achieved a 6.76× reduction with no observed failures. These results show that compression must be evaluated across imaging conditions, not by model size or average accuracy alone.

Upload images, audio, and videos by dragging in the text input, pasting, orclicking here.

Tap or paste here to upload images

https://huggingface.co/login?next=%2Fpapers%2F2609.21038-

Get this paper in your agent:

hf papers read 2609\.21038

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper5

#### capicu-ai/cellpose-sam-wquant-w4a16-g64 Image Segmentation• 0.2B• Updatedabout 10 hours ago • 17 #### capicu-ai/cellpose-sam-wquant-w8a8-qdq Image Segmentation• 0.3B• Updatedabout 10 hours ago • 25 #### capicu-ai/cellpose-sam-wquant-w8a16 Image Segmentation• 0.3B• Updatedabout 10 hours ago • 19 #### capicu-ai/cellpose-sam-wquant-mixed-w4-w8 Image Segmentation• 0.2B• Updatedabout 10 hours ago • 19 Browse 5 models citing this paper## Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2609.21038 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2609.21038 in a Space README.md to link it from this page.

Collections including this paper1

Similar Articles

ReQuant: Fixed-Grid Discrete Refinement for Post-Training Quantization

arXiv cs.AI

ReQuant introduces a backpropagation-free, fixed-grid discrete refinement stage for post-training quantization (PTQ) that iteratively improves initial quantized models while preserving the quantized format, showing consistent gains across various LLMs and bit-widths.