BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding
Summary
BRepCLIP introduces contrastive multimodal pretraining on boundary representation (BRep) primitives for CAD understanding, aligning BRep geometry with language and image embeddings to achieve state-of-the-art retrieval and zero-shot classification.
View Cached Full Text
Cached at: 06/05/26, 10:10 PM
Paper page - BRepCLIP: Contrastive Multimodal Pretraining on BRep Primitives for CAD Understanding
Source: https://huggingface.co/papers/2606.05515
Abstract
BRepCLIP enables multimodal representation learning for CAD models by aligning boundary representation geometry with language and image embeddings through contrastive pretraining, achieving superior retrieval and classification performance compared to point-based methods.
Learning representations ofCAD modelsis a largely open problem. While 3D representation learning has flourished around point clouds and meshes, the native format of CAD -boundary representationsBReps, which encodes exact parametric surfaces, curves, and their topology, has received little attention as a representation learning substrate. We introduce BRepCLIP, the first framework to align BRep geometry with language and image embeddings throughcontrastive pretraining. We model each CAD object as a sequence of face andedge tokenswith separatediscrete vocabulariesfor surface and curve geometry, augmented with spatial andsemantic descriptorsthat capture surface types (e.g., cylindrical, torus, NURBS) and curve primitives (e.g., line, arc, B-spline). Atransformer encoderaggregates these tokens into aglobal BRep embedding, aligned withCLIP’s text and image encoders via a joint contrastive objective. BRepCLIPgenerates more discriminative and semantically grounded embeddings than existing point-based alternatives, improvingTop-1 retrievalover OpenShape by 40.4%, 22.0%, and 23.9% on ABC, CADParser, and Automate, respectively, and improvingzero-shot classificationon FabWave by 15% in Top-1 score. We further demonstrate its utility as a CAD-aware similarity metric for evaluating text and image-conditioned CAD generation, establishing the importance of structure-aware pretraining formultimodal CAD understanding. Project page is available at https://muhammadusama100.github.io/BrepClip2026/
View arXiv pageView PDFProject pageAdd to collection
Get this paper in your agent:
hf papers read 2606\.05515
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2606.05515 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2606.05515 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2606.05515 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
PR-CAD: Progressive Refinement for Unified Controllable and Faithful Text-to-CAD Generation with Large Language Models
PR-CAD introduces a unified framework using LLMs for iterative text-to-CAD generation and editing, achieving state-of-the-art controllability and faithfulness via reinforcement learning and a curated high-fidelity dataset.
Vision Pretraining for Dense Spatial Perception
This paper introduces masked boundary modeling, a self-supervised paradigm for vision pretraining that learns sub-pixel boundary representations to improve dense spatial perception. The resulting model, LingBot-Vision, demonstrates significant improvements in depth estimation and other downstream tasks, showing that boundary modeling is a scalable pretraining principle for spatially structured visual representations.
Embodied CAD: Solver-Grounded LLM Agents for Parametric B-Rep Assembly Modeling
Presents Embodied CAD, a closed-loop framework that grounds LLM agents in a CAD execution environment for parametric B-Rep assembly modeling, using solver feedback for planning and refinement.
CLIP: Connecting text and images
CLIP is OpenAI's vision-language model that learns from text-image pairs from the internet, enabling zero-shot visual classification without task-specific training data. It addresses major limitations in traditional computer vision by reducing dependence on expensive labeled datasets and improving real-world generalization.
IMCBench: A benchmark for multimodal LLMs in Image-grounded Medical Conversations
IMCBench is a new benchmark for evaluating multimodal LLMs on image-grounded medical conversations, pairing clinical images with synthetic patient profiles. Evaluations across safety, accuracy, and uncertainty show that even strong models like Claude Opus 4.6 have safety issues, highlighting the need for multi-dimensional evaluation.