TRELLIS.2 image-to-3D now runs on Mac (Apple Silicon) - no NVIDIA GPU needed

Reddit r/LocalLLaMA Tools

Summary

A developer ported Microsoft's TRELLIS.2 image-to-3D model to run on Apple Silicon Macs by replacing CUDA-only dependencies with PyTorch MPS equivalents, enabling offline 3D mesh generation without requiring NVIDIA GPUs.

I ported Microsoft's TRELLIS.2 to run on Apple Silicon via PyTorch MPS. The original depends on five CUDA-only compiled extensions (flex\_gemm, flash\_attn, o\_voxel, cumesh, nvdiffrast) that have no Mac equivalent. Wrote replacement backends from scratch: \- Pure-PyTorch sparse 3D convolution (replacing flex\_gemm) \- Python mesh extraction using spatial hashing (replacing CUDA hashmap ops in o\_voxel) \- SDPA attention for sparse transformers (replacing flash\_attn) \- GPU-accelerated trilinear voxel sampling via torch.grid\_sample on MPS Generates \~400K vertex meshes from a single photo in about 3.5 minutes on M4 Pro (24GB). Texture baking takes about 18 seconds using MPS GPU acceleration. Not as fast as H100 but works offline with zero Cloud cost. Repo: https://github.com/shivampkumar/trellis-mac
Original Article

Similar Articles