Show HN: Sign language translation with smart glasses

Hacker News Top Tools

Summary

Hand Wave is an open-source sign language recognition system for web and iOS, backed by a Python inference service, aiming to enable translation via smart glasses.

Hi!<p>I have relatives that speak sign language, and always found it odd that despite unbelievable advances in AI in recent years, the problem still felt somewhat neglected.<p>Especially with the advent of wearable tech; to my knowledge, this is the first project that integrates the meta glasses w&#x2F; fingerspelling translation software.<p>As for the technical aspect, I trained a neural net on Google&#x27;s FSboard dataset modeling a CNN + GRU temporal encoder architecture (trained with CTC), and then decoded the output with CTC beam search and a KenLM language model to solve some of the deficiencies with my model.<p>I&#x27;ve also made it cross-platform (web + iOS, with both web screen sharing and the ability to use non smart-glasses). The project is entirely FOSS.<p>I&#x27;m currently working on making the on-device model work cleanly, but unfortunately performance takes a bit of hit on lower-end devices so for now I&#x27;ve opted for hosting the model on Modal.<p>There&#x27;s so much room for improvement, but I&#x27;m happy with this starting point. Let me know what you think, and check out the YouTube demo!
Original Article
View Cached Full Text

Cached at: 08/08/26, 11:17 AM

aadisang/hand-wave

Source: https://github.com/aadisang/hand-wave

Hand Wave

Sign recognition for web and iOS, backed by a small Python inference service.

Watch the demo on YouTube

Setup

Requirements: pnpm 10.33+, Node 22+, Python 3.11/3.12, uv, and moon.

cp .env.example .env
pnpm install
uv sync --project apps/inference

Don’t forget to set VITE_INFERENCE_URL in .env.

Development

pnpm dev

Research Credits

Similar Articles

Hand Wave

Product Hunt

Hand Wave is a smart glasses product that translates sign language into speech, aimed at improving accessibility for deaf and hard-of-hearing users.

Show HN: Subvocal – Talk to your computer without making noise

Hacker News Top

Show HN: Subvocal (YC F26) presents smart glasses that decode silently mouthed or internal speech into text using RF sensing through the face, replacing their earlier EMG prototype with antenna-embedded frames and foundation models trained on scaled pretraining data.

Toward Real-Time Sentence-Level Sign Language Translation

arXiv cs.CL

This paper presents a sentence-level sign language translation system fine-tuned with QLoRA on a subset of How2Sign, achieving BLEU 15.9. Its main contribution is a hardware-aware streaming pipeline using a Raspberry Pi 4B client and a CPU/GPU backend, reducing mean latency by 27.71%.