screenshot-to-code

A demo shows the AI model Step 3.7 Flash reading a screenshot of a dashboard, fetching live crypto prices, and building a working app in minutes for about 50 cents.

Chinese University of Hong Kong open-sourced ScreenCoder, an AI tool that can directly convert screenshots or hand-drawn sketches into editable HTML code, which has garnered 2.7k Stars on GitHub.

SPRITE introduces a pipeline that converts static game UI screenshots into editable engine assets using vision-language models and YAML to handle complex layouts and nesting.