Training a vision model from scratch on iPod touch 4 images

Reddit r/LocalLLaMA Models
machine-learning computer-vision generative-models dcgan training-from-scratch image-generation

Summary

Trained a DCGAN from scratch on 350 photos of a red solo cup taken with an iPod touch 4, producing results reminiscent of early DALL-E.

I trained a DCGAN model from scratch on iPod touch 4 pics. I understand the scale needed to train a vision model from scratch so I’m starting with just 1 case/object to take pics of. I took around 350 pics of a red solo cup in different backgrounds, lighting conditions, etc. The pictures that the model generates reminds me of Open AI’s DALL E from back in 2022. I’m gonna try to take around 5000 total, I wanna see if the model can pick up on specific sensor artifacts from the iPods camera.
Original Article

Similar Articles

Improved Techniques for Training Consistency Models

OpenAI Blog

OpenAI presents improved techniques for training consistency models that enable high-quality single-step image generation without distillation, achieving significant FID improvements on CIFAR-10 and ImageNet 64×64 through novel loss functions and training strategies.

Qwen-Image-Flash (26 minute read)

TLDR AI

This paper from Alibaba revisits few-step distillation for visual generative models, focusing on training recipe factors such as data composition, teacher guidance, and task mixture, using Qwen-Image-2.0 as a case study to develop Qwen-Image-Flash.

Thinking with images

OpenAI Blog

OpenAI releases o3 and o4-mini models that can reason with images in their chain-of-thought process, enabling visual understanding through native image manipulation tools like cropping and zooming without separate specialized models. These models achieve state-of-the-art performance on multimodal benchmarks including STEM questions, chart reading, and visual search tasks.