This is some next level VFX Reality-Aware rendering

Reddit r/singularity Products

Summary

Simulon introduces Reality-Aware Rendering on iPhone, letting users place neural assets via their phone, act out a scene, and have the app regenerate the take so assets react to actions, speech, and surroundings. An Android release is planned.

Found this on Instagram: Introducing Reality-Aware Rendering in Simulon, a completely new way to create with the real world. Place neural assets with your phone and act out the scene. When you stop recording, Simulon renders the take, reading everything in it (what you do, what you say and the place around you), and your assets respond to all of it. The final is regenerated from your recording: a new performance of the scene, not a copy of the footage. Available now on iPhone. Coming to Android soon. https://www.instagram.com/simulon\_
Original Article

Similar Articles

Image2Sim: Scaling Embodied Navigation via Generative Neural Simulator

Hugging Face Daily Papers

Image2Sim is a neural simulation framework that creates high-fidelity interactive environments from RGB-D images, enabling scalable training for embodied navigation agents. It generates nearly 20K scenes and over 10 million training samples, showing strong benchmark improvements and effective real-world zero-shot transfer.

@yoheinakajima: this stuff is so cool

X AI KOLs Following

Marc demonstrates depth-aware light injection in VisionCamera using DINOv2 and Apple Vision framework, enabling real-time rendering with react-native-webgpu.