I reduced image-processing token usage by ~95% compared with GPT-4o direct vision, while maintaining roughly the same accuracy.How significant is that?[P]

Reddit r/MachineLearning News

Summary

A researcher shares preliminary results demonstrating a method that reduces image-processing token usage by approximately 95% compared to GPT-4o while maintaining similar accuracy, and seeks feedback on its significance.

I'm testing a new approach for reducing the cost of image-based LLM inference. I evaluated it on the MOMA Graph benchmark, using 1,315 questions. Compared with using GPT-4o to process the original images directly, I observed approximately: ~95% lower token usage roughly the same accuracy as the GPT-4o direct-image baseline I'm intentionally not sharing implementation details yet because the method is still under development. I'm mainly trying to understand how strong the result itself is. If these numbers hold across larger and more diverse benchmarks, would you consider this a meaningful result in multimodal AI efficiency? What evidence would you want to see before taking the claim seriously? For example: more datasets stronger baselines statistical significance latency measurements API cost comparison performance across different models failure-case analysis I'm especially interested in feedback from people working on multimodal models, VLM efficiency, or inference optimization.
Original Article

Similar Articles

Converting Text to image to save on token usage

Reddit r/ArtificialInteligence

DeepSeek's OCR paper introduces 'optical compression,' showing that an image token can encode roughly 10 text tokens' worth of information with high accuracy, making images of text more token-efficient than raw text. Community tools and a new app, Imagizer, demonstrate this approach in practice.