InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation
Summary
InsightTok introduces content-aware perceptual losses to improve discrete visual tokenization for better text and face reconstruction, enhancing autoregressive image generation quality.
View Cached Full Text
Cached at: 05/18/26, 02:23 AM
Paper page - InsightTok: Improving Text and Face Fidelity in Discrete Tokenization for Autoregressive Image Generation
Source: https://huggingface.co/papers/2605.14333 Published on May 14
#2 Paper of the day Authors:
,
,
,
,
,
,
,
,
,
,
,
Abstract
InsightTok improves discrete visual tokenization for better text and face reconstruction through content-aware perceptual losses, enhancing autoregressive image generation quality.
Text and faces are among the most perceptually salient and practically important patterns in visual generation, yet they remain challenging forautoregressive generatorsbuilt on discrete tokenization. A central bottleneck is thetokenizer: aggressivedownsamplingand quantization often discard the fine-grained structures needed to preserve readable glyphs and distinctive facial features. We attribute this gap to standarddiscrete-tokenizer objectivesbeing weakly aligned withtext legibilityandfacial fidelity, as these objectives typically optimize generic reconstruction while compressing diverse content uniformly. To address this, we propose InsightTok, a simple yet effectivediscrete visual tokenizationframework that enhances text and face fidelity through localized, content-awareperceptual losses. With a compact 16kcodebookand a 16xdownsamplingrate, InsightTok significantly outperforms priortokenizers in text and face reconstruction without compromising general reconstruction quality. These gains consistently transfer toautoregressive image generationin InsightAR, producing images with clearer text and more faithful facial details. Overall, our results highlight the potential of specialized supervision intokenizertraining for advancing discrete image generation.
View arXiv pageView PDFGitHub9Add to collection
Get this paper in your agent:
hf papers read 2605\.14333
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2605.14333 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2605.14333 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2605.14333 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting [R]
This paper introduces an adaptive video tokenisation method that exploits temporal redundancy in latent space to allocate tokens dynamically, achieving efficient compression without auxiliary networks. The proposed Latent Inpainting Transformer reconstructs dropped positions, delivering 31x speedup over ElasticTok-CV and 2x over InfoTok.
Balancing Image Compression and Generation with Bootstrapped Tokenization
Introduces SelfBootTok, a self-bootstrapped tokenization method that separates global and local information, reducing generator computation by ~40% and achieving a new state-of-the-art gFID of 1.56 with only 64 tokens.
Nemotron-Labs-Diffusion-Image: Advancing Masked Discrete Diffusion for High-Resolution Image Synthesis
This paper proposes Nemotron-Labs-Diffusion-Image, a masked discrete diffusion model for high-resolution text-to-image synthesis, introducing a token-editing mechanism and grouped cross-entropy objective to improve token refinement and training efficiency.
AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation
AVTok proposes a unified 1D tokenizer for audio-video generation using a dual-stream transformer with shared encoder-decoder and modal-specific queries, achieving compact latent representations and excelling in reconstruction and downstream generation tasks.
Unified Multimodal Autoregressive Modeling with Shared Context-Visual Tokenizer is Key to Unification
UniAR presents a unified autoregressive framework that uses a single discrete visual tokenizer to bridge visual understanding and generation, achieving state-of-the-art results in image generation and editing.