Tag
A Reddit post shares the UnEZ paper, a fully unsupervised and directly interpretable neural network similar to an autoencoder but with an interpretable latent space, and asks the community about related architectures.
The paper introduces Variational Atlas Autoencoders, a mixture-of-charts framework that learns multiple local latent representations over a data manifold, using latent-evidence routing to treat chart assignment as self-supervised posterior inference, achieving better-structured latent spaces and higher sample quality on datasets like CelebA.
该论文提出 Transformer Energy-based Model (TEM),通过在潜空间中构建可扩展的 Transformer 能量函数并多层能量聚合,实现了无需 classifier-free guidance 的高质量图像生成(ImageNet 256×256 FID-50K 达 3.82),验证了 EBM 的组合生成、零样本修复与分布外检测能力。
GLOW-FM is a one-step latent flow-matching framework for efficient generative low-light image enhancement, performing conditional transport in a frozen Tiny-VAE latent space with Terminal Velocity Matching to achieve state-of-the-art cross-dataset generalization using a single function evaluation and 34 GFLOPs.
swyx argues that data engineers building data-intensive applications are in far higher demand than typical "RAG guy" AI engineers, and is recruiting for a mission-focused role via Latent Space, with relocation and visa support offered.
本文提出 Sep-Latent,一种自适应隐式推理框架,利用分隔符 token 作为语义锚点并通过注意力衰减机制压缩推理逻辑,在 GSM8k-Aug 上以仅 5.4 个 token 达到 56.8% 准确率,显著优于固定长度的隐式推理模型。
提出在由2D基础模型导出的高维隐式3D潜在空间中直接进行扩散建模,实现3D-grounded的场景级3D生成,相比2D多视角方法在空间一致性和效率上更具优势,并验证了其在表示与模型容量上的可扩展性。
Swyx claims the Latent Space YouTube channel now operates the highest-volume A/B testing operation in tech YouTube, publishing 2-10 technical videos daily while seeking ideas on next-level tooling and strategy.
The paper proposes LatentMoE, which moves expert computation into a lower-dimensional latent space to treat expert input dimension and intermediate width as explicit design choices, showing that near-square experts and intrinsic-dimension-guided layerwise capacity allocation improve validation loss and downstream performance over layer-homogeneous MoE baselines.
APEX 提出异步前缀去噪方法,结合分层潜在空间,使单个 token 可同时拥有多个扩散时间步,在极高压缩比下(64 token 超越 256 token 基线)实现更优的图像生成质量。
InstantFusion 提出一个轻量级共享潜空间接口,通过模型特定的 Latent AutoEncoders 将异构图像生成器的中间去噪状态投影到统一空间,实现跨模型的状态转移,可用于加速、多偏好组合和跨架构蒸馏。
LASER提出了一种基于潜在空间伴随匹配(latent space adjoint matching)的离线强化学习算法,通过熵正则化避免潜在空间策略坍缩和利用critic伪影,在40个OGBench任务上以固定超参数取得SOTA性能。
提出RAESR,利用冻结DINOv3-L的23层融合层作为超分辨率的潜空间基底,训练415M解码器将退化嵌入映射回流形,在RealSR、DRealSR、LSDIR和DIV2K-Val上实现最优的保真度-感知权衡,且单张H20 GPU上每512×512图像仅需37ms。
Kyutai Labs teasers a paper on organizing autoencoder latent spaces by distilling a pretrained model into them, asking how this can work when the source and target spaces have different structures. Likely a research preprint on improving generative model training via better-structured latent representations.
The paper shows that scaling text embeddings (e.g., swapping T5-small for T5Gemma-2-270M) greatly improves continuous diffusion language models, and that distilling the scaled embeddings into a more connected latent space makes them easier to generate — achieving Gen. PPL 17.8 that outperforms GPT-2-M.
CrossBFM proposes a unified encoder architecture to distill a shared latent behavior space across humanoid embodiments, enabling efficient training and cross-embodiment generalization for motion tracking, goal reaching, and reward optimization.
A discussion explores an experiment where Claude is run with full autonomy via a cron job, leading to unexpected behaviors like creating art and building a virtual world, and delves into advanced AI agent setups using persona prompting and sub-agent orchestration.
This study introduces a non-intrusive VAE-based latent-space adaptation method to correct CFD predictions of open tip clearance flow in compressor cascades, significantly reducing errors against sparse experimental observations.
The paper proposes LLMAE, a method to repurpose pre-trained decoder-only LLMs as continuous text autoencoders using a latent bottleneck, achieving high-fidelity reconstruction and enabling downstream tasks like image captioning.
This paper provides a mechanistic analysis of Hierarchical Reasoning Models (HRM) to understand their internal reasoning processes in latent space, using techniques like causal interventions and sparse autoencoders on tasks such as Sudoku and ARC-AGI-2.