Tag
This paper extends the MoCoP method by using deep-learning-based morphology profiles to improve molecular embeddings for QSAR predictions and toxicity assessment in drug discovery.
DanLing NestedTensor presents a PyTorch tensor abstraction for composable multi-ragged tensors, reducing padding waste in variable-size deep learning inputs and achieving significant speedups (e.g., 2.74×–3.39×) and memory efficiency improvements on A100 GPUs.
This paper introduces Staged Depth Training (SDT), a representation curriculum for Physics-Informed Neural Networks (PINNs) that explicitly learns and transfers hidden representations to improve training performance.
The paper presents a comparative study of forecasting models for neutron monitor time series, including seasonal baselines and quantum-inspired architectures, highlighting that simple and functional models perform well on periodic scientific data.
This paper introduces an algebraic framework using neural ideals and neural codes to classify and interpret features in neural networks, with practical applications on the MNIST dataset and an open-source visualization tool.
LoopVL extends Loop Transformers to vision-language models, iteratively updating a unified multimodal state through shared modules (Module-Loop and Model-Loop) and outperforming similarly sized non-recurrent models on understanding and reasoning benchmarks, with notable 'Visual Aha Moments' in attention.
The paper proposes TAPS (Trajectory Adaptive Progress–Fluctuation Scheduler), which adaptively adjusts the step size of recurrent updates in looped transformers by decomposing terminal loss sensitivity into persistent progress and centered fluctuation, improving accuracy without retraining and delivering up to 1.56× wall-clock speedup when applied during training.
AMD is acquiring Fei-Fei Li's World Labs for $8.2 billion to enhance its AI capabilities and compete with Nvidia in the development of world models for physical understanding.
Fei-Fei Li announces that her AI startup World Labs is joining AMD, highlighting the company's work in spatial intelligence and the release of Atlas, a model for new camera view prediction.
Acacia is a graph foundation model trained exclusively on the Common Crawl web graph, supporting arbitrary features, various tasks like node classification and link prediction, and in-context learning without relying on pretrained LLMs.
This paper presents an Insurance Reserve Intelligence Platform using Physics-Informed and Knowledge-Informed Neural Networks for accurate and efficient term-life insurance reserve prediction, achieving high accuracy and 119.53 times faster inference than classical solvers.
This paper investigates whether audio large language models can detect unreliable transcriptions and proposes a lightweight predictor using audio encoder representations to trigger clarification requests.
AFP-GIC is an IEEE Access 2026 paper proposing Adaptive Fused Prior Transfer for controllable generative image compression, achieving up to 167:1 compression with a single pretrained model across five bitrate operating points and reducing decoder latency by 18.1% versus DC-VIC.
WorldAttention proposes an efficient attention architecture with Hybrid Sparse Attention and Hierarchical KV Cache for interactive video world models, achieving state-of-the-art performance on benchmarks like VBench-Long and InterVBench.
InfiniHand is an end-to-end streaming framework for world-space hand motion estimation from egocentric video, jointly estimating hand parameters, camera trajectories, and locations to reduce errors and improve performance over state-of-the-art baselines.
MEM v3 is a memory management tool for PyTorch that dynamically adjusts batch size and gradient accumulation to prevent CUDA OOM crashes during training and fine-tuning, featuring chaos resistance, crash-proof checkpoints, and live telemetry.
TT-VidT is a new video pretraining method that efficiently models motion by decoupling the temporal axis, achieving state-of-the-art results on motion-centric benchmarks with reduced computational cost.
The paper introduces a structured residual connectivity design for diffusion transformers that enables adaptive cross-layer connections, leading to faster convergence and improved image synthesis quality with minimal parameter increase.
This article describes Sebastian Raschka's YouTube video episode on reasoning techniques in AI, focusing on log-probability scoring and self-refinement to improve model performance without retraining.
The article explains why replacing a dense feed-forward layer with a top-2 Mixture of Experts (MoE) in LLMs can increase inference latency due to communication overheads in multi-GPU setups, despite reducing FLOPs per token.