deep-learning

A curated roundup of the top AI papers from August 3-9, featuring works such as Rehearse, Zero-Mem, DataSpace, Harness-R1, and Prompt-Induced Waste.

An approachable explanation of why transformers need positional encoding, using a bug report analogy and Python's Counter to illustrate how parallel processing loses word order.

Highlights a paper introducing ZeRO (Zero Redundancy Optimizer), a memory optimization system for efficiently training extremely large models on limited GPU memory.

Stanford's CS230 Deep Learning (Autumn 2025) course playlist is shared on YouTube, offering free access to the lectures.

This paper presents an equipment-centric framework that uses deep learning-based vision and event-driven finite state machines to localize workpieces in hot forging factories, achieving high detection accuracy and low latency in operational settings.

This paper identifies an objective gap in Direct Forecasting for multivariate time series and proposes CvLoss, a plug-in structural regularizer that constrains forecast residuals on a cross-variable graph to improve consistency across synchronous and asynchronous interactions. Experiments show consistent improvements over competitive forecasting models.

This paper introduces Matrix Zonotopic Attention (MZAttn), a context-adaptive value projection for set transformers, and provides a theoretical analysis showing it can represent target operators that standard attention requires depth to approximate. Experiments demonstrate performance gains on high-rank combinatorial set-prediction tasks.

This paper introduces Unscented KalmanNet (UKN), a hybrid deep learning filter that augments the Unscented Kalman Filter with learned components to improve state estimation accuracy and covariance calibration under unknown noise statistics and model mismatch. Experiments show significant RMSE reductions over UKF and other KalmanNet variants.

CAMP introduces a cycle-aware multi-scale patch mixer for time series forecasting, achieving state-of-the-art results on multiple benchmarks through adaptive cycle learning and horizon-guided patch refinement.

This paper introduces NeuMoSync, a novel architecture that integrates neuron-specific neuromodulatory signals into deep neural networks to improve plasticity and adaptability in continual learning, demonstrating strong performance across multiple benchmarks.

ENCODE GRAMMAR is a deep learning model resource for decoding DNA sequence logic of regulatory elements in the human genome, with a blog series covering model access, interpretation, and applications.

A research paper evaluating CHAP, a CNN-BiLSTM model, for classifying sedentary behavior from wearable accelerometer data, focusing on transfer from hip to wrist placement and the benefits of finetuning.

This paper introduces a contrast-invariant deep ptychography neural network that uses a factorization strategy to decouple learned object texture from measurement scaling, enabling consistent reconstructions across varying illumination conditions. The method achieves up to 5x reduction in Fourier error over the previous PtychoPINN-torch baseline across multiple experimental datasets.

This paper introduces GLOBE, a trajectory-aligned coreset selection framework that uses gradient trajectories across multiple checkpoints and multi-order matching with structured sparse optimization to select compact, representative training subsets, outperforming existing methods on six benchmarks.

This paper unifies Euclidean residual connections and geodesic normalization on the hypersphere, introducing a one-parameter family of angular retractions called p-SpheretNorm. The proposed norm-preserving algebraic methods outperform existing deep connection schemes on nanoGPT, showing the exponential map is just one end of a spectrum.

This paper proposes a multi-representation deep learning framework combining CNNs, LSTMs, and recurrence plot analysis to characterize alpha and gamma EEG biomarkers in Fragile X Syndrome, showing improved classification over single-modality baselines.

DSETA is a dual-stage continual learning framework for travel time prediction that separates intra-day real-time adaptation from inter-day long-term trend learning, with online A/B tests showing MAE reductions across three cities and successful deployment in DiDi's production environment.

This paper proposes a retain-aware localization method for machine unlearning that reduces collateral damage to semantically similar retained examples, and introduces a retain-similar evaluation set. Experiments on CIFAR-10 with ResNet18 show reduced collateral damage and improved unlearning metrics.

This paper analyzes the Virtual Cell Challenge benchmark for held-out CRISPRi perturbation prediction, finding that simple magnitude-based scalar features outperform deep MLP encoders, and that magnitude-only predictors transfer better across cell types.

A deep learning CNN model from Seoul National University forecast a very strong El Niño months ahead of NOAA's physics-based models, and has been validated as the models converged. The AI also predicts a La Niña flip in 2028, far beyond traditional forecast horizons.