Data-centric debugging for teams training neural nets [P]
Summary
WeightsLab is an open-source, PyTorch-native tool that allows teams to pause training, inspect live loss signals, and catch data issues like mislabels and class imbalance before they affect model performance. It is designed for computer vision engineers working with images, videos, and LiDAR point clouds.
Similar Articles
What I learned building a debugger for PyTorch training loops and how it changed how I think about failure diagnosis [D]
The author shares lessons from building NeuralDBG, an open-source debugger for PyTorch training loops that detects localized failures like vanishing/exploding gradients by monitoring per-layer gradient norm transitions instead of global loss. Practical code snippets and community questions are included.
WARP: Weight-Space Analysis for Recovering Training Data Portfolios
WARP is a framework that recovers the domain mixture weights of a fine-tuned model from its released weights by generating pseudo-checkpoints via model merging and extracting geometric features. It achieves low mean absolute error on BERT and GPT-2, outperforming membership inference.
Are you in the Weights?
A tool that lets you check if your data is included in the training sets of large language models, exploring the concept of digital immortality in AI.
@AnthropicAI: We also partnered with Neuronpedia to create an interactive demo of our methods on open-weights models. Try it here:
Anthropic partnered with Neuronpedia to release an interactive demo of their interpretability methods on open-weights models, called Jacobian Lens.
CoG-Guided Weight Correction for Fault-Tolerant Deep Neural Networks
Proposes a Center of Gravity guided weight correction method for fault-tolerant deep neural networks, achieving significant fault tolerance improvements on LSTM and CNN models without retraining.