I have trained a model to predict my blood sugar [P]
Summary
The author trained an encoder-only transformer to predict future blood glucose levels from past glucose, carbs, insulin, and future meal/insulin inputs, releasing the MIT-licensed source code with pretrained weights.
Similar Articles
CGM-JEPA: Learning Consistent Continuous Glucose Monitor Representations via Predictive Self-Supervised Pretraining
Introduces CGM-JEPA, a self-supervised pretraining framework for continuous glucose monitor data that improves cross-modal and cross-cohort performance through masked latent prediction and distributional objectives.
Evidence-Guided Neural Architecture Selection under Uncertainty for Subject-Specific Blood Glucose Forecasting
Proposes EVIDENT, a framework that integrates Bayesian training and evidence-based ranking for neural architecture selection, demonstrated on subject-specific blood glucose forecasting in type 1 diabetes, systematically selecting low-capacity models that generalize reliably.
Trained transformer-based chess models to play like humans (including thinking time) [P]
Trained transformer-based chess models for rating buckets from 800 to 2500+, predicting moves, thinking time, and outcome. Achieves strong accuracy with only 9M parameters, and includes a novel thinking-time prediction component.
Next-Latent Prediction Transformers [R]
Microsoft Research introduces Next-Latent Prediction (NextLat), a self-supervised method that trains transformers to predict their own next latent state, enabling compact world models for reasoning and planning and achieving up to 3.3x faster inference via self-speculative decoding.
@TeachTheMachine: Using a Transformer Model: From Training to Inference
This tutorial covers how to use a transformer model from training to inference, focusing on autoregressive generation, prefill vs. decode phases, and key-value caching for efficient inference.