llm-pretraining

Tag

Cards List
#llm-pretraining

InfoLaw: Information Scaling Laws for Large Language Models with Quality-Weighted Mixture Data and Repetition

Hugging Face Daily Papers ↗ · 2026-05-04 Cached

InfoLaw is a data-aware scaling framework that predicts model loss based on token consumption, model size, data mixture weights, and repetition, enabling efficient data-recipe selection under varying compute budgets.

0 favorites 0 likes
← Previous
← Back to home

Submit Feedback