llm-data

OntoBook converts medical ontology graphs into synthetic textbook prose using LLMs, then uses the resulting 1.3M French textbooks to pretrain ModernCamemBERT, achieving significant gains on medical coding benchmarks.

DataFlow is an open-source tool with visual, low-code pipelines to generate, clean, and prepare high-quality LLM training datasets from raw data. It includes a technical report on arXiv.