Tag
SciCustom is a framework for constructing custom scientific benchmarks from large-scale data, enabling fine-grained evaluation of LLMs' scientific capabilities without expert annotation. It uses ontology-grounded knowledge units and voting-based consensus to select relevant benchmarks, demonstrated in chemistry and healthcare.