Tag
This paper examines the validity of using LLMs as data annotators, focusing on Portugal's AMALIA-9B model for European Portuguese. It finds that while the model shows agreement with human coders, its reliance on surface correlates raises concerns about construct validity, with implications for sovereign LLM programs.
Portugal released Amalia, a 9 billion parameter large language model.
The Portuguese government invested €5.5M in AMÁLIA, an open-source LLM for European Portuguese based on EuroLLM, but the model's data, weights, and benchmarks are not yet publicly available.