Teaching LLMs a Low-Resource Language: Enhancing Code Completion in Pharo

Hugging Face Daily Papers Papers

Summary

This paper presents an end-to-end pipeline for adapting LLMs to low-resource programming languages, using Pharo as a case study, achieving superior code completion with small models suitable for real-time IDE support.

Large Language Models (LLMs) unlocked new possibilities in automated code writing, becoming the backbone of most code completion tools. While LLMs excel in mainstream languages, they often lack support for the so-called low-resource languages where training data is scarce. As a result, these languages lag behind in the quality of code completion tooling available to their communities. A concrete example is Pharo, a Smalltalk-inspired language whose IDE currently offers only single-token completion. In this work, we report on our experience bringing LLM-based code completion to Pharo. First, we describe an end-to-end pipeline that combines Pharo-specific data curation, continued pre-training and fine-tuning of open code LLMs. Second, we introduce a set of Pharo code completion benchmarks designed to evaluate whether models (i) learn Pharo's syntax and (ii) accurately complete masked Pharo code from real-world GitHub repositories. Third, we show empirically that Pharo-specialized models substantially outperform their original base checkpoints and also exceed the accuracy of substantially larger code LLMs on Pharo completion. Overall, our case study demonstrates the feasibility of bringing strong LLM-based code completion to low-resource programming languages, with models small enough to provide ``real-time'' in-IDE support.
Original Article
View Cached Full Text

Cached at: 07/09/26, 07:50 AM

Paper page - Teaching LLMs a Low-Resource Language: Enhancing Code Completion in Pharo

Source: https://huggingface.co/papers/2607.04939

Abstract

Large language models can be adapted for low-resource programming languages through specialized training pipelines and benchmarks, achieving superior code completion performance compared to general-purpose models.

Large Language Models(LLMs) unlocked new possibilities in automated code writing, becoming the backbone of mostcode completiontools. While LLMs excel in mainstream languages, they often lack support for the so-called low-resource languages where training data is scarce. As a result, these languages lag behind in the quality ofcode completiontooling available to their communities. A concrete example is Pharo, a Smalltalk-inspired language whose IDE currently offers only single-token completion. In this work, we report on our experience bringing LLM-basedcode completionto Pharo. First, we describe an end-to-end pipeline that combines Pharo-specific data curation,continued pre-trainingandfine-tuningof open code LLMs. Second, we introduce a set of Pharocode completion benchmarksdesigned to evaluate whether models (i) learn Pharo’s syntax and (ii) accurately complete masked Pharo code from real-world GitHub repositories. Third, we show empirically that Pharo-specialized models substantially outperform their original base checkpoints and also exceed the accuracy of substantially larger code LLMs on Pharo completion. Overall, our case study demonstrates the feasibility of bringing strong LLM-basedcode completionto low-resource programming languages, with models small enough to provide ``real-time’’ in-IDE support.

View arXiv pageView PDFGitHub0Add to collection

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2607.04939 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2607.04939 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2607.04939 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

No Code LLM Finetuning

Reddit r/AI_Agents

This article discusses making LLM finetuning accessible to non-coders, highlighting a video demonstration of how anyone can customize LLMs without coding.