alkhder at AlexandriaX-2026: Context-Aware English-to-Dialectal Arabic Dialogue Translation with QLoRA-Fine-Tuned NileChat-3B
Summary
Team Alkhder's AlexandriaX-2026 shared-task submission QLoRA-fine-tunes NileChat-3B-Base for context-aware English-to-13-dialectal-Arabic dialogue translation, achieving spBLEU 20.36 and chrF++ 36.64 while ranking sixth in both tracks.
View Cached Full Text
Cached at: 10/19/26, 07:11 AM
# alkhder at AlexandriaX-2026: Context-Aware English-to-Dialectal Arabic Dialogue Translation with QLoRA-Fine-Tuned NileChat-3B
Source: [https://arxiv.org/html/2610.22525](https://arxiv.org/html/2610.22525)
rmTeXGyreTermesX \[\*devanagari\]rmLohit Devanagari
###### Abstract
This paper describes team Alkhder’s submission to Subtask 1 of the AlexandriaX\-2026 shared task, which asks systems to translate English dialogue turns into thirteen Arabic dialects\. We fine\-tune NileChat\-3B\-Base with QLoRA on the Alexandria parallel dialogue corpus, training one set of adapter weights for all dialects\. Each turn is translated conditioned on the target country and dialect, the domain, the participant roles, the speaker–addressee gender direction, and the preceding dialogue context\. At inference, conversations are translated autoregressively and the model is fed its own previous outputs back as context without using any gold target\-side test information\. Under the constrained track, using only Alexandria data, it trains in about one hour and translates the private test set in under two hours\. The system reaches a country\-macro\-averaged spBLEU of 20\.36 and chrF\+\+ of 36\.64 on both tracks\.
## 1Introduction
Dialectal Arabic machine translation \(MT\) remains difficult because Arabic varieties differ from Modern Standard Arabic \(MSA\) and from one another in vocabulary, morphology, syntax, pragmatics, and sociolinguistic use, including across cities within the same country\([Abdul\-Nabi et al\., 2024](https://arxiv.org/html/2610.22525#bib.bib5)\)\. Progress is limited by scarce and domain\-specific parallel data\([Meftouh et al\., 2015](https://arxiv.org/html/2610.22525#bib.bib10);[Bouamor et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib8);[Mohamed et al\., 2023](https://arxiv.org/html/2610.22525#bib.bib9)\), non\-standardized spelling\([Alhafni et al\., 2024](https://arxiv.org/html/2610.22525#bib.bib11);[Kheder et al\., 2024](https://arxiv.org/html/2610.22525#bib.bib12)\), and the need to use dialogue context and speaker information during translation\([El Mekki et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib27);[Bawden et al\., 2016](https://arxiv.org/html/2610.22525#bib.bib13)\)\. The AlexandriaX\-2026 shared task\([El Mekki et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib27)\)addresses these issues by evaluating systems on meaning preservation and dialect\-specific adaptation\.
We participate in Subtask 1,*Context\-Aware English\-to\-Dialectal Arabic Dialogue Translation*, in both the constrained and unconstrained track\. The task is to translate selected English dialogue turns into one of thirteen dialectal Arabic varieties, using the available conversational and metadata context\. Two varieties, Libyan and Sudanese, have no training data and are therefore evaluated in a zero\-shot setting\.
We build one system that satisfies the constrained track rules and submit it to both the constrained and unconstrained rankings\. The system fine\-tunes NileChat\-3B\-Base\([El Mekki et al\., 2025](https://arxiv.org/html/2610.22525#bib.bib2)\), a 3B\-parameter Arabic and dialect\-focused language model, with QLoRA\([Dettmers et al\., 2023](https://arxiv.org/html/2610.22525#bib.bib3)\)on turn\-level prompts derived from the Alexandria corpus\([EL Mekki et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib1)\)\. Each prompt includes the target dialect and the relevant dialogue metadata\. One set of adapter weights is used for all dialects\.111Code:[https://github\.com/HasanAlkheder/AlexandriaX2026\-Subtask1](https://github.com/HasanAlkheder/AlexandriaX2026-Subtask1)\.
We show that this compact approach trains in about one GPU\-hour and covers all dialects\. The system achieves a country\-macro\-averaged spBLEU of 20\.36 and chrF\+\+ of 36\.64, ranking sixth in both tracks\. We show that, as implemented, self\-generated dialogue context contributes no measurable benefit\. We further discuss the challenge imposed by the strong per\-country resource imbalance in the training data against the country\-macro\-averaged evaluation metric\.
The paper proceeds as follows\. Section[2](https://arxiv.org/html/2610.22525#S2)covers the task setup and related work, Section[3](https://arxiv.org/html/2610.22525#S3)our system, and Section[4](https://arxiv.org/html/2610.22525#S4)the experimental configuration\. Section[5](https://arxiv.org/html/2610.22525#S5)reports results, before concluding in Section[6](https://arxiv.org/html/2610.22525#S6)\.
## 2Background
### 2\.1Task setup
AlexandriaX\-2026\([El Mekki et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib27)\)includes three subtasks: context\-aware English\-to\-dialectal Arabic dialogue translation, cross\-dialect Arabic MT for short financial queries, and diagnostic MT evaluation based on error spans and an LQM\-inspired typology\([Malaysha et al\., 2024](https://arxiv.org/html/2610.22525#bib.bib16);[Magdy et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib15)\)\. We participate in Subtask 1, which requires systems to translate selected English turns into a specified Arabic dialect using dialogue context, country and dialect labels, domain, persona descriptions, speaker–addressee gender direction and turn position\. The translation must preserve meaning and use appropriate lexical, morphological, pragmatic and sociolinguistic forms\. We enter both tracks\. The constrained track allows only Alexandria data and models with up to 5B parameters, whereas the unconstrained track permits external data and models of any size\.
### 2\.2Data
The task uses the Alexandria corpus\([EL Mekki et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib1)\), which contains multi\-domain, multi\-turn English–dialectal Arabic conversations from thirteen countries\. Training and development data are available for eleven countries and contain 66,480 and 12,250 turns, respectively\. The data are highly imbalanced, with 14,933 Palestinian training turns compared with 2,034 Tunisian turns \(Table[1](https://arxiv.org/html/2610.22525#S2.T1)reports the train\+dev pool\)\. Libya and Sudan have no training or development data and are evaluated zero\-shot\. The public test set contains 14,442 turns, while the private test set contains 14,459 turns across 4,673 conversations, distributed near\-uniformly over the thirteen countries \(roughly 1,100 turns each, with 1,309 for Libya and 915 for Sudan\) and scored through CodaBench\.
Table 1:Turn\-level training examples per country\. Libya and Sudan have no training data\.
### 2\.3Related Work
Early dialectal Arabic MT addressed limited data through crowdsourcing and MSA\-based pivoting\([Zbib et al\., 2012](https://arxiv.org/html/2610.22525#bib.bib7);[Salloum and Habash, 2013](https://arxiv.org/html/2610.22525#bib.bib19)\)\. Later resources such as PADIC, MADAR and AraBench expanded corpus coverage and evaluation, but remained limited by restricted domains and data scarcity\([Meftouh et al\., 2015](https://arxiv.org/html/2610.22525#bib.bib10);[Bouamor et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib8);[Sajjad et al\., 2020](https://arxiv.org/html/2610.22525#bib.bib20)\)\. Arabic\-specific pretrained models and instruction\-tuned LLMs have improved performance, although results remain uneven across dialects\([Kadaoui et al\., 2023](https://arxiv.org/html/2610.22525#bib.bib14);[El Mekki et al\., 2025](https://arxiv.org/html/2610.22525#bib.bib2);[Alkhder and Abboush, 2026](https://arxiv.org/html/2610.22525#bib.bib18);[Jon et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib26)\)\.
Arabic dialects also lack standardized orthographies, which creates multiple valid spellings and affects automatic evaluation\. Existing approaches normalize dialectal text into CODA or MSA\([Habash et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib21);[Alhafni et al\., 2024](https://arxiv.org/html/2610.22525#bib.bib11);[Khered et al\., 2025](https://arxiv.org/html/2610.22525#bib.bib6)\)\. Context\-aware MT further shows that previous dialogue turns improve coherence, pronoun resolution and ambiguity resolution, while speaker information such as gender helps reduce agreement errors\([Tiedemann and Scherrer, 2017](https://arxiv.org/html/2610.22525#bib.bib22);[Voita et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib23);[Bawden et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib24);[Vanmassenhove et al\., 2018](https://arxiv.org/html/2610.22525#bib.bib25)\)\. AlexandriaX\-2026 extends this work to English\-to\-dialectal Arabic translation across thirteen varieties by providing dialogue history and speaker–addressee gender metadata\.
Recent low\-resource MT systems adapt pretrained multilingual models\([DeGenaro and Lupicki, 2024](https://arxiv.org/html/2610.22525#bib.bib17)\)\. Parameter\-efficient methods such as LoRA and QLoRA make this feasible with limited computational resources\([Hu et al\., 2022](https://arxiv.org/html/2610.22525#bib.bib4);[Dettmers et al\., 2023](https://arxiv.org/html/2610.22525#bib.bib3)\)\.
## 3System Overview
Instruction
translate final turn into⟨\\langledialect⟩\\rangleMetadata
country⋅\\cdotdialect⋅\\cdotdomain
personas⋅\\cdotgender directionContext\(last 4 turns\)
EN<t\+ AR<tQuery
English turnttprompt for turnttNileChat\-3B\-Basefrozen, 4\-bit NF4LoRAr=16r\{=\}16trainableArabicturnttself\-generated context:t→t\+1t\\rightarrow t\{\+\}1Figure 1:System overview\.### 3\.1Prompt construction
Every training and test example is formatted as one instruction\-style prompt with four blocks: \(i\) aninstructionto translate only the final English turn into the named dialect, preserving meaning, tone, register, persona and gender agreement; \(ii\) ametadatablock giving the target country and dialect name, domain, participant descriptions, and the current speaker with the gender direction \(e\.g\.female→\\rightarrowmale\); \(iii\) thecontext, i\.e\. the conversation so far truncated to the last four turns, where each previous turn appears as its English source and, when available, its Arabic translation; and \(iv\) thequery, the English turn to translate, followed by a fixed response marker\. Appendix[A](https://arxiv.org/html/2610.22525#A1)provides a prompt template\.
The dialect is specified in natural language, allowing one adapter to serve all thirteen varieties, including the zero\-shot Libyan and Sudanese dialects\. Although Libyan and Sudanese are absent from fine\-tuning, the model can associate them with related varieties seen during pretraining, namely Maghrebi Arabic for Libyan and Egyptian Arabic for Sudanese\. Training prompts use gold Arabic translations in the context, whereas inference prompts use the model’s own previous outputs\.
### 3\.2Base model and fine\-tuning
As our base model, we select NileChat\-3B\-Base\([El Mekki et al\., 2025](https://arxiv.org/html/2610.22525#bib.bib2)\), a dialect\-focused Arabic language model with≈\\approx3B parameters leaving headroom under the 5B constrained track limit\. We fine\-tune with QLoRA\([Dettmers et al\., 2023](https://arxiv.org/html/2610.22525#bib.bib3)\)\. The base weights are frozen and quantised to 4\-bit NF4 with double quantisation and bfloat16 compute\. Low\-rank adapters\([Hu et al\., 2022](https://arxiv.org/html/2610.22525#bib.bib4)\)withr=16r=16,α=32\\alpha=32and dropout0\.050\.05are trained on all attention and MLP projection matrices \(q/k/v/o\_proj,gate/up/down\_proj\)\. Training is run for one epoch using an adapter trained jointly on the eleven dialects for which training data are available\. This also supports transfer across varieties and enables zero\-shot evaluation for Libyan and Sudanese, for which no training data are available\. Zero\-shot varieties are reached at inference only, through the natural\-language dialect label and the model’s pretraining exposure to related varieties\. Appendix[B](https://arxiv.org/html/2610.22525#A2), Table[8](https://arxiv.org/html/2610.22525#A2.T8)lists the configuration\.
### 3\.3Context\-aware inference
At test time, conversations are translated sequentially in dialogue order\. Each Arabic translation the model produces for turnttis inserted into the context of turnt\+1t\+1\. The dialogue context is therefore self\-generated without using target\-side information from the test set\. This prevents leakage but could lead to error propagation since a mistranslated turn remains visible for up to four subsequent turns\. Decoding is greedy \(num\_beams=1\{=\}1\) with a repetition penalty of 1\.05 and a cap of 200 new tokens\. For throughput, at each turn position prompts from 16 conversations are batched with left padding and generated in parallel\. All predictions are cached to persistent storage per country and the pipeline can be restarted after interruptions\. Figure[1](https://arxiv.org/html/2610.22525#S3.F1)summarizes our system\.
## 4Experimental Setup
### 4\.1Data preparation
We fold the dev split into training and create one supervised example for each dialogue turn\. Each example contains the metadata, the preceding turns with their English sources and gold Arabic translations, and the gold Arabic translation of the current turn\. This yields 78,730 examples \(66,480 train \+ 12,250 dev\)\. Because the official metric macro\-averages over countries, we cap each country at 2,500 randomly sampled examples\. The cap applies to all eleven varieties with training data and acts as a uniform downsample that equalises per\-country counts \(2,500 each, 27,500 in total\) \(Table[1](https://arxiv.org/html/2610.22525#S2.T1)\)\.
### 4\.2Preprocessing and training
Prompts are limited to four preceding turns and truncated to 896 tokens, with older context removed first\. We apply no orthographic normalization, dediacritization or transliteration because the Alexandria references preserve the original dialectal writing, including code\-switched Latin\-script tokens\. We train for one epoch with a learning rate of2e−42\\mathrm\{e\}\{\-4\}, cosine scheduling, 20 warmup steps, an effective batch size of 16, 1,719 optimizer steps, paged 8\-bit AdamW and bf16 computation\. Training uses one NVIDIA A100\-SXM4\-80GB GPU and takes approximately one hour\. Decoding the private test set takes approximately 1\.5 hours\.
### 4\.3Submission and evaluation
We submit predictions for every private\-test turn in both tracks using the official JSON format\. The files are validated to ensure complete coverage and no missing, duplicate or empty predictions before submission\. The primary metric is country\-macro\-averaged spBLEU, with chrF\+\+ reported as a secondary metric\.
## 5Results
### 5\.1Official results
Table[2](https://arxiv.org/html/2610.22525#S5.T2)presents the official results\. Our system achieves 20\.36 spBLEU and 36\.64 chrF\+\+, ranking sixth in both the constrained and unconstrained tracks\. The same predictions were evaluated in both tracks\. Compared with the leading systems, we retain 80\.7% of the chrF\+\+ score but only 66\.9% of the spBLEU score\. Against the best unconstrained system, the figures are 76\.1% and 60\.8%\. The chrF\+\+/spBLEU ratio in Table[2](https://arxiv.org/html/2610.22525#S5.T2)increases monotonically with rank in both tracks, suggesting outputs that remain similar at the character level but differ in inflection, clitic attachment, spelling or lexical choice\.
Table 2:Official Subtask 1 results\.
### 5\.2Post\-submission analysis
These experiments were conducted post submission using matched public\-test references and a fixed ablation set\.
#### Code\-switching\.
The system learns to code\-switch in the varieties where the references use Latin\-script material most frequently, especially Tunisian and Moroccan Arabic\. However, its code\-switching density is lower than the references in the main code\-switching varieties, reaching 35–58% of the reference token rate \(0\.58 for Tunisian, 0\.58 for Moroccan, 0\.48 for Lebanese, 0\.35 for Egyptian and 0\.15 for Mauritanian; Table[3](https://arxiv.org/html/2610.22525#S5.T3)\)\. We report percentage of turns containing at least one Latin\-script token, percentage of all tokens in Latin script \(token rates are Latin\-script tokens divided by all whitespace\-delimited tokens on that side’s text\), and the ratio of system to reference token rates\.
Table 3:Latin\-script code\-switching on the matched public\-test pair\.Replacing omitted loanwords with Arabic paraphrases reducesnn\-gram overlap and likely contributes to the lower spBLEU scores\. In the two zero\-shot varieties the direction reverses\. The system over\-produces Latin\-script tokens relative to the references \(1\.27 for Libyan, 1\.63 for Syrian\)\. Under\-production is therefore specific to the dialects whose references code\-switch heavily, while the consistent relationship between the dialect label and code\-switching density shows that the natural\-language dialect label affects register\-level behaviour, not only vocabulary\.
#### Context ablation\.
We compared self\-generated history, gold Arabic history and empty history on 200 conversations per country \(Table[4](https://arxiv.org/html/2610.22525#S5.T4)\)\.
Table 4:Context ablation on 200 conversations per country \(8,000 turns\), scored against public\-test references\.Gold history achieves 21\.62 macro spBLEU and 37\.66 chrF\+\+, while empty history achieves 21\.41 and 37\.23\. The submitted self\-generated condition performs worst, with 20\.56 spBLEU and 36\.73 chrF\+\+\. This shows that the model gains little from dialogue history and that errors in its previous translations can outweigh the benefits of context\. The effect is consistent and empty history matches or outperforms the submitted self\-generated condition in all thirteen varieties \(Table[5](https://arxiv.org/html/2610.22525#S5.T5)\)\.
Table 5:Per\-country context ablation \(macro spBLEU\)\.
#### Orthographic normalization\.
Normalizing system outputs and references with five rulesrules—given in Appendix[C](https://arxiv.org/html/2610.22525#A3)—increases macro spBLEU from 20\.80 to 22\.36 and chrF\+\+ from 37\.01 to 38\.28\. The largest spBLEU improvements occur for Saudi \(\+2\.68\), Omani \(\+2\.56\), Sudanese \(\+2\.11\) and Egyptian \(\+2\.08\) Arabic, and the smallest for Moroccan \(\+0\.64\) and Syrian \(\+0\.73\) \(Table[6](https://arxiv.org/html/2610.22525#S5.T6), and per\-country gains in Appendix[D](https://arxiv.org/html/2610.22525#A4), Table[9](https://arxiv.org/html/2610.22525#A4.T9)\)\. However, normalizing system outputs only, while leaving references unchanged, reduces macro spBLEU from 20\.80 to 15\.49 \(−5\.31\-5\.31\)\. This suggests that the model already matches the spelling style of the corpus\. Changing only the model outputs breaks matches with the references\. Normalization is therefore only useful for analysis, when both the model outputs and the references are normalized in the same way\. It should not be applied to the submitted outputs as it would lower the score\.
Table 6:Effect of orthographic normalzation on the public\-test evaluation\.
#### MSA fallback\.
The system does not show a strong general tendency to fall back to MSA\. Its MSA function\-word rates are close to the reference rates, with only small positive residuals for Sudanese \(\+0\.34\), Tunisian \(\+0\.35\) and Mauritanian \(\+0\.18\) \(Table[7](https://arxiv.org/html/2610.22525#S5.T7)\)\. The apparent MSA signal in the raw system outputs therefore largely reflects the reference texts and not systematic model behavior\.
Table 7:MSA function\-word rate difference\.
#### Manual error analysis\.
We annotated 60 private\-test turns, approximately five per country, using categories adapted from the shared task’s LQM\-inspired typology\. Twenty\-three turns were error\-free \(Appendix[E](https://arxiv.org/html/2610.22525#A5), Table[10](https://arxiv.org/html/2610.22525#A5.T10)\)\. Content errors were most common \(19\), followed by dialect–MSA confusion \(11\), which was concentrated in Libyan \(3\), Sudanese \(3\) and Mauritanian \(2\)\. Morphological agreement errors occurred in 8 turns across eight countries, while orthographic errors occurred in 2\. Six further turns had understandable content but sounded non\-native in register\. The LLM annotator identified the content and morphology errors but missed these foreign\-register cases, showing the value of human evaluation for dialectal naturalness\.
## 6Conclusion
We present a compact, dialect\-focused 3B model fine\-tuned with QLoRA on turn\-level metadata\-rich prompts\. This provides a practical constrained track system for context\-aware dialectal Arabic dialogue translation\. The system trains in about one GPU\-hour, feeds its own outputs back as context without any gold leakage at inference, and covers thirteen dialects\. It achieves 20\.36 spBLEU / 36\.64 chrF\+\+ on both tracks\. Future work covers longer training with a larger LoRA rank and beam\-search decoding\.
## References
- Abdul\-Nabiet al\.\(2024\)R\. Abdul\-Nabi, R\. Obeidat, and A\. BsoulA survey on machine translation of low\-resource arabic dialects\.In2024 15th International Conference on Information and Communication Systems \(ICICS\),pp\. 1–6\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1)\.
- Alhafniet al\.\(2024\)B\. Alhafni, S\. Al\-Towaity, Z\. Fawzy, F\. Nassar, F\. Eryani, H\. Bouamor, and N\. HabashExploiting dialect identification in automatic dialectal text normalization\.InProceedings of The Second Arabic Natural Language Processing Conference,pp\. 42–54\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1),[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Alkhder and Abboush \(2026\)H\. Alkhder and M\. AbboushSDNLP at amiya 2026: syrian arabic dialect modeling with lora\.InProceedings of the 13th Workshop on NLP for Similar Languages, Varieties and Dialects,pp\. 359–364\.Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Bawdenet al\.\(2018\)R\. Bawden, R\. Sennrich, A\. Birch, and B\. HaddowEvaluating discourse phenomena in neural machine translation\.InProceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Volume 1 \(Long Papers\),M\. Walker, H\. Ji, and A\. Stent \(Eds\.\),New Orleans, Louisiana,pp\. 1304–1313\.External Links:[Link](https://aclanthology.org/N18-1118/),[Document](https://dx.doi.org/10.18653/v1/N18-1118)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Bawdenet al\.\(2016\)R\. Bawden, G\. Wisniewski, and H\. MaynardInvestigating gender adaptation for speech translation\.InActes de la conférence conjointe JEP\-TALN\-RECITAL 2016\. volume 2 : TALN \(Posters\),L\. Danlos and T\. Hamon \(Eds\.\),Paris, France,pp\. 490–497\.External Links:[Link](https://aclanthology.org/2016.jeptalnrecital-poster.23/)Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1)\.
- Bouamoret al\.\(2018\)H\. Bouamor, N\. Habash, M\. Salameh, W\. Zaghouani, O\. Rambow, D\. Abdulrahim, O\. Obeid, S\. Khalifa, F\. Eryani, A\. Erdmann,et al\.The madar arabic dialect corpus and lexicon\.InProceedings of the eleventh international conference on language resources and evaluation \(LREC 2018\),Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1),[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- DeGenaro and Lupicki \(2024\)D\. DeGenaro and T\. LupickiExperiments in mamba sequence modeling and NLLB\-200 fine\-tuning for low resource multilingual machine translation\.InProceedings of the 4th Workshop on Natural Language Processing for Indigenous Languages of the Americas \(AmericasNLP 2024\),M\. Mager, A\. Ebrahimi, S\. Rijhwani, A\. Oncevay, L\. Chiruzzo, R\. Pugh, and K\. von der Wense \(Eds\.\),Mexico City, Mexico,pp\. 188–194\.External Links:[Link](https://aclanthology.org/2024.americasnlp-1.22/),[Document](https://dx.doi.org/10.18653/v1/2024.americasnlp-1.22)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p3.1)\.
- Dettmerset al\.\(2023\)T\. Dettmers, A\. Pagnoni, A\. Holtzman, and L\. ZettlemoyerQLoRA: efficient finetuning of quantized LLMs\.Advances in Neural Information Processing Systems36\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p3.1),[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p3.1),[§3\.2](https://arxiv.org/html/2610.22525#S3.SS2.p1.1)\.
- El Mekkiet al\.\(2025\)A\. El Mekki, H\. Atou, O\. Nacar, S\. Shehata, and M\. Abdul\-MageedNileChat: towards linguistically diverse and culturally aware LLMs for local communities\.InProceedings of the 2025 Conference on Empirical Methods in Natural Language Processing,C\. Christodoulopoulos, T\. Chakraborty, C\. Rose, and V\. Peng \(Eds\.\),Suzhou, China,pp\. 10967–10991\.External Links:[Link](https://aclanthology.org/2025.emnlp-main.556/),[Document](https://dx.doi.org/10.18653/v1/2025.emnlp-main.556),ISBN 979\-8\-89176\-332\-6Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p3.1),[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1),[§3\.2](https://arxiv.org/html/2610.22525#S3.SS2.p1.1)\.
- El Mekkiet al\.\(2026\)A\. El Mekki, A\. A\. Elmadany, S\. M\. Magdy, S\. Ezzini, M\. El\-Haj, M\. Jarrar, Z\. Alyafeai, B\. Ghanem, and M\. Abdul\-MageedAlexandriaX 2026: The First Shared Task on Dialectal Arabic Machine Translation\.InProceedings of The Fourth Arabic Natural Language Processing Conference: Shared Tasks,Budapest, Hungary\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1),[§2\.1](https://arxiv.org/html/2610.22525#S2.SS1.p1.1)\.
- EL Mekkiet al\.\(2026\)A\. EL Mekki, S\. M\. Magdy, H\. Atou, R\. AbuHweidi, B\. Qawasmeh, O\. Nacar, T\. Al\-hibiri, R\. Saadie, H\. A\. Alsayadi, N\. G\. Hammouda, A\. M\. Alkhazimi, A\. Hamod, A\. Y\. Al\-Ghafri, W\. El\-Sayed, A\. I\. al Sharji, M\. Ballout, A\. Belfathi, K\. Ghaddar, S\. Sibaee, A\. Aoun, A\. M\. Aseri, L\. Abureesh, A\. Bashiti, M\. Yousef, A\. Hafiz, Y\. Mohamed, E\. Hamedtou, B\. Emehah, R\. Alhamouri, Y\. Nafea, A\. El Aatar, W\. Al\-Dhabyani, E\. S\. Hamed, S\. Shatnawi, F\. Alwajih, K\. Elkhidir, A\. Alasmari, A\. Gerrio, O\. S\. Alshahri, A\. A\. Elmadany, I\. Berrada, A\. A\. A\. Al\-kathiri, F\. Zaraket, M\. Jarrar, Y\. M\. EL Hadj, H\. Alhuzali, and M\. Abdul\-MageedAlexandria: a multi\-domain dialectal Arabic machine translation dataset for culturally inclusive and linguistically diverse LLMs\.InProceedings of the 64th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),San Diego, California, United States,pp\. 32567–32592\.External Links:[Link](https://aclanthology.org/2026.acl-long.1503/),[Document](https://dx.doi.org/10.18653/v1/2026.acl-long.1503),ISBN 979\-8\-89176\-390\-6Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p3.1),[§2\.2](https://arxiv.org/html/2610.22525#S2.SS2.p1.1)\.
- Habashet al\.\(2018\)N\. Habash, F\. Eryani, S\. Khalifa, O\. Rambow, D\. Abdulrahim, A\. Erdmann, R\. Faraj, W\. Zaghouani, H\. Bouamor, N\. Zalmout, S\. Hassan, F\. Al\-Shargi, S\. Alkhereyf, B\. Abdulkareem, R\. Eskander, M\. Salameh, and H\. SaddikiUnified guidelines and resources for Arabic dialect orthography\.InProceedings of the Eleventh International Conference on Language Resources and Evaluation \(LREC 2018\),N\. Calzolari, K\. Choukri, C\. Cieri, T\. Declerck, S\. Goggi, K\. Hasida, H\. Isahara, B\. Maegaard, J\. Mariani, H\. Mazo, A\. Moreno, J\. Odijk, S\. Piperidis, and T\. Tokunaga \(Eds\.\),Miyazaki, Japan\.External Links:[Link](https://aclanthology.org/L18-1574/)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Huet al\.\(2022\)E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, and W\. ChenLoRA: low\-rank adaptation of large language models\.InInternational Conference on Learning Representations \(ICLR\),Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p3.1),[§3\.2](https://arxiv.org/html/2610.22525#S3.SS2.p1.1)\.
- Jonet al\.\(2026\)J\. Jon, R\. Bondok, and O\. BojarCurrent state of LLMs for Arabic dialectal machine translation\.InProceedings of the 2nd Workshop on NLP for Languages Using Arabic Script,M\. El\-Haj, P\. Rayson, M\. Jarrar, I\. Ezeani, S\. Ezzini, S\. Ahmadi, A\. Haddad Haddad, C\. Amol, A\. Abdelali, and S\. Abudalfa \(Eds\.\),Rabat, Morocco,pp\. 329–363\.External Links:[Link](https://aclanthology.org/2026.abjadnlp-1.41/),[Document](https://dx.doi.org/10.18653/v1/2026.abjadnlp-1.41)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Kadaouiet al\.\(2023\)K\. Kadaoui, S\. M\. Magdy, A\. Waheed, M\. T\. I\. Khondaker, A\. O\. El\-Shangiti, E\. M\. B\. Nagoudi, and M\. Abdul\-MageedTARJAMAT: evaluation of bard and ChatGPT on machine translation of ten Arabic varieties\.InProceedings of ArabicNLP 2023,H\. Sawaf, S\. El\-Beltagy, W\. Zaghouani, W\. Magdy, A\. Abdelali, N\. Tomeh, I\. Abu Farha, N\. Habash, S\. Khalifa, A\. Keleg, H\. Haddad, I\. Zitouni, K\. Mrini, and R\. Almatham \(Eds\.\),Singapore \(Hybrid\),pp\. 52–75\.External Links:[Link](https://aclanthology.org/2023.arabicnlp-1.6/),[Document](https://dx.doi.org/10.18653/v1/2023.arabicnlp-1.6)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Khederet al\.\(2024\)W\. B\. Kheder, J\. Jon, A\. Beyer, A\. Messaoudi, R\. Affan, C\. Barras, M\. Tychonov, and J\. GauvainALADAN at iwslt24 low\-resource arabic dialectal speech translation task\.InProceedings of the 21st International Conference on Spoken Language Translation \(IWSLT 2024\),pp\. 192–202\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1)\.
- Kheredet al\.\(2025\)A\. Khered, Y\. Benkhedda, and R\. T\. Batista\-NavarroDial2MSA\-verified: a multi\-dialect arabic social media dataset for neural machine translation to modern standard arabic\.InProceedings of the 4th Workshop on Arabic Corpus Linguistics \(WACL\-4\),pp\. 50–62\.Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Magdyet al\.\(2026\)S\. M\. Magdy, F\. Alwajih, A\. El Mekki, W\. El Sayed, and M\. Abdul\-MageedLQM: linguistically motivated multidimensional quality metrics for machine translation\.InFindings of the Association for Computational Linguistics: ACL 2026,M\. Liakata, V\. P\. Moreira, J\. Zhang, and D\. Jurgens \(Eds\.\),San Diego, California, United States,pp\. 40470–40493\.External Links:[Link](https://aclanthology.org/2026.findings-acl.2012/),[Document](https://dx.doi.org/10.18653/v1/2026.findings-acl.2012),ISBN 979\-8\-89176\-395\-1Cited by:[Appendix E](https://arxiv.org/html/2610.22525#A5.p2.1),[§2\.1](https://arxiv.org/html/2610.22525#S2.SS1.p1.1)\.
- Malayshaet al\.\(2024\)S\. Malaysha, M\. El\-Haj, S\. Ezzini, M\. Khalilia, M\. Jarrar, S\. Almujaiwel, I\. Berrada, and H\. BouamorAraFinNLP 2024: the first Arabic financial NLP shared task\.InProceedings of the Second Arabic Natural Language Processing Conference,N\. Habash, H\. Bouamor, R\. Eskander, N\. Tomeh, I\. Abu Farha, A\. Abdelali, S\. Touileb, I\. Hamed, Y\. Onaizan, B\. Alhafni, W\. Antoun, S\. Khalifa, H\. Haddad, I\. Zitouni, B\. AlKhamissi, R\. Almatham, and K\. Mrini \(Eds\.\),Bangkok, Thailand,pp\. 393–402\.External Links:[Link](https://aclanthology.org/2024.arabicnlp-1.34/),[Document](https://dx.doi.org/10.18653/v1/2024.arabicnlp-1.34)Cited by:[§2\.1](https://arxiv.org/html/2610.22525#S2.SS1.p1.1)\.
- Meftouhet al\.\(2015\)K\. Meftouh, S\. Harrat, S\. Jamoussi, M\. Abbas, and K\. SmailiMachine translation experiments on padic: a parallel arabic dialect corpus\.InProceedings of the 29th Pacific Asia conference on language, information and computation,pp\. 26–34\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1),[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Mohamedet al\.\(2023\)N\. H\. Mohamed, M\. Rassem, L\. Han, and G\. NenadicAlphaMWE\-arabic: arabic edition of multilingual parallel corpora with multiword expression annotations\.InProceedings of the 14th International Conference on Recent Advances in Natural Language Processing,pp\. 448–457\.Cited by:[§1](https://arxiv.org/html/2610.22525#S1.p1.1)\.
- Sajjadet al\.\(2020\)H\. Sajjad, A\. Abdelali, N\. Durrani, and F\. DalviAraBench: benchmarking dialectal Arabic\-English machine translation\.InProceedings of the 28th International Conference on Computational Linguistics,D\. Scott, N\. Bel, and C\. Zong \(Eds\.\),Barcelona, Spain \(Online\),pp\. 5094–5107\.External Links:[Link](https://aclanthology.org/2020.coling-main.447/),[Document](https://dx.doi.org/10.18653/v1/2020.coling-main.447)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Salloum and Habash \(2013\)W\. Salloum and N\. HabashDialectal Arabic to English machine translation: pivoting through Modern Standard Arabic\.InProceedings of the 2013 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies,L\. Vanderwende, H\. Daumé III, and K\. Kirchhoff \(Eds\.\),Atlanta, Georgia,pp\. 348–358\.External Links:[Link](https://aclanthology.org/N13-1036/)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
- Tiedemann and Scherrer \(2017\)J\. Tiedemann and Y\. ScherrerNeural machine translation with extended context\.External Links:1708\.05943,[Link](https://arxiv.org/abs/1708.05943)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Vanmassenhoveet al\.\(2018\)E\. Vanmassenhove, C\. Hardmeier, and A\. WayGetting gender right in neural machine translation\.InProceedings of the 2018 Conference on Empirical Methods in Natural Language Processing,E\. Riloff, D\. Chiang, J\. Hockenmaier, and J\. Tsujii \(Eds\.\),Brussels, Belgium,pp\. 3003–3008\.External Links:[Link](https://aclanthology.org/D18-1334/),[Document](https://dx.doi.org/10.18653/v1/D18-1334)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Voitaet al\.\(2018\)E\. Voita, P\. Serdyukov, R\. Sennrich, and I\. TitovContext\-aware neural machine translation learns anaphora resolution\.InProceedings of the 56th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),I\. Gurevych and Y\. Miyao \(Eds\.\),Melbourne, Australia,pp\. 1264–1274\.External Links:[Link](https://aclanthology.org/P18-1117/),[Document](https://dx.doi.org/10.18653/v1/P18-1117)Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p2.1)\.
- Zbibet al\.\(2012\)R\. Zbib, E\. Malchiodi, J\. Devlin, D\. Stallard, S\. Matsoukas, R\. Schwartz, J\. Makhoul, O\. Zaidan, and C\. Callison\-BurchMachine translation of arabic dialects\.InProceedings of the 2012 conference of the north american chapter of the association for computational linguistics: Human language technologies,pp\. 49–59\.Cited by:[§2\.3](https://arxiv.org/html/2610.22525#S2.SS3.p1.1)\.
## Appendix APrompt Template
Prompts are generated following the template below\. Angle brackets mark fields filled from the dataset\. In the actual prompt,<arabic\_translation\_i\>contains the gold Arabic during training and the model’s own previous output at inference\.
> Translate ONLY the last English turn into <dialect\_name\>\. Preserve the meaning, tone, register, persona and gender agreement of the speaker\. Output the translation and nothing else\. \#\#\# Metadata Country: <country\_name\> \(<country\_code\>\) Dialect: <dialect\_name\> Domain: <domain\> Participants: <persona\_a\>; <persona\_b\> Speaker: <speaker\_role\> \(<gender\_direction\>\) \#\#\# Conversation so far Turn <i\> \[<speaker\_i\>\] EN: <english\_turn\_i\> Turn <i\> \[<speaker\_i\>\] AR: <arabic\_translation\_i\> \(last four turns only\) \#\#\# Turn to translate EN: <english\_turn\_t\> AR:
The model generates after the final marker\. At inference, generation stops at the end\-of\-sequence token or after 200 new tokens\.
## Appendix BFull Configuration
Table 8:System configuration
## Appendix COrthographic Normalization Rules
The following mappings are applied to both hypotheses and references before rescoring\. Codepoints are given alongside the glyphs to avoid ambiguity\.
- •Alef variants أ \(U\+0623\), إ \(U\+0625\) and آ \(U\+0622\)→\\rightarrowbare alef ا \(U\+0627\)
- •Alef maqsura ى \(U\+0649\)→\\rightarrowya ي \(U\+064A\)
- •Ta marbuta ة \(U\+0629\)→\\rightarrowha ه \(U\+0647\)
- •Hamza carriers: waw with hamza ؤ \(U\+0624\)→\\rightarrowwaw و \(U\+0648\); ya with hamza ئ \(U\+0626\)→\\rightarrowya ي \(U\+064A\)
- •Deletion of short\-vowel and gemination diacritics ـَ ـُ ـِ ـً ـٌ ـٍ ـّ ـْ \(U\+064B–U\+0652\), superscript alef ـٰ \(U\+0670\), and tatweel ـ \(U\+0640\)
- •Collapse of repeated whitespace
## Appendix DPer\-Country Results
Table 9:Per\-country results on the public test split\.Norm\.is the spBLEU gain from orthographic normalization\.∗zero\-shot varieties\.
## Appendix EAnnotation Protocol
We sampled 60 turns from our private\-test predictions, stratified to give approximately five per country\. Each turn was presented with its English source, the preceding dialogue context, the country and dialect label, and the speaker–addressee gender direction, but without a reference translation, since references for the private test set are not released\.
Labels were assigned independently by one native\-speaker annotator and by an LLM prompted with the same category definitions, and were then reconciled by the human annotator\. Categories were adapted from the LQM\-inspired typology of Subtask 3\([Magdy et al\., 2026](https://arxiv.org/html/2610.22525#bib.bib15)\): content or meaning error, dialect–MSA confusion, morphological agreement error, orthographic error, and register or persona mismatch\. A sixth category,unnatural but content\-acceptable, was added by the human annotator during labelling for turns whose content was recoverable but whose register sounded non\-native\.
Table 10:Annotation counts over 60 sampled turns\.Similar Articles
@alamin_ai_: OMG, guys, this is unbelievable Please listen to the Levantine Arabic and the seamless code-switching with english, a 7…
A significant breakthrough in Levantine Arabic speech synthesis and English code-switching, achieving a 76% improvement using a single RTX 3060 in an evening.
Diarization-Guided Qwen-ASR Adaptation for Multilingual Two-Speaker Conversational Speech
This paper presents a system for the MLC-SLM 2026 Challenge that combines speaker diarization with fine-tuned Qwen-ASR using supervised full fine-tuning, LoRA on synthetic speech, and GRPO reinforcement learning to achieve a 17.97 tcpMER on the final evaluation set.
QU-NLP at QIAS 2026: Multi-Stage QLoRA Fine-Tuning for Arabic Islamic Inheritance Reasoning
This paper presents Qatar University's multi-stage QLoRA fine-tuning approach on Qwen3-4B for Arabic Islamic inheritance reasoning, achieving 90% MIR-E score through domain adaptation on Islamic fatwa records followed by task-specific training on 12,000 structured inheritance cases, matching commercial systems like Gemini-2.5-flash with minimal computational resources.
TTLab at AlexandriaX-2026: A Fine-Tuned Surface Tagger for Arabic Machine-Translation Error-Span Detection and Classification
TTLab presents a fine-tuned surface tagger for Arabic machine-translation error-span detection and classification, using MARBERTv2 to achieve 3rd place in the AlexandriaX-2026 shared task.
Dziri Voicebot: An End-to-End Low-Resource Speech-to-Speech Conversational System for Algerian Dialect
This paper presents a modular end-to-end speech-to-speech conversational system for the low-resource Algerian Dialect, integrating ASR, NLU, RAG, and TTS with dedicated datasets and fine-tuned models.