french-nlp

Tag

Cards List
#french-nlp

Small Edits, Shifting Decisions: Benchmarking LLM Accuracy and Reliability on French Input Variants

arXiv cs.CL ↗ · 2026-10-27 Cached

The paper introduces a controlled benchmark of French surface variants (apostrophe omission, diacritic removal, keyboard typos) across seven tasks with 12,600 inputs, showing that accuracy drops and Brier score/NLL rise with perturbation intensity, while calibration combined with input restoration improves reliability.

0 favorites 0 likes
#french-nlp

FrenchNews-7: Benchmarking Cross-Publisher French News Editorial Desk Classification

arXiv cs.CL ↗ · 2026-08-20 Cached

This paper introduces FrenchNews-7, a benchmark for classifying French news editorial desks across multiple publishers, featuring a fine-tuned CamemBERT classifier and evaluations against LLM baselines.

0 favorites 0 likes
← Back to home

Submit Feedback