cognate-benchmark

Tag

Cards List
#cognate-benchmark

When Similar Means Different: Evaluating LLMs on Arabic--Hebrew Cognates

arXiv cs.CL · 2026-06-12 Cached

This paper introduces SemCog Bench, a curated benchmark of 1,858 Arabic-Hebrew word pairs with sentence-level annotations, to evaluate LLMs' ability to distinguish true cognates from false friends and loanwords. Results show high accuracy on true cognates but sharp drops on false friends, highlighting a key limitation in cross-lingual semantic reasoning.

0 favorites 0 likes
← Back to home

Submit Feedback