corpus

Tag

Cards List
#corpus

Hey, guess what: CUES lead to inferences about typicality

arXiv cs.CL ↗ · 2026-10-27 Cached

This paper constructs EventTyp and EventTypGold corpora to study typicality and atypicality inferences in conversation, finding that humans rely on three cues—commonsense knowledge, utterance emphasis, and snark—while LLMs struggle due to lacking commonsense knowledge about event typicality.

0 favorites 0 likes
#corpus

Wieszcz-XIX: A 3.1-Billion-Word Corpus of Pre-1918 Polish and Temporally Bounded Language Models Trained From Scratch

arXiv cs.CL ↗ · 2026-10-09 Cached

论文提出 Wieszcz-XIX,一个涵盖 1800–1918 年波兰语的 31 亿词(67.5 亿 token)语料库,并从零训练了 47M 至 349M 参数的时间受限语言模型,展示其在时期词汇上相对现代波兰基座模型的交叉优势,同时发布语料、代码与权重。

0 favorites 0 likes
#corpus

YODAS v3: Over 1 Million Hours of High-Bandwidth, Stereophonic, Multilingual Speech

arXiv cs.CL ↗ · 2026-09-25 Cached

YODAS v3 is a weakly-labeled speech corpus containing over 1.1 million hours of high-bandwidth, stereophonic, multilingual audio in 147 languages, designed to advance speech foundation models.

0 favorites 0 likes
#corpus

The Illinois Social Attitudes Aggregate Corpus (ISAAC): An Open Tool and Reproducible Pipeline for Analyzing Social Group Discourse at Scale

arXiv cs.CL ↗ · 2026-09-24 Cached

We introduce ISAAC, an open corpus of 527 million+ English-language Reddit posts for analyzing social group discourse, with a multi-step pipeline for annotation and analysis. It enables cross-category comparisons and temporal tracking of public attitudes, accessible via web apps and programming interfaces.

0 favorites 0 likes
#corpus

Leveraging Human Reading Behavior for Keyphrase Extraction: A Webcam-based Eye-tracking Corpus

arXiv cs.CL ↗ · 2026-08-12 Cached

This paper explores using lightweight webcam-based eye-tracking features to improve keyphrase extraction from Chinese academic abstracts, introducing the CLIS-ET corpus and showing that fixation features enhance KPE performance.

0 favorites 0 likes
#corpus

PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing

arXiv cs.CL ↗ · 2026-08-12 Cached

This paper introduces PERCEPT, the first large-scale Persian–English code-mixed corpus annotated with Universal Dependencies POS tags, collected from X, Instagram, and Digikala. It presents an LLM-assisted annotation framework and analyzes code-mixing patterns across platforms.

0 favorites 0 likes
#corpus

@yiyirats: You know all too well how effective it is to memorize a vocabulary book from A to Z. Recently I came across a website called 英语台词社, which takes a different approach—it compiles subtitles from a large number of movies and American TV series into a searchable corpus, currently containing subtitle texts from over 54,000 movies and more than 4,000 TV series. The practical uses are quite straightforward: you can use it to practice listen…

X AI KOLs Timeline ↗ · 2026-08-06 Cached

Introduces the 英语台词社 website, which provides a searchable corpus of subtitles from over 54,000 movies and 110,000 episodes of American TV series, for practicing English listening, shadowing, and authentic expressions.

0 favorites 0 likes
#corpus

ICLE++: Modeling Fine-Grained Traits for Holistic Essay Scoring

arXiv cs.CL ↗ · 2026-07-31 Cached

This paper introduces ICLE++, a new corpus of persuasive student essays annotated with both holistic and trait-specific scores, aimed at improving generalization and multi-trait scoring in automated essay scoring (AES) research.

0 favorites 0 likes
#corpus

A Human-in-the-Loop Corpus for LLM-Based Simplification of Scientific Summaries

arXiv cs.CL ↗ · 2026-07-29 Cached

This paper presents a human-in-the-loop workflow for creating a corpus of LLM-based simplifications of scientific summaries, using SciSummNet and GPT-4o-mini with non-expert and expert feedback to improve cross-disciplinary accessibility.

0 favorites 0 likes
#corpus

A Corpus of Persuasion Techniques in Slavic Languages

arXiv cs.CL ↗ · 2026-07-14 Cached

A new annotated corpus of persuasion techniques in Bulgarian, Polish, and Russian, covering parliamentary debates and social media, with 25 fine-grained techniques and baseline models for detection and classification.

0 favorites 0 likes
#corpus

Echoes Across Vietnam's Highlands, Delta, and Coast: A Multilingual Corpus for Cham, Khmer, and Tay-Nung

arXiv cs.CL ↗ · 2026-07-10 Cached

Introduces CKTN, the first multilingual corpus and benchmark for Cham, Khmer, and Tay-Nung languages, addressing fragmentation in multilingual encoders with a script-aware adaptation recipe.

0 favorites 0 likes
#corpus

A Word-Level Digital Reader of the Prasthanatrayi with Sankara's Bhasya: Corpus, Method, and an Open, Offline Reading Aid for the Advaita Vedanta Canon

arXiv cs.CL ↗ · 2026-07-09 Cached

Presents an open, offline word-level digital reader of the Prasthānatrayī with Śaṅkara's Bhāṣya, featuring clickable word analysis, concordance, and a hybrid pipeline using rule-based and LLM-assisted methods.

0 favorites 0 likes
#corpus

RMISC: A Large-scale Real-world Multivariate Corpus for Time Series Foundation Models

arXiv cs.AI ↗ · 2026-07-08 Cached

Introduces RMISC, a large-scale real-world multivariate time series corpus with around 200 datasets and 142 billion time points, and demonstrates that pretraining time series foundation models on real-world multivariate data improves zero-shot generalization compared to synthetic data.

0 favorites 0 likes
#corpus

I built an open, from-scratch MT pipeline + parallel corpus for Tunisian Darija (Arabizi) early baseline, and I'm growing it into a curated community corpus [P]

Reddit r/MachineLearning ↗ · 2026-07-05

An 18-year-old Tunisian student introduces an open-source machine translation pipeline and parallel corpus for Tunisian Darija in Arabizi script, built from scratch with a small 15.6M-parameter Transformer and an honest baseline BLEU of 3.89, and calls for contributors to ethically expand the corpus.

0 favorites 0 likes
#corpus

MultiSynt/MT: Trillion-Token Multi-Parallel Pre-Training Data Translated Across 36 Languages

arXiv cs.CL ↗ · 2026-07-02 Cached

This paper introduces MultiSynt/MT, a trillion-token multilingual parallel corpus created by translating English pre-training data into 36 languages. Experiments show that LLMs trained on this translated data achieve performance comparable to native data with fewer tokens, though some evaluation blind spots and cultural gaps remain.

0 favorites 0 likes
#corpus

SEFORA: Student Essays with Feedback Corpus and LLM Feedback Evaluation Framework

arXiv cs.CL ↗ · 2026-07-02 Cached

This paper introduces SEFORA, a public corpus of instructor feedback on student essays, and UniMatch, a reference-based evaluation framework for assessing LLM-generated feedback. Experiments show that current LLMs struggle to match instructor feedback, achieving at most 0.4 F1.

0 favorites 0 likes
#corpus

Do Speech Emphasis Models Generalize across Languages and Emotions?

arXiv cs.CL ↗ · 2026-06-29 Cached

Introduces MMEE, a multilingual multi-emotion emphasis corpus of 10,000 utterances across 7 languages and 34 emotions, and benchmarks emphasis detection models under various transfer settings, finding that multilingual training improves robustness while monolingual models show limited zero-shot transfer.

0 favorites 0 likes
#corpus

Introducing corpora Hlava Cor and Hlava AD: Human Label Variation in Coreference and Discourse Relations

arXiv cs.CL ↗ · 2026-06-25 Cached

This paper introduces two new Czech corpora, Hlava Cor and Hlava AD, designed to study human label variation in coreference and discourse relations. The corpora feature multiple annotations and annotator explanations, achieving 60-65% inter-annotator agreement and revealing systematic differences in interpretation.

0 favorites 0 likes
#corpus

Prague Dependency Treebank -- Consolidated 2.0: Enriching a Complex Annotation Scheme

arXiv cs.CL ↗ · 2026-06-24 Cached

We present the second consolidated version of the Prague Dependency Treebank, a 4-million-token manual multilingual annotation resource covering morphology, syntax, semantics, coreference, and discourse, along with compatible lexicons.

0 favorites 0 likes
#corpus

@geekbb: Organized the quarterly reports, notes, and interviews of fund manager Zheng Xi from over a decade into a structured corpus, built as a traceable AI skill, enabling AI to conduct investment research Q&A and fund analysis based on real data rather than model hallucinations. https://github.com/lyra81604/zhengxi-views…

X AI KOLs Timeline ↗ · 2026-06-22 Cached

Compiled the public quarterly reports, notes, and interviews of fund manager Zheng Xi into a structured corpus, and built it as a traceable skill across AI platforms for real data-driven investment research Q&A and fund analysis.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback