shared-task

Tag

Cards List
#shared-task

psytechlab at CLPsych 2026: Utilising Natural Language Processing methods and Large Language Models for Social Media Text Analysis

arXiv cs.CL · yesterday Cached

This paper describes the use of NLP methods including LSTM, BERT, and LLMs for analyzing mental health states from social media posts as part of the CLPsych 2026 shared task, achieving top consistency scores for summarization.

0 favorites 0 likes
#shared-task

Team MKC at CLPsych 2026: Capturing and Characterizing Mental Health Changes through Social Media Timeline Dynamics

arXiv cs.CL · 2026-07-01 Cached

This paper presents an LLM-based pipeline for analyzing mental health changes from sequentially ordered social media posts, participating in the CLPsych 2026 shared task. It performs post-level assessment and user-level temporal modeling to capture shifts in psychological well-being.

0 favorites 0 likes
#shared-task

DistilledGemma: Balanced Efficiency-Accuracy for Person-Place Relation Extraction from Multilingual Historical Articles

arXiv cs.CL · 2026-06-30 Cached

This paper presents DistilledGemma, a system for person-place relation extraction from multilingual historical newspaper articles using a three-stage knowledge distillation pipeline from a 26B Gemma teacher to a 2.3B student, achieving competitive accuracy and efficiency in the HIPE-2026 shared task.

0 favorites 0 likes
#shared-task

UOL@IDEM at BEA 2026 Shared Task 1: Neural Fusion and Feature-Rich Modeling for L1-Aware Vocabulary Difficulty Prediction

arXiv cs.CL · 2026-06-24 Cached

This paper describes UOL@IDEM's closed-track submission to the BEA 2026 shared task on L1-aware vocabulary difficulty prediction, combining multilingual contextual representations with engineered features. The system achieves competitive RMSE scores for Spanish, German, and Chinese, with frequency being the most stable predictor.

0 favorites 0 likes
#shared-task

QIAS 2026: Overview of the Shared Task on Islamic Inheritance Reasoning

arXiv cs.CL · 2026-06-15 Cached

This paper presents an overview of the QIAS 2026 shared task on Islamic inheritance reasoning, evaluating LLMs on multi-step legal and numerical reasoning using the MAWARITH benchmark.

0 favorites 0 likes
#shared-task

CUNY at CLPsych 2026: A Pipeline Approach to Classification and Summarization of Mental Health Changes

arXiv cs.CL · 2026-05-26 Cached

CUNY's submission to the CLPsych 2026 shared task uses a pipeline approach combining in-context learning with open-weight LLMs, supervised classifiers, and retrieval-augmented generation to classify and summarize mental health changes from Reddit timelines, achieving top rankings on multiple subtasks.

0 favorites 0 likes
#shared-task

Findings of the Counter Turing Test: AI-Generated Text Detection

arXiv cs.CL · 2026-05-21 Cached

This paper presents findings from the Counter Turing Test shared task on AI-generated text detection, with top systems achieving perfect binary classification but significantly lower performance in model attribution, highlighting the difficulty of distinguishing outputs from different large language models.

0 favorites 0 likes
#shared-task

Retrieval-Augmented Long-Context Translation for Cultural Image Captioning: Gators submission for AmericasNLP 2026 shared task

arXiv cs.CL · 2026-05-21 Cached

University of Florida Gators submission to the AmericasNLP 2026 shared task on cultural image captioning for Indigenous languages, using a two-stage pipeline with Qwen2.5-VL for Spanish captioning and retrieval-augmented Gemini 2.5 Flash for target-language translation, achieving significant improvements over the baseline.

0 favorites 0 likes
#shared-task

Closing the Gap at CRAC 2026: Two-Stage Adaptation for LLM-Based Multilingual Coreference Resolution

arXiv cs.CL · 2026-05-19 Cached

This paper presents a two-stage adaptation method for LLM-based multilingual coreference resolution, achieving first place in the LLM track of CRAC 2026 with a CoNLL F1 of 74.32. The approach fine-tunes Gemma-3-27b using a multilingual base adapter followed by dataset-specific adapters.

0 favorites 0 likes
#shared-task

What Makes Words Hard? Sakura at BEA 2026 Shared Task on Vocabulary Difficulty Prediction

arXiv cs.CL · 2026-05-15 Cached

This paper describes two models for vocabulary difficulty prediction: a black-box LLM fine-tuned with a soft-target loss achieving high accuracy, and an explainable model providing insights into difficulty factors. The models were part of the BEA 2026 Shared Task and achieve strong correlations.

0 favorites 0 likes
#shared-task

RETUYT-INCO at BEA 2026 Shared Task 2: Meta-prompting in Rubric-based Scoring for German

arXiv cs.CL · 2026-05-13 Cached

This paper details the RETUYT-INCO team's participation in the BEA 2026 Shared Task 2, introducing a meta-prompting approach for rubric-based scoring of German short answers.

0 favorites 0 likes
#shared-task

PSK@EEUCA 2026: Fine-Tuning Large Language Models with Synthetic Data Augmentation for Multi-Class Toxicity Detection in Gaming Chat

arXiv cs.CL · 2026-05-11 Cached

This paper presents a system for the EEUCA 2026 shared task on toxicity detection in gaming chat, achieving 4th place by fine-tuning Llama 3.1 8B with synthetic data augmentation. It highlights a 'validation trap' phenomenon where high validation scores do not correlate with test performance due to dataset distribution shifts.

0 favorites 0 likes
← Back to home

Submit Feedback