Enhancing Knowledge Entity Relation Extraction in Abstracts and Full-text Content of Academic Articles Using Large Language Models
Summary
The paper evaluates multiple LLM-based strategies for knowledge entity relation extraction from academic abstracts and full texts, finding that a LoRA-adapted T5 model achieves the best macro F1 scores while hybrid SLM/LLM strategies further improve performance.
View Cached Full Text
Cached at: 11/02/26, 09:30 AM
# Enhancing Knowledge Entity Relation Extraction in Abstracts and Full-text Content of Academic Articles Using Large Language Models Source: [https://arxiv.org/abs/2610.41552](https://arxiv.org/abs/2610.41552) [View PDF](https://arxiv.org/pdf/2610.41552) > Abstract:This study investigates the effectiveness of large pre\-trained language models \(LLMs\) for knowledge entity relation extraction \(KERE\) from academic papers\. Existing studies have examined individual types of LLM\-based strategies and evaluated model performance using metrics such as precision and recall\. To provide a broader evaluation, this study investigates multiple strategies, including closed\-source LLM\-based CoT prompting, LoRA\-adapted open\-source LLMs, LLM\-enhanced small pre\-trained language models \(SLMs\), and SLM\-enhanced closed\-source LLMs\. In addition, this study introduces two strategies, namely SLM\-enhanced open\-source LLMs and closed\-source LLM\-enhanced open\-source LLMs\. These strategies are evaluated from multiple perspectives, including metrics, their ability to mitigate errors observed in SLMs, and potential directions for model optimization\. This study manually constructs two annotated datasets in the NLP domain, covering Abstract and Full\-Text datasets\. Experimental results show that the LoRA\-adapted T5 model achieves the highest macro F1 scores of 0\.7408 and 0\.7013 on the Abstract and Full\-Text datasets, respectively\. SLMs also benefit from LLM\-generated entity descriptions under the LLM\-enhanced SLM strategy\. Error analysis further reveals that the effectiveness of LLM\-based strategies in mitigating SLM errors varies across error types\. Based on the identified limitations and error patterns of these strategies, several optimization directions are proposed\. In addition, combining strategies with different error patterns further improves KERE performance\. ## Submission history From: Chengzhi Zhang \[[view email](https://arxiv.org/show-email/4ec71361/2610.41552)\] **\[v1\]**Fri, 30 Oct 2026 10:50:28 UTC \(9,050 KB\)
Similar Articles
Leveraging External Knowledge for Historical Document Restoration via Retrieval-Augmented Large Language Models
This paper introduces ARI, a framework that uses retrieval-augmented large language models to restore illegible portions of historical documents, significantly improving named entity restoration by combining implicit LLM knowledge with explicitly retrieved external historical context.
LLM Wiki v2 (16 minute read)
This post presents a pattern for building personal knowledge bases using LLMs, offering a structured approach for leveraging large language models in knowledge management.
Labeling Training Data for Entity Matching Using Large Language Models
This paper investigates using LLMs as teacher models to label training data for entity matching, showing that student models trained on machine-labeled data perform on par with those trained on manually labeled benchmarks, with significant cost and speed advantages.
Tracing Relational Knowledge Recall in Large Language Models
Researchers trace how LLMs recall relational facts by probing per-head attention contributions, showing these are strong linear features whose fidelity correlates with relation specificity and entity connectedness.
Integrating knowledge graphs and multilingual scholarly corpora for domain-adaptive LLMs in SSH
This paper presents a use case from the European project LLMs4EU and ALT-EDIC infrastructure, focusing on adapting foundation models to Social Sciences and Humanities (SSH) research practices by integrating knowledge graphs and multilingual scholarly corpora. The approach aims to support tasks like question answering and literature review while ensuring domain sensitivity and regulatory compliance.