Integrating the Analytic Hierarchy Process with Large Language Models for Transparent Multi-Criteria Decision-Making

arXiv cs.AI Papers

Summary

The paper proposes an end-to-end approach for Large Language Models to perform the Analytic Hierarchy Process workflow, improving transparency and alignment with expert judgments in multi-criteria decision-making tasks.

arXiv:2609.16779v1 Announce Type: new Abstract: LLMs are increasingly employed in a wide range of decision-making tasks. However, the opacity of their internal reasoning makes it difficult to validate or interpret their outputs, and the need for interpretability becomes especially critical in high-stakes settings. This study examines the decision-making capabilities of LLMs through the Analytic Hierarchy Process (AHP), a classical and widely used multicriteria decision-making framework. We construct a new annotated benchmark based on AHP and propose the first end-to-end approach that enables LLMs to perform the complete AHP workflow. Experiments in real-world decision problems in the legal and higher-education ranking domains show that our method significantly improves alignment with expert judgments.
Original Article
View Cached Full Text

Cached at: 09/16/26, 09:04 AM

# Integrating the Analytic Hierarchy Process with Large Language Models for Transparent Multi-Criteria Decision-Making
Source: [https://arxiv.org/abs/2609.16779](https://arxiv.org/abs/2609.16779)
[View PDF](https://arxiv.org/pdf/2609.16779)

> Abstract:LLMs are increasingly employed in a wide range of decision\-making tasks\. However, the opacity of their internal reasoning makes it difficult to validate or interpret their outputs, and the need for interpretability becomes especially critical in high\-stakes settings\. This study examines the decision\-making capabilities of LLMs through the Analytic Hierarchy Process \(AHP\), a classical and widely used multicriteria decision\-making framework\. We construct a new annotated benchmark based on AHP and propose the first end\-to\-end approach that enables LLMs to perform the complete AHP workflow\. Experiments in real\-world decision problems in the legal and higher\-education ranking domains show that our method significantly improves alignment with expert judgments\.

## Submission history

From: Pascale Zarate \[[view email](https://arxiv.org/show-email/cb41a79f/2609.16779)\] \[via CCSD proxy\] **\[v1\]**Tue, 15 Sep 2026 07:47:04 UTC \(241 KB\)

Similar Articles

Offline Multimodal Large Language Models for Decision Support in Air Operations

arXiv cs.AI

This paper investigates offline multimodal large language models as decision support tools for air operations, detailing a modular retrieval-augmented architecture and presenting a pilot study with the Brazilian Air Force that demonstrates reduced cognitive workload and improved efficiency in doctrinal assessment tasks.

From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models

arXiv cs.CL

The paper introduces a multi-layer taxonomy for large language models comprising 14 capability domains and 91 subskills, drawing from human cognitive science to organize LLM evaluation beyond isolated tasks. It demonstrates operational utility by mapping 15,934 papers across major AI conferences, revealing concentrated attention on language-semantic competence and reasoning while identifying underexplored domains.