Designing AI Pipelines for Decision-Ready ITSM Intelligence

arXiv cs.AI Papers

Summary

This paper presents a sociotechnical AI pipeline for ITSM ticket data, combining LLM-based schema normalization and clustering to generate executive-facing decision-support artifacts. Stakeholder evaluation shows strong ratings across interpretability, actionability, trust, and likelihood of use.

arXiv:2608.12670v1 Announce Type: new Abstract: IT service management (ITSM) systems accumulate large volumes of heterogeneous ticket data that are difficult for sales and executive stakeholders to convert into actionable intelligence. This paper presents a sociotechnical AI pipeline, designed and evaluated following design science research principles, that transforms raw ITSM exports into a multilevel decision-support artifact. The pipeline combines LLM-based schema normalization, HDBSCAN sub-topic clustering, and hierarchical agglomerative clustering to generate executive-facing Main-topics and granular Sub-topics. A stakeholder evaluation across six artifacts and five raters from Sales Engineering and customer success roles shows that all four decision-support metrics, interpretability, actionability, trust, and likelihood of use, on average exceed 4.0 out of 5.0, with trust as the most consistent signal. The findings position ITSM analytics as an Information Systems (IS) problem of transformation, abstraction, and human-centered design.
Original Article
View Cached Full Text

Cached at: 08/14/26, 09:27 AM

# Designing AI Pipelines for Decision-Ready ITSM Intelligence
Source: [https://arxiv.org/abs/2608.12670](https://arxiv.org/abs/2608.12670)
[View PDF](https://arxiv.org/pdf/2608.12670)

> Abstract:IT service management \(ITSM\) systems accumulate large volumes of heterogeneous ticket data that are difficult for sales and executive stakeholders to convert into actionable intelligence\. This paper presents a sociotechnical AI pipeline, designed and evaluated following design science research principles, that transforms raw ITSM exports into a multilevel decision\-support artifact\. The pipeline combines LLM\-based schema normalization, HDBSCAN sub\-topic clustering, and hierarchical agglomerative clustering to generate executive\-facing Main\-topics and granular Sub\-topics\. A stakeholder evaluation across six artifacts and five raters from Sales Engineering and customer success roles shows that all four decision\-support metrics, interpretability, actionability, trust, and likelihood of use, on average exceed 4\.0 out of 5\.0, with trust as the most consistent signal\. The findings position ITSM analytics as an Information Systems \(IS\) problem of transformation, abstraction, and human\-centered design\.

## Submission history

From: Archan Dutta \[[view email](https://arxiv.org/show-email/d9f565ec/2608.12670)\] **\[v1\]**Thu, 13 Aug 2026 00:09:26 UTC \(322 KB\)

Similar Articles

Strategic Decision Support for AI Agents

arXiv cs.AI

This paper proposes a framework for strategic decision support for AI agents, formulating an optimization problem to minimize support usage while controlling missed-support error. The authors develop an online algorithm and calibration method, demonstrating effectiveness across information gathering, human-AI collaboration, and tool use scenarios.

Most AI features don't fail because of the model

Reddit r/artificial

An AI feature for support ticket triage failed not due to model issues but because of stale data from a pipeline change, highlighting the need for integrated monitoring across teams.