Designing AI Pipelines for Decision-Ready ITSM Intelligence
Summary
This paper presents a sociotechnical AI pipeline for ITSM ticket data, combining LLM-based schema normalization and clustering to generate executive-facing decision-support artifacts. Stakeholder evaluation shows strong ratings across interpretability, actionability, trust, and likelihood of use.
View Cached Full Text
Cached at: 08/14/26, 09:27 AM
# Designing AI Pipelines for Decision-Ready ITSM Intelligence Source: [https://arxiv.org/abs/2608.12670](https://arxiv.org/abs/2608.12670) [View PDF](https://arxiv.org/pdf/2608.12670) > Abstract:IT service management \(ITSM\) systems accumulate large volumes of heterogeneous ticket data that are difficult for sales and executive stakeholders to convert into actionable intelligence\. This paper presents a sociotechnical AI pipeline, designed and evaluated following design science research principles, that transforms raw ITSM exports into a multilevel decision\-support artifact\. The pipeline combines LLM\-based schema normalization, HDBSCAN sub\-topic clustering, and hierarchical agglomerative clustering to generate executive\-facing Main\-topics and granular Sub\-topics\. A stakeholder evaluation across six artifacts and five raters from Sales Engineering and customer success roles shows that all four decision\-support metrics, interpretability, actionability, trust, and likelihood of use, on average exceed 4\.0 out of 5\.0, with trust as the most consistent signal\. The findings position ITSM analytics as an Information Systems \(IS\) problem of transformation, abstraction, and human\-centered design\. ## Submission history From: Archan Dutta \[[view email](https://arxiv.org/show-email/d9f565ec/2608.12670)\] **\[v1\]**Thu, 13 Aug 2026 00:09:26 UTC \(322 KB\)
Similar Articles
Governance by Design: Architecting Agentic AI for Organizational Learning and Scalable Autonomy
This paper presents a qualitative case study of a large IT services company's 2025 development and rollout of an agentic AI system, distilling seven lessons for embedding governance into system architecture and operations to balance autonomy with accountability.
Strategic Decision Support for AI Agents
This paper proposes a framework for strategic decision support for AI agents, formulating an optimization problem to minimize support usage while controlling missed-support error. The authors develop an online algorithm and calibration method, demonstrating effectiveness across information gathering, human-AI collaboration, and tool use scenarios.
Most AI features don't fail because of the model
An AI feature for support ticket triage failed not due to model issues but because of stale data from a pipeline change, highlighting the need for integrated monitoring across teams.
Agentic Analysis for Agentic Infrastructure: An LLM-Powered Pipeline for Comparative Governance of DAO and Corporate AI Protocols
This paper introduces an LLM-powered comparative pipeline for analyzing governance discourse in AI agent protocols, applying it to ERC-8004 and Google A2A to examine how institutional design shapes thematic priorities and community structure.
A Multi-Agent Platform for Automated Enterprise Analytics and Insight Generation
This paper proposes a multi-agent framework built on CrewAI for automated conversational business intelligence, using five specialized AI agents to process queries, retrieve data, and generate insights, with evaluation showing significant accuracy and quality improvements over baselines.