Goal-driven Variant Categorization

arXiv cs.AI Papers

Summary

The paper proposes a goal-driven approach to categorize process variants in process mining by using a goal model and Large Language Models (LLMs) to interpret and assign variants to predefined categories, evaluated on public logs.

arXiv:2609.22475v1 Announce Type: new Abstract: Process discovery rarely yields a single coherent process structure. For analysis, a common step is to cluster process variants based on structural similarity and then assign business meaning to the resulting groups. Since these partitions are not derived from the organization's goals, analysts must manually interpret and consolidate variants into business-meaningful categories. This judgment-intensive step becomes increasingly difficult as the number and complexity of variants grow. In this paper, we propose a goal-driven approach to variant categorization that reverses this workflow. We first author an organization's goal model that predefines the categorization axis. Each variant is transformed into a textual narrative describing its behavior, and a Large Language Model (LLM) interprets it in the context of the goal model and assigns the variant to the most appropriate category. LLM-based semantic reasoning connects low-level process behavior with analyst-defined business goals. We instantiate this approach end-to-end and evaluate it on three public logs differing substantially in scale and behavioral diversity. Goal-model guidance yields partitions that differ from those produced by unguided induction and respond to controlled edits to the declared alternatives, at the cost of authoring a goal model.
Original Article
View Cached Full Text

Cached at: 09/23/26, 09:07 AM

# Goal-driven Variant Categorization
Source: [https://arxiv.org/html/2609.22475](https://arxiv.org/html/2609.22475)
DOI:[XXXXXXX\.XXXXXXX](https://doi.org/XXXXXXX.XXXXXXX)Conference:ACM International Conference on Process Mining; 2027; TBDISBN:978\-1\-4503\-XXXX\-X/2027/XXCCS:Information systems Data miningCCS:Software and its engineering Requirements analysisCCS:Computing methodologies Natural language generationDaniel CalegariandDaniel AmyotAffiliation:University of Ottawa,Ottawa,Canadaemail:[damyot@uottawa\.ca](mailto:[email protected])

2027

###### Abstract\.

Process discovery rarely yields a single coherent process structure\. For analysis, a common step is to cluster process variants based on structural similarity and then assign business meaning to the resulting groups\. Since these partitions are not derived from the organization’s goals, analysts must manually interpret and consolidate variants into business\-meaningful categories\. This judgment\-intensive step becomes increasingly difficult as the number and complexity of variants grow\. In this paper, we propose a goal\-driven approach to variant categorization that reverses this workflow\. We first author an organization’s goal model that predefines the categorization axis\. Each variant is transformed into a textual narrative describing its behavior, and a Large Language Model \(LLM\) interprets it in the context of the goal model and assigns the variant to the most appropriate category\. LLM\-based semantic reasoning connects low\-level process behavior with analyst\-defined business goals\. We instantiate this approach end\-to\-end and evaluate it on three public logs differing substantially in scale and behavioral diversity\. Goal\-model guidance yields partitions that differ from those produced by unguided induction and respond to controlled edits to the declared alternatives, at the cost of authoring a goal model\.

###### Keywords:

Process mining; trace variants; variant categorization; goal models; GRL; large language models

## 1\.Introduction

Process analysis on real\-life event logs must reconcile two perspectives: the behavior recorded in execution data and the business meaning the organization assigns to it\. Often, process discovery generates unreadable models, and the standard approach to joining the two perspectives is toclustertrace variants by structural similarity\([Song et al\., 2009](https://arxiv.org/html/2609.22475#bib.bib1);[Amling et al\., 2026](https://arxiv.org/html/2609.22475#bib.bib2)\)and then attach business meaning \(often asgoals\) to express categories the organization recognizes\. However, this is usually a judgment\-heavy step, which becomes costly as the diversity and number of variants grow\.

Recent work narrows this gap from both sides\. On the clustering side, pairing a structural partition with a generated per\-cluster description improves readability, yet the boundary is still induced from activity co\-occurrence, and neither the boundary nor the label is checked against the process\([Amling et al\., 2026](https://arxiv.org/html/2609.22475#bib.bib2)\)\. On the goal side, goal\-oriented process mining supplies an external referent\([Ghasemi and Amyot, 2020](https://arxiv.org/html/2609.22475#bib.bib4)\), but the closest approach decides only whether each variant satisfies a declared objective and sets the unsatisfying variants aside rather than categorizing them\([Ghasemi et al\., 2025](https://arxiv.org/html/2609.22475#bib.bib7)\)\. As far as we know, no existing work uses business semantics to define an explicitly declared categorization axis prior to assignment, nor does it treat uncategorized behavior as an inspectable coverage gap\.

In this paper, we propose a goal\-driven variant categorization approach that fixes the categorization axis in advance by declaring it in a goal model\. A large language model \(LLM\) then derives a category taxonomy from that model and assigns trace variants to its categories\. The goal model is written in the standard Goal\-oriented Requirement Language \(GRL\)\([ITU\-T, 2018](https://arxiv.org/html/2609.22475#bib.bib5);[Amyot et al\., 2022](https://arxiv.org/html/2609.22475#bib.bib8)\)and is set before any variant is assigned\. Each variant is rendered as a narrative with the trace\-textualization mechanism of LUPIN\([Pasquadibisceglie et al\., 2024](https://arxiv.org/html/2609.22475#bib.bib3)\), and the LLM classifies each narrative into one of the taxonomy’s categories\. Narratives assigned to no category are reported as an inspectable residual, which may indicate a goal\-model coverage gap\. The approach then produces per\-category descriptions, process models, and conformance measures for a human analyst to review, with the option to recategorize any variant\.

The contributions are:1a categorization method in which the goal model is the axis and the residual is a first\-class output;2GoalCat\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\), a publicly available Python implementation on the standard process\-mining stack, with a guided mode and an open \(goal\-model\-free\) mode; and3a pre\-registered evaluation on three public logs\([de Leoni and Mannhardt, 2015](https://arxiv.org/html/2609.22475#bib.bib11);[Mannhardt, 2016](https://arxiv.org/html/2609.22475#bib.bib13);[van Dongen, 2019](https://arxiv.org/html/2609.22475#bib.bib12)\), with a replication package, answering two research questions:

- •RQ1 \(Divergence\)\.To what extent does a taxonomy induced from a declared goal model partition the variants of a log differently from a taxonomy induced from the narratives alone, beyond run\-to\-run variation?
- •RQ2 \(Robustness\)\.When one declared goal model alternative is removed, merged, or added, does the categorization change only for the variants that realized it?

In this paper, Section[2](https://arxiv.org/html/2609.22475#S2)covers background and related work, Section[3](https://arxiv.org/html/2609.22475#S3)presents theGoalCatpipeline, Section[4](https://arxiv.org/html/2609.22475#S4)reports the evaluation, Sections[5](https://arxiv.org/html/2609.22475#S5)and[6](https://arxiv.org/html/2609.22475#S6)discuss results and threats to validity, and finally Section[7](https://arxiv.org/html/2609.22475#S7)concludes\.

## 2\.Background and Related Work

#### Variant clustering and LLM\-based textualization

Trace clustering methods differ mainly in how traces are encoded before the partition is computed\. Early work groups traces by control\-flow similarity\([Song et al\., 2009](https://arxiv.org/html/2609.22475#bib.bib1)\)\. Later methods encode behavior around each event, such as conserved subsequences and their context\([Bose and van der Aalst, 2009](https://arxiv.org/html/2609.22475#bib.bib16)\), or learn representations from logs\([Koninck et al\., 2018](https://arxiv.org/html/2609.22475#bib.bib17)\)\. In all of them, the groups are formed based on structural or behavioral proximity, and a business label is assigned afterward\([Song et al\., 2009](https://arxiv.org/html/2609.22475#bib.bib1)\)\. LLMs enter this line through natural\-language renderings of logs, models, and their abstractions\([Berti et al\., 2024](https://arxiv.org/html/2609.22475#bib.bib18)\)\. Recent clustering work pairs an explainable partition with a generated per\-cluster description\([Amling et al\., 2026](https://arxiv.org/html/2609.22475#bib.bib2)\)\. This improves readability, but the model is only asked to*name*a group that has already been formed; the boundary and the label are not checked against the process\. We use textualization for the opposite purpose\. LUPIN renders a trace as a natural\-language narrative for next\-activity prediction\([Pasquadibisceglie et al\., 2024](https://arxiv.org/html/2609.22475#bib.bib3)\); we invoke the same renderer once per complete variant and let the LLM decide only a bounded membership question against alternatives declared before taxonomy induction and assignment\.

#### Goal models and goal\-oriented process mining

The User Requirements Notation \(URN\) is a standard language that combines goals and processes, and its goal sublanguage is the Goal\-oriented Requirement Language \(GRL\)\([ITU\-T, 2018](https://arxiv.org/html/2609.22475#bib.bib5)\)\. A GRL model is a graph of*intentional elements*, i\.e\., goals, softgoals, tasks, and resources, held by actors, and connected by decomposition, contribution, and dependency links\([Amyot et al\., 2022](https://arxiv.org/html/2609.22475#bib.bib8)\)\. Decomposition is typed: an AND\-decomposition requires every subelement to be satisfied, whereas an OR\- or XOR\-decomposition names alternative subelements, each on its own a sufficient realization of the parent\. URN has two decades of reported use\([Amyot et al\., 2022](https://arxiv.org/html/2609.22475#bib.bib8)\), with tool support in jUCMNav\([Roy et al\., 2006](https://arxiv.org/html/2609.22475#bib.bib14)\)\.

We use one construct from this language: the OR/XOR\-decomposition of a goal into alternative tasks\. Before taxonomy induction and assignment, it declares a discrete set of ways the goal can be met, and its named elements serve as category anchors\. Other GRL elements inform category meaning without introducing additional category anchors\. The two operators differ: XOR alternatives are mutually exclusive, whereas OR alternatives may co\-occur\([ITU\-T, 2018](https://arxiv.org/html/2609.22475#bib.bib5)\)\.

Figure[1](https://arxiv.org/html/2609.22475#acmlabel1)shows a GRL goal model for the Road\-Traffic\-Fine log \(RTFM\)\([de Leoni and Mannhardt, 2015](https://arxiv.org/html/2609.22475#bib.bib11)\)\. One actor, the traffic police back\-office, holds a goal tree that is AND\-decomposed at the top into issuing and resolving a fine, and OR/XOR\-decomposed below into the ways a case can end\. Three softgoals record what the organization wants to optimize while ending it\. One of the model’s four key performance indicators \(KPIs\) converts a measured duration into a satisfaction level that propagates along the contribution links\([ITU\-T, 2018](https://arxiv.org/html/2609.22475#bib.bib5);[Fan et al\., 2018](https://arxiv.org/html/2609.22475#bib.bib6)\)\. We developed the model for this work from publicly available sources \(Section[4\.1](https://arxiv.org/html/2609.22475#S4.SS1)\)\.

Every issued fine reaches a lawful, documented closureFine is issued and formally communicatedFine case is resolved \(4\)Create FineSend FineResolve viatimely payment \(12\)Fine becomes enforceable and is resolvedInsert FineNotificationAdd PenaltyEnforced case is closedResolve viadelinquentpayment \(13\)Contested appeal is resolvedResolve viacoercive creditcollection \(20\)Resolve viaadministrativeappeal\(Prefecture\) \(14\)And: 4 sub\-stepsResolve viajudicial appeal\(Judge\) \(19\)Time to finedispatch \(days\) \(112\)target 30 \| threshold 90 \| worst 360Maximize timely fine revenue \(22\)Preserve offender’s due\-process rights \(23\)Minimize administrative & enforcement cost \(21\)Actor: Traffic Police Back\-OfficeAndAndOrAndOrXorMake \(\+100\)Help \(\+50\)Make \(\+100\)Hurt \(−\-50\)

Figure 1\.The RTFM goal model in GRL notation: rounded rectangles are goals, hexagons are tasks, the barred hexagon is a KPI, and the curved outlines are softgoals\. Decomposition links carry a filled head at the decomposed parent and its And/Or/Xor operator; contribution links carry an open head and their negative/positive weight in the\[−100,100\]\[\-100,100\]interval\.Goal model for the Road Traffic Fine Management process in GRL notation\. One actor, the issuing police back\-office, holds a goal tree AND\-decomposed at the top into issuing a fine and resolving it, and OR/XOR\-decomposed below into five ways a case can end: timely payment, delinquent payment, administrative appeal, judicial appeal, and coercive credit collection\. Administrative appeal is AND\-decomposed into four mandatory sub\-steps\. Three softgoals describe organizational priorities, and one KPI converts duration into a satisfaction level\.Goal\-oriented process mining connects such goal models to recorded behavior, so that the analysis refers to an explicit statement of the process’s purpose\([Ghasemi and Amyot, 2020](https://arxiv.org/html/2609.22475#bib.bib4)\)\. The closest approach,GoPED, decides for each variant whether it satisfies a declared objective and sets the unsatisfying variants aside\([Ghasemi et al\., 2025](https://arxiv.org/html/2609.22475#bib.bib7)\)\. Two differences matter here\. First, GoPED asks*whether*declared goals are met \(a filter\), whereas we ask*which*declared alternative a variant realizes \(a categorization\)\. Second, GoPED’s set\-aside variants are a filtered remainder; we make them a first\-class residual that analysts can inspect\.

## 3\.GoalCatpipeline

This section presents the goal\-driven categorization method \(contribution1\) through the pipeline that implements it\.GoalCatruns trace\-variant categorization in four phases \(Figure[2](https://arxiv.org/html/2609.22475#acmlabel2)\) with two operating modes\.Phase Iextracts the trace variants, profiles each variant across several behavioral views, and renders each variant as a natural\-language narrative\.Phase IIuses an explicittaxonomy\_modeswitch \(intent\_guidedoropen\), defining whether a taxonomy is derived from an authored goal model or induced from narrative structure\.Phase IIIassigns narratives to the categories of the taxonomy, and describes quantitative and qualitative aspects of each category\. Finally,Phase IVsubmits those descriptions for analyst review and outputs the categorization results\. In what follows, we detail each step\.

I\. SHARED REPRESENTATIONINPUTEvent logXES \+ caseattributesDETERMINISTIC1\. Extractvariantsshared activitysequenceDETERMINISTIC2\. Multi\-viewprofilesorder – timerework – outcomeDETERMINISTIC3\. Variantnarrativesone per completevariantDETERMINISTIC4\. Narrativesamplefrequent – rare– extremeII\. MODE\-SPECIFIC TAXONOMY×\\timesMODE CHOICEtaxonomy\_modeHUMANG\. Goal modelGRL/URN – frozenKPI indicatorsLLM5a\. Guidedinductiondeclared axisLLM5b\. Openinductionsample\-derivedARTIFACTAnchoredtaxonomyARTIFACTInducedtaxonomy×\\timesONE ACTIVE LANEIII\. CATEGORY ANALYSISIV\. VALIDATE AND REPORTAll variant narratives\(Step 3\)LLM6\. Assignnarrativescategory, if anyDETERMINISTIC7\. Discovermodelsfitness – precisionDETERMINISTIC7b\. Indicatorsatisfactionguided mode only,optionalDETERMINISTIC8a\. Buildabstractionsmodel – coverage– profileLLM8b\. Generatedescriptionsone per categoryHUMAN9\. Analystreview×\\timesOUTPUTCategorizationoutputstaxonomy – logcoverage reportUNASSIGNED NARRATIVES – RESIDUALGuided mode: candidate goal\-model coverage gapOpen mode: other / unclassifiableMEASURED GOAL SATISFACTIONIndicator \+ goal satisfaction \(CSV\)Measured goal model \(\.jucm\)sampleguidedopen\(no goal model\)selected taxonomyaccept / renameunassignedreportedKPI indicators \(guided mode only\)measured satisfaction, if presentmerge / split – repeat 5–9\(rename: in place, no LLM call\)guided mode only – revise goal model

Figure 2\.TheGoalCatpipeline \(phases I–IV\)\. Solid arrows are sequence flows; dashed arrows are data associations, not step transitions\.The \\GoalCat\{\} pipeline has four phases\. Phase I extracts, profiles, textualizes, and samples trace variants\. Phase II induces a taxonomy through either intent\-guided or open induction\. Phase III assigns every variant to a category or to the residual and analyzes the resulting categories\. Phase IV supports analyst review and may return to taxonomy induction or goal\-model revision\.Goal model as declared taxonomy \(Step G\)\.The pipeline requires a prior GRL/URN goal model with goals, actors, contribution links, and one declared*axis root*: an OR\- or XOR\-decomposed goal whose alternative tasks form the categorization axis\. We restrict the axis to OR/XOR points because any other basis would need an analyst\-chosen criterion; other bases are future work\. Naming the root fixes a single*frontier*of candidate alternatives\. The frontier is computed by descending from the root through nested OR/XOR points and stopping at any alternative that contains none, so an alternative that is AND\-decomposed into mandatory sub\-steps stays on the frontier as one alternative\. A goal whose AND\-decomposition joins several independent OR points declares no single axis, because a case realizes one alternative from each\. The frontier later fixes the set the induced taxonomy must cover exactly \(Step 5a\) and the alternatives onto which each variant is projected \(Step 6\)\. On RTFM, the descent yields the five frontier alternatives of Figure[1](https://arxiv.org/html/2609.22475#acmlabel1): timely payment, delinquent payment, administrative appeal, judicial appeal, and coercive credit collection\.*Administrative appeal*shows where the descent halts: it is AND\-decomposed into four mandatory sub\-steps and remains one alternative\. The root decomposition is an inclusive OR, so one case may satisfy more than one alternative\. The categories are disjoint only because Step 6 assigns a single label\.

Narrative representation \(Steps 1–4\)\.These four steps build the narrative representation shared by both modes\. Variant extraction groups log traces by their activity sequence\. Profiling characterizes each variant along several views: activity order, duration and waiting times, rework, case outcome, resource, and the variant’s frequency in the log, following the multi\-perspective profiling proposed for trace clustering\([Song et al\., 2009](https://arxiv.org/html/2609.22475#bib.bib1)\)\. Duration, rework, and resource distributions are aggregated across all cases of the variant\. The event sequence rendered as text is not an aggregate; it comes from a single representative case, the one whose duration is closest to the variant’s median, so the narrative reads as one coherent story\. Textualization renders that profile as a natural\-language narrative through LUPIN’s event and trace templates\([Pasquadibisceglie et al\., 2024](https://arxiv.org/html/2609.22475#bib.bib3)\)\. Finally, a narrative sample \(frequent, rare, and extreme variants\) is drawn to calibrate the granularity at which taxonomy induction sets category boundaries\. The assignment subsequently applies to every narrative, not just the sample\. Table[1](https://arxiv.org/html/2609.22475#S3.T1)summarizes eight RTFM narratives, each being rendered as a structured header \(sampling reason, frequency, trace length, outcome\), i\.e\., an aggregation over the variant’s cases, followed by the activity sequence with inter\-activity gaps\. Nothing further about the variant is disclosed to the LLM\.

Table 1\.Excerpt of RTFM narratives and the guided\-arm category from the initial induction\.Taxonomy induction: intent\-guided and open \(Steps 5a/5b\)\.These modes differ in taxonomy induction and in the realization criterion used during assignment \(Step 6\)\. Inintent\_guidedmode, the LLM receives the narrative sample together with the goal model and is asked to set category boundaries within the axis the model declares\. It may not propose a different axis or introduce a category that is not traceable to a declared alternative\. Both constraints are rechecked once the taxonomy is returned: a result that is not a partition of the declared axis invalidates the run, and milder anomalies are reported to the analyst\. An*empty*category, one to which no variant is later assigned, is not a defect; it is reported as declared\-alternative coverage\. Inopenmode, the LLM proposes categories directly from the narrative sample, an unsupervised analog of the clustering step in trace\-clustering pipelines\([Song et al\., 2009](https://arxiv.org/html/2609.22475#bib.bib1);[Amling et al\., 2026](https://arxiv.org/html/2609.22475#bib.bib2)\)\. Granularity is asymmetric: a category may anchor several alternatives under one inclusive\-OR point, but two categories may not share an anchor, so induction cannot subdivide an alternative\. Finer granularity has to be declared in the goal model\. On RTFM, guided induction reproduces the five alternatives of Figure[1](https://arxiv.org/html/2609.22475#acmlabel1)and the categories of Table[1](https://arxiv.org/html/2609.22475#S3.T1)\. Each category is returned as a record with an anchor, evidence variants, and a description:*judicial appeal*anchors to element 19, cites V0005, and its description restates the goal model’s contribution links for that element \(*Make*\(\+100\)\(\+100\)towards due\-process rights,*Hurt*\(−50\)\(\-50\)towards administrative cost\); nothing in it is read off the log\. Three payment variants that differ only in installment structure \(V0003, V0007, V0008\) all fall under*delinquent payment*\(Section[6](https://arxiv.org/html/2609.22475#S6)\)\. Softgoals, contribution links, and KPIs inform category descriptions without introducing additional anchors; these descriptions may nevertheless influence Step 6’s assignments\.

Assignment and residual \(Step 6\)\.Assignment maps every narrative, not only the sample, to the category it best realizes, or to none\. The assignment prompt receives category identifiers, names, and descriptions, along with batches of narratives, and requests exactly one category identifier ornullper variant, along with a rationale\. In guided mode, realization means satisfying the declared alternative; in open mode, it means matching the recurring pattern described by the category\. Assignment records the LLM’s rationale and a margin that the pipeline computes independently, based on a structural metric \(edit distance over activity sequences\) and a profile metric \(outcome, duration, rework\)\. Coverage is reported at two levels of granularity: variant\-level coverageCVC\_\{V\}and case\-weighted coverageCCC\_\{C\}\. They can differ substantially, since a long tail of low\-frequency variants can depressCVC\_\{V\}with little effect onCCC\_\{C\}\. The residual means different things in the two modes\. Inintent\_guidedmode, it is behavior not assigned to a declared alternative: a candidate coverage gap that may also reflect an unresolved case, insufficient narrative evidence, or assignment error\. Inopenmode, there is no declaration to revise, so it is the analog of clustering noise\. The limit of this reading is visible in Table[1](https://arxiv.org/html/2609.22475#S3.T1): V0001, a still\-open case, lies one edit from*timely payment*, its nearest category, and only its rationale \(*ends with Send Fine and has no resolution*\) distinguishes an open case from a genuine goal model coverage gap\.

Category analysis \(Steps 7–8\)\.Per\-category discovery applies the Inductive Miner\([Leemans et al\., 2015](https://arxiv.org/html/2609.22475#bib.bib10)\)via PM4Py\([Berti et al\., 2023](https://arxiv.org/html/2609.22475#bib.bib9)\)to each categorized subset independently, and a description step then renders the resulting evidence as prose judging the category’s alignment with the model\.

Indicator satisfaction \(Step 7b, guided mode only\)\.This optional step measures each KPI of the goal model over a category’s own sublog, converts it to a satisfaction level, and propagates it through the goal model\. The declared and the measured readings can disagree\. On the full RTFM log, the goal model declares that judicial appeal*Makes*\(\+100\) the softgoal on due\-process rights, yet across the five evaluated replicates the filing time with the Judge in that category is measured at 91 to 113 days against a statutory 30\-day window, so that indicator scores−100\-100in every replicate\. This step does not enter either research question; per\-category indicator values are in the replication package\.

Analyst review \(Step 9\)\.The analyst accepts, renames, merges, or splits categories through a decisions file\. A merge or split requires re\-running Steps 5–8\. Inintent\_guidedmode, a recurrent coverage gap may be routed back to revise the goal model itself\.

#### Implementation\.

GoalCat\(contribution2\) is implemented in Python, built around PM4Py\([Berti et al\., 2023](https://arxiv.org/html/2609.22475#bib.bib9)\), and reusing the LUPIN module\([Pasquadibisceglie et al\., 2024](https://arxiv.org/html/2609.22475#bib.bib3)\)for textualization\. Goal models are authored using the native interchange format of the GRL/URN environment jUCMNav\([Roy et al\., 2006](https://arxiv.org/html/2609.22475#bib.bib14)\); KPI’s conversion and propagation follow the standard’s arithmetic and are checked against the closed\-form equations in\([Fan et al\., 2018](https://arxiv.org/html/2609.22475#bib.bib6)\)\. Every LLM\-backed step goes through a single adapter, so swapping the provider or model is a configuration change\. The source code, including a web\-based analyst interface, is publicly available\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)\.

## 4\.Evaluation

This section reports the evaluation \(contribution3\) of the two questions stated in the introduction, RQ1 \(divergence\) and RQ2 \(robustness\)\. The use of AI in conducting it is described in Section[4\.1](https://arxiv.org/html/2609.22475#S4.SS1)\. All the material is publicly available\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)\.

### 4\.1\.Setup

Protocol\.Every run follows a protocol frozen before execution: one LLM \(gemini\-3\.5\-flash\-lite, temperature 0\), one narrative sample per log shared by all conditions, and one assignment batch size \(25 narratives\)\. Steps 7–9 were not executed in any evaluated condition: the comparison is defined on the partitions produced by Step 6, before category analysis or analyst revision\. A pre\-registered stability check reruns Step 5a five times per axis and requires an invariant anchor set; all four evaluated axes passed\.

Logs and goal models\.Three public logs span a fifty\-fold range in variant count: RTFM\([de Leoni and Mannhardt, 2015](https://arxiv.org/html/2609.22475#bib.bib11)\)is high\-volume and low\-variety, Sepsis\([Mannhardt, 2016](https://arxiv.org/html/2609.22475#bib.bib13)\)is the opposite, and BPIC 2019\([van Dongen, 2019](https://arxiv.org/html/2609.22475#bib.bib12)\)is high on both\. Each log’s goal model was authored for this study from publicly available information, without domain\-expert review\. Sepsis’s root goal joins two independent OR frontiers under an AND decomposition, so it is treated as two axes, each with its own runs\.

Arms\.Each axis is compared across five treatments: intent\-guided \(TGT^\{G\}, Step 5a with the goal model\), open \(TOT^\{O\}, Step 5b on the identical sample without it\),guided\_no\_sample, and two label\-list controls \(label\_list,label\_list\_strict\)\. The controls skip Step 5a and assign against the same externally authored list under the open and guided assignment criteria, respectively\. List cardinality matchesTGT^\{G\}except for Sepsis admission, whose guided taxonomy has two categories whereas the shared Sepsis control list has five\. Open and label\-list runs are shared between Sepsis’s two axis comparisons\.

Replicates and statistics\.The frozen protocol fixed two replicates per arm\. Guided and open were later extended to five replicates on RTFM and Sepsis and three on BPIC 2019, so that both arms’ replicate\-agreement floors rest on the same number of reruns\. We report every completed replicate and state thennfor each table\. Replicates are identical\-input reruns of a temperature\-0 endpoint, so we report means with descriptive min–max ranges and apply no inferential test\. RQ2 is scoped to RTFM and Sepsis; BPIC 2019’s perturbations were not run for cost reasons \(Section[4\.4](https://arxiv.org/html/2609.22475#S4.SS4)\)\.

Use of AI in this research and evaluation\.An LLM coding assistant, Claude Code with Anthropic’s Claude models \(Opus 5 and Sonnet 5\), was used throughout the research lifecycle, with the authors making every design decision and reviewing every artifact\. Specifically, it \(i\) generated most of theGoalCatsource code and its test suite from the authors’ specifications; the KPI conversion and propagation code was additionally checked against the closed\-form equations of\([Fan et al\., 2018](https://arxiv.org/html/2609.22475#bib.bib6)\); \(ii\) produced first drafts of the three goal models and of the RQ2 perturbed variants from the public sources cited in the replication package, which the authors revised \(element naming, decomposition operators, and indicator value sets\) and froze before any run; no domain expert reviewed them \(Section[6](https://arxiv.org/html/2609.22475#S6)\); \(iii\) drafted the pre\-registered protocol, the condition configurations, and the analysis scripts that compute coverage, partition agreement, and the reassignment rates, which the authors reviewed and which are guarded by regression tests; \(iv\) generated the TikZ sources of Figures[1](https://arxiv.org/html/2609.22475#acmlabel1)and[2](https://arxiv.org/html/2609.22475#acmlabel2)from the authors’ sketches; and \(v\) assembled the replication package\. Every categorization result reported below was produced bygemini\-3\.5\-flash\-liteinside the pipeline, and every number in the tables was computed by the deterministic analysis scripts from the archived run outputs, not by the assistant\.

Table[2](https://arxiv.org/html/2609.22475#S4.T2)summarizes the evaluation logs and the intent\-guided partition \(TGT^\{G\}\)\.\|TG\|\|T^\{G\}\|is the number of categories in the guided taxonomy \(Step 5a\); it is invariant across every replicate of every axis and is therefore reported without a range\. Residual \(var\.\) and Residual \(cases\) are the percentages of variants and cases, respectively, assigned to no category \(Step 6\), given as mean \[min–max\] over thennguided replicates because Step 6 is not deterministic; a bare residual value denotes a range whose endpoints coincide at the displayed precision\.

Table 2\.Evaluation logs and the intent\-guided partition \(TGT^\{G\}\)\.
### 4\.2\.RQ1 \(divergence\): intent\-guided versus open induction

Both arms categorize the same variants of the same log with the same model and narrative sample\. They differ in the origin of their taxonomies and, in the evaluated implementation, in a mode\-specific realization criterion in the Step 6 prompt\. The comparison therefore contrasts two complete treatments; it does not isolate taxonomy provenance alone\. We compare coverage, use of the declared alternatives, and the resulting partitions\.

Coverage\.The pattern differs across logs\. On Sepsis, the guided residual is larger than the open residual on both axes\. On RTFM, case\-weighted residual rates are nearly identical because one unresolved high\-frequency variant dominates both, although variant\-weighted rates differ\. In BPIC 2019, the residual ranges overlap under both weightings: the guided mean is lower by variant count but higher by case count\. Coverage therefore describes assignment under a particular declared frame, narrative representation, and assignment mechanism; it is not a quality score\.

Guided’s residual is stable across BPIC 2019’s reruns, whereas open’s swings by roughly 55 percentage points \(variant\-weighted\) across identical reruns, ten times guided’s widest swing anywhere in the study \(RTFM, under 7 points\)\. The open arm’s category names remain stable across reruns; the portion of the log they cover does not\. On the largest and most diverse log, open’s coverage is thus unpredictable from one identical rerun to the next, which the frozen two\-replicate protocol could register as a swing but not distinguish from a single outlier\.

Declared alternatives\.No declared alternative goes unused\. Every alternative on the frontier is realized by at least one variant on every axis and in every replicate: 5/5 on RTFM, 2/2 on Sepsis’s admission axis, 5/5 on its discharge axis, and 4/4 on BPIC 2019\. Several alternatives are nonetheless near\-vanished in full scope, and per\-category figures computed from them are anecdotal\.

Partition agreement\.The two arms do not cut the log along the same lines\. We measure the agreement between two categorizations of the same variants with Adjusted Mutual Information \(AMI\), which is 1 for identical partitions and about 0 for unrelated ones, treating the residual as a block of its own \(Table[3](https://arxiv.org/html/2609.22475#S4.T3)\)\. Guided\-vs\-open agreement averages 0\.17 to 0\.30 across the four axes \(variant\-weighted\)\. Each arm’s agreement with its own reruns is the noise floor for that comparison\. Guided’s minimum within\-arm agreement exceeds the maximum guided\-vs\-open agreement on every axis and weighting, separating the observed cross\-arm differences from the variation observed among guided reruns\. Open’s floor is less consistent: on RTFM \(both weightings\) and on BPIC 2019 case\-weighted, it overlaps the guided\-vs\-open band, so on those three readings the conclusion rests on guided’s stability alone\. On RTFM, hand inspection shows a systematic split\-and\-merge rather than scattered noise: the open arm folds the two appeal categories into one, splits the payment categories by execution detail, and sends most of the guided residual into the merged appeal category \(contingency counts are in the replication package\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)\)\.

Table 3\.Partition agreement \(AMI, residual as its own block\), mean \[min–max\] over replicate pairs\. Each arm’s own agreement is the noise floor for the guided\-vs\-open column\.Controls\.The two label\-list controls replace the induced taxonomy with a fixed, externally authored list of the same size \(except on Sepsis admission\)\. Agreement between guided and either control stays well below guided’s own replicate floor on every axis, so neither the number of categories nor the assignment criterion explains the divergence on its own\. Each list was deliberately drawn along a different axis from the goal model, so the controls cannot separate the goal model’s axis from its vocabulary\. Full results are in the replication package\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\); Section[6](https://arxiv.org/html/2609.22475#S6)discusses the caveats\.

Baselines\.Structural clustering over activity\-presence vectors \(no order or timing; HDBSCAN\) over\-segments every log relative to the declared axis, and none of its three partitions aligns with either LLM partition\. A five\-rule classifier written once for RTFM from the process description, without tuning against the log, uses activity presence and the order ofAdd penaltyandPayment\. Its fixed priority assigns appeals before collection or payment, even when a later activity closes the case\. It agrees with the guided assignment for approximately 97% of cases in replicate 1, with agreement above 99% in four of the five guided categories\. Disagreement concentrates in the delinquent payment category\.

Answer to RQ1 \(Divergence\)Across all four axes and both weightings, cross\-arm agreement remains below the observed guided–guided agreement range; mean variant\-weighted AMI is 0\.17–0\.30\. Separation from open–open agreement is incomplete on RTFM under both weightings and on case\-weighted BPIC 2019\. Every declared alternative is used, while residual size depends on the log and weighting\. Neither tested label\-list control reproduces the guided partition, but the comparison does not isolate the factors in which the treatments differ\.

### 4\.3\.RQ2 \(robustness\): goal\-model perturbations

Here we edit the goal model itself and re\-run the guided arm five times for each edited model\. Each axis is perturbed in three ways: \(A\) one declared alternative is removed; \(B\) two are merged \(refused where a decomposition point would be left with a single child\); and \(C\) one plausible but unrealized alternative is added under the axis, grounded in the same public material as the base model \(e\.g\., RTFM’s*fine annulment*\)\. Table[4](https://arxiv.org/html/2609.22475#S4.T4)reports two rates for A and B, each representing the mean over five replicates, with its min–max range\.TargetReassignmentis the share of variants realizing the perturbed alternative\(s\) that change category\. It checks that the edit took effect: it is exactly 100% for every removal and falls slightly short for both merges \(97\.5% RTFM, 99\.3% Sepsis discharge\), because the merge tool retains one target’s original ID\.CollateralReassignment, the share of*every other*variant that changes category, is the quantity of interest\. For perturbation C, no baseline variant realizes the added alternative, so we reportDistractorUptake, the share of variants assigned to it\. Step 5a admits the distractor into the taxonomy in all 15 replicates, and Step 6 assigns it zero variants in every one\.

Collateral movement means little on its own, since two identical reruns already reassign some variants\. Hence, every rate is read againstC∅C^\{\\emptyset\}, the same rate measured between pairs of five unperturbed guided replicates within one fixed collateral population\. Those ten pairs are not independent, soC∅C^\{\\emptyset\}is a descriptive min–max range rather than a null distribution\. Of the eight conditions \(three axes times three edits, less the refused Sepsis admission merge\), four have ranges that sit entirely inside theirC∅C^\{\\emptyset\}range: Sepsis admission’s removal sits entirely below it, quieter than ordinary replicate noise, and three conditions \(Sepsis admission’s and discharge’s distractors, and Sepsis discharge’s removal of*Release E*\) extend a few points past its upper edge\. In these three conditions, the five\-replicate mean remains within the baseline range, but some replicates exceed its upper edge\. This descriptive overlap does not establish equivalence or rule out the possibility of an additional perturbation effect\.

Table 4\.Goal\-model perturbations, guided arm, mean \[min–max\] over five replicates per condition \(Sepsis admission has no merge: OR point with only two children\)\.nnin the Target column is the number of variants realizing the perturbed alternative\(s\) \(n/a for C\);nnin the Collateral column is the rest\.†C’s Target column reports DistractorUptake in place of TargetReassignment\.Answer to RQ2 \(Robustness\)Largely yes\. Collateral reassignment stays within or slightly above the range observed among unperturbed replicates in all eight conditions\. An added alternative that no variant realizes is admitted into the taxonomy in all 15 runs but receives no variant in any of them\. Target reassignment \(100% for removals and 97\.5–99\.3% for merges\) confirms that each edit took effect\. On RTFM, the unperturbed range is wide, so its three conditions can detect only a large reorganization\.

### 4\.4\.Feasibility

Across all runs in this study, the pipeline issued roughly 6,900 hosted\-LLM calls \(58\.8M input tokens, 9\.9M output tokens\) at an estimated cost of USD 42\.3 on the gemini\-3\.5\-flash\-lite paid endpoint, running on a single laptop\-class workstation \(8\-core Apple M3, 8 GB RAM\)\. A single guided or open condition costs roughly USD 0\.05 on RTFM, USD 0\.17 on Sepsis, and USD 3\.09 on BPIC 2019\. Cost tracks variant count, since assignment issues one call per batch of 25 narratives \(10, 34, and 479 calls, respectively\), while Step 5a is a single call regardless of log size\. Wall\-clock time does not follow cost: the deterministic steps dominate a guided condition’s wall\-clock time on the small logs \(81–87% on RTFM\), whereas on BPIC 2019, the LLM assignment step alone runs for 600–2,100 s\. A laptop\-class local model \(qwen2\.5:3b via Ollama\) was not a viable substitute: the frozen batch size exceeded its context window\. These figures are indicative, not a benchmark; a full resource characterization accompanies the replication package\.

## 5\.Discussion

Guided and open treatments produce different partitions\(RQ1\)\. Cross\-arm agreement falls below the observed guided–guided range on every axis and weighting, but it overlaps the open–open range on RTFM and case\-weighted BPIC 2019\. RTFM inspection identifies a split\-and\-merge pattern, while its mean case\-weighted cross\-arm AMI of 0\.91 shows that the difference is much smaller for frequent cases\. This comparison describes the complete treatments and does not isolate the effect of goal\-model guidance\.

Controlled goal\-model perturbations provide the strongest evidence about the mechanism\(RQ2\)\. Collateral reassignment is generally comparable to observed unperturbed variation, although three conditions partly exceed its range\. The result supports sensitivity to declared alternatives with limited additional disruption relative to baseline variation; it does not imply negligible absolute movement or validate the categories\. Distractors receive no assignments\.

The declared frame provides an explicit reference for inspecting the residual\.The unresolved RTFM variant carrying 13\.6% of cases remains residual under both arms in every replicate; the guided model relates its exclusion to the declared resolution alternatives\. Guided residual rates are more stable than open ones on Sepsis and BPIC 2019, but the guided residual is not uniformly larger\. Coverage depends on the declared frame, narrative representation, and assignment mechanism; it does not assess the quality of categorization or illustrate gaps in the goal model coverage\.

On a log with a small, well\-separated outcome vocabulary, the goal model contributes traceability rather than discriminative power: a hand\-written classifier matches the guided partition almost exactly, whereas structural clustering fails, because three payment variants differing only in installment structure collapse to one activity\-occurrence vector\. The guided arm also places those three variants in one category for a different reason: the goal model declares a single alternative there\.The partition’s granularity is set by what the model declares, not by what the log distinguishes\.That ceiling belongs to the construct studied here, one OR/XOR frontier projected to a single label, not to fixing the axis in advance, which admits finer\-grained declared bases\.

The goal model fixes the taxonomy’s structure\. Across all 46 guided and ablation inductions on the four axes, exactly one anchor set occurs per axis, with and without the narrative sample\. Generated descriptions and rationales vary; the category descriptions feed Step 6, so assignment variation may reflect both description changes and Step 6’s own nondeterminism\. That\|TG\|\|T^\{G\}\|equals the frontier size everywhere is enforced on RTFM and Sepsis \(two categories may not share an anchor, and the merge rule never fired\) but was*observed*on BPIC 2019, where seven guided runs executed before the partition check existed recovered the declared frontier exactly \(7/77/7\) from the goal\-model excerpt alone\.

Step 7b \(guided arm only\) was pre\-registered for RTFM alone, the only log whose indicators are organizational targets rather than percentiles computed from the log itself\. Because its sublogs are Step 6’s output,indicator satisfaction characterizes the partition rather than validating it\.

Folding interleavings of concurrent activities into partial\-order classes would not cut assignment cost where it matters: RTFM’s 231 variants fold to 85, but BPIC 2019’s 11,973 fold only to 11,463, because the variant explosion in that log is rework\-driven rather than parallelism\-driven\.

## 6\.Threats to Validity

#### Conclusion validity\.

The evaluation covers three logs and two to five replicates per condition, providing limited evidence about variability and generalization\. Guided and open replicate counts are matched within each axis, but differ across logs and from the controls\. Pairwise comparisons share runs, and min–max ranges depend on the number of observations; these ranges are descriptive and do not establish statistical significance or equivalence\. Reliability is controlled by construction\. We record and hash every condition’s inputs, and a paired comparison that departs from its design is re\-run and not reported\. Step 5a reproduces the same anchor set in every guided rerun of every axis, whereas Step 6 assignments vary; the observed guided–guided AMI ranges exceed the corresponding open–open ranges in Table[3](https://arxiv.org/html/2609.22475#S4.T3)\. Cost and latency were measured on one workstation against a hosted endpoint whose behavior varied during the measurement window; they show the pipeline is affordable at these scales and are not a benchmark\.

#### Internal validity\.

Perturbation B merges two alternatives: it moves a category boundary and also lowers the taxonomy’s cardinality, and the two effects cannot be separated here\. The batch size was fixed for wall\-clock/reliability reasons rather than varied, so it cannot explain within\-pair differences, but its interaction with assignment quality is uncharacterized\. Both are engineering choices rather than variables under study\.

#### Construct validity\.

No domain authority reviewed the goal models, the resulting categories, residuals, or the generated descriptions\. Two claims are therefore out of reach: that the declared alternatives align with how the organization thinks about the process, and that a residual variant indicates a real gap rather than an omission by the model’s author\. The construct is also coarser than the log, as the RTFM payment variants of Section[5](https://arxiv.org/html/2609.22475#S5)show\. The single\-label projection is a further limitation: an inclusive OR point permits several alternatives to hold at once, whereas assignment returns exactly one, and we did not measure how often that choice discards a second, genuinely realized alternative\. On RTFM, the effect is measurable and concentrated as 120 variants lodge an appeal and then close by payment or collection, and the five identical\-input guided replicates resolve between 42 and 74 of them by the appeal, the rest by the closing activity\. The guided arm’s variant\-level instability is thus largest where the declared axis leaves the single\-label choice open, which is an argument for declaring the tie\-break in the goal model rather than leaving it to the LLM\. Finally, the two arms differ in four respects: the guided arm is given an external axis, a fixed number of categories, the goal model’s own vocabulary, and a stricter assignment criterion\. The last of these plausibly shifts the residual boundary on its own, and none of the four is separable from these runs\. The evaluation therefore characterizes the categorization mechanism, while the organizational relevance of its outputs and their usefulness to analysts remain unvalidated\.

#### External validity\.

Every run uses one LLM\. The paired design only requires that both arms of a pair share it, so the comparison is sound, but we cannot say whether the divergence holds for other model families\. The approach also assumes a goal model that declares one usable OR/XOR axis\. Sepsis does not because its root joins two independent OR frontiers, so we split it into two axes\. A model whose decomposition types are left unset silently defaults to AND and declares no axis at all\. Finally, the authors used Step 9 only as a mechanism check; no domain expert reviewed a description, so the analyst\-review loop runs but is not evaluated\.

## 7\.Conclusion and Future Work

We presented goal\-driven variant categorization1, an approach that uses a GRL/URN goal model to induce a classification taxonomy and categorize trace variants\. The goal model declares the alternative ways a goal is met, and those declared elements serve as category anchors, while behavior that matches none of them is reported as a residual, i\.e\., an inspectable candidate goal\-model coverage gap\. We instantiated the approach asGoalCat2, a publicly available pipeline, and evaluated it on three public logs spanning a fifty\-fold range in variant count\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)3\.

On RQ1, the guided and open treatments partition the same variants differently\. Cross\-arm agreement stays below the guided replicate range on every axis, but overlaps the open range on RTFM and on BPIC 2019 case\-weighted\. The arms also differ in four respects that this design cannot separate\. On Sepsis and BPIC 2019, guided residuals are more stable than open ones, though not uniformly larger\. For RQ2, the main result is that removing or merging a declared alternative moves the variants that realized it\. Collateral reassignment stays generally within the range of unperturbed reruns, and an added alternative that no variant realizes receives none\. Two findings bound the claim\. On RTFM, a handwritten classifier agrees with the guided partition in 97% of cases, but only in about two\-thirds of variants\. The goal model fixes the anchored structure at Step 5a, while the generated descriptions and Step 6 remain sources of variation\. That remaining variation is concentrated where the declared axis leaves the single\-label choice open \(Section[5](https://arxiv.org/html/2609.22475#S5)\), so a goal model used as a categorization axis should also declare which alternative prevails when a case realizes several\. In addition, at these scales, a run costs from a few cents to a few dollars per condition\.

Several research directions follow\. First, the goal models and the categorizations they produce require domain\-expert validation, which would also settle whether a recurring residual marks a genuine gap in organizational intent\. Second, other declared categorization axes \(AND\-decomposition phases, softgoal profiles, KPI bands\) deserve to be instantiated, each with its own validity treatment\. Third, how the approach degrades under partial or under\-specified goal models deserves direct study\. Fourth, extending Step 7b with the whether\-question of goal\-oriented process mining would give a satisfaction signal for the residual and a finer read within each category\. Replication with other model families and an evaluation of the analyst\-review loop itself remain open\.

## Data Availability

The source code, experimentation scripts, and results are publicly available\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)\.

## Ethics and Privacy Statement

Event logs are public: Road Traffic Fine Management\([de Leoni and Mannhardt, 2015](https://arxiv.org/html/2609.22475#bib.bib11)\), Sepsis\([Mannhardt, 2016](https://arxiv.org/html/2609.22475#bib.bib13)\), and BPI Challenge 2019\([van Dongen, 2019](https://arxiv.org/html/2609.22475#bib.bib12)\)\. Goal models were authored from publicly available information\. No institutional review was required\.

###### Acknowledgements\.

Use of AI\.GenAI tools were used in two distinct ways in this work, and the authors take full responsibility for all content\. First, in the conduct of the research: as detailed in Section[4\.1](https://arxiv.org/html/2609.22475#S4.SS1)\(*Use of AI in this research and evaluation*\), Claude Code with Anthropic’s models generated most of theGoalCatsource code and tests \(Section[3](https://arxiv.org/html/2609.22475#S3),Implementation\), drafted the goal models and their RQ2 perturbations, drafted the pre\-registered protocol and the analysis scripts, generated the TikZ sources of Figures[1](https://arxiv.org/html/2609.22475#acmlabel1)and[2](https://arxiv.org/html/2609.22475#acmlabel2), and assembled the replication package\([Calegari and Amyot, 2026](https://arxiv.org/html/2609.22475#bib.bib15)\)\. Every such artifact was specified, reviewed, and revised by the authors, and the goal models were frozen before any run\. The LLM under study,gemini\-3\.5\-flash\-lite, produced every categorization result reported in Section[4](https://arxiv.org/html/2609.22475#S4), as the object of the experiments rather than as an assistant\. Second, in writing: GenAI tools assisted with drafting, restructuring, and language editing of this manuscript\. All claims, numbers, and interpretations were verified by the authors against the archived run outputs\.

## References

- Amlinget al\.\(2026\)J\. Amling, E\. Slany, C\. Dormagen, M\. Kretschmann, and S\. ScheeleBridging the interpretability gap in process mining: a comprehensive approach combining explainable clustering and generative ai\.InExplainable Artificial Intelligence \(xAI 2025\),CCIS, Vol\.2577,pp\. 78–103\.Note:CC BY 4\.0External Links:[Document](https://dx.doi.org/10.1007/978-3-032-08324-1%5F4)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p1.1),[§1](https://arxiv.org/html/2609.22475#S1.p2.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.p4.1)\.
- Amyotet al\.\(2022\)D\. Amyot, O\. Akhigbe, M\. Baslyman, S\. Ghanavati, M\. Ghasemi, J\. Hassine, L\. Lessard, G\. Mussbacher, K\. Shen, and E\. YuCombining goal modelling with business process modelling: two decades of experience with the user requirements notation standard\.Enterprise Modelling and Information Systems Architectures \(EMISAJ\)17,pp\. 2:1–38\.External Links:[Document](https://dx.doi.org/10.18417/emisa.17.2)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p3.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p1.1)\.
- Bertiet al\.\(2024\)A\. Berti, H\. Kourani, and W\. M\. P\. van der AalstPM\-llm\-benchmark: evaluating large language models on process mining tasks\.InProcess Mining Workshops \- ICPM 2024 Intl\. Workshops, Revised Selected Papers,A\. Delgado and T\. Slaats \(Eds\.\),LNBIP, Vol\.533,pp\. 610–623\.External Links:[Document](https://dx.doi.org/10.1007/978-3-031-82225-4%5F45)Cited by:[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1)\.
- Bertiet al\.\(2023\)A\. Berti, S\. J\. van Zelst, and D\. SchusterPM4Py: A process mining library for python\.Softw\. Impacts17,pp\. 100556\.External Links:[Document](https://dx.doi.org/10.1016/J.SIMPA.2023.100556)Cited by:[§3](https://arxiv.org/html/2609.22475#S3.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.p6.1)\.
- Bose and van der Aalst \(2009\)R\. P\. J\. C\. Bose and W\. M\. P\. van der AalstContext aware trace clustering: towards improving process mining results\.InProceedings of the SIAM Intl\. Conf\. on Data Mining, SDM 2009,pp\. 401–412\.External Links:[Document](https://dx.doi.org/10.1137/1.9781611972795.35)Cited by:[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1)\.
- Calegari and Amyot \(2026\)D\. Calegari and D\. AmyotGoalCat: goal\-driven variant categorization\.Note:GitHubhttps://github\.com/dcalegar/GoalCat, AGPL\-3\.0Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p4.1),[§3](https://arxiv.org/html/2609.22475#S3.SS0.SSS0.Px1.p1.1),[§4\.2](https://arxiv.org/html/2609.22475#S4.SS2.p5.1),[§4\.2](https://arxiv.org/html/2609.22475#S4.SS2.p6.1),[§4](https://arxiv.org/html/2609.22475#S4.p1.1),[§7](https://arxiv.org/html/2609.22475#S7.p1.1),[Data Availability](https://arxiv.org/html/2609.22475#Sx1.p1.1),[Acknowledgements](https://arxiv.org/html/2609.22475#Sx2.acknowledgements1)\.
- de Leoni and Mannhardt \(2015\)M\. de Leoni and F\. MannhardtRoad traffic fine management process\.4TU\.ResearchData\.External Links:[Document](https://dx.doi.org/10.4121/uuid%3A270fd440-1057-4fb9-89a9-b699b47990f5)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p4.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p3.1),[§4\.1](https://arxiv.org/html/2609.22475#S4.SS1.p2.1),[Ethics and Privacy Statement](https://arxiv.org/html/2609.22475#Sx2.p1.1)\.
- Fanet al\.\(2018\)Y\. Fan, A\. A\. Anda, and D\. AmyotAn arithmetic semantics for GRL goal models with function generation\.InSystem Analysis and Modeling \(SAM 2018\),LNCS, Vol\.11150,pp\. 144–162\.External Links:[Document](https://dx.doi.org/10.1007/978-3-030-01042-3%5F9)Cited by:[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p3.1),[§3](https://arxiv.org/html/2609.22475#S3.SS0.SSS0.Px1.p1.1),[§4\.1](https://arxiv.org/html/2609.22475#S4.SS1.p5.1)\.
- Ghasemiet al\.\(2025\)M\. Ghasemi, D\. Amyot, and W\. Van WoenselGoal\-oriented process mining: a scalability experiment\.InMoDRE Workshop @ IEEE 33rd Intl\. Requirements Engineering Conf\. Workshops \(REW\),pp\. 304–313\.External Links:[Document](https://dx.doi.org/10.1109/REW66121.2025.00046)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p2.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p4.1)\.
- Ghasemi and Amyot \(2020\)M\. Ghasemi and D\. AmyotFrom event logs to goals: a systematic literature review of goal\-oriented process mining\.Requirements Engineering25\(1\),pp\. 67–93\.External Links:[Document](https://dx.doi.org/10.1007/s00766-018-00308-3)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p2.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p4.1)\.
- ITU\-T \(2018\)ITU\-TRecommendation z\.151 \(10/2018\): user requirements notation \(urn\) — language definition\.Note:[https://www\.itu\.int/rec/T\-REC\-Z\.151](https://www.itu.int/rec/T-REC-Z.151)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p3.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p1.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p2.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p3.1)\.
- Konincket al\.\(2018\)P\. D\. Koninck, S\. vanden Broucke, and J\. D\. WeerdtAct2vec, trace2vec, log2vec, and model2vec: representation learning for business processes\.InBusiness Process Management \(BPM 2018\),LNCS, Vol\.11080,pp\. 305–321\.External Links:[Document](https://dx.doi.org/10.1007/978-3-319-98648-7%5F18)Cited by:[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1)\.
- Leemanset al\.\(2015\)S\. J\. J\. Leemans, D\. Fahland, and W\. M\. P\. van der AalstScalable process discovery with guarantees\.InEnterprise, Business\-Process and Information Systems Modeling \(BPMDS/EMMSAD\),LNBIP, Vol\.214,pp\. 85–101\.External Links:[Document](https://dx.doi.org/10.1007/978-3-319-19237-6%5F6)Cited by:[§3](https://arxiv.org/html/2609.22475#S3.p6.1)\.
- Mannhardt \(2016\)F\. MannhardtSepsis cases \- event log\.4TU\.ResearchData\.External Links:[Document](https://dx.doi.org/10.4121/uuid%3A915d2bfb-7e84-49ad-a286-dc35f063a460)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p4.1),[§4\.1](https://arxiv.org/html/2609.22475#S4.SS1.p2.1),[Ethics and Privacy Statement](https://arxiv.org/html/2609.22475#Sx2.p1.1)\.
- Pasquadibisceglieet al\.\(2024\)V\. Pasquadibisceglie, A\. Appice, and D\. MalerbaLUPIN: A LLM approach for activity suffix prediction in business process event logs\.In6th Intl\. Conf\. on Process Mining, ICPM 2024,pp\. 1–8\.External Links:[Document](https://dx.doi.org/10.1109/ICPM63005.2024.10680620)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p3.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.p3.1)\.
- Royet al\.\(2006\)J\. Roy, J\. Kealey, and D\. AmyotTowards integrated tool support for the user requirements notation\.InSystem Analysis and Modeling: Language Profiles \(SAM 2006\),LNCS, Vol\.4320,pp\. 198–215\.External Links:[Document](https://dx.doi.org/10.1007/11951148%5F13)Cited by:[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px2.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.SS0.SSS0.Px1.p1.1)\.
- Songet al\.\(2009\)M\. Song, C\. W\. Günther, and W\. M\. P\. van der AalstTrace clustering in process mining\.InBusiness Process Management Workshops,LNBIP, Vol\.17,pp\. 109–120\.External Links:[Document](https://dx.doi.org/10.1007/978-3-642-00328-8%5F11)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p1.1),[§2](https://arxiv.org/html/2609.22475#S2.SS0.SSS0.Px1.p1.1),[§3](https://arxiv.org/html/2609.22475#S3.p3.1),[§3](https://arxiv.org/html/2609.22475#S3.p4.1)\.
- van Dongen \(2019\)B\. F\. van DongenBPI challenge 2019\.4TU\.ResearchData\.External Links:[Document](https://dx.doi.org/10.4121/uuid%3Ad06aff4b-79f0-45e6-8ec8-e19730c248f1)Cited by:[§1](https://arxiv.org/html/2609.22475#S1.p4.1),[§4\.1](https://arxiv.org/html/2609.22475#S4.SS1.p2.1),[Ethics and Privacy Statement](https://arxiv.org/html/2609.22475#Sx2.p1.1)\.

Similar Articles

From Isolated Tasks to Structured Capabilities: A Multilayer Taxonomy for Large Language Models

arXiv cs.CL

The paper introduces a multi-layer taxonomy for large language models comprising 14 capability domains and 91 subskills, drawing from human cognitive science to organize LLM evaluation beyond isolated tasks. It demonstrates operational utility by mapping 15,934 papers across major AI conferences, revealing concentrated attention on language-semantic competence and reasoning while identifying underexplored domains.