Sensitivity Analysis of Decision Rules in an Agent-Based Agro-Ecological Model
Summary
This paper proposes a novel random-forest-supervised HSIC-ANOVA method for sensitivity analysis of hierarchical decision-rule parameter spaces in agent-based agro-ecological models, applied to the MAELIA platform to interpret outputs like nitrogen leaching, soil organic carbon, and yield predictions.
View Cached Full Text
Cached at: 10/19/26, 07:02 AM
# Sensitivity Analysis of Decision Rules in an Agent-Based Agro-Ecological Model
Source: [https://arxiv.org/html/2610.22420](https://arxiv.org/html/2610.22420)
Baptiste LesquoyPaul SavesBenoit GaudouJean VillerdNicolas VerstaevelOlivier Therond
###### Abstract
Agent\-based models are well\-suited for modelling agro\-ecological systems for decision\-making, yet turning their simulations into actionable insight requires identifying which decisions actually drive the behaviours\. In such a context, sensitivity analysis stumbles upon a structural feature of many complex systems: the parameters are not a flat vector but a decision tree in which many parameters appear only when a higher\-level choice activates them\. Classical global sensitivity analysis presupposes independent inputs over a fixed Cartesian product and is ill\-posed on such a branched space and biased by construction\. We instead treat the structure of the decisions as a first\-class modelling object\. Using advanced surrogate modelling techniques, we encode the crop\-management itinerary of the high\-resolution agro\-ecological modelling platform MAELIA as a hierarchical design space featuring both categorical and numerical variables\. We propose a novel dedicated method to analyse this kind of hierarchical space, a random\-forest\-supervised HSIC\-ANOVA, which ranks main effects and interactions natively on the tree while placing rarely and always active decisions on an equal footing\. We show how, when applied to simulation outputs such as nitrogen leaching, soil organic carbon variation, and yield predictions, it can deliver an interpretable, decision\-oriented reading\.
###### Keywords:
Sensitivity Analysis Agent\-Based Modelling and Simulation Agro\-Ecological System Hierarchical and mixed Parameter Space Kernel\-Based Dependence Measures
## 1Introduction
Socio\-agro\-ecological systems couple human decisions with biophysical processes such as crop growth, water flow, and nutrient cycling\. Agent\-Based Models \(ABMs\) have become a reference tool for representing these couplings because they relax the strong analytical assumptions of aggregate models and make space, heterogeneity, stochasticity and individual decision\-making explicit\[[8](https://arxiv.org/html/2610.22420#bib.bib8),[27](https://arxiv.org/html/2610.22420#bib.bib27)\]\. The MAELIA \(Modelling of socio\-Agro\-Ecological system for Landscape Integrated Assessment\) platform is a representative example: built on the GAMA simulation platform\[[48](https://arxiv.org/html/2610.22420#bib.bib48)\], it simulates the interaction between agricultural activities, hydrology and water\-resource governance at a daily time step and from the plot to the territory spatial scale, and it produces a broad range of socio\-economic and agro\-environmental indicators\[[18](https://arxiv.org/html/2610.22420#bib.bib18),[50](https://arxiv.org/html/2610.22420#bib.bib50)\]\. Still, this descriptive variety makes the model difficult to analyse, since any simulated output emerges from the coupling of its components, computed jointly at each time step, each feeding the others, rather than from a single parameter taken in isolation\. Attributing an output to the inputs is further complicated by the shape of the input space itself\. In such applications, parameters form a*decision tree*rather than a flat vector:*conditionally active*sub\-parameters have meaning only when decreed by a higher\-level*meta*variable, so the very existence of a parameter depends on the value taken by another\. Applying a flat sampling strategy to this branched space generates invalid architectural combinations, typically handled by imputing default values to inactive decreed variables\[[47](https://arxiv.org/html/2610.22420#bib.bib47)\]\. Therefore, a structured hierarchical treatment of the parameter space is necessary\[[40](https://arxiv.org/html/2610.22420#bib.bib40)\]as formalised in recent work\[[2](https://arxiv.org/html/2610.22420#bib.bib2)\]\. Moreover, the Surrogate Modelling Toolbox \(SMT\) and adsg\-core libraries provide open\-source software to deal with them practically\[[41](https://arxiv.org/html/2610.22420#bib.bib41)\]\. To understand such complex models and quantify how much of the output variability can be assigned to the inputs, practitioners generally perform Global Sensitivity Analysis \(GSA\)\[[36](https://arxiv.org/html/2610.22420#bib.bib36)\]\. While a substantial literature adapts these tools to ABMs specifically\[[8](https://arxiv.org/html/2610.22420#bib.bib8),[51](https://arxiv.org/html/2610.22420#bib.bib51),[6](https://arxiv.org/html/2610.22420#bib.bib6)\], two obstacles remain\. First, variance\-based indices require many model evaluations, which are prohibitive for a time\-consuming simulator \(which is the case most of the time with ABM\)\. Second, and more fundamentally, classical GSA assumesi\.i\.d\.\(independent and identically distributed\) inputs, which a hierarchical space violates by construction\[[39](https://arxiv.org/html/2610.22420#bib.bib39)\]\. Furthermore, imputed values mask the true influence of the upstream decisions that actually control a branch, breaking the variance decomposition\. To overcome this, a complementary line of work makes the exploration itself systematic: a recent multi\-stage workflow for stochastic ABMs first screens the space and then trains a surrogate on which it computes sensitivity indices and explanations\[[42](https://arxiv.org/html/2610.22420#bib.bib42)\]\.
Whether such an approach transfers to a complex, real agro\-ecological simulator whose parameter space is genuinely hierarchical remains an open challenge\. This paper addresses this challenge\. We model the structure of agricultural decisions and analyse the sensitivity of MAELIA within it\. Our contributions are threefold: \(i\)An application to a complex model:We apply the analysis to MAELIA, a high\-resolution agro\-ecological agent\-based modelling platform whose daily\-step coupling of management, soil and climate is markedly more complex than the toy or single\-purpose models that dominate the ABM sensitivity\-analysis literature; \(ii\)A hierarchical, structured parameter space for SA:We encode MAELIA’s crop\-management decision as a design space of meta and decreed variables \(soil\-preparation and fertilisation switches activating their dependent counts, depths, doses and dates\), spanning1414potential parameters, so that sampling and sensitivity analysis respect the conditional activation of variables; \(iii\)A structure\-aware analysis pipeline:We propose a two\-stage pipeline over the hierarchical space that couples random\-forest supervision with an HSIC\-ANOVA decomposition\. The random forest identifies the influential variables, and the subsequent decomposition quantifies how strongly the outputs depend on them, handling categorical and numerical inputs alike\. The remainder of this paper is as follows\. Section[2](https://arxiv.org/html/2610.22420#S2)reviews sensitivity analysis methods for agent\-based models, hierarchical and mixed\-variable design spaces, and surrogate\-assisted exploration\. Section[3](https://arxiv.org/html/2610.22420#S3)presents MAELIA and its parameterisation through date\-dose files\. Section[4](https://arxiv.org/html/2610.22420#S4)details the proposed analysis pipeline\. Section[5](https://arxiv.org/html/2610.22420#S5)reports the experimental setup and the results\. Section[6](https://arxiv.org/html/2610.22420#S6)concludes and outlines perspectives\.
## 2Related Work
#### Sensitivity Analysis of Agent\-Based Models\.
Sensitivity analysis attributes model output variability to its inputs\. Methods range from low\-cost Morris screening for initial factor ranking\[[33](https://arxiv.org/html/2610.22420#bib.bib33)\]to variance\-based decomposition\. For instance, Sobol’ indices capture main and interaction effects\[[44](https://arxiv.org/html/2610.22420#bib.bib44),[38](https://arxiv.org/html/2610.22420#bib.bib38)\], while Shapley effects allocate variance even with dependent inputs\[[43](https://arxiv.org/html/2610.22420#bib.bib43),[45](https://arxiv.org/html/2610.22420#bib.bib45)\]\. Applying GSA to ABMs requires addressing intrinsic stochasticity, output selection, and replication limits, which a dedicated literature addresses via practical guidelines and tailored protocols\[[51](https://arxiv.org/html/2610.22420#bib.bib51),[8](https://arxiv.org/html/2610.22420#bib.bib8),[6](https://arxiv.org/html/2610.22420#bib.bib6)\]\. Although variance\-based GSA successfully enhances the analytical and policy relevance of agro\-ecological ABMs\[[27](https://arxiv.org/html/2610.22420#bib.bib27),[3](https://arxiv.org/html/2610.22420#bib.bib3)\], these approaches are inadequate for models governed by optional, hierarchical operations\.
#### Hierarchical and Mixed\-Variable Design Spaces\.
Most GSAs assumei\.i\.d\.inputs ranging over a Cartesian product\. Agricultural itineraries break this assumption: variables are*mixed*\(continuous dates and doses, integer counts, categorical operations, and fertiliser types\) and*hierarchical*,i\.e\.some variables are active only under specific values of others\. A unified framework describes such spaces through meta\-variables \(which decide which sub\-problem is instantiated\) and decreed variables \(active only when their parent decision enables them\), together with the graph\-structured distances needed to model them\[[2](https://arxiv.org/html/2610.22420#bib.bib2),[40](https://arxiv.org/html/2610.22420#bib.bib40),[21](https://arxiv.org/html/2610.22420#bib.bib21)\]\.
#### Surrogate\-Assisted, Multi\-Stage Exploration\.
Because ABM simulations are costly, exhaustive GSA is rarely affordable directly\. Training surrogates such as polynomial chaos, random forest, or Gaussian process to compute sensitivity indices is efficient in that context\[[35](https://arxiv.org/html/2610.22420#bib.bib35),[1](https://arxiv.org/html/2610.22420#bib.bib1),[19](https://arxiv.org/html/2610.22420#bib.bib19)\]\. Building on this, a recent two\-phase workflow screens the space using space\-filling designs, linear analysis, and regression trees to rank factors, size replications, and locate tipping points, before training a surrogate for indices and explanations\[[42](https://arxiv.org/html/2610.22420#bib.bib42)\]\. We adapt this approach to a more complex model, filling a critical gap by representing the agricultural parameter space as a genuinely hierarchical directed acyclic graph\.
## 3The MAELIA platform
### 3\.1Main Features and Capabilities
The MAELIA \(Modelling of socio\-Agro\-Ecological system for Landscape Integrated Assessment\) platform is a spatially explicit, agent\-based platform for the integrated assessment of socio\-agro\-ecological systems\[[18](https://arxiv.org/html/2610.22420#bib.bib18),[50](https://arxiv.org/html/2610.22420#bib.bib50),[31](https://arxiv.org/html/2610.22420#bib.bib31)\]\. The latter covers a family of processes such as agronomic, hydrological, or socio\-economic dynamics, allowing each configuration to be specifically tailored for the emulation of any given territory and research question\. At a daily time step and at the individual field and farmer levels, it brings together the main processes that shape an agricultural territory\. Driven by daily weather, it simulates the growth of crops, the water, carbon, and nitrogen cycles in the soil, the dynamics of water resources, and the farmers’ activities on the land, including withdrawals for irrigation\. Each simulated day, these processes converge into a specific situation that each farmer agent reads and acts upon\. For instance, considering past and forecasted weather along with soil water content, a farmer may hold off sowing, while also navigating structural constraints such as regulatory drought decrees\[[50](https://arxiv.org/html/2610.22420#bib.bib50)\]\. Whichever technical operations \(tillage, sowing, fertilisation…\) are ultimately performed on the crops or the soil, they in turn modify plant growth and resource uptake, altering the very state from which the next day’s decisions will be made\. MAELIA is built to capture exactly these kinds of interactions, scaling seamlessly from a small cluster of farms to large territories comprising 1,150 agricultural holdings across 40,000 hectares\[[53](https://arxiv.org/html/2610.22420#bib.bib53)\]\.
MAELIA is a modular platform assembled from many sub\-models and modelling options that can be activated according to the question at hand\[[31](https://arxiv.org/html/2610.22420#bib.bib31)\]\. Demonstrating its versatility, MAELIA can model the quantitative management of water resources during low\-flow periods\[[30](https://arxiv.org/html/2610.22420#bib.bib30)\], while other configurations have addressed territorial water management\[[29](https://arxiv.org/html/2610.22420#bib.bib29),[52](https://arxiv.org/html/2610.22420#bib.bib52),[50](https://arxiv.org/html/2610.22420#bib.bib50)\], crop\-livestock systems\[[11](https://arxiv.org/html/2610.22420#bib.bib11)\], organic waste management\[[32](https://arxiv.org/html/2610.22420#bib.bib32)\], and agroecological transitions like cover crop adoption\[[53](https://arxiv.org/html/2610.22420#bib.bib53)\]\. MAELIA has been applied to many territories in France and Germany, and the current work aims to scale it to all of France\[[26](https://arxiv.org/html/2610.22420#bib.bib26)\]\.
### 3\.2MAELIA architecture
Spatially, a MAELIA simulation relies on a multi\-layered topology in which the territory is partitioned along distinct, intersecting boundaries\. By computing processes across these overlapping layers, the model aggregates them into a coherent territorial dynamic\. Partitions include: \(i\) meteorological zones matching the ARPEGE \(Météo\-France\) grid; \(ii\) administrative boundaries for communes; \(iii\) hydrological watersheds; and \(iv\) agricultural fields governed by the European land parcel identification system\. Weather information is read from external files \(attached to weather zones\); rainfall drives water balance and drainage, while temperature and radiation drive crop growth\. The soil is described by its type and refined into layers of possibly unequal thickness, with general properties such as bulk density, gravel/clay contents, water\-holding capacity or maximal depth\.
The simulation biophysical representation rests on the crop model together with nitrogen and carbon modules\[[11](https://arxiv.org/html/2610.22420#bib.bib11),[31](https://arxiv.org/html/2610.22420#bib.bib31)\]\. Henceforth, this study considers the following outputs: \(i\)Nitrogen leaching \(Nlixi\\text\{N\}\_\{\\text\{lixi\}\}\): the deep drainage flux leaving the soil profile when water inputs exceed the field capacity of the deep horizon, carrying dissolved mineral nitrogen with it; \(ii\)Variation of soil organic carbon \(ΔCorg\\Delta\\text\{C\}\_\{\\text\{org\}\}\): a daily balance between the humification of crop residues and the mineralisation of active and stable soil organic matter, modulated by temperature and moisture; \(iii\)Yield \(Yield\): simulated from a potential optimal yield, penalised daily by water stress, the ratio of actual to maximal transpiration, and by nitrogen stress through the nitrogen nutrition index\.
Farmers are the agents at the centre of this work, operating at two distinct decision\-making scales\[[18](https://arxiv.org/html/2610.22420#bib.bib18)\]\. Annually, the farmer draws up a cropping plan, allocating crop rotations across the plots they manage\. The crop grown on a given plot can either follow a predefined sequence or be dynamically selected by the agent\. The latter mode, which yields richer emergent behaviour, relies on a multi\-criteria decision process grounded in Dempster\-Shafer belief theory within a belief\-desire\-intention architecture\[[49](https://arxiv.org/html/2610.22420#bib.bib49)\]\. Subsequently, at the daily scale, the farmer manages the crop through technical operations: soil tillage, sowing, fertilisation, irrigation, hoeing, and harvesting\. The dated sequence of operations applied to a crop is called a*crop management itinerary*and constitutes the object of our study\. These operations are governed by*decision rules*elicited from domain experts and supplied as input to the model\. This approach ensures that the resulting simulated behaviours remain realistic and reusable across different territories, crops, and weather conditions\[[5](https://arxiv.org/html/2610.22420#bib.bib5)\]\. Specifically, each technical operation is confined to a temporal window and enabled only when specific conditions of the crop, the soil, and the weather are satisfied\. Furthermore, whether an operation is actually performed, and to what extent, is constrained by the workforce available on the farm\[[18](https://arxiv.org/html/2610.22420#bib.bib18)\]\. Weather forecasts also play a role in this process, influencing the decisions of certain agents based on the reliability the agents attribute to them\. These decisions couple the sub\-models mainly through the state of the soil and its plot: a water\-balance sub\-model updates soil moisture, the crop sub\-model reads it to advance growth, the farmer reads both to decide whether an operation can take place, and the operation rewrites the plot state for the next day\. This indirection through the soil keeps the sub\-models interchangeable, so a component can be deactivated without disturbing the rest\[[18](https://arxiv.org/html/2610.22420#bib.bib18)\]\.
At this second scale, the agents’ decisions meet the biophysical mechanisms, and each output is sensitive to them: tillage reworks the soil and the mineralisation of the residues it buries, fertilisation sets the nitrogen made available to the crop, and the sowing and harvest dates bound the growing window\. Because the rules tie each operation to the evolving state of the crop environment, the model keeps farming decisions adaptive yet interpretable, any operation being traceable to the rule that triggered it\[[15](https://arxiv.org/html/2610.22420#bib.bib15)\]\. Both scales of decision ultimately rest on rules, and the values of its parameters specify every rule\. Those parameters, how they are set, and the alternatives we substitute for them, are addressed in what follows\.
### 3\.3Model Parameters
#### A Controllable input space for crop management itineraries\.
This article focuses on the agricultural model and, in particular, on the technical operations that compose the farmer agents’ technical itineraries\. This study examines the effect of these operational choices on three outputs \(Nlixi,ΔCorg,N\_\{\\text\{lixi\}\},\\Delta C\_\{\\text\{org\}\},Yield\)\. The natural input space is that of the crop management itineraries themselves, but it is not directly accessible in MAELIA: technical operations are triggered depending on farmers’ decision rules, and an itinerary is thus fully known only at the end of a simulation\. Sampling the rule\-related parameters explores the itinerary space redundantly, incompletely, and with little control\. We therefore added to MAELIA a new way of specifying technical operations, one that describes the itinerary directly and bypasses the decision rules altogether\. Such a description, as a list of dated operations with their quantities, is a common formalism, used as input or output by many agricultural models\[[26](https://arxiv.org/html/2610.22420#bib.bib26)\]that we adapted to the specificity of MAELIA\. We introduce a new type of farmer agent driven by this*date\-dose*formalism\. This agent is functionally equivalent to the rule\-based one: an itinerary produced by a rule\-based simulation, extracted and replayed through the date\-dose agent, yields identical outputs and intermediary variables\. What changes is only how the itinerary is obtained: stated rather than inferred\.
#### The date\-dose formalism\.
Table 1:Attributes of the date\-dose formalism\. The depth, dose, and subtype apply only to the listed operations and are left empty otherwise\.AttributeApplies toAdmissible valuesUnitPlotAll operationsAny plot in the simulation—SpeciesAll operationsAny species in the simulation—DateAll operationsAny calendar date \(DD/MM/YYYY\)—OperationAll operationsSowing, tillage, hoeing, fertilisation, plant protection, irrigation, mowing, grazing, harvest—DepthSowing, tillage, hoeing≥0\\geq 0\(or empty for no effect on water reserve\)cmMowing≥3\\geq 3cmDoseFertilisation \(mineral\)≥0\\geq 0\(N required; P, K optional\)kg/haFertilisation \(organic\)≥0\\geq 0kg/haIrrigation≥0\\geq 0mmSubtypeFertilisationAny fertiliser in the simulation—Other operationsAny free label \(or empty\)—
In the date\-dose formalism, an itinerary is a list of technical operations, each described by seven attributes\. Two locate the operation: the plot it is applied to and the cultivated species\. One gives its type, drawn from the operations that MAELIA can natively handle:*sowing*,*tillage*,*hoeing*,*fertilisation*,*plant protection*,*irrigation*,*mowing*,*grazing*, and*harvest*\. One gives its execution date\. And, the last three apply only to the operations for which they are meaningful: one encodes a working depth or cutting height, another a dose, whose unit depends on the operation and, the last one a subtype, which for a fertilisation names the fertiliser applied and for any other operation is a free label with no effect on the run, used only to retrieve the tagged operations in the model’s outputs\. Table[1](https://arxiv.org/html/2610.22420#S3.T1)specifies each attribute and its admissible values\.
#### The crop\-management decision as a hierarchy\.
Of the operations MAELIA recognises, the study explores only sowing, soil preparation, fertilisation and harvest, and it realises soil preparation by tillage alone, leaving the other operation types such as hoeing, plant protection, irrigation, mowing and grazing outside the design space\. The attributes introduced in this section are structured as a hierarchy of conditional decisions spanning multiple levels of the technical itinerary\. A first meta variable, the number of tillage passes \(Number\_Of\_Preparations∈\{0,1,2\}\\in\\\{0,1,2\\\}\), decides whether soil preparation occurs at all and, when it does, how many passes are performed\. Each preparation event is then described by an explicit working depth, namelyFirst\_Tillage\_Depthfor the first operation and, when a second operation is active,Second\_Tillage\_Depth\. The timing of soil preparation is expressed through a temporal offset before sowing \(Preparation\_To\_Sowing\_Delay\), which keeps the preparation operation agronomically ordered with respect to sowing\. Sowing is characterised by its campaign date \(Sowing\_Date\) and by a sowing depth \(Sowing\_Depth\), the latter included because sowing also works the upper soil layer and thus bears on carbon and nitrogen redistribution\. Similarly, the fertilisation block follows a conditional structure\[[40](https://arxiv.org/html/2610.22420#bib.bib40)\]\. The number of fertilisation events is controlled by a second meta variable,Number\_Of\_Fertilisations∈\{0,1,2,3\}\\in\\\{0,1,2,3\\\}\. If no fertilisation is selected, no fertilisation date or dose is active\. If one, two, or three events are selected, the corresponding dates \(First\_Fertilisation\_Date,Second\_Fertilisation\_Date,Third\_Fertilisation\_Date\) and doses \(First\_Fertilisation\_Dose,Second\_Fertilisation\_Dose,Third\_Fertilisation\_Dose\) become active\. Fertilisation is represented through a single fertiliser reference, so that the explored variability focuses on the timing and amount of nitrogen supplied rather than on product identity\. To ensure chronological consistency, operational dates are constrained relative to one another\. Sowing, harvest, and fertilisation dates are expressed in campaign days from August1st1^\{\\text\{st\}\}\(day11\)\. The design enforces agronomic temporal order: soil preparation must occur before sowing, fertilisation events must follow their activated chronological sequence, and harvest must occur after sowing\[[40](https://arxiv.org/html/2610.22420#bib.bib40)\]\. The full decision structure is formalised as the design space graph of Fig\.[2](https://arxiv.org/html/2610.22420#S4.F2), comprising the1414potential variables—spanning meta, discrete, and continuous types—intertwined through conditional activation and value constraints\[[10](https://arxiv.org/html/2610.22420#bib.bib10)\]\.
Specifying the itinerary directly gives full control over the operations, but the model no longer guarantees that the result makes agronomic sense: a date\-dose file can schedule a harvest before a sowing\. Turning this formalism into an input space for the sensitivity analysis, one restricted to agronomically admissible itineraries and given a well\-defined structure, is the subject of the next section\.
## 4Sensitivity Analysis over a Hierarchical Space
Expert knowledgebounds, admissibility, activationMAELIA simulatordate\-dose modeHierarchical spacedesign space graphDOE generationscenariosRaw datasetinputsXX, outputsYYIntrinsic correctionactivation\-adjusted1/pA21/p\_\{A\}^\{2\}Random forest supervisionintrinsic conditional permutation importanceHSIC\-ANOVAalgebraic distanceAgronomic insightsdecision families1\. Design & simulation2\. Sensitivity\-analysis pipelinedata / structurecomputationsimulatorresults
Figure 1:Workflow of the data\-driven hierarchical sensitivity\-analysis pipeline\. Expert knowledge fixes the bounds, admissibility constraints and conditional activation that define the hierarchical space\. Scenarios are simulated in MAELIA’s date\-dose mode\. The resulting dataset feeds a random forest that*supervises*the HSIC\-ANOVA decomposition by setting its kernel scales, and a frequency correction yields the intrinsic indices\.The pipeline takes a table of MAELIA simulations, each row pairing a crop\-management itinerary,i\.e\., a value for each of the 14 parameters, with the agro\-environmental outputs it produces, and returns, for every output, a ranked list of the decisions and combinations of decisions that drive it\. What sets it apart is that this ranking is computed*on the design space graph*, without averaging away or imputing the variables that a higher\-level choice leaves inactive\.
Figure[1](https://arxiv.org/html/2610.22420#S4.F1)summarises the procedure\. Its upper panel covers design and simulation: expert knowledge fixes the bounds, the admissibility constraints and the conditional activation defining the hierarchical space, from which a design of experiments is drawn and run through MAELIA in date\-dose mode\. Its lower panel is our novel analysis, the random forest\-supervised HSIC\-ANOVA\. It encodes the itinerary together with the pattern of which variables are active \(Section[4\.1](https://arxiv.org/html/2610.22420#S4.SS1)\), lets a random forest learn which variables matter for each output and prune the rest to keep the analysis tractable \(Section[4\.2](https://arxiv.org/html/2610.22420#S4.SS2)\), ranks main effects and interactions with a kernel\-based dependence measure that inactive branches cannot bias \(Section[4\.3](https://arxiv.org/html/2610.22420#S4.SS3)\), and rebalances parameters active only part of the time against those always active \(Section[4\.4](https://arxiv.org/html/2610.22420#S4.SS4)\)\. We then discuss its novelty \(Section[4\.5](https://arxiv.org/html/2610.22420#S4.SS5)\)\.
Figure 2:Design space graph of the MAELIA crop\-management decisions\. Each structural count is a meta variable feeding a choice node \(blue\), whose branches enumerate its admissible values; selecting one activates the decreed variables \(yellow\)\. The sowing date, the sowing depth and the harvest date depend on no choice and are always active\.### 4\.1Encoding the Itinerary and its Activation Pattern
Figure[2](https://arxiv.org/html/2610.22420#S4.F2)illustrates, reading from left to right, how we structure the crop\-management decision as a directed acyclic graph\. This representation builds upon the hierarchical design spaces framework\[[40](https://arxiv.org/html/2610.22420#bib.bib40),[21](https://arxiv.org/html/2610.22420#bib.bib21)\]and relies on theadsg\-coreimplementation\[[9](https://arxiv.org/html/2610.22420#bib.bib9)\]\. The two structural counts, the number of tillage passes and of fertilisations, are*meta variables*represented as*choice nodes*, in blue, that fan out into the values they can take, or supports\. In that case, their supports are\{0,1,2\}\\\{0,1,2\\\}and\{0,…,3\}\\\{0,\\ldots,3\\\}\. Selecting a value for a meta variable*decrees*some other*decreed*variables, in yellow, whose domains are given under brackets such as dates and depths\. For example, choosing 2 fertilisations activates the first and second date\-dose pairs and leaves the third out\. Three yellow variables, the sowing date and depth together with the harvest date, are*neutral*and always active and independent of the other variables\. Two meta variables, the nine variables they decree, and three neutral ones make up the 14 parameters of the study\. Consequently, the graph dictates which variables are active or inactive for any given itinerary\. This process generates an*activation vector*containing the values of only the active nodes, which we then carry through the analysis\[[10](https://arxiv.org/html/2610.22420#bib.bib10)\]\. We model inactive variables as genuinely absent rather than imputing a numeric default\. As such, a dose that is never applied is structurally deactivated\. Regarding variables’ types,*continuous variables*are rescaled to a uniform range to prevent unit\-based bias, while meta variables retain their integer encoding as*ordinal variables*\[[40](https://arxiv.org/html/2610.22420#bib.bib40)\]\.
### 4\.2Learning What Matters with a Random Forest
A sensitivity analysis has to measure the impact of each parameter and of each combination of parameters, meaning computing214−12^\{14\}\-1terms, which can be time\-consuming\. With many weakly relevant inputs, the search for interactions quickly drowns in spurious combinations\. We therefore first ask a simpler model which parameters are worth looking at\. For each output, we fit a random forest\[[7](https://arxiv.org/html/2610.22420#bib.bib7)\]and rank the parameters by*permutation importance*, the intuition being that if shuffling a parameter barely changes the forest’s predictions, then that parameter does not matter much for the output\. Two adjustments make this reading honest in a hierarchical space\. The first concerns training\. If inactive parameters were handed to the forest as a fixed default value, the forest could cheat, reading that recurring value as a tell\-tale sign that a branch is switched off rather than learning the parameter’s own effect\. To remove that shortcut, we fill each inactive entry, before training, with a value drawn at random from the cases where the parameter is active, which scrambles the artificial signal while leaving the genuine relationships intact\. The second concerns the importance measure itself\. Shuffling a parameter across active and inactive rows alike would create itineraries that cannot exist, so we shuffle each parameter only among the itineraries where it is active, and we express the resulting loss of accuracy relative to how much the output varies within that active subspace of the graph\. This*conditional permutation importance*keeps a decision that applies rarely, deep in the design space graph, from being unfairly diluted by all the itineraries in which it plays no role\. These importances serve two purposes\. They set how sharply each parameter is allowed to influence the dependence measure of the next step, and they let us discard parameters whose importance is indistinguishable from noise\. In practice, a parameter whose importance falls below a small threshold \(τ=0\.1%\\tau=0\.1\\%\) is treated as noise and pruned, and the retained importances are scaled by a common factor \(s=5\.0s=5\.0\) that sets the length scales of the kernel of Section[4\.3](https://arxiv.org/html/2610.22420#S4.SS3)\. This value is large enough for a dominant parameter to be seen as almost unrelated to itself between the two ends of its range \(a residual similarity ofe−5≈0\.7%\\text\{e\}^\{\-5\}\\approx 0\.7\\%\), so that the most influential parameters are free to express their full effect\. Ultimately, this pruning keeps the analysis affordable and sparse\[[17](https://arxiv.org/html/2610.22420#bib.bib17)\]\. Traditional kernel tuning methods, like Gaussian process maximum likelihood estimation or kernel target alignment, struggle in such high\-dimensional spaces; they spread the kernel weights too thinly across the many interactions, effectively getting lost in higher\-order effects, which is a phenomenon referred to as the*curse of dimensionality*\[[4](https://arxiv.org/html/2610.22420#bib.bib4)\]\.
### 4\.3Measuring and Decomposing Dependence on the Design Space Graph
To quantify how strongly a decision influences an output, we use the Hilbert\-Schmidt Independence Criterion \(HSIC\)\[[20](https://arxiv.org/html/2610.22420#bib.bib20),[12](https://arxiv.org/html/2610.22420#bib.bib12)\], a robust measure of statistical dependence\. Unlike standard correlation, HSIC detects nonlinear and threshold\-like relationships, which is essential for capturing agronomic responses, such as yield saturating once nitrogen needs are met\. HSIC compares configurations through a kernel that acts as a similarity measure between input parameters\.
The validity of this approach rests entirely on making that similarity respect the hierarchical structure of the parameter space\. To achieve this, we apply the conditional algebraic distance\[[21](https://arxiv.org/html/2610.22420#bib.bib21),[41](https://arxiv.org/html/2610.22420#bib.bib41)\]\. For an operation that an upstream choice can switch on or off, two itineraries that both omit it are treated as identical on that operation, since there is nothing to compare\. One that operates and one that omits it are treated as maximally different, as this gap represents a discrete decision\. Finally, two itineraries that both perform it are compared via an ordinary numeric distance on their continuous parameters \(e\.g\., date, dose, or depth\)\. Structural counts, such as the number of tillage passes or fertilisations, are handled separately, because a count selects which sub\-itinerary is instantiated rather than tuning a quantity\[[40](https://arxiv.org/html/2610.22420#bib.bib40),[22](https://arxiv.org/html/2610.22420#bib.bib22)\]\. Moving from one to two fertilisations is a change in management structure, not a mere numerical step\. Consequently, switched\-off branches contribute no artificial variability, ensuring the measured dependence reflects actual decisions rather than imputed placeholder values\.
In practice, the empirical HSIC reduces to the Frobenius inner product of the inputs’ and outputs’ centred Gram matrices\[[20](https://arxiv.org/html/2610.22420#bib.bib20),[12](https://arxiv.org/html/2610.22420#bib.bib12),[14](https://arxiv.org/html/2610.22420#bib.bib14),[46](https://arxiv.org/html/2610.22420#bib.bib46)\]\. While this marginal formulation is highly effective for screening complex simulators\[[28](https://arxiv.org/html/2610.22420#bib.bib28)\], it evaluates variables in isolation\[[25](https://arxiv.org/html/2610.22420#bib.bib25)\]\. To resolve this, we apply a kernel\-based functional ANOVA\[[16](https://arxiv.org/html/2610.22420#bib.bib16),[13](https://arxiv.org/html/2610.22420#bib.bib13),[34](https://arxiv.org/html/2610.22420#bib.bib34)\]to split the total input\-output dependence into orthogonal shares\. This orthogonality is guaranteed provided the univariate kernels are empirically centred, a condition our pipeline satisfies by construction\. Each variable receives a main\-effect share, and each combination receives an interaction share, all expressed as fractions of the total dependence\. Because the random forest has already pruned irrelevant parameters, the remaining combinatorial space is small enough to evaluate interactions of up to four simultaneous decisions\. This yields the ranked decompositions presented in Section[5](https://arxiv.org/html/2610.22420#S5), achieved with a highly tractable computational complexity of𝒪\(n2p\)\\mathcal\{O\}\(n^\{2\}p\), wherennis the number of simulations andppthe number of explored variables\.
### 4\.4Comparing Rare and Common Decisions Fairly
Even with normalisation, one bias remains that is specific to graph\-structured spaces\. A decision that is only active in a small fraction of the itineraries can never top a global ranking simply because it is absent from most of the samples\. The importance of a third fertilisation, present in only a quarter of the itineraries, is structurally reduced\. As HSIC compares itineraries pairwise, and because a pair of itineraries says something about a group of decisions only when that group is present in both itineraries, we propose to shift from “how much does this decision move the output across all itineraries?” to “how much does it move the output among the itineraries where it is actually taken?”\. The hierarchical distance confines the signal of a subsetAAof decisions to the itineraries whereAAis jointly active, that is, with probabilitypAp\_\{A\}\. Then, only aboutpA2p\_\{A\}^\{2\}of all pairs are informative andSAintrinsic=HSIC^ApA2S^\{\\text\{intrinsic\}\}\_\{A\}=\\frac\{\\widehat\{\\text\{HSIC\}\}\_\{A\}\}\{p\_\{A\}^\{2\}\}recovers the influence that a decision carries when it is taken\. A following renormalisation step ensures that the total shares sum up to100%100\\%to give a new*intrinsic index*\. This intrinsic reading places deeply nested choices on the same footing as the always\-active meta variables and gives a complementary view of the model’s levers, alongside global ranking\.
### 4\.5Novelty with Respect to the State of the Art
Each step above draws on established ideas, but their combination joins two lines of work that had stayed apart\. On one side, kernel\-based dependence measures and their ANOVA decompositions\[[12](https://arxiv.org/html/2610.22420#bib.bib12),[13](https://arxiv.org/html/2610.22420#bib.bib13)\]rank nonlinear and interacting effects efficiently, yet, as applied to global sensitivity analysis, they assume inputs that vary freely and independently and provide no built\-in handling of variables that exist only conditionally, so applying them here forces the analyst to invent values for absent variables and biases the result\. On the other side, the machinery for hierarchical design spaces and its conditional distances\[[40](https://arxiv.org/html/2610.22420#bib.bib40),[10](https://arxiv.org/html/2610.22420#bib.bib10),[21](https://arxiv.org/html/2610.22420#bib.bib21)\]handles exactly such trees, but has so far served optimisation and prediction, not GSA\. Our pipeline brings the conditional distances into the dependence measure, uses the random forest to keep the interaction analysis tractable, and adds the activation\-frequency correction so that conditionally active decisions can finally be ranked within a single, structure\-aware decomposition\. To make this reusable beyond the present study, hierarchical structures and samplers are based on the extensionsmt\-design\-space\-extof SMT\[[40](https://arxiv.org/html/2610.22420#bib.bib40)\]\. This open project is reproducible online111See[https://anonymous\.4open\.science/r/Sensitivity\_analysis\_MAELIA\-DB70](https://anonymous.4open.science/r/Sensitivity_analysis_MAELIA-DB70)\.
## 5Results
### 5\.1Experimental Setup
#### Study configuration and outputs\.
The pipeline of Section[4](https://arxiv.org/html/2610.22420#S4)is applied to the homogenised*terrainSA*configuration, in which a single reference plot is cloned so that soil type, geometry and weather zone are held constant across simulations\. This deliberate homogenisation removes the dominant pedo\-climatic signal and isolates the effect of the cropping itinerary, which is the object of the sensitivity analysis\. For the same reason, the analysis is restricted to a single crop, winter wheat; focusing on one well\-characterised production system removes the confounding influence of crop identity and rotation effects, so that the observed output variability can be attributed to the technical operations themselves rather than to differences between crops\. Three agronomic and environmental outputs are analysed, each aggregated over the simulated horizon:Nlixi\\mathrm\{N\_\{lixi\}\},ΔCorg\\Delta\\mathrm\{C\_\{org\}\}, and yield\.
#### Design of experiments\.
The design comprises5,0005,000configurations drawn from the hierarchical space of Fig\.[2](https://arxiv.org/html/2610.22420#S4.F2)by hierarchical Latin hypercube sampling with thesmt\-design\-space\-extextension of SMT, so that the conditional activation of decreed variables is respected at sampling time\[[41](https://arxiv.org/html/2610.22420#bib.bib41),[40](https://arxiv.org/html/2610.22420#bib.bib40)\]\. Each configuration is simulated over the ten weather years of the record\. Its outputs are computed at the end of each year and averaged, which damps the interannual variability of the weather\. Continuous variables are rescaled to\[0,1\]\[0,1\]on their observed bounds, the two structural counts keep their integer codes, and inactive variables carry a dedicated inactive state for identification as described in Section[4\.1](https://arxiv.org/html/2610.22420#S4.SS1)\.
#### Analysis settings\.
For each output, the impact of the inputs is evaluated over the full set of5,0005,000simulations up to interaction of order 4\. To do this, we leverage random forests to supervise kernel scales through the conditional permutation importance of Section[4\.2](https://arxiv.org/html/2610.22420#S4.SS2)\. Then, the HSIC\-ANOVA decomposition of Section[4\.3](https://arxiv.org/html/2610.22420#S4.SS3)builds a Gaussian input kernel from the conditional algebraic distance on the conditionally active continuous variables and an ordinal distance on the two structural counts, together with a Gaussian output kernel whose bandwidth follows the output standard deviation\. A standard heuristic and a fixed random seed make the forest and the permutations reproducible; the terms contributing below a small fraction of the total dependence are discarded\. The random forest uses300300unconstrained trees with a minimum leaf size of1%1\\%of the sample; inactive entries are filled by random marginal imputation, and the conditional permutation importance is averaged over66reshuffles per variable\.
### 5\.2Per\-Output Sensitivity
Figure[3](https://arxiv.org/html/2610.22420#S5.F3)reports, for each output, the HSIC\-ANOVA terms ranked by their share of the global input\-output dependence, a first\-order term being a single\-variable main effect and a higher\-order term an interaction\. Across the three outputs, the bulk of the dependence is carried by first\-order effects, and the few interactions above the retention threshold almost all couple the number of fertilisations with the applied doses\. The itinerary therefore acts through additive main effects, with a secondary interaction structure concentrated on the fertilisations\.
For nitrogen leaching, the leading levers are the fertiliser applications, through both their doses and their dates: the second dose \(Second\_Fertilisation\_Dose,12\.1%12\.1\\%\), the number of fertilisations \(Number\_Of\_Fertilisations,9\.4%9\.4\\%\), the second date \(9\.2%9\.2\\%\), the first dose \(8\.6%8\.6\\%\) and the third dose \(6\.9%6\.9\\%\)\. This is consistent with an output driven by the synchronisation between nitrogen supply and the crop uptake window, in which mistimed or oversized applications leave mineral nitrogen available for deep drainage\.
0055101015151st Ferti\. Date x 1st Ferti\. DoseNb\. Prepa\.Nb\. Ferti\. x 3rd Ferti\. DoseNb\. Ferti\. x 1st Ferti\. Dose1st Ferti\. Date3rd Ferti\. Dose1st Ferti\. Dose2nd Ferti\. DateNb\. Ferti\.2nd Ferti\. Dose12\.112\.1%9\.49\.4%9\.29\.2%8\.68\.6%6\.96\.9%3\.63\.6%2\.52\.5%3\.43\.4%2\.62\.6%2\.02\.0%Contribution to global HSIC \(%\)Nitrogen leaching00551010151520202525Nb\. Ferti\. x 1st Ferti\. Dose x 2nd Ferti\. DoseNb\. Ferti\. x Harvest Date x 2nd Ferti\. DoseNb\. Ferti\. x Harvest Date x 1st Ferti\. Dose3rd Ferti\. DoseNb\. Ferti\. x 1st Ferti\. DoseNb\. Prepa\.Nb\. Ferti\.1st Ferti\. Dose2nd Ferti\. DoseHarvest Date25\.825\.8%12\.812\.8%11\.211\.2%10\.210\.2%8\.58\.5%3\.03\.0%3\.43\.4%1\.81\.8%1\.61\.6%1\.51\.5%Contribution to global HSIC \(%\)Soil organic carbon change005510101515202025251st Ferti\. Dose x 2nd Ferti\. DoseNb\. Ferti\. x 2nd Ferti\. Dose x 3rd Ferti\. DoseNb\. Ferti\. x 2nd Ferti\. DoseNb\. Ferti\. x 3rd Ferti\. DoseNb\. Ferti\. x 1st Ferti\. Dose x 2nd Ferti\. DoseNb\. Ferti\. x 1st Ferti\. Dose3rd Ferti\. DoseNb\. Ferti\.1st Ferti\. Dose2nd Ferti\. Dose20\.620\.6%19\.019\.0%17\.617\.6%8\.78\.7%7\.77\.7%3\.83\.8%2\.52\.5%2\.32\.3%4\.74\.7%2\.42\.4%Contribution to global HSIC \(%\)YieldOrder 1Order 2Order 3
Figure 3:HSIC\-ANOVA top terms for the three outputs, ranked by contribution to the global input\-output dependence\. Most retained terms are first\-order main effects, with the strongest interactions coupling the number of fertilisations with the applied doses\.Soil organic\-carbon variation is governed by a different family\. The harvest date \(Harvest\_Date,25\.8%25\.8\\%\) carries by far the largest single share, ahead of the second and first doses \(12\.8%12\.8\\%and11\.2%11\.2\\%\) and the numbers of fertilisations \(10\.2%10\.2\\%\) and of preparations \(8\.5%8\.5\\%\)\. The length of the crop cycle sets the duration over which residues are returned, and organic matter is mineralised, while the coarse structural choices of the itinerary modulate the buried carbon and its turnover\. It is also the output for which higher\-order interactions are most visible, with three third\-order terms above the threshold, two coupling the number of fertilisations with the harvest date and an early dose and the third joining it to the first two doses, although each stays small\.
Yield is the output most clearly driven by the quantity of nitrogen supplied\. The second, first and third doses \(20\.6%20\.6\\%,19\.0%19\.0\\%and8\.7%8\.7\\%\) together with the number of fertilisations \(17\.6%17\.6\\%\) dominate its profile, and it carries the strongest interaction structure of the three, coupling the number of fertilisations with the first dose \(7\.7%7\.7\\%\) and, at third order, with the first two doses \(4\.7%4\.7\\%\)\.
Note that the meta\-variables, starting with the number of fertilisations, rank among the most important parameters, showing that the coarse composition of the itinerary matters more than the fine tuning of its operations\. Also, the shares plotted in Fig\.[3](https://arxiv.org/html/2610.22420#S5.F3)are*global*, measured over the whole design, so a decreed variable active on only part of the itineraries is mechanically penalised: the third fertiliser application, active on about25%25\\%of the design against50%50\\%for the second and75%75\\%for the first, comes last of the three doses in every output\.
Table 2:Global versus intrinsic \(activation\-adjusted by1/pA21/p\_\{A\}^\{2\}\) HSIC share of the three fertiliser\-dose main effects, expressed in global dependence shares\.The intrinsic reading of Section[4\.4](https://arxiv.org/html/2610.22420#S4.SS4)removes this bias to show how much a decision moves the output*among the itineraries where it is actually applied*\. For yield, the two readings disagree sharply as depicted in Table[2](https://arxiv.org/html/2610.22420#S5.T2): the global ranking of the doses is second \(20\.6%20\.6\\%\), first \(19\.0%19\.0\\%\), third \(8\.7%8\.7\\%\), whereas the intrinsic one reverses it to third \(28\.0%28\.0\\%\), second \(16\.1%16\.1\\%\), first \(6\.6%6\.6\\%\)\. The third dose seems the most decisive dose when a farmer chooses to make 3 fertilisations\. The same reversal holds for nitrogen leaching, and the late dose climbs to a near\-first position for soil organic carbon\. These two readings respond to different questions: the global one weighs a decision by how much it shapes the outputs over the whole population of itineraries, while the intrinsic one by how much it matters when it is on the table\. No variable pruned by the random forest reappears in the HSIC\-ANOVA table of its output, which confirms that the supervision of Section[4\.2](https://arxiv.org/html/2610.22420#S4.SS2)concentrates the decomposition on the actionable levers\.
### 5\.3Aggregation by Decision Family
To read the results at the level of management decisions rather than individual parameters, the per\-term contributions are aggregated into four semantic families:*fertilisation doses*,*fertilisation timing*, the*sowing and harvest calendar*\(also carrying preparation\-to\-sowing delay\), and the structural itinerary composition, that is the number of fertilisations and of preparations, which we call*management structure*\. Because an interaction term belongs to several families, its contribution is divided equally among its constituent parameters before aggregation, so that family shares remain additive\. A fifth family, the working depths of tillage and sowing, carries negligible dependence for all three outputs and is omitted\.
Figure[4](https://arxiv.org/html/2610.22420#S5.F4)reports, for each output, the fractional share of the global dependence carried by each family\.
0010102020303040405050Sowing & harvest timingMgt\. structureFerti\. timingFerti\. doses46\.946\.9%23\.723\.7%22\.222\.2%1\.61\.6%Fraction of allocated global HSIC \(%\)Nitrogen leaching001010202030304040Ferti\. timingMgt\. structureSowing & harvest timingFerti\. doses37\.337\.3%32\.232\.2%25\.525\.5%0\.60\.6%Fraction of allocated global HSIC \(%\)Soil organic carbon change001010202030304040505060607070Ferti\. timingMgt\. structureFerti\. doses66\.066\.0%27\.827\.8%1\.61\.6%Fraction of allocated global HSIC \(%\)Yield
Figure 4:HSIC\-ANOVA contributions aggregated into four decision families\. The sowing and harvest calendar carries no sufficient and retained term for yield\.This aggregation contrasts outputs explicitly\. Fertilisation doses are the most influential family for all three outputs, but the family that comes next differs from one output to the other\. Nitrogen leaching is a fertilisation matter above all, with doses \(46\.9%46\.9\\%\) and timing \(23\.7%23\.7\\%\) together accounting for about 70% of its dependence, the management structure adding a further22\.2%22\.2\\%and the sowing and harvest calendar staying marginal \(1\.6%1\.6\\%\)\. Soil organic\-carbon variation spreads its dependence more evenly across doses \(37\.3%37\.3\\%\), the sowing and harvest calendar \(32\.2%32\.2\\%\) and management structure \(25\.5%25\.5\\%\), fertilisation timing being negligible \(0\.6%0\.6\\%\), reflecting an output shaped by nitrogen quantities, how long the crop occupies the ground and the itinerary composition rather than by the exact application dates\. Yield is the most concentrated output, with fertilisation doses carrying about two\-thirds of its dependence alone \(66\.0%66\.0\\%\) ahead of management structure \(27\.8%27\.8\\%\) while the timing family contributes little \(1\.6%1\.6\\%\)\. Together, these panels show that a single hierarchical sensitivity analysis separates the outputs by their most influential levers\. While fertilisation doses lead all outputs, the discriminating secondary family is fertilisation timing for leaching, the crop calendar for carbon, and the management structure for yield\. The latter is a substantial contributor to all three outputs\.
## 6Conclusion and Perspectives
This paper argued that a complex agro\-ecological agent\-based model should not be explored as if its parameters formed an unstructured hypercube, because its agricultural decisions are intrinsically hierarchical: many parameters exist only once a higher\-level management choice activates them\. Taking the MAELIA platform as a case study, the crop\-management itinerary, expressed through date\-dose formalism, was encoded as a hierarchical design space of meta and decreed variables, and a random forest supervised HSIC\-ANOVA was defined over it\. Applied to three outputs on a homogenised, single\-crop configuration, the analysis returned an interpretable, decision\-oriented picture\. Fertilisation doses are the leading lever for all three outputs, and the family that comes next sets them apart: fertilisation timing for nitrogen leaching, the sowing and harvest calendar for soil organic\-carbon variation, and the structural composition of the itinerary for yield, with the number of fertilisations standing out as a top\-ranked decision throughout\. First\-order effects carry most of the dependence, and the interactions that emerge, mostly couplings between the number of fertilisations and the applied doses, stay secondary\. These conclusions follow from an analysis carried out within the structured space in which the decisions are actually made\.
A natural question is how this pipeline compares against established sensitivity\-analysis methods such as variance\-based GSA indices\[[24](https://arxiv.org/html/2610.22420#bib.bib24)\]\. In our setting, however, no such head\-to\-head comparison is well posed\. Classical variance\-based methods presuppose inputs that vary independently over a fixed Cartesian product, an assumption that a branched design space violates by construction: a large fraction of the combinations they would require assign values to sub\-parameters whose activating branch is switched off, and are therefore configurations the simulator never produces\. A Sobol’ analysis run over the flattened space would thus not be a competing measurement of the same quantity, but an answer to a different, ill\-posed question in which the conditional structure has been discarded\. More generally, forcing a classical method onto this space requires imputing arbitrary values for the inactive variables, and these imputed values distort the variance decomposition, biasing the resulting indices and masking the influence of the upstream decisions that control each branch\. The contribution here is to define a sensitivity attribution that remains well\-posed on the hierarchical space, not to outperform a baseline that does not address the same problem\[[23](https://arxiv.org/html/2610.22420#bib.bib23)\]\.
Several directions extend this work\. On the modelling side, reintroducing controlled pedo\-climatic variation and additional crops would test how robust the decision\-family rankings are once the environment and the crop are allowed to vary again, and applying the same pipeline to other GAMA\-based agro\-ecological models would probe its generality\. Finally, because the encoding and the sampler are shared with surrogate\-based optimisation, the same structured space could support Bayesian optimisation of management itineraries, turning the sensitivity analysis into a first step of a broader decision\-support workflow\. Furthermore, on the visualisation side, and to enhance the interpretability of our results, we developed an interactive web page featuring post\-hoc explainable AI tools such as partial dependence plots and individual conditional expectation curves\. This interface leverages thesmt\-explainabilitylibrary\[[37](https://arxiv.org/html/2610.22420#bib.bib37)\]to allow for real\-time visual exploration of the agronomic responses for stakeholders and thematicians\.
Disclosure of Interests\.The authors have no competing interests to declare that are relevant to the content of this article\.
## References
- \[1\]Angione, C\., Silverman, E\., Yaneske, E\.: Using machine learning as a surrogate model for agent\-based simulations\. PLOS ONE17\(2022\)
- \[2\]Audet, C\., Hallé\-Hannan, E\., Le Digabel, S\.: A general mathematical framework for constrained mixed\-variable blackbox optimization problems with meta and categorical variables\. In: Operations Research Forum\. vol\. 4, p\. 12\. Springer \(2023\)
- \[3\]Baniecki, H\., Casalicchio, G\., Bischl, B\., Biecek, P\.: On the robustness of global feature effect explanations\. In: Joint European Conference on Machine Learning and Knowledge Discovery in Databases\. pp\. 125–142\. Springer \(2024\)
- \[4\]Beh, J\., Morio, J\., Simatos, F\.: Phase transition for conditional covariance matrices estimated by importance sampling, and implications for cross\-entropy schemes in high dimension\. arXiv preprint arXiv:2511\.11351 \(2025\)
- \[5\]Bergez, J\.E\., Leenhardt, D\., Colomb, B\., Dury, J\., Carpani, M\., Casagrande, M\., Charron, M\.H\., Guillaume, S\., Therond, O\., Willaume, M\.: Computer\-model tools for a better agricultural water management: Tackling managers’ issues at different scales – a contribution from systemic agronomists\. Computers and Electronics in Agriculture86, 89–99 \(2012\)\. https://doi\.org/10\.1016/j\.compag\.2012\.04\.005
- \[6\]Borgonovo, E\., Pangallo, M\., Rivkin, J\.W\., Rizzo, L\., Siggelkow, N\.: Sensitivity analysis of agent\-based models: A new protocol\. Computational and Mathematical Organization Theory28, 52–94 \(2022\)\. https://doi\.org/10\.1007/s10588\-021\-09358\-5
- \[7\]Breiman, L\.: Random forests\. Machine Learning45\(1\), 5–32 \(2001\)\. https://doi\.org/10\.1023/A:1010933404324
- \[8\]ten Broeke, G\., van Voorn, G\., Ligtenberg, A\.: Which sensitivity analysis method should I use for my agent\-based model? Journal of Artificial Societies and Social Simulation19\(1\), 5 \(2016\)\. https://doi\.org/10\.18564/jasss\.2857
- \[9\]Bussemaker, J\.H\., Boggero, L\., Nagel, B\.: System architecture design space exploration: Integration with computational environments and efficient optimization\. In: AIAA Aviation 2024\. p\. 4647 \(2024\)
- \[10\]Bussemaker, J\.H\., Saves, P\., Bartoli, N\., Lefebvre, T\., Lafage, R\.: System architecture optimization strategies: Dealing with expensive hierarchical problems\. Journal of Global Optimization91\(4\), 851–895 \(2025\)
- \[11\]Catarino, R\., Therond, O\., Berthomier, J\., Miara, M\., Mérot, E\., Misslin, R\., Vanhove, P\., Villerd, J\., Angevin, F\.: Fostering local crop\-livestock integration via legume exchanges using an innovative integrated assessment and modelling approach based on the MAELIA platform\. Agricultural Systems189, 103066 \(2021\)
- \[12\]Da Veiga, S\.: Global sensitivity analysis with dependence measures\. Journal of Statistical Computation and Simulation85\(7\), 1283–1305 \(2015\)\. https://doi\.org/10\.1080/00949655\.2014\.945932
- \[13\]Da Veiga, S\.: Kernel\-based ANOVA decomposition and Shapley effects: Application to global sensitivity analysis\. arXiv preprint arXiv:2101\.05487 \(2021\)
- \[14\]De Lozzo, M\., Marrel, A\.: New improvements in the use of dependence measures for sensitivity analysis and screening\. Journal of Statistical Computation and Simulation86\(15\), 3038–3058 \(2016\)\. https://doi\.org/10\.1080/00949655\.2016\.1149854
- \[15\]Drogoul, A\., Ferber, J\., Cambier, C\.: Multi\-agent simulation as a tool for analysing emergent processes in societies\. In: Simulating Societies: The Computer Simulation of Social Processes\. University of London College Press, London \(1994\)
- \[16\]Durrande, N\., Ginsbourger, D\., Roustant, O\., Carraro, L\.: ANOVA kernels and RKHS of zero mean functions for model\-based sensitivity analysis\. Journal of Multivariate Analysis115, 57–67 \(2013\)\. https://doi\.org/10\.1016/j\.jmva\.2012\.08\.016
- \[17\]Emine, Y\., Forel, A\., Malek, I\., Vidal, T\.: Free lunch in the forest: Functionally\-identical pruning of boosted tree ensembles\. In: Proceedings of the AAAI Conference on Artificial Intelligence\. vol\. 39, pp\. 16488–16495 \(2025\)\. https://doi\.org/10\.1609/aaai\.v39i16\.35370
- \[18\]Gaudou, B\., Sibertin\-Blanc, C\., Therond, O\., Amblard, F\., et al\.: The MAELIA multi\-agent platform for integrated analysis of interactions between agricultural land\-use and low\-water management strategies\. In: Multi\-Agent\-Based Simulation XIV \(MABS 2013\), Lecture Notes in Computer Science, vol\. 8235, pp\. 85–100\. Springer \(2014\)\. https://doi\.org/10\.1007/978\-3\-642\-54783\-6\_6
- \[19\]Geurts, P\., Ernst, D\., Wehenkel, L\.: Extremely randomized trees\. Machine Learning63\(1\), 3–42 \(2006\)\. https://doi\.org/10\.1007/s10994\-006\-6226\-1
- \[20\]Gretton, A\., Bousquet, O\., Smola, A\., Schölkopf, B\.: Measuring statistical dependence with Hilbert–Schmidt norms\. In: Algorithmic Learning Theory \(ALT\)\. Lecture Notes in Computer Science, vol\. 3734, pp\. 63–77\. Springer \(2005\)\. https://doi\.org/10\.1007/11564089\_7
- \[21\]Hallé\-Hannan, E\., Audet, C\., Diouane, Y\., Le Digabel, S\., Saves, P\.: A distance for mixed\-variable and hierarchical domains with meta variables\. Neurocomputing653, 131208 \(2025\)\. https://doi\.org/10\.1016/j\.neucom\.2025\.131208
- \[22\]Halstrup, M\.: Black\-Box Optimization of Mixed Discrete\-Continuous Optimization Problems\. Ph\.D\. thesis, Technische Universität Dortmund \(2016\)
- \[23\]Idrissi, M\.I\., Bousquet, N\., Gamboa, F\., Iooss, B\., Loubes, J\.M\.: Hoeffding decomposition of functions of random dependent variables\. Journal of Multivariate Analysis208, 105444 \(2025\)
- \[24\]Idrissi, M\.I\., Machado, A\.F\., Charpentier, A\.: Beyond shapley values: Cooperative games for the interpretation of machine learning models\. In: Proceedings of the IJCAI 2025 Workshop on Explainable Artificial Intelligence \(XAI\) \(Aug 2025\), workshop paper
- \[25\]Jaber, E\., Remy, E\., Chabridon, V\., Mougeot, M\., Lucor, D\.: Fusion of heterogeneous data for robust degradation prognostics\. Reliability Engineering & System Safety p\. 112435 \(2026\)
- \[26\]Javourez, U\., Therond, O\.: MAELIA for large\-scale farming system design: Methodological approach\. In: 8th International Farming System Design Conference \(2025\)
- \[27\]Ligmann\-Zielinska, A\., Kramer, D\.B\., Spence Cheruvelil, K\., Soranno, P\.A\.: Using uncertainty and sensitivity analyses in socioecological agent\-based models to improve their analytical performance and policy relevance\. PLOS ONE9\(10\), e109779 \(2014\)\. https://doi\.org/10\.1371/journal\.pone\.0109779
- \[28\]Marrel, A\., Chabridon, V\.: Statistical developments for target and conditional sensitivity analysis: Application on safety studies for nuclear reactor\. Reliability Engineering & System Safety214, 107711 \(2021\)
- \[29\]Martin, E\., Gascoin, S\., Grusson, Y\., Murgue, C\., Bardeau, M\., Anctil, F\., Ferrant, S\., Lardy, R\., Le Moigne, P\., Leenhardt, D\., et al\.: On the use of hydrological models and satellite data to study the water budget of river basins affected by human activities: Examples from the Garonne basin of France\. Surveys in Geophysics37\(2\), 223–247 \(2016\)
- \[30\]Mazzega, P\., Therond, O\., Debril, T\., March, H\., Sibertin\-Blanc, C\., Lardy, R\., Sant’Ana, D\.: Critical multi\-level governance issues of integrated modelling: An example of low\-water management in the Adour\-Garonne basin \(France\)\. Journal of Hydrology519, 2515–2526 \(2014\)
- \[31\]Misslin, R\., Belorgey, M\., Catarino, R\., Clivot, H\., Colas, F\., Gaudou, B\., Taillandier, P\., Tribouillois, H\., Villerd, J\., Therond, O\.: Challenges for integrated assessment modeling of socio\-agro\-ecological systems\. In: 1st Conference GAMA Days \(2021\)
- \[32\]Misslin, R\., Clivot, H\., Levavasseur, F\., Villerd, J\., Soulié, J\.C\., Houot, S\., Therond, O\.: Integrated assessment and modeling of regional recycling of organic waste\. Journal of Cleaner Production379, 134725 \(2022\)
- \[33\]Morris, M\.D\.: Factorial sampling plans for preliminary computational experiments\. Technometrics33\(2\), 161–174 \(1991\)\. https://doi\.org/10\.1080/00401706\.1991\.10484804
- \[34\]Novello, P\., Fel, T\., Vigouroux, D\.: Making sense of dependence: Efficient black\-box explanations using dependence measure\. Advances in Neural Information Processing Systems35, 4344–4357 \(2022\)
- \[35\]Rasmussen, C\.E\., Williams, C\.K\.I\.: Gaussian Processes for Machine Learning\. MIT Press \(2006\)
- \[36\]Razavi, S\., Jakeman, A\., Saltelli, A\., Prieur, C\., Iooss, B\., Borgonovo, E\., Plischke, E\., Lo Piano, S\., Iwanaga, T\., Becker, W\., Tarantola, S\., Guillaume, J\.H\.A\., Jakeman, J\., Gupta, H\., Melillo, N\., Rabitti, G\., Chabridon, V\., Duan, Q\., Sun, X\., Smith, S\., Sheikholeslami, R\., Hosseini, N\., Asadzadeh, M\., Puy, A\., Kucherenko, S\., Maier, H\.R\.: The future of sensitivity analysis: An essential discipline for systems modeling and policy support\. Environmental Modelling & Software137, 104954 \(2021\)\. https://doi\.org/10\.1016/j\.envsoft\.2020\.104954
- \[37\]Robani, M\.D\., Palar, P\.S\., Zuhal, L\.R\., Saves, P\., Morlier, J\.: Smt\-ex: An explainable surrogate modeling toolbox for mixed\-variables design exploration\. In: AIAA SCITECH 2025 Forum\. p\. 0777 \(2025\)
- \[38\]Saltelli, A\.: Making best use of model evaluations to compute sensitivity indices\. Computer Physics Communications145\(2\), 280–297 \(2002\)\. https://doi\.org/10\.1016/S0010\-4655\(02\)00280\-1
- \[39\]Saltelli, A\., Ratto, M\., Andres, T\., Campolongo, F\., Cariboni, J\., Gatelli, D\., Saisana, M\., Tarantola, S\.: Global Sensitivity Analysis: The Primer\. John Wiley & Sons \(2008\)
- \[40\]Saves, P\., Hallé\-Hannan, E\., Bussemaker, J\., Diouane, Y\., Bartoli, N\.: Modeling hierarchical spaces: A review and unified framework for surrogate\-based architecture design\. Structural and Multidisciplinary Optimization \(2026\)
- \[41\]Saves, P\., Lafage, R\., Bartoli, N\., Diouane, Y\., Bussemaker, J\., Lefebvre, T\., Hwang, J\.T\., Morlier, J\., Martins, J\.R\.R\.A\.: SMT 2\.0: A surrogate modeling toolbox with a focus on hierarchical and mixed variables Gaussian processes\. Advances in Engineering Software188, 103571 \(2024\)\. https://doi\.org/10\.1016/j\.advengsoft\.2023\.103571
- \[42\]Saves, P\., Mastio, M\., Verstaevel, N\., Gaudou, B\.: From model\-based screening to data\-driven surrogates: A multi\-stage workflow for exploring stochastic agent\-based models\. In: Proceedings of the Multi\-Agent\-Based Simulation Workshop \(2026\)
- \[43\]Shapley, L\.S\.: A value for n\-person games\. In: Kuhn, H\.W\., Tucker, A\.W\. \(eds\.\) Contributions to the Theory of Games II, pp\. 307–317\. Princeton University Press \(1953\)
- \[44\]Sobol’, I\.M\.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates\. Mathematics and Computers in Simulation55\(1–3\), 271–280 \(2001\)\. https://doi\.org/10\.1016/S0378\-4754\(00\)00270\-6
- \[45\]Song, E\., Nelson, B\.L\., Staum, J\.: Shapley effects for global sensitivity analysis: Theory and computation\. SIAM/ASA Journal on Uncertainty Quantification4\(1\), 1060–1083 \(2016\)\. https://doi\.org/10\.1137/15M1048070
- \[46\]Spagnol, A\., Le Riche, R\., Da Veiga, S\.: Global sensitivity analysis for optimization with variable selection\. SIAM/ASA Journal on Uncertainty Quantification7\(2\), 417–443 \(2019\)\. https://doi\.org/10\.1137/18M1167978
- \[47\]Sportisse, A\., Boyer, C\., Josse, J\.: Imputation and low\-rank estimation with missing not at random data\. Statistics and Computing30\(6\), 1629–1643 \(2020\)
- \[48\]Taillandier, P\., Gaudou, B\., Grignard, A\., Huynh, Q\.N\., Marilleau, N\., Caillou, P\., Philippon, D\., Drogoul, A\.: Building, composing and experimenting complex spatial models with the GAMA platform\. GeoInformatica23\(2\), 299–322 \(2019\)\. https://doi\.org/10\.1007/s10707\-018\-00339\-6
- \[49\]Taillandier, P\., Therond, O\., Gaudou, B\.: A new BDI agent architecture based on the belief theory: Application to the modelling of cropping plan decision\-making\. In: Proceedings of the International Congress on Environmental Modelling and Software \(iEMSs\) \(2012\)
- \[50\]Therond, O\., Sibertin\-Blanc, C\., Lardy, R\., Gaudou, B\., et al\.: Integrated modelling of social\-ecological systems: The MAELIA high\-resolution multi\-agent platform to deal with water scarcity problems\. In: Proceedings of the 7th International Congress on Environmental Modelling and Software \(iEMSs\) \(2014\)
- \[51\]Thiele, J\.C\., Kurth, W\., Grimm, V\.: Facilitating parameter estimation and sensitivity analysis of agent\-based models: A cookbook using NetLogo and R\. Journal of Artificial Societies and Social Simulation17\(3\), 11 \(2014\)\. https://doi\.org/10\.18564/jasss\.2503
- \[52\]Tribouillois, H\., Constantin, J\., Casal, L\., Villerd, J\., Therond, O\.: Introducing and expanding cover crops at the watershed scale: Impact on water flows\. Agriculture, Ecosystems & Environment337, 108050 \(2022\)
- \[53\]Tribouillois, H\., Constantin, J\., Murgue, C\., Villerd, J\., Therond, O\.: Integrated modeling of crop and water management at the watershed scale: Optimizing irrigation and modifying crop succession\. European Journal of Agronomy140, 126592 \(2022\)Similar Articles
Agri-SAGE: Simulation-Grounded Multi-Agent LLM for Context-Aware Agricultural Advisory Generation
This paper introduces Agri-SAGE, a closed-loop framework that integrates multi-agent LLM reasoning with biophysical simulation (APSIM) to generate and validate context-aware agricultural advisories. The framework outperforms static baselines in retrospective analysis, with Tree-of-Thoughts achieving peak yields and Reflexion reducing computational cost via episodic memory.
Semantic Uncertainty-Guided Orchestration in Hierarchical Multi-Agent Systems
This paper introduces HASSUM, a semantic-uncertainty-guided orchestration framework for hierarchical multi-agent systems that uses semantic entropy and density to improve reliability and adapt decision-making.
Hierarchical Bayesian optimization of an aircraft-based multi-agent system-of-systems
This paper introduces a hierarchical Bayesian optimization framework for optimizing aircraft-based multi-agent systems-of-systems, applied to wildfire suppression, improving search efficiency and robustness in complex design spaces.
Beyond Simply Environment Scaling: Designing Effective Environment Distributions for Multimodal Agent Learning
The paper argues that simply scaling multimodal environments does not always improve agent training, and proposes Ability-aware Environment Selection (AES) and Hierarchical Difficulty Curriculum (HDC) to better structure environment distributions along diversity and difficulty dimensions.
SciHazard: A Benchmark for Measuring Scientific Safety Risks with Decomposed Harm Scoring
Introduces SciHazard, a benchmark for measuring scientific safety risks in LLMs with a decomposed harm scoring framework, and evaluates 31 frontier models, finding deep research agents pose higher risks.