Geo-Strat-RL: Learning Geological Event Reasoning from Verifiable Tasks

arXiv cs.LG Papers

Summary

This paper presents Geo-Strat-RL, a synthetic environment that uses reinforcement learning with verifiable rewards (RLVR) to train vision-language models to reason about geological event histories from stratigraphic diagrams and seismic data, demonstrating improved reconstruction and cross-domain transfer.

arXiv:2606.25000v1 Announce Type: new Abstract: To evaluate whether vision-language models can reason about geological histories, it is necessary to construct observations for which the underlying process history is known. Furthermore, reasoning over geological histories is not just a question of recognizing visual patterns, but also of understanding temporal and structural relationships that may be only indirectly visible or highly ambiguous. When ground-truth event histories are not uniquely identifiable or are unavailable, it remains an open challenge to teach models capable of visual reasoning to produce valid geological reconstructions that are consistent with both observed evidence and geological principles. We therefore investigate whether defining a verifiable geological reasoning task can improve geological event reconstruction across observation domains through reinforcement learning with verifiable rewards (RLVR). To this end, we present Geo-Strat-RL, a synthetic environment that generates stratigraphic observations and compact visible-evidence event histories. The environment combines a geological generator with an executable verifier that scores chronology, event identity, deposition, and structural relationships. We show that RLVR improves geological reconstruction in vision-language models (VLMs), increasing geological content scores on held out stratigraphic diagrams. We further evaluate the same held-out geological histories in a synthetic seismic observation domain by converting the generated scenes into acoustic-impedance-derived amplitude sections. In this controlled paired-renderer setting, we present evidence that geological reasoning learned from stratigraphic diagram-domain RLVR training transfers to synthetic seismic representations without seismic-specific training examples, supporting the hypothesis that RLVR can teach reusable geological reasoning concepts across related observation formats.
Original Article
View Cached Full Text

Cached at: 06/25/26, 05:10 AM

# Geo-Strat-RL: Learning Geological Event Reasoning from Verifiable Tasks
Source: [https://arxiv.org/html/2606.25000](https://arxiv.org/html/2606.25000)
###### Abstract

To evaluate whether vision\-language models can reason about geological histories, it is necessary to construct observations for which the underlying process history is known\. Furthermore, reasoning over geological histories is not just a question of recognizing visual patterns, but also of understanding temporal and structural relationships that may be only indirectly visible or highly ambiguous\. When ground\-truth event histories are not uniquely identifiable or are unavailable, it remains an open challenge to teach models capable of visual reasoning to produce valid geological reconstructions that are consistent with both observed evidence and geological principles\. We therefore investigate whether defining a verifiable geological reasoning task can improve geological event reconstruction across observation domains through reinforcement learning with verifiable rewards \(RLVR\)\. To this end, we present Geo\-Strat\-RL, a synthetic environment that generates stratigraphic observations and compact visible\-evidence event histories\. The environment combines a geological generator with an executable verifier that scores chronology, event identity, deposition, and structural relationships\. We show that RLVR improves geological reconstruction in vision\-language models \(VLMs\), increasing geological content scores on held\-out stratigraphic diagrams\. We further evaluate the same held\-out geological histories in a synthetic seismic observation domain by converting the generated scenes into acoustic\-impedance\-derived amplitude sections\. In this controlled paired\-renderer setting, we present evidence that geological reasoning learned from stratigraphic diagram\-domain RLVR training transfers to synthetic seismic representations without seismic\-specific training examples, supporting the hypothesis that RLVR can teach reusable geological reasoning concepts across related observation formats\.

vision\-language models, reinforcement learning, synthetic benchmarks, geology, sequence stratigraphy

## 1Introduction

Machine learning has a long history in geoscience, spanning remote sensing, seismic interpretation, lithology classification, document\-scale knowledge extraction, and many more applications\(Bergenet al\.,[2019](https://arxiv.org/html/2606.25000#bib.bib25); Dramsch,[2020](https://arxiv.org/html/2606.25000#bib.bib26); Zhuet al\.,[2017](https://arxiv.org/html/2606.25000#bib.bib27); Waldelandet al\.,[2018](https://arxiv.org/html/2606.25000#bib.bib28); Wuet al\.,[2019](https://arxiv.org/html/2606.25000#bib.bib29); Hall,[2016](https://arxiv.org/html/2606.25000#bib.bib30); Bressanet al\.,[2020](https://arxiv.org/html/2606.25000#bib.bib31); Denget al\.,[2023](https://arxiv.org/html/2606.25000#bib.bib5); Linet al\.,[2024](https://arxiv.org/html/2606.25000#bib.bib6)\)\. Recent foundation models extend this line of work from task\-specific predictors toward language\- and vision\-language systems that can answer domain questions, follow instructions, and synthesize scientific context\. Geoscience\-specific language models such as K2 and GeoGalactica adapt general large language models \(LLMs\) with geoscience corpora and instruction data\(Denget al\.,[2023](https://arxiv.org/html/2606.25000#bib.bib5); Linet al\.,[2024](https://arxiv.org/html/2606.25000#bib.bib6)\), while remote\-sensing VLMs such as GeoChat show how multimodal instruction\-following can be specialized to geospatial imagery\(Kuckrejaet al\.,[2024](https://arxiv.org/html/2606.25000#bib.bib7)\)\. These systems suggest that geological artificial intelligence \(AI\) is moving from classification toward reasoning, but they do not directly test whether a model can reconstruct a latent geological history from a static diagram\.

Controlled geological generators provide a way to make this question measurable\. Earlier generative\-model work used neural networks to represent distributions of porous media and to define geological priors\(Mosseret al\.,[2017](https://arxiv.org/html/2606.25000#bib.bib32),[2020](https://arxiv.org/html/2606.25000#bib.bib33)\)\. More recently, conversational systems have shown how large language models can expose decades of exploration knowledge through natural\-language interfaces\(Mosseret al\.,[2024](https://arxiv.org/html/2606.25000#bib.bib34)\)\. Geo\-Strat\-RL follows the same practical pattern: the model is not asked to describe geology in the abstract, but to recover a known geological object from controlled observations and to be evaluated against quantities that can be checked\.

Stratigraphic cross sections provide a compact setting for this question\. The final image is static, but the interpretation depends on temporal ordering, superposition, cross\-cutting relationships, and the distinction between deposition, deformation, erosion, and intrusion\. This makes the task different from object recognition or captioning: the model must infer a process history whose steps are only indirectly visible\. General VLMs such as LLaVA\-style models connect a visual encoder to an instruction\-following language model\(Liuet al\.,[2023](https://arxiv.org/html/2606.25000#bib.bib8)\); recent Qwen\-VL models provide strong open multimodal baselines\(Qwen Team,[2025a](https://arxiv.org/html/2606.25000#bib.bib14)\)\. Qwen3\-VL further emphasizes stronger multimodal reasoning and multi\-level visual feature integration\(Qwen Team,[2025b](https://arxiv.org/html/2606.25000#bib.bib15)\)\. However, broad VLM benchmarks rarely isolate whether the model has learned domain\-specific temporal rules rather than surface\-level description\.

We therefore frame stratigraphic interpretation as an RLVR problem\. The generator provides images and exact event histories, the verifier maps model output to decomposed geological rewards, and training can optimize the model against this executable feedback without human preference labels\. This follows recent reasoning\-model work in which reinforcement learning improves answer\-verifiable tasks\(Shaoet al\.,[2024](https://arxiv.org/html/2606.25000#bib.bib12); DeepSeek\-AI,[2025](https://arxiv.org/html/2606.25000#bib.bib13)\), but we apply the idea to visual geological event reconstruction\. To make the approach practical on open VLMs, we train low\-rank adaptation \(LoRA\) adapters\(Huet al\.,[2021](https://arxiv.org/html/2606.25000#bib.bib11)\)with Hugging Face Transformer Reinforcement Learning \(TRL\)’s Group Relative Policy Optimization \(GRPO\) implementation, which supports custom reward functions and multimodal GRPO training\(von Werraet al\.,[2020](https://arxiv.org/html/2606.25000#bib.bib16); Hugging Face,[2026](https://arxiv.org/html/2606.25000#bib.bib17)\)\.

This paper studies whether current VLMs can infer geological event histories from synthetic cross sections without relying on rendered layer names, arrows, or other visual annotations\. The objective is not to produce the most realistic geological diagrams or seismic representations\. Rather, Geo\-Strat\-RL uses geology as a compact, high\-ambiguity reasoning domain in which generalisation across geoscience domains from RLVR can be studied under controlled supervision: the observations require temporal and structural reasoning, the answer is verifiable, and the same latent event history can be rendered through different representation domains\. The benchmark is intentionally narrow: each image is generated by a controlled simulator with a known event sequence, and each model response is scored against a compact JavaScript Object Notation \(JSON\) target\.

![Refer to caption](https://arxiv.org/html/2606.25000v1/assets/figures/seismic_transfer_pair_simple.png)Figure 1:A simple paired held\-out scene rendered as a diagram observation and as a seismic\-style amplitude observation\. Both panels correspond to the same hidden geological history and compact target\.### Contributions

- •A controlled geological generator that produces stratigraphic observations together with compact visible\-evidence event histories\.
- •An executable verifier that decomposes model performance into format, chronology, event identity, deposition, and structural\-attribute components\.
- •A training and evaluation workflow that uses generated examples and verifiable rewards to improve open VLM geological reconstruction\.
- •A fixed no\-label train/validation/test fixture suite with component\-wise confidence intervals for diagram and seismic\-style observations\.
- •Paired diagram/seismic\-style experiments that test whether policies trained on one observation domain transfer to the other for the same latent geological histories\.

### Artifacts

Repository, dataset, model, and adapter links are collected in[Appendix˜E](https://arxiv.org/html/2606.25000#A5)\.

## 2Methodology

### 2\.1Task Definition

Given a cross\-section imagexx, the model must produce a compact JSON objectyycontaining a chronological event sequence\. Each event is represented with a short event code and attributes:

y=\{"seq":\[e1,e2,…,eT\]\}\.\\displaystyle y=\\\{\\texttt\{"seq"\}:\[e\_\{1\},e\_\{2\},\\ldots,e\_\{T\}\]\\\}\.\(1\)The same compact target can be paired with different renderings of the hidden scene;[Figure˜1](https://arxiv.org/html/2606.25000#S1.F1)shows a simple diagram/seismic\-style pair used in the transfer setting\. The target chronology is generated directly by the simulator and then normalized to include only evidence visible in the final rendered image, with an explicit initialbasementunit retained as a fixed convention\. The compact schema supports five event codes: depositionD, tiltingT, faultingF, erosion or angular unconformityE, and intrusionI\. Each deposition event namesbasementor one layer; deposition events are not grouped\. Tilting records affected layers and clockwise or counterclockwise direction\. Faulting records a fault identifier and normal or reverse motion\. Erosion records an angular\-unconformity surface and visible truncated layers or structures\. Intrusion records a dike identifier, preserved start and end points, and visible cut layers\. For intrusions whose endpoints fall inside the stratigraphic column, the layer endpoint is approximated from generated vertical endpoint metadata rather than inferred independently from rendered pixels; it is therefore a controlled target convention, not a claim about human image\-picking precision\. The event letters are a deliberate interface choice rather than geological notation: fixed short codes reduce completion length, lower truncation risk, simplify deterministic parsing, and keep the verifier stable across model families\. Fault events intentionally omit affected\-layer lists because such lists are ambiguous in final static images after erosion and later deposition; the benchmark instead scores fault chronology, identity, and normal/reverse sense\.

### 2\.2Synthetic Generator

The generator samples a chronological sequence and then renders the final state\. It starts from an explicit basement unit, deposits a lower package of layers, optionally tilts that package, adds complexity\-dependent finite faults and intrusions, applies erosion or an angular unconformity, and deposits younger layers\. For complexity levels 4 and 5, an intrusion is guaranteed later in the program if none was sampled before erosion\. The randomized generator uses 4–9 layers and cycles through five complexity levels when building training rows\. Lithologies are drawn from a small stylized set\. Diagram colors and textures are not semantic identifiers: basement has a fixed diagnostic style, while non\-basement depositional units and intrusions receive seed\-deterministic randomized styles with contrast constraints between neighboring units\.

The geometric model is deliberately textbook\-like\. Deposition creates polygonal units with finite visible thickness\. Tilting rotates existing layers around the lower frame\. Faulting uses a finite displacement field in fault\-local coordinates with along\-fault decay, across\-fault attenuation, and a narrow core transition; affected layers and existing intrusions are split and deformed rather than simply overprinted by a fault line\. Erosion clips existing layers and intrusions below a sloping unconformity surface, and intrusion inserts an irregular dike polygon through the current stratigraphy\. After construction, the scene is vertically scaled into the frame, deformation voids are assigned either to basement exposure or to an upward extension of the youngest visible layer, and the final input image is rendered without layer names, arrows, or event markers\. The event vocabulary follows standard sequence\-stratigraphic and structural\-geology concepts, but the renderer is intentionally schematic rather than a physical forward model\(Catuneanu,[2006](https://arxiv.org/html/2606.25000#bib.bib21); Allan,[1989](https://arxiv.org/html/2606.25000#bib.bib24)\)\.

These assumptions are intentionally restrictive\. The diagram benchmark does not model depositional facies uncertainty, ambiguous outcrop exposure, or multiple valid geological interpretations\. Instead, it provides a controlled process\-history task where the simulator defines a single answer key and where failures can be attributed to visual recognition, chronological ordering, or schema compliance\.

![Refer to caption](https://arxiv.org/html/2606.25000v1/assets/figures/construction_flow_seed_20001.png)Figure 2:Construction flow for generated seed 20001\. The training and evaluation images contain only the final cross section, but the simulator constructs the scene through a known chronological event sequence\.![Refer to caption](https://arxiv.org/html/2606.25000v1/assets/figures/construction_final_annotated_seed_20001.png)Figure 3:Enlarged annotated final cross section for generated seed 20001\. This panel is for reader audit only; benchmark images do not contain labels or arrows\.Compact target example\.For the construction flow in[Figure˜2](https://arxiv.org/html/2606.25000#S2.F2), the visible\-evidence target is:

`Target JSON`

`2\.3 Seismic\-Style Transfer Renderer To test whether diagram\-domain RLVR learns geological reasoning that survives a controlled observation\-domain shift, we add a seismic\-style renderer for the same hidden scenes\. This renderer changes only the observed data domain, not the sampled geological history or compact JSON target\. For each seed, the paired diagram and seismic\-style observations therefore have the same event sequence and the same visible\-evidence answer key\. The diagram observation is a colored schematic cross section, while the seismic\-style observation is a synthetic acoustic amplitude section represented as an image for VLM input; Figure˜1 shows a minimal paired example\. The renderer first rasterizes three acoustic property fields over the final scene: P\-wave velocity vpv\_\{p\}, density ρ\\rho, and acoustic impedance Z=ρ​vpZ=\\rho v\_\{p\}\. Depositional units receive deterministic acoustic impedances that increase by a fixed minimum step from one layer to the next, with only a small lithology\-dependent perturbation\. This makes each depositional contact produce a visible reflection coefficient, including contacts between visually similar or locally adjacent units\. Faults, unconformities, and intrusions enter through the same final deformed geometry used by the diagram renderer; intrusions receive a high\-impedance body, but their interior amplitudes are smoothed so the task cue is the body and its cut relationships rather than point\-diffraction artifacts\. The velocity model is then used in a simple two\-dimensional acoustic finite\-difference calculation\. We place a line of surface shots and receivers over a padded model, inject a Ricker wavelet, propagate pressure waves with an absorbing boundary sponge, mute direct arrivals, and record synthetic shot gathers\. The shot gathers are mapped back to depth with a lightweight Kirchhoff\-style imaging condition using source–image–receiver travel times and illumination normalization\. The final displayed seismic\-style image blends this depth image with the impedance\-contact image, adds controlled coherent noise and trace\-gain variation, and scales amplitudes to grayscale\. This produces a depth\-domain acoustic\-amplitude section whose layers, faults, unconformities, and intrusions remain aligned with the paired diagram while adding basic wave\-propagation and acquisition effects\. In addition to the GRPO runs performed on stratigraphic diagrams as the training domain, we additionally train one Qwen3\-VL\-4B adapter on the paired seismic\-style observations to test reverse transfer back to stratigraphic diagrams\. 2\.4 Environment and Datasets The generator is exposed to the reinforcement learning framework TRL as a materialized Hugging Face dataset\. Each row contains a conversational prompt, a Portable Network Graphics \(PNG\)\-encoded image, the compact answer in the answer field, and metadata such as seed, complexity, and number of visible events\. The same interface can generate examples on demand by advancing through deterministic seeds, so the environment is not intrinsically limited to a closed set of diagrams\. For reproducibility, and lower training\-time overhead, the reported runs instead use a fixed cached training split with distinct seeded rows; this split is larger than the number of prompt rows consumed by the 2000\-step training jobs\. The RLVR training runs reported here use images without rendered visual annotations, 16 generations per prompt, generation batch size 16, LoRA rank 16 with alpha 32 and dropout 0\.05, target modules q\_proj and v\_proj, and 2000 GRPO training steps\. The main Qwen2\.5\-VL\-3B and Qwen3\-VL\-4B adapters are trained on diagram observations; a separate Qwen3\-VL\-4B adapter is trained on seismic\-style observations with the same GRPO recipe\. Validation and test fixtures are fixed disjoint Hugging Face datasets; exact artifact identifiers and seed ranges are listed in Appendix˜E\. The results in this paper report only held\-out test performance\. Table˜1 summarizes the fixed train, validation, and test splits\. Table 1: Dataset composition of geological events\. All reported RLVR runs use the same fixed training split\. Validation and test rows report exact compact visible targets for the fixed held\-out fixtures\. Figure 4: Examples from the synthetic dataset\. The model receives only the stratigraphic diagram as an image and must recover a compact chronological event sequence\. Figure 5: Training reward and loss during the completed 2,000\-step TRL/GRPO LoRA training runs\. The curves include Qwen2\.5\-VL\-3B diagram\-domain training, Qwen3\-VL\-4B diagram\-domain training, and Qwen3\-VL\-4B seismic\-domain training; final claims are based on held\-out test rows and the transfer analysis rather than training reward alone\. 2\.5 Reward Components The prompt requires the model to emit only compact JSON with a top\-level seq field\. The verifier first extracts and parses JSON, accepting fenced JSON only after stripping the fence\. Invalid JSON receives zero reward\. For a valid compact response, the scalar training reward RR is a weighted sum of ten component scores: R\\displaystyle R =0\.10​Rjson\+0\.15​Rcount\+0\.25​Rorder\+0\.10​Rtypes\\displaystyle=0\.10R\_\{\\text\{json\}\}\+0\.15R\_\{\\text\{count\}\}\+0\.25R\_\{\\text\{order\}\}\+0\.10R\_\{\\text\{types\}\} \+0\.15​Rdep\+0\.10​Rfault\+0\.08​Rintr\+0\.04​Runc\\displaystyle\\quad\+0\.15R\_\{\\text\{dep\}\}\+0\.10R\_\{\\text\{fault\}\}\+0\.08R\_\{\\text\{intr\}\}\+0\.04R\_\{\\text\{unc\}\} \+0\.02​Rextra\+0\.01​Rprose\.\\displaystyle\\quad\+0\.02R\_\{\\text\{extra\}\}\+0\.01R\_\{\\text\{prose\}\}\. \(2\) Each component lies in \[0,1\]\[0,1\], so the weights express how much the verifier values different failure modes\. RjsonR\_\{\\text\{json\}\} checks only that the response is parseable compact JSON\. RcountR\_\{\\text\{count\}\}, RorderR\_\{\\text\{order\}\}, and RtypesR\_\{\\text\{types\}\} evaluate the coarse event history: the number of events, their chronological event\-code order, and the set of event codes present\. RdepR\_\{\\text\{dep\}\}, RfaultR\_\{\\text\{fault\}\}, RintrR\_\{\\text\{intr\}\}, and RuncR\_\{\\text\{unc\}\} evaluate event\-specific geological attributes for deposition, faults, intrusions, and unconformities\. The final two terms are interface and parsimony terms: RextraR\_\{\\text\{extra\}\} penalizes hallucinated additional events, and RproseR\_\{\\text\{prose\}\} penalizes explanations around the JSON object\. For an unparsable response, the verifier sets R=0R=0 rather than applying these terms\. Thus a syntactically valid compact response with no geological match can still receive the format reward; this is useful during RL training because it bootstraps the required response interface, but it is not counted as geological reasoning in the geology\-only analysis\. For reporting geological reconstruction independent of response\-interface compliance, we define Rgeo=17\(\\displaystyle R\_\{\\text\{geo\}\}=\\frac\{1\}\{7\}\( Rcount\+Rorder\+Rtypes\+Rdep\\displaystyle R\_\{\\text\{count\}\}\+R\_\{\\text\{order\}\}\+R\_\{\\text\{types\}\}\+R\_\{\\text\{dep\}\} \+Rfault\+Rintr\+Runc\)\.\\displaystyle\+R\_\{\\text\{fault\}\}\+R\_\{\\text\{intr\}\}\+R\_\{\\text\{unc\}\}\)\. \(3\) This unweighted geology\-only score is not the training objective\. It is used for cross\-domain analysis because it excludes JSON validity, prose suppression, and extra\-event parsimony, and therefore better reflects event\-history recovery once a compact answer has been produced\. The seven terms in RgeoR\_\{\\text\{geo\}\} are intentionally averaged with equal weight: this makes the reported geology score less sensitive to the particular RL reward weights in the training objective\. The table and log names follow these terms directly\. json\_valid is the parseability term, and no\_prose is the compact\-output term\. event\_count penalizes missing or extra events; event\_order compares event codes in chronological position with an additional length penalty; and event\_types measures set overlap over event codes\. deposition\_units matches layer identifiers for D events\. fault\_attributes matches fault identifier and normal/reverse sense, while intrusion\_attributes and unconformity\_attributes match the required compact fields for intrusions and unconformities at the expected event position\. no\_extra\_events is one when the response has no more events than the target and otherwise decays as target length over response length\. The remaining equations define the non\-attribute components\. Let A=\(a1,…,aM\)A=\(a\_\{1\},\\ldots,a\_\{M\}\) be the predicted compact event list and B=\(b1,…,bN\)B=\(b\_\{1\},\\ldots,b\_\{N\}\) be the target list\. Here MM and NN are the predicted and target lengths, c​\(e\)c\(e\) returns the event code of event ee \(for example D, F, or I\), and 𝟏​\[⋅\]\\mathbf\{1\}\[\\cdot\] is an indicator function\. The implemented component scores are: Rcount\\displaystyle R\_\{\\text\{count\}\} =max⁡\(0,1−\|M−N\|N\),\\displaystyle=\\max\\left\(0,1\-\\frac\{\|M\-N\|\}\{N\}\\right\), \(4\) Rorder\\displaystyle R\_\{\\text\{order\}\} =max⁡\(0,Sord−0\.25​\|M−N\|N\),\\displaystyle=\\max\\left\(0,S\_\{\\text\{ord\}\}\-0\.25\\frac\{\|M\-N\|\}\{N\}\\right\), \(5\) Sord\\displaystyle S\_\{\\text\{ord\}\} =1N​∑i=1N𝟏​\[i≤M∧c​\(ai\)=c​\(bi\)\],\\displaystyle=\\frac\{1\}\{N\}\\sum\_\{i=1\}^\{N\}\\mathbf\{1\}\[i\\leq M\\wedge c\(a\_\{i\}\)=c\(b\_\{i\}\)\], \(6\) Rtypes\\displaystyle R\_\{\\text\{types\}\} =\|CA∩CB\|\|CB\|,\\displaystyle=\\frac\{\|C\_\{A\}\\cap C\_\{B\}\|\}\{\|C\_\{B\}\|\}, \(7\) Rextra\\displaystyle R\_\{\\text\{extra\}\} =\{1,M≤N,N/M,M\>N\.\\displaystyle=\\begin\{cases\}1,&M\\leq N,\\\\ N/M,&M\>N\.\\end\{cases\} \(8\) The count score is one when the response has the correct length and decreases linearly as events are missing or added\. SordS\_\{\\text\{ord\}\} is the fraction of target positions whose event code matches at the same chronological position; RorderR\_\{\\text\{order\}\} then subtracts a smaller length penalty so that a response cannot obtain a high order score simply by matching a short prefix\. For the type\-overlap score, CA=\{c​\(ai\)\}i=1MC\_\{A\}=\\\{c\(a\_\{i\}\)\\\}\_\{i=1\}^\{M\} and CB=\{c​\(bi\)\}i=1NC\_\{B\}=\\\{c\(b\_\{i\}\)\\\}\_\{i=1\}^\{N\} are the predicted and target sets of event codes\. This rewards whether the response includes the right kinds of geological processes, independent of how many times they occur\. RextraR\_\{\\text\{extra\}\} is one when the response is no longer than the target and decays as N/MN/M when the model adds unsupported events\. Typed attribute scores are averaged over target events of the relevant type at their expected positions\. For each required field, scalar/string values receive 1 for exact normalized equality and 0 otherwise, while list values receive target\-normalized set overlap\. The required compact fields are: D basement or layer id for RdepR\_\{\\text\{dep\}\}; F fault id and normal/reverse sense for RfaultR\_\{\\text\{fault\}\}; I intrusion id, start, end, and cut\-layer list for RintrR\_\{\\text\{intr\}\}; and E surface type and truncated\-feature list for RuncR\_\{\\text\{unc\}\}\. If a target contains no event of a typed class, that typed attribute score is defined as 1\. For seismic\-style scoring, a prediction may omit the leading basement deposition event when the target begins with basement, because basement is not always uniquely distinguishable in the amplitude\-style observations\. The prose score RproseR\_\{\\text\{prose\}\} is 1 for a bare JSON object, 0\.75 for a fenced JSON object, and 0 when extra prose surrounds the object\. The TRL run passes this verifier as a custom reward function to GRPOTrainer\. TRL computes rewards over generated completions and supports weighted custom reward functions; its current GRPO documentation also explicitly supports VLM training with image\-text datasets \(Hugging Face, 2026\)\. The training and evaluation scripts use the aggregate reward for optimization and log every component for analysis\. The implementation uses Hugging Face datasets for split storage \(Lhoest et al\., 2021\), and PyTorch for training utilities \(Paszke et al\., 2019\)\. For API\-served pretrained open and closed VLM evaluations, we use OpenRouter as the primary model provider; locally trained LoRA adapters and local base checkpoints are evaluated directly with the same prompts and verifier\. 3 Results 3\.1 Held\-Out Test Results Table 2: Current held\-out test performance on stratigraphic diagram images from porestar/geo\-strat\-rl\-test\. Each metric cell reports the mean with a 95% bootstrap confidence interval underneath\. RR is the full verifier reward; RgeoR\_\{\\text\{geo\}\} averages event count, event order, event types, deposition units, fault attributes, intrusion attributes, and unconformity attributes\. Unless otherwise noted, evaluations use 100 examples with 5 rollouts per example; the GPT\-5\.5 diagram evaluation uses 3 rollouts per example because medium\-reasoning API inference was substantially more expensive\. Rollouts are averaged within each example before bootstrapping over held\-out examples\. Err\. and Trunc\. report rollout\-level provider/error and truncation rates where current result files are included\. Arrows indicate that higher scores are better; bold underlined values mark the best reported mean in each metric\. Table 3: Held\-out test performance on seismic\-style observations generated from stratigraphic diagrams\. Each evaluation uses 100 examples with 5 rollouts per example, averages rollouts within example, and bootstraps over example means for 95% confidence intervals\. RR is the full verifier reward; RgeoR\_\{\\text\{geo\}\} averages event count, event order, event types, deposition units, fault attributes, intrusion attributes, and unconformity attributes\. Err\. and Trunc\. report rollout\-level provider/error and truncation rates\. The Gemini 2\.5 Flash Lite evaluation is retained for comparison but should be read with caution: even with a 16,384\-token output cap, 82 of 500 rollouts ended with length truncation\. Table˜2 reports held\-out test performance and shows that RLVR\-style optimization produces large improvements over the corresponding base models\. Each table row is one model evaluation: a specified open or closed VLM, base checkpoint, or LoRA adapter evaluated on a fixed observation domain with the same prompts, held\-out examples, rollout protocol, and verifier\. Unless otherwise noted, each evaluation uses the same 100 held\-out examples with 5 rollouts per example, and confidence intervals are computed by averaging rollouts within each example, then bootstrapping over the 100 example means\. For cost reasons, the GPT\-5\.5 diagram evaluation uses 3 rollouts per example; we disclose this exception because medium\-reasoning GPT\-5\.5 inference was substantially more expensive than the other API evaluations\. Table˜3 reports the corresponding seismic\-style evaluations, including pretrained API\-served baselines, local pretrained checkpoints, and local LoRA adapters\. For Qwen2\.5\-VL\-3B, held\-out test reward increases from 0\.208 to 0\.695 after diagram\-domain GRPO LoRA tuning with 16 generations per prompt\. For Qwen3\-VL\-4B, held\-out test reward increases from 0\.311 to 0\.740, the highest mean among the reported local open tuned evaluations\. The closed GPT\-5\.5 medium\-reasoning diagram evaluation reaches 0\.747 average reward under the same verifier after enabling JSON\-object mode and omitting an output\-token cap\. It is 0\.007 average reward above the Qwen3\-VL\-4B diagram ng16 LoRA evaluation, while producing the strongest event\-count, event\-order, deposition\-unit, fault\-attribute, intrusion\-attribute, unconformity\-attribute, and no\-extra\-event scores in Table˜2\. For the Mistral Small 3\.2 24B diagram evaluation, average reward is 0\.624 with a 95% bootstrap confidence interval of \[0\.591, 0\.656\]; this evaluation had 7 provider errors out of 500 rollouts and 10 truncated outputs out of 500 rollouts\. Mistral Small 3\.2 24B has the strongest average reward among the pretrained seismic evaluations, with 0\.716 \[0\.683, 0\.747\] and no provider errors or truncations in the final result file\. The strongest seismic\-style evaluation overall is the Qwen3\-VL\-4B seismic ng16 LoRA adapter, with R=0\.745R=0\.745 \[0\.713, 0\.776\] and Rgeo=0\.670R\_\{\\text\{geo\}\}=0\.670 \[0\.628, 0\.711\]\. Gemini 2\.5 Flash Lite remains affected by long, non\-compact seismic completions: after reevaluating with a 16,384\-token output cap, 82 of 500 rollouts still terminate by length\. We keep this evaluation in Table˜3 because it documents observed service behavior under the same compact\-JSON task, but we interpret it as a truncation\-limited baseline rather than a clean estimate of model capability\. GPT\-5\.5 also completes cleanly on seismic\-style observations, reaching 0\.656 \[0\.632, 0\.680\] average reward with zero final truncations\. Both adapters reach perfect JSON validity on the diagram test split; Qwen3\-VL\-4B also reaches perfect no\-prose compliance, while Qwen2\.5\-VL\-3B still emits prose in some rollouts\. The remaining errors concentrate in structural attributes: fault and intrusion attributes improve moderately, while unconformity attributes remain the weakest component\. Figure˜6 shows that the strongest gains are not limited to the easiest examples: both adapters improve over their pretrained bases at every complexity level\. The degradation with increasing complexity remains substantial, however, which supports reporting complexity\-stratified scores rather than one aggregate\. 3\.2 Diagram/Seismic Domain Transfer For the transfer experiment, the most relevant question is not whether a model obeys the JSON interface but whether it extracts the geological history from a different data domain\. We therefore report a geology\-only score that averages the seven content components: event count, event order, event types, deposition units, fault attributes, intrusion attributes, and unconformity attributes\. This deliberately excludes json\_valid, no\_prose, and no\_extra\_events, because those components mainly measure response\-interface compliance and output parsimony\. The aggregate reward remains useful for training, but it mixes schema learning with geological interpretation and is less clean for a cross\-modal transfer investigation\. Additional paired examples are provided in Appendix˜C\. Figure 6: Held\-out test performance by generator complexity on porestar/geo\-strat\-rl\-test\. Each complexity bucket contains 20 examples, and the same held\-out examples are evaluated for the pretrained models, RLVR LoRA adapters, and OpenAI GPT\-5\.5 medium reasoning\. Dashed lines show pretrained open models; solid lines show RLVR LoRA adapters; the dotted line shows GPT\-5\.5\. RLVR improves both aggregate reward and geology\-only score at every complexity level, while GPT\-5\.5 remains strongest at lower complexity and competitive at higher complexity\. Table 4: Cross\-domain transfer on paired held\-out examples\. Arrows indicate that higher values are better; bold underlined values mark the best value in each numeric column\. The geology\-only score averages event count, event order, event types, deposition units, fault attributes, intrusion attributes, and unconformity attributes; format and prose components are excluded\. N/A indicates that no Qwen2\.5\-VL\-3B seismic\-domain adapter is reported\. Figure 7: Before/after geology\-only scores for diagram\-only RLVR\. Vertical bars show 95% bootstrap confidence intervals over held\-out examples\. The right panel isolates transfer to seismic\-style observations: no seismic\-style examples are used for these two RLVR runs, yet both tuned adapters improve on the paired amplitude test\. Table 5: Detailed geology\-component scores on seismic\-style held\-out examples\. Arrows indicate that higher scores are better; bold underlined values mark the best non\-delta method score in each component column\. Diagram\-domain LoRA adapters improve every geological component on the seismic\-style test, and the Qwen3\-VL\-4B seismic\-domain adapter further improves seismic event count, event order, event types, deposition units, fault attributes, and unconformity attributes\. Tables˜4 and 7 show that diagram\-domain RLVR improves geology\-only scores on both the original diagram domain and the synthetic seismic\-style observation domain\. Table˜4 also includes the reverse experiment: a Qwen3\-VL\-4B adapter trained on seismic\-style observations reaches the strongest seismic geology\-only score, 0\.670, and transfers back to diagram observations at 0\.652\. Table˜5 shows that this is not just schema transfer; on seismic\-style observations, Qwen3 diagram\-domain training improves event count by 0\.580, event types by 0\.568, deposition units by 0\.503, and intrusion attributes by 0\.367, while seismic\-domain training gives the strongest event order and unconformity scores\. The OpenAI GPT\-5\.5 medium\-reasoning evaluations in Tables˜2 and 3 reach 0\.747 average reward on diagrams and 0\.656 average reward on seismic\-style observations\. All 500 GPT\-5\.5 seismic rollouts finish with valid compact JSON and application programming interface \(API\) finish reason stop\. Qwen2\.5\-VL\-3B improves from 0\.171 to 0\.588 geology\-only score after diagram\-domain RLVR\. The conservative conclusion is therefore that the LoRA adapters provide evidence for controlled cross\-domain geological transfer in both directions, with the domain\-matched Qwen3 seismic adapter ending highest on seismic and retaining most of the gain when evaluated on diagrams\. 4 Discussion The results support four observations\. First, strong pretrained VLMs can recover some geological structure from diagrams without visual annotations, but performance varies substantially by model class and response format\. Gemma 4 31B IT is the best open model we evaluated by average reward and reaches near\-perfect JSON and no\-prose compliance on the 5\-rollout evaluation\. The completed OpenAI GPT\-5\.5 medium\-reasoning run is the strongest closed\-model comparison currently reported here; however, its remaining errors still concentrate in the same structural attributes, especially faults and unconformities on the highest\-complexity scenes\. This strong closed\-model result should not be interpreted as evidence that small task\-specific RLVR is already the main driver of frontier\-model performance on this benchmark\. Recent reasoning\-model reports show that large\-scale reinforcement learning on verifiable tasks can improve general reasoning, while multimodal systems such as Kimi k1\.5 and Kimi K2\.5 combine RL with multimodal or joint text\-vision training \(DeepSeek\-AI, 2025; Kimi Team, 2025, 2026\)\. At the same time, recent VLM reports attribute gains to stronger visual processing and multimodal reasoning machinery, including dynamic\-resolution vision transformers in Qwen2\.5\-VL and multi\-level vision transformer \(ViT\) feature fusion in Qwen3\-VL \(Qwen Team, 2025a, b\)\. The GPT\-5\.5 result is therefore consistent with at least two nonexclusive explanations: broad frontier\-scale RL/post\-training over many verifiable tasks, and substantially stronger visual recognition and visual\-temporal reasoning without any geology\-specific adaptation\. It is not known which RLVR environments are used in the GPT\-5\.5 training recipe, and some of the improvement could come from geology\-relevant tasks or specific geological training environments\. The present experiments cannot separate these mechanisms, and require deeper investigation of training recipes and ablations to determine how much of the improvement comes from general training versus geology\-specific RLVR, as well as how much of the improvement comes from visual recognition versus temporal reasoning\. Second, the GRPO LoRA runs substantially improve smaller open VLMs\. Among the local open base/LoRA rows, the Qwen3\-VL\-4B diagram LoRA adapter has the highest average reward and strongest event\-count, event\-order, event\-type, deposition, fault, intrusion, unconformity, no\-extra\-event, and no\-prose means\. This suggests that executable geological rewards can shape both the response interface and parts of the visual\-temporal interpretation\. However, the perfect format scores also show that some reward improvement comes from learning the compact schema, so future ablations should separate schema learning from event\-history reasoning\. Third, structural attributes remain the hardest part of the task\. Even the best diagram\-domain GRPO LoRA row reaches only 0\.328 on unconformity attributes and 0\.428 on fault attributes\. This is consistent with the qualitative difficulty of deciding which structures are visibly truncated, which layers a dike cuts, and which units are affected by younger faults after erosion and redeposition\. Future benchmark passes should keep the same prompt, reward, JSON\-mode, and no\-output\-cap protocol so that closed\-model comparisons remain complete and auditable\. This also means that there is significant room for improvement in RLVR training recipes, model architectures, and pretraining data that can improve structural reasoning and interpretation of geological relationships\. The availability of the benchmark environment will allow future updates to the test dataset to prevent overfitting and to track progress on this challenging aspect of geological reasoning\. Fourth, the seismic\-style transfer experiments are the first evidence that the learned behavior is not strongly tied to the stratigraphic diagram domain\. The results of applying the diagram\-pretrained models to seismic\-style observations show that the same geological event structure can be extracted from a different visual domain, even without any seismic\-specific training examples\. This does not prove robust seismic interpretation: the renderer deliberately makes contacts and structural relationships distinguishable, and it is still generated from the same symbolic scene model\. The result should therefore be read as evidence about reuse of verifier\-trained reasoning concepts across controlled observation formats, not as a claim that the model has learned an operational seismic\-interpretation workflow\. It supports the narrower hypothesis that verifier\-driven training can teach reusable geological event structure across controlled observation domains, not just a response template\. This raises the question of which other verifiable domains and observation formats can share geological reasoning concepts, and how far such transfer can be pushed toward real\-world geological data\. The ultimate goal is not to reproduce synthetic benchmarks, but to learn geological reasoning useful for real geoscience tasks where verification is difficult\. Limitations This benchmark is synthetic, stylized, and intentionally restricted to a small set of event types\. The generated diagrams and seismic\-style observations do not capture the full ambiguity, acquisition physics, processing artifacts, noise distributions, or interpretive richness of field geology and real seismic interpretation\. Although the seismic\-style renderer includes acoustic finite\-difference propagation, surface acquisition, absorbing padding, simple depth imaging, coherent noise, and trace\-gain variation, it should be treated as a controlled transfer proxy rather than as a realistic seismic processing workflow\. The setup also differs from how geoscientists normally interpret outcrops or seismic data\. Sequence\-stratigraphic and subsurface interpretation commonly integrate multiple evidence sources, including outcrop analogs, cores, well logs, regional geological context, and multiple seismic sections or volumes with different imaging quality \(Catuneanu et al\., 2009; Posamentier and Kolla, 2003\)\. Real interpretations are often revised through this integrated comparison process, whereas Geo\-Strat\-RL gives the model a single isolated image and evaluates it against one simulator\-defined visible\-evidence target\. This design is useful for controlled RLVR experiments but should not be confused with the broader expert workflow used for field, reservoir, or exploration interpretation\. Future Work Future work should add human geological baselines, richer depositional environments, uncertainty\-aware targets, additional VLM families, and ablations that separate visual recognition errors from temporal\-ordering errors\. The benchmark also makes a natural test bed for interpretability\. Because every response is decomposed into event\-count, order, type, deposition, fault, intrusion, and unconformity scores, failures can be tied to specific geological operations rather than only to an aggregate reward\. Future work could combine component\-level errors with VLM interpretability methods, such as visual\-token attribution, attention or activation analysis, patch ablations, and representation probes, to test which image regions and visual relationships drive each predicted event\. When models expose visible rationales or chain\-of\-thought traces under an appropriate evaluation protocol, those traces could also be inspected against the executable event history to distinguish perceptual failures from failures of chronological or cross\-cutting reasoning\. Impact Statement This paper studies synthetic evaluation and training environments for geological reasoning with vision\-language models\. The primary intended impact is improved measurement of domain\-specific visual reasoning, with potential downstream relevance to geoscience education and model\-evaluation methodology\. The benchmark is not intended for operational subsurface interpretation or safety\-critical geological decision making\. Acknowledgments I thank Håkon Nese and Ashley Clarke for their reviews and for providing improvement suggestions for the manuscript and method\. References U\. S\. Allan \(1989\) Model for hydrocarbon migration and entrapment within faulted structures\. AAPG Bulletin 73 \(7\), pp\. 803–811\. Cited by: §2\.2\. K\. J\. Bergen, P\. A\. Johnson, M\. V\. de Hoop, and G\. C\. Beroza \(2019\) Machine learning for data\-driven discovery in solid earth geoscience\. Science 363 \(6433\), pp\. eaau0323\. External Links: Document Cited by: §1\. T\. S\. Bressan, M\. K\. de Souza, T\. J\. Girelli, and F\. Chemale \(2020\) Evaluation of machine learning methods for lithology classification using geophysical data\. Computers & Geosciences 139, pp\. 104475\. External Links: Document Cited by: §1\. O\. Catuneanu, V\. Abreu, J\. P\. Bhattacharya, M\. D\. Blum, R\. W\. Dalrymple, P\. G\. Eriksson, C\. R\. Fielding, W\. L\. Fisher, W\. E\. Galloway, M\. R\. Gibling, K\. A\. Giles, J\. M\. Holbrook, R\. Jordan, C\. G\. St\. C\. Kendall, B\. Macurda, O\. J\. Martinsen, A\. D\. Miall, J\. E\. Neal, D\. Nummedal, L\. Pomar, H\. W\. Posamentier, B\. R\. Pratt, J\. F\. Sarg, K\. W\. Shanley, R\. J\. Steel, A\. Strasser, M\. E\. Tucker, and C\. Winker \(2009\) Towards the standardization of sequence stratigraphy\. Earth\-Science Reviews 92 \(1–2\), pp\. 1–33\. External Links: Document Cited by: §4\. O\. Catuneanu \(2006\) Principles of sequence stratigraphy\. Elsevier\. Cited by: §2\.2\. DeepSeek\-AI \(2025\) DeepSeek\-R1: incentivizing reasoning capability in LLMs via reinforcement learning\. arXiv preprint arXiv:2501\.12948\. External Links: Link Cited by: §1, §4\. C\. Deng, T\. Zhang, Z\. He, Y\. Xu, Q\. Chen, Y\. Shi, L\. Fu, W\. Zhang, X\. Wang, C\. Zhou, Z\. Lin, and J\. He \(2023\) K2: a foundation language model for geoscience knowledge understanding and utilization\. arXiv preprint arXiv:2306\.05064\. External Links: Link Cited by: §1\. J\. S\. Dramsch \(2020\) 70 years of machine learning in geoscience in review\. Advances in Geophysics 61, pp\. 1–55\. External Links: Document Cited by: §1\. B\. Hall \(2016\) Facies classification using machine learning\. The Leading Edge 35 \(10\), pp\. 906–909\. External Links: Document Cited by: §1\. E\. J\. Hu, Y\. Shen, P\. Wallis, Z\. Allen\-Zhu, Y\. Li, S\. Wang, L\. Wang, and W\. Chen \(2021\) LoRA: low\-rank adaptation of large language models\. arXiv preprint arXiv:2106\.09685\. External Links: Link Cited by: §1\. Hugging Face \(2026\) TRL GRPOTrainer documentation\. External Links: Link Cited by: §1, §2\.5\. Kimi Team \(2025\) Kimi k1\.5: scaling reinforcement learning with LLMs\. arXiv preprint arXiv:2501\.12599\. External Links: Link Cited by: §4\. Kimi Team \(2026\) Kimi k2\.5: visual agentic intelligence\. arXiv preprint arXiv:2602\.02276\. External Links: Link Cited by: §4\. K\. Kuckreja, M\. S\. Danish, M\. Naseer, A\. Das, S\. Khan, and F\. S\. Khan \(2024\) GeoChat: grounded large vision\-language model for remote sensing\. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, External Links: Link Cited by: §1\. Q\. Lhoest, A\. Villanova del Moral, Y\. Jernite, A\. Thakur, P\. von Platen, S\. Patil, J\. Chaumond, M\. Drame, J\. Plu, L\. Tunstall, J\. Davison, H\. Sajjad, G\. Chhablani, B\. Malik, S\. Brandeis, T\. Le Scao, V\. Sanh, C\. Xu, N\. Patry, A\. McMillan\-Major, P\. Schmid, S\. Gugger, C\. Delangue, T\. Matussiere, L\. Debut, S\. Bekman, P\. Cistac, T\. Goehringer, V\. Mustar, F\. Lagunas, A\. M\. Rush, and T\. Wolf \(2021\) Datasets: a community library for natural language processing\. In Proceedings of the 2021 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pp\. 175–184\. External Links: Link Cited by: §2\.5\. Z\. Lin, C\. Deng, L\. Zhou, T\. Zhang, Y\. Xu, Y\. Xu, Z\. He, Y\. Shi, B\. Dai, Y\. Song, B\. Zeng, Q\. Chen, Y\. Miao, B\. Xue, S\. Wang, L\. Fu, W\. Zhang, J\. He, Y\. Zhu, X\. Wang, and C\. Zhou \(2024\) GeoGalactica: a scientific large language model in geoscience\. arXiv preprint arXiv:2401\.00434\. External Links: Link Cited by: §1\. H\. Liu, C\. Li, Q\. Wu, and Y\. J\. Lee \(2023\) Visual instruction tuning\. In Advances in Neural Information Processing Systems, Vol\. 36\. External Links: Link Cited by: §1\. L\. Mosser, P\. Aursand, K\. S\. Brakstad, C\. Lehre, and J\. Myhre\-Bakkevig \(2024\) Exploration robot chat: uncovering decades of exploration knowledge and data with conversational large language models\. In SPE Norway Subsurface Conference, External Links: Document Cited by: §1\. L\. Mosser, O\. Dubrule, and M\. J\. Blunt \(2017\) Reconstruction of three\-dimensional porous media using generative adversarial neural networks\. Physical Review E 96 \(4\), pp\. 043309\. External Links: Document, Link Cited by: §1\. L\. Mosser, O\. Dubrule, and M\. J\. Blunt \(2020\) Stochastic seismic waveform inversion using generative adversarial networks as a geological prior\. Mathematical Geosciences 52 \(1\), pp\. 53–79\. External Links: Document, Link Cited by: §1\. OpenAI \(2026\) GPT\-5\.5 system card\. External Links: Link Cited by: Table 2, Table 3\. A\. Paszke, S\. Gross, F\. Massa, A\. Lerer, J\. Bradbury, G\. Chanan, T\. Killeen, Z\. Lin, N\. Gimelshein, L\. Antiga, A\. Desmaison, A\. Kopf, E\. Yang, Z\. DeVito, M\. Raison, A\. Tejani, S\. Chilamkurthy, B\. Steiner, L\. Fang, J\. Bai, and S\. Chintala \(2019\) PyTorch: an imperative style, high\-performance deep learning library\. In Advances in Neural Information Processing Systems, Vol\. 32\. External Links: Link Cited by: §2\.5\. H\. W\. Posamentier and V\. Kolla \(2003\) Seismic geomorphology and stratigraphy of depositional elements in deep\-water settings\. Journal of Sedimentary Research 73 \(3\), pp\. 367–388\. External Links: Document Cited by: §4\. Qwen Team \(2025a\) Qwen2\.5\-VL technical report\. arXiv preprint arXiv:2502\.13923\. External Links: Link Cited by: §1, §4\. Qwen Team \(2025b\) Qwen3\-VL technical report\. arXiv preprint arXiv:2511\.21631\. External Links: Link Cited by: §1, §4\. Z\. Shao, P\. Wang, Q\. Zhu, R\. Xu, J\. Song, X\. Bi, H\. Zhang, M\. Zhang, Y\. K\. Li, Y\. Wu, and D\. Guo \(2024\) DeepSeekMath: pushing the limits of mathematical reasoning in open language models\. arXiv preprint arXiv:2402\.03300\. External Links: Link Cited by: §1\. L\. von Werra, Y\. Belkada, L\. Tunstall, E\. Beeching, T\. Thrush, N\. Lambert, S\. Huang, K\. Rasul, and Q\. Gallouédec \(2020\) TRL: transformers reinforcement learning\. External Links: Link Cited by: §1\. A\. U\. Waldeland, A\. C\. Jensen, Leiv\-J\. Gelius, and A\. H\. S\. Solberg \(2018\) Convolutional neural networks for automated seismic interpretation\. The Leading Edge 37 \(7\), pp\. 529–537\. External Links: Document Cited by: §1\. X\. Wu, L\. Liang, Y\. Shi, and S\. Fomel \(2019\) FaultSeg3D: using synthetic data sets to train an end\-to\-end convolutional neural network for 3d seismic fault segmentation\. Geophysics 84 \(3\), pp\. IM35–IM45\. External Links: Document Cited by: §1\. X\. X\. Zhu, D\. Tuia, L\. Mou, G\. Xia, L\. Zhang, F\. Xu, and F\. Fraundorfer \(2017\) Deep learning in remote sensing: a comprehensive review and list of resources\. IEEE Geoscience and Remote Sensing Magazine 5 \(4\), pp\. 8–36\. External Links: Document Cited by: §1\. Appendix A Compact Target Schema The compact target is a JSON object with optional metadata fields and a required chronological sequence: Target Schema Each event is one of: Event Forms Intrusion endpoints are strings: "bottom" or "top" for diagram boundaries, "layer\_N" for a preserved layer endpoint, and "angular\_unconformity" when erosion truncates the intrusion\. Every target starts with \["D","basement"\]; other fully eroded or occluded events are omitted even if they occurred in the hidden simulator history\. Basement denotes pre\-existing rock below the first deposited layer\. In diagram\-domain images, it is rendered as a gray/taupe unit with a rock texture made of dark diagonal crack lines and small dark speckles, and can be visible either at the bottom of the frame or where deformation exposes lower material\. All non\-basement diagram colors and textures are randomized per example, with contrast constraints between neighboring depositional units, so they are not semantic layer identifiers\. For seismic\-domain scoring, we accept either a leading \["D","basement"\] event or a sequence that starts directly at \["D","layer\_1"\], because basement is not always uniquely distinguishable in seismic\-style images\. Appendix B Model Prompts The benchmark uses a single user message containing the image and one of the following domain\-specific text prompts\. The first sentence identifies the rendered image domain; the remaining instructions define the compact JSON interface, visible\-evidence convention, and basement convention\. Diagram\-Domain Prompt Seismic\-Domain Prompt Appendix C Extended Paired Transfer Examples Figure˜8 shows additional held\-out diagram and seismic\-style observations for the same hidden scenes and compact targets\. Figure 8: Additional paired held\-out transfer examples\. Each row uses the same hidden scene and answer key, observed once as the diagram task and once as a seismic\-style amplitude section\. This pairing isolates observation\-domain transfer from changes in geological history\. Appendix D Generator and Renderer Specification This appendix records the code\-level generator and renderer used for the results in this paper\. The generator is deterministic conditional on seed ss and complexity cc, but it samples a geological event program before rendering\. Let Ω=\[m,W−m\]×\[m,H−m\]\\Omega=\[m,W\-m\]\\times\[m,H\-m\] be the visible frame, with W=900W=900, H=520H=520, and m=70m=70 pixels\. The frame margin keeps contacts, faults, and intrusion endpoints away from image boundaries, leaving visible context for clipping and reducing ambiguous edge\-touching geometries\. For a given seed, the simulator samples an ordered event program ℰs,c=\(e1,…,eT\),Gt=Aet​\(Gt−1;θt\),\\displaystyle\\mathcal\{E\}\_\{s,c\}=\(e\_\{1\},\\ldots,e\_\{T\}\),\\qquad G\_\{t\}=A\_\{e\_\{t\}\}\(G\_\{t\-1\};\\theta\_\{t\}\), \(9\) where GtG\_\{t\} is the geometric scene state after event tt, AetA\_\{e\_\{t\}\} is the event operator, and θt\\theta\_\{t\} are event parameters\. The final visible target is derived from GTG\_\{T\} by retaining only events with visible evidence in the rendered scene\. seed ss complexity cc sample event program ℰs,c\\mathcal\{E\}\_\{s,c\} apply geological operators AeA\_\{e\} clip and scale final geometry GTG\_\{T\} visible\-event JSON target diagram or seismic image D\.1 Stratigraphic Event Program The default random generator samples N∼U​\{4,…,9\}N\\sim U\\\{4,\\ldots,9\\\} total depositional layers\. A lower package size NpreN\_\{\\mathrm\{pre\}\} is sampled uniformly from Npre∼U​\{max⁡\(2,⌊N/2⌋\),…,max⁡\(2,N−1\)\}\.\\displaystyle N\_\{\\mathrm\{pre\}\}\\sim U\\left\\\{\\max\(2,\\lfloor N/2\\rfloor\),\\ldots,\\max\(2,N\-1\)\\right\\\}\. \(10\) The event order is constrained to remain geologically plausible: lower deposition, optional tilting, optional faults and intrusion, erosion, upper deposition, and for the highest complexity optional later faulting, erosion, and additional deposition\. Depositional lithology is sampled from sandstone, shale, limestone, conglomerate, and siltstone\. The numerical constants in Tables˜6 and 7 are synthetic generator defaults chosen to keep contacts, offsets, intrusions, and unconformities visible at the benchmark image resolution\. They are not calibrated field or restoration parameters\. Table 6: Stratigraphic event\-program sampling used by generate\_random\_scenario\. Uniform ranges are inclusive for integer variables and continuous for real\-valued variables\. D\.2 Geometric Operators The initial basement is a polygon below the first depositional surface and is rendered with the fixed gray/taupe crack\-and\-speckle basement texture\. Deposition uses the current top surface st−1​\(x\)s\_\{t\-1\}\(x\) to create a polygonal layer\. With contact overlap δ=2\\delta=2 px and thickness hih\_\{i\}, the nominal top and bottom surfaces are bi​\(x\)\\displaystyle b\_\{i\}\(x\) =st−1​\(x\)\+δ,\\displaystyle=s\_\{t\-1\}\(x\)\+\\delta, \(11\) ui​\(x\)\\displaystyle u\_\{i\}\(x\) =max⁡\(m,bi​\(x\)−hi\)\.\\displaystyle=\\max\(m,b\_\{i\}\(x\)\-h\_\{i\}\)\. \(12\) If the current surface is an unconformity, the new layer top is horizontal at minx⁡bi​\(x\)−hi\\min\_\{x\}b\_\{i\}\(x\)\-h\_\{i\}; otherwise it follows the prior top surface\. When the scene approaches the top frame, all previous geometry is translated downward to leave at least 2424 px of visible thickness for the next deposition\. Tilting rotates all existing layer polygons around the lower\-frame pivot o=\(W/2,H−m\)o=\(W/2,H\-m\): Pi′=Rα​\(Pi;o\)\.\\displaystyle P\_\{i\}^\{\\prime\}=R\_\{\\alpha\}\(P\_\{i\};o\)\. \(13\) Faulting uses a finite displacement field in local fault coordinates\. For a point p=\(x,y\)p=\(x,y\), center q=\(xf,0\.55​H\)q=\(x\_\{f\},0\.55H\), fault tangent 𝐭=\(d​cos⁡ϕ,sin⁡ϕ\),𝐧=\(−ty,tx\),\\displaystyle\\mathbf\{t\}=\(d\\cos\\phi,\\sin\\phi\),\\qquad\\mathbf\{n\}=\(\-t\_\{y\},t\_\{x\}\), \(14\) and local coordinates a=\(p−q\)⋅𝐭a=\(p\-q\)\\cdot\\mathbf\{t\}, b=\(p−q\)⋅𝐧b=\(p\-q\)\\cdot\\mathbf\{n\}, the displacement amplitude is λ​\(a,b\)\\displaystyle\\lambda\(a,b\) =max⁡\(0,1−\(a/L\)2\)​exp⁡\[−\(\|b\|/D\)2\]\\displaystyle=\\sqrt\{\\max\\left\(0,1\-\\left\(a/L\\right\)^\{2\}\\right\)\}\\exp\\left\[\-\\left\(\|b\|/D\\right\)^\{2\}\\right\] ⋅max⁡\(𝟏​\[mf​b\>0\], 0\.18​exp⁡\[−\(b/\(0\.45​D\)\)2\]\),\\displaystyle\\quad\\cdot\\max\\left\(\\mathbf\{1\}\[m\_\{f\}b\>0\],\\,0\.18\\exp\\left\[\-\\left\(b/\(0\.45D\)\\right\)^\{2\}\\right\]\\right\), \(15\) where mf∈\{−1,1\}m\_\{f\}\\in\\\{\-1,1\\\} is the moving\-side sign\. The slip vector is 𝐯=\(τ/ty\)​𝐭\\mathbf\{v\}=\(\\tau/t\_\{y\}\)\\mathbf\{t\}, so the deformed point is p′=p\+λ​\(a,b\)​𝐯\.\\displaystyle p^\{\\prime\}=p\+\\lambda\(a,b\)\\mathbf\{v\}\. \(16\) Layer and intrusion polygons are split by the fault trace before this deformation is applied\. If a younger fault terminates against an older fault, the trace is truncated at their intersection and deformation is applied only on the active side\. Erosion constructs a linear unconformity ue​\(x\)=y0\+β​\(x−W/2\),\\displaystyle u\_\{e\}\(x\)=y\_\{0\}\+\\beta\(x\-W/2\), \(17\) where β\\beta is the sampled slope and y0y\_\{0\} is the largest value required to keep the surface at least 88 px below the visible top of the eroded package\. All material above ue​\(x\)u\_\{e\}\(x\) is clipped\. Intrusion inserts a six\-vertex dike polygon with sampled center, width, top, and bottom; later erosion and faulting can clip or deform this polygon like any other geometry\. Finally, all visible geometry is vertically scaled into the frame if the constructed scene does not fill the available height\. Remaining visible voids are made explicit: voids connected to the top frame extend the youngest visible layer upward, while lower voids become basement exposure\. Table 7: Main geometric constants and operators in the stratigraphic generator\. D\.3 Seismic\-Domain Synthetic Renderer The seismic\-style renderer consumes the same final scene GTG\_\{T\} and answer key as the diagram renderer\. It does not resample the geology\. Instead, it maps the final geometry to acoustic material properties, simulates simple surface seismic acquisition with a two\-dimensional acoustic wave equation, images the simulated records back into depth, and displays the result as a grayscale amplitude section\. The goal is not survey realism; it is a controlled observation domain in which the same layers, faults, unconformities, and intrusions are visible through seismic\-style amplitudes\. final geometry rasterize vp,ρ,Zv\_\{p\},\\rho,Z surface shots acoustic finite difference \(FD\) depth imaging contact image and cleanup noise, gain, display scaling Let Mk​\(x,y\)M\_\{k\}\(x,y\) be the raster mask for deposited unit kk in the final deformed scene\. For each unit, we assign density ρk=clip⁡\(1980\+36​k\+dℓk,1850,2850\),\\displaystyle\\rho\_\{k\}=\\operatorname\{clip\}\\left\(1980\+36k\+d\_\{\\ell\_\{k\}\},1850,2850\\right\), \(18\) where dℓkd\_\{\\ell\_\{k\}\} is a small lithology\-dependent density offset\. We then assign acoustic impedance Zk=3\.8\+0\.95​k\+0\.08​ℓk,\\displaystyle Z\_\{k\}=3\.8\+0\.95k\+0\.08\\,\\ell\_\{k\}, \(19\) where ℓk\\ell\_\{k\} is a bounded lithology offset\. The fixed 0\.950\.95 step guarantees that every successive deposited layer differs in acoustic impedance enough to produce a visible contact reflection\. The P\-wave velocity is derived from the impedance and density, vp,k=clip⁡\(106​Zkρk,1750,4300\),\\displaystyle v\_\{p,k\}=\\operatorname\{clip\}\\left\(\\frac\{10^\{6\}Z\_\{k\}\}\{\\rho\_\{k\}\},1750,4300\\right\), \(20\) where the factor 10610^\{6\} converts the compact impedance units used in the renderer to International System of Units \(SI\)\-like units\. The raster fields are vp​\(x,y\)=∑kMk​\(x,y\)​vp,k,ρ​\(x,y\)=∑kMk​\(x,y\)​ρk,Z​\(x,y\)=ρ​\(x,y\)​vp​\(x,y\)/106\.\\displaystyle v\_\{p\}\(x,y\)=\\sum\_\{k\}M\_\{k\}\(x,y\)v\_\{p,k\},\\qquad\\rho\(x,y\)=\\sum\_\{k\}M\_\{k\}\(x,y\)\\rho\_\{k\},\\qquad Z\(x,y\)=\\rho\(x,y\)v\_\{p\}\(x,y\)/10^\{6\}\. \(21\) Intrusions are assigned a high\-impedance body with vp=4300v\_\{p\}=4300 and ρ=2920\\rho=2920\. After imaging, amplitudes inside the intrusion mask are smoothed and attenuated so that intrusions appear as coherent bodies that cut layers rather than as strings of point\-diffraction artifacts\. The velocity raster is resized to a compact modeling grid and padded by 3232 cells on all sides\. We use a second\-order acoustic finite\-difference update for pressure pp, pi,jt\+1=2​pi,jt−pi,jt−1\+\(vp​\(i,j\)​Δ​tΔ​x\)2​∇2pi,jt\+si,jt,\\displaystyle p^\{t\+1\}\_\{i,j\}=2p^\{t\}\_\{i,j\}\-p^\{t\-1\}\_\{i,j\}\{\}\+\\left\(\\frac\{v\_\{p\}\(i,j\)\\Delta t\}\{\\Delta x\}\\right\)^\{2\}\\nabla^\{2\}p^\{t\}\_\{i,j\}\{\}\+s^\{t\}\_\{i,j\}, \(22\) where ∇2\\nabla^\{2\} is the five\-point spatial Laplacian, Δ​x=12\\Delta x=12 m, Δ​t=0\.001\\Delta t=0\.001 s, and sts^\{t\} is a Ricker source wavelet\. A multiplicative sponge taper in the padded region absorbs outgoing energy and keeps boundary reflections outside the displayed domain\. The default acquisition uses 1111 surface shots and 8888 surface receivers, both placed just below the top boundary\. For each shot, recorded traces are direct\-arrival muted using the near\-surface velocity and then de\-meaned across receivers and time to reduce source and receiver imprint\. The simulated shot gathers are imaged back to depth by a lightweight Kirchhoff\-style condition\. For image point \(x,z\)\(x,z\), shot position xsx\_\{s\}, receiver position xrx\_\{r\}, and depth\-dependent root\-mean\-square \(RMS\) velocity vrms​\(z\)v\_\{\\mathrm\{rms\}\}\(z\), we use the two\-way travel\-time approximation T​\(x,z;xs,xr\)=\(x−xs\)2\+z2\+\(x−xr\)2\+z2vrms​\(z\)\.\\displaystyle T\(x,z;x\_\{s\},x\_\{r\}\)=\\frac\{\\sqrt\{\(x\-x\_\{s\}\)^\{2\}\+z^\{2\}\}\+\\sqrt\{\(x\-x\_\{r\}\)^\{2\}\+z^\{2\}\}\}\{v\_\{\\mathrm\{rms\}\}\(z\)\}\. \(23\) The image is the illumination\-normalized weighted sum of trace amplitudes sampled at TT: Imig​\(x,z\)=∑s,rDs,r​\(T​\(x,z;xs,xr\)\)​a​\(x,z;xs,xr\)∑s,ra​\(x,z;xs,xr\)\+10−6,\\displaystyle I\_\{\\mathrm\{mig\}\}\(x,z\)=\\frac\{\\sum\_\{s,r\}D\_\{s,r\}\\\!\\left\(T\(x,z;x\_\{s\},x\_\{r\}\)\\right\)\\,a\(x,z;x\_\{s\},x\_\{r\}\)\}\{\\sum\_\{s,r\}a\(x,z;x\_\{s\},x\_\{r\}\)\+10^\{\-6\}\}, \(24\) where Ds,rD\_\{s,r\} is a modeled shot gather and aa is a geometric spreading weight\. The very shallow part of the image is tapered to suppress source and receiver artifacts\. The broad migration background is removed by subtracting a smoothed copy, leaving a wave\-propagation texture term\. To keep the section interpretable as a depth\-domain observation, the displayed image is dominated by the impedance\-contact image\. We compute vertical reflectivity from ZZ, RZ​\(y,x\)=Z​\(y\+1,x\)−Z​\(y,x\)max⁡\(Z​\(y\+1,x\)\+Z​\(y,x\),10−6\),\\displaystyle R\_\{Z\}\(y,x\)=\\frac\{Z\(y\+1,x\)\-Z\(y,x\)\}\{\\max\(Z\(y\+1,x\)\+Z\(y,x\),10^\{\-6\}\)\}, \(25\) convolve it vertically with a short Ricker wavelet, normalize it, and blend it with the high\-pass migration texture: S0=0\.12​norm⁡\(Imig−𝒢6,10∗Imig\)\+0\.88​norm⁡\(w∗yRZ\)\.\\displaystyle S\_\{0\}=0\.12\\,\\operatorname\{norm\}\(I\_\{\\mathrm\{mig\}\}\-\\mathcal\{G\}\_\{6,10\}\*I\_\{\\mathrm\{mig\}\}\)\+0\.88\\,\\operatorname\{norm\}\(w\*\_\{y\}R\_\{Z\}\)\. \(26\) Here ∗y\*\_\{y\} denotes vertical convolution\. The migration texture is suppressed in a halo around intrusions, and the intrusion body is smoothed after blending and again after display\-grid resizing\. Finally, trace\-gain variation, coherent noise, and white noise are applied: S~​\(x,y\)\\displaystyle\\tilde\{S\}\(x,y\) =S0​\(x,y\)​\(1\+σg​g~​\(x\)\)\+σc​std​\(S0\)​C~​\(x,y\)\\displaystyle=S\_\{0\}\(x,y\)\\left\(1\+\\sigma\_\{g\}\\tilde\{g\}\(x\)\\right\)\+\\sigma\_\{c\}\\,\\mathrm\{std\}\(S\_\{0\}\)\\,\\tilde\{C\}\(x,y\) \+ϵ​\(x,y\),ϵ∼𝒩​\(0,σn2​std​\(S0\)2\),\\displaystyle\\quad\+\\epsilon\(x,y\),\\qquad\\epsilon\\sim\\mathcal\{N\}\\left\(0,\\sigma\_\{n\}^\{2\}\\mathrm\{std\}\(S\_\{0\}\)^\{2\}\\right\), \(27\) where g~\\tilde\{g\} and C~\\tilde\{C\} are unit\-standard\-deviation smoothed random fields\. The grayscale image intensity is I​\(x,y\)=clip⁡\(127\.5​\[1−S~​\(x,y\)/Q98\.5​\(\|S~\|\)\],0,255\)\.\\displaystyle I\(x,y\)=\\operatorname\{clip\}\\left\(127\.5\\left\[1\-\\tilde\{S\}\(x,y\)/Q\_\{98\.5\}\(\|\\tilde\{S\}\|\)\\right\],0,255\\right\)\. \(28\) The numerical constants in Table˜8 are synthetic renderer defaults chosen to keep contact amplitudes, offsets, intrusions, and unconformities visible at the benchmark image resolution\. They are not calibrated field\-seismic or rock\-physics parameters\. Table 8: Seismic\-domain renderer parameters\. These values are the defaults in SeismicRenderConfig\. Appendix E Artifacts and Benchmark Details The repository, fixed dataset identifiers, model references, and LoRA adapter identifiers used for this paper are collected here; anonymous review access is provided for non\-public artifacts\. Table 9: Repository and dataset artifacts\. Table 10: Model and adapter artifacts\. The current held\-out test split is porestar/geo\-strat\-rl\-test, split train, containing 100 examples with seeds 11000–11099\. The pretrained\-model notes in docs/benchmarks/ record API\-service run context, and the machine\-checkable artifact manifest records the canonical API uncertainty summaries used for the main OpenRouter rows\. The GPT\-5\.5 diagram comparison is backed by the Azure OpenAI 100\-example, 3\-rollout summary; the GPT\-5\.5 seismic comparison is backed by the Azure OpenAI 100\-example, 5\-rollout seismic summary\. The canonical local base and RLVR evaluation artifacts are bundled in docs/assets/eval\_loras\_15\_06\_2026/batched\_geo\_strat\_evals\.zip; it contains per\-rollout JSON Lines \(JSONL\) rows with prompts, targets, generated responses, parsed outputs, reward components, bootstrap summaries, and uncertainty files for the 100\-example, 5\-rollout diagram and seismic\-style runs\. Bootstrap confidence intervals for any evaluation JSONL can be computed with geo\-strat\-rl\-eval\-uncertainty\. The interval calculation groups rows by example, averages all rollouts for each example, and bootstraps over example\-level means; final intervals should be recomputed after target\-schema refreshes rather than copied across schema versions\. The reported GRPO training curves are tracked in Weights & Biases and rendered in Figure˜5\. The reproduction notebook is notebooks/colab\_batched\_post\_rl\_eval\.ipynb; it evaluates the Qwen2\.5\-VL\-3B and Qwen3\-VL\-4B base checkpoints, the diagram ng16 LoRA adapters, and the Qwen3\-VL\-4B seismic ng16 LoRA adapter on both the diagram and seismic\-style domains\. All paper figure assets are regenerated by scripts/generate\_paper\_figures\.py; the optional \-\-refresh\-wandb\-history flag refreshes the cached W&B reward history used for Figure˜5\.`

Similar Articles

Reinforcing Dual-Path Reasoning in Spatial Vision Language Models

Hugging Face Daily Papers

This paper introduces SR-REAL, a unified framework for spatial vision-language models that combines linguistic deduction and 3D geometric reasoning via reinforcement learning, enabling robust multi-step spatial reasoning across diverse tasks.

Video Models Can Reason with Verifiable Rewards

Hugging Face Daily Papers

VideoRLVR optimizes video diffusion models for verifiable reasoning tasks using reinforcement learning with rule-based rewards, achieving better performance than supervised methods in constraint-satisfying video generation.