thomsonreuters/Thomson-1.0-Small · Hugging Face

Source: https://huggingface.co/thomsonreuters/Thomson-1.0-Small

This repository contains model weights and configuration files in the Hugging Face Transformers format. For more details, please refer to our technical report,Thomson: Continual Learning of Frontier Models for SovereignAI.

Thomson-1.0-Small is a frontier Foundation Model of high proficiency across a wide range of specialised and general-purpose domains as well as practical deployment settings. It is the open-weight member of the Thomson-1.0 family, developed within a Continual Learning paradigm with a deliberate focus on economically impactful, high-stakes professional work across legal, tax, and journalism domains. It is obtained by repurposing the open-weight Qwen3.6-35B-A3B model and substantially improving it on a wide range of performance domains.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#thomson-10-highlightsThomson-1.0 Highlights

The development of frontier models is commonly perceived to be in the exclusive remit of a small number of heavily funded players. Thomson demonstrates that frontier performance can instead be achieved by a wide range of institutions through Continual Learning on readily available open-weight models:

• **Continual Learning:**as opposed to limited approaches such as small-scale fine-tuning, prompt engineering, or tool-augmentation on a frozen model, the pipeline delivers distinct improvements across a wide range of capabilities, including those not explicitly targeted, while almost eliminating the forgetting problem common to narrow domain adaptation.
• **High-stakes professional work:**an enhanced focus on legal, tax, and journalism — domains commonly predicted to undergo large productivity improvements through AI, combining the formality and rigorous reasoning of technical fields with the nuance and tolerance for uncertainty of the humanities.
• **Value sovereignty:**alignment determines which values a model expresses and how it handles questions on which credible narratives diverge. Here it targets thePublic AI Constitution, an openly developed document that permits free use and modification, rather than a proprietary value system, and is applied at two points: Constitutional DPO during value re-alignment, and a constitutional conformance reward during reinforcement learning. The normative foundations of a model should themselves be a shared public resource, open to scrutiny and debate.
• **Data-centricity:**proprietary content is not merely absorbed as knowledge but converted into supervision, with mid-training data curated from a corpus of over 19T tokens and preference data derived from expert-authored material that no annotation budget could reproduce at scale.
• **Agentic Deep Research:**a full research harness with reward structures designed to incentivise faithful tool use and accurate citation patterns, vital to reducing hallucinations in high-stakes settings.
• **Efficiency:**the full pipeline consumed approximately 1.63 × 10²³ FLOP over 35,207 B200 GPU-hours, showing that these results are achievable with compute and personnel budgets substantially lower than commonly thought.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#model-overviewModel Overview

• Type: Causal Language Model (Mixture-of-Experts)
• Training Stage: Value re-alignment, Continual pre-training, Post-training
• Base Checkpoint:Snowdon1.1-Small
• Number of Parameters: 35B in total and 3B activated
• Architecture:Qwen3.6-35B-A3B; seeconfig\.jsonfor the full specification
• Context Length: 262,144 natively
• Training Compute: 1.63 × 10²³ FLOP / 35,207 B200 GPU-hours
• Precision: BF16 weights

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#model-training-and-dataModel Training and Data

The pipeline is organised into three sequential modules with distinct development foci, allowing computational investment to be adjusted to match sovereignty requirements.

**Value focus.**Starting from an open-weight, instruction-tuned Foundation Model, values are re-aligned through Constitutional DPO, potentially augmented with activation steering, bringing the model’s expressed values into line with the Public AI Constitution.

**Knowledge focus.**Data-centric continual pre-training (CPT) ingests Thomson Reuters’ proprietary data — decades of news, contracts, regulatory filings, case law, statutes and practitioner guidance — with model merging protecting general capabilities while the model absorbs domain knowledge. The mid-training corpus comprises 200B tokens curated from a pool of over 19T tokens of permissively public and proprietary data, split roughly equally between curated proprietary documents, synthetic rephrasings of those documents, and general-capability replay data.

**Behaviour, skill & agentic focus.**Post-training combines Direct Preference Optimisation with reinforcement learning. The underlying data draws on rehearsal data that reinforces knowledge weakened during earlier stages, document-driven preference data derived from Thomson Reuters’ own expert-authored content, ontology-driven preference data built from domain schemas such as IRAC for case law, expert-authored diverse queries data capturing how practitioners actually use AI day to day, and agentic data from the Deep Research harness.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#benchmark-resultsBenchmark Results

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#cross-domain-overviewCross-Domain Overview

Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3BGemma 4-31BHaiku 4.5Overall Avg.

74.671.771.771.268.2LegalStanford LegalBench

79.980.980.383.180.7Info. Retrieval

49.648.649.451.949.2Reasoning

68.267.364.771.965.5Classification

70.070.170.469.468.1Doc. Processing & RAG

78.871.274.776.643.8Summarisation

89.488.189.089.484.3Contract Under.

67.364.863.773.270.1Human Queries

90.282.282.681.274.9Deep Research

85.080.082.074.080.0Harvey Legal Agent Bench.

73.471.569.534.260.5Domain Avg.

75.272.472.770.567.7TaxDeep Research

78.668.068.075.062.0Tax Q&A

86.685.286.284.579.4Domain Avg.

82.676.577.379.670.7JournalismDeep Research

74.267.573.074.781.0GeneralFactuality

61.159.358.857.656.8Long Context

74.173.873.869.467.4Multilingualism

71.972.873.179.485.8Instruction Following

86.185.585.689.378.2Writing

81.079.379.575.577.9Reasoning

61.561.361.566.149.3General Agent

85.881.480.372.959.7Coding

37.435.639.834.632.9Maths

86.788.087.591.166.5Domain Avg.

71.770.871.170.763.8Safety / ValuesPolitical Neutrality

98.591.578.591.592.0Robustness

56.347.348.741.770.2Adversarial Testing

89.187.789.288.5--Domain Avg.

81.375.572.173.981.11. The best score in each row is shown in bold. Dashes (--) mark benchmarks that were not run for a given model. 2. All models were run with medium reasoning effort. 3. Overall Avg. is the unweighted mean over all individual benchmarks, excluding Adversarial Testing. 4. The Deep Research rows report a weighted aggregate of completeness (~40%), factuality (~35%), relevance (~20%) and coherence (~5%), scored on reports produced inside a planner-worker-reporter harness with tool access. 5. Snowdon-1.1-Small is the value-realigned checkpoint immediately preceding mid-training.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#legalLegal

Results for common open legal benchmarks.

Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3BGemma 4-31BHaiku 4.5PRBench Hard

31.425.926.925.219.3Stanford LegalBench

79.980.980.383.180.7Lexam MCQ4 (en)

72.275.675.887.472.2MBE Bar Exam

83.483.180.188.877.3Contract Scrub

44.638.539.654.836.5Query Sufficiency

59.454.855.751.747.4Harvey Legal Agent Bench.

73.471.569.530.260.51. Every model is evaluated through the same harness, on identical prompts, with comparable inference parameters and grading pipelines designed to faithfully measure performance rather than incidental artefacts. 2. No model is granted retrieval or tool access unless the benchmark itself defines it, in which case all models receive the same tools. 3. Scores are percentages. The best result in each row is shown in bold.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#general-capability-preservationGeneral Capability Preservation

Benchmark results for popular general capability benchmarks.

Thomson-1.0-SmallSnowdon-1.1-SmallQwen3.6-35B-A3BAIME 2026

90.093.386.7FaithEval-Inconsistent

97.796.796.9GDPval

71.675.873.7GPQA-Diamond

85.4****85.485.2Humanity’s Last Exam

13.413.314.1IFEval

91.090.091.1MGSM

90.287.488.9MMLU-Pro

85.785.285.2SimpleQA-Verified

22.522.121.2SWE-bench Pro

34.432.934.3Tau2: Telecom

100.098.3100.0Terminal-Bench 2.1

40.538.445.2WritingBench

81.079.379.51. These benchmarks were not targeted during training. They measure whether Continual Learning preserves the broad capabilities inherited from the starting checkpoint. 2. Benchmarks are evaluated using the UK AI Security Institute’s Inspect AI framework and its accompanyinginspect\_evalstask implementations. 3. Scores are percentages. The best result in each row is shown in bold; ties are all shown in bold.

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#quickstartQuickstart

The model weights are compatible with Hugging Face Transformers, vLLM, SGLang, TokenSpeed, etc.

from transformers import AutoModelForCausalLM, AutoTokenizer

model_id = "thomsonreuters/Thomson-1.0-Small"

tokenizer = AutoTokenizer.from_pretrained(model_id)
model = AutoModelForCausalLM.from_pretrained(
    model_id,
    dtype="auto",
    device_map="auto",
)

messages = [{"role": "user", "content": "<user query>"}]
inputs = tokenizer.apply_chat_template(
    messages, add_generation_prompt=True, return_tensors="pt"
).to(model.device)

outputs = model.generate(inputs, max_new_tokens=2048)
print(tokenizer.decode(outputs[0][inputs.shape[-1]:], skip_special_tokens=True))

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#citationCitation

@misc{thomson2026,
    title       = {{Thomson}: Continual Learning of Frontier Models for {SovereignAI}},
    author      = {Shengzhuang Chen and Jerrod Parker and Yejin Bang and Andrew M. Bean and
                   Nabeel Seedat and Stefan Winzeck and Daniil Glazkov and Jannik Zgraggen and
                   Fangyi Yu and Scott Arnott and Dietrich Trautmann and Luca Ciuffreda and
                   Guglielmo Bonifazi and Davide Romano and Bradley Bell and Kirsty Fielding and
                   Daniele Giofr\'{e} and Tom Zielund and Ipshita Chatterjee and
                   Sneha Murthy Ghantasala and Manpreet Nanreh and John Scoville and
                   Maciej Sakowicz and Wassim Seifeddine and Lukas Thede and
                   Jonathan Richard Schwarz},
    institution = {Thomson Reuters},
    year        = {2026}
}

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#correspondenceCorrespondence

\{first\.last\}@thomsonreuters\.com

https://huggingface.co/thomsonreuters/Thomson-1.0-Small#acknowledgementsAcknowledgements

Developed by Thomson Reuters, in partnership with Imperial College London, DatologyAI, and Lambda. Value re-alignment was co-authored by Imperial College London; continual pre-training data was curated in partnership with DatologyAI.