autotrust/JEV-35B-NVFP4 · Hugging Face

Source: https://huggingface.co/autotrust/JEV-35B-NVFP4

https://huggingface.co/autotrust/JEV-35B-NVFP4#%F0%9F%94%B4-live-autotrustgurusearch-recommendation–search-demo-%E2%86%92-newsguruso🔴 Live: AutoTrust/GuruSearch recommendation & search demo →news.guru.so

**Try AutoTrust/GuruSearch live (new, 11 October 2026).**A recommendation and search demo in which every ranking is a calibrated System 1 decision, made in about half a second: - **Recommendation:**the latest headlines from 6 news feeds, ranked by importance. - **Search:**results from Google News, Bing News and Yahoo News re-ranked by relevance, side by side with the search engines’ own order, plus a short answer with citations.

https://huggingface.co/autotrust/JEV-35B-NVFP4#autotrustjev-35bautotrust/JEV-35B

https://huggingface.co/autotrust/JEV-35B-NVFP4#nvfp4-versionNVFP4 version

This repository isautotrust/JEV-35B with its 10,240 routed expert MLPs (40 layers × 256 experts) quantized to NVFP4. Everything else is the bf16 model unchanged: attention, linear attention, the shared expert, the routers, the vision tower, the MTP layer, the lm_head, the System 1 adapter, the decision head and the temperatures. Below the NVFP4 comparison, the rest of this card is the JEV-35B card; its tables are the bf16 results unless marked otherwise.

JEV-35B (bf16)JEV-35B-NVFP4download (weights)71.9 GB25.6 GBGPU memory for the weights (vLLM)66.5 GiB23.3 GiB(−65 %)Decision Index 0.3, public suite (our scoring with the kit)59.7559.18same top-1 answer as bf16 (308,559 Decision Index answers)—96.6 %approximate public vision score (our rebuild, 13,361 rows)72.0871.23same answer as bf16 (vision rows)—95.2 %median single-request latency, text / image (one B200)215 / 378 ms227 / 371 mscomputer use, numbered boxes + element text (60 tasks)95 %95 %computer use, numbered boxes only (60 tasks)38 %37 %robot arm, pick and place (20 scenes)75 %65 %

• **Text: −0.57 on the Decision Index.**All five areas within 1.2 skill points of bf16 (Knowledge 0.422, Language 0.628, Retrieval 0.706, Tools 0.753, Arts 0.413); the largest per-benchmark changes are Home appliance simulator −5.7, CRUXEval −4.7 and GPQA +5.4.
• Images: −0.85 on the vision rebuild, a small but real loss (paired bootstrap 95 % interval −1.5 to −0.2), mostly on CharXiv charts (−5.3).
• **Robot arm: 13 of 20 scenes against 15 of 20.**Four scenes changed outcome (3 lost, 1 gained), within noise (sign test p = 0.63); every grasped cube still reached the tray (13/13).
• **Speed:**the same latency as bf16 on one B200 for single requests; the gain is memory (one 32–48 GB GPU is enough).
• Games(seed 0, one run each, noisy): 2048 largest tile 64 (bf16 32), Snake 5 food (bf16 11), Quick, Draw! 85.9 % on finished sketches (bf16 86.3 %), chess mate-in-one 45 % (bf16 47 %), Connect Four 1 win of 6 (bf16 0).

The two videos below were recorded with this NVFP4 checkpoint; per-episode NVFP4 results are inreports/demos\-nvfp4/, the bf16 ones inreports/demos/.

**What is quantized and how.**NVFP4 is NVIDIA’s 4-bit floating-point format: FP4 E2M1 values in groups of 16 with an FP8 E4M3 scale per group and an FP32 scale per tensor. Per expert, the gate, up and down projections are quantized (gate and up share one tensor scale, as vLLM fuses them); the expert activations use static scales calibrated on 3,072 System 1 prompts. The checkpoint uses the ModelOpt NVFP4 layout (quant\_method: modelopt), so vLLM loads it without any flag. The System 1 adapter has no LoRA on the routed experts, soadapter\_vllm/is the same as for the bf16 model.

https://huggingface.co/autotrust/JEV-35B-NVFP4#deploy-the-nvfp4-version-vllmDeploy the NVFP4 version (vLLM)

hf download autotrust/JEV-35B-NVFP4 --local-dir JEV-35B-NVFP4
bash JEV-35B-NVFP4/serve.sh     # vLLM on :8000

serve\.shand the API are exactly those of JEV-35B (seeQuick start); vLLM reads the quantization fromconfig\.json/hf\_quant\_config\.json.

GPUhow NVFP4 runsB200 / B300 / GB200 (SM100)native W4A4: FlashInfer TRT-LLM NVFP4 MoE kernels (tested, B200)RTX PRO 6000, RTX 5090, DGX Spark (SM12x)native W4A4: CUTLASS / FlashInfer CUTLASS FP4 MoE kernels (not tested here)H100 / H200 / A100 (SM80–90)Marlin W4A16: weights in FP4, activations bf16 (not tested here)

https://huggingface.co/autotrust/JEV-35B-NVFP4#the-jev-35b-card-bf16-resultsThe JEV-35B card (bf16 results)

https://huggingface.co/autotrust/JEV-35B-NVFP4#a-system-1-decision-model-on-qwen35-35b-a3b-35-b-parameters-about-3-b-active-per-token-up-to-256-options-in-one-passA System 1 decision model on Qwen3.5-35B-A3B (35 B parameters, about 3 B active per token), up to 256 options in one pass

Decision Index 0.3, public suite: 59.75(our scoring with the kit), against 53.64 forautotrust/JEV-27B-VLon the board. Approximate public vision score72.08(our rebuild of the vision benchmarks; JEV-27B-VL 71.67 on the same rebuild, a tie within noise). Median single-request latency 241 ms on one B200 (JEV-27B-VL 271 ms).

Two models, two organisations.****TypeSafe Jev 1.13is the hosted, closed model made by TypeSafe AI.autotrust/JEV-35B-NVFP4is an independent open-weights model built by AutoTrust AI; it is not affiliated with, endorsed by, or a product of TypeSafe AI.

https://huggingface.co/autotrust/JEV-35B-NVFP4#decision-index-03-public-suiteDecision Index 0.3 (public suite)

public indexautotrust/JEV-35B, System 1(our run with the kit)59.75autotrust/JEV-27B-VL, System 1 (board, public part)53.64 area (skill)Knowledge & ReasoningLanguageRetrieval & ClassificationTools & AutomationArts & TasteJEV-35B0.4260.6320.7100.765****0.422JEV-27B-VL0.4140.5640.5370.7350.416 JEV-35B: all 140,178 scoreable requests of the 0.3 public suite answered (0 errors), System 1 only (thinking off), every choice read in one pass (up to 256 options), scored with the kit’sscore \-\-edition 0\.3. Our scoring, not a board entry: the board’s Full score also counts private tests (80 %), which only its maintainers run. JEV-27B-VL: the board’s public numbers for JEV-27B, whose text decisions JEV-27B-VL reproduces (see the JEV-27B-VL card).

JEV-35B is ahead in all five areas and on 24 of 37 benchmarks. Largest gains (skill points): PhishNChips +42.3, HoVer +28.3, Habermas Machine +28.1, VAST +22.8, WinoGrande +18.9, BANKING77 +18.3, iSarcasmEval +17.2, When2Call +14.9, GPQA +9.5. JEV-27B-VL is ahead on POP909-CL (+25.7), GSM8K (+18.3), ANLI (+11.4), BPoMP (+10.8), NLI4CT (+6.7) and BBH (+4.8).

https://huggingface.co/autotrust/JEV-35B-NVFP4#every-benchmarkEvery benchmark

Skill rescales the benchmark’s own metric so that chance is 0 (below chance counts as 0); ★ = gold benchmark (weight 1.2); the higher score is in bold.

Knowledge & Reasoning(area skill 0.426; JEV-27B-VL 0.414)

benchmarkJEV-35BJEV-27B-VLGPQA Diamond ★0.3600.265GSM8K (0.3 rebuild)0.3590.542ChessBench0.1270.091MuSR0.3610.402SATA-Bench0.2840.328CRUXEval0.5460.583CLadder0.4400.410HLE ★0.0000.000MMLU-Pro ★0.6420.567BBH ★0.6470.695WinoGrande ★0.8410.651 Language Understanding(area skill 0.632; JEV-27B-VL 0.564)

benchmarkJEV-35BJEV-27B-VLContractNLI0.7320.639ANLI ★0.5450.658HellaSwag ★0.9620.900ACOS0.2800.169FinEntity0.8560.755iSarcasmEval0.4260.254VAST0.5500.322NLI4CT0.6270.694RAGTruth0.6660.604 Retrieval & Classification(area skill 0.710; JEV-27B-VL 0.537)

benchmarkJEV-35BJEV-27B-VLBANKING77 ★0.9220.739CLINC150+OOS ★0.9430.845BRIGHT ★0.4210.417Amazon ESCI0.5190.430PhishNChips0.6610.238HoVer0.7610.478 Tools & Automation(area skill 0.765; JEV-27B-VL 0.735)

benchmarkJEV-35BJEV-27B-VLBFCL ★0.9500.946ToolRet0.6000.604API-Bank ★0.8560.825Home appliance simulator0.5000.523When2Call0.8630.714 Arts & Human Taste(area skill 0.422; JEV-27B-VL 0.416)

benchmarkJEV-35BJEV-27B-VLBPoMP0.7500.859Humicroedit0.2320.223POP909-CL0.1320.390cfcolor0.2560.283Habermas Machine0.4160.135New Yorker0.7440.607

https://huggingface.co/autotrust/JEV-35B-NVFP4#images-approximate-public-vision-scoreImages (approximate public vision score)

The vision benchmarks of the Decision Index are not published; this is our rebuild of their public datasets (CV-Bench, BLINK, RealWorldQA, CharXiv, InfographicVQA, Mind2Web, CORD + FUNSD, Hateful Memes, R-Bench-M, MMMU-Pro vision; Winoground not included), scored with the board’s chance correction and weights. The same rebuild gives JEV-27B-VL 71.67 against its board score of 71.53 on the same benchmarks.

approximate public vision scoreaccuracyECEJEV-35B72.0878.6 %0.050JEV-27B-VL (same rebuild)71.6778.0 %0.044 benchmarkJEV-35B skillJEV-27B-VL skillCV-Bench75.776.9BLINK55.656.7RealWorldQA68.972.2CharXiv80.780.7InfographicVQA95.095.9Mind2Web83.683.2KIE (CORD+FUNSD)98.798.6Moderation (Hateful Memes)47.738.0R-Bench-M28.130.3MMMU-Pro vision43.539.2 Overall the two models are level: the difference (+0.4) is inside the noise (paired bootstrap 95% interval −0.7 to +1.6). Only two per-benchmark differences are statistically significant (paired McNemar test, p < 0.01), both in favour of JEV-35B: moderation (+9.6) and MMMU-Pro (+4.3). The small deficits on RealWorldQA, CV-Bench, BLINK, InfographicVQA and R-Bench-M (−1 to −3) are not significant. The vision tower is Qwen3.5-35B-A3B’s, unchanged; image decisions are zero-shot.

https://huggingface.co/autotrust/JEV-35B-NVFP4#speedSpeed

One sequential client, the same 587 rows (387 text rows sampled across the Decision Index, 200 image rows), POST /v1/decide onserve\.sh(vLLM, System 1 as a LoRA), one B200:

median (p95)textimageallJEV-35B215 ms (415)378 ms (784)241 ms (682)JEV-27B-VL (same benchmark)207 ms (617)457 ms (910)271 ms (746)

https://huggingface.co/autotrust/JEV-35B-NVFP4#computer-use-robot-arm-and-gamesComputer use, robot arm and games

Same demo code, seeds, scenes and opponents as theJEV-27B-VL card; every step is one System 1 decision (POST /v1/decide, thinking off), one model on one B200.

**Computer use: screenshot → which element to click.**A real browser (headless Chromium). Every clickable element gets a numbered box; System 1 picks the next click (or “the task is complete”), the browser clicks it, and the loop repeats.

Robot arm: pick and place from a camera image(MuJoCo). At every step System 1 answers two questions from the top camera: is the target left or right of the gripper, and above or below it? The arm halves its step whenever an answer flips.

JEV-35BJEV-27B-VLComputer use, numbered boxes + element text (60 tasks: shop, settings, mail)95%95%Computer use, numbered boxes only (60 tasks)**38%**10%ms per click decision, median (6 browsers in parallel)397720Robot arm, binary-decision servo (20 scenes): pick-and-place success75%75%Robot arm: median distance from the cube centre when grasping2.5 cm2.7 cmRobot arm: placed in the tray, once grasped15/1515/15Robot arm: ms per decision, median239239Robot arm, direct choice among 8 motor actions (10 scenes)0%0%

• Computer use with element text: 95%, the same three failures as JEV-27B-VL(shop seeds 12, 15, 20: the colour swatch carries no text and is skipped).
• **Numbered boxes only (every element read from pixels): 38% against 10%.**JEV-35B completes 90% of the settings tasks but only 15% of mail and 10% of shop; most failures still declare the task complete too early (24 of 37).
• **Robot arm: same success rate, different scenes.**Each model misses 5 of 20 grasps (both miss scenes 4 and 19), every miss 3 cm or more off the cube centre; once grasped, every cube reaches the tray.
• Choosing directly among 8 motor commands fails for both models; decompose control into simple visual questions.

Games(seed 0 for both models; board as image + text):

gameJEV-35BJEV-27B-VL2048: score / largest tile336 / 322,080 / 128Connect Four against a rule-based opponent (6 games)0 wins, 6 losses0 wins, 6 lossesFlappy Bird: pipes passed03Snake: food eaten1121Quick, Draw! top-1 among 16 (320 sketches; 30% / 60% / 100% of strokes)35.0 / 57.5 / 86.3%**41.6 / 62.2 / 87.8%**Chess mate in one, choice among 16 moves (200 Lichess puzzles)47.0%52.0% **For game play, use JEV-27B-VL.**Over five seeds JEV-35B’s largest 2048 tile averages 64 (random play: 102), it passes no Flappy Bird pipe and eats 3–18 pieces of food in Snake (mean 10). Per-episode results:reports/demos/.

https://huggingface.co/autotrust/JEV-35B-NVFP4#quick-start-vllmQuick start (vLLM)

hf download autotrust/JEV-35B-NVFP4 --local-dir JEV-35B-NVFP4
bash JEV-35B-NVFP4/serve.sh    # vLLM on :8000; one GPU with 32 GB or more

serve\.shrunsserve\_decide\.py: the standard vLLM OpenAI server (same flags asvllm serve) with aPOST /v1/decideroute. Plain requests are System 2; requests for the LoRA modulejev\-decision(adapter\_vllm/: backbone LoRA + the decision head as anlm\_headLoRA) are System 1. Tested with a vLLM development build from September 2026.

The adapter has no LoRA on the routed experts.serve\.shsetsJEV\_DECIDE\_NO\_MOE\_LORA=1and\-\-lora\-target\-modulesso that the routed experts run on vLLM’s normal MoE kernels (the decision head needs\-\-max\-lora\-rank 320; vLLM’s MoE-LoRA kernel supports at most rank 128).

https://huggingface.co/autotrust/JEV-35B-NVFP4#system-1-post-v1decideSystem 1:POST /v1/decide

curl localhost:8000/v1/decide -H 'Content-Type: application/json' -d '{
  "kind": "choice",
  "state": "Customer message: my card was charged twice for the same order.",
  "question": "Which team should handle this ticket?",
  "options": ["billing", "shipping", "technical support", "account security"]}'

fieldvaluekind``noul: yes/no, probabilities for\["false", "true"\]·score: 0–5 ·choice: youroptions``statewhat the decision is about: a string, a JSON object, or a list mixing text and imagesquestionone question about the stateoptions``choiceonly: 2–256 stringsthinking``"off"(default) The response hasoptions,probabilities,choice,choice\_indexandusage.GET /v1/decide/infolists the defaults.

https://huggingface.co/autotrust/JEV-35B-NVFP4#system-2System 2

import requests
requests.post("http://localhost:8000/v1/chat/completions", json={
    "model": "autotrust/JEV-35B-NVFP4",
    "messages": [{"role": "user", "content": "In one sentence, what is safety stock?"}],
    "max_tokens": 200})

If you call/v1/completionsfor System 1 yourself, passtop\_k: 0andtop\_p: 1\.0so that the returned probabilities are not truncated.

https://huggingface.co/autotrust/JEV-35B-NVFP4#engine-and-read-outEngine and read-out

System 1 reads the hidden state at the last token of a bare-text prompt:

[kind] choice
[state] ...
[question] ...
[options]
A) ...
B) ...
[decision]:

A 264-slot linear head (fp32) gives one logit per slot; the active slots of the question’s kind are soft-maxed with a per-kind temperature (calibration\.json). In vLLM the head is expressed as anlm\_headLoRA (adapter\_vllm/, rank 320) and the head bias is added client-side (adapter\_vllm/decision\_head\.json).

https://huggingface.co/autotrust/JEV-35B-NVFP4#limitationsLimitations

• System 1 only on this card: thinking (adaptive System 2) has not been evaluated for this model.
• Knowledge & Reasoning is the weak area (GPQA 0.360, MMLU-Pro 0.642, HLE below chance); JEV-27B-VL is better on GSM8K, ANLI and BBH.
• Weaker than JEV-27B-VL at sequential game play (2048, Flappy Bird, Snake).
• The vision score is our rebuild, not the board’s; image decisions are zero-shot.
• NVFP4: Decision Index −0.57 and vision −0.85 against bf16; only the B200 (SM100) kernels were tested.
• English-centric; not for high-stakes decisions without confidence gating.

https://huggingface.co/autotrust/JEV-35B-NVFP4#filesFiles

model-*.safetensors       Qwen/Qwen3.5-35B-A3B with NVFP4 routed experts (ModelOpt layout), everything else bf16
config.json · hf_quant_config.json · nvfp4_activation_amax.json
                          quantization config and calibrated expert activation ranges
tokenizer* · chat_template.jinja · generation_config.json · *_config.json
adapter/                  System 1 LoRA (peft), rank 32
head.safetensors          264-slot decision head (fp32)
judge_config.json         slot layout, verbalizer ids, read-out
calibration.json          per-kind temperatures
adapter_vllm/             System 1 for vLLM: backbone LoRA + the head as an lm_head LoRA (rank 320), plus decision_head.json
serve_decide.py · serve.sh
                          vLLM server with POST /v1/decide next to the OpenAI endpoints
videos/                   computer-use and robot-arm episodes
reports/demos/            per-episode computer-use, robot-arm and game results (bf16)
reports/demos-nvfp4/      the same for this NVFP4 checkpoint

https://huggingface.co/autotrust/JEV-35B-NVFP4#licenseLicense

Apache-2.0. This repository contains the weights ofQwen/Qwen3.5-35B-A3B(Apache-2.0), with the routed experts quantized to NVFP4, plus the System 1 adapter, decision head and calibration ofautotrust/JEV-35B.