Made the horizontal open-source model for Jev with RLCD, and it surpasses all the Jev benchmarks. HF space, benchmark, model, repo

Reddit r/LocalLLaMA Models

Summary

The article announces the release of Laya, an open-source 421M-parameter non-autoregressive decision model trained using RLCD, which surpasses Jev benchmarks and is available for testing on Hugging Face.

Thanks for the exceptional support (https://www.reddit.com/r/LocalLLaMA/comments/1wijo3e/i_literally_built_the_jev_architecture_one_year/) and for the dozens of requests to make a generic model, run benchmarks, and create an HF space so anyone can test it. So here you go, guys. I trained an improved model on a large data corpus, its now called Laya. It is trained on a single RTX 6000 Pro (96 GB VRAM); the model architecture is a 421M-parameter non-autoregressive decision model pairing a bidirectional ModernBERT-large encoder with a scratch Transformer head that scores [MASK] option markers to resolve typed schemas in a single ~35 ms forward pass. The dataset is a 100% human-annotated corpus of over 25,000 real-world examples across intent routing, fact-checking, moderation consensus, prompt guardrails, rubric scoring, and multi-turn conversation trajectories, without synthetic data shortcuts. The RLCD(unofficial, btw) I did is a policy-gradient reinforcement learning approach that kinda optimizes decision models against strictly proper scoring rules, ensuring maximum reward is achieved only when outputting true, mathematically calibrated probabilities. NB: It can be run on low end PC as its a small 421M model, cheers HF space to try: https://huggingface.co/spaces/convaiinnovations/laya-demo GitHub Repo: https://github.com/NandhaKishorM/laya HF Repo: https://huggingface.co/convaiinnovations/laya Thank you to everyone who supported me, shared the story, gave personal DM. It will need more refinement, of course. If anyone wishes to buy me a coffee, here is the link: https://github.com/NandhaKishorM
Original Article

Similar Articles

OpenJev-RLCD: A Working RLCD Implementation

arXiv cs.AI

The paper presents OpenJev-RLCD, a working open-source implementation of Reinforcement Learning for Calibrated Decisions (RLCD) for reasoning models, using a 'calibrate, then reinforce' recipe with proper scoring rules that matches or beats SFT, RFT/STaR and GRPO with temperature scaling, especially in selective prediction (e.g., 81% of GSM8K items decided at ≤5% error versus 19% for GRPO).

Laya the open source version of Jev

Hacker News Top

Laya is an open-source, fast multilingual decision engine that offers non-autoregressive, calibrated probabilities for structured schemas, claiming to be 6-8 times faster than Jev with full openness.

A Jev-style model fine-tuned on Qwen3.5 4B

Reddit r/LocalLLaMA

The author fine-tuned Qwen3.5 4B using LoRA with public and synthetic data to create a Jev-style model, achieving improved performance and open-sourcing the model and dataset.

What Is RLCD? The Secret Behind Jev

Hacker News Top

RLCD is explained as a schema-conditioned Plackett–Luce objective that advances reward modeling from scalar rewards to pairwise preferences to multiway calibrated decisions, simplifying the understanding of Jev.