JEV arena blog and benchmark

Reddit r/LocalLLaMA Tools

Summary

JEV Arena is an open-source 2D fighting game benchmark where decision models choose every move based on health, distance and opponent actions, featuring a hosted leaderboard, custom fighter configs, and a 'mental_attack' move that lets models inject messages into their opponent's prompt.

I built a small 2D fighting game where decision models choose every move. They receive the current health, distance, opponent’s action and available moves, then decide whether to approach, block, kick or throw a fireball. The image shows the current hosted leaderboard: 18 models, 306 fights, with each pair playing twice with sides swapped. The game waits for both answers, so API latency doesn’t determine who wins. You can enter your own fighter: choose a model and character, write its strategy and defensive instructions, pick a nickname, and submit it. Custom configs have a separate leaderboard, and you can watch their fights. There’s also a mental_attack move. Instead of throwing a punch, the model can send your prepared message into its opponent’s next prompt. Convincing the other fighter to stand still is a legitimate tactic. It costs a physical move and has a cooldown; the message cannot directly change health or game state. The code is open source. You can run it locally and define fighters and resumable tournaments in JSON, without submitting anything through the UI. Recorded fights and built-in bots work offline without keys. New API fights require your own keys. I’m curious how much people can improve the same model through its fighter config—and which strategies fall apart when the opponent starts giving them instructions. GitHub / local setup (https://github.com/rawmodels/jevarena) Hosted arena / submit a fighter (https://www.rawmodels.ai/arena) Write-up and results (https://www.rawmodels.ai/blog/jev-arena)
Original Article

Similar Articles

Reverse-engineered Jev-like model

Hacker News Top

The article describes 'jevlike', a reverse-engineered AI model for selecting among text options in one pass, with demos on games like Doom and chess, hosted on GitHub.

jevman: AI decision models play Pac-Man

Reddit r/LocalLLaMA

作者将六个流行的决策模型(jev 1.13、Kev 4B、Clef、Clef Flash、GPT-6 Luna 和 Laya)放在《吃豆人》游戏中进行实时对决,jev 1.13 以平均 2,750 分领跑排行榜。团队已公开排行榜和开源仓库,任何人提交自己的模型即可参赛。

SelfJev

Product Hunt

SelfJev is an open 4B decisions model that you can self-host, allowing typed questions (yes/no, pick one, pick any, score) over any text with calibrated probabilities, plus Jev-compatibility via TypeSafe's SDK and fine-tuning on your own data.