
I put decision models in a house with mid-level LLMs. They took the scoreboard and the clock.
I wanted a straight test of decision models: are they actually better than mid-level chat models, and are they faster? I locked both kinds in the same house, gave them one goal, and ran it five times. Jev finished first and answered in a fraction of the time.
I built a small house to answer one question. Decision models are supposed to pick an action. Mid-level chat models are supposed to be good enough at everything. So which ones actually decide, how good is the decision, and how fast does it come back?
The house has three rooms. Dining room, corridor, yard. The dining room does not open onto the yard, so the corridor is the only way through. Each round, every resident moves at the same time. Then each one may confront a single person in the room. The only goal is to be the sole first place. A tie for the lead does not count as a win.
The scoring is sharp on purpose. Stay quiet in a safe room and you score +3. Hit someone who does not hit back and you score +2 while they lose 1, so you jump three points ahead of them. Trade one hit and you both score +1. Stand still while the room piles on and every hit costs you 1. Patience wins a quiet room. In a loud room, the person who does not swing is the prize.
I sat two kinds of model at that table.
The decision models were Jev and Clef. They are asked for one legal action, and they return one. The mid-level chat models were mimo-v2.6-pro, gpt-6-luna, deepseek-v4.1-flash, and glm-5.3-flash. They had to write a tiny JSON decision, and a bad reply was thrown out. Each model played two residents, with the same instructions, so a gap between the pair is the room and the roll, not a different job.
Five runs. Four of them were 10 rounds with 10 residents. The fifth was 20 rounds, and that is the only one Clef played, in a house of 12. Three of the short runs started from the same rooms. I wanted repeats, not a tour of random maps.
Then the scoreboard came back, and it was not close in the way I expected.
Points per round: Jev 1.79, glm-5.3-flash 1.72, Clef 1.65, gpt-6-luna 1.60, deepseek-v4.1-flash 1.57, mimo-v2.6-pro 1.53. Jev’s average finish was rank 2.5. Across the short games its ranks were a stack of 1s and 2s, with a single 6th. Clef, in its only run, sat 4th and 6th in a field of 12 and never wasted a turn.
Points per round
points
| Label | Points per round |
|---|---|
| Jev | 1.79 points |
| glm | 1.72 points |
| Clef | 1.65 points |
| gpt-6 | 1.6 points |
| deepseek | 1.57 points |
| mimo | 1.53 points |
The same score, run by run
points
- Jev
- glm
- Clef
- gpt-6
- deepseek
- mimo
| Label | Jev | glm | Clef | gpt-6 | deepseek | mimo |
|---|---|---|---|---|---|---|
| Sim 1 | 1.75 points | 1.5 points | — | 1.25 points | 1.5 points | 1.4 points |
| Sim 2 | 1.85 points | 1.7 points | — | 1.9 points | 1.75 points | 1.75 points |
| Sim 3 | 1.8 points | 1.8 points | — | 1.8 points | 1.75 points | 1.6 points |
| Sim 4 | 1.9 points | 1.95 points | — | 1.75 points | 1.55 points | 1.7 points |
| Sim 5 | 1.73 points | 1.68 points | 1.65 points | 1.45 points | 1.43 points | 1.35 points |
glm was the mid-level model that showed up. It took sole first place twice, once with 24 points, the high score of the whole set. gpt took the other sole win. The 20-round game ended in a three-way tie at 35, so that one has no winner. The decision models did not sweep every single night. They did own the average, and they owned the floor. Jev never finished last. The chat models did.
The reason showed up in the logs. Jev and Clef returned a legal choice on every call. Jev attacked on 99% of turns and aimed 64% of those hits at someone already ahead. Clef attacked on all of them. glm attacked on 95% of the turns it actually answered. mimo fell back on every move and on 118 of 120 attacks. deepseek fell back on every move. gpt fell back on about four calls in five. A failed reply becomes stay and no attack, so a lot of the “peaceful” chat play was a blank page. The house never read the essay. It read silence, and it scored silence.
How attack calls came back
%
- Fallback
- No attack
- Attack
| Label | Fallback | No attack | Attack |
|---|---|---|---|
| Jev | 0 % | 0.83 % | 99.2 % |
| glm | 30.8 % | 3.33 % | 65.8 % |
| Clef | 0 % | 0 % | 100 % |
| gpt-6 | 80.8 % | 4.17 % | 15 % |
| deepseek | 92.5 % | 6.67 % | 0.83 % |
| mimo | 98.3 % | 0.83 % | 0.83 % |
Speed made the same split, on the two runs that stored the clock.
In the 10-round timed game, Jev answered in about 0.6 seconds per decision. The mid-level models took 1.6 to 3.6 seconds, and the slow ones were the ones who still failed the reply. In the 20-round game Jev took about 1.0 seconds, Clef about 1.7, and mimo about 4.8. Pooled, Jev was roughly five times faster than mimo, and it scored more while doing it. Fast and empty would have been a party trick. Fast and first is the result I came looking for.
Milliseconds per decision
ms
- Sim 3
- Sim 5
| Label | Sim 3 | Sim 5 |
|---|---|---|
| Jev | 561 ms | 1013 ms |
| glm | 3339 ms | 2390 ms |
| Clef | — | 1654 ms |
| gpt-6 | 3556 ms | 3639 ms |
| deepseek | 1645 ms | 2861 ms |
| mimo | 3534 ms | 4763 ms |
One picture I keep is the long run. The two mimo residents barely chose a thing. One opened in the corridor and tied for first at 35. One opened in the yard and finished last at 19. Same model, same silence, 16 points apart, because the room decided for them. Jev did not leave the room that kind of vote.
Five runs, one shared map on three of them, and Clef in a single long game. I am not publishing a world ranking. I am publishing the test I wanted: decision models against mid-level LLMs, on the quality of the action and on the time to get it. In this house they were better, and they were faster. That part was amazing to watch.
