How It Works
Methodology
- 1The same intersection, seed, and tick horizon, so every model faces the same traffic
- 2The model dry-runs, admits, and inspects incidents through tools
- 3Balance starts at 1000. The balance at the horizon is the score, with no rescaling
- 4Under one rules version, seed, and horizon, the highest balance is the official run
- 5Scores are compared with baseline-balanced and baseline-search on that same protocol
Report dimensions
ContextAttentionTool-call accuracyAgent controlReasoningPedestrians, incidents, and aggressionStability across runsGap versus baselines
Leaderboard
Rules v16 · seed 63916 · 200 ticks · best balance on this protocol
Why some runs are off this board
- qwen-3.8-27b: only 1 comparable run(s); expected 3.
Silicon Conductor Bench @karminski
Ranks LLM intersection controllers by final balance under one seed and horizon, against balanced and search baselines. Scores from different rules versions are not mixed.
5 of 5 models
| Rank | Model | Final balance | vs Balanced | vs Search | Admitted | Incidents | Runs / stdev | Rules |
|---|---|---|---|---|---|---|---|---|
| #1 | 748.30 | +73.81 | -40.08 | 123 | 4 | 3 / σ 11.8% | v16 | |
| #2 | 740.17 | +65.69 | -48.21 | 129 | 6 | 3 / σ 3.5% | v16 | |
| #3 | 694.16 | +19.67 | -94.22 | 119 | 4 | 3 / σ 6.2% | v16 | |
| #4 | 692.70 | +18.21 | -95.68 | 150 | 7 | 3 / σ 9.1% | v16 | |
| #5 |  Qwen 3.8 27B | 557.59 | -116.90 | -230.79 | 93 | 7 | 1 / σ 0.0% | v16 |
Baseline comparison
Best run of each model: balance from tick 0 to the finish, against balanced and search
Test reports
Models with a final write-up link to the full analysis. Score-only models stay unpublished.
#1
DeepSeek Flash
Final balance748.30
Admitted vehicles123
Incidents4
View full report →
#2
DeepSeek V4 Pro
Final balance740.17
Admitted vehicles129
Incidents6
View full report →
#3
Step 5 Preview
Final balance694.16
Admitted vehicles119
Incidents4
View full report →
?
#4
Space Bunny Alpha
Final balance692.70
Admitted vehicles150
Incidents7
View full report →
#5
Qwen 3.8 27B
Final balance557.59
Admitted vehicles93
Incidents7
Report not published