Skip to content
Road to Intelligence

Judge the Judge

Build a leaderboard with a simulated LLM judge that favours the first and the longer answer. Watch a padded assistant climb to the top, then fix it with swapped orders and length control.

From Chapter 16: Evaluation, Reliability, Safety & Interpretability

Try it · toy model

Judge the Judge

Know well8 min