Judge the Judge
Build a leaderboard with a simulated LLM judge that favours the first and the longer answer. Watch a padded assistant climb to the top, then fix it with swapped orders and length control.
From Chapter 16: Evaluation, Reliability, Safety & Interpretability
Try it · toy model
Judge the Judge
Know well8 min
Read the concepts