Teach a Preference
Judge candidate summaries and fit a small reward model. Change the rubric and watch the ranking change.
From Chapter 10: From Base Model to Assistant
Try it · toy model
Teach a Preference
Implement12 min
Read the concepts
Judge candidate summaries and fit a small reward model. Change the rubric and watch the ranking change.
From Chapter 10: From Base Model to Assistant
Try it · toy model
Teach a Preference
Read the concepts