LLM كحَكَم ومحاذيره

في هذا الدرس

use a model as a grader responsibly.

الموضوعات المخطط لها

• A judge model scores answers against a rubric, scaling beyond what humans can read.
• Calibrate: have humans label a sample (for example 50), compare agreement with the judge, and adjust the rubric.
• Known biases: favors longer answers, favors its own style, can be inconsistent; use clear rubrics and fixed settings.
• Prefer deterministic checks where possible (citation present, source id matches).
• Re-calibrate when the judge model changes.