عرض عملي: التراجع عن تغيير مطالبة أفسد إجابات الاسترداد

خطوة بخطوة

1. Show config v42 and the change in v43: a shorter prompt that drops refund-window wording.
2. Run the eval gate: refund cases fail; compare with v42 scores.
3. Planned mistake: ship v43 to a canary without the gate because the average score looked fine. Fix: add per-category thresholds so refund cases gate alone.
4. Watch the canary's escalation rate rise; abort the rollout.
5. Roll back to v42 by changing the config pointer; confirm via logged bundle IDs.
6. Add the failing cases to the eval set and write up the change.

اختبر فهمك