Demo: cutting cost per answer by routing easy questions to a smaller model
On This Lesson 3 topics
This lesson is planned. The outline below lists the topics it will cover. The full lesson has not been published yet.
In this lesson
reduce cost while holding quality; prepares SRC-021-LAB1.
Draft outline details
Step by step
- Classify a sample of questions by difficulty and measure the baseline cost and quality.
- Define a routing rule (simple classifier or rules).
- Planned mistake: judge success by cost alone. Fix: run the evaluation set before and after; one category degraded.
- Adjust the rule and add a fallback to the larger model on low confidence.
- Re-measure cost per conversation and quality.
- Document the rule, the evaluation results, and a review trigger.
Practice
Apply this lesson with the module's lab, exercises and quiz.
Marking a lesson complete is optional and you can undo it any time. Your progress stays in this browser.