Demo: hosted API vs self-hosted model, three-year cost
On This Lesson 3 topics
This lesson is planned. The outline below lists the topics it will cover. The full lesson has not been published yet.
In this lesson
model the cost trade-off between hosted and self-hosted; prepares SRA-021-LAB1.
Draft outline details
Step by step
- Choose the use case, such as the support assistant, and define usage: requests per day, tokens per request, and yearly growth.
- Model the hosted option: price per unit (verify current), caching, and price-change scenarios.
- Model self-hosting: GPUs, utilization, operations staff, evaluation, upgrades, and redundancy.
- Find the break-even volume and compare control and data-handling benefits.
- Planned mistake: compare per-token price with GPU rental only. Fix: add engineers, idle capacity, redundancy, and upgrades, which move break-even sharply.
- Recommend with a trigger for revisiting and an exit plan.
Practice
Apply this lesson with the module's lab, exercises and quiz.
Marking a lesson complete is optional and you can undo it any time. Your progress stays in this browser.