AI platform capabilities
On this page 9 topics
Overview
Topics
- Shared LLM gateway with quotas
- redaction
- cost attribution
- and routing
- shared retrieval services
- AI golden path
Learn first
4 h of practice (estimate)
Learning outcomes
- Design a shared LLM gateway: authentication, per-team quotas, redaction of sensitive data, logging, cost attribution, and model routing.
- Offer shared retrieval services (embedding, indexing, search) with clear data ownership per team.
- Build an AI golden path: template, evaluation harness, observability, and security checks pre-wired.
- Decide which AI capabilities to centralize and which to leave to product teams.
Lessons
Lab and exercises
Lab
SRB-021-LAB1 · FulfillCo LLM gateway
Outcomes: 1, 2, 3, 4 · Time: ~4 h
- Define gateway requirements from the four teams.
- Prototype auth, quotas, redaction, request logging, and cost attribution.
- Test a runaway team against another team's quota and scan logs for personal data.
- Write the AI golden path and decide what stays central versus product-owned.
Acceptance: one team's runaway usage cannot exhaust another's quota; cost per team reported; no unredacted personal data in logs.
Exercises
| ID | Outcome | Task |
|---|---|---|
| SRB-021-EX01 | 1 | List the gateway responsibilities and three non-goals. |
| SRB-021-EX02 | 1 | Design quota tiers for four teams with burst limits. |
| SRB-021-EX03 | 2 | Design a shared retrieval service with per-team data ownership and access control. |
| SRB-021-EX04 | 3 | Write redaction rules and five test inputs including tricky ones. |
| SRB-021-EX05 | 3 | Draft the AI golden path checklist. |
| SRB-021-EX06 | 4 | Decide which of six capabilities to centralize (gateway, prompt library, retrieval engine, eval harness, product prompts, UX). |
Show solutions
- EX01 Auth, quotas, redaction, logging, cost, routing; not prompts, evaluation of product quality, or business logic.
- EX02 Per-team daily token budgets, per-minute rate limits, alerts at 80%, hard stop with clear error.
- EX03 Namespaces per team, source permission filter at query time, deletion path, re-embedding.
- EX04 Email, phone, address, order number patterns; tests for formats and false positives.
- EX05 Gateway client, eval harness, observability, security checks, runbook.
- EX06 Centralize gateway, retrieval machinery, eval harness; leave product prompts and UX to teams; prompt library optional.
Workplace evidence: a shared AI capability other teams adopted.
Quiz
Outcomes: O1 gateway · O2 retrieval services · O3 AI golden path · O4 centralize or not.
A self-check for you: nothing is graded, saved or sent anywhere. Choose an answer, then check it. You can try again as often as you like.
Practical part
Platform capability review: present the gateway and golden path and defend central versus product-owned choices. Pass: 70% on the quiz and the three lab acceptance checks demonstrated.
Common mistakes
Every team holding its own provider keys; logging full prompts with customer data; centralizing prompt design that belongs to product teams.
Assessment
Platform capability review.
Workplace evidence
A shared AI capability other teams adopted.
Career relevance
AI strategy (SRA-021) and AI governance (STF-021).