Shuffle sharding
On This Lesson 4 topics
This lesson is planned. The outline below lists the topics it will cover. The full lesson has not been published yet.
In this lesson
reduce the chance that one bad client harms many.
Planned topics
- Each client gets a small random subset of workers; the overlap between two clients is small.
- A poison request takes down its shard, not everyone.
- Works with retries: other workers in the subset keep serving.
- Needs enough workers for subsets to differ.
Draft outline details
Demonstration
an example: 8 workers, each customer assigned 2 of them; chance two customers share both is 1 in 28; one noisy tenant degrades only a pair.
Check your understanding
Why does shuffle sharding help?
Show answer
Few other clients share the same workers.
Practice
Apply this lesson with the module's lab, exercises and quiz.
Marking a lesson complete is optional and you can undo it any time. Your progress stays in this browser.