Recovering event streams and derived data
On This Lesson 4 topics
This lesson is planned. The outline below lists the topics it will cover. The full lesson has not been published yet.
In this lesson
recover Kafka and caches and rebuild stores derived from the source of truth.
Planned topics
- Identify the source of truth (the orders database) and what is derived (search index, caches, read models, analytics).
- Kafka: replicate across zones or clusters (for example mirroring); consumer offsets need translating or resetting on failover; at-least-once replay means consumers must be idempotent.
- Caches are rebuilt; protect the database from a cold-cache stampede during recovery.
- Derived stores need a tested rebuild path from the source of truth and a time estimate.
Draft outline details
Demonstration
Table: store | source or derived | recovery method | rebuild time. Rebuild path for search: replay orders table or the event log into the index.
Check your understanding
Why must consumers be idempotent after failover?
Show answer
Replays can deliver the same event again.
Practice
Apply this lesson with the module's lab, exercises and quiz.
Marking a lesson complete is optional and you can undo it any time. Your progress stays in this browser.