Data architecture
On this page 9 topics
Overview
Topics
- Operational vs analytical workloads
- data lifecycle
Learn first
3 h of practice (estimate)
Learning outcomes
- Separate operational (transactional) and analytical workloads and explain why they need different stores.
- Describe the data lifecycle (creation, use, sharing, archiving, deletion) for each major data set.
- Choose between a data warehouse, a data lake, and a lakehouse for a reporting need.
- Produce a conceptual data model and a data-flow view for a solution.
Lessons
Lab and exercises
Lab
ARC-023-LAB1 · Larkspur data architecture
Outcomes: 1–4 · Time: ~3 h
- List every Larkspur data set from the case brief and interview notes.
- Draw the conceptual data model and mark one system of record per entity.
- Draw the data-flow view from stores and web to ERP, CRM, platform, and reporting; label each arrow with data set and trigger.
- Choose warehouse, lake, or lakehouse for the three reporting needs and justify.
- Fill the lifecycle table: stages, retention with its source, copies, deletion trigger.
- Defend the view to a role-played head of reporting.
Acceptance: every data set has one system of record and a defined retention.
Exercises (case-based; six exercises)
| ID | Outcome | Task |
|---|---|---|
| ARC-023-EX01 | 1 | The store-ops lead runs a nightly stock report on the production order database and checkout slows at 02:00. Write a half-page note explaining the cause and the target design. |
| ARC-023-EX02 | 2 | For "customer profile", fill a five-stage lifecycle with retention, copies, and deletion trigger. |
| ARC-023-EX03 | 3 | Choose warehouse, lake, or lakehouse for: finance daily sales, store camera footfall counts, demand-forecast training. Justify each in two lines. |
| ARC-023-EX04 | 4 | Draw a conceptual model for returns (Customer, Order, ReturnRequest, Refund, Product) and mark systems of record. |
| ARC-023-EX05 | 1, 4 | Two systems both claim to own product prices. Propose the system of record, the flow, and what the other system may do. |
| ARC-023-EX06 | 2, 3 | Review a data architecture with no deletion stage and a lake holding copies of customer files; give three corrections. |
Show solutions
- EX01 Long scans compete with checkout for I/O and locks; move reporting to a replica or warehouse fed by change capture; keep the store report on the analytical copy.
- EX02 Create at sign-up (CRM and platform); use while the account is active; share with the delivery carrier (address only); archive after inactivity period set by policy; delete on request or at the retention end, including warehouse and backups; verify periods with legal.
- EX03 Finance: warehouse (modeled, reconciled); footfall: lake (raw, semi-structured, exploratory); forecast training: lakehouse or lake with a curated layer, depending on team skills.
- EX04 Customer, Order, ReturnRequest (platform), Refund (payment provider and ERP posting), Product (ERP); relations Order 1-many ReturnRequest, ReturnRequest 1-1 Refund.
- EX05 ERP is system of record; platform consumes prices through an interface and caches; platform may propose promotions through ERP, not edit prices locally.
- EX06 Add deletion and archive stages; list all copies with owners; apply the same retention to the lake as to the source; add classification to lake folders.
All four outcomes are also covered by the lab acceptance and the quiz.
Workplace evidence: a data architecture view you produced that guided a reporting or platform decision.
Quiz
Outcomes: O1 operational vs analytical · O2 data lifecycle · O3 warehouse, lake, lakehouse · O4 conceptual model and data flow.
A self-check for you: nothing is graded, saved or sent anywhere. Choose an answer, then check it. You can try again as often as you like.
Practical part
Data architecture review of the Larkspur lab: the reviewer checks one system of record and a defined retention for every data set. Pass: quiz at least 8/10, at least five of six exercises correct, and a lab with no data set missing an owner or retention.
Common mistakes
Reporting directly off production databases; data sets with no system of record; ignoring deletion.
Assessment
Data architecture review.
Workplace evidence
A data architecture view you produced that guided a reporting or platform decision.
Career relevance
The data section of every solution architecture pack.