Data products, versions and transformation lineage
Models many-input transformations and immutable output versions with rule-level quality results. Original worked design example; adapt responsibilities, thresholds and assumptions to your system.
Rendering…
What this template contains
- Diagram type
- Entity-relationship diagram
- Source
- 45 lines
Make it your own.
erDiagram
DATA_PRODUCT ||--|{ DATA_VERSION : versions
TRANSFORM_RUN ||--o{ RUN_INPUT : consumes
DATA_VERSION ||--o{ RUN_INPUT : input_to
TRANSFORM_RUN ||--|{ RUN_OUTPUT : produces
DATA_VERSION ||--o{ RUN_OUTPUT : output_of
DATA_VERSION ||--o{ QUALITY_RESULT : checked_by
QUALITY_RULE ||--o{ QUALITY_RESULT : evaluates
OWNER ||--o{ DATA_PRODUCT : accountable_for
DATA_PRODUCT {
string product_id PK
string owner_id FK
string name
}
DATA_VERSION {
string version_id PK
string product_id FK
string content_hash
}
TRANSFORM_RUN {
string run_id PK
string code_commit
}
RUN_INPUT {
string run_id FK
string version_id FK
}
RUN_OUTPUT {
string run_id FK
string version_id FK
}
QUALITY_RULE {
string rule_id PK
string definition
}
QUALITY_RESULT {
string result_id PK
string version_id FK
string rule_id FK
string status
}
OWNER {
string owner_id PK
string team
}