图表
·
工作室
高层架构图
← 返回画廊
画廊
/
数据平台
/
高层架构图
数据平台
模板
高层架构图
容器集群上的端到端数据栈。
极简浅色 · 极简深色 · 完整编辑版
极简浅色
极简深色
完整编辑版
新标签页打开
下载
相关图表
全部数据平台 →
MASK IDS
CLEAN + JOIN
AGGREGATE
LIFECYCLE
Raw
raw-commerce
Tool
NiFi ingest
Format
JSON · Parquet
Writer
Data Engineer
E-COMMERCE EXAMPLE
clickstream events
order records
Anonymized
anon-commerce
Tool
Trino SQL
Format
Iceberg · partitioned
Writer
Data Engineer
E-COMMERCE EXAMPLE
session pseudonyms
masked customer IDs
Staging
staging-commerce
Tool
Trino · notebooks
Format
Iceberg · cleaned
Writer
Data Scientist
E-COMMERCE EXAMPLE
joined order facts
validated event rows
Aggregated
analytics-marts
Tool
Trino INSERT
Format
Iceberg · metrics
Writer
Data Scientist
E-COMMERCE EXAMPLE
daily conversion rate
revenue by channel
Archive
archive-commerce
Tool
Object storage lifecycle
Format
Cold tier · immutable
Writer
Data Engineer
E-COMMERCE EXAMPLE
retained clickstream
closed order snapshots
SQL PATH
Trino INSERT INTO … SELECT
filter · join · aggregate — repeatable transforms
NOTEBOOK PATH
Python notebooks on object storage
explore · validate · model — interactive analysis
medallion
奖章架构图
REST
CSV
EVENTS
READ
JDBC
KERNEL
HTTPS
AUTH
AUTH
DATA PLATFORM
CRM
customer records
POS exports
daily CSV batches
Event stream
near-real-time events
DAG
Orchestrator
schedules · retries · lineage
STORE
Object storage
versioned data objects
SQL
Query engine
federated SQL access
BI tool
dashboards · reports
Notebooks
Python · exploration
Partner API
scoped data products
Identity provider
SSO · service identities · policy groups
Centralized logging
platform events · audit trail · retention
TYPE KEY
Source / consumer
Focal platform surface
Orchestration
Primary data path
Layer-wide service
dp-integration
数据平台集成图
Component
vs. AD group
Data Engineer
GRP-DATA-ENG
Data Scientist
GRP-DATA-SCI
Analyst
GRP-ANALYST
Administrator
GRP-ADMIN
External Partner
GRP-PARTNER
Object storage
S3
Write
Read
None
Admin
None
Query engine
SQL
Write
Read
Read
Admin
Read
Notebooks
PY
Write
Write
None
Admin
None
BI tool
DASH
Write
Read
Write
Admin
Read
shared dashboards
Orchestrator
DAG
Write
Read
None
Admin
None
LEGEND
Admin
Write
Read
None
partner read boundary
dp-security-matrix
数据平台安全矩阵