Architecture · Diagram Design
High-level architecture · End-to-end stack
High-level architecture · End-to-end stack
Architecture diagram showing data sources moving through Apache NiFi and MinIO into Trino, data modeling, and Superset dashboards, with Airflow orchestration.
DATA SOURCES
INGESTION
STORAGE
TRANSFORMATION & ANALYSIS
VISUALIZATION
SOURCES
EXT
WEB
Census · Survey · Admin
EXT
FTP
Census · Business
EXT
DB Connection
CDC · SQL · API
EXT
Legacy System
Trade data
Orchestration / Workflow Automation
(Apache Airflow)
COLL
Apache NiFi
Collect · route · transform
VIRT
Trino
SQL · data virtualization
STORE
MinIO / S3
Object store · S3-API
ANLZ
Data Modeling
Notebook · Python · R
DASH
Dashboards
Superset · reports
Kubernetes
Identity Manager
(Active Directory)
LEGEND
External source · outside cluster
Kubernetes boundary
Focal component (MinIO)
Primary data path
Orchestration trigger