Architecture · Diagram Design · Parametric
High-level architecture · Vertical Orchestration + Security
High-level architecture · Vertical Orchestration + Security
Architecture diagram showing data sources moving through ingestion, storage, transformation, and visualization alongside orchestration, security, and observability.
DATA SOURCES
INGESTION
STORAGE
TRANSFORM
VISUALIZATION
ORCHESTRATION
SECURITY
OBSERVABILITY
SOURCES
EXT
PostgreSQL
CDC · SQL · API
EXT
SFTP drop
Batch · landing
EXT
Web forms
Survey · admin
EXT
Legacy system
Trade · mainframe
Orchestration / Workflow Automation
(Apache Airflow)
COLL
Apache NiFi
Collect · route · transform
VIRT
Trino
SQL · data virtualization
STORE
MinIO / S3
Object store · S3-API
ANLZ
Notebooks
Jupyter · Python · R
DASH
Superset
Dashboards · reports
Kubernetes
Identity Manager
(Keycloak · LDAP · OIDC)
Monitoring & Observability
(Prometheus · Grafana · Loki)
LEGEND
External · outside cluster
Kubernetes boundary
Focal (storage hub)
Primary path
Orchestration trigger
Query read-back