designing robust data architectures with optimized data pipelines on cloud data platforms.
I design data platforms that scale from raw ingestion to governed, analytics ready warehouses. My focus is architecture that's not just performant on day one, but maintainable, cost aware, and adaptable as data volume and business needs grow.
- Architecture: dimensional modeling, medallion (bronze/silver/gold) lakehouses, data mesh principles
- Pipelines: batch & streaming ELT/ETL, orchestration, CDC
- Cloud Platforms: Snowflake, Databricks
- Governance: data quality, lineage, cataloging, access control
- Engineering: IaC, CI/CD for data, testing pipelines like software
| Project | Description | Stack |
|---|---|---|
| Modern Data Warehouse on Snowflake | End to end ELT pipeline: raw ingestion, staging, dimensional star schema, with automated testing and documentation. | Snowflake, dbt, Airflow |
| Medallion Lakehouse Architecture | Bronze/Silver/Gold lakehouse on Databricks with schema enforcement, data quality checks, and incremental (CDC) processing. | Databricks, Delta Lake, PySpark |
| Real Time Streaming Pipeline | Event driven pipeline ingesting streaming data, processing with Spark Structured Streaming, and landing into a queryable sink. | Kafka, Spark Streaming, Docker |
| Cloud Data Platform as Code | Fully reproducible cloud data platform (warehouse, storage, IAM, networking) defined and deployed via IaC with CI/CD. | Terraform, AWS/Azure, GitHub Actions |
| Data Modeling Playbook | Reference repo comparing modeling approaches: 3NF, Kimball star schema, Data Vault 2.0 with the same dataset, plus decision guidance on when to use each. | SQL, dbt, ERD diagrams |
| Data Quality & Observability Framework | Framework for validating pipeline outputs, tracking data lineage, and alerting on anomalies. | Great Expectations, dbt tests, Airflow |
Feel free to reach out if you'd like to connect, share ideas, or discuss potential future collaborations. I'm always open to discussing data architecture, pipeline design or cloud data platform strategy, as well as exploring potential career opportunities as a Data Product Manager or Data Architect.
LinkedIn: kurowskakatya