Skip to content
View vitorchavernue's full-sized avatar

Block or report vitorchavernue

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
vitorchavernue/README.md

Vitor Chavernue

Senior Data Engineer & Data Analyst

LinkedIn Email Location


👋 About me

Data Engineer and Data Analyst with 15 years of experience across the whole data lifecycle: ingestion, transformation, modeling, governance and visualization.

  • 🏗️ I build data platforms from scratch in companies with little or no analytics culture, implementing medallion architecture (bronze, silver, gold), dimensional models and governed data products for BI.
  • ☁️ Hands-on with modern cloud stacks: AWS (S3, Glue, Athena), Snowflake, Azure (Data Factory, Synapse) and Databricks, including cross-cloud migrations (AWS → Snowflake on Azure) and cost optimization.
  • 📊 Expert in SQL, Python and Power BI, turning data into reliable insights for executive decision-making — including enterprise Power BI practices: PBIP/TMDL in Git, row-level security, incremental refresh and calculation groups.
  • 🔄 Data migrations between systems: source-to-target mapping, data cleaning rules, full and incremental loads and reconciliation that proves nothing was lost.
  • 📈 Statistics applied to business questions: hypothesis testing, confidence intervals, experiment design (A/B, champion vs challenger) and credit risk scoring.
  • 🤝 Delivered data projects for companies such as Itaú, JBS (Seara, Friboi, Swift), Suhai Seguradora, Samsung, Panasonic and Nestlé.
  • 🌏 Advanced English — 2 years living and working in Australia.

🛠️ Tech Stack

Languages SQL Python PySpark DAX

Cloud & Data Platforms AWS Snowflake Azure Databricks BigQuery Redshift

Data Engineering dbt Airflow Delta Lake SSIS Pentaho FastAPI Docker GitHub Actions

Analytics & Statistics pandas SciPy Spark MLlib

BI & Visualization Power BI Looker Studio Qlik Tableau SSAS

Databases (SQL & NoSQL) SQL Server PostgreSQL Oracle MongoDB DynamoDB Cassandra


🚀 Featured Projects

Project Description Stack
Fintech Credit Risk Analytics Credit risk analytics on 307k real loans and 17M credit history records: Databricks medallion pipeline, hypothesis tests on business rules, credit scorecard (AUC 0.755) and approval cutoff simulation — the score cuts defaults by 42% vs the current rules at the same approval rate Databricks · PySpark · Spark SQL · Delta Lake · MLlib · SciPy
Legacy Banking Data Migration Migration of a legacy core banking database (SQL Server) to PostgreSQL and MongoDB: source-to-target mapping and cleaning rules, full and incremental loads, reconciliation gate (every transaction compared field by field, money totals and app balances), rejected records with reasons, alerts, a FastAPI service and a Power BI cut-over dashboard (backlog burn-down, reconciliation history) — CI on real SQL Server, PostgreSQL and MongoDB containers Python · SQL Server · PostgreSQL · MongoDB · SQLAlchemy · FastAPI · Power BI · Docker
Auto Insurance Data Warehouse Restructuring of a slow legacy SQL Server for an auto insurer: ODS and star-schema data warehouse (SCD2 customer address, monthly earned premium snapshot, claim lifecycle), incremental T-SQL loads in a single transaction, a release gate that reconciles premium and claims with the legacy system to the cent, SQL Server Agent scheduling and a Power BI dashboard (loss ratio, brokers, claims and theft) — the warehouse returns exactly the legacy loss ratio report with 608× fewer reads; CI on SQL Server 2022 SQL Server · T-SQL · Columnstore · SQL Server Agent · Power BI · Python
Public Spending Data Platform AWS lakehouse migration to Snowflake: ingestion, Glue, Athena, dbt star schema with data quality tests, shadow validation (99.5% gate), monthly Airflow orchestration, cost analysis, Terraform and CI AWS S3 · Glue · Athena · Snowflake · dbt · Airflow · Terraform
E-commerce Product Analytics on BigQuery Product and marketing analytics on the real GA4 export of the Google Merchandise Store: dbt models over nested events, purchase funnel, channel conversion with confidence intervals and significance tests, weekly cohort retention, RFM segmentation and a public Looker Studio dashboard BigQuery · dbt · SQL · Python · Looker Studio · GitHub Actions
E-commerce Logistics Data Platform on Azure Delivery and freight analytics for ~100k orders: Data Factory orchestration, ADLS Gen2 medallion lake, Synapse Spark and serverless SQL, geospatial route analysis and a data quality gate Azure Data Factory · Synapse · ADLS Gen2 · PySpark
Contact Center SLA — Power BI Enterprise Power BI project for outsourced customer service (6 BPO partners, voice and WhatsApp, 1.5M contacts): PBIP/TMDL in Git, contract-based SLA measures, calculation group for time intelligence, dynamic row-level security, incremental refresh, report as code and a CI quality gate with the Tabular Object Model and 19 best-practice rules Power BI · DAX · Power Query · TMDL · Python · GitHub Actions
Data Lakehouse on Databricks End-to-end lakehouse with medallion architecture, config-driven ingestion, data quality rules and star schema Databricks · PySpark · Delta Lake · Spark SQL
Public Budget Execution Dashboard Analysis of Brazilian public spending with official government data: execution, regional distribution and KPIs Power BI · DAX · Power Query

💼 What I bring

  • Data architecture: lakehouse and data warehouse design, ODS, medallion layers, star schema
  • Pipelines & ETL: batch ingestion, orchestration, Glue/ADF/Databricks jobs, SQL-based transformations
  • Data migrations: source-to-target mapping, cleaning rules, incremental sync and reconciliation gates before cut-over
  • Data quality & governance: validation with business areas in staging, data and process testing, monitoring of daily routines
  • Cost & performance: query optimization, workload migration to pay-per-use compute
  • Advanced analytics: hypothesis testing, experiment design, credit scoring and policy simulation in money terms
  • BI & storytelling: executive dashboards and governed self-service models in Power BI (RLS, incremental refresh, calculation groups, CI checks)

Pinned Loading

  1. fintech-credit-risk-analytics fintech-credit-risk-analytics Public

    Credit risk analytics on Databricks: PySpark, Spark SQL, Delta Lake, hypothesis testing, credit scorecard and credit policy simulation

    Python

  2. public-spending-data-platform public-spending-data-platform Public

    AWS lakehouse (S3, Glue, Athena) migration to Snowflake: dbt star schema, Airflow orchestration, data quality tests, shadow validation (99.5% gate), Terraform and CI.

    Python

  3. ecommerce-logistics-azure-platform ecommerce-logistics-azure-platform Public

    Azure logistics data platform: Data Factory, ADLS Gen2, Synapse Spark and serverless SQL, medallion architecture, geospatial delivery analytics and data quality gate.

    Python

  4. contact-center-sla-powerbi contact-center-sla-powerbi Public

    Enterprise Power BI for contact center SLAs: PBIP/TMDL in Git, contract-based SLA measures, calculation group, dynamic RLS, incremental refresh, report as code and a CI quality gate with the Tabula…

    Python

  5. legacy-banking-data-migration legacy-banking-data-migration Public

    Legacy core banking migration (SQL Server) to PostgreSQL and MongoDB: mapping and cleaning rules, full and incremental loads, reconciliation gate, alerts and a FastAPI service.

    Python

  6. auto-insurance-data-warehouse auto-insurance-data-warehouse Public

    Auto insurance data warehouse on SQL Server: legacy OLTP to ODS and star schema, T-SQL incremental ETL with SCD2, columnstore, data quality gate and before/after benchmark in CI.

    Python