Senior Data Engineer
Michael Carrell
I build and govern petabyte-scale data platforms — Snowflake, dbt, Airflow, Iceberg and Kafka, all managed as code.
About
Senior Data Engineer with 7+ years building petabyte-scale data platforms across real estate, energy/GIS, retail and consulting. I lead Snowflake platform design across the Rocket family of companies, including the on-schedule migration of Redfin's ~1 PB platform to a PIFI-compliant system built in Terraform with RBAC, SSO, masking and row access policies. I also defined ingestion for a ~100 PB Iceberg data lake using Kafka and Airflow, and cut pipeline costs 75% by moving 100+ pipelines to Airflow on AWS. M.S. in Business Data Analytics.
Experience
Rocket Companies (Redfin)
Snowflake Platform Lead Feb 2026 – Present
- Led the on-schedule migration of Redfin's ~1 PB Snowflake platform, spanning 30+ teams, to a PIFI-compliant system with RBAC, SAML SSO, SCIM provisioning and AWS PrivateLink.
- Established platform data security: dynamic data masking, row access policies and network policies.
- Built the infrastructure-as-code foundation with Terraform and schemachange.
- Defined ingestion and storage for a ~100 PB data lake: Apache Iceberg fed by Kafka streaming and Airflow batch.
- Lead Snowflake platform design across the Rocket family of companies, serving 30+ business units; trained 300+ engineers and analysts.
Senior Data Engineer Aug 2023 – Feb 2026
- Migrated 100+ pipelines from Azure Data Factory and Databricks to Airflow on AWS, cutting cost by 75%.
- Built CI/CD for dbt, taking deploys from weekly to multiple times a day.
- Designed a CCPA compliance system for privacy masking across structured and unstructured data.
Data Engineer Mar 2022 – Aug 2023
- Built Python and SQL pipelines feeding Kimball models in Snowflake and dbt, integrating ad, geospatial and web-traffic data at 30M+ transactions a day.
B3 Insight
- Modeled raw GIS data into the structure behind the company's analytics platform, covering 10k+ wells across 6 states.
Blue Margin, Inc.
- Designed enterprise data warehouses and SSAS cube pipelines for consulting clients.
Spreetail
- Turned complex transactional databases into an easy-to-use, robust data warehouse.
Skills
Warehousing & Modeling
Orchestration & Platform
Data Governance
Languages & BI
Education
Contact
Open to conversations about data platform, data engineering and analytics engineering roles. The best way to reach me is email.