Tomas Herrera
Data Engineer · Denver, CO · tomas.herrera@example.com · linkedin.com/in/tomasherrera
Summary
Data engineer with 6 years building batch and streaming pipelines that analytics and ML teams depend on daily. Rebuilt a 30-pipeline dbt/Airflow stack feeding a 4TB Snowflake warehouse, cutting load time 65% and incidents 80%. Strong SQL (Snowflake, PostgreSQL) and Python; experienced with Spark, Kafka, and warehouse cost optimization.
Professional Experience
Senior Data Engineer · Lakeshore Commerce
Feb 2023 – Present
- Cut daily warehouse load time 65% (6.2h to 2.1h) by rebuilding 30+ legacy ETL jobs as incremental dbt models orchestrated in Airflow, feeding a 4TB Snowflake warehouse used by 120 analysts.
- Reduced pipeline incidents 80% (from ~12/month to 2) by adding 400+ dbt tests, source freshness SLAs, and alerting on every production model — data outages stopped reaching the exec dashboard.
- Cut Snowflake spend 38% ($11K/month) by right-sizing virtual warehouses, converting full-refresh models to incremental, and adding clustering keys on the 3 largest tables.
- Brought clickstream data from next-day to under 5 minutes by shipping a Kafka + Spark Structured Streaming pipeline, unlocking same-session personalization for the growth team.
Data Engineer · Beacon Freight
Jun 2020 – Jan 2023
- Enabled the company’s first self-serve analytics by building ELT from 14 operational sources (PostgreSQL, Salesforce, REST APIs) into BigQuery with Fivetran and dbt, replacing analyst CSV pulls.
- Cut a nightly Spark job’s runtime from 7h to 55min (and its cost 60%) by fixing skewed joins, partitioning by shipment date, and moving to spot instances on EMR.
- Eliminated silent data corruption in billing reports by introducing Great Expectations checks at ingestion, catching 9 upstream schema changes before they hit finance.
Projects
Open-source: dbt-freshness-monitor
- Built and maintain a 400-star dbt package that turns source freshness checks into per-table SLA dashboards; adopted in production by 5 companies.
Technical Skills
- Data platform: SQL (Snowflake, BigQuery, PostgreSQL), dbt, Airflow, Spark, Kafka, Python, data modeling (dimensional, star schema)
- Reliability & infrastructure: data quality testing (dbt tests, Great Expectations), AWS (S3, EMR, Glue, Lambda), Terraform, CI/CD (GitHub Actions), warehouse cost optimization
Certifications & Education
- B.S. Computer Science, Colorado State University — May 2020
- SnowPro Core Certification — Mar 2024