About the role

  • BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.

Responsibilities

  • Serve as a Databricks-first data engineer, designing, building, and supporting scalable Lakehouse data pipelines (ETL/ELT) using Spark and Delta Lake.
  • Develop and maintain Databricks notebooks, workflows, and jobs, with secondary support for On-Premise SQL Server integrations.
  • Build analytics-ready data models in Databricks, supporting limited dimensional and reporting models on SQL Server as needed.
  • Drive data ingestion, migration, and integration between Databricks and On-Premise systems as part of platform modernization.
  • Collaborate with analysts, data scientists, business stakeholders, and all teams under the Data Enterprise organization (including Data Operation and MDM) to translate requirements into scalable, maintainable solutions
  • Optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency.
  • Implement enterprise data quality checks, security best practices, and governance standards across Databricks and SQL environments.
  • Support production pipelines with CI/CD and automated deployment for reliable, repeatable releases.

Requirements

  • Bachelor's Degree in Computer Science, or a closely related field, or the equivalent
  • Databricks and Spark: 2–5 years of hands‑on experience with Databricks notebooks, Spark transformations, and Delta Lake for scalable
  • Strong Python, Scala, and SQL skills for building and maintaining data pipelines.
  • Exposure to automated deployment pipelines using tools such as Azure DevOps and Databricks Asset Bundles (DABs) for reliable, production-ready workflows.
  • Understanding of enterprise data quality checks, security practices, and governance frameworks.
  • Ability to work effectively with analysts, stakeholders, and cross-functional teams to troubleshoot and optimize pipelines.

Benefits

  • Generous healthcare on day one
  • Stock purchase plan
  • 401k
  • Tuition reimbursement
  • Fertility/adoption support
  • Free financial coaching
  • Health & wellness program and discounts
  • Professional development & training
  • Free beer!

Job title

BI Data Engineer – Level II

Job type

Experience level

JuniorMid level

Salary

$97,000 - $163,000 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job