BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Responsibilities
Serve as a Databricks-first data engineer, designing, building, and supporting scalable Lakehouse data pipelines (ETL/ELT) using Spark and Delta Lake.
Develop and maintain Databricks notebooks, workflows, and jobs, with secondary support for On-Premise SQL Server integrations.
Build analytics-ready data models in Databricks, supporting limited dimensional and reporting models on SQL Server as needed.
Drive data ingestion, migration, and integration between Databricks and On-Premise systems as part of platform modernization.
Collaborate with analysts, data scientists, business stakeholders, and all teams under the Data Enterprise organization (including Data Operation and MDM) to translate requirements into scalable, maintainable solutions
Optimize Spark jobs and Databricks workflows for performance, reliability, and cost efficiency.
Implement enterprise data quality checks, security best practices, and governance standards across Databricks and SQL environments.
Support production pipelines with CI/CD and automated deployment for reliable, repeatable releases.
Requirements
Bachelor's Degree in Computer Science, or a closely related field, or the equivalent
Databricks and Spark: 2–5 years of hands‑on experience with Databricks notebooks, Spark transformations, and Delta Lake for scalable
Strong Python, Scala, and SQL skills for building and maintaining data pipelines.
Exposure to automated deployment pipelines using tools such as Azure DevOps and Databricks Asset Bundles (DABs) for reliable, production-ready workflows.
Understanding of enterprise data quality checks, security practices, and governance frameworks.
Ability to work effectively with analysts, stakeholders, and cross-functional teams to troubleshoot and optimize pipelines.
Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.
Seeking a Boomi Integration Architect specializing in Data Warehouse and Master Data Hub implementations. Responsible for designing high - performance integration solutions across enterprise platforms.