Manager overseeing HR technology and data architecture operations enabling HR strategy effectiveness at Healthfirst. Leading a team of analysts for data integrity and operational support across systems.
About the role
- Senior Data Engineer enhancing data infrastructure using Databricks and GCP. Managing data pipelines and collaboration with data scientists for innovative solutions.
Responsibilities
- Design and implement robust data pipelines using Databricks and integrate these with Delta Lake for efficient data storage and management.
- Manage end-to-end data workflows from ingestion to insights, utilizing FiveTran for seamless data integration and GCP for scalable cloud solutions.
- Administer Databricks environments, ensuring optimal configuration, security, and performance across all data operations.
- Utilize Unity Catalog to manage data governance across all Databricks workspaces, ensuring compliance with data privacy and security policies.
- Develop and maintain scalable and efficient data models and architecture, supporting the strategic goals of the organization.
- Collaborate with data scientists and analysts to deploy machine learning models and complex analytical projects.
Requirements
- Bachelor’s degree in computer science, engineering, information technology or related field or four (4) years of relevant experience in lieu of degree.
- Minimum of five (5) years of experience [nine (9) years for non-degreed candidates] in a data engineering role with significant exposure to Databricks, Delta Lake, and cloud platforms like GCP.
- Proven expertise in Databricks administration and managing large-scale data environments.
- Strong experience with SQL, Python, and other scripting languages commonly used in data engineering.
- Familiarity with Fivetran or similar data integration tools and understanding of ETL processes.
Benefits
- Health insurance
- Professional development opportunities
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Distinguished Data Engineer in data pipelines driving innovation in AWS. A hands - on technical leader delivering next - gen data solutions across Capital One's lines of business.
Product Manager for Capital One enhancing financial experiences and optimizing product development with technology. Collaborating with cross - functional teams and leading initiatives for the Core Data Platform Services.
Sr. Lead Data Engineer at Capital One responsible for delivering data solutions and mentoring teams. Engage in collaborative Agile practices and drive powerful experiences for financial empowerment.
Senior Data Engineer at EDO building data pipelines for advertising effectiveness measurement. Collaborating with Data Scientists using AWS, Airflow, DBT, and Snowflake on large data sets.
Data Engineer transforming data into actionable insights at InnoWave. Designing data pipelines and collaborating between technical teams and business stakeholders in Lisbon.
Data Engineer developing and maintaining infrastructure for analytics at Waitwhile. Responsible for data lifecycle management, API availability, and AI operationalization.
Data Engineer supporting, developing, and maintaining a data analytics platform with agile delivery. Working with business and IT teams to leverage data technologies effectively.
Data Engineer at Domes Resorts responsible for designing data pipelines and supporting analytics. Join E - Commerce, Intelligence & Innovation team to drive business growth through data solutions.
VP Enterprise Data Architect managing scalable data solutions and architecture for Pacific Life. Leading teams and advancing AI - first data ecosystem.