Data Engineer supporting, developing, and maintaining a data analytics platform with agile delivery. Working with business and IT teams to leverage data technologies effectively.
Responsibilities
Supports, develops and maintains a data and analytics platform.
Effectively and efficiently process, store and make data available to analysts and other consumers.
Works with the Business and IT teams to understand the requirements to best leverage the technologies to enable agile data delivery at scale.
Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured).
Implements methods to continuously monitor and troubleshoot data quality and data integrity issues.
Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users.
Develops reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages.
Develops physical data models and implements data storage architectures as per design guidelines.
Analyzes complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models.
Participates in testing and troubleshooting of data pipelines.
Develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others).
Requirements
Preferred working experience in technologies like Spark with Databricks and/or Snowflake, PowerBI and deep understanding of conceptual developments in Agentic AI.
Knowledge of SQL (strong)
Python (basic for data handling)
Databricks notebooks (basic transformations)
Understanding of bronze → silver → gold architecture
Familiarity with cloud concepts and technologies in Azure
External candidate must have completed a degree from an accredited US University within the past 2 years.
External candidate must currently reside in the US.
Manager overseeing HR technology and data architecture operations enabling HR strategy effectiveness at Healthfirst. Leading a team of analysts for data integrity and operational support across systems.
Distinguished Data Engineer in data pipelines driving innovation in AWS. A hands - on technical leader delivering next - gen data solutions across Capital One's lines of business.
Product Manager for Capital One enhancing financial experiences and optimizing product development with technology. Collaborating with cross - functional teams and leading initiatives for the Core Data Platform Services.
Sr. Lead Data Engineer at Capital One responsible for delivering data solutions and mentoring teams. Engage in collaborative Agile practices and drive powerful experiences for financial empowerment.
Senior Data Engineer at EDO building data pipelines for advertising effectiveness measurement. Collaborating with Data Scientists using AWS, Airflow, DBT, and Snowflake on large data sets.
Data Engineer transforming data into actionable insights at InnoWave. Designing data pipelines and collaborating between technical teams and business stakeholders in Lisbon.
Data Engineer developing and maintaining infrastructure for analytics at Waitwhile. Responsible for data lifecycle management, API availability, and AI operationalization.
Data Engineer at Domes Resorts responsible for designing data pipelines and supporting analytics. Join E - Commerce, Intelligence & Innovation team to drive business growth through data solutions.
VP Enterprise Data Architect managing scalable data solutions and architecture for Pacific Life. Leading teams and advancing AI - first data ecosystem.
Senior Data Engineer at Red Hat designing and optimizing 데이터 솔루션 supporting sales and forecasting. Collaborating with teams and applying modern data engineering practices to ensure data quality.