Senior Data Engineer for the MDM Data Product Team at Avenga. Responsible for provisioning data from master data customer and product systems.
About the role
- Data Engineer with Sanford Health implementing and managing data pipelines. Collaborating cross-functionally to ensure data quality and performance across health systems.
Responsibilities
- Assemble and manage large, complex datasets that meet both non-functional and functional business requirements.
- Identify, design, and implement internal process improvements to enhance scalability, optimize data delivery, and automate manual processes.
- Build and maintain optimal data pipeline architecture for efficient extraction, transformation, and loading of data from various sources.
- Provide technical expertise and support for data-related issues.
- Partner with data and analytics experts to enhance functionality and performance of data systems.
- Design and deploy frameworks and microservices to serve data assets to data consumers.
- Performs root cause analysis on data and processes to identify opportunities for improvement.
- Act as a trusted advisor and partner to business leads, understanding their needs, interpreting data drivers, and aligning data strategies with business goals.
- Evaluate customer requirements and contribute to the development of structural necessities within the data architecture.
- Ensure database implementation procedures comply with relevant regulations.
- Organize data within cloud storage and implement appropriate security measures.
- Collaborate cross-functionally with multiple teams within the organization.
- Works independently and collaboratively in a team environment.
- Excellent analytical and problem-solving abilities.
- Strong attention to detail to ensure accuracy and predictability of data pipelines.
- Effectively communicates with engineers, product managers, and analysts to understand data needs.
- Commitment to building secure, resilient, and fault-tolerant architectures with clear documentation and support procedures.
Requirements
- Bachelor’s degree required in data engineering, data analytics, computer engineering, or a related field.
- Minimum of 3 years’ experience in data engineering or database analytics.
- Must have strong programming skills in Python, Scala, and SQL.
- Advanced SQL knowledge and experience working with relational databases.
- Prior work with various data management technologies such as RedShift, Postgres, or Snowflake is preferred.
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Data Engineer Manager leading robust data solutions for PwC's clients. Transforming raw data into actionable insights and coaching team members.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.