Senior Data Engineer designing and scaling data foundations for AI adoption across Ad Tech. Collaborating with cross - functional teams to deliver robust pipelines for high - profile AI applications.
About the role
- Data Engineer responsible for developing scalable ETL pipelines for MENA mobility solution provider. Driving data-driven decisions and managing complex integrations in fast-paced environment.
Responsibilities
- Design, implement, and maintain ETL/ELT pipelines using AWS and custom scripts.
- Ensure robust data syncing between DWH and data sources.
- Develop and maintain scrapers of websites and mobile applications.
- Set up alerts and monitoring for data anomalies (e.g. missing data, syncing issues).
- Implement data quality assurance and validation frameworks.
- Improve query and system performance, including optimization of Redshift clusters, table vacuuming, and scheduling batch jobs.
- Work closely with DevOps for data flow integration across environments.
- Transition legacy ETLs to modern platforms and ensure scheduled exports run reliably.
- Eliminate redundant procedures and replace outdated solutions.
Requirements
- 3+ years of proven experience as a Data Engineer
- Excellent programming skills in Python and SQL.
- Hands-on experience with AWS (DMS, Redshift, S3, Glue).
- Familiarity with data scraping techniques and frameworks.
- Strong understanding of data warehousing concepts and performance tuning.
- Experience with data migration.
- Knowledge of DevOps practices and working in Agile environments.
- Ability to work independently and collaboratively in a fast-paced environment.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Specialist in Data Engineering leading pipeline optimization at Inmetrics. Collaborating in innovative data - driven projects within a hybrid work environment.
Data Architect responsible for designing and implementing data architecture at Stefanini. Collaborate with technical teams and stakeholders in a hybrid work environment.
Senior Data Engineer at Reos responsible for scalable ETL pipelines using Microsoft Fabric. Focused on data integration from various sources and data modeling processes.
Junior Data Engineer developing and maintaining data pipelines for AI - powered identity platform at Saviynt. Collaborating with senior engineers, analysts, and BI developers to ensure reliable data for decision - making.
Strategic technical leader architecting data landscape for Sales and Trade at Conagra Brands. Designing scalable solutions and enhancing data integration across enterprise platforms.
Consultant - Data Engineering Specialist supporting public health surveillance data ecosystem. Focused on automated data integrations and ensuring data flows securely across systems.
Data Engineer developing and maintaining data pipelines for SkyShowtime's streaming data ecosystem. Collaborating with teams to facilitate analysis and operationalise data processing systems.
Tech Lead Data Engineering overseeing data engineering, ETL processes, and cloud technologies. Leading project delivery with strong hands - on experience in Informatica, Python, and GCP.
Data Engineer developing and maintaining data infrastructure for healthcare solutions in Portugal. Working with Oracle databases and Pentaho ETL pipelines in a flexible hybrid model.