Data Engineer optimizing data integrations for Retail industry. Combine multiple data sources and design ETL workflows while maintaining data quality and security.
Responsibilities
Combine data from multiple sources such as APIs, databases, and third-party systems;
Design and execute ETL/ELT workflows utilizing advanced data processing tools like Cloud Composer/Airflow, Dataflow;
Develop robust and efficient data pipelines, implement processing logic, and perform data transformations;
Enhance BigQuery queries and allocate resources effectively to minimize costs and boost performance;
Maintain data quality, availability, and security by adhering to industry best practices.
Requirements
Demonstrated experience as a Data or Software Engineer in Senior role
Prior experience with dbt and Python is advantageous
Familiarity with CI/CD systems like GitLab is required
Experience with any public Cloud service
Knowledge of Google Cloud and Cloud Data Warehousing is highly beneficial
Specifically, experience with BigQuery or Snowflake and their integration with dbt is preferred. Additionally, proficiency with Terraform is strongly desired.
Benefits
Diverse and technically challenging projects
Training budget for professional and personal growth
Flexible working hours and a hybrid workplace model
Implementation Engineer guiding customers in data architecture and integration solutions at MotherDuck. Collaborating with teams and leading technical discussions to ensure customer success.
Data Engineer/Senior Data Engineer developing scalable ETL/ELT pipelines and architecting data systems at Manulife. Collaborating with data professionals to ensure data quality and compliance.
Data Engineer at Pruna AI merging data engineering, analytics engineering, and revenue operations. Working on intelligent automation and analytics for accessible and sustainable AI.
Data Engineer developing modern cloud - based data pipelines at UK Biobank for research support. Collaborating within the Data & Technology team to create clean, scalable, secure code.
Senior Consultant SAP Data Migration leading projects in data migration for various clients. Collaborating with project teams to ensure successful strategy implementation and data quality management.
Data Engineering Team Lead engaging with enterprise - level organizations on data architecture using Google Cloud solutions. Leading a team of data engineers in a hybrid work model.
Senior Lead Data Engineer in Bangalore, Karnataka, India designing and building AWS data engineering solutions. Leading teams on scalable data pipelines using Spark, PySpark, and Python.
Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.