Data Engineer developing modern cloud-based data pipelines at UK Biobank for research support. Collaborating within the Data & Technology team to create clean, scalable, secure code.
Responsibilities
Contribute to the Data Engineering team, embracing good software engineering practices to develop AWS data pipelines
Participate in the secure data engineering lifecycle to ensure pipelines are designed, developed, deployed and operated securely
Undertake hands-on development of data pipelines, including planning, writing, and deploying clean, scalable, testable and secure code
Contribute to the building of CI pipelines and development of Infrastructure as Code to deploy resources to AWS deployment, test and production environments
Requirements
Knowledge of developing data pipelines with Python and SQL
Awareness of the technologies and tools involved in developing and running AWS cloud-based data pipelines
Some experience working in a software development or data engineering capacity
Willingness to learn and introduce new languages, concepts, and approaches
Senior Consultant SAP Data Migration leading projects in data migration for various clients. Collaborating with project teams to ensure successful strategy implementation and data quality management.
Data Engineering Team Lead engaging with enterprise - level organizations on data architecture using Google Cloud solutions. Leading a team of data engineers in a hybrid work model.
Senior Lead Data Engineer in Bangalore, Karnataka, India designing and building AWS data engineering solutions. Leading teams on scalable data pipelines using Spark, PySpark, and Python.
Data Engineer creating and implementing Big Data applications at Absa with business stakeholders and technology leaders. Involves ETL/ELT pipeline design, data automation, and team mentorship.
Senior Data Architect delivering, enhancing, and adopting enterprise data and analytics products for DoD organizations. Collaborating with teams to translate requirements into scalable solutions for national security outcomes.
Senior Data Engineer supporting the delivery and enhancement of enterprise data and analytics for DoD organizations. Collaborating with engineers and government partners on scalable, production - ready solutions.
Senior Data Engineer at Skillfield designing distributed data processing solutions using Apache Spark. Collaborates on cloud and on - prem solutions across enterprise levels in a hybrid work environment.
Senior Data Engineer optimizing ETL/ELT pipelines at Asahi Kasei. Evaluate programming concepts and support data science projects while ensuring solution stability in a hybrid work setup.
Data Engineer responsible for building data intelligence system for the public sector. Ensuring data ingestion, quality, correlation, and helping with analytics for decision making.
Big Data Engineer focused on architecting and deploying scalable Apache Spark environments. Working on Nebul’s sovereign AI cloud to enhance data performance and security.