Data Engineer role at Qodea, a leading cloud consultancy. Designing and maintaining scalable data pipelines using cloud platforms.
Responsibilities
How You’ll Shape Our SuccessThe purpose of this role is to design, build, and maintain scalable data pipelines and infrastructure that enable the efficient processing and analysis of large, complex data sets.
What You’ll Do*Develop and maintain automated data processing pipelines using Google Cloud:*
Design, build, and maintain data pipelines to support data ingestion, ETL, and storage
Build and maintain automated data pipelines to monitor data quality and troubleshoot issues
*Implement and maintain databases and data storage solutions:*
Stay up-to-date with emerging trends and technologies in big data and data engineering
Ensure data quality, accuracy, and completeness
*Implement and enforce data governance policies and procedures to ensure data quality and accuracy:*
Collaborate with data scientists and analysts to design and optimise data models for analytical and reporting purposes
Develop and maintain data models to support analytics and reporting
Monitor and maintain data infrastructure to ensure availability and performance
Requirements
What You’ll Need to Succeed
Experience with cloud platforms such as Amazon Web Services (AWS) or Google Cloud Platform (GCP).
Proficiency in SQL and experience with relational databases such as MySQL, PostgreSQL, or Oracle.
Experience with big data technologies such as Hadoop, Spark, or Hive.
Familiarity with data warehousing and ETL tools such as Amazon Redshift, Google BigQuery, or Apache Airflow.
Proficiency in at least one programming language such as Python, Java, or Scala.
Strong analytical and problem-solving skills with the ability to work independently and in a team environment.
Benefits
**Financial:**
Competitive base salary.
Discretionary company bonus scheme.
Employee referral scheme
Meal Vouchers
**Health & Wellbeing:**
Health Care Package
Life and Health Insurance
Bookster
**Time Off & Flexibility:**
28 days of annual leave
Floating bank holidays
An extra paid day off on your birthday.
Ten paid learning days per year.
Flexible working hours
Sabbatical leave (after 5 years).
Work from anywhere (up to 3 weeks per year).
**Development & Recognition:**
Industry-recognised training & certifications.
Bonusly: employee recognition and rewards platform.
Data Engineer/Analyst maintaining and improving data infrastructure for Braiins. Collaborating with technical and business teams to ensure reliable data flows and insights.
Medior Data Engineer handling Azure migrations for a major urban mobility client. Focused on data pipeline development and ensuring platform reliability with cutting - edge technologies.
Developing ML and computer vision solutions for cutting - edge autonomous vehicle dataset pipeline at Mobileye. Collaborating across teams for data curation and advanced perception algorithms.
Data Migration Lead in a hybrid role managing data migration for a major transformation programme in the media sector. Collaborating with various teams to ensure data integrity and successful migration.
Consultant ML & DataOps at Smile integrating data science projects for major clients. Designing MLOps solutions and enhancing data governance in a collaborative environment.
Data Engineer developing and maintaining data pipelines for Coolbet’s analytical services. Working within an Agile framework to ensure data reliability and efficiency.
API Data Engineer developing innovative data - driven solutions and advancing data architecture for AI Control Tower. Building and integrating APIs and data pipelines to support organizational needs.
Journeyman Data Architect supporting Leidos' enterprise data and analytics program for the Department of War. Collaborating on solutions for data architecture, cloud environments, and governance.
Senior Software Engineer developing backend services and data infrastructure for integrated products at Booz Allen. Collaborating with a small elite team to deliver reliable and scalable services.
AWS Streaming Data Engineer developing software and systems in a fast, agile environment. Utilizing experience with real - time data ingestion and processing systems across distributed environments.