Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
About the role
- Principal Data Engineer at Qodea delivering Google Cloud data solutions to enterprise organizations. Leading projects and mentoring engineering teams to modernize infrastructure and enhance performance.
Responsibilities
- Lead client engagements and team lead on client-facing delivery projects
- Consult, design, coordinate architecture to modernise infrastructure for performance, scalability, latency, and reliability
- Identify, scope, and participate in the design and delivery of cloud data platform solutions
- Create and maintain appropriate standards and best practices around Google Cloud SQL, BigQuery, and other data technologies
- Design and execute a platform modernization approach for customers' data environments
- Document and share technical best practices/insights with engineering colleagues and the Data Engineering community
- Mentor and develop engineers within the Qodea Data Team and within our customers' engineering teams
- Act as the point of escalation with client-facing problems that need solving
Requirements
- Strong experience as a Senior / Principal Cloud Data Engineer, with a solid track record of migrating large volumes of of data through the use of cloud data services and modern tooling
- Experience working on projects within large enterprise organisations either as an internal resource or as a 3rd party consultant
- Experience in performing a technical leadership role on projects and contributing to technical decision making during in-flight projects.
- A track record of being involved in a wide range of projects with various tools and technologies, and solving a broad range of problems using your technical skills.
- Demonstrable experience of utilising strong communication and stakeholder management skills when engaging with customers
- Significant experience of coding in Python and Scala or Java
- Experience with big data processing tools such as Hadoop or Spark
- Cloud experience; GCP specifically in this case, including services such as Cloud Run, Cloud Functions, BigQuery, GCS, Secret Manager, Vertex AI etc.
- Experience with Terraform
- Prior experience in a customer-facing consultancy role would be highly desirable
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.