Principal Data Engineer leading Azure platform designs and implementations for enterprise solutions at UBDS Group. Mentoring teams and driving high engineering standards in hybrid environments.
Responsibilities
Architect Azure-native data solutions
Write and review production-grade code
Set engineering standards and patterns
Guide teams while remaining deeply involved in delivery
Design and implement Azure-native data architectures, including:
ADLS Gen2-based lakehouse platforms
Azure Databricks and/or Microsoft Fabric solutions
Azure Synapse and Azure SQL architectures
Event-driven pipelines using Event Hub and Service Bus
Build and optimise robust data pipelines using Python, SQL, PySpark and Spark.
Lead implementation of medallion/lakehouse models in production environments.
Design hybrid batch and streaming ingestion patterns.
Implement secure-by-design principles across:
Entra ID (Azure AD), RBAC and managed identities
Private endpoints and network isolation
Encryption and key management
Develop Infrastructure as Code using Terraform and/or Bicep.
Build and maintain CI/CD pipelines using Azure DevOps or GitHub Actions.
Embed governance, lineage and metadata management using Microsoft Purview.
Integrate AI capabilities into Azure data platforms, including:
Azure ML pipelines
Azure OpenAI / RAG architectures
Production-ready ML deployment patterns
Conduct design reviews, code reviews and technical assurance across teams.
Mentor engineers and elevate Azure data engineering standards across engagements.
Requirements
Deep Azure Engineering Experience
Strong hands-on experience delivering enterprise Azure data platforms.
Advanced SQL and Python skills, including performance optimisation.
Strong experience with Azure Databricks and/or Microsoft Fabric.
Proven experience implementing Lakehouse and medallion architectures.
Experience designing and implementing streaming/event-driven architectures in Azure.
Strong understanding of Azure networking, security and governance controls.
Experience working in production environments supporting live services.
DevOps & Platform Discipline
Strong Infrastructure as Code experience (Terraform/Bicep).
CI/CD implementation for both infrastructure and data workloads.
Experience building resilient, observable and maintainable data systems.
Understanding of monitoring and alerting using Azure Monitor and Log Analytics.
Leadership & Influence
Experience acting as a technical lead or design authority.
Ability to influence architecture direction while remaining delivery-focused.
Comfortable working directly with clients and senior stakeholders.
Experience in public sector or regulated environments is highly desirable.
Benefits
**Why people choose to grow their careers at UBDS Group**
Professionals choose to grow their careers at UBDS Group for its reputation as a dynamic and forward-thinking organisation that is deeply committed to both innovation and employee development. At UBDS Group, employees are given unique opportunities to work on cutting-edge projects across a diverse range of industries, exposing them to new challenges and learning opportunities that are pivotal for professional growth. The Group’s culture emphasises continuous improvement, offering ample training programs, mentorship, and the chance to gain certifications that enhance their skills and marketability.
UBDS Group fosters a collaborative environment where creativity and innovation are encouraged, allowing employees to contribute ideas and solutions that have a tangible impact on the company and its clients. This combination of professional development, a culture of innovation, and the opportunity to make meaningful contributions makes UBDS Group an attractive place for those looking to advance their careers and be at the forefront of technological and operational excellence.
**Employee Benefits**
Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
Private medical cover for you and your spouse/partner, offered via Vitality
Discretionary bonus based on a blend of personal and company performance
Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
Google Data Architect creating and optimizing data solutions using GCP technologies. Collaborating with teams to enhance enterprise data architecture across business functions.
Azure Lead Data Engineer designing and developing ETL/ELT pipelines with Azure Data Factory and Snowflake. Collaborating with cross - functional teams in a cloud - native environment.
Data Engineer designing and maintaining the data systems for Skiffra’s AI - native orchestration platform. Collaborating closely with product and engineering teams for data integration and system design.
Data Engineer at Kyndryl designing and maintaining data pipelines using AWS and Python. Optimizing ingestion, transformation workflows, and cloud solutions for large - scale data environments.
Data Architect responsible for the integrity and reliability of Patient Services data in Life Sciences. Ensuring analytics - ready data through strategic vendor collaboration and data stewardship.
Project & Data Engineer providing operational support and data management for utility service projects in the Greater Los Angeles area. Involves invoice processing, data accuracy, and system coordination.
Senior Data Engineer developing scalable data architectures and integrating data ecosystems at Porto Bank. Ensuring data quality and effective pipeline development for various business teams.
Data Engineering Advisor designing data flow management systems to support advanced analytics at Desjardins Group. Collaborate with teams to enhance data value and transformation.
Founding Staff Data Engineer building and leading data engineering team for AI - driven art valuation platform. Establishing architecture and standards for data systems and pipelines.