Senior Data Engineer developing and maintaining data solutions while ensuring data governance for the organization. Collaborating with teams using Microsoft Azure technologies in a hybrid work environment.
Responsibilities
Own, design, develop and maintain LCCCs data platform ensuring reliable data across the organisation
Extensive hands‑on experience designing and delivering scalable, resilient cloud‑based data lake platforms using modern lakehouse architectures
Drive better data governance through the creation and embedding of principles and processes
Build and maintain key data governance and management artefacts e.g., Flow Diagram, Data Dictionary, KPI Catalogue
Define overall approach and data flow for Extract, Transform and Load; and application of this for a given deployment/project
Identify patterns, anomalies, and structure of data in preparation for Extract Transformation and Load
Design and implement data pipelines and processes based on business requirements
Write ETL data validation and data reconciliation queries
Define high level and low-level design of a data platform to ensure robustness e.g., restorability, traceability, ease to support, etc.
Define, embed, and drive data management and governance approaches, principles, and processes
Identify data quality issues through data profiling, analysis, and stakeholder engagement
Design and maintain the Microsoft Azure modern Datawarehouse architecture, implementation, administration, and support
Translate complex business requirements into clear, scalable technical designs and delivery plans, ensuring alignment between stakeholder outcomes and engineering execution
Requirements
Extensive experience in Cloud (preferably Microsoft Azure) Datawarehouse architecture as well as cloud data lakehouse platforms
Experience of ETL and ELT processes, working with database architecture
Able to develop and optimise coding in SQL and python
Experience in creating data pipelines using Cloud (preferably Azure Data Factory)
Experience with Cloud: ADLS, Databricks, SQL DW, Serverless Architecture
Experience in CI/CD pipelines and monitoring
Able to work with large datasets and extrapolate conclusions
Strong analytical and critical thinking abilities
Highly desirable: Experience in building and maintaining reliable and scalable ETL on big data platforms as well as experience working with varied forms of data infrastructure
Data Engineering experience in Microsoft stack
Benefits
Annual performance based bonus, up to 10%
25 days annual leave, plus eight bank holidays
Up to 8% pension contribution
Financial support and time off for study relevant to your role, plus a professional membership subscription
Employee referral scheme (up to £1500), and colleague recognition scheme
Family friendly policies, including enhanced maternity leave and shared parental leave
Free, confidential employee assistance, including financial management, family care, mental health, and on-call GP service
Three paid volunteering days a year
Season ticket loan and cycle to work schemes
Family savings on days out and English Heritage, gym discounts, cash back and discounts at selected retailers
Data & AI Engineer at Decathlon Colombia designing and optimizing data ecosystems. Involves building data pipelines and deploying machine learning models.
Senior hands - on engineering lead at Electric Mind focusing on data platforms, AI, and analytics. Collaborating with teams on complex, mission - critical transformations in technology solutions.
AI Data Engineer (Azure + Copilot Studio) developing data pipelines and AI agent solutions. Involves working with Azure Data Factory, Copilot Studio, and data integration in a hybrid role.
Senior Data Engineer in Porto Bank developing and managing scalable data architectures and systems. Focused on integrating diverse data solutions while identifying and managing risks.
Data Engineer developing scalable data architectures supporting analytics and ML at Porto Bank. Ensuring quality and efficient data integration while managing risks and standards.
Engineer of Data designing and architecting data for educational intelligence. Collaborating on data analytics and visualization in business decision - making processes.
Senior Data Engineer building data pipelines and analytics solutions in a healthcare - focused R&D environment. Collaborating with cross - functional teams to support AI and scientific advancement.
Lead Data Engineer building reliable data infrastructure at Eve, a legal technology company. Architecting data systems to enable data - driven decision making for law firms.
Senior Data Engineer designing and delivering scalable data pipelines and high performance analytical solutions on Google Cloud. Enhance data quality via KPIs and migrate data platforms to cloud - native ecosystems.
As a Mid/Senior Data Engineer at Cloud++, work on designing robust ETL/ELT pipelines and data models, enabling data - driven decision - making with cloud technologies.