About the role

Data Engineer at Yü Group Plc shaping data strategy for the energy supplier in the UK. Collaborating with cross-functional teams to leverage data for business insights.

Responsibilities

Uphold and deliver data strategy aligned with business goals and industry best practices.
Enforce data governance policies and procedures to ensure data quality, integrity, and security.
Ensure data compliance and security needs are met in system construction and access control.
Apply security measures such as RLS and Column Masking to keep the data secure to the correct parties.
Design, build, and optimise scalable data solutions using Snowflake, Azure Data Services, and DBT for data transformation and modelling.
Support the Head of Data in managing the project prioritisation, identifying any potential threats to delivery.
Optimise and validate performance and cost of data workloads within Snowflake (query tuning) and Azure environments.
Use programming language to maintain data sets, databases, tables, data lakes or data warehouses.
Implement big data tools such as Apache Spark / Kafka to automate data pipelines.
Develop connections between multiple sources of data with APIs or database connectors.
Work closely with cross-functional teams, including IT, finance, marketing, and operations, to understand their data needs and provide strategic guidance.
Collaborate with the Senior Data Engineer, Data Engineers and Data Analysts to determine design needs.
Contribute to the Key Performance Indicators (KPIs) related to data quality, analytics, and business impact.

Degree educated or 2+ years’ experience in data engineering, data system development or related roles.
Ability to build, maintain and improve upon data architecture, collection and storage systems.
Fundamental understanding of core data engineering practices, metadata and SCD application.
Proficiency in data warehousing (including the Lakehouse concept), relational databases and ETL.
Ability to build and maintain data architectures, pipelines and sets.
Working knowledge of key programming languages such with preference in machine learning.
Experience working with Apache Spark, Python, SQL and similar tools / programs.
Experience working with modern cloud solutions such as Snowflake, Databricks, Fabric preferable.
Strong knowledge of data governance, architecture, analytics, and emerging technologies.
Excellent communication skills with the ability to convey technical concepts to non-technical stakeholders.
Familiarity with regulatory requirements, especially in the of data protection and privacy.
Strong understanding of the energy industry and related data challenges or ability to adapt and learn new information effectively and efficiently.