Data Engineering Professional at BT Group enabling data-driven decision making through scalable data solutions. Responsible for development, testing, and deployment of ETL/ELT pipelines.
Responsibilities
Deliver the development, testing, and deployment of ETL/ELT data pipelines for ingesting, transforming, and curating data, ensuring adherence to data security and privacy standards.
Contribute to designing and enhancing data warehouse architecture and reusable engineering patterns for processing and storing large scale structured and unstructured datasets.
Support major engineering initiatives by shaping technical approaches and contributing innovative solutions to complex or ambiguous problems.
Produce business relevant, high quality data outputs that strengthen the organisation’s data assets and overall data engineering capability.
Apply engineering best practices and Agile delivery methodologies to ensure consistent, high quality, and iterative delivery of data engineering solutions.
Execute initiatives to build and improve data and analytics infrastructure, enabling scalable and reusable data engineering capabilities.
Identify and implement improvements to data engineering processes by analysing data, optimising workflows, and driving efficiency gains.
Conduct thorough quality assurance and testing of data pipelines, models, and engineering frameworks to ensure accuracy, reliability, and fitness for business use.
Requirements
Handson experience with key Google Cloud Platform services such as BigQuery, Cloud Storage, Cloud Composer, Dataflow, and Pub/Sub
Proficiency in SQL, including writing complex queries, optimizing performance, handling large datasets, and implementing data validation and quality checks across analytical platforms
Experience in designing and implementing Data Warehouse solutions across different platforms, including schema design, ETL/ELT patterns and performance tuning
Experience in Python for building data pipelines and automation using cloud services, APIs, and SDKs, with an understanding of modular coding, error handling, and reusable components
Experience with Terraform for infrastructure as code; willingness and ability to learn quickly is essential.
Understanding of DevOps principles with hands-on experience in version control, CI/CD pipelines, automation, and defect management
Mandatory experience with GitLab for code management and deployments
Working knowledge of Agile delivery practices and tools such as Jira and Confluence, with the ability to collaborate in fast paced, iterative development cycles.
Strong analytical and communication skills, with the ability to interpret complex data and present insights in clear, user friendly formats for technical and nontechnical stakeholders.
Experience managing deadlines and delivering high quality work under pressure in dynamic and fastmoving environments.
Experience creating processes and documentation, including developing standard operating procedures, architectural diagrams, and technical documentation.
Ability to work effectively with multiple stakeholders, collaborating across engineering, product, business, and operations teams to drive aligned outcomes.
Experience in data quality frameworks, including implementing data validation, monitoring, and continuous improvement techniques.
Familiarity with incident and service management tools such as ServiceNow for handling production issues, change management, and operational workflows.
Data Engineer building scalable data platforms using Databricks and Azure for Reconomy. Collaborating across teams to deliver high - quality data solutions.
Senior Data Engineer developing scalable data solutions for SimplePractice. Collaborating across teams for data - driven insights and efficient business operations.
Engineer building and operating data systems for Spotify's marketing initiatives. Contributing to data pipelines and integrations supporting global campaigns like Wrapped.
Junior Data Architect role supporting data architecture design and delivery at Solirius Reply. Involves working with clients on scalable and secure data solutions.
Data Engineer building and maintaining data pipelines for Statista, a leading data platform. Collaborating with teams on data infrastructure and optimizing publishing processes.
Marketing Data Engineer owning technical setup for marketing measurement and supporting data initiatives. Collaborating across multiple departments to ensure reliable tracking and conversion implementation.
Team Lead overseeing Product Data Architecture for a specialized team in Product Data Development. Collaborating with Software Development and Product Management to establish data standards.
Data Engineer responsible for analyzing business data and translating it into technical requirements. Designing and implementing data products in Finance Domain with minimal guidance.
Data Engineer at Ekimetrics responsible for designing and industrializing data pipelines. Develop modern data solutions while deepening knowledge in Data Engineering and Data Science.
Data Engineer developing and maintaining data infrastructure for analytics at OAG. Collaborating with teams to ensure high data reliability and performance across platforms in the travel industry.