Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
About the role
- Data Engineer in the Telegraph Data team developing reliable and scalable data platforms. Collaborating with cross-functional teams to optimise business processes and enhance data architecture.
Responsibilities
- Build shippable software following Engineering standards in place.
- Build and maintain key Engineering blocks that other teams can rely upon (such as APIs and Big Data implementations).
- Support the current stack and be able to extend it with new features as well as work on ad-hoc R&D projects
- Work closely with TMG’s business intelligence users, operations and development teams on projects and CR’s, encouraging a data driven and pragmatic approach to tackling challenges and problems.
- Ensure the deliveries are on time and of the required quality
- Maintain the company’s data assets at required quality levels and help to design and build solid, efficient, stable APIs.
- Help to maintain our high standard of code and keep up to date with the latest technologies and methodologies to ensure TMG stays ahead of the game.
- Ensure a globally robust and highly scalable approach to development to support our growing number of global users and services.
- Enforce best practices in terms of code quality and design of processes.
Requirements
- Python development skills, including the ability to implement ETL data pipelines in Python and any familiarity with Rest APIs
- Advanced SQL scripting knowledge
- Experience with Google Cloud Platform, (preferable) or AWS/Azure
- 2+ years of experience in data or software development
- Knowledge of big data platforms relational databases
- Knowledge of technologies: Git, Docker, Bash language
- Ability to propose, design and implement a simple ETL solutions both in batch and real-time
- Understanding of what is a CI/CD continuous delivery pipeline and ability to design a process and the ability to pick the correct technology for the correct task
- Desirable Skills
- Experience with DBT (Data build Tools) to develop data pipelines
- Experience with Data streams in Google Dataflow or Apache beam
- Experience using Airflow
- Experience with NoSQL databases like Redis, Elastic Search
Benefits
- The nature of our industry means life at the Telegraph Media Group is fast-paced, demanding, and interesting. We also want it to be rewarding for everyone who works here by creating a suite of benefits that contribute to lifestyle choices and leisure activities. From dynamic working opportunities, medical cover, and parental leave (six months fully paid maternity leave and enhanced paternity/partner leave), to life assurance and season ticket loans, you can choose from a range of flexible benefits, designed to support your lifestyle and help you achieve a healthy work-life balance.
- **Training and development**
- With support from your manager and colleagues, you’ll also have access to a variety of training and development opportunities through The Academy. Covering a range of personal and professional skills, our courses enable you to develop an enjoyable and rewarding career.
- **Our commitment to inclusion**
- At Telegraph Media Group, we foster a diverse and inclusive workplace and we are committed to building a team that reflects a wide variety of skills, perspectives and backgrounds. We believe in equality of opportunity and welcome candidates from all backgrounds, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief.
- We are proud to be a Disability Confident Employer as part of the government’s Disability Confident Scheme. If you are disabled or have a long-term health condition and would like support in applying for any of our roles or if you require any reasonable adjustments in the recruitment process with us, please make us aware.
- To find out more about Diversity, Inclusion and Belonging at Telegraph Media Group, and for more information on our purpose, beliefs, and people values, please visit our website
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.
Data Engineer managing and organizing datasets for AI models at Walaris, developing AI - driven autonomous systems for defense and security applications.
Data Engineer designing and maintaining data pipelines at Black Semiconductor. Collaborating with process, equipment, and IT teams to support manufacturing analytics and decision - making.
Junior Data Engineer role focusing on Business Intelligence and Big Data at Avanade. Collaborating on data analysis and SQL queries in a supportive learning environment.
GCP Data Engineer designing and developing data processing modules for Ki, an algorithmic insurance carrier. Working closely with multiple teams to optimize data pipelines and reporting.
Data Engineer at Securian Financial optimizing scalable data pipelines for AI and advanced analytics. Collaborating with teams to deliver secure and accessible data solutions.