Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
About the role
- Data Engineer in the Telegraph Data team developing reliable and scalable data platforms. Collaborating with cross-functional teams to optimise business processes and enhance data architecture.
Responsibilities
- Build shippable software following Engineering standards in place.
- Build and maintain key Engineering blocks that other teams can rely upon (such as APIs and Big Data implementations).
- Support the current stack and be able to extend it with new features as well as work on ad-hoc R&D projects
- Work closely with TMG’s business intelligence users, operations and development teams on projects and CR’s, encouraging a data driven and pragmatic approach to tackling challenges and problems.
- Ensure the deliveries are on time and of the required quality
- Maintain the company’s data assets at required quality levels and help to design and build solid, efficient, stable APIs.
- Help to maintain our high standard of code and keep up to date with the latest technologies and methodologies to ensure TMG stays ahead of the game.
- Ensure a globally robust and highly scalable approach to development to support our growing number of global users and services.
- Enforce best practices in terms of code quality and design of processes.
Requirements
- Python development skills, including the ability to implement ETL data pipelines in Python and any familiarity with Rest APIs
- Advanced SQL scripting knowledge
- Experience with Google Cloud Platform, (preferable) or AWS/Azure
- 2+ years of experience in data or software development
- Knowledge of big data platforms relational databases
- Knowledge of technologies: Git, Docker, Bash language
- Ability to propose, design and implement a simple ETL solutions both in batch and real-time
- Understanding of what is a CI/CD continuous delivery pipeline and ability to design a process and the ability to pick the correct technology for the correct task
- Desirable Skills
- Experience with DBT (Data build Tools) to develop data pipelines
- Experience with Data streams in Google Dataflow or Apache beam
- Experience using Airflow
- Experience with NoSQL databases like Redis, Elastic Search
Benefits
- The nature of our industry means life at the Telegraph Media Group is fast-paced, demanding, and interesting. We also want it to be rewarding for everyone who works here by creating a suite of benefits that contribute to lifestyle choices and leisure activities. From dynamic working opportunities, medical cover, and parental leave (six months fully paid maternity leave and enhanced paternity/partner leave), to life assurance and season ticket loans, you can choose from a range of flexible benefits, designed to support your lifestyle and help you achieve a healthy work-life balance.
- **Training and development**
- With support from your manager and colleagues, you’ll also have access to a variety of training and development opportunities through The Academy. Covering a range of personal and professional skills, our courses enable you to develop an enjoyable and rewarding career.
- **Our commitment to inclusion**
- At Telegraph Media Group, we foster a diverse and inclusive workplace and we are committed to building a team that reflects a wide variety of skills, perspectives and backgrounds. We believe in equality of opportunity and welcome candidates from all backgrounds, regardless of age, gender, ethnicity, disability, sexual orientation, gender identity, socio-economic background, religion and/or belief.
- We are proud to be a Disability Confident Employer as part of the government’s Disability Confident Scheme. If you are disabled or have a long-term health condition and would like support in applying for any of our roles or if you require any reasonable adjustments in the recruitment process with us, please make us aware.
- To find out more about Diversity, Inclusion and Belonging at Telegraph Media Group, and for more information on our purpose, beliefs, and people values, please visit our website
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.