Senior Lead Data Engineer designing and building scalable data solutions utilizing AI technology for a globally recognized financial institution. Serving sophisticated clients across the globe.
About the role
- Data Engineer responsible for creating pipelines and models to support analytics at Trainline. Collaborating with BI Developers and Data Scientists to drive business insights through data.
Responsibilities
- Be key to making our data lake more accessible and insightful breaking down the barriers to access by working on new data marts and designing data models that even the most basic SQL users can use
- Build data pipelines with Spark or DBT
- Use SQL to transform data into meaningful insights
- Build and deploy infrastructure with Terraform
- Implement DDL, DML with Iceberg
- Do code reviews for your peers
- Orchestrate your pipelines with DAGs on Airflow
- Participate in SCRUM ceremonies (standups, backlogs, demos, retros, planning)
- Secure data with IAM and AWS Lake formation
- Deploy your changes with Jenkins and GitHub actions
Requirements
- Proven experience as a Data Engineering using SQL and Python
- Previous experience with data lakes in AWS, Glue Catalog and Athena (or equivalent)
- Good experience with DBT
- Capable of using popular data modelling tools to create a diagram of proposed tables to enable discussion
- Good communicator and comfortable with presenting ideas and outputs to technical and non-technical users
- Worked on Apache Airflow before to create DAGS
- Ability to work within Agile, considering minimum viable products, story pointing and sprints
Benefits
- Private healthcare & dental insurance
- Generous work from abroad policy
- 2-for-1 share purchase plans
- EV Scheme to further reduce carbon emissions
- Extra festive time off
- Excellent family-friendly benefits
- Career growth with clear career paths
- Transparent pay bands
- Personal learning budgets
- Regular learning days
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer Consultant building and maintaining enriched data infrastructure for analytical thinking at Northwest Permanente. Involves data collection, cleansing, and transformation for business intelligence.
Vice President - Business, Data Architect role at TD Securities focusing on business data architecture and analytics capabilities. Collaborate with stakeholders to define and govern data models and ensure alignment with strategy.
Staff Data Engineer at Headspace building privacy - first data platforms for mental health support. Leading data engineering strategies and mentoring team members to enhance data - driven decision making.
Senior Data Engineer building and implementing data pipelines at Headspace. Collaborating with analytics and data science teams to enhance personalized mental health support.
Data Engineering Intern working on data pipelines and infrastructure in fast - growing fintech. Collaborating with data engineers, learning best practices and developing data solutions.
Senior Software Engineer building and maintaining data infrastructure for Gusto. Collaborating with Data Science and Business Intelligence teams to achieve their goals.
Data Engineer building and maintaining scalable data pipelines for AI Search Infrastructure at You.com. Collaborating across teams to ensure data quality and enable AI capabilities.
Data Engineer developing and managing technology - based data solutions for clients in different industries in Greece. Participating in software development lifecycle within Agile team setting.
Data Architect leading design and governance of high - quality data architectures for clients. Collaborating with engineering teams and stakeholders to transform business challenges into scalable data solutions.