Hybrid AWS Data Platform Engineer – Administrator

at UBDS

• Job title: AWS Data Platform Engineer – Administrator
• Job type: Full Time
• Experience level: Mid level, Senior
• Salary: Not specified
• Degree requirement: Bachelor's Degree
• Tech skills: Airflow, Amazon Redshift, Apache, AWS, Docker, Python, SQL, Terraform
• Location requirements: Hybrid, London, United Kingdom

About the role

• AWS Data Platform Engineer managing AWS data services and Infrastructure as Code for large-scale data operations. Implementing CI/CD pipelines with cross-functional collaboration for robust data infrastructure.

Responsibilities

• Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
• Implement and maintain Infrastructure as Code (IaC) using Terraform.
• Manage orchestration workflows using Apache Airflow.
• Support CI/CD pipelines and version control using GitLab.
• Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
• Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
• Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
• Troubleshoot and resolve incidents related to AWS data infrastructure.
• Contribute to documentation and process improvement initiatives.
• Managing and monitoring access and RBAC controls.

Requirements

• Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
• Strong hands-on experienced with Terraform for IaC.
• Experience with Airflow for DAG orchestration and monitoring.
• Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
• Experience with Python, SQL and Bash for automation, querying and troubleshooting.
• Understanding of AWS Security best practices, IAM policies and RBAC.
• Understanding of AWS Networking and VPC
• Experience with containerisation using Docker
• Experience with Disaster Recovery, backups and snapshots.
• **Desirable Skills:**
• Understanding of AWS Neptune, EKS
• Experience with Jira Service Desk
• Experience supporting Data Engineers
• Experience working as a consultant
• README and Confluence documentation

Benefits

• Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
• Private medical cover for you and your spouse/partner, offered via Vitality
• Discretionary bonus based on a blend of personal and company performance
• Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
• Electric Vehicle leasing with salary sacrifice
• Contributed Pension Scheme
• Death in service cover