AWS Data Platform Engineer managing AWS data services and Infrastructure as Code for large-scale data operations. Implementing CI/CD pipelines with cross-functional collaboration for robust data infrastructure.
Responsibilities
Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
Implement and maintain Infrastructure as Code (IaC) using Terraform.
Manage orchestration workflows using Apache Airflow.
Support CI/CD pipelines and version control using GitLab.
Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
Troubleshoot and resolve incidents related to AWS data infrastructure.
Contribute to documentation and process improvement initiatives.
Managing and monitoring access and RBAC controls.
Requirements
Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
Strong hands-on experienced with Terraform for IaC.
Experience with Airflow for DAG orchestration and monitoring.
Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
Experience with Python, SQL and Bash for automation, querying and troubleshooting.
Understanding of AWS Security best practices, IAM policies and RBAC.
Understanding of AWS Networking and VPC
Experience with containerisation using Docker
Experience with Disaster Recovery, backups and snapshots.
**Desirable Skills:**
Understanding of AWS Neptune, EKS
Experience with Jira Service Desk
Experience supporting Data Engineers
Experience working as a consultant
README and Confluence documentation
Benefits
Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
Private medical cover for you and your spouse/partner, offered via Vitality
Discretionary bonus based on a blend of personal and company performance
Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
Senior Embedded Platform Engineer developing low - level embedded software for Ford's Electric Vehicles and the future of transportation. Collaborating with agile teams to ensure functionality and efficiency.
Senior IT Engineer enhancing cloud platform and infrastructure reliability at Xcel Energy. Collaborating with teams to influence platform strategy and deliver high - impact capabilities.
Platform Engineer developing Kubernetes solutions supporting multi - tenant platforms at Bundesdruckerei in Berlin. Collaborating on innovative digital solutions for identity and data protection.
Lead Platform Engineer at PGIM Private Capital focusing on cloud modernization. Collaborate with cross - functional teams to develop cloud - based applications in a hybrid work environment.
AI Platform Engineer designing and deploying AI and ML platforms at Utica National Insurance Group. Collaborating with internal teams to implement AI solutions and establish observability and telemetry.
Head of Platform Engineering at Flutter leading core infrastructure services and cloud platforms. Focused on modernizing systems and improving reliability for critical operations.
Join Bupa as a Senior Platform Engineer to design and build a scalable, secure data platform. Collaborate and mentor in a healthcare and insurance setting with innovative technology.
Senior Consultant delivering solutions for client challenges using Red Hat technologies. Promote and implement best practices while collaborating with diverse teams.
Senior Consultant shaping platform engineering strategy and roadmap at Securian Financial. Driving modernization and operational consistency through stakeholder alignment and business impact.
Power Platform Engineer building secure, scalable business applications on Microsoft Platform for legacy modernization. Collaborating with teams to implement optimal app patterns and enhance user experience.