Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
Implement and maintain Infrastructure as Code (IaC) using Terraform.
Manage orchestration workflows using Apache Airflow.
Support CI/CD pipelines and version control using GitLab.
Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
Troubleshoot and resolve incidents related to AWS data infrastructure.
Contribute to documentation and process improvement initiatives.
Managing and monitoring access and RBAC controls.
Requirements
Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
Strong hands-on experienced with Terraform for IaC.
Experience with Airflow for DAG orchestration and monitoring.
Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
Experience with Python, SQL and Bash for automation, querying and troubleshooting.
Understanding of AWS Security best practices, IAM policies and RBAC.
Understanding of AWS Networking and VPC
Experience with containerisation using Docker
Experience with Disaster Recovery, backups and snapshots.
**Desirable Skills:**
Understanding of AWS Neptune, EKS
Experience with Jira Service Desk
Experience supporting Data Engineers
Experience working as a consultant
README and Confluence documentation
Benefits
Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
Private medical cover for you and your spouse/partner, offered via Vitality
Discretionary bonus based on a blend of personal and company performance
Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
Principal AWS Platform Engineer at Appvia guiding clients in cloud adoption and DevOps excellence. Leading teams and projects while fostering innovation in cloud technologies.
Platform Engineer building secure and reliable internal platforms for developers at Alto Software Group. Collaborating with cross - functional teams to enhance developer experience and productivity.
Vertica Database Administrator overseeing Vertica systems operations at MassMutual. Providing 24/7 support while ensuring data reliability and security across clustered environments.
Director of Platform Engineering leading the vision, design, and evolution of a developer platform for cloud and infrastructure services. Driving DevOps excellence and automation initiatives across divisions in a strategic role.
Security Engineer developing agent - based tooling and services for NVIDIA's secure software development lifecycle. Collaborating across teams to ensure compliance and security in software development practices.
Power Platform Developer at Macaw creating applications and automating processes with Microsoft technologies. Collaborating with teams to understand requirements and deliver functional solutions.
AI Platform Engineer building and operating secure, scalable components of a cloud AI platform at Elevance Health. Design, implement, and automate cloud services and APIs while improving performance and efficiency.
Platform Engineer focusing on Kubernetes for Bundesdruckerei in Berlin. Supporting a multi - tenant platform with over 80 applications, evaluating new technologies and ensuring automation with infrastructure as code.