AWS Data Platform Engineer managing AWS data services and Infrastructure as Code for large-scale data operations. Implementing CI/CD pipelines with cross-functional collaboration for robust data infrastructure.
Responsibilities
Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
Implement and maintain Infrastructure as Code (IaC) using Terraform.
Manage orchestration workflows using Apache Airflow.
Support CI/CD pipelines and version control using GitLab.
Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
Troubleshoot and resolve incidents related to AWS data infrastructure.
Contribute to documentation and process improvement initiatives.
Managing and monitoring access and RBAC controls.
Requirements
Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
Strong hands-on experienced with Terraform for IaC.
Experience with Airflow for DAG orchestration and monitoring.
Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
Experience with Python, SQL and Bash for automation, querying and troubleshooting.
Understanding of AWS Security best practices, IAM policies and RBAC.
Understanding of AWS Networking and VPC
Experience with containerisation using Docker
Experience with Disaster Recovery, backups and snapshots.
**Desirable Skills:**
Understanding of AWS Neptune, EKS
Experience with Jira Service Desk
Experience supporting Data Engineers
Experience working as a consultant
README and Confluence documentation
Benefits
Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
Private medical cover for you and your spouse/partner, offered via Vitality
Discretionary bonus based on a blend of personal and company performance
Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
Cloud Operations Engineer responsible for ensuring operational stability of Saviynt’s cloud platform. Collaborating with teams to troubleshoot issues and implement improvements in a dynamic environment.
Senior Platform Engineer creating scalable and efficient cloud systems for clients. Join Qodea's Professional Services team focused on innovation at the intersection of technology and design.
Platform Engineer working at Qodea to design and implement cloud solutions using Google Cloud for global leaders. Collaborating with teams to ensure optimal cloud performance and security.
Engineer, Platform Engineering responsible for developing requirements, testing, and deploying VSAT platforms and modems. Collaborating across SES departments and with Platform Vendors.
Senior Platform Engineer in Crypto Security Engineering Team at TransUnion. Building secure, scalable infrastructure and collaborating with teams to maintain cryptographic services.
Platform Engineer at Radiance Technologies responsible for designing and implementing a Kubernetes platform. Collaborating to enhance scalability, security, and reliability of deployments while streamlining processes.
AI Agent Platform Engineer creating and maintaining infrastructure for AI agents at Binance. Focused on automation across trading, compliance, and customer service.
Data Platform Engineer developing cloud solutions for a leading retail company in Portugal and Spain. Collaborating on data pipelines and optimizing data integration solutions in a hybrid work environment.
Principal Software Engineer responsible for shaping Web Platform architecture and performance at Autodesk. Driving strategic initiatives for high - quality web experiences with cross - functional collaboration.
IT Project Manager managing a diverse portfolio of technology projects, focusing on software solutions in the financial industry. Leading project planning and aligning delivery teams with objectives and timelines.