Cloud Engineer at SDG Group managing data volume optimization for GCP. Designing workflows and ensuring efficient data processing in a hybrid work environment.
About the role
- AWS Data Platform Engineer managing AWS data services and Infrastructure as Code for large-scale data operations. Implementing CI/CD pipelines with cross-functional collaboration for robust data infrastructure.
Responsibilities
- Provision, manage, and maintain AWS data services: S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch.
- Implement and maintain Infrastructure as Code (IaC) using Terraform.
- Manage orchestration workflows using Apache Airflow.
- Support CI/CD pipelines and version control using GitLab.
- Monitor and maintain core services such as S3 security file scanning, monitoring and reporting of data infrastructure access and usage patterns, and data ingress/egress patterns.
- Managing infrastructure that supports Data Engineering workflows including: disaster recovery, performance improvements, coding patterns.
- Collaborate with cross-functional teams (Data Engineering, SRE, Security) to ensure robust and secure data operations.
- Troubleshoot and resolve incidents related to AWS data infrastructure.
- Contribute to documentation and process improvement initiatives.
- Managing and monitoring access and RBAC controls.
Requirements
- Strong hands-on experience with AWS native data services including S3, Redshift, OpenSearch, Athena, Lambda, Glue, Batch, Athena, Step Function, SQS, CloudWatch, CloudTrail, EMR.
- Strong hands-on experienced with Terraform for IaC.
- Experience with Airflow for DAG orchestration and monitoring.
- Experience with YAML for CI/CD pipelines (e.g. GitLab CI/CD, GitHub Actions).
- Experience with Python, SQL and Bash for automation, querying and troubleshooting.
- Understanding of AWS Security best practices, IAM policies and RBAC.
- Understanding of AWS Networking and VPC
- Experience with containerisation using Docker
- Experience with Disaster Recovery, backups and snapshots.
- **Desirable Skills:**
- Understanding of AWS Neptune, EKS
- Experience with Jira Service Desk
- Experience supporting Data Engineers
- Experience working as a consultant
- README and Confluence documentation
Benefits
- Training – All team members are offered a number of options in terms of personal development, whether it is technical led, business acumen or methodologies. We want you to grow with us and to help us achieve more
- Private medical cover for you and your spouse/partner, offered via Vitality
- Discretionary bonus based on a blend of personal and company performance
- Holiday – You will receive 25 Days holiday, plus 1 day for Birthday and 1 day for your work anniversary in addition to UK bank holidays
- Electric Vehicle leasing with salary sacrifice
- Contributed Pension Scheme
- Death in service cover
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Product Reliability Engineer role at Kraken focused on scalable energy management solutions. Collaborating with teams to ensure product performance and system resilience in a hybrid work environment.
Frontend Platform Developer at Borrowell building foundational components for product teams in a remote - first environment. Collaborating with cross - functional teams to enhance code quality and app reliability.
AI Platform Engineer role at RAVL focused on developing GenAI platforms and agent - based architectures. Building scalable integration layers for enterprise AI in a growing engineering team.
ML Platform Engineer at RAVL designing scalable machine learning platforms for financial services. Leading development on Azure Databricks and optimizing MLOps pipelines for enterprise environments.
AI Platform Engineers building next - generation AI systems at RAVL, focused on developing GenAI platforms and scalable enterprise AI architectures.
Lead Platform Engineer managing cloud - native infrastructure at InsurTech company, driving architectural decisions and enhancing platform reliability under a culture of simplicity and care.
Principal Platform Engineer leading platform architecture and operations at Automata, transforming lab automation through integrated technology solutions in a hybrid work model.
Power Platform Engineer developing solutions using PowerPlatform at knowmad mood. Collaborating with multidisciplinary teams in Madrid for quality project delivery in a hybrid mode.
Cloud Operations Engineer responsible for ensuring operational stability of Saviynt’s cloud platform. Collaborating with teams to troubleshoot issues and implement improvements in a dynamic environment.