Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.
Responsibilities
Analyze and improve existing data pipelines to optimize performance, cost efficiency, and scalability.
Transition batch/snapshot pipelines to delta-based data processing pipelines.
Develop and maintain Terraform modules for efficient infrastructure management on AWS.
Migrate data pipelines from Google Cloud Platform to AWS while minimizing downtime and ensuring high reliability.
Design and implement dashboards and alerting systems to enable proactive monitoring of data pipeline performance.
Mentor, support and guide team members, share expertise and best practices, and contribute to the overall growth of the team.
Requirements
Python programming skills for data manipulation, scripting, and pipeline development.
Experience building scalable and distributed data pipelines using PySpark.
Strong command of SQL for querying and transforming large datasets.
Experience with AWS services such as S3, ECS, etc., with particular emphasis on Lambda and Glue.
Experience designing and managing infrastructure using Terraform.
Knowledge of Terragrunt is a plus.
Experience configuring and maintaining pipelines to support automation and deployment workflows.
Knowledge of DataDog for monitoring, alerting, and dashboard creation.
Benefits
Hybrid/flexible working - Onsite 3 Days a week Romania office based near București Basarab train station.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.
Data Engineer responsible for analyzing data and supporting decision - making processes in a wellness - focused company. Utilizing advanced data technologies and collaborating with internal teams for effective data management.
Data Engineer at TeCreation focusing on data analysis and innovative system development in the well - being industry. Collaborating on data integration and business intelligence reporting.
Senior Data Engineer developing high - impact data solutions in a collaborative financial team. Integrating data systems and ensuring performance with innovative technologies.
Senior Data Engineer developing data pipelines and infrastructure on Google Cloud Platform for WorkWhile's staffing marketplace. Collaborating with Data Science and Engineering teams to enhance data quality and availability.
Data Engineer developing data platforms for a consulting firm focused on quality solutions. Collaborating within a small team to deliver robust infrastructure and systems.
Senior Data Engineer designing and maintaining data pipelines within a fast - growing social impact startup. Collaborate cross - functionally to enhance products and analytics capabilities.
Senior Associate in data engineering at PwC focusing on designing robust data solutions. Leading complex data pipeline projects and collaborating with cross - functional teams to support automation and analytics.
Data Engineering & Warehousing Manager overseeing data engineering and warehousing operations at Hastings Insurance. Leading pipelines, platforms, and technical teams for enterprise data insights.
Senior Data Engineer delivering scalable data solutions in data engineering team at fintech startup. Building and maintaining data pipelines, collaborating with cross - functional teams for accurate data delivery.