Data Engineer developing cloud migration and data solutions for retail at Public Group. Engage in multiple projects and create growth opportunities in a hybrid team environment.
Responsibilities
Be part of the team that will migrate on-premises data systems to cloud solutions, ensuring data integrity and minimal downtime.
Design, develop, and optimize data pipelines for **Bronze, Silver, and Gold layers** within the Microsoft Fabric ecosystem.
Monitor and troubleshoot cloud infrastructure performance, ensuring scalability and efficiency.
Collaborate with the team to implement best practices for **data governance**, **security**, and **compliance** in the cloud.
Document workflows, architecture, and key processes to support team operations and future scalability.
Stay abreast of the latest data engineering technologies and trends, particularly within the Microsoft Azure ecosystem, and identify opportunities to leverage new tools and techniques.
Manage and modernize existing on-premise data solutions (e.g., SQL Server, SSIS, SSAS) while supporting migration initiatives to cloud platforms.
Optimize data storage, retrieval, and transformation processes across hybrid environments.
Ensure data availability, consistency, and synchronization between on-premise systems and cloud-based services.
Support and enhance hybrid data workflows and design patterns (e.g., staged migration, dual-write strategies).
Requirements
2+ years of working experience in ETL pipeline design and implementation using tools like Airflow, SSIS, and Python (including PySpark).
Strong proficiency in SQL for data manipulation, transformation, and performance tuning.
Εxperience with Microsoft Data Solutions, including Azure Synapse, Data Lake, Power BI and Microsoft Fabric.
Strong understanding of data warehousing principles and best practices, with experience in implementing dimensional models and star schemas.
Strong understanding of data governance frameworks and data privacy regulations.
Excellent communication and collaboration skills to work effectively with cross-functional teams.
Ability to prioritize tasks in a fast-paced, dynamic environment.
Benefits
💼 **Competitive compensation & benefits package**
💰** Performance-based bonus scheme**
🧑⚕️ **Comprehensive life & health insurance**
🏡 **Flexible hybrid working model** – to support your work-life balance
🧡 **Psychological support** via a professional helpline for you and your family
🚀 **Career growth opportunities** in a role that evolves with you
🎉** Valuable experience** in a well-known and fast-growing organization
📚 **Continuous learning** and upskilling through tailored programs
Intern Data Engineer at Flutter Studios learning to create applications in the gaming industry. Join a cross - functional team to implement a basic application in an Agile environment.
AI/Data Engineer at Comcast developing data pipelines and AI solutions for audit processes. Leading team efforts to ensure data quality and compliance with audit objectives across business units.
Senior Data Engineer involved in AWS Cloud and Big Data solutions for Financial Crime. Join CommBank's team to tackle complex data - centric problems with advanced technologies.
Senior Data Engineer leading and mentoring a team in building scalable data pipelines for digital transformation projects in an international software company.
Senior Data Operations Engineer at iKnowHow designing and implementing scalable data - driven applications. Focus on data pipelines, APIs, and collaboration across teams for project success.
Data/AI Engineer supporting innovations in corporate travel with AWS technologies at HRS Group. Collaborating with data teams to develop AI solutions and maintain data pipelines.
Data Engineer developing data solutions for reporting and analytics at Assurant. Implementing and optimizing Data Warehouse solutions in cloud and on - premise environments with Agile methodology.
AI Engineer developing AI - driven analytics for trading at Deloitte. Focusing on scalable data pipelines and collaboration with traders for actionable insights.
Data Engineer involved in delivering scalable enterprise systems and digital transformation platforms for Qualysoft. Collaborate with global teams across various industries and technologies.