Senior Data Engineer at Cifas designing and developing data pipelines using Microsoft Fabric tools. Collaborating with teams to ensure data integrity and performance optimization.
Responsibilities
Maintaining, monitoring and managing the Cifas data analytics environment, leveraging Microsoft Fabric tools to build and manage data ecosystems, ensuring scalability and performance optimisation.
Designing and implementing scalable data pipelines using Microsoft Fabric components such as Data Factory, Lakehouse, and Data Warehouse.
Developing and optimising complex queries for data extraction, transformation, and loading (ETL) processes.
Collaborating with cross-functional teams and external providers to understand data requirements and deliver solutions that meet business needs.
Ensuring data quality and integrity through rigorous testing and validation procedures.
Monitoring and troubleshooting data workflows, ensuring high availability and performance.
Ensuring data pipelines are available and optimised for the application of data science and AI tools
Implementing data governance and security measures in compliance with industry standards.
Documenting data workflows, system architectures, and integration processes to ensure transparency and knowledge sharing across teams.
Providing technical support and training where necessary to ensure effective use of data platforms and tools.
Requirements
A degree in Computer Science, Information Systems, or a related field.
Proven experience in data engineering with a focus on SQL and Microsoft Fabric and its components.
Proficiency in programming languages like Python, SQL, and Scala for data manipulation and pipeline development.
Hands-on experience with Microsoft Fabric tools, including Data Factory, Lakehouse, and Data Warehouse.
Familiarity with cloud platforms such as Azure, AWS, or GCP.
Understanding of data modelling techniques and best practices.
Knowledge of data visualization tools like Power BI or Tableau.
Certifications in Microsoft Azure or related technologies.
Familiarity with big data technologies and frameworks
Experience of working with data science and AI tools in Microsoft Fabric
Ability to diagnose and resolve issues within data pipelines and systems.
Capacity to design scalable and efficient solutions for complex data challenges.
Strong written and verbal communication skills to liaise with technical and non-technical stakeholders effectively.
Benefits
Remote working with approximately 2 days a month in the London office.
Generous annual leave allowance plus the bank holidays
Private healthcare
Excellent pension package through salary sacrifice
Personal and professional growth
Employee wellbeing services – Wellbeing hub access with resources to various online exercise content, meditation guides, sleep stories and yoga.
Data Engineering Academy focused on Snowflake and Databricks for professionals interested in expanding their technical capabilities. Fully remote with future office work in Monterrey or Saltillo after completion.
Senior Data Engineer at Intent HQ designing and scaling data platforms. Building high - impact intelligence from millions of customer insights with a focus on performance and reliability.
SAP Data Engineer supporting MERKUR GROUP's evolution into a data - driven company. Responsible for data integration, modeling, and collaboration with various departments in Group Finance.
Data Engineer at Booz Allen Hamilton organizing data and developing advanced technology solutions. Leading data engineering activities for mission - driven projects and mentoring multidisciplinary teams.
Senior Data Engineer at Bristol Myers Squibb developing scalable data pipelines for foundational products. Collaborating with data scientists and IT professionals to ensure data quality and accessibility.
Data Engineer II role focusing on developing and maintaining data pipelines for analytics. Collaborating with Data Science and Analytics teams to ensure data quality and reliability.
Senior Data Architecture Specialist designing and maintaining data integration solutions for Morgan Stanley. Involved in building data architecture and optimizing data storage using various technologies.
Lead Data Engineer responsible for building and maintaining the central HR data lake. Collaborating with analysts and business stakeholders for data - driven decision making.
Join GKN Aerospace as a Life Cycle Assessment & Sustainability Data Engineer. Conduct analyses of environmental impacts and manage sustainability data for a greener future.