Director of Data Engineering enabling the building and support of Azure data pipelines for analytical use cases. Leading a group of data engineers at Manulife.
Responsibilities
Enable the building, maintenance, enhancements, and support of new and existing Azure data pipelines for various analytical use cases inclusive of AI/ML/BI/GEN AI and reporting
Lead and mentor a group of data engineers and partner with collaborators in understanding data and using it to serve our businesses and operations whilst ensuring alignment to Manulife’s IT security and risk guidelines
Gain deep understanding of data by collaborating with business and advanced analytics partners; demonstrate the understanding to design, curate and publish connected data sets that enables users to self-serve
Lead on ensuring our Azure applications in prod run within SLA and ensure their robustness and security
Propose technology improvements or come up with innovative solutions to solve business problems
Collaborate with Architecture, security and risk teams and implement the latest guidelines and Azure standard methodologies
Automate infrastructure provisioning and deployment using tools such as terraform
Implement CI/CD pipelines that enables automated code deployment
Participate in Agile sprints and ceremonies; supports rapid iteration and development
Take lead in maintaining the inventory of critical data elements and lineage
Cultivate and maintain strong relationships and fosters collaboration with various teams and partners within the organization.
Requirements
Bachelor’s in computer/IT or data related fields required
Master’s degree is a plus
10 + years of previous data engineering experience
5+ years of experience working in enabling azure related data technologies
Proficient knowledge in Azure infrastructure including subscriptions, resource groups, resources, RBAC for access control, Azure AD integration, and security principles
Strong hands-on knowledge of Azure Databricks, ADF, ADLS, Synapse Serverless/dedicated/spark pools, Python, PySpark, and T-SQL
Experience designing and developing scripts for ETL processes and automation in Azure Data Factory and Azure Databricks
High proficiency in GIT/Jenkins/dev ops processes to maintain and resolve issues with data pipelines
Knowledge of implementing azure technologies and networking via terraform along with ability to fix issues with Azure infrastructure
Proficient in data modeling, data mart, data lakehouse architecture, SCD, data mesh, and delta lake overall
Solid understanding of data privacy and compliance regulations and standard methodologies for preserving customer data.
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
retirement savings plans (including pension and a global share ownership plan with employer matching contributions)
financial education and counseling resources
generous paid time off program in Canada including holidays, vacation, personal, and sick days
Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.