Senior Data Engineer at Manulife building and maintaining Azure data pipelines for AI/ML analysis. Collaborating with partners to use data effectively and promote customer-first approaches.
Responsibilities
Enable the building, maintenance, enhancements, and support of new and existing Azure data pipelines for various analytical use cases inclusive of AI/ML/BI/GEN AI and reporting
Partner with collaborators in understanding data and using it to serve our businesses and operations whilst ensuring alignment to Manulife’s IT security and risk guidelines
Develop data understanding with partners; prioritize building interconnected datasets for user access
Value quality on ensuring our Azure applications in prod run within SLA and ensure their robustness and security
Propose technology improvements or come up with innovative solutions to solve business problems
Collaborate with the Architecture team, as well as experts in security and risk management
Lead, mentor and guide data engineers to promote customer first approach
Automate infrastructure provisioning and deployment using tools such as terraform
Implement CI/CD pipelines that enables automated code deployment
Participate in Agile sprints and ceremonies; supports rapid iteration and development
Take lead in maintaining the inventory of critical data elements and lineage
Cultivate and maintain strong relationships and foster collaboration with various teams and partners within the organization
Requirements
Bachelor’s in computer/IT or data related fields required
Master’s degree is a plus
6 + years of previous data engineering experience
3+ years of experience working in enabling azure related data technologies
Solid understanding of Azure infrastructure
Strong hands-on knowledge of Azure Databricks, ADF, ADLS, Synapse Serverless/dedicated/spark pools, Python, PySpark, and T-SQL
Experience designing and developing scripts for ETL processes and automation in Azure Data Factory and Azure Databricks
High proficiency in GIT/Jenkins/dev ops processes
Knowledge of implementing azure technologies and networking via terraform
Proficient in data modeling, data mart, data lakehouse architecture, SCD, data mesh, and delta lake
Solid understanding of data privacy and compliance regulations
Benefits
health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
adoption/surrogacy and wellness benefits
employee/family assistance plans
various retirement savings plans (including pension and a global share ownership plan with employer matching contributions)
financial education and counseling resources
generous paid time off program in Canada (includes holidays, vacation, personal, sick days, and statutory leaves of absence)
Snowflake Data Engineer optimizing data pipelines using Snowflake for a global life science company. Collaborate with cross - functional teams for data solutions and performance improvements in Madrid.
Data Engineer designing and implementing big data solutions at DATAIS. Collaborating with clients to deliver actionable business insights and innovative data products in a hybrid environment.
SAP Data Engineer supporting MERKUR GROUP in becoming a data - driven company. Responsible for data integration, ETL processes, and collaboration with various departments.
Big Data Engineer designing and managing data applications on Google Cloud. Join Vodafone’s global tech team to optimize data ingestion and processing for machine learning.
Data Engineer building and maintaining data pipelines for Farfetch’s data platform. Collaborating with the Data team to improve data reliability and architecture in Porto.
Senior Data Engineer at Razer leading initiatives in data engineering and AI infrastructure. Collaborating across teams to develop robust data solutions and enhancing AI/ML projects.
Data Engineering Intern working with data as Jua builds AI for climate and geospatial datasets. Contributing to the integration and validation of new datasets with experienced mentors.
Data Engineer supporting a fintech company in building and maintaining data pipelines. Collaborating with tech teams and enhancing data processing in a high - volume environment.
Staff Engineer developing innovative data solutions for dentsu's B2B marketing vision. Collaborating using cutting - edge cloud technologies and mentoring engineers in their careers.
Senior Data Engineer developing and optimizing data pipelines for Scene+’s cloud - native platform in Toronto. Collaborating across teams to enhance data governance and analytics capabilities.