Senior Data Engineer at Keyrus focusing on data solutions and projects to drive performance. Collaborating with teams globally to enhance data transformation and governance processes.
About the role
- Director of Data Engineering enabling the building and support of Azure data pipelines for analytical use cases. Leading a group of data engineers at Manulife.
Responsibilities
- Enable the building, maintenance, enhancements, and support of new and existing Azure data pipelines for various analytical use cases inclusive of AI/ML/BI/GEN AI and reporting
- Lead and mentor a group of data engineers and partner with collaborators in understanding data and using it to serve our businesses and operations whilst ensuring alignment to Manulife’s IT security and risk guidelines
- Gain deep understanding of data by collaborating with business and advanced analytics partners; demonstrate the understanding to design, curate and publish connected data sets that enables users to self-serve
- Lead on ensuring our Azure applications in prod run within SLA and ensure their robustness and security
- Propose technology improvements or come up with innovative solutions to solve business problems
- Collaborate with Architecture, security and risk teams and implement the latest guidelines and Azure standard methodologies
- Automate infrastructure provisioning and deployment using tools such as terraform
- Implement CI/CD pipelines that enables automated code deployment
- Participate in Agile sprints and ceremonies; supports rapid iteration and development
- Take lead in maintaining the inventory of critical data elements and lineage
- Cultivate and maintain strong relationships and fosters collaboration with various teams and partners within the organization.
Requirements
- Bachelor’s in computer/IT or data related fields required
- Master’s degree is a plus
- 10 + years of previous data engineering experience
- 5+ years of experience working in enabling azure related data technologies
- Proficient knowledge in Azure infrastructure including subscriptions, resource groups, resources, RBAC for access control, Azure AD integration, and security principles
- Strong hands-on knowledge of Azure Databricks, ADF, ADLS, Synapse Serverless/dedicated/spark pools, Python, PySpark, and T-SQL
- Experience designing and developing scripts for ETL processes and automation in Azure Data Factory and Azure Databricks
- High proficiency in GIT/Jenkins/dev ops processes to maintain and resolve issues with data pipelines
- Knowledge of implementing azure technologies and networking via terraform along with ability to fix issues with Azure infrastructure
- Proficient in data modeling, data mart, data lakehouse architecture, SCD, data mesh, and delta lake overall
- Solid understanding of data privacy and compliance regulations and standard methodologies for preserving customer data.
Benefits
- health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
- adoption/surrogacy and wellness benefits
- employee/family assistance plans
- retirement savings plans (including pension and a global share ownership plan with employer matching contributions)
- financial education and counseling resources
- generous paid time off program in Canada including holidays, vacation, personal, and sick days
- full range of statutory leaves of absence
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Data Engineer developing scalable data pipelines for ETL/ELT processes using GCP services. Collaborating with team members to optimize data workflows and ensure data integrity.
Data Governance Engineer in Fintech developing a formal cyber data governance framework. Collaborating with cyber security, analytics, and platform engineering teams on metadata and lineage capabilities.
Junior Data Engineer role at Allegro, focusing on developing ETL/ELT pipelines and processing large datasets. Collaborate with cross - functional teams for data quality and reporting.
Data Engineer at Concept Reply developing innovative data - driven solutions in IoT. Collaborating with teams to unlock the potential of data and cloud computing.
Data Engineer creating and managing data pipelines for critical data solutions at S&P Global. Collaborating on enterprise - scale data processing in a supportive, innovative environment.
Data Engineer supporting and evolving data environment in cloud migration. Maintain and optimize existing databases while designing modern data solutions with cross - functional collaboration.
Senior Data Engineer responsible for data pipeline projects at Suprema Gaming. Focus on batch and streaming data solutions while collaborating with business teams.
Senior data leader managing the enterprise data architecture at Breakthru Beverage. Leading high - performing teams in data engineering and defining modern data strategies.
Data Engineer at Equinix implementing data architecture solutions for scalability and analytics. Collaborating with teams to design data pipelines and maintain data models for business objectives.