Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
About the role
- Senior Data Architect shaping data architecture strategy within the U.S. Segment at Manulife. Leading implementation of data integration strategies and optimizing data solutions.
Responsibilities
- Leads the development and implementation of data integration and migration strategies for large datasets.
- Designs and architects highly scalable data pipelines to load data from various source systems.
- Designs, architects, and maintains data models, data warehouses, and data lakes optimized for scalability and performance.
- Designs data architecture and IT solutions to ensure data is stored properly, usable by business units, and protected from attacks.
- Optimizes data solutions for performance and scalability, utilizing techniques such as data partitioning, distributed processing, and data compression.
- Identifies the needs of the data lakes and data warehouses, the data that is available, and creates a blueprint for creating, testing and maintaining them.
- Works with database administrators and data analysts to ensure they can easily use and access data.
- Works with management to create databases that will be usable and store the required information.
- Addresses issues with data migration (e.g., validation, clean-up and mapping) and understands the importance of Data Dictionaries.
- Documents data architectures, technical processes, and performance optimization strategies.
- Documents data interfaces and movement which includes frequency of movement, data transformations, and any aggregation or calculations.
- Integrates views of data by working with business team members and application designers to determine data requirements (e.g., availability, volumes).
- Defines data architecture standards and guidelines, and how to use the architected databases.
- Helps ensure a focus on data quality, working closely with business team members to determine its importance.
- Software/platform/infrastructure architecture plans to support business strategy and outcomes.
- Defines the overall integration of Data and ML pipelines across the data supply chain and defines the technical and operational design of these pipelines.
- Implements mechanisms to monitor and prevent unethical use of data, such as bias in algorithms or discriminatory practices.
Requirements
- Experience architecting, designing and developing large-scale data solutions and enterprise-wide systems
- Strong knowledge of data management skills (e.g., Hadoop, NoSQL, Spark), metadata management, big data management
- Expert knowledge of structured analysis and design techniques
- Knowledge across data technology stack (e.g., Azure Data Factory, Databricks, Spark, Python, Synapse)
- Strong understanding of data management, from RDBMS to NoSQL data models
- Knowledge of ETL and data integration tools and technologies
- Software development experience using multiple languages (e.g., Python , Java, C, C++, C#)
- Understanding of logical designs of how databases will link to each other and the flow of data between stages
- Ability to use AI to support data management strategies.
- Provides professional advice – takes a lead role of process or program execution
- Is accountable for own work and contributes to setting standards through expertise in own job discipline that impact others’ deliverables
- Work is guided by cascaded policies or business plans
- May lead medium to large size projects or work streams with moderate resource requirements, risk and/or complexity with multiple teams representing different interests
Benefits
- health, dental, mental health, vision, short- and long-term disability, life and AD&D insurance coverage
- adoption/surrogacy and wellness benefits
- employee/family assistance plans
- various retirement savings plans (including pension and a global share ownership plan with employer matching contributions)
- financial education and counseling resources
- generous paid time off program including holidays, vacation, personal, and sick days
- full range of statutory leaves of absence
Job title
Job type
Experience level
Salary
Degree requirement
Tech skills
Location requirements
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer designing and building data pipelines at LexisNexis. Collaborating with partners for high - quality analytics and AI - ready data.
Data Engineer implementing data pipelines on Snowflake platform with a focus on innovation and collaboration for Zurich's data projects.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.
Data Engineer developing cloud solutions and software tools on Microsoft Azure big data platform. Collaborating with various teams for data analysis and visualization in healthcare.