Senior Data Engineer building data collection and transformation frameworks on Snowflake and Azure. Leading architecture and design of complex data solutions in a hybrid work environment.
Responsibilities
Create data collection, extraction, and transformation frameworks for structured and unstructured data.
Develop and maintain infrastructure systems on the cloud (e.g. data warehouses, data lakes) including data access points.
Prepare and manipulate data using Azure SQL, Azure Data Factory, Databricks and other data pipeline tools.
Organize data into formats and structures that improve reuse and efficient delivery to businesses and analytics teams and system applications.
Integrate data across data lake, data warehouse and systems applications to ensure the delivery of information across the enterprise.
Lead the development and evolution of the data service layer, driving integration of components to deliver an excellent customer offering.
Evaluate data architecture and integrations, with a focus on ongoing optimization and enhancement of solution capabilities.
Engage critically with partners to establish clear needs and link to solutions, including setting up prototypes, and involving multiple parties in design sessions.
Lead the architecture, design and implementation of complex data solutions and integrations including best practices for the full development life cycle, coding standards, code reviews, source control management, build processes, testing, and operations.
Perform database monitoring, collaborate with database administrators to optimize database performance.
Lead the end-to-end migration of on-premises data solutions to Microsoft Azure, including re-architecting legacy systems, optimizing data pipelines for cloud scalability, and ensuring secure, high-performance integration across platforms.
Collaborate with team members to ensure adherence to standards for code, design, documentation, testing and deployment
Collaborate with data governance and strategy to ensure data lineage is well understood and constructed in a way to highlight data re-use and simplicity.
Work to assess new opportunities to simplify the data operation with new tools, technologies, file storage, management, and process.
Resolve data load issues to ensure seamless execution of downstream processes.
Conduct thorough testing and implement proactive measures to prevent recurrence and improve overall data pipeline reliability.
Requirements
5+ years of hands-on experience in relational database development (preferably Microsoft SQL Server or Oracle)
Minimum of 7 years of experience working in data warehousing/management, data architecture and supporting methodologies including 5+ years of hands-on experience in data modelling and data integration.
3+ years of experience designing, developing, and testing Azure data pipelines.
Experience migrating complex data solutions from on-premises infrastructure to cloud environments is a strong asset.
Familiar with software design pattern and best practices
Bachelor's degree required, Masters an asset, in Software Engineering, Computer Science; or equivalent work experience in a Technology or business environment
Proficient in multiple programming languages and coding.
Excellent ability to design and engineer enterprise solutions.
Experience manipulating, processing and extracting value from large, disconnected datasets.
Excellent verbal and written communication skills.
Knowledge of Business Intelligence, Analytics & Reporting.
Familiar with dashboard building and Data Visualizations
Experience working with DevOps pipelines (Git, Maven, Gitlab, Jenkins), continuous integration/delivery, automated testing (unit, functional, performance)
Benefits
Comprehensive Total Rewards Program, including performance-based bonuses
Flexible benefits starting from day one
Choice of a health spending account (HSA) or personal spending account (PSA)
Retirement planning support, with profit-sharing programs including company match and a defined contribution pension plan
Growth & development opportunities, including unlimited access to Coursera, mentorship programs, and an internal gig marketplace
Holistic wellness support, with an Employee & Family Assistance Program, 24/7 virtual healthcare, and workplace wellness initiatives
Flexibility that works for you, including hybrid work arrangements, a Work from Abroad program, and paid time off programs
Recognition and rewards, with company-wide recognition programs, exclusive banking perks from RBC & BMO, and access to great employee discounts
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.