Senior Data Engineer building data collection and transformation frameworks on Snowflake and Azure. Leading architecture and design of complex data solutions in a hybrid work environment.
Responsibilities
Create data collection, extraction, and transformation frameworks for structured and unstructured data.
Develop and maintain infrastructure systems on the cloud (e.g. data warehouses, data lakes) including data access points.
Prepare and manipulate data using Azure SQL, Azure Data Factory, Databricks and other data pipeline tools.
Organize data into formats and structures that improve reuse and efficient delivery to businesses and analytics teams and system applications.
Integrate data across data lake, data warehouse and systems applications to ensure the delivery of information across the enterprise.
Lead the development and evolution of the data service layer, driving integration of components to deliver an excellent customer offering.
Evaluate data architecture and integrations, with a focus on ongoing optimization and enhancement of solution capabilities.
Engage critically with partners to establish clear needs and link to solutions, including setting up prototypes, and involving multiple parties in design sessions.
Lead the architecture, design and implementation of complex data solutions and integrations including best practices for the full development life cycle, coding standards, code reviews, source control management, build processes, testing, and operations.
Perform database monitoring, collaborate with database administrators to optimize database performance.
Lead the end-to-end migration of on-premises data solutions to Microsoft Azure, including re-architecting legacy systems, optimizing data pipelines for cloud scalability, and ensuring secure, high-performance integration across platforms.
Collaborate with team members to ensure adherence to standards for code, design, documentation, testing and deployment
Collaborate with data governance and strategy to ensure data lineage is well understood and constructed in a way to highlight data re-use and simplicity.
Work to assess new opportunities to simplify the data operation with new tools, technologies, file storage, management, and process.
Resolve data load issues to ensure seamless execution of downstream processes.
Conduct thorough testing and implement proactive measures to prevent recurrence and improve overall data pipeline reliability.
Requirements
5+ years of hands-on experience in relational database development (preferably Microsoft SQL Server or Oracle)
Minimum of 7 years of experience working in data warehousing/management, data architecture and supporting methodologies including 5+ years of hands-on experience in data modelling and data integration.
3+ years of experience designing, developing, and testing Azure data pipelines.
Experience migrating complex data solutions from on-premises infrastructure to cloud environments is a strong asset.
Familiar with software design pattern and best practices
Bachelor's degree required, Masters an asset, in Software Engineering, Computer Science; or equivalent work experience in a Technology or business environment
Proficient in multiple programming languages and coding.
Excellent ability to design and engineer enterprise solutions.
Experience manipulating, processing and extracting value from large, disconnected datasets.
Excellent verbal and written communication skills.
Knowledge of Business Intelligence, Analytics & Reporting.
Familiar with dashboard building and Data Visualizations
Experience working with DevOps pipelines (Git, Maven, Gitlab, Jenkins), continuous integration/delivery, automated testing (unit, functional, performance)
Benefits
Comprehensive Total Rewards Program, including performance-based bonuses
Flexible benefits starting from day one
Choice of a health spending account (HSA) or personal spending account (PSA)
Retirement planning support, with profit-sharing programs including company match and a defined contribution pension plan
Growth & development opportunities, including unlimited access to Coursera, mentorship programs, and an internal gig marketplace
Holistic wellness support, with an Employee & Family Assistance Program, 24/7 virtual healthcare, and workplace wellness initiatives
Flexibility that works for you, including hybrid work arrangements, a Work from Abroad program, and paid time off programs
Recognition and rewards, with company-wide recognition programs, exclusive banking perks from RBC & BMO, and access to great employee discounts
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.