Create data collection, extraction, and transformation frameworks for structured and unstructured data.
Develop and maintain infrastructure systems on the cloud (e.g. data warehouses, data lakes) including data access points.
Prepare and manipulate data using Azure SQL, Azure Data Factory, Databricks and other data pipeline tools.
Organize data into formats and structures that improve reuse and efficient delivery to businesses and analytics teams and system applications.
Integrate data across data lake, data warehouse and systems applications to ensure the delivery of information across the enterprise.
Lead the development and evolution of the data service layer, driving integration of components to deliver an excellent customer offering.
Evaluate data architecture and integrations, with a focus on ongoing optimization and enhancement of solution capabilities.
Engage critically with partners to establish clear needs and link to solutions, including setting up prototypes, and involving multiple parties in design sessions.
Lead the architecture, design and implementation of complex data solutions and integrations including best practices for the full development life cycle, coding standards, code reviews, source control management, build processes, testing, and operations.
Perform database monitoring, collaborate with database administrators to optimize database performance.
Lead the end-to-end migration of on-premises data solutions to Microsoft Azure, including re-architecting legacy systems, optimizing data pipelines for cloud scalability, and ensuring secure, high-performance integration across platforms.
Collaborate with team members to ensure adherence to standards for code, design, documentation, testing and deployment
Collaborate with data governance and strategy to ensure data lineage is well understood and constructed in a way to highlight data re-use and simplicity.
Work to assess new opportunities to simplify the data operation with new tools, technologies, file storage, management, and process.
Resolve data load issues to ensure seamless execution of downstream processes.
Conduct thorough testing and implement proactive measures to prevent recurrence and improve overall data pipeline reliability.
Requirements
5+ years of hands-on experience in relational database development (preferably Microsoft SQL Server or Oracle)
Minimum of 7 years of experience working in data warehousing/management, data architecture and supporting methodologies including 5+ years of hands-on experience in data modelling and data integration.
3+ years of experience designing, developing, and testing Azure data pipelines.
Experience migrating complex data solutions from on-premises infrastructure to cloud environments is a strong asset.
Familiar with software design pattern and best practices
Bachelor's degree required, Masters an asset, in Software Engineering, Computer Science; or equivalent work experience in a Technology or business environment
Proficient in multiple programming languages and coding.
Excellent ability to design and engineer enterprise solutions.
Experience manipulating, processing and extracting value from large, disconnected datasets.
Excellent verbal and written communication skills.
Knowledge of Business Intelligence, Analytics & Reporting.
Familiar with dashboard building and Data Visualizations
Experience working with DevOps pipelines (Git, Maven, Gitlab, Jenkins), continuous integration/delivery, automated testing (unit, functional, performance)
Benefits
Comprehensive Total Rewards Program, including performance-based bonuses
Flexible benefits starting from day one
Choice of a health spending account (HSA) or personal spending account (PSA)
Retirement planning support, with profit-sharing programs including company match and a defined contribution pension plan
Growth & development opportunities, including unlimited access to Coursera, mentorship programs, and an internal gig marketplace
Holistic wellness support, with an Employee & Family Assistance Program, 24/7 virtual healthcare, and workplace wellness initiatives
Flexibility that works for you, including hybrid work arrangements, a Work from Abroad program, and paid time off programs
Recognition and rewards, with company-wide recognition programs, exclusive banking perks from RBC & BMO, and access to great employee discounts
Senior Associate Data Engineer contributing to Travelers' analytics landscape by building and operationalizing data solutions. Collaborating with teams to ensure reliable data delivery across the enterprise.
Salesforce Data Engineer serving as a subject matter expert in the State of Tennessee. Designing scalable data pipelines and collaborating on cross - agency initiatives.
Data Engineer Senior responsible for building data architecture and optimizing pipelines for Business Intelligence. Collaborating with analysts to develop insights using Power BI and Azure technologies.
Principal Data Engineer driving modernization from legacy systems to cloud - native platforms at Mastercard. Architecting and developing ETL platforms with AI integration and establishing data - driven strategies.
Principal Data Engineer modernizing cloud - native platforms for AI - powered solutions at Mastercard. Leading teams to enhance data processing efficiency and reliability across global operations.
Data Engineer creating data pipelines for Santander's card transactions. Collaborating with an agile team in strategic projects involving Databricks and PySpark.
Data Engineer designing, implementing, and maintaining data pipelines at Sabiá Gaming. Focused on high - quality data access and integration for enhanced decision - making.
Quantitative Data Engineer developing data solutions and automations for MassMutual's investment management. Working with data orchestration tools within a collaborative team environment.
Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.