Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
About the role
- Data Engineer designing and building scalable data pipelines for advanced analytics. Utilizing Azure cloud platforms and industry-leading tools to support client data needs.
Responsibilities
- Develop, maintain, and optimize reusable, scalable data pipelines that include robust error handling and logging mechanisms.
- Implement automated notifications and error reporting using Azure Logic Apps and other tools.
- Collaborate with cross-functional teams to ensure data pipelines align with business objectives and meet performance requirements.
- Ensure data quality by implementing and maintaining frameworks.
- Design and implement data models and ETL/ELT processes that enable high-performance analytics solutions.
- Support the integration and transformation of diverse data sources into unified and consumable formats.
- Stay up-to-date with the latest advancements in Azure data services, including Microsoft Fabric, to deliver innovative solutions.
Requirements
- 3-5 years of proven experience as a Data Engineer or in a similar role.
- Proficiency in designing and implementing data pipelines with tools such as Azure Data Factory and Azure Synapse, preferably within Microsoft Fabric.
- Strong programming skills in Python (preferable), Spark, Java, or C#.
- Advanced SQL expertise (T-SQL, PL/SQL) for database design and query optimization.
- Hands-on experience with cloud data platforms, particularly Azure (Databricks, Synapse, Data Factory, Logic Apps).
- Familiarity with data quality frameworks.
Benefits
- Competitive compensation with bonus potential.
- Comprehensive benefits, including health, dental, and vision coverage.
- Generous PTO and paid holidays.
- Certification support, training programs, and professional growth opportunities.
- Flexible work environment with remote and hybrid options.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.
Senior Data Engineer responsible for growing customer - defined targeting calculations and developing key/value databases for real - time data processing.
Data Engineer developing and maintaining the Data Lakehouse platform using Microsoft Azure technology stack at RBC. Collaborating with business and technology teams to enhance data ingestion and modeling processes.