Senior Azure Data Engineer at Accellor enhancing data capabilities for enterprise clients using Azure technologies. Building solutions to transform business processes through robust data engineering practices.
Responsibilities
Develop and maintain robust data pipelines to collect, transform, and process large datasets from various sources, ensuring timely and accurate delivery of data for analytics and reporting.
Strong experience in performance tuning databases, procedures, and functions, with a focus on optimizing data architecture, scalability, and cost savings.
Pipeline Development: Design and implement scalable data integration pipelines using Azure Data Factory (ADF) and Azure Databricks.
Data Modeling: Create and maintain complex data models in Azure Synapse Analytics and Azure SQL Database to support business intelligence needs
Work with the Lead Engineer to automate business processes, automate the movement of data within the organization, and orchestrate the exchange of data with external partners.
Collaborate with other department managers and business leaders to complete organizational goals and strategic priorities and support critical processes.
Optimize data architecture and performance by leveraging modern technologies and by implementing performance-tuning strategies for databases, procedures, and functions.
Automate data workflows to improve efficiency and scalability, while ensuring data integrity, hygiene, and cost efficiency.
Work closely with business stakeholders to gather requirements, translate them into technical specifications, and deliver solutions within project timelines.
Troubleshoot and resolve data and reporting issues, driving continuous improvement in analytic capabilities.
Requirements
Bachelor’s degree is preferred in Computer Science, Data Engineering, with over 12+ years of professional experience.
A proven track record in building scalable data pipelines and automating data processes through programming, scripts, APIs, and platform tools.
Strong expertise in modern data tools and technologies, including SQL Server, Microsoft Fabric, Data Bricks, Azure Functions, ADF, Synapse, Python, C# / .NET, and APIs.
Cloud Platform: Proven experience with the Azure Data Stack (ADF, Synapse, Databricks, ADLS).
Languages: Strong proficiency in SQL and Python (PySpark). Knowledge of Scala or C# is a plus.
Deep understanding of data integrity and hygiene, with a commitment to maintaining high standards of data quality.
Excellent communication and collaboration skills, with the ability to work effectively with cross-functional teams and stakeholders.
Senior Data Engineer at Keyrus leading the design, development, and delivery of scalable data platforms. Collaborating with teams to translate requirements into production - grade solutions and mentoring engineers.
Senior Data Engineer for global payments platform designing ETL pipelines and data models. Collaborating across teams to tackle complex data challenges in an innovative fintech environment.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.