We are looking for a highly skilled Databricks & Azure Senior Data Engineer with at least 6 to 10 years of experience.
The ideal candidate should have a strong background in Azure data services, including Databricks, Synapse Analytics, Microsoft Fabric, PySpark and SQL.
He/She will be responsible for designing, building, and maintaining scalable data solutions that meet business requirements and align with industry best practices.
Requirements
6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks.
Expertise in Python, SQL (SparkSQL, TSQL, PLSQL), Dimensional Data Modeling, Data Warehousing, and ETL/ELT processes.
Develop and optimize large-scale data pipelines using Databricks, Synapse, and Apache Spark.
Integrate data into Azure Data Lake Storage via Data Factory and Data Flows.
Architect Delta Lake & Lakehouse solutions for scalable analytics.
Optimize performance across Databricks, and Synapse environments.
Data Engineer developing architecture and pipelines for data analytics at NinjaTrader. Empowering analysts and improving business workflows through data - driven solutions.
Data Engineer joining Alterric to collaborate on data platform projects and analytics solutions. Working with Azure Cloud technologies to ensure data quality and integrity for informed decision - making.
Data Engineer at Kyndryl transforming raw data into actionable insights using ELK Stack. Responsible for developing, implementing, and maintaining data pipelines and processing workflows.
Senior Data Engineer at Clorox developing cloud - based data solutions. Leading data engineering projects and collaborating with business stakeholders to optimize data flows.
Data Engineer building solutions on AWS for high - performance data processing. Leading initiatives in data architecture and analytics for operational support.
Senior Data Engineer overseeing Databricks platform integrity, optimizing data practices for efficient usage. Leading teams on compliance while mentoring a junior Data Engineer.
Associate Data Engineer contributing to software applications development and maintenance using Python. Collaborating with teams for clean coding and debugging practices in Pune, India.
Lead Data Engineer responsible for delivering scalable cloud - based data solutions and managing cross - functional teams. Collaborating with global stakeholders and ensuring high - quality project execution in a fast - paced environment.
Data Engineer focusing on development and optimization of data pipelines in an insurance context. Ensuring data integrity and supporting data - driven decision - making processes.