Lead Data Engineer responsible for designing and implementing data solutions. Work with AWS and Snowflake in a global data and AI company headquartered in New York.
About the role
- Senior Azure Data Engineer responsible for data solutions in Data & Analytics team. Requires expertise in Databricks, Azure services, and data pipeline optimization.
Responsibilities
- Design, build, and maintain scalable data solutions that meet business requirements and align with industry best practices.
- Collaborate with the Data & Analytics team on various projects.
Requirements
- 6+ years of experience as a Databricks & Data Engineer, building Azure-based data solutions using Data Factory, Synapse, Databricks.
- Expertise in Python, SQL (SparkSQL, TSQL, PLSQL), Dimensional Data Modeling, Data Warehousing, and ETL/ELT processes.
- Develop and optimize large-scale data pipelines using Databricks, Synapse, and Apache Spark.
- Integrate data into Azure Data Lake Storage via Data Factory and Data Flows.
- Architect Delta Lake & Lakehouse solutions for scalable analytics.
- Optimize performance across Databricks, and Synapse environments.
- Any ERP experience
- Leverage Microsoft Fabric for seamless data integration & transformation.
- Operationalize ML models in Databricks and automate CI/CD pipelines with Azure DevOps.
- Ensure data governance & security with Azure Purview & Databricks Unity Catalog
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer designing and optimizing ETL workflows using Snowpark. Collaborating with the CTO to enhance parcel shipping analytics software.
Senior Data Engineer developing ingestion, ETL & ELT processes with Azure Synapse at Indra Group. Supporting data solutions and compliance in a collaborative hybrid work environment.
Senior Data Engineer building data pipelines for business intelligence at Getsafe. Involves designing and maintaining a Data Warehouse platform using tools like SQL and Python in a hybrid work environment.
Big Data Architect involved in the Data Engineering Team, drafting architectures and sizing efforts. Collaborating with key team members to ensure data platform efficiency and best practices.
Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Data Engineer building and maintaining core data infrastructure for Aircall's AI customer communications platform. Support data reliability and scalability for high - impact use cases.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.
Data Engineer developing and maintaining ETL processes with Informatica IDMC for BMW TechWorks Romania. Collaborating with teams to implement cloud - based data architecture solutions.
Microsoft Data Architect designing and building business intelligence solutions on Azure. Collaborating with teams and engaging clients for strategic data solutions.