Senior Data Engineer for Semrush, developing scalable data pipelines and optimizing data systems. Collaborating with teams for analytics and mentoring junior engineers in best practices.
About the role
- Senior Data Engineer at a fast-growing MNC designing scalable data pipelines and infrastructure for AI. Collaborate with teams while building solutions for analytics and energy optimization.
Responsibilities
- Design and build scalable data pipelines and infrastructure that fuel AI and analytics
- Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage
- Design, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure
- Create data models for analytics purposes
- Utilize Azure Data Factory to create and maintain ETL (Extract, Transform, Load) operations
- Implement data validation and cleansing procedures for data integrity
- Ensure data security and compliance
- Collaborate with data engineers and stakeholders to understand requirements and translate them into data platform architectures
Requirements
- Must have 5+ years of experience with Data Engineering using Azure
- Should be a blend of technical expertise, analytical problem-solving, and collaboration with cross-functional teams
- Should be well versed in coding, spark core and data ingestion using Azure
- Core Azure DE skills and coding skills (pyspark, python and SQL)
- Must have experience with Azure DevOps, Apache Spark, Python, SQL proficiency, Azure Databricks knowledge and Big data technologies
Job title
Job type
Experience level
Salary
Degree requirement
No Education Requirement
Tech skills
Location requirements
Intern working on data engineering tasks for machine learning in the automotive field. Collaborating with Data Engineers and learning about data management tools.
Data Engineer developing and maintaining ETL processes using Azure Data Factory and Snowflake. Collaborating with teams to ensure reliable data for analytical purposes.
Senior Principal Engineer managing data quality framework implementation at Mercer. Collaborating with international stakeholders and ensuring robust data governance practices.
Data Engineer designing and implementing architectures in cloud environments. Collaborating with teams to define technical standards and achieve business goals.
Lead Data Engineer modernizing design standards for imagery models. Collaborate with stakeholders to build and optimize data pipelines and oversee integration efforts.
Data Engineer at Yü Group Plc shaping data strategy for the energy supplier in the UK. Collaborating with cross - functional teams to leverage data for business insights.
Data Engineer responsible for building scalable ETL/ELT data pipelines using Azure and Python. Collaborating with teams to ensure data quality and support analytics needs.
Senior Data Engineer at McKesson focusing on claims data, designing data pipelines and ensuring data integrity. Collaborating with teams to support analytics and reporting initiatives.
Data Engineer Student role at Canada Life focusing on connected data products for Canadian business needs. Collaborating with data teams to support analytics and decision - making initiatives.