About the role

  • Senior Data Engineer responsible for data pipelines and analytics solutions across Microsoft ecosystem. Collaborating with stakeholders to ensure reliable data delivery and cloud-first strategies.

Responsibilities

  • Lead the design, development, and implementation of advanced data pipelines and ETL processes using Azure Data Lake Storage and Azure Data Factory.
  • Architect and manage scalable data solutions on Databricks for high-performance data processing and analytics.
  • Oversee the development and optimization of SQL Server databases and queries to meet complex reporting and analytical needs.
  • Write and maintain Python scripts for sophisticated data transformation, analysis, and automation tasks.
  • Spearhead data migration projects from on-premises systems to Azure cloud services, ensuring strategic planning, minimal disruption, and data integrity.
  • Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand and translate data requirements into technical solutions.
  • Troubleshoot and resolve complex data-related issues, ensuring high data quality and reliability.
  • Monitor, optimize, and scale data workflows to improve performance and cost-efficiency.
  • Develop and enforce best practices for data engineering processes, documentation, and governance.

Requirements

  • 5-7 years experience working with enterprise level relational and/or non-relational database and ETL/ELT technologies.
  • Extensive experience with Azure Data Lake Storage, Azure Data Factory, Databricks, SQL Server, and Python.
  • Demonstrated experience in the implementation and creation of both on-premise SQL Server Databases as well as Azure SQL Databases.
  • Deep understanding of data modeling, ETL processes, data warehousing concepts, and data architecture.
  • Proven track record of managing and executing large-scale data migration projects from on-premises to cloud environments.
  • Advanced proficiency in SQL for complex querying and database management.
  • Strong experience with Python for advanced data manipulation and automation tasks.
  • In-depth knowledge of cloud computing concepts and services, particularly within Azure.
  • Demonstrated leadership skills, with the ability to mentor and guide junior team members.
  • Excellent problem-solving abilities and attention to detail.
  • Exceptional communication skills and experience working collaboratively in a team-oriented environment.
  • Experience with data governance and data quality frameworks.
  • Familiarity with Azure services (e.g., Azure Synapse Analytics, Azure SQL Database, Cosmos DB) and big data technologies.
  • Experience with semi-structured/NoSQL databases is a plus.
  • Azure data certifications (e.g., Azure Data Engineer Associate) are a plus but not required.

Job title

Senior Data Engineer

Job type

Experience level

Senior

Salary

$175,000 - $200,000 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job