Senior Data Engineer designing and optimizing data platforms for clients using Microsoft Azure, Microsoft Fabric, Power BI, and Databricks. Working closely with clients to deliver scalable solutions.
Responsibilities
Work directly with clients to understand business goals, data challenges, and technical requirements
Lead or support discovery sessions, requirements workshops, architecture discussions, and solution reviews
Develop and optimize batch and streaming data ingestion pipelines from enterprise applications, databases, APIs, and file-based sources
Implement medallion/Lakehouse architectures, dimensional models, and data transformation workflows to support analytics and reporting use cases
Engineer solutions using technologies such as PySpark, Spark SQL, SQL, Python, Delta Lake, and orchestration tools within Azure and Databricks
Recommend best practices for data modeling, governance, lineage, monitoring, DevOps, and security
Help establish engineering standards, reusable frameworks, accelerators, and documentation for internal and client teams
Contribute to estimation, project planning, and delivery management for client engagements
Requirements
Bachelor’s degree in computer science or related field
8 years of experience in data engineering, data platform development, or cloud data solutions
3 years of hands-on experience with Azure Databricks, Apache Spark, or similar distributed data processing technologies
Expertise with Microsoft Azure infrastructure and data resources, including Fabric, Azure Data Factory, Synapse Data Analytics, Power BI, Azure SQL, Azure Cosmos DB
Deep expertise with Databricks, specifically the ability to design enterprise-level strategy and architecture including Unity Catalog, data warehousing, data sharing, and Mosaic AI
Experience setting end-to-end modern data platforms in Azure including architecture/design, ingestion, storage strategies, analytics & reporting, Apache Spark, and networking requirements
DevOps for data, GitHub, automated testing, and working with containers (AKS, Docker, registries, etc.)
Excellent communication skills, ability to clearly explain concepts to teammates and customers, and quickly learn new concepts and technologies.
Data Engineer providing technical expertise on mission - critical NAVSUP OIS program. Work involves data architecture and database management in AWS GovCloud environments.
Senior Data Engineer focusing on data infrastructure for an AI - driven insurtech startup based in Nepal. Collaborating with teams to optimize data models and maintain data quality.
Senior Professional Consultant leading architecture and design for SAP BW and SAC solutions at Freudenberg. Collaborating with stakeholders and optimizing performance of data landscapes.
Senior Data Engineer designing and managing data architectures to transform large - scale data into insights for Humana. Involves leading technical discussions and implementing best data practices.
Data Engineer II at Early Warning Services developing data science tools and infrastructure. Collaborating on software enhancements and mentoring interns in a hybrid work environment.
Senior Data Architect responsible for optimizing data architecture and supporting data - driven business decisions at TruStage. Leading technical guidance for data architecture and cross - functional team collaboration.
Senior Data Architect developing data architecture plans at The Hartford, collaborating with internal teams to align data standards and practices. Leading complex solutions with a focus on operational effectiveness.
Senior Solution Architect defining architecture framework for SA‑CCR in regulatory risk. Collaborating with stakeholders to ensure compliance and efficient data governance.
Senior Data Engineer optimizing and designing data pipelines on AWS for The Rec Hub. Collaborating with the team to enhance data processing and mentorship.