Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
About the role
- Data Architect specializing in Azure and Databricks technologies at Ness Digital Engineering. Leading the design and implementation of enterprise-scale data solutions.
Responsibilities
- Lead the architecture, design, and implementation of enterprise data warehouses, data lakes, and lakehouses on Azure and Databricks
- Define and enforce data modeling standards, best practices, and guidelines
- Architect end-to-end modern data platforms leveraging Azure Synapse, Databricks, Delta Lake
- Design scalable ETL/ELT pipelines and orchestrate workflows for ingestion, transformation, and consumption
- Partner with business stakeholders, product teams, and data engineers to deliver high-quality data solutions
- Ensure solutions are secure, performant, and compliant with enterprise governance and regulatory standards
- Define data strategy and reference architecture for modernization from legacy to modern architectures
- Provide technical leadership and mentoring to engineering teams
Requirements
- 15+ years of experience in Data Engineering/Architecture
- Proven experience as a Data Architect or Senior Data Engineer/Lead designing and implementing enterprise data warehouses
- Hands-on expertise with Azure services: Azure Synapse Analytics, Azure Data Factory, Azure Data Lake Storage, Azure Purview
- Strong expertise with Databricks: Delta Lake, Lakehouse, Spark, MLflow
- Very strong SQL development and optimization skills
- Strong data modeling skills
- Knowledge of traditional data platforms
- Solid understanding of data governance, metadata management, data quality, and security
- Experience in building real-time/streaming data pipelines is a plus
- Bachelor’s/Master’s degree in Computer Science, Information Systems, or related field
- Certifications in Azure Data Engineer/Architect or Databricks preferred.
Benefits
- Flexible work arrangements
- Professional development opportunities
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.