Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
About the role
- Data Architect responsible for designing and enforcing Medallion Architecture for AI consultancy's Lakehouse implementations with a focus on data modeling and standards.
Responsibilities
- Design and enforce Medallion Architecture for the Lakehouse.
- Drive architectural decision-making through SAF/ARB architecture forums.
- Lead design for all Data Factory squads working on data initiatives.
- Define standards for Apache Iceberg tables, including partitioning strategy, schema evolution, time travel and snapshot retention, and table optimization schedules.
- Establish data modeling standards (e.g., dimensional modeling for Gold layer, SCD2, naming conventions, metadata management).
- Define lineage standards leveraging OpenMetadata.
- Coordinate with platform teams on Iceberg-related activities.
- Collaborate with Data Quality leads to implement validation rules.
- Proactively manage escalations and communicate progress with senior stakeholders.
- Provide guidance to Glue Data Engineers.
- Establish code review processes and best practices.
- Create reusable design patterns and templates for consistency.
Requirements
- data architecture roles, ideally 10 years+ with at least 3 years in Lakehouse implementations.
- Lakehouse architecture (S3, Iceberg, Glue, Spark).
- schema evolution, partitioning strategies, and table optimization in Iceberg.
- defining metadata management, lineage, and data quality frameworks.
- Medallion architecture and data modeling principles.
- leading architectural forums and influence decision-making.
- AWS services (S3, Glue, Athena, EMR).
- Apache Iceberg, Spark.
- OpenMetadata, or similar lineage tools.
- automating work / repetitive tasks.
- communicating and stakeholder management.
- working collaboratively across multiple squads and teams.
- working in a fast-paced environment and deliver aggressive migration targets.
- working with Jira and agile way of working.
Benefits
- Competitive salary and performance bonuses
- Comprehensive health insurance
- Professional development and certification support
- Opportunity to work on cutting-edge AI projects
- Flexible working arrangements
- Career advancement opportunities in a rapidly growing AI company
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.