Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
About the role
- Data Architect responsible for designing and enforcing Medallion Architecture for AI consultancy's Lakehouse implementations with a focus on data modeling and standards.
Responsibilities
- Design and enforce Medallion Architecture for the Lakehouse.
- Drive architectural decision-making through SAF/ARB architecture forums.
- Lead design for all Data Factory squads working on data initiatives.
- Define standards for Apache Iceberg tables, including partitioning strategy, schema evolution, time travel and snapshot retention, and table optimization schedules.
- Establish data modeling standards (e.g., dimensional modeling for Gold layer, SCD2, naming conventions, metadata management).
- Define lineage standards leveraging OpenMetadata.
- Coordinate with platform teams on Iceberg-related activities.
- Collaborate with Data Quality leads to implement validation rules.
- Proactively manage escalations and communicate progress with senior stakeholders.
- Provide guidance to Glue Data Engineers.
- Establish code review processes and best practices.
- Create reusable design patterns and templates for consistency.
Requirements
- data architecture roles, ideally 10 years+ with at least 3 years in Lakehouse implementations.
- Lakehouse architecture (S3, Iceberg, Glue, Spark).
- schema evolution, partitioning strategies, and table optimization in Iceberg.
- defining metadata management, lineage, and data quality frameworks.
- Medallion architecture and data modeling principles.
- leading architectural forums and influence decision-making.
- AWS services (S3, Glue, Athena, EMR).
- Apache Iceberg, Spark.
- OpenMetadata, or similar lineage tools.
- automating work / repetitive tasks.
- communicating and stakeholder management.
- working collaboratively across multiple squads and teams.
- working in a fast-paced environment and deliver aggressive migration targets.
- working with Jira and agile way of working.
Benefits
- Competitive salary and performance bonuses
- Comprehensive health insurance
- Professional development and certification support
- Opportunity to work on cutting-edge AI projects
- Flexible working arrangements
- Career advancement opportunities in a rapidly growing AI company
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.
VP, Senior Data Engineer responsible for designing and developing cloud data solutions for insider risk in Information Security at SMBC. Collaborating with multiple teams to enhance cybersecurity data platform.
Data Engineer responsible for architecting, developing, and maintaining Allegiant’s enterprise data infrastructure. Overseeing transition to cloud hosted data warehouse and developing next - generation data tools.
Senior Data Engineer developing Azure - based data solutions for clients in the Data & AI department. Collaborating with architects and consultants to enhance automated decision making.