Working Student contributing to data engineering projects for AI/ML workflows while gaining hands - on experience with data pipelines and tools.
About the role
- Seeking a Data Architect experienced in designing scalable cloud data platforms and modern data ecosystems at Reply. Collaboration with customers and engineering teams for robust data solutions is key.
Responsibilities
- Design and lead end-to-end architecture for complex cloud-based data ecosystems, including lakehouse and enterprise data platforms.
- Translate business requirements into scalable architectural designs, roadmaps, and technical specifications, including advanced scenarios, such as establishing common data models across development teams, sharing multi-tenant system data directly to customers, integrations between Databricks and external data platforms, and handling RLS from Databricks source data to analytics and reporting tools.
- Architect and implement Databricks-based solutions, including Unity Catalog, Delta Lake, Databricks SQL, Workflows, and governance frameworks. Establish data governance policies in addition to technical solutions.
- Define and enforce data modelling standards for relational, dimensional, and lakehouse structures, including common data models across global systems.
- Architect and oversee development of ETL/ELT frameworks, source-to-target mappings, and reusable transformation standards, focusing on meta-data solutions.
- Establish best practices for data ingestion, curation, cataloging, lineage, quality, and MDM across the data ecosystem. Establish MDM solutions, preferably with Profisee.
- Partner with cross-functional engineering teams to ensure architectural consistency, performance optimization, and security compliance.
- Mentor and lead junior engineers, contributing to technical direction, design reviews, and architectural decision-making.
- Develop cloud-native reference architectures leveraging Azure Data Factory, Azure SQL, Synapse Analytics, Azure Data Lake, Stream Analytics, and other modern Azure services.
- Collaborate with executive and architect stakeholders to define data governance standards, taxonomy structures, and metadata strategies. Explain and defend architecture decisions to customers.
Requirements
- Bachelor’s Degree in Computer Science, Engineering, MIS, or a related field.
- 12+ years of experience in total along with strong data engineering or data platform development background and with at least 3+ years in data architecture roles.
- 3+ years of experience with Databricks, including Unity Catalog, Delta Lake, Databricks SQL, and Workflow orchestration.
- Strong proficiency with Python, Apache Spark, and distributed data processing frameworks.
- Advanced SQL expertise, including performance tuning, indexing, and optimization for large datasets.
- Proven experience designing and implementing lakehouse architectures and cloud data ecosystems.
- Hands-on experience with Azure Data Services: ADF, ADLS, Azure SQL, Synapse Analytics, Stream Analytics or Fabric equivalents.
- Strong understanding of data modelling principles (3NF, dimensional modelling, Kimball, Inmon) and enterprise data warehouse concepts.
- Prior consulting experience delivering analytics or data platform solutions to enterprise clients.
- Familiarity with CI/CD pipelines and IaC tools (Terraform, ARM, Bicep).
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Architect designing end - to - end Snowflake data solutions and collaborating with technical stakeholders at Emerson. Supporting the realization of Data and Digitalization Strategy.
Manager of Data Engineering leading data assets and infrastructure initiatives at CLA. Collaborating with teams to enforce data quality standards and drive integration efforts.
Data Engineer building modern Data Lake architecture on AWS and implementing scalable ETL/ELT pipelines. Collaborating across teams for analytics and reporting on gaming platforms.
Chief Data Engineer leading Scania’s Commercial Data Engineering team for growing sustainable transport solutions. Focused on data products and pipelines for BI, analytics, and AI.
Entry - Level Data Engineer at GM, focusing on building large scale data platforms in cloud environments. Collaborating with data engineers and scientists while migrating systems to cloud solutions.
Data Engineer designing and building scalable ETL/ELT pipelines for enterprise - grade analytics solutions. Collaborating with product teams to deliver high - quality, secure, and discoverable data.
Data Engineer responsible for data integrations with AWS technology stack for Adobe's Digital Experience. Collaborating with multiple teams to conceptualize solutions and improve data ecosystem.
People Data Architect designing and managing people data analytics for Gen, delivering actionable insights for HR. Collaborating across teams to enhance data - driven decision - making.
Data Engineer role focused on shaping future connectivity for customers at Vodafone. Involves solving complex challenges in a diverse and inclusive environment.