About the role

  • Lead the technical discovery, design, and planning phases, effectively translating complex client business needs and requirements into detailed architectural blueprints and robust technical specifications.
  • Design and document the end-to-end data flow and pipeline orchestration, from various source system ingestion patterns (batch and streaming) to the final curated Gold Layer models, primarily utilizing **AWS Redshift**.
  • Define the **canonical data models** for the Silver Layer and establish the optimal **dimensional models** for the Gold Layer, leveraging data modeling tools like **Erwin**.
  • Provide clear technical leadership and oversight to the engineering and development teams, ensuring alignment with the established architectural vision.

Requirements

  • 15+ years of progressive experience in data engineering, data warehousing, and cloud architecture roles.
  • Minimum of 10 years specifically in a client-facing or leadership role designing and implementing large-scale data migration projects.
  • Candidates must demonstrate deep, hands-on experience and architectural proficiency across the following technologies:
  • **AWS Services:** Amazon EMR (Elastic MapReduce), Amazon S3, AWS Glue, and Amazon Redshift.
  • **Data Processing:** Expert knowledge in **PySpark** for large-scale data transformation and processing.
  • **Data Warehousing:** Proven experience designing and managing scalable data warehouse solutions, specifically using **Redshift**.
  • **Data Streaming:** Kafka and/or Amazon Kinesis.
  • **Data Warehouse:** Hands-on experience with **Snowflake**.
  • **Data Governance & Quality:** Experience with tools like DataHub and data quality frameworks such as **Great Expectations**.
  • **Modeling:** Advanced data modeling techniques and methodologies.
  • Participate in fast iteration cycles, adapting to evolving project requirements.
  • Collaborate as part of a cross-functional Agile team to create and enhance software that enables state-of-the-art big data and ML applications.
  • Collaborate with Data scientists, software engineers, data engineers, and other stakeholders to develop and implement best practices for MLOps, including CI/CD pipelines, version control, model versioning, monitoring, alerting and automated model deployment.
  • Ability to work with a global team, playing a key role in communicating problem context to the remote teams
  • Excellent communication and teamwork skills

Benefits

  • Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging and entrepreneurial environment, with a high degree of individual responsibility.

Job title

Solution Architect

Job type

Experience level

SeniorLead

Salary

Not specified

Degree requirement

No Education Requirement

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job