Lead the technical discovery, design, and planning phases, effectively translating complex client business needs and requirements into detailed architectural blueprints and robust technical specifications.
Design and document the end-to-end data flow and pipeline orchestration, from various source system ingestion patterns (batch and streaming) to the final curated Gold Layer models, primarily utilizing **AWS Redshift**.
Define the **canonical data models** for the Silver Layer and establish the optimal **dimensional models** for the Gold Layer, leveraging data modeling tools like **Erwin**.
Provide clear technical leadership and oversight to the engineering and development teams, ensuring alignment with the established architectural vision.
Requirements
15+ years of progressive experience in data engineering, data warehousing, and cloud architecture roles.
Minimum of 10 years specifically in a client-facing or leadership role designing and implementing large-scale data migration projects.
Candidates must demonstrate deep, hands-on experience and architectural proficiency across the following technologies:
**Data Processing:** Expert knowledge in **PySpark** for large-scale data transformation and processing.
**Data Warehousing:** Proven experience designing and managing scalable data warehouse solutions, specifically using **Redshift**.
**Data Streaming:** Kafka and/or Amazon Kinesis.
**Data Warehouse:** Hands-on experience with **Snowflake**.
**Data Governance & Quality:** Experience with tools like DataHub and data quality frameworks such as **Great Expectations**.
**Modeling:** Advanced data modeling techniques and methodologies.
Participate in fast iteration cycles, adapting to evolving project requirements.
Collaborate as part of a cross-functional Agile team to create and enhance software that enables state-of-the-art big data and ML applications.
Collaborate with Data scientists, software engineers, data engineers, and other stakeholders to develop and implement best practices for MLOps, including CI/CD pipelines, version control, model versioning, monitoring, alerting and automated model deployment.
Ability to work with a global team, playing a key role in communicating problem context to the remote teams
Excellent communication and teamwork skills
Benefits
Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, fast-growing, challenging and entrepreneurial environment, with a high degree of individual responsibility.
Software Integration Engineer Grad Intern at Aerospace Corporation developing cloud native applications and backend services. Involves collaboration with leading scientists and engineers in high - tech environment.
Senior Solutions Engineer at Cloudflare driving customer success through technical expertise and collaboration. Collaborating across teams to ensure technical success for prospects and existing customers.
AI Solutions Engineer & Architect shaping AI solutions and strategies at HvS - Consulting in Germany. Responsible for integration of AI in business processes and continuous market observation.
SAP PP/DS Solution Architect delivering SAP transformations with a focus on process design and integration. Join a thriving partnership organization with an inspiring working environment.
Client Solutions Consultant managing digital banking propositions across the region. Collaborating with clients to drive transformation in existing banks.
Solution Architect at Stefanini designing integration solutions with IBM software and AWS. Collaborating with development teams to ensure successful implementations and maintain integration standards.
Senior Solutions Architect at Degreed, bridging technology and strategy to enhance upskilling solutions. Engaging with clients, guiding implementations, and contributing to AI initiatives for workforce development.
PLM Solution Architect contributing to a long - term defense project in Sweden. Involves PLM solution delivery in collaboration with an integration team.
Medior Solution Architect specializing in Finance & Operations for retail and supply chain sectors. Designing and implementing Dynamics 365 solutions aligned with business processes and requirements.
Solution Architect responsible for delivering SaaS solutions and managing client relationships for Omnea. Focused on strategic and operational tasks to ensure customer success and product implementation.