Forward Deployed Engineer owning end - to - end enterprise deployments at HeyGen for dynamic AI video solutions. Collaborating with customers to integrate systems and provide technical leadership.
About the role
- Engenheiro(a) de Dados responsável por desenvolvimento de pipelines e otimização de dados em Azure. Focando na qualidade de dados e na arquitetura Medallion.
Responsibilities
- Pipeline Development: Build and maintain robust data pipelines using PySpark in the Azure Databricks environment, ensuring high availability and continuous data flow.
- Medallion Architecture: Implement and manage the data lifecycle following a layered structure (Bronze, Silver, Gold), ensuring organization and quality from ingestion through consumption.
- Ingestion and Integration: Configure ETL/ELT workflows from heterogeneous sources (SQL Server, APIs, streaming) using Azure Data Factory and Azure Data Lake Storage (ADLS).
- Optimization and Monitoring: Oversee cluster and process performance with a focus on scalability, latency reduction, and cost-efficiency in the cloud.
- Data Quality: Develop data cleansing, processing and enrichment routines to turn raw data into assets ready for business analysis.
- Security and Governance: Document technical processes and ensure all pipelines comply with data security and privacy policies.
Requirements
- Education: Bachelor's degree in Computer Science, Engineering, Data Science or related IT fields.
- Azure Cloud: Hands-on experience with the Microsoft data ecosystem.
- Technical Stack: Advanced proficiency in Databricks, PySpark, Python and SQL.
- Architecture: Solid experience with Medallion Architecture, Data Lake concepts and Delta Lake technology.
- Modeling: Knowledge of data modeling (Dimensional/Star schema).
- Visualization: Basic knowledge of Power BI to support the consumption (Gold) layer.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Environmental Engineer or Geoscientist involved in environmental site investigations and remediation across multiple Canadian locations. Leading projects and mentoring staff within a collaborative team.
Project Engineer managing projects in the food & beverage sector. Collaborating with internal teams and stakeholders to deliver successful project outcomes within budget and timeline.
Senior System & Safety Engineer at Vay owning the system architecture for Remote Driving technology. Working at the intersection of hardware, software, and vehicle integration.
Embedded Software Engineer at Ford developing software for Advanced Driver Assistance Systems. Collaborating cross - functionally on product lifecycle and ensuring quality through rigorous testing.
GC
Junior Engineer assisting with type approval activities for maritime equipment and systems. Working with experienced engineers in an international team based in Norway or Germany.
Mid - Level IAM Engineer at Crypto.com focusing on agentic AI management and identity ecosystem protection in cloud - native environments.
Mid - Level IAM Engineer designing and managing identity solutions for Crypto.com. Focus on security across cloud - native environments and integration of AI technologies.
Mid - Level IAM Engineer focusing on Agentic AI management for Identity Security Team at Crypto.com. Joining a team dedicated to leveraging security technologies for user protection.
Mid - Level IAM Engineer focusing on Agentic AI management in a cloud - native environment at Crypto.com. Join a seasoned Security Team dedicated to user security and protection.