Senior Data Engineer developing scalable data architectures and integrating data ecosystems at Porto Bank. Ensuring data quality and effective pipeline development for various business teams.
Responsibilities
Develop robust, scalable data architectures that support data and business teams;
Design, build and integrate monitoring mechanisms and oversight for the data ecosystem;
Design and build development and documentation standards and best practices;
Document, monitor and ensure data quality;
Design and enforce best practices for pipeline development;
Ensure knowledge is shared across the team;
Identify, manage and mitigate risks related to the team’s activities;
Ensure proper understanding of business needs and strategic vision;
Requirements
Degree in Engineering, Computer Science or related fields;
Experience with Azure and/or AWS;
Experience with Databricks;
Experience with Delta Lake / Lakehouse;
Experience with CosmosDB, Azure Synapse and Analysis Services;
Experience with Python, SQL and PySpark;
Experience with distributed data processing;
Experience with continuous integration and delivery (CI/CD) pipelines and/or Azure DevOps;
Experience with API development and/or Azure Functions;
Benefits
Flexible meal and food allowances;
Health insurance;
Dental plan;
Wellhub and TotalPass;
Exclusive access to Bio Ritmo gym for employees;
Profit sharing (PLR);
Equity program — "Porto em Ação";
Sand courts and multi-sport courts;
Transport voucher (Vale-Transporte);
Van shuttle services;
Extended parental leave;
Extended maternity leave;
Medical clinic with specialist services;
Childcare or babysitter allowance;
Life insurance;
Private pension plan — PortoPrev;
Discounts on products and services;
Tuition assistance: reimbursement for undergraduate, postgraduate or MBA studies;
Monthly running events;
Language course reimbursement (English or Spanish);
Google Data Architect creating and optimizing data solutions using GCP technologies. Collaborating with teams to enhance enterprise data architecture across business functions.
Azure Lead Data Engineer designing and developing ETL/ELT pipelines with Azure Data Factory and Snowflake. Collaborating with cross - functional teams in a cloud - native environment.
Principal Data Engineer leading Azure platform designs and implementations for enterprise solutions at UBDS Group. Mentoring teams and driving high engineering standards in hybrid environments.
Data Engineer designing and maintaining the data systems for Skiffra’s AI - native orchestration platform. Collaborating closely with product and engineering teams for data integration and system design.
Data Engineer at Kyndryl designing and maintaining data pipelines using AWS and Python. Optimizing ingestion, transformation workflows, and cloud solutions for large - scale data environments.
Data Architect responsible for the integrity and reliability of Patient Services data in Life Sciences. Ensuring analytics - ready data through strategic vendor collaboration and data stewardship.
Project & Data Engineer providing operational support and data management for utility service projects in the Greater Los Angeles area. Involves invoice processing, data accuracy, and system coordination.
Data Engineering Advisor designing data flow management systems to support advanced analytics at Desjardins Group. Collaborate with teams to enhance data value and transformation.
Founding Staff Data Engineer building and leading data engineering team for AI - driven art valuation platform. Establishing architecture and standards for data systems and pipelines.