Senior Data Engineer in Porto Bank developing and managing scalable data architectures and systems. Focused on integrating diverse data solutions while identifying and managing risks.
Responsibilities
Develop a robust, scalable Data Architecture to support data teams (Analytics, BI, Data Science, Machine Learning and other verticals) and business stakeholders, democratizing access to data in a secure, simple, structured and high-quality manner;
Design, build, and integrate monitoring mechanisms to track the health and performance of the data ecosystem;
Design and implement development standards and best practices, and document the environment and deliverables;
Document, monitor and ensure data quality;
Design and enforce best practices for pipeline development, with a focus on performance and scalability;
Ensure and maintain a cross-functional view to relate and integrate areas (Data Products and MLOps) and data solutions;
Ensure knowledge is shared across the team;
Identify, manage and mitigate risks related to activities under your and the team's responsibility;
Ensure and implement the designed data architecture;
Ensure accurate understanding of business needs and strategic vision;
Ensure that all mapped requirements to be developed are delivered with quality, scalability and on schedule.
Requirements
Bachelor's degree in Engineering, Computer Science, or a related field;
Experience with Azure and/or AWS;
Experience with Databricks;
Experience with Delta Lake / Lakehouse architectures;
Experience with Cosmos DB, Azure Synapse and Analysis Services;
Experience with Python, SQL and PySpark;
Experience with distributed data processing;
Experience with continuous integration and continuous delivery (CI/CD) pipelines and/or Azure DevOps;
Senior hands - on engineering lead at Electric Mind focusing on data platforms, AI, and analytics. Collaborating with teams on complex, mission - critical transformations in technology solutions.
AI Data Engineer (Azure + Copilot Studio) developing data pipelines and AI agent solutions. Involves working with Azure Data Factory, Copilot Studio, and data integration in a hybrid role.
Data Engineer developing scalable data architectures supporting analytics and ML at Porto Bank. Ensuring quality and efficient data integration while managing risks and standards.
Engineer of Data designing and architecting data for educational intelligence. Collaborating on data analytics and visualization in business decision - making processes.
Senior Data Engineer building data pipelines and analytics solutions in a healthcare - focused R&D environment. Collaborating with cross - functional teams to support AI and scientific advancement.
Lead Data Engineer building reliable data infrastructure at Eve, a legal technology company. Architecting data systems to enable data - driven decision making for law firms.
Senior Data Engineer designing and delivering scalable data pipelines and high performance analytical solutions on Google Cloud. Enhance data quality via KPIs and migrate data platforms to cloud - native ecosystems.
As a Mid/Senior Data Engineer at Cloud++, work on designing robust ETL/ELT pipelines and data models, enabling data - driven decision - making with cloud technologies.
Senior Data Engineer responsible for designing and building real - time data pipelines using Apache Kafka. Collaborating with cross - functional teams to support data - driven applications.
Senior Data Architect working on data architecture and integration at CenterWell. Ensuring solutions meet technical robustness and business needs while collaborating with various stakeholders.