Palantir Data Engineer supporting production data pipelines at a global data and AI company. Monitoring workflows, troubleshooting issues, and ensuring data system reliability.
About the role
- Senior Data Engineer developing scalable data architectures and integrating data ecosystems at Porto Bank. Ensuring data quality and effective pipeline development for various business teams.
Responsibilities
- Develop robust, scalable data architectures that support data and business teams;
- Design, build and integrate monitoring mechanisms and oversight for the data ecosystem;
- Design and build development and documentation standards and best practices;
- Document, monitor and ensure data quality;
- Design and enforce best practices for pipeline development;
- Ensure knowledge is shared across the team;
- Identify, manage and mitigate risks related to the team’s activities;
- Ensure proper understanding of business needs and strategic vision;
Requirements
- Degree in Engineering, Computer Science or related fields;
- Experience with Azure and/or AWS;
- Experience with Databricks;
- Experience with Delta Lake / Lakehouse;
- Experience with CosmosDB, Azure Synapse and Analysis Services;
- Experience with Python, SQL and PySpark;
- Experience with distributed data processing;
- Experience with continuous integration and delivery (CI/CD) pipelines and/or Azure DevOps;
- Experience with API development and/or Azure Functions;
Benefits
- Flexible meal and food allowances;
- Health insurance;
- Dental plan;
- Wellhub and TotalPass;
- Exclusive access to Bio Ritmo gym for employees;
- Profit sharing (PLR);
- Equity program — "Porto em Ação";
- Sand courts and multi-sport courts;
- Transport voucher (Vale-Transporte);
- Van shuttle services;
- Extended parental leave;
- Extended maternity leave;
- Medical clinic with specialist services;
- Childcare or babysitter allowance;
- Life insurance;
- Private pension plan — PortoPrev;
- Discounts on products and services;
- Tuition assistance: reimbursement for undergraduate, postgraduate or MBA studies;
- Monthly running events;
- Language course reimbursement (English or Spanish);
- Porto Theater: exclusive sessions for employees;
- Library;
- Break room;
- Game room;
- Massage and podiatry services;
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Azure Data Architect responsible for designing, deploying, and managing scalable cloud infrastructure on Microsoft Azure. Requires over 9 years of experience in cloud architecture and engineering.
Senior Data Engineer designing and building automated data platforms and pipelines for Coody clients. Delivering efficient solutions in a consultant role across exciting industries and companies.
Senior Data Platform Consultant driving analytics solutions on Databricks for Snap's clients. Leading architecture and delivery while shaping Databricks capability growth within the team.
Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.