Palantir Data Engineer supporting production data pipelines at a global data and AI company. Monitoring workflows, troubleshooting issues, and ensuring data system reliability.
About the role
- Senior Data Engineer developing high-impact data solutions for the finance sector at Extractta. Collaborating in a dynamic team while ensuring data governance and security standards.
Responsibilities
- Design, develop and support robust data infrastructure solutions with a focus on scalability, security and efficiency.
- Lead the implementation and maintenance of ecosystems such as Trino, AWS Glue, Redshift, Airflow, Kafka and Spark on Kubernetes (K8s).
- Collaborate with engineering, data science and product teams to ensure smooth integration across systems.
- Diagnose and resolve performance, scalability and reliability incidents.
- Apply and promote best practices in architecture, governance and data monitoring.
Requirements
- Strong experience with data infrastructure ecosystems: Trino, AWS Glue, Terraform, CI/CD, Apache Airflow, Kafka and Spark on Kubernetes.
- Proven experience with cloud computing (AWS).
- Advanced proficiency in Python (including PySpark) and object-oriented programming.
- Demonstrated experience with distributed systems, data warehouses and large-scale ETL/ELT pipelines.
- Practical knowledge of data governance, security and storage (e.g., S3, Redshift).
- Analytical skills and problem-solving with a focus on operational efficiency.
- Good communication skills and experience working collaboratively.
- Certifications such as AWS Certified Solutions Architect or similar (preferred).
- Familiarity with Trino for ad-hoc analysis (preferred).
- Experience with monitoring tools like Datadog or New Relic (preferred).
- Knowledge of data-applied AI, particularly RAG (Retrieval-Augmented Generation) (preferred).
Benefits
- Competitive compensation based on experience;
- Opportunities for growth within the company and participation in strategic projects;
- Dynamic and challenging work environment;
- Opportunity to work at a growing company in the market.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Senior Azure Data Architect responsible for designing, deploying, and managing scalable cloud infrastructure on Microsoft Azure. Requires over 9 years of experience in cloud architecture and engineering.
Senior Data Engineer designing and building automated data platforms and pipelines for Coody clients. Delivering efficient solutions in a consultant role across exciting industries and companies.
Senior Data Platform Consultant driving analytics solutions on Databricks for Snap's clients. Leading architecture and delivery while shaping Databricks capability growth within the team.
Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.