Palantir Data Engineer supporting production data pipelines at a global data and AI company. Monitoring workflows, troubleshooting issues, and ensuring data system reliability.
About the role
- Data Engineer responsible for gathering and processing data using cutting-edge frameworks at Diconium. Collaborating with stakeholders to design and manage data pipelines for various fields.
Responsibilities
- Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks
- Monitor and improve the performance of the pipelines
- Work on fast paced and innovative projects with the goal to deliver innovative solutions for our customers
- Support different stakeholders (internal/external) in making the right technology decisions
- Design, implement, and manage data pipelines for our clients (internal/external)
- Support our customers in obtaining the necessary data easily and transparently in order to develop intelligent data products in different fields (mobility, automotive, industrial, consumer, financial & non-profit organizations)
Requirements
- Python
- Scripting (Bash/Python/Go/Ruby)
- ETL
- Spark
- Amazon Web Services (AWS)
- Good communication skills
- CI/CD
- Data Warehouse
- Data Architecture
- Streaming Processing (Kafka, eventhub etc)
- SQL
- Relevant working experience of 5+ years
Benefits
- Discover new skills and improve your strengths
- Adapt your working day to your personal lifestyle
- Celebrate community, sustainability and diversity
- Develop yourself both professionally and personally through training programs
- Free language courses
- Competence centers and an active tech community
- Benefit from hybrid work
- Workation
- Flexible hours
- Parental support
- Sabbaticals
- Enjoy public transport tickets
- Job bikes
- Health offers
- Supplementary insurances
- Pension plan
- Various discounts
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Azure Data Architect responsible for designing, deploying, and managing scalable cloud infrastructure on Microsoft Azure. Requires over 9 years of experience in cloud architecture and engineering.
Senior Data Engineer designing and building automated data platforms and pipelines for Coody clients. Delivering efficient solutions in a consultant role across exciting industries and companies.
Senior Data Platform Consultant driving analytics solutions on Databricks for Snap's clients. Leading architecture and delivery while shaping Databricks capability growth within the team.
Data Engineer Associate developing and implementing data solutions within PNC's Asset Management Group. Collaborating on technical solutions using PySpark, Hadoop, and SQL for scalable data systems.
Senior Data Engineer at Assembly working on data integration, transformation, and analytics collaboration. Handling cloud services and data quality across data projects with cross - functional teams.
Senior Data Engineer developing scalable data pipelines and collaborating with cross - functional teams at Technis. Technical guidance in a hybrid work environment based in Lausanne, Switzerland.
Data Engineer designing and maintaining data pipelines for CIEE, a philanthropic institution supporting youth development. Collaborating with Data Analysts for data quality and reliability.
Senior Data Engineer responsible for designing and implementing data solutions at Harambee. Collaborating with various stakeholders to enhance technology supporting work - seekers' journeys.
Senior Manager Data Engineer at Squarcle delivering technical leadership in data engineering and compliance with business objectives. Leading teams to optimize and develop data platforms for clients.