Data Engineer designing and optimizing data pipelines using Databricks and Google Cloud Platform. Collaborating with analysts and scientists to deliver high - quality data products.
About the role
- Data Engineer responsible for gathering and processing data using cutting-edge frameworks at Diconium. Collaborating with stakeholders to design and manage data pipelines for various fields.
Responsibilities
- Gather and process raw, structured, semi-structured, and unstructured data using batch and real-time data processing frameworks
- Monitor and improve the performance of the pipelines
- Work on fast paced and innovative projects with the goal to deliver innovative solutions for our customers
- Support different stakeholders (internal/external) in making the right technology decisions
- Design, implement, and manage data pipelines for our clients (internal/external)
- Support our customers in obtaining the necessary data easily and transparently in order to develop intelligent data products in different fields (mobility, automotive, industrial, consumer, financial & non-profit organizations)
Requirements
- Python
- Scripting (Bash/Python/Go/Ruby)
- ETL
- Spark
- Amazon Web Services (AWS)
- Good communication skills
- CI/CD
- Data Warehouse
- Data Architecture
- Streaming Processing (Kafka, eventhub etc)
- SQL
- Relevant working experience of 5+ years
Benefits
- Discover new skills and improve your strengths
- Adapt your working day to your personal lifestyle
- Celebrate community, sustainability and diversity
- Develop yourself both professionally and personally through training programs
- Free language courses
- Competence centers and an active tech community
- Benefit from hybrid work
- Workation
- Flexible hours
- Parental support
- Sabbaticals
- Enjoy public transport tickets
- Job bikes
- Health offers
- Supplementary insurances
- Pension plan
- Various discounts
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.
Associate Data Engineer supporting privacy engineering controls and executing privacy impact assessments in a financial services company. Collaborating across business units to ensure alignment with privacy regulations.
Data Engineer at CVS Health optimizing data pipelines and analytical models. Driving data - driven decisions with healthcare data for improved business outcomes.
Senior Data Engineer at CVS Health developing robust data pipelines for healthcare data. Collaborating with teams to provide actionable insights and integrate them with consumer touchpoints.
Senior Data Engineer supporting AI - enabled financial compliance initiative with data pipelines and ingestion processes. Collaborating with diverse teams in a mission - critical regulated environment.
Data Architect leading the definition and construction of cloud data architecture for Kyndryl. Participating in significant technological modernization initiatives, focusing on Google Cloud Platform.
Senior Data Engineer driving data intelligence requirements and scalable data solutions for a global consulting firm. Collaborating across functions to enhance Microsoft architecture and analytics capabilities.
Experienced AI Engineer designing and building production - grade agentic AI systems using generative AI and large language models. Collaborating with data engineers, data scientists in a tech - driven company.
Intermediate Data Engineer designing and building data pipelines for travel industry data management. Collaborating across teams to ensure reliable data for analytics and reporting.