Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
Responsibilities
Design, implement and operate fully automated data pipelines (ETL, ELT, etc.) for efficient processing of large volumes of structured and unstructured data using Azure Databricks
Connect various internal (e.g. databases, APIs) and external data sources (including APIs, web crawlers)
Ensure technical and operational data quality and consistency through appropriate validation and cleansing processes
Monitor running data pipelines and processes and resolve any operational errors
Work closely with our Data Scientists, Data Analysts, Data Engineers and BI developers
Document work results in a structured, audience-appropriate manner
Requirements
Degree in Computer Science, Data Engineering, a natural science or a comparable field
Initial professional experience in Data Engineering
Knowledge of developing and optimizing data pipelines (ETL, ELT), ideally with Spark and Databricks
Experience with Python, SQL, Spark, etc., with a clear focus on Data Engineering
Solid basic understanding of connecting databases, APIs, etc. to a data platform
Implementation and adherence to high data protection and security standards in a regulated environment
Drive to continuously learn and proactively develop professionally
Very good German and good English skills, both written and spoken
Benefits
30 days of vacation + Rosenmontag (Carnival Monday) off
Flexible working hours and the option to work remotely up to 2 days per week
Internal complimentary courses and ongoing training and development
Occupational health promotion, sports and recreation programs (location Neuss)
Support for company pension scheme
Family-friendly policies, private supplementary insurance also available for dependents
Opportunity to study while working
Flat-hierarchy communication and regular feedback discussions
After-work events as well as summer and Christmas parties (location Neuss)
Employee offers via Corporate Benefits or other employee discounts for items such as electronics, travel or housing
Fully equipped kitchen with coffee, tea, water and fresh fruit
Subsidized delivered lunch and a snack vending machine offering sweet, healthy or hot snacks (location Neuss)
Covered free parking and lockable bicycle parking (location Neuss)
Good public transport connections
Option for a JobRad (bike leasing) and a discounted Deutschlandticket
Digital Analytics Capability - Adobe Data Engineer helping Bankwest with analytical foundations for digital experiences. Implementing and maintaining Adobe Experience Cloud applications for customer engagement.
AWS Data Architect overseeing enterprise data platform architecture for Signet Jewelers. Guiding engineering teams and ensuring data solutions are reliable and aligned with enterprise strategy.
MDM Data Engineer managing Profisee MDM platform and ensuring data quality in enterprise systems at Pacific Life. Collaborating with data stewards and integrating with upstream and downstream systems.
Senior/Lead Data Engineer at HOLYWATER TECH managing infrastructure for analytical platforms like BigQuery and data integration. Involves collaborations with Data Product Owners and significant engineering responsibilities.
Process Mining Data Engineer implementing Celonis across business units at LSEG. Collaborating with executives and teams to optimize operations and drive business outcomes.
Senior Data Engineer focusing on Retrieval - Augmented Generation (RAG) and AI solutions at LexisNexis. Collaborating with teams to integrate AI into existing systems and optimizing models for performance.
Senior Data Engineer on CNN's AI Enablement & Machine Learning team optimizing ML and AI experiences. Collaborating with engineers to enhance data pipelines and integrate features into platforms.
Data Engineer at Sand Cherry Associates with expertise in ETL, Python, and SQL. Responsible for designing data structures and maintaining accuracy for client projects.
Data Engineer responsible for creating and maintaining ETL pipelines at Sand Cherry Associates. Requires strong expertise in Redshift SQL, Python, and DBT with hybrid work structure.