Data Engineer optimizing PostgreSQL and OpenSearch platforms at Deutschlandradio. Supporting media research with data analysis and maintaining high data quality in projects.
Responsibilities
Further development and optimization of our on-premise data platform (PostgreSQL, OpenSearch) for the analysis of podcast logfiles in particular
Maintenance and improvement of ETL/ELT pipelines (Airflow) for processing usage data from various sources
Maintenance of the CI/CD pipeline (GitLab) and deployment processes for automated data processing and dashboard updates
Technical support of our tracking solution (Piano Analytics) and ensuring high data quality for analyses
Provision of reliable data for the media research team and editorial departments, and support with technical questions regarding dashboards and reports
Further development of monitoring and alerting and ensuring GDPR compliance across all data processes
Requirements
Degree in Computer Science, Mathematics, Data Science or a comparable professional background with several years of experience as a Data Engineer
Strong programming skills in Python and solid SQL skills, ideally with practical experience in PostgreSQL
Experience with Airflow for orchestrating ETL/ELT pipelines and familiarity with GitLab CI/CD, Docker and Linux environments
Experience in logfile analysis and processing, and ideally knowledge of OpenSearch, Elasticsearch or similar search engines
Basic understanding of Machine Learning and NLP for future projects is desirable, as well as cloud experience (GCP, AWS)
Strong communication skills, enjoyment of independent work and the ability to convey technical matters clearly
Good written and spoken German (C1 level or higher)
Benefits
Exciting and creative tasks in a dynamic and motivated team
Work at a public-service broadcaster that follows the guiding principle of acting "confidently, respectfully and curiously" both internally and externally
The opportunity to contribute your own ideas and suggestions, as well as a variety of development and training opportunities
Flexible home office and mobile working options
Family-friendly employer and childcare during the summer holidays
Company pension scheme and other attractive collective-agreement social benefits
Discounted sports offerings through our corporate sports program and a partnership with Urban Sports Club
Good public transport connections and a monthly subsidy for the Deutschlandticket (nationwide public transport pass)
Meal options available at both Cologne and Berlin locations
Data Engineer creating clean, reliable data pipelines for Plenti, a fintech lender. Collaborating with modern tools like AWS and Databricks to enhance data quality and analytics.
Data Platform Specialist overseeing data quality and platform operations at Stackgini. Collaborating with teams to enhance data management solutions and improve system performance.
Staff Data Engineer at PPRO transforming data ecosystem into a self - service platform. Leading technical vision for data engineering and building scalable infrastructures.
SSIS Data Engineer at iKnowHow Group focusing on data migration projects. Involves data modeling, integration, and using T - SQL/SQL alongside SSIS packages.
Principal Data Engineer designing and implementing data solutions that ensure trust and transparency in supply chains. Collaborating with global teams and mentoring fellow engineers in data practices.
Senior Data Engineer role at Dun & Bradstreet focused on data analytics and visualization. Collaborating with teams to optimize data processes and deliver actionable insights.
Senior Data Engineer with AWS expertise leading financial data architecture and scalable solutions. Collaborating in wealth management to enhance data quality and systems.
Data Migration Specialist handling large - scale data migration from legacy to enterprise PLM platform. Analyzing data structures, developing strategies, and ensuring integrity across systems.
Director leading strategy, governance, and delivery of enterprise data platform at Phillips 66. Partnering with AI, Data Science, and business teams to enhance analytics and business systems.