Data Engineer optimizing PostgreSQL and OpenSearch platforms at Deutschlandradio. Supporting media research with data analysis and maintaining high data quality in projects.
Responsibilities
Further development and optimization of our on-premise data platform (PostgreSQL, OpenSearch) for the analysis of podcast logfiles in particular
Maintenance and improvement of ETL/ELT pipelines (Airflow) for processing usage data from various sources
Maintenance of the CI/CD pipeline (GitLab) and deployment processes for automated data processing and dashboard updates
Technical support of our tracking solution (Piano Analytics) and ensuring high data quality for analyses
Provision of reliable data for the media research team and editorial departments, and support with technical questions regarding dashboards and reports
Further development of monitoring and alerting and ensuring GDPR compliance across all data processes
Requirements
Degree in Computer Science, Mathematics, Data Science or a comparable professional background with several years of experience as a Data Engineer
Strong programming skills in Python and solid SQL skills, ideally with practical experience in PostgreSQL
Experience with Airflow for orchestrating ETL/ELT pipelines and familiarity with GitLab CI/CD, Docker and Linux environments
Experience in logfile analysis and processing, and ideally knowledge of OpenSearch, Elasticsearch or similar search engines
Basic understanding of Machine Learning and NLP for future projects is desirable, as well as cloud experience (GCP, AWS)
Strong communication skills, enjoyment of independent work and the ability to convey technical matters clearly
Good written and spoken German (C1 level or higher)
Benefits
Exciting and creative tasks in a dynamic and motivated team
Work at a public-service broadcaster that follows the guiding principle of acting "confidently, respectfully and curiously" both internally and externally
The opportunity to contribute your own ideas and suggestions, as well as a variety of development and training opportunities
Flexible home office and mobile working options
Family-friendly employer and childcare during the summer holidays
Company pension scheme and other attractive collective-agreement social benefits
Discounted sports offerings through our corporate sports program and a partnership with Urban Sports Club
Good public transport connections and a monthly subsidy for the Deutschlandticket (nationwide public transport pass)
Meal options available at both Cologne and Berlin locations
Snowflake Data Engineer responsible for data pipelines and warehouses for enterprise analytics at Liberty Coca - Cola. Collaborating across business functions to ensure high data quality and performance.
Full - Stack Data Engineer designing and optimizing complex data solutions for automotive content. Collaborating with teams to enhance user experience across MOTOR's product lines.
Principal Data Engineer designing and evolving enterprise data platform. Collaborating with analytics teams to enable AI and data products at American Tower.
BI Data Engineer II supporting scalable Lakehouse data pipelines at Boston Beer Company. Collaborating with stakeholders to drive data ingestion and maintain enterprise data quality.
Senior Data Engineer at A Kube Inc responsible for building and maintaining data pipelines for product performance. Collaborating with product, engineering, and analytics teams to ensure data quality and efficiency.
Data Engineer engineering DUAL Personal Lines’ strategic data platforms for global insurance group. Providing technical expertise in data engineering and collaborating with internal teams for solution delivery.
Data Engineer role focused on creating and monitoring data pipelines in an innovative energy company. Collaborate with IT and departments to ensure quality data availability in a hybrid work environment.
SQL Migration Data Engineer at Auxo Solutions focusing on Azure SQL/Fabric Lakehouse migrations and building data pipelines. Collaborating on technical designs and data governance for modernization initiatives.