Senior Big Data Engineer utilizing cutting-edge technologies for real-time data processing. Collaborating in an agile environment to enhance a high-traffic data platform.
Responsibilities
Participate in all agile scrum meetings such as daily standups, refinement sessions, retro sessions, etc
Maintaining the data platform by means of daily reconciliations, data reloads, tackling support tickets, etc.
Being able to come up with new ideas to improve existing products and services.
Implementation of bug fixes and enhancements within the data platform.
Performing code reviews for other engineers.
Taking ownership of releases where necessary
Being able to communicate with the respective stakeholders, making sure that all information is transmitted correctly and to the right audience.
Take ownership of complex, large-scale initiatives, including data migration projects, ensuring successful planning, execution, and delivery.
Requirements
Object oriented programming (Java)
Data modelling using any database technologies
ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
Applied understanding of CI\CD in change management
Dockerised applications
Used distributed version control systems
Excellent team player
Meticulous and passionate about your work
Functional oriented programming (experience with Python, Scala)
Analytical mindset
Low latency databases such as ClickHouse
Hold a Bachelor’s Degree in Computer Science or equivalent
Can collaborate in scoping exercises
Mentoring skills
Have worked with both Linux and Windows environments.
Data Warehouse Modelling Engineer designing and maintaining data models using Data Vault 2.0 for iGaming industry. Collaborating with stakeholders and optimizing data models in a hybrid work environment.
Senior Data Engineer driving impactful data solutions for the climate logistics startup HIVED's core data platform. Collaborating with cross - functional squads to enhance analytics and delivery.
Data Engineer developing and maintaining CRE forecasting infrastructure for Cushman & Wakefield. Collaborates with senior economists and technical teams to ensure high - quality data solutions.
Data Engineer at PwC, engaging with Azure cloud services to enhance data handling and integrity. Responsibilities include pipeline optimizations, documentation, and collaboration with stakeholders.
Data Engineer Manager at PwC focusing on building data infrastructure and solutions. Leading data engineering projects to transform raw data into actionable insights and drive business growth.
Junior Data Engineer at OneMarketData focusing on data quality and integrity in financial datasets. Collaborating with senior analysts and assisting in data management and analysis tasks.
Senior Data Engineering Analyst developing and implementing data solutions. Collaborating in a diverse environment focused on data processing and analysis for clients' digital transformation.
Principal Software Engineer in Threat Data Platform developing AI - driven tools for threat intelligence automation. Collaborating on robust data pipelines for PANW’s product ecosystem.
Senior Azure Data Engineer maintaining business intelligence solutions for Grupo Gloria, implementing and stabilizing projects in Azure and Databricks with Power BI reporting.