Senior Big Data Engineer utilizing cutting-edge technologies for real-time data processing. Collaborating in an agile environment to enhance a high-traffic data platform.
Responsibilities
Participate in all agile scrum meetings such as daily standups, refinement sessions, retro sessions, etc
Maintaining the data platform by means of daily reconciliations, data reloads, tackling support tickets, etc.
Being able to come up with new ideas to improve existing products and services.
Implementation of bug fixes and enhancements within the data platform.
Performing code reviews for other engineers.
Taking ownership of releases where necessary
Being able to communicate with the respective stakeholders, making sure that all information is transmitted correctly and to the right audience.
Take ownership of complex, large-scale initiatives, including data migration projects, ensuring successful planning, execution, and delivery.
Requirements
Object oriented programming (Java)
Data modelling using any database technologies
ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
Applied understanding of CI\CD in change management
Dockerised applications
Used distributed version control systems
Excellent team player
Meticulous and passionate about your work
Functional oriented programming (experience with Python, Scala)
Analytical mindset
Low latency databases such as ClickHouse
Hold a Bachelor’s Degree in Computer Science or equivalent
Can collaborate in scoping exercises
Mentoring skills
Have worked with both Linux and Windows environments.
Data Engineer I building and operationalizing complex data solutions for Travelers' analytics using Databricks. Collaborating within teams to educate end users and support data governance.
Data Engineer shaping modern data architecture to drive golf’s digital transformation. Collaborating with teams to enhance data pipelines and insights for customer engagement and revenue growth.
Staff Data Engineer overseeing complex data systems for CITY Furniture. Responsible for architecting and optimizing data ecosystems in a hybrid work environment.
Data Engineer strengthening data platform team at Samba TV to improve data analytics and reporting capabilities. Building on AWS, Databricks, BigQuery, and Snowflake technology.
Data Engineer focusing on secure ETL/ELT data pipelines and compliance in healthcare. Designing scalable ingestion frameworks and ensuring alignment with federal standards.
Data Migration Engineer at Capgemini delivering migration solutions for Guidewire Claim Center. Collaborating on cloud data migrations and validating processes in a sustainable tech environment.
Data Engineer responsible for collecting and analyzing data at Cruise Planners. Collaborate with teams for actionable insights using MySQL and Power BI.
Data Engineer for Leader Entertainment developing data solutions on Google Cloud Platform. Collaborating on data models, pipelines, and analytics in a hybrid role.
Senior Data Engineer designing and scaling data foundations for AI adoption across Ad Tech. Collaborating with cross - functional teams to deliver robust pipelines for high - profile AI applications.
Specialist in Data Engineering leading pipeline optimization at Inmetrics. Collaborating in innovative data - driven projects within a hybrid work environment.