Big Data Engineer working within the Big Data Team using cutting edge technologies to collate data across different sources. Supporting an event driven micro service lambda architecture for a Tier 1 Platform.
Responsibilities
Participate in all agile scrum meetings such as daily standups, refinement sessions, retro sessions, etc
Maintaining the data platform by means of daily reconciliations, data reloads, tackling support tickets, etc.
Being able to come up with new ideas to improve existing products and services.
Implementation of bug fixes and enhancements within the data platform.
Performing code reviews for other engineers.
Taking ownership of releases where necessary
Being able to communicate with the respective stakeholders, making sure that all information is transmitted correctly and to the right audience.
Take ownership of complex, large-scale initiatives, including data migration projects, ensuring successful planning, execution, and delivery.
Requirements
Object oriented programming (Java)
Data modelling using any database technologies
ETL processes (ETLs are oldschool, we transfer in memory now) and experience with Apache Spark or Apache NiFi
Applied understanding of CI\CD in change management
Dockerised applications
Used distributed version control systems
Hold a Bachelor’s Degree in Computer Science or equivalent
Can collaborate in scoping exercises
Mentoring skills
Have worked with both Linux and Windows environments.
Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.