Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
About the role
- Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.
Responsibilities
- Design, develop, and maintain data pipelines and transformation processes using modern data engineering tools
- Build and manage batch and real-time data processing solutions
- Develop curated, reusable data assets to support downstream analytics and reporting
- Ensure data quality, integrity, and consistency across multiple data sources
- Work with data ingested via APIs, file-based ingestion (e.g. SFTP), and event streams (e.g. Kafka)
- Optimise data pipelines for performance, scalability, and cost efficiency
- Contribute to the development of data platform components and reusable engineering patterns
- Work within established architecture and engineering standards
- Collaborate with DevOps engineers, testers, and architects to deliver end-to-end data solutions
- Support onboarding of new data sources and integration into existing platforms
- Contribute to knowledge sharing and continuous improvement within engineering teams
Requirements
- Experience in data engineering, building and maintaining data pipelines
- Strong hands-on experience with Python and PySpark
- Experience working with AWS data services (e.g. S3, EMR, Glue)
- Experience with event-driven architectures, particularly Kafka
- Understanding of batch and real-time data processing
- Experience working with large-scale datasets and distributed systems
- Familiarity with data quality, validation, and schema management
- Experience using Terraform and GitHub within a DevOps environment
- Ability to work within defined engineering standards and best practices
- Experience with Azure, Databricks, or Microsoft Fabric
- Experience in regulated environments
- Exposure to data migration from legacy systems
- Understanding of analytics, reporting, or data product use cases
- Experience working in collaborative, cross-functional teams
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer (dbt) at SDG Group involved in all phases of data projects. Collaborate on data ingestion, transformation, and visualization in a hybrid environment.
Data Consultant at SDG Group specializing in Data & Analytics projects. Collaborate on technical - functional definitions, ETL, data modeling, and visualization for cloud solutions.