Data Engineer II leading development and delivery of data pipelines for Syneos Health. Collaborating with teams to optimize data processing and integrate solutions into production environments.
About the role
- Lead Data Engineer at Australian Payments Plus designing and productionising data pipelines. Collaborating on large data sets and ensuring data integrity for various payment solutions.
Responsibilities
- Lead and manage the delivery of data driven projects.
- Interrogate and interpret business requirements.
- Build and develop data pipelines to ingest and transform data. Make data available for business use, as per project and operational requirements.
- Ensure data integrity (accuracy, consistency, and completeness), of the data available on the modern data platform. (Snowflake)
- Work with data analysts and business users to build and maintain the master data catalogue and system documentation.
- Build and maintain integrations between data lake, data warehouse, real-time streaming platforms, databases, ETL tools, governance, and BI tools.
- Write python scripts to manipulate and transform complex datasets, merge different data sets together, reformat data.
- Create and Publish data flow diagrams and data models.
- Secure data at rest and in Transit through encryption.
- Deploy automated machine learning data models that meet the desired business outcomes.
- Support platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues.
- Work closely with the team to ensure deliverables and targets are being met.
- Constantly strive to improve delivery excellence and grow team engagement and mentor others within the team.
- Provide second level support on a rotational roster.
Requirements
- Tertiary qualification in engineering, mathematics, computer science, or a related discipline.
- 4-7 years of experience in building and maintaining bank grade data infrastructure.
- Experience in transforming and manipulating large and complex datasets.
- Experienced with SQL and NoSQL modern data stores, able to write complex queries and transformations.
- Experienced in implementing data warehousing (snowflake) solutions in large commercial environments and transforming and manipulating large and complex data sets.
- Enjoys working in an agile team and can work on user stories autonomously.
- Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Lead Data Engineer overseeing data operations and analytics engineering teams for OneOncology. Focused on operational excellence in data platform and model reliability for cancer care improvement.
Senior AWS Software Data Engineer at Boeing focusing on AWS Data services to support digital analytics capabilities. Collaborating with cross - functional teams to design, develop, and maintain software data solutions.
Senior Data Engineer designing and improving software for business capabilities at Barclays. Collaborating with teams to build a data and intelligence platform for Equity Derivatives.
Senior AI & Data Engineer developing and implementing AI solutions in collaboration with clients and teams. Working on projects involving generative AI, predictive analytics, and data mastery.
Consultant driving IA business growth in Deloitte's Artificial Intelligence & Data team. Delivering innovative solutions using data analytics and automation technologies.
Data Engineer responsible for managing data architecture and pipelines at Snappi, a neobank. Collaborating with teams to enable data processing and analysis in innovative banking solutions.
Data Engineer at Destinus developing the data platform to support production and analytics needs. Involves migrating Excel sources to Lakehouse and integrating ERP systems in a hybrid role.
Senior Data Engineer developing solutions within the Global Specialty portfolio at an insurance company. Engaging with diverse business partners to ensure high quality data reporting.
Data Engineer at UBDS Group focusing on designing and optimizing modern data platforms. Collaborating in a multidisciplinary team to develop reliable data assets for analytics and operational use cases.