Lead Data Engineer at Australian Payments Plus designing and productionising data pipelines. Collaborating on large data sets and ensuring data integrity for various payment solutions.
Responsibilities
Lead and manage the delivery of data driven projects.
Interrogate and interpret business requirements.
Build and develop data pipelines to ingest and transform data. Make data available for business use, as per project and operational requirements.
Ensure data integrity (accuracy, consistency, and completeness), of the data available on the modern data platform. (Snowflake)
Work with data analysts and business users to build and maintain the master data catalogue and system documentation.
Build and maintain integrations between data lake, data warehouse, real-time streaming platforms, databases, ETL tools, governance, and BI tools.
Write python scripts to manipulate and transform complex datasets, merge different data sets together, reformat data.
Create and Publish data flow diagrams and data models.
Secure data at rest and in Transit through encryption.
Deploy automated machine learning data models that meet the desired business outcomes.
Support platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues.
Work closely with the team to ensure deliverables and targets are being met.
Constantly strive to improve delivery excellence and grow team engagement and mentor others within the team.
Provide second level support on a rotational roster.
Requirements
Tertiary qualification in engineering, mathematics, computer science, or a related discipline.
4-7 years of experience in building and maintaining bank grade data infrastructure.
Experience in transforming and manipulating large and complex datasets.
Experienced with SQL and NoSQL modern data stores, able to write complex queries and transformations.
Experienced in implementing data warehousing (snowflake) solutions in large commercial environments and transforming and manipulating large and complex data sets.
Enjoys working in an agile team and can work on user stories autonomously.
Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment.
Data Architect responsible for designing data systems architecture at Amoddex, a consulting firm specialized in IT strategy and transformation. Collaborate on various data projects to enhance organization processes.
Senior Data Engineer delivering scalable cloud - based data solutions for ASSA ABLOY. Collaborating with cross - functional teams to fulfill data & analytics strategy in a dynamic environment.
Manager of Data Engineering & Automation leading automated, data - driven solutions for Finance at Adobe. Overseeing a team focusing on ETL, RPA, AI, and other technologies for operational excellence.
Senior Data Engineer for major American investment client at CI&T. Joining a team specializing in tech transformation combining human expertise and AI.
Data Architect II designing and implementing data solutions for SAP and Microsoft Fabric integration at Sun Chemical. Leading modernization efforts in enterprise data ecosystems with advanced analytics.
Data Engineer Analyst democratizing finance data at Itaú. Supporting decision - making processes for Finance and Risk business areas with high - quality data.
Sr. Data Engineer for Aramark, developing cloud - native service - oriented products to enhance data processing capabilities. Work closely with teams to deliver modern data products and frameworks.
Data Architect defining, evolving, and governing data models for capital markets trading and finance at a leading global firm. Engaging with senior stakeholders in a hybrid role based in London.
Data Engineer building data solutions for clients at Aambience Services using innovative technologies. Collaborating with teams to ensure data quality and performance.
Data Architect designing and implementing data solutions and governance procedures for Uni Systems. Optimizing data architecture and collaborating on business intelligence projects in a hybrid environment.