Senior Consultant focusing on data migrations within Master Data Management for Scheer group. Engaging in project leadership, consulting, and strategy development for data migration projects.
About the role
- Data Engineer developing data pipelines and data assets at Australian Payments Plus. Managing complex datasets and ensuring data integrity using modern data platforms.
Responsibilities
- Build and develop data pipelines to ingest and transform data. Make data available for business use, as per project and operational requirements.
- Ensure data integrity (accuracy, consistency, and completeness), of the data available on the modern data platform (Snowflake).
- Work with data analysts and business users to build and maintain the master data catalogue and system documentation.
- Build and maintain integrations between data lake, data warehouse, real-time streaming platforms, databases, ETL tools, governance, and BI tools.
- Write python scripts to manipulate and transform complex datasets, merge different data sets together, reformat data.
- Create and Publish data flow diagrams and data models.
- Secure data at rest and in Transit through encryption.
- Deploy automated machine learning data models that meet the desired business outcomes.
- Support platform enhancements, capacity management, performance monitoring, troubleshooting and resolution of technical issues.
- Work closely with the team to ensure deliverables and targets are being met.
- Provide second level support on a rotational roster.
Requirements
- Tertiary qualification in engineering, mathematics, computer science, or a related discipline.
- 2+ years of experience in building and maintaining bank grade data infrastructure.
- Experience in transforming and manipulating large and complex datasets.
- Experienced with SQL and NoSQL modern data stores, able to write complex queries and transformations.
- Experienced in implementing data warehousing (snowflake) solutions in large commercial environments and transforming and manipulating large and complex data sets.
- Enjoys working in an agile team and can work on user stories autonomously.
- Demonstrable track record of dealing well with ambiguity, prioritizing needs, and delivering results in a dynamic environment.
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer developing ETL processes and BI solutions for RUF Lebensmittelwerk. Collaborating on data models in a cloud environment with Microsoft technologies.
Manager leading data and analytics projects to enhance client operations across multiple states at PwC. Focusing on strategic planning, mentoring junior staff, and project success.
Data Engineer II specializing in automated systems for data processing and analysis in property taxation. Collaborating across teams to ensure accuracy and deliver timely solutions.
Data Architect leading scalable cloud - based architectures at Fidelity. Collaborating with cross - functional teams to modernize brokerage recordkeeping systems and ensure data compliance.
Salesforce Solutions Architect specializing in Data Engineering at Pottencial, integrating Salesforce with analytical platforms. Leading governance and scalable solutions in CRM environments.
Data Engineer developing complex software systems for a multinational IT services company in Switzerland. Utilizing data engineering techniques and high - level programming languages.
Senior Data Management Engineer at a leading IT Consulting firm. Designing enterprise data solutions ensuring data quality and governance using Informatica tools.
Senior Data Management Engineer designing and implementing enterprise data solutions for a global IT leader. Collaboration with stakeholders to ensure data quality and scalability.
Senior Data Management Engineer designing and implementing data solutions for a global IT consulting leader. Collaborating with teams to ensure data accessibility, quality, and governance.