Data Engineer developing automated data pipelines for Creditreform. Collaborating with Data Scientists and Analysts and ensuring data quality and consistency.
About the role
- Principal Consultant/Technical Data & Analytics Lead at Atturra, driving customer transformation using Databricks lakehouse solutions. Leading teams and facilitating technical engagements to deliver data insights.
Responsibilities
- Lead migration and analytics engagements on Databricks from scoping through production hand over
- Design, build and optimise batch or streaming pipelines into Delta Lake, governed by Unity Catalog
- Model data using medallion principles and champion standards that keep quality, lineage and security front of mind
- Embed automated testing, monitoring and CI/CD so releases are fast and recoverable
- Deliver curated Power BI datasets, dashboards and reusable APIs that enable near real time insight and bidirectional syncs
- Mentor engineers, resolve blockers quickly and present progress, risks and ROI to executives and clients.
Requirements
- A track record of architecting and delivering Databricks lakehouse solutions at scale
- Advanced SQL plus Python or Scala, with deep knowledge of Delta Lake, Unity Catalog and DevOps automation
- Experience integrating enterprise systems through REST, messaging or ETL tools and governing enterprise data models
- Databricks Certification ideal
- Confident stakeholder engagement—from technical deep dives to board level briefings
- Exposure to IBM i/DB2, ConnectWise, HubSpot, Boomi, Snowflake or Tableau
- Hands on experience operationalising machine learning workloads in Databricks
- Familiarity with cost optimisation and FinOps in cloud analytics environments.
Benefits
- Career growth via succession planning, internal promotions, and mentorship opportunities
- Ongoing investment in professional development through industry and technology certifications, and study assistance
- Mental health support through our Employee Assistance Program
- Support for family and caring responsibilities, including paid parental leave
- Employee referral program, with monetary incentives offered
- Commitment to supporting Australia’s veterans
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer building and maintaining core data infrastructure for Aircall's AI customer communications platform. Support data reliability and scalability for high - impact use cases.
Senior Data Engineer shaping data landscape and leading ETL/ELT solutions for mission - critical engineering projects in the UK. Collaborating with teams to deliver high - quality data products.
Data Engineer developing and maintaining ETL processes with Informatica IDMC for BMW TechWorks Romania. Collaborating with teams to implement cloud - based data architecture solutions.
Microsoft Data Architect designing and building business intelligence solutions on Azure. Collaborating with teams and engaging clients for strategic data solutions.
Manager in AI Consulting at PwC designing enterprise data architectures and delivering AI - powered products with a collaborative team.
Senior Data Engineer developing data - pipelines and deploying AI tools for Mariner's ecosystem. Collaborating with cross - departmental teams to enhance enterprise data products and systems integrations.
Data Architect for Amazon leading data strategy and advanced analytics solutions. Collaborating with cross - functional teams to drive measurable value and enhance data literacy across the organization.
Data Platform Engineer at Taxfix managing data infrastructures and pipelines to support analytics and AI - driven product features. Collaborating with cross - functional teams to ensure data reliability.
Mid - level Data Engineer building secure, scalable data infrastructure on AWS for fintech startup TrueLayer. Collaborating with DevOps and Analytics teams to enhance data operations.