About the role

  • Data Assurance Lead ensuring data quality and implementing assurance frameworks in AI and data consultancy. Collaborating with stakeholders in Financial Services and Banking sectors.

Responsibilities

  • **Your responsibilities as the Data Assurance Lead include:**
  • ***Data Quality Framework Implementation***
  • Implement Soda Core data quality checks across all Medallion layers (Bronze, Silver, Gold).
  • Define and maintain a data quality rules library, covering:
  • Schema validation (completeness, uniqueness, data types)
  • Business rule validation (referential integrity, value ranges)
  • Reconciliation checks (source-to-target, row counts, checksums)
  • Freshness and timeliness SLAs as per data contracts**
  • ***Automation & Governance***
  • Implement automated data contracts using Soda and secure sign-off with producers and consumers.
  • Create automated validation and reconciliation processes.
  • Establish data quality scorecards in OpenMetadata, integrated with Soda.
  • Retrofit assurance checks across all live data flows.
  • Develop automated regression test suites for critical flows.**
  • ***Monitoring & Incident Management***
  • Configure data quality alerts and thresholds.
  • Define escalation procedures for data incidents.
  • Collaborate with operational teams for alerting and monitoring.
  • Analyze data issues, implement countermeasures, and optimize check performance.**
  • ***Collaboration & Training***
  • Work closely with Data Factory squads to embed data quality best practices.
  • Provide QA on Glue jobs to ensure compliance with the assurance framework.
  • Maintain comprehensive documentation and runbooks.
  • Train teams on data quality standards and tools.

Requirements

  • ***To be successful in this role, you should have:***
  • strong experience with data quality frameworks and tools (Soda Core or similar).
  • hands-on experience with Lakehouse architectures and Medallion design.
  • proficiency in AWS services (S3, Glue, Athena) and data validation techniques.
  • Strong analytical and problem-solving skills.
  • 8+ years experience in data engineering or data quality roles, with at least 3 years in data assurance leadership.
  • ***You will also have experience in:***
  • identifying ways to automate their work / repetitive tasks.
  • dealing with data contracts, metadata management, and lineage tools (OpenMetadata preferred).
  • building automated validation and reconciliation pipelines.
  • communicating and stakeholder management.
  • leading cross-functional initiatives and drive adoption.
  • working in a fast-paced environment and deliver aggressive migration targets.
  • working with Jira and agile way of working.

Benefits

  • **Working with Deeplight, you will have access to our great benefits which include:**
  • · Competitive salary and performance bonuses
  • · Comprehensive health insurance
  • · Professional development and certification support
  • · Opportunity to work on cutting-edge AI projects
  • · Flexible working arrangements
  • · Career advancement opportunities in a rapidly growing AI company

Job title

Data Assurance Lead

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Tech skills

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job