Data Engineer designing and implementing data ingestion systems for IT consulting firm. Involves managing data architectures and developing ETL/ELT pipelines using modern tools and frameworks.
About the role
- Own the insights data platform at BR-DGE, a fintech focused on scalable payment infrastructures. Collaborate with Analytics and Engineering to deliver trusted datasets and timely signals.
Responsibilities
- Design and ship a tiered data platform that supports multiple latency needs.
- Build and own end-to-end ingestion patterns across batch, micro batch, and selected near real time use cases.
- Implement schema evolution, data contracts, and approaches for late arriving and corrected data.
- Treat curated datasets as products that are well defined, documented, reliable, and safe to use.
- Set platform standards for idempotent ingestion, deduplication, data quality, lineage, and observability.
- Ensure the platform meets regulated fintech & payments expectations for access control, security, and governance.
- Partner with Product and Engineering on event and domain modelling.
- Support Data Science with reliable feature ready datasets and pragmatic collaboration.
- Evolve the current lightweight tooling into a more observable, structured platform.
- Automate data infrastructure and workflows using infrastructure as code and CI CD practices.
Requirements
- Proven experience designing, building, and operating production grade data pipelines and platforms.
- Strong SQL, specifically PostgreSQL, plus at least one programming language such as Python or Java.
- Experience with data processing or orchestration tooling such as Spark, Airflow, or Kafka.
- Experience designing data models for analytics and reporting workloads.
- Practical knowledge of data quality, testing, observability, lineage, and governance patterns.
- Strong experience with AWS based data platforms, with hands on use of services like S3, Glue, Athena, Redshift, Kinesis, EMR, or MSK.
- Infrastructure as code experience using Terraform or CloudFormation, and comfort operating systems in production.
- Ability to collaborate across Engineering, Product, Analytics, and Data Science, and drive standards through influence.
Benefits
- Flexible, remote-first working
- 33 days holiday, including public holidays
- Birthday off
- Family healthcare
- Life insurance
- Employee assistance programme
- Investment in learning and development
- Regular team events and off-sites
- A collaborative culture where documentation is treated as a first-class product
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Data Engineer managing complex financial modeling and reporting data for Financial Services organization. Collaborating with Data Analysts on cutting - edge financial reports.
Data Engineering Lead designing and optimizing scalable data pipelines for a property insurance company. Collaborating across teams, mentoring engineers, and driving data architecture initiatives.
Senior Advisor managing data architecture and modeling frameworks for iA Financial Group. Supporting transformation and innovation of data management practices within the organization.
Senior Data Engineer leading the design and implementation of enterprise data strategies for Kemper Insurance's analytics and business intelligence initiatives.
Data Engineer developing data products and warehouse solutions using cloud services and platforms while ensuring data governance and quality. Supporting tech team with technical architecture and implementation processes.
Senior Clinical Data Engineer at McKesson designing and implementing data solutions and analytics. Collaborating with clinical teams and technical experts for effective data management with scalable solutions.
Tax Technology Assistant Manager building a global tax data warehouse for Flutter, collaborating across teams. Utilizing SQL and Python for data transformation and optimizations in a hybrid role.
Senior Data Engineer designing and implementing Data Platform solutions for healthcare enterprise at Milliman IntelliScript. Collaborating with cross - functional teams while ensuring data privacy compliance.
Staff Data Engineer for IntelliScript's Data Platform managing data strategy and governance. Lead projects ensuring data quality and compliance with industry standards.