Senior Data Engineer at Independence Pet Holdings shaping data ecosystem by building platforms and pipelines. Collaborating with teams to enhance data analytics and operational insights.
About the role
- Senior Data Engineer designing and developing scalable data pipelines for fintech company. Collaborating with stakeholders to ensure analytics-ready data formats and supporting batch and streaming processes.
Responsibilities
- Design, develop, and maintain scalable data pipelines using Apache Spark (PySpark and/or Scala)
- Build and optimize data workflows on Databricks , including Delta Lake, notebooks, and scheduled jobs
- Ingest, transform, and curate large-scale structured and semi-structured datasets
- Perform performance tuning and cost optimization of Spark workloads and Databricks clusters
- Implement data quality checks, monitoring, and error handling
- Collaborate with analytics and business stakeholders to deliver well-modeled, analytics-ready data
- Support batch processing and, where applicable, streaming data pipelines
- Follow best practices for testing, documentation, security, and version control
Requirements
- 5+ years of experience in Data Engineering or related roles
- Strong hands-on experience with Apache Spark (PySpark or Scala)
- Proven experience working in Databricks environments
- Strong SQL skills and experience with relational and analytical databases
- Experience building and maintaining ETL/ELT pipelines at scale
- Familiarity with modern data lake architectures (Delta Lake preferred)
- Experience with Git-based version control
Benefits
- Flexible work from home options
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer at Vancity designing, building, and optimizing scalable data pipelines. Collaborating closely with analytics and business teams to deliver trusted data products while ensuring high standards of data quality.
Principal Software Engineer shaping and evolving Mastercard’s global enterprise data architecture. Leading modernization of data platforms across hybrid cloud and on - premises environments.
Senior Data Engineer leading Snowflake implementation and defining modern data architecture. Mentoring internal team while working on strategic projects.
Data Engineer at Booz Allen creating advanced technology solutions and managing data engineering activities for mission - driven projects. Collaborating with a multi - disciplinary team in a fast - paced environment.
Lead Platform Data Engineer focusing on data architecture and integration at Allegion, enhancing security solutions. Collaborate on data strategy and mentor engineering teams for data standardization and quality.
Data Engineer building and optimising the Azure - based data platform at Castle Trust Bank. Collaborating to deliver scalable, reliable solutions empowering decision - making across the Bank.
Lead Data Engineer at Castle Trust Bank, owning the Azure - Databricks platform and SQL infrastructure. Delivering scalable and reliable solutions that drive strategic goals across the organization.
Data Engineer responsible for building and maintaining cloud environments and data pipelines at Boeing. Collaborating with teams to ensure system performance and deliver value to customers.
Data Engineer at Fellowmind creating data pipelines and platforms leveraging Microsoft Fabric. Collaborating with teams for end - to - end data solutions and ensuring quality and reliability.