Data Engineer building and scaling client - facing Microsoft Fabric analytics platform to drive revenue and decision - making. Collaborating with teams to develop pipelines, optimize performance, and ensure client satisfaction.
About the role
- Principal Data Pipeline Lead at SS&C overseeing development of scalable data pipelines. Leading a small team and providing technical guidance for modern data platform integration.
Responsibilities
- Lead the development of batch and real-time data pipelines on top of a modern data platform
- Design and build scalable ingestion and transformation pipelines
- Mentor a small team of engineers
- Collaborate with platform engineering team to build pipelines
- Implement CDC pipelines using Debezium and Kafka
- Build streaming pipelines using Kafka and Apache Flink
- Develop transformation workflows using Python, Spark / PySpark, and Airflow
- Ingest data from DB2 replication streams
- Process legacy fixed-width and CSV data feeds
- Integrate API-based data sources
- Store and manage data using Apache Iceberg and Parquet
- Enable analytics through Trino and StarRocks
Requirements
- 8+ years building data platforms or large-scale data pipelines
- Strong programming experience in Python
- Experience with Spark / PySpark
- Experience building pipelines with Apache Airflow
- Experience with Kafka-based streaming architectures
- Experience implementing CDC pipelines (Debezium or similar)
- Experience with Apache Flink or other streaming frameworks
- Experience with Parquet and modern table formats such as Apache Iceberg
- Experience with distributed query engines such as Trino, Presto, or StarRocks
- Experience integrating data from heterogeneous or legacy systems
- Experience leading or mentoring engineers
Benefits
- Competitive salary
- Opportunities for increased leadership scope as the team expands
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
Data Engineer role focusing on migrating legacy systems to ADA at BBVA. Collaborate with multidisciplinary teams and ensure system integrity during transitions.
Senior Data Engineer focused on modernizing enterprise data capabilities at U.S. Bank. Designing and building reusable data engineering patterns for consistent delivery across teams.
Senior Data Engineer at SS&C building and optimizing data pipelines in a lakehouse environment. Collaborating with data architects and stakeholders in the financial services sector.
Experienced Data Architect designing and implementing scalable data architecture for a financial services and healthcare technology company. Collaborating across teams to support analytics and operational needs.
Data Architect designing scalable, secure data architectures for fraud detection and risk management at Fiserv. Collaborating with cross - functional teams and managing large datasets and pipelines.
Director of Engineering overseeing development of AI - driven data platforms at LVT. Leading teams to transform sensor data into actionable insights using modern architecture and technologies.
Senior Data Engineer at Independence Pet Holdings shaping data ecosystem by building platforms and pipelines. Collaborating with teams to enhance data analytics and operational insights.
Senior Data Engineer designing and developing scalable data pipelines for fintech company. Collaborating with stakeholders to ensure analytics - ready data formats and supporting batch and streaming processes.
Senior Data Engineer at Vancity designing, building, and optimizing scalable data pipelines. Collaborating closely with analytics and business teams to deliver trusted data products while ensuring high standards of data quality.