Software Developer creating complex visualizations using C#/WPF for equipment at SINGULUS TECHNOLOGIES. Focus on developing Windows services and data visualizations across various technologies.
About the role
- Senior Technical Lead/Architect specializing in AWS-based streaming data pipelines and event-driven capabilities. Designing and implementing robust solutions for a high-impact financial data platform.
Responsibilities
- Provide technical solution discovery effort on any new capabilities or new functionality.
- Assist PO with technical user stories to ensure healthy backlog features
- Lead the development of **real-time data pipelines** using **AWS DMS**, **MSK**, Kafka or Glue Streaming and for CDC ingestion from multiple SQL Server sources (RDS/on-prem).
- Build and optimize **streaming and batch data pipelines** using **AWS Glue (PySpark)** to validate, transform, and normalize data to **Iceberg and DynamoDB**.
- Define and enforce **data quality, lineage, and reconciliation logic** with support for both streaming and batch use cases.
- Integrate with **S3 Bronze/Silver layers** and implement efficient **schema evolution and partitioning strategies** using Iceberg.
- Collaborate with architects, analysts, and downstream application teams to design **API and file-based egress** layers.
- Implement **monitoring, logging**, and **event-based alerting** using CloudWatch, SNS, and EventBridge.
- Mentor junior developers and enforce best practices for modular, secure, and scalable data pipeline development.
Requirements
- 6+ years of hands-on expert level data engineering experience in **cloud-based environments** (AWS preferred) with event driven implementation
- Strong experience with **Apache Kafka / AWS MSK** including topic design, partitioning, and Kafka Connect/Debezium
- Proficiency in **AWS Glue (PySpark)** and for both batch and streaming ETL
- Working knowledge of **AWS DMS**, **S3**, **Lake Formation**, **DynamoDB**, and **Iceberg**
- Solid grasp of **schema evolution**, **CDC patterns**, and **data reconciliation frameworks**
- Experience with infrastructure-as-code (CDK/Terraform) and DevOps practices (CI/CD, Git)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Project Logistics Planner for MANN+HUMMEL overseeing logistics tasks in the project lifecycle. Coordinating trial production, logistics costs, and planning for new projects in Tumkur, India.
Software Engineer in Platform team at Finsolutia building shared services. Design clean APIs and manage AI gateway integrations while improving developer experience.
Software Engineer at CACI tasked with solving customer problems using technical expertise. Involves collaboration and development in dynamic environments using advanced programming skills.
Software Developer in game development focusing on programming game mechanics and visualizations. Join our team in Lübbecke to create innovative gaming devices and software.
Senior Software Development Engineer supporting U.S. Federal Government contracts. Leading product design and development in a collaborative, metadata - driven environment.
Software Development Engineer supporting U.S. Federal Government contracts at Workday. Collaborating on product design and development with a focus on functional analysis and high - impact outcomes.
Join Gedeon Richter as DDC Engineering Lead supporting biotechnological product development with a focus on medical devices. Collaborate with multifunctional teams ensuring project goals are met.
Senior Software Development Engineer at Workday, supporting U.S. Federal Government contracts. Leading design and development in a metadata - driven environment with strong team collaboration and mentorship.
Tech Lead Fullstack Specialist for digital channels at NIO, driving innovation in tech and software development. Focused on leadership, user experience, and best practices in development.