Full Stack Engineer designing and building AI - powered products transforming customer support at Forethought. Work with a collaborative team to deliver exceptional customer experiences in a hybrid role.
About the role
- Senior Technical Lead/Architect specializing in AWS-based streaming data pipelines and event-driven capabilities. Designing and implementing robust solutions for a high-impact financial data platform.
Responsibilities
- Provide technical solution discovery effort on any new capabilities or new functionality.
- Assist PO with technical user stories to ensure healthy backlog features
- Lead the development of **real-time data pipelines** using **AWS DMS**, **MSK**, Kafka or Glue Streaming and for CDC ingestion from multiple SQL Server sources (RDS/on-prem).
- Build and optimize **streaming and batch data pipelines** using **AWS Glue (PySpark)** to validate, transform, and normalize data to **Iceberg and DynamoDB**.
- Define and enforce **data quality, lineage, and reconciliation logic** with support for both streaming and batch use cases.
- Integrate with **S3 Bronze/Silver layers** and implement efficient **schema evolution and partitioning strategies** using Iceberg.
- Collaborate with architects, analysts, and downstream application teams to design **API and file-based egress** layers.
- Implement **monitoring, logging**, and **event-based alerting** using CloudWatch, SNS, and EventBridge.
- Mentor junior developers and enforce best practices for modular, secure, and scalable data pipeline development.
Requirements
- 6+ years of hands-on expert level data engineering experience in **cloud-based environments** (AWS preferred) with event driven implementation
- Strong experience with **Apache Kafka / AWS MSK** including topic design, partitioning, and Kafka Connect/Debezium
- Proficiency in **AWS Glue (PySpark)** and for both batch and streaming ETL
- Working knowledge of **AWS DMS**, **S3**, **Lake Formation**, **DynamoDB**, and **Iceberg**
- Solid grasp of **schema evolution**, **CDC patterns**, and **data reconciliation frameworks**
- Experience with infrastructure-as-code (CDK/Terraform) and DevOps practices (CI/CD, Git)
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Cloud Software Engineer developing scalable cloud ecosystems at CrowdStrike, leveraging Golang & Python for backend solutions. Focusing on distributed systems and collaborative development practices.
Lead Software Engineer developing comprehensive technology solutions for financial services. Handling design, development, and stakeholder coordination in a hybrid work environment.
Senior Technical Leader at Cloudinary focusing on GenAI - native ecosystems. Owning technical direction and building developer - facing products.
Senior Engineer managing data products for performance marketing at TickPick. Building and optimizing pipelines and analytics for growth - focused decision - making.
Software Developer applying programming skills in business applications for a market - leading company. Engaging in professional development and cloud transformation initiatives.
Senior Software Engineer developing prototypes for AI - powered perception systems at Hayden AI. Focus on robotics, C++, and production - grade software systems in a hybrid work environment.
Senior Dynamics Software Developer responsible for maintaining and enhancing Dynamics365 Sales functionalities at ISS Tech Team. Collaborating with teams to explore AI opportunities and build new features.
Software Engineer developing compensation intelligence software at Compa. Collaborating across the stack to enhance core product features for top enterprises.
Software Developer at Everflow developing scalable software solutions for partner marketing. Collaborating with teams to enhance core platform features and participate actively in agile processes.