AWS Streaming Data Engineer developing software and systems in a fast, agile environment. Utilizing experience with real-time data ingestion and processing systems across distributed environments.
Responsibilities
resolve problems with complete end-to-end streaming solutions in a fast, agile environment
develop software and systems from vision to production-ready
utilize experience with real-time data ingestion and processing systems operating across distributed environments
identify needed system improvements
help clients overcome difficult challenges using the latest architectural approaches, tools, and technologies
Requirements
5+ years of experience in software with a cloud-first development approach
4+ years of experience with enterprise data engineering development, including geospatial data
3+ years of experience with AWS services and cloud-native architecture patterns, including ECS / EKS, Lambda, SQS, SNS, EC2, RDS, DynamoDB, IAM policies, security groups, and network security
3+ years of experience with Infrastructure as Code, including AWS CDK, Terraform, or CloudFormation
Experience working with ETL / ELT pipeline development using AWS services
Experience with API design and versioning for distributed streaming systems, including Apache Kafka
Experience developing and deploying production geospatial solutions from concept to O & M
TS/SCI clearance with a polygraph
Bachelor's degree
Benefits
health, life, disability, financial, and retirement benefits
Consultant ML & DataOps at Smile integrating data science projects for major clients. Designing MLOps solutions and enhancing data governance in a collaborative environment.
Data Engineer developing and maintaining data pipelines for Coolbet’s analytical services. Working within an Agile framework to ensure data reliability and efficiency.
API Data Engineer developing innovative data - driven solutions and advancing data architecture for AI Control Tower. Building and integrating APIs and data pipelines to support organizational needs.
Journeyman Data Architect supporting Leidos' enterprise data and analytics program for the Department of War. Collaborating on solutions for data architecture, cloud environments, and governance.
Senior Software Engineer developing backend services and data infrastructure for integrated products at Booz Allen. Collaborating with a small elite team to deliver reliable and scalable services.
Mid - level Data Engineer ensuring efficient data transformation and integration for data annotation projects. Collaborating with teams to optimize data quality and performance in pipeline operations.
Cloud Data Platform Administrator supporting deployment and operations of modern Enterprise Data Platform. Focus on AWS infrastructure, CI/CD integration, and secure cloud operations.
Data Engineer developing and maintaining data architecture for Business Intelligence platform. Collaborating with data analysts to build interactive dashboards and real - time insights.
Principal Data Architect at nbn defining and evolving enterprise data models for the digital future of Australia. Providing leadership in data governance and advanced analytics practices.