Staff Data Engineer at Qualifinds building AI - driven valuation tools and leading data ingestion development for art and collectibles management.
About the role
- Senior Data Engineer designing secure and scalable data systems for maritime and defense applications. Seeking experienced professional with strong expertise in AWS and Azure environments.
Responsibilities
- Design, build, and maintain scalable batch and real-time machine learning, data science, and data export pipelines.
- Architect and manage AWS and Azure cloud infrastructure.
- Administer and optimize databases including MongoDB and PostgreSQL using RDS and EC2-hosted environments.
- Implement replication strategies, failover systems, and resiliency management for high-availability operations.
- Design systems that strictly separate public and private/classified data.
- Support high-throughput streaming ingestion and processing (sensor, radar, SDR, maritime feeds).
- Develop infrastructure-as-code and automated deployment pipelines.
- Ensure secure-by-design architecture aligned with compliance requirements.
- Provide guidance and architectural leadership for handling data at scale.
- Monitor performance, reliability, and cost optimization across environments.
- Collaborate with DevSecOps, AI/ML, and mission teams to deliver operational capabilities.
Requirements
- 7+ years of professional experience in Data Engineering
- Proven experience building production-grade data pipelines
- Strong hands-on experience with AWS (RDS, EC2, S3, IAM, VPC)
- Experience with Azure data services
- Database expertise in MongoDB and PostgreSQL
- Proficiency in Python, TypeScript, and SQL
- Experience implementing high-availability, replication, and disaster recovery strategies
- Experience working in government, defense, or regulated environments
- Active security clearance OR ability to obtain/maintain clearance
- Experience with GIS systems and geospatial data architectures (preferred)
- Experience with real-time streaming frameworks (Kafka, Kinesis, Spark, Flink) (preferred)
- Familiarity with SDR, radio frequency data, radar systems, GIS, or maritime domain awareness platforms (preferred)
- Experience managing high-velocity time-series or sensor data (preferred)
- AWS certifications (Solutions Architect, DevOps, Data Analytics) (preferred)
- Microsoft Azure certifications (preferred)
- Experience with containerization (Docker, Kubernetes) (preferred)
- Infrastructure-as-code (Terraform, CloudFormation, Bicep) (preferred)
- Security+ or similar certification preferred in secure environments (preferred)
Benefits
- Competitive salary
- Equity eligibility
- Health, dental, and vision insurance
- 401(k) options
- Professional development and certification support
- Opportunity to work on mission-critical maritime and defense technology
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
Tech skills
Location requirements
Senior Data Engineer role at AI & Data Engineering focused on Databricks engineering.
Senior Data Engineer at Yü Group responsible for leading data engineering team and optimizing data solutions within the energy sector.
Data Engineer managing payment processing and data accuracy while collaborating with financial teams. Building and optimizing data pipelines for transactional data in a hybrid work environment.
Data Engineer building analytical tools for Dry Bulk market data operations at Kpler. Join a team of over 700 experts transforming data into actionable strategies.
Data Engineer developing tools for maintaining data integrity in cargo tracking at Kpler. Collaborating with analysts and engineers to enhance data quality management.
Lead Azure Data Engineer designing and optimizing data ecosystems on Microsoft Cloud. Responsible for building scalable data platforms and pipelines for analytics and reporting.
Data Engineer providing support for IBM DataStage ETL jobs at Callibrity. Collaborating with stakeholders and working to modernize technology solutions in a hybrid work environment.
Cloud Data Engineer implementing tailored solutions for Volkswagen Group data processing. Building ETL/ELT pipelines while collaborating with technical experts.
Data Engineer responsible for building scalable data infrastructure that supports data - driven decisions. Collaborating with team to maintain systems and unlock data value for organizations.