TR
TravelersSenior Data Engineer
Senior Associate Data Engineer contributing to Travelers' analytics landscape by building and operationalizing data solutions. Collaborating with teams to ensure reliable data delivery across the enterprise.
About the role
- Develop and maintain robust, scalable data pipelines and infrastructure automation workflows using GitHub, AWS, and Databricks
- Implement and manage CI/CD pipelines using GitHub Actions and GitLab CI/CD for automated infrastructure deployment, testing, and validation
- Deploy and manage Databricks LLM Runtime or custom Hugging Face models within Databricks notebooks and model serving endpoints
- Manage and optimize Cloud Infrastructure costs, usage, and performance through tagging policies, right-sizing EC2 instances, storage tiering strategies, and auto-scaling
- Set up infrastructure observability and performance dashboards using AWS CloudWatch for real-time insights into cloud resources and data pipelines
- Develop and manage Terraform or CloudFormation modules to automate infrastructure provisioning across AWS accounts and environments
- Implement and enforce cloud security policies, IAM roles, encryption mechanisms (KMS), and compliance configurations
- Administer Databricks Workspaces, clusters, access controls, and integrations with Cloud Storage and identity providers
- Enforce DevSecOps practices for infrastructure-as-code, ensuring all changes are peer-reviewed, tested, and compliant with internal security policies
- Coordinate cloud software releases, patching schedules, and vulnerability remediations using Systems Manager Patch Manager
- Automate AWS housekeeping and operational tasks such as cleanup of unused EBS volumes, snapshots, old AMIs, rotation of secrets, and log retention enforcement
- Perform incident response, disaster recovery planning, and post-mortem analysis for operational outages
- Collaborate with cross-functional teams including Data Scientists, Data Engineers, and other stakeholders to gather and implement infrastructure and data requirements
Requirements
- 4+ years of experience in DataOps / CloudOps / DevOps roles
- Strong proficiency in at least one scripting language (e.g., Python, Bash)
- Experience with infrastructure-as-code tools (e.g., Terraform, CloudFormation)
- Hands-on experience integrating and operationalizing LLMs in production pipelines
- Deep hands-on experience with AWS Services: EC2, S3, RDS, CloudWatch, IAM, Lambda, VPC
- Experience with AWS Data Services: Athena, Glue, MSK, Redshift
- Experience with AWS Security and compliance services: KMS, IAM, Config, CloudTrail, Secrets Manager
- Experience with Operational services: Auto Scaling, Systems Manager, CloudFormation/Terraform
- Experience with ML/AI services: Bedrock, SageMaker, OpenSearch serverless
- Working knowledge of Databricks: Cluster and workspace management, job orchestration, IAM passthrough
- Experience deploying and managing CI/CD workflows using GitHub Actions, GitLab CI, or AWS CodePipeline
- Strong understanding of cloud networking: VPC Peering, Transit Gateway, security groups, PrivateLink
- Familiarity with container orchestration platforms (e.g., Kubernetes, ECS)
- Strong understanding of data modeling, data warehousing concepts, and AI/ML lifecycle management
- Knowledge of cost optimization strategies across compute, storage, and network layers
- Experience with data governance, logging, and compliance practices (e.g., SOC2, HIPAA, GDPR)
- Bonus: Exposure to LangChain, Prompt Engineering, RAG, vector databases (AWS OpenSearch, Pinecone, Milvus)
- Preferred: AWS certifications (Solutions Architect, DevOps, SysOps), multi-cloud experience (Azure/GCP), FinOps/cost tools, production-grade Python, high-availability and disaster recovery experience, Zero Trust architecture, Terraform Sentinel, Databricks Unity Catalog, agile cross-functional teamwork
Benefits
- Competitive Salary
- Flexible Benefits Package
- Wide range of benefits, resources, and competitive compensation plans designed to support employees at every career and life stage
Job title
Job type
Experience level
Salary
Not specified
Degree requirement
No Education Requirement
Tech skills
Location requirements
3I
3Core Systems, IncAWS Data Engineer
Data Engineer specializing in PySpark and Snowflake at 3Core Systems, Inc. Focused on building and optimizing data pipelines on AWS and Snowflake.
NL
NOVALINK SOLUTIONS LLCSalesforce Data Engineer
Salesforce Data Engineer serving as a subject matter expert in the State of Tennessee. Designing scalable data pipelines and collaborating on cross - agency initiatives.
FI
FindasenseSenior Data Engineer – Intelligence
Data Engineer Senior responsible for building data architecture and optimizing pipelines for Business Intelligence. Collaborating with analysts to develop insights using Power BI and Azure technologies.
Principal Data Engineer driving modernization from legacy systems to cloud - native platforms at Mastercard. Architecting and developing ETL platforms with AI integration and establishing data - driven strategies.
Principal Data Engineer modernizing cloud - native platforms for AI - powered solutions at Mastercard. Leading teams to enhance data processing efficiency and reliability across global operations.
IN
Data Engineer creating data pipelines for Santander's card transactions. Collaborating with an agile team in strategic projects involving Databricks and PySpark.
SA
Sabiá AdministraçãoSenior Data Engineer
Data Engineer designing, implementing, and maintaining data pipelines at Sabiá Gaming. Focused on high - quality data access and integration for enhanced decision - making.
MA
MassMutualQuantitative Data Engineer
Quantitative Data Engineer developing data solutions and automations for MassMutual's investment management. Working with data orchestration tools within a collaborative team environment.
Senior Data Engineer designing and scaling data infrastructure for analytics, machine learning, and business intelligence in a software supply chain security company.