Hybrid Senior DevOps Engineer – Secure On-Prem, MLOps Focus

Posted 5 hours ago

Apply now

About the role

  • DevOps Engineer focusing on deploying high-security on-prem infrastructure and MLOps platforms for mission-critical systems. Collaborating on Kubernetes-based orchestration and machine learning workloads.

Responsibilities

  • Design and maintain hardened on-prem infrastructure with strong security, reliability, and compliance standards.
  • Deploy and operate production-grade Kubernetes clusters.
  • Implement IaC using Terraform.
  • Enforce container security best practices (image scanning, RBAC, secrets management, encryption).
  • Design secure networking architectures (segmentation, firewalls, controlled ingress/egress).
  • Build and maintain CI/CD pipelines with integrated security controls (DevSecOps).
  • Support MLOps workflows.
  • Deploy and optimize LLM inference workloads, including GPU-based environments.
  • Implement monitoring, logging, and incident response processes.
  • Document infrastructure and ensure auditability.

Requirements

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Strong experience managing secure on-premise environments.
  • Must have strong expertise in Infrastructure as Code (Terraform).
  • Must have strong expertise in Kubernetes and Docker.
  • Experience working with CI/CD pipelines (e.g., GitHub Actions).
  • Experience supporting ML/LLM workloads and MLOps practices.
  • Strong version control experience with Git.
  • Familiarity with monitoring tools, incident management, and troubleshooting practices.
  • Understanding of cybersecurity standards and regulatory compliance requirements.

Job title

Senior DevOps Engineer – Secure On-Prem, MLOps Focus

Job type

Experience level

Senior

Salary

Not specified

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job