About the role

Principal Engineer overseeing the architecture, operations, and performance tuning of Ceph storage clusters. Working with world-class engineers to drive innovation in private cloud storage at scale.

Responsibilities

Scale-Out Distributed Storage Architecture
Extensive experience in the design, architecture, and management of scale-out distributed storage systems in large production environments.
Demonstrated expertise in system performance tuning, data durability optimization (replication and/or erasure coding), and lifecycle management for petabyte-scale data deployments.
Proven ability to drive the evaluation, selection, and deployment of best-of-breed software-defined storage (SDS) solutions that meet demanding SLAs for latency, throughput, and availability.
Ceph Storage Architecture & Operations
Architect, deploy, and manage large-scale clusters across multiple production sites.
Ensure storage availability, data durability, and cluster resiliency through advanced CRUSH map configurations, erasure coding, and replication strategies.
Define upgrade strategy, cluster augmentation, node rebalancing, and hardware refreshes with minimal downtime.
Own end-to-end lifecycle management of storage clusters, including OS/Kernel tuning, firmware upgrades, and hardware integration.
Large Scale OpenStack Platform Experience
Deep (hands-onº architectural experience with the design, deployment, and management of large-scale OpenStack platforms in production environments.

15–18 years of experience in scale-out distributed storage systems, infrastructure engineering, and Linux systems.
10+ years hands-on experience with Ceph, including architecture, operations, and large-scale production support.
Proven experience managing clusters at petabyte scale with high performance and resiliency requirements.
Strong expertise in: Linux Systems: Kernel tuning, cgroups, systemd, process/thread debugging.
Networking: TCP/IP, VLANs, BGP/OSPF, bonding, load balancing, RDMA, Jumbo Frames.
Storage Internals: LVM, OSD design, Bluestore, RocksDB tuning, journaling, caching layers.
Performance Tools: perf, iostat, atop, strace, tcpdump, Wireshark, eBPF.
Debugging: Core dump analysis, kernel crash dump (kdump), system call tracing.
Proficiency in Python and Shell scripting for automation and tooling.
Hands-on experience with configuration management (Ansible, Salt, Puppet) and IaC tools like Terraform.
Knowledge of containerization (Docker, Kubernetes, LXC) and their storage backends (CSI, RBD).
Experience with monitoring and logging stacks (Prometheus, Grafana, ELK, OpenObserve).
Familiarity with cloud platforms (Azure, GCP, OpenStack, AWS) and hybrid cloud storage.

Health benefits include medical, vision and dental coverage.
Financial benefits include 401(k), stock purchase and company-paid life insurance.
Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart. Eligibility requirements apply to some benefits and may depend on your job classification and length of employment. Benefits are subject to change and may be subject to a specific plan or program terms.