Hybrid System Software Engineer – AI

Posted 7 minutes ago

Apply now

About the role

  • System Software Engineer at a stealth-mode startup building infrastructure for AI data centers. Collaborating across technology stacks to influence foundational design and optimization.

Responsibilities

  • Collaborate across the stack to influence the design of our foundational technology, ensuring it meets the needs of next-generation AI models.
  • Identify and resolve performance bottlenecks in distributed training and inference workloads through deep-dive analysis of the software-hardware interface.
  • Conduct rigorous performance benchmarking and characterization on multi-node clusters.

Requirements

  • Strong proficiency in C++ and Python, with a deep understanding of systems programming fundamentals (memory management, concurrency, OS internals).
  • Proficient in a Linux development environment.
  • Experience with GPU programming (CUDA) and performance optimization for parallel architectures.
  • Familiarity with distributed AI frameworks (PyTorch, JAX, or DeepSpeed) and/or inference engines (vLLM, SGLang, Dynamo/TRT-LLM).
  • Hands-on experience with large-scale cluster orchestration and telemetry tools.

Benefits

  • meaningful equity
  • benefits
  • 401k

Job title

System Software Engineer – AI

Job type

Experience level

Mid levelSenior

Salary

CA$120,000 - CA$180,000 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job