Onsite Senior Software Engineer, AI Networking

Posted 6 hours ago

Apply now

About the role

  • Senior Software Engineer optimizing AI workloads using ML techniques at NVIDIA. Focus on performance optimization across large GPU and CPU clusters in AI systems.

Responsibilities

  • Design and implement resource allocation and combinatorial optimization techniques to optimize LLM models at datacenter scale.
  • Research, develop, and deploy AI/ML techniques to optimize large-scale Deep Learning training and inference on NVIDIA supercomputers and distributed systems.
  • Build and productionize ML-based tools for performance prediction and optimization.
  • Develop and deploy a scalable, reliable data curation pipeline capable of handling complex data types.
  • Collaborate across hardware and software teams to deliver valuable performance analysis insights.
  • Lead performance test planning, establish performance targets for new technologies and solutions.

Requirements

  • PhD or Master's degree in Computer Science, Software Engineering, or equivalent experience
  • 4+ years of experience applying machine learning techniques to computer architecture and system optimization problems
  • Hands-on experience developing and deploying various learning algorithms (e.g., reinforcement learning, offline RL, supervised learning)
  • Proficiency in building and using ML models with leading frameworks such as PyTorch, TensorFlow, or JAX
  • Proven ability to apply GNNs/transformers-based optimization to PyTorch model graph and Kineto execution traces
  • Expertise combining knowledge of NVIDIA GPUs, the CUDA library, and deep learning frameworks (TensorFlow/PyTorch) with networking concepts
  • Strong programming capabilities in Python, Bash, and C++.
  • A collaborative teammate with effective communication and interpersonal abilities.

Benefits

  • Competitive salaries
  • Equity
  • Comprehensive benefits package

Job title

Senior Software Engineer, AI Networking

Job type

Experience level

Senior

Salary

$152,000 - $241,500 per year

Degree requirement

Postgraduate Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job