Engineer developing algorithms and optimizations for NVIDIA's inference and compiler stack. Working at the intersection of large-scale systems, compilers, and deep learning.
Responsibilities
Build, develop, and maintain high-performance runtime and compiler components, focusing on end-to-end inference optimization.
Define and implement mappings of large-scale inference workloads onto NVIDIA’s systems.
Extend and integrate with NVIDIA’s SW ecosystem, contributing to libraries, tooling, and interfaces that enable seamless deployment of models across platforms.
Benchmark, profile, and monitor key performance and efficiency metrics to ensure the compiler generates efficient mappings of neural network graphs to our inference hardware.
Collaborate closely with hardware architects and design teams to feedback software observations, influence future architectures, and codesign features that unlock new performance and efficiency points.
Prototype and evaluate new compilation and runtime techniques, including graph transformations, scheduling strategies, and memory/layout optimizations tailored to spatial processors.
Publish and present technical work on novel compilation approaches for inference and related spatial accelerators at top tier ML, compiler, and computer architecture venues.
Requirements
MS or PhD in Computer Science, Electrical/Computer Engineering, or related field, or equivalent experience, with 5 years of relevant experience.
Strong software engineering background with proficiency in systems level programming (e.g., C/C++ and/or Rust) and solid CS fundamentals in data structures, algorithms, and concurrency.
Hands on experience with compiler or runtime development, including IR design, optimization passes, or code generation.
Experience with LLVM and/or MLIR, including building custom passes, dialects, or integrations.
Familiarity with deep learning frameworks such as TensorFlow and PyTorch, and experience working with portable graph formats such as ONNX.
Solid understanding of parallel and heterogeneous compute architectures, such as GPUs, spatial accelerators, or other domain specific processors.
Strong analytical and debugging skills, with experience using profiling, tracing, and benchmarking tools to drive performance improvements.
Excellent communication and collaboration skills, with the ability to work across hardware, systems, and software teams.
Ideal candidates will have direct experience with MLIR based compilers or other multilevel IR stacks, especially in the context of graph based deep learning workloads.
Machine Learning Engineer delivering real - world impact through efficient, adaptive ML systems in production. Collaborating with strategic partners and directly impacting AI research and product vision.
Machine Learning Engineer designing, building, and operationalizing AI/ML solutions for mission - critical applications. Collaborating with data engineering teams to support production - grade ML systems in a hybrid work environment.
Senior Data Platform Engineer optimizing AI/ML infrastructure on AWS at Trajector. Building scalable solutions for data governance, observability, and CI/CD.
Lead Machine Learning Engineer directing innovative AI projects for clients in various sectors. Collaborate to develop AI solutions that enhance efficiency and customer experience.
Associate Director leading machine learning engineering solutions for AI - powered supply chain at S&P Global Mobility. Collaborating with teams to deliver technical solutions and data processing workflows.
Machine Learning Operations Engineer involved in building non - human pilot for aerospace startup. Focus on DevOps and MLOps to enhance infrastructure for innovative machine learning projects.
AI/ML Engineer developing AI solutions leveraging Large Language Models at Deutsche Börse Group. Collaborating with expert developers to enhance internal processes.
Senior Machine Learning Engineer driving innovations in AI and machine learning for Disney's Ad Platforms. Collaborating with cross - functional teams and mentoring junior engineers.
Intern developing machine learning tools within ADEO Services' AI Factory team. Collaborating on software quality and automation alongside a senior ML engineer.