Hybrid AI Software Development Engineer

Posted 1 hour ago

Apply now

About the role

  • AI Software Development Engineer optimizing AI inference workloads including Large Language Models on Intel GPUs. Involves graph compilation, runtime execution, and kernel optimization.

Responsibilities

  • Optimize emerging AI inference workloads such as Large Language Models (LLMs) and Diffusion models on GPUs
  • Develop and optimize graph-based compilation flows (e.g., MLIR/LLVM) for neural network workloads
  • Write and tune performance-critical GPU kernels and runtime code in C++ or parallel programming languages
  • Identify and resolve bottlenecks across compiler, runtime, and kernel layers
  • Profile, benchmark, and characterize AI workloads to validate performance gains
  • Collaborate with hardware, driver, and framework teams on hardware/software co-optimization

Requirements

  • Bachelor's degree with 4+ years of relevant experience, OR Master's degree with 2+ years of relevant experience in Computer Science or a related field
  • Strong C++ development and debugging skills
  • Solid understanding of GPU architectures or AI accelerators
  • Hands-on experience with modern neural network architecture for inference on hardware accelerators
  • Preferred: PhD and 1+ years of relevant experience
  • Familiarity with OpenVINO or other AI inference frameworks
  • Knowledge of neural network optimization techniques and performance tradeoffs
  • Experience across multiple layers of the AI software stack, including AI inference engines or runtimes, graph compilers (e.g., MLIR/LLVM), GPU kernels or performance critical compute code
  • Performance profiling and workload analysis

Benefits

  • Competitive pay
  • Stock bonuses
  • Health insurance
  • Retirement
  • Vacation

Job title

AI Software Development Engineer

Job type

Experience level

Mid levelSenior

Salary

$170,500 - $240,710 per year

Degree requirement

Bachelor's Degree

Location requirements

Report this job

See something inaccurate? Let us know and we'll update the listing.

Report job