GPU Performance Engineer in Micron's Smart Manufacturing and AI team. Focusing on large-scale modeling, optimization, and deployment of AI solutions in their memory solutions.
Responsibilities
Architect and execute large-scale custom model training and fine-tuning jobs (SFT, RLHF) on multi-node, multi-GPU clusters.
Optimize training throughput and memory efficiency using distributed training strategies (FSDP, DeepSpeed, Megatron-LM) and mixed-precision techniques (FP16/BF16).
Design and develop autonomous AI Agents capable of multi-step reasoning, planning, and tool execution to automate complex manufacturing workflows.
Analyze and profile complex workloads (e.g., LLM training, Rendering pipelines) to identify bottlenecks in compute, memory bandwidth, and latency.
Write and optimize high-performance kernels using CUDA, HIP, or custom assembly (PTX/SASS) to unlock hardware capabilities.
Collaborate with Hardware Architects to define features for next-generation GPUs based on workload characterization.
Design and implement performance regression testing suites to catch degradations in drivers or compilers.
Mentor junior engineers on parallel programming paradigms and optimization techniques.
Requirements
Deep understanding of GPU architecture (memory hierarchy, tensor cores, interconnects like NVLink) and experience managing GPU resources in both cloud environments and on-prem.
Hands-on experience with Distributed Data Parallel (DDP), Fully Sharded Data Parallel (FSDP), and model parallelism techniques.
Proficiency in fine-tuning Large Language Models using PEFT techniques (LoRA, QLoRA) and optimizing inference engines (vLLM, TensorRT-LLM).
Experience developing GenAI applications and AI Agents using frameworks like LangChain, LangGraph, LlamaIndex, or AutoGen.
Proficiency with Large Language Models (LLMs), including prompt engineering, function calling/tool use, and Chain-of-Thought (CoT) reasoning.
Experience in building and executing end-to-end ML systems automating training, testing and deploying Machine Learning models.
Familiarity with machine learning frameworks (PyTorch is required, TensorFlow, scikit-learn, etc.).
Software development skills and the desire to work on cutting edge development in a Cloud environment.
Strong scripting and programming skills in one of the following, Python or Java (Python preferred).
Software Engineer at Contour Education, creating impactful software solutions for students. Collaborating on full - stack features and enhancing the Learning Portal experience.
Senior Project Engineer leading Smart Manufacturing projects at Cargill to enhance process efficiency. Focus on engineering new technologies and improving existing manufacturing systems.
Senior Software Engineer at Nuix developing solutions for eDiscovery and data governance. Collaborating in Agile teams to deliver software projects with a focus on performance and reliability.
Backend infrastructure developer working on software that powers kiosks for global checkout experience. Join a high - impact team at Mashgin to create innovative AI solutions.
Full Stack Developer Intern assisting in web application development for Seagate's AI transformation projects. Collaborating with Data Scientists and developers on front and back - end technologies.
Senior Engineer providing engineering support and oversight for structural steel modules fabrication for AP1000 European and US Domestic plants. Collaborating with supply chain and managing fabrication processes.
Software Engineering Intern contributing to Universal Robots' robotics software development team in Bengaluru. Collaborating on modern UI and scalable architecture with hands - on experience.
Senior Software Engineer embedding machine learning models into operational workflows at Upstart. Driving personalization strategies and improving servicing decisions with data - driven approaches.
Software Architect at PointClickCare developing effective software solutions for the healthcare industry. Collaborating with teams to drive technical innovation and feasibility in software design.
Software Engineer building next generation crypto - forward products for Coinbase. Solving complex technical challenges in cryptocurrency and blockchain technology.