Lead Software Engineer within Wells Fargo Digital Technology, focusing on GPU infrastructure and GenAI model inferencing. Building high performance, reliable, and secure model serving systems.
Responsibilities
Lead complex technology initiatives including those that are companywide with broad impact
Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines
Design, code, test, debug, and document for projects and programs
Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors
Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
Lead projects, teams, or serve as a peer mentor
Engineer GPU clusters and node pools; configure NVLink/NVSwitch, NVIDIA GPU Operator, MIG profiles, container runtime, and kernel/driver baselines for high-throughput LLM/SLM workloads.
Design and implement OpenAI-compatible APIs (Responses, Interactions) behind the AI Gateway: define OpenAPI contracts, authN/Z (OAuth2/mTLS), rate limits/quotas, SLAs, versioning/deprecation, and SDK generation.
Build and support MCP servers and tool adapters; manage agent/tool identity and capability metadata; integrate with agent registries and execution flows.
Develop Agentic AI capabilities (tools/agents/workflows) including disaggregated prefill/decode patterns; contribute to runbooks, guardrails, and safe tool usage.
Build UI surfaces (developer/ops consoles) for endpoint onboarding, prompt testing, evaluations, observability dashboards, and incident response workflows.
Apply prompt engineering and evaluation best practices; create golden test suites, regression harnesses, and measurable SLO-aligned criteria for production promotion.
Requirements
5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
5+ years of experience in Python for backend/services development, packaging, instrumentation, and automation
5+ years of experience building modern web UI for developer/ops workflows, including dashboards, wizards, and prompt/eval tooling, with strong testing and accessibility practices
1+ years of experience building MCP servers, tool adapters, and agent workflows, with an understanding of agent identity, permissions, and governance metadata
2+ years of experience in GenAI engineering, including LLM/SLM operations, fine-tuning/evaluation, per-model performance recipes, and prompt engineering and evaluation harnesses
1+ years of experience with LLM API exposure, including AI Gateway — OAuth2/mTLS, rate limits/quotas, OpenAPI/SDKs, SLAs, versioning/deprecation, and OpenAI-compatible API design for responses and interactions
1+ years of experience with serving large language models (LLM/SLM), including vLLM, Triton, TensorRT-LLM/MII, KV cache strategies, FP8/INT4 AWQ/GPTQ, and certified disaggregated prefill/decode
1+ years of experience with orchestration tools for GPU workload management, such as Run:AI (Collections/queues, quotas, preemption, fair share), OpenShift AI (RHOAI), and OCP/GKE administration
1+ years of experience with GPU Inference Layer, including NVIDIA and CUDA technologies such as CUDA, cuDNN, NVLink/NVSwitch, MIG, NIXL, GPU profiling, and H100/H200 performance tuning
Benefits
No visa sponsorship available
No relocation assistance for this position
Job title
Lead Software Engineer – Gen AI Inferencing Services, Agentic AI
Staff Software Engineer leading the APAC team within Abnormal AI's Multi - Product Platform. Focusing on customer experience and international expansion in cutting - edge security solutions.
Fullstack Developer creating APIs and modern interfaces at OpenCircle, a technology company focused on innovation. Working with both backend and frontend technologies in a collaborative environment.
Principal Software Engineer designing and building LLM - powered systems for AI - driven solutions. Collaborating across teams to transform engineering problems into production - ready intelligent applications.
Associate Software Engineer Co - Op helping develop and maintain software products at CodeMettle. Collaborating with engineering teams on various projects and gaining practical experience in software development.
AI Software Engineer - Reliability diagnosing and resolving complex production issues for restaurant technology solutions. Leveraging AI tools to enhance system resilience and efficiency in a hybrid work environment.
Senior Engineering Technician collaborating with teams on civil infrastructure projects for Battery Energy Storage Systems and Clean Transportation at Black & Veatch.
Lead Engineer responsible for testing and documentation of Level - 4 autonomous systems at MOTOR Ai. Collaborating with cross - functional teams to ensure effective system validation and integration.
Senior Software Architect designing scalable SaaS applications for Euna Solutions. Leading architectural standards, mentoring teams, and ensuring alignment with business goals in a hybrid environment.
Principal Full Stack Engineer at Fidelity collaborating on high - quality scalable systems solutions. Leading technical strategies and development efforts in financial services technology environment.
Senior Software Engineer developing automation tools within Fidelity’s SkillBridge Program. Focusing on risk management in the Cloud and DevOps environments for corporate readiness.