Wells Fargo is seeking a Lead Software Engineer - LLM Inferencing & Agentic AI within Digital Technology's AI Capability Engineering organization. In this role, you will design, build, and operate the GenAI Platform's GPU infrastructure and LLM/SLM serving systems, ensuring highly performant, reliable, and secure model inferencing at scale.
You will work across the full inferencing stack-from GPU cluster configuration and Run:AI / OpenShift AI orchestration to vLLM and NVIDIA Triton runtime optimization, including performance tuning, production hardening, and multi-model deployment. Focus areas include operating H100/H200 GPU clusters, advanced GPU scheduling, disaggregated prefill/decode serving, deep observability, and productionizing endpoints behind the enterprise API Gateway.
You will also design and deliver OpenAI-compatible APIs (Responses, Interactions), support MCP server integrations, and contribute to agentic AI development-including tools, agents, workflows, and evaluations. This role additionally involves building UI surfaces that improve developer and operator productivity, enabling teams to use, monitor, and troubleshoot AI services more effectively.
Strong experience with LLM/SLM behavior, inferencing optimizations, tuning techniques, and prompt engineering/evaluation is expected.
In this role, you will:
- Lead complex technology initiatives including those that are companywide with broad impact
- Act as a key participant in developing standards and companywide best practices for engineering complex and large scale technology solutions for technology engineering disciplines
- Design, code, test, debug, and document for projects and programs
- Review and analyze complex, large-scale technology solutions for tactical and strategic business objectives, enterprise technological environment, and technical challenges that require in-depth evaluation of multiple factors, including intangibles or unprecedented technical factors
- Make decisions in developing standard and companywide best practices for engineering and technology solutions requiring understanding of industry best practices and new technologies, influencing and leading technology team to meet deliverables and drive new initiatives
- Collaborate and consult with key technical experts, senior technology team, and external industry groups to resolve complex technical issues and achieve goals
- Lead projects, teams, or serve as a peer mentor
- Engineer GPU clusters and node pools; configure NVLink/NVSwitch, NVIDIA GPU Operator, MIG profiles, container runtime, and kernel/driver baselines for high-throughput LLM/SLM workloads.
- Design and implement OpenAI-compatible APIs (Responses, Interactions) behind the AI Gateway: define OpenAPI contracts, authN/Z (OAuth2/mTLS), rate limits/quotas, SLAs, versioning/deprecation, and SDK generation.
- Build and support MCP servers and tool adapters; manage agent/tool identity and capability metadata; integrate with agent registries and execution flows.
- Develop Agentic AI capabilities (tools/agents/workflows) including disaggregated prefill/decode patterns; contribute to runbooks, guardrails, and safe tool usage.
- Build UI surfaces (developer/ops consoles) for endpoint onboarding, prompt testing, evaluations, observability dashboards, and incident response workflows.
- Apply prompt engineering and evaluation best practices; create golden test suites, regression harnesses, and measurable SLO-aligned criteria for production promotion.
- 5+ years of Software Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
- 5+ years of experience in Python for backend/services development, packaging, instrumentation, and automation
- 5+ years of experience building modern web UI for developer/ops workflows, including dashboards, wizards, and prompt/eval tooling, with strong testing and accessibility practices
- 1+ years of experience building MCP servers, tool adapters, and agent workflows, with an understanding of agent identity, permissions, and governance metadata
- 2+ years of experience in GenAI engineering, including LLM/SLM operations, fine-tuning/evaluation, per-model performance recipes, and prompt engineering and evaluation harnesses
- 1+ years of experience with LLM API exposure, including AI Gateway - OAuth2/mTLS, rate limits/quotas, OpenAPI/SDKs, SLAs, versioning/deprecation, and OpenAI-compatible API design for responses and interactions
- 1+ years of experience with serving large language models (LLM/SLM), including vLLM, Triton, TensorRT-LLM/MII, KV cache strategies, FP8/INT4 AWQ/GPTQ, and certified disaggregated prefill/decode
- 1+ years of experience with orchestration tools for GPU workload management, such as Run:AI (Collections/queues, quotas, preemption, fair share), OpenShift AI (RHOAI), and OCP/GKE administration
- 1+ years of experience with GPU Inference Layer, including NVIDIA and CUDA technologies such as CUDA, cuDNN, NVLink/NVSwitch, MIG, NIXL, GPU profiling, and H100/H200 performance tuning
- Hybrid onsite at required locations
- No visa sponsorship available
- No relocation assistance for this position
2 Feb 2026
*Job posting may come down early due to volume of applicants.
We Value Equal Opportunity
Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.
Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit's risk appetite and all risk and compliance program requirements.
Candidates applying to job openings posted in Canada: Applications for employment are encouraged from all qualified candidates, including women, persons with disabilities, aboriginal peoples and visible minorities. Accommodation for applicants with disabilities is available upon request in connection with the recruitment process.
Applicants with Disabilities
To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo .
Drug and Alcohol Policy
Wells Fargo maintains a drug free workplace. Please see our Drug and Alcohol Policy to learn more.
Wells Fargo Recruitment and Hiring Requirements:
a. Third-Party recordings are prohibited unless authorized by Wells Fargo.
b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.
Wells Fargo Compensation & Benefits Highlights
-
Healthcare Strength — Health coverage begins on day 1 with medical, dental, and vision, and includes mental health, prescription drugs, and preventive care often covered at 100% in-network. Well-being resources such as 24-hour clinical support and an Employee Assistance Program add to the breadth.
-
Parental & Family Support — Paid parental leave provides up to 16 weeks for a primary caregiver (4 weeks for non-primary) alongside fertility benefits and up to a $35,000 lifetime reimbursement for adoption, surrogacy, and donor expenses. Backup child and adult care further supports family needs.
-
Retirement Support — Retirement benefits feature a 401(k) with company matching contributions up to 6% of eligible pay. An employee stock purchase plan adds another avenue for long-term savings.
Wells Fargo Insights
Similar Jobs
What We Do
Wells Fargo & Company (NYSE: WFC) is a leading financial services company that has approximately $2.2 trillion in assets. We provide a diversified set of banking, investment and mortgage products and services, as well as consumer and commercial finance, through our four reportable operating segments: Consumer Banking and Lending, Commercial Banking, Corporate and Investment Banking, and Wealth & Investment Management. Wells Fargo ranked No. 33 on Fortune’s 2025 rankings of America’s largest corporations. Our technology professionals drive innovation, information security, and big data analytics while maintaining a network that handles more than 12 billion customer interactions a year. Join us! Are you looking for more? Find it here. At Wells Fargo, we're more than a financial services leader – we’re a global trailblazer committed to driving innovation, empowering communities, and helping our customers succeed. We believe that a meaningful career is much more than just a job – it’s about finding all of the elements to help you thrive, in one place. Living the Well Life means you’re supported in life, not just work. It means having robust benefits, competitive compensation, and programs designed to help you find work-life balance and well-being. You’ll be rewarded for investing in your community, celebrated for being your authentic self, and empowered to grow. And we’re recognized for it — Wells Fargo continues to rank on the LinkedIn Top Companies lists of best workplaces “to grow your career.” All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic. © 2026 Wells Fargo Bank, N.A. All rights reserved. Member FDIC.
Why Work With Us
We're known for our “Well Life” approach to supporting employees’ career aspirations, work-life balance, and mental and physical health. Wells Fargo continues to rank on the LinkedIn Top Companies lists of best workplaces “to grow your career.”
Gallery
Wells Fargo Offices
Hybrid Workspace
Employees engage in a combination of remote and on-site work.
