About Northern Trust
As a global leader in innovative wealth management, asset servicing, asset management and banking services, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families, corporations and institutions.
Since 1889, we have aligned our efforts with our three guiding Principles That Endure: Service, Expertise, and Integrity. Together, they reflect the three cornerstones of business conduct which we strive to instill in our employees, whom we call partners, and to provide to our clients and the communities we serve worldwide.
With more than 135 years of financial experience and over 24,000 partners, we serve the world’s most sophisticated clients using leading technology and exceptional service.
Job Description: AI Engineer – Generative AI & Product Engineering
Role Overview
We are seeking a hands-on AI Engineer with strong product development experience to design, build, and deploy enterprise-grade Generative AI solutions. The ideal candidate combines expertise in LLMs, RAG, agentic AI, Python, Azure, and cloud-native engineering with a product mindset focused on scalability, reliability, security, and user experience.
The engineer will work across the full product lifecycle, from architecture and prototyping through API development, deployment, evaluation, monitoring, and production support.
Key Responsibilities
- Design and develop enterprise Generative AI and agentic AI applications using LangChain/LangSmith and LangGraph.
- Build multi-step and stateful AI workflows involving reasoning, tool integration, retrieval, and human-in-the-loop patterns.
- Develop Retrieval-Augmented Generation (RAG) solutions using PostgreSQL and pgvector for vector storage and semantic retrieval.
- Integrate applications with Azure OpenAI and other LLM-based services.
- Design effective prompts and reusable prompt patterns using advanced prompt engineering techniques.
- Build scalable backend services and REST APIs using Python and FastAPI.
- Develop evaluation and observability mechanisms for measuring AI response quality, latency, reliability, and retrieval effectiveness.
- Use LangSmith for tracing, evaluation, debugging, and observability of LLM/agent workflows.
- Containerize and deploy AI services to Azure Kubernetes Service (AKS).
- Design solutions using appropriate Azure services for identity, security, networking, storage, monitoring, and application integration.
- Implement production-ready practices including exception handling, logging, retries, API security, configuration management, and observability.
- Work closely with product owners, architects, and engineering teams to convert business requirements into scalable AI product capabilities.
- Participate in architecture/design reviews, code reviews, testing, deployment, troubleshooting, and ongoing product enhancement.
- Evaluate emerging LLM, retrieval, agentic AI, and AI engineering techniques and apply them where they provide measurable product value.
- Partner with application, infrastructure, cloud, database, and operations teams during major incidents and production issues to identify dependencies and resolve problems.
Required Technical Skills
Generative AI
- Large Language Models (LLMs)
- Azure OpenAI
- Retrieval-Augmented Generation (RAG)
- Prompt Engineering
- Agentic AI / AI Agents
- LLM evaluation and observability
AI Frameworks
- LangChain
- LangGraph
- LangSmith
Application Engineering
- Python
- FastAPI
- REST APIs
- Async/API development
- Microservices architecture
Data & Vector Search
- PostgreSQL
- pgvector
- Vector embeddings
- Semantic/vector search
- RAG retrieval and indexing patterns
Cloud & Deployment
- Microsoft Azure
- Azure Kubernetes Service (AKS)
- Containers/Docker
- Cloud-native application development
- CI/CD and production deployment practices
Product Development Experience
The candidate should demonstrate experience taking AI capabilities beyond proof-of-concept into production products, including:
- Translating business requirements into technical product capabilities
- Designing reusable and maintainable AI architectures
- Balancing model quality, latency, cost, security, and scalability
- Designing APIs and integration patterns for enterprise applications
- Establishing AI evaluation and quality measures
- Troubleshooting production LLM/RAG applications
- Collaborating across engineering, architecture, product, QA, DevOps, and business teams
- Owning features through design, development, testing, deployment, and production stabilization
Preferred Qualifications
- Strong hands-on experience developing enterprise GenAI/RAG products
- Experience building LangGraph-based agentic workflows
- Hands-on experience with LangSmith tracing and evaluation
- Experience deploying Python/FastAPI applications on AKS
- Experience with PostgreSQL/pgvector at production scale
- Understanding of LLM hallucination, grounding, context management, guardrails, and evaluation
- Familiarity with Azure identity, secrets management, monitoring, and enterprise security patterns
- Experience building internal developer, infrastructure, automation, operations, or knowledge-management AI products is a plus.
Salary Range:
$80,800 - 133,400 USDSalary range is a good faith estimate of base pay. Northern Trust provides a comprehensive benefits package including retirement benefits (401k and pension), health and welfare benefits (medical, dental, vision, spending accounts and disability), paid time off, parental and caregiver leave, life & accident insurance, and other voluntary and well-being benefits. Northern Trust also provides a discretionary bonus program that may include an equity component.
Work Authorization
Applicants must be authorized to work in the U.S. without the need for employment-based visa sponsorship now or in the future. Northern Trust will not sponsor applicants for U.S. work visa status for this opportunity (no sponsorship is available for H-1B, L-1, TN, O-1, E-3, H-1B1, F-1, J-1, OPT, CPT or any other employment-based visa).
Working with Us
As a Northern Trust partner, you will be part of a flexible and collaborative work culture, which has a strong history of financial strength and stability. Movement within the organization is encouraged, senior leaders are accessible, and you can take pride in working for a company committed to an inclusive workplace and assisting the communities we serve.
Philanthropy is deeply rooted in Northern Trust’s history and is an essential element of our culture. Employees around the world give their time and talent to work for the greater good of their communities.
Reasonable Accommodation
Northern Trust is committed to working with and providing adjustments to individuals with health conditions and disabilities. If you need a reasonable accommodation for any part of the employment process, please email our HR Service Center at [email protected], or alternatively you can discuss your individual requirements with the recruiter you are working with.
Skills Required
- Experience developing enterprise generative AI and agentic AI applications
- Experience with large language models, Azure OpenAI, Retrieval-Augmented Generation, prompt engineering, and LLM evaluation and observability
- Experience with LangChain, LangGraph, and LangSmith
- Proficiency in Python, FastAPI, REST APIs, asynchronous API development, and microservices architecture
- Experience with PostgreSQL, pgvector, vector embeddings, semantic search, and RAG retrieval and indexing
- Experience with Microsoft Azure, Azure Kubernetes Service, containers or Docker, cloud-native development, CI/CD, and production deployment
- Product development experience taking AI capabilities from proof of concept into production
- Ability to translate business requirements into technical product capabilities and design reusable AI architectures
- Experience designing APIs and enterprise integration patterns
- Experience establishing AI evaluation and quality measures
- Experience troubleshooting production LLM and RAG applications
- Experience collaborating across engineering, architecture, product, QA, DevOps, and business teams
- Experience owning features through design, development, testing, deployment, and production stabilization
- Strong hands-on experience developing enterprise GenAI and RAG products
- Experience building LangGraph-based agentic workflows
- Hands-on experience with LangSmith tracing and evaluation
- Experience deploying Python and FastAPI applications on AKS
- Experience with PostgreSQL and pgvector at production scale
- Understanding of LLM hallucination, grounding, context management, guardrails, and evaluation
- Familiarity with Azure identity, secrets management, monitoring, and enterprise security patterns
- Experience building internal developer, infrastructure, automation, operations, or knowledge-management AI products
Northern Trust Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Northern Trust and has not been reviewed or approved by Northern Trust.
-
Retirement Support — A 401(k) with company match alongside an employer‑funded defined‑benefit pension is highlighted in employer‑verified materials and filings, setting the retirement package apart from many private employers.
-
Leave & Time Off Breadth — PTO is portrayed as solid overall, and two paid volunteer days per year are clearly documented across corporate materials.
-
Parental & Family Support — Company sources and postings reference paid parental and caregiver leave and recent enhancements to parental benefits, indicating meaningful family support within the package.
Northern Trust Insights
What We Do
As a global leader in innovative wealth management, asset servicing and investment solutions, Northern Trust (Nasdaq: NTRS) is proud to guide the world’s most successful individuals, families and institutions by remaining true to our enduring principles of service, expertise and integrity. A globally recognized Fortune 500 Company in continuous operation since 1889, we’ve built a legacy of empowering clients to reach their goals with confidence. Since our roots as a trust bank, we’ve grown to a global presence with more than 24,000 employees in more than 20 countries and across six core business units: Wealth Management Asset Management Asset Servicing Technology Corporate Functions Enterprise Operations Join a Team That’s Achieving Greater At Northern Trust, we refer to our employees as partners – with good reason. We understand that relationships are the key to our success. Here you’ll join a diverse and inclusive team of innovators with the drive to challenge the way things have always been done. Instead of choosing between a dynamic career and work-life balance, enjoy working with a team that supports your goals in the office and at home. We’ll help you get where you want to go without sacrificing what matters most to you. Delivering value and adhering to our enduring principles What are enduring principles? Since our founding, they have guided our strategy and success. Thanks to the dedication of our partners, Northern Trust continues to thrive by adhering to three enduring principles: service, expertise and integrity . What does this mean? Service Northern Trust has a relentless drive to provide exceptional service to our clients, our partners and our communities. We set new standards and go above and beyond in our commitment to delivering greater results. Expertise Expertise is at the core of who we are. We focus sharply on what we do well. From expanding our capabilities, to hiring talented professionals to developing innovative solutions, our expertise is why we continue to be a trusted advisor for generations of families and institutions. Integrity Operating with uncompromising ethics is central to Northern Trust’s heritage. As a result, our clients, partners and communities know they can rely on us. For more than 130 years, our integrity has been our guide – and that will never change.
Why Work With Us
At Northern Trust, we go further because we go together. We embrace flexibility, encourage balance, and prioritize inclusion at all levels, working together to keep you connected. We are committed to our employees—all 24,000 of them. Whether this is a first step or a bold new leap in your career, we’re here to help you move forward.
Gallery
