AI Architect – Production LLM Systems (Azure)

Posted 2 Days Ago
Be an Early Applicant
Dallas, TX, USA
Hybrid
Expert/Leader
Consulting
We are the trusted global infrastructure leader.
The Role
Lead architectural evolution for an enterprise AI platform, focusing on production-grade LLM systems, integrating RAG pipelines, and ensuring cloud security and performance standards.
Summary Generated by Built In
Company Description

Work with Us. Change the World.

At AECOM, we're delivering a better world. Whether improving your commute, keeping the lights on, providing access to clean water, or transforming skylines, our work helps people and communities thrive. We are the world's trusted infrastructure consulting firm, partnering with clients to solve the world’s most complex challenges and build legacies for future generations.

There has never been a better time to be at AECOM. With accelerating infrastructure investment worldwide, our services are in great demand. We invite you to bring your bold ideas and big dreams and become part of a global team of over 50,000 planners, designers, engineers, scientists, digital innovators, program and construction managers and other professionals delivering projects that create a positive and tangible impact around the world.

We're one global team driven by our common purpose to deliver a better world. Join us.

Job Description

As an AI Architect, you will lead the architectural evolution of Oscar, our enterprise AI platform used across the organization. This is a highly technical, hands-on role focused on building secure, observable, production-grade LLM systems at scale.

You will define the architectural runway for future capabilities like agent orchestration, tool-use frameworks, and enterprise data integration while staying deeply engaged in technical spikes, design reviews, and delivery execution.

This role sits at the intersection of LLM engineering, Azure cloud architecture, and real-world enterprise deployment.

This position will offer flexibility for hybrid work schedules to include both in-office presence and telecommute/virtual work, to be based from either Houston or Dallas, TX.

Key Responsibilities

  • Define and evolve the AI architecture roadmap for Oscar, building scalable patterns for LLM integration, RAG pipelines, and agent-based workflows
  • Architect and optimize production-grade RAG systems, including retrieval strategies, embedding design, vector search tuning, and model orchestration in Azure
  • Lead technical spikes and convert prototypes into secure, production-ready implementations
  • Establish observability, alerting, cost efficiency, and performance standards for AI services operating at enterprise scale
  • Mentor engineers through Sprint execution, conduct design and code reviews, and elevate overall engineering quality
  • Evaluate emerging AI frameworks (e.g., MCP, orchestration patterns) and introduce practical innovations aligned to product roadmap needs

Qualifications

Minimum Qualifications

  • Bachelor's Degree plus at least 10 years of distributed systems or enterprise platforms experience, including 3+ years deploying AI/LLM systems into production environments, or demonstrated equivalent experience and education
  • Proven hands-on experience designing and implementing RAG architectures in enterprise environments
  • Deep expertise with Azure cloud services and cloud-native application design
  • Strong foundation in APIs, distributed systems, security controls, and production observability
  • Comfortable operating hands-on while leading technical direction

Preferred Qualifications

  • Experience building or scaling enterprise chatbots or AI-driven internal platforms
  • Familiarity with agent orchestration frameworks, Model Context Protocol (MCP), MLOps/DevSecOps practices, and multi-agent architectures

Additional Information

  • Relocation assistance is not available for this position
  • Sponsorship for US work authorization is not available for this position, now or in the future.

About AECOM 

AECOM is proud to offer comprehensive benefits to meet the diverse needs of our employees. Depending on your employment status, AECOM benefits may include medical, dental, vision, life, AD&D, disability benefits, paid time off, leaves of absences, voluntary benefits, perks, flexible work options, well-being resources, employee assistance program, business travel insurance, service recognition awards, retirement savings plan, and employee stock purchase plan. 

AECOM is the global infrastructure leader, committed to delivering a better world. As a trusted professional services firm powered by deep technical abilities, we solve our clients’ complex challenges in water, environment, energy, transportation and buildings. Our teams partner with public- and private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. AECOM is a Fortune 500 firm that had revenue of $16.1 billion in fiscal year 2025. Learn more at aecom.com. 

What makes AECOM a great place to work 

You will be part of a global team that champions your growth and career ambitions. Work on groundbreaking projects - both in your local community and on a global scale - that are transforming our industry and shaping the future. With cutting-edge technology and a network of experts, you’ll have the resources to make a real impact. Our award-winning training and development programs are designed to expand your technical expertise and leadership skills, helping you build the career you’ve always envisioned. Here, you’ll find a welcoming workplace built on respect, collaboration and community—where you have the freedom to grow in a world of opportunity. 

As an Equal Opportunity Employer, we believe in your potential and are here to help you achieve it. All your information will be kept confidential according to EEO guidelines. 

Skills Required

  • Bachelor's Degree plus 10 years of distributed systems experience
  • 3+ years deploying AI/LLM systems into production
  • Experience designing and implementing RAG architectures
  • Deep expertise with Azure cloud services
  • Strong foundation in APIs and production observability

AECOM Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about AECOM and has not been reviewed or approved by AECOM.

  • Healthcare Strength Multiple national medical options (UnitedHealthcare/Surest) and regional HMOs (Kaiser) cover in‑network preventive care at 100%, with added programs like Color cancer screening and Carrum Health surgery support at little or no cost. A medical expense estimator and varied plan designs help employees tailor coverage to anticipated needs.
  • Parental & Family Support Paid Parental Leave offers up to four weeks at 100% pay for all new parents (birth, adoption, foster, surrogacy), and five days of subsidized backup child care via Care.com adds practical support. Company‑paid short‑term disability provides income protection for up to 26 weeks, complementing family-related needs.
  • Equity Value & Accessibility An Employee Stock Purchase Plan enables buying company stock at a 12% discount with payroll contributions up to 10%. This straightforward access to discounted equity can augment total compensation over time.

AECOM Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dallas, TX
51,000 Employees
Year Founded: 1990

What We Do

AECOM is the global infrastructure leader, committed to delivering a better world. As a trusted professional services firm powered by deep technical abilities, we solve our clients’ complex challenges in water, environment, energy, transportation and buildings. Our teams partner with public- and private-sector clients to create innovative, sustainable and resilient solutions throughout the project lifecycle – from advisory, planning, design and engineering to program and construction management. AECOM is a Fortune 500 firm that had revenue of $16.1 billion in fiscal year 2024. Learn more at aecom.com.

Why Work With Us

Together, we thrive. We’re committed to being the best workplace in our industry – fostering respect, community, and innovation so our people can thrive, drive better outcomes for our clients, and fulfill our purpose of delivering a better world.

Gallery

Gallery

Similar Jobs

Cox Enterprises Logo Cox Enterprises

Search Engine Optimization Specialist

Artificial Intelligence • Automotive • Greentech • Information Technology • Machine Learning • Software • Cybersecurity
Remote or Hybrid
United States
50000 Employees
22-33 Hourly

Lansweeper Logo Lansweeper

Senior Quality Assurance Engineer

Cloud • Information Technology • Software
Hybrid
Austin, TX, USA
404 Employees

Optimum Logo Optimum

Product Manager

AdTech • Digital Media • Internet of Things • Marketing Tech • Mobile • Retail • Software
Hybrid
3 Locations
9000 Employees
123K-203K Annually

Optimum Logo Optimum

Site Reliability Engineer

AdTech • Digital Media • Internet of Things • Marketing Tech • Mobile • Retail • Software
Hybrid
2 Locations
9000 Employees
84K-137K Annually

Similar Companies Hiring

Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
108 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account