Lead Software Engineer – AI/RAG Platform

Posted 4 Days Ago
Be an Early Applicant
Hiring Remotely in GA
Remote
Senior level
Other • Retail
The Role
The Lead Software Engineer oversees the development and enhancement of an AI platform, leading a team, mentoring engineers, and ensuring the reliability and scalability of AI services.
Summary Generated by Built In

Purpose:
The IT Lead Developer will provide technical leadership for planning, designing, configuring, testing, implementing, documenting, training and maintaining the solutions for the products implemented on the ServiceNow platform to meet business needs and corporate objectives.

Minimum Eligibility Requirements:

  • 7–10 years of professional software engineering experience, with increasing scope and ownership. 

  • Hands-on experience designing and deploying 2–5 production RAG agents or AI-powered applications. 

  • Proficiency in Python for backend services and LLM orchestration (LangChain, Semantic Kernel, or similar frameworks). 

  • Working knowledge of Angular or comparable modern front-end frameworks. 

  • Demonstrated experience with Azure OpenAI services — including LLM APIs, Azure AI Search (vector/index), and associated Azure infrastructure. 

  • Experience with service-based and microservice architectures, RESTful API design, and async service communication. 

  • Familiarity with MCP or other tool-calling/function-calling patterns for LLM-to-system integrations. 

  • Experience with cloud environments (Azure preferred) including compute, storage, networking, and IAM fundamentals. 

  • Practical knowledge of agile/scrum methodologies — sprint ceremonies, story estimation, backlog grooming. 

Essential Job Functions:

Technical Leadership 

  • Architect, develop, and continuously improve a production RAG agent built on Azure OpenAI — including chunking strategies, vector indexing, retrieval ranking, and prompt engineering. 

  • Lead full-stack development across an Angular front end and a Python-based service and LLMOps layer. 

  • Design and maintain MCP (Model Context Protocol) integrations with inventory and merchandising systems to ground AI responses in live operational data. 

  • Own the model evaluation pipeline using Ragas to track faithfulness, answer relevance, and context precision metrics across releases. 

  • Make architectural decisions for reliability, scalability, and observability of all AI services deployed in Azure. 

 

Team & Stakeholder Collaboration 

  • Lead, mentor, and conduct code reviews for a team of software engineers, fostering a culture of quality and continuous learning. 

  • Work closely with product managers and business stakeholders to understand associate pain points, translate them into technical requirements, and prioritize the backlog. 

  • Champion agile practices — participate in sprint planning, retrospectives, and daily stand-ups as a senior voice on the team. 

  • Communicate technical trade-offs and architectural decisions clearly to both technical and non-technical audiences. 

 

Innovation & Quality 

  • Evaluate emerging LLM capabilities, tooling, and Azure OpenAI updates; recommend and prototype improvements to keep the platform current. 

  • Establish and maintain engineering best practices including CI/CD pipelines, code quality standards, and security practices for AI workloads. 

  • Troubleshoot and resolve complex issues in retrieval quality, LLM hallucination, latency, and integration reliability. 

Nice to Have 

  • Experience with Ragas or other LLM evaluation frameworks (RAGAS, ROUGE, G-Eval, etc.). 

  • Familiarity with retail systems — POS, OMS, inventory/merchandising platforms. 

  • Exposure to LLMOps tooling such as MLflow, Weights & Biases, or Azure ML. 

  • Prior experience in a Center of Excellence or innovation-focused team within a larger enterprise. 

 

Our Technology Stack 

 

Front End 

Angular 

Back End / LLMOps 

Python, REST APIs, MCP 

AI / LLM 

Azure OpenAI (GPT-4), Azure AI Search, RAG Architecture 

Evaluation 

Ragas 

Cloud & DevOps 

Microsoft Azure, CI/CD pipelines, Agile/Scrum 

Integrations 

Inventory & Merchandising Systems via MCP 

 

Work Environment 

 

  • This is a hybrid position based at our Atlanta, GA headquarters, with a standard office schedule Monday through Friday during core business hours. 

  • You will work in a collaborative, open-plan office environment within the IT department, with dedicated space for focused engineering work. 

  • The role involves regular in-person collaboration with product managers, business stakeholders, and your engineering team. 

  • Occasional visits to retail store locations may be required to gather associate feedback and observe how the product is used in context. 

  • Some extended hours may be needed around major releases or on-call rotations for production incidents. 

  • Standard physical requirements of a professional office environment apply — prolonged sitting, use of a computer workstation, and participation in in-person and video meetings. 

 

Why Join Our AI Center of Excellence 

 

  • Be the technical lead on a live, production AI product used by thousands of associates across a national retail footprint. 

  • Work at the intersection of applied AI and real-world retail operations — your work has immediate, visible impact. 

  • Collaborate with a passionate team in a company that is genuinely investing in AI as a strategic priority. 

  • Competitive compensation, comprehensive benefits, and a culture that values curiosity and continuous improvement. 

  • Opportunities to grow into broader AI architecture and engineering leadership as the Center of Excellence scales. 

 Working Conditions (travel & environment)

  • Limited travel required including air and car travel.
  • While performing the duties of this job, the employee is occasionally exposed to a warehouse environment and moving vehicles. The noise level in the work environment is typically quiet to moderate.

PHYSICAL/SENSORY    REQUIREMENTS

Sedentary Work – Ability to exert 10 - 20 pounds of force occasionally, and/or negligible amount of force frequently to lift, carry, push, pull or otherwise move objects.  Sedentary work involves sitting most of the time, but may involve walking or standing for brief periods of time. 

Note:  Floor & Decor considers all applicants for employment without regard to race, color, religion, sex, gender identity, sexual orientation, national origin, age, disability, medical condition, pregnancy, marital or familial status, veteran status, or based on any other class protected by applicable federal, state, or local law.  Floor & Decor also provides reasonable accommodations to qualified individuals with disabilities in accordance with the Americans with Disabilities Act and applicable state and local law.

This job description does not constitute an employment agreement between the employer and the employee and is subject to change by the employer at its sole discretion.

Benefits & Rewards

Bonus opportunities & career advancement opportunities at every level

Programs that help you reach your financial goals: 401k with company match, Employee Stock Purchase Plan, and Referral Bonus Program

Medical, Dental, Vision, Life, and other Insurance Plans (subject to eligibility criteria)

Work-life balance, including:

  • Paid vacation and sick time for eligible associates

  • Paid holidays plus a personal holiday

  • Paid Volunteer Time Off that starts on Day 1

Equal Employment Opportunity

Floor & Decor provides equal employment opportunities to all associates and applicants without regard to age, race, color, religion or creed, national origin or ancestry, sex (including pregnancy), sexual orientation, gender, gender identity, disability, veteran status, genetic information, ethnicity, citizenship, or any other category protected by law.

This policy applies to all areas of employment, including recruitment, testing, screening, hiring, selection for training, upgrading, transfer, demotion, layoff, discipline, termination, compensation, benefits and all other privileges, terms and conditions of employment.  This policy and the law prohibit employment discrimination against any associate or applicant on the basis of any legally protected status outlined above.

Top Skills

Angular
Azure Ai Search
Azure Openai
Ci/Cd
Mcp
Python
Rest Apis
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Atlanta, GA
15,001 Employees
Year Founded: 2000

What We Do

At Floor & Decor, we don't just sell flooring; we create endless possibilities. Redefining the retail experience since 2000, we are constantly in build mode, just like our customers. Joining F&D means moving fast, being part of decisions, and getting support at every turn.

Why Work With Us

We are builders, both of dream spaces and careers. You aren't just a number at a store selling some of everything -- you're a valued associate receiving customized training plans and endless career possibilities at a store focused on doing one thing better than anyone else.

Gallery

Gallery

Similar Jobs

Samsara Logo Samsara

Director, Equity Admin

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
GA
4000 Employees
134K-191K Annually

Samsara Logo Samsara

Engagement Services Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
GA
4000 Employees
101K-136K Annually

Samsara Logo Samsara

Mid-market Account Executive

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
GA
4000 Employees
152K-190K Annually

Samsara Logo Samsara

Customer Success Manager

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
GA
4000 Employees
89K-135K Annually

Similar Companies Hiring

Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Milestone Systems Thumbnail
Software • Security • Other • Big Data Analytics • Artificial Intelligence • Analytics
Lake Oswego, OR
1500 Employees
Fairly Even Thumbnail
Software • Sales • Robotics • Other • Hospitality • Hardware
New York, NY

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account