Senior Software Engineer II - AI

Posted Yesterday
Be an Early Applicant
2 Locations
Hybrid
Senior level
Artificial Intelligence • Software • Analytics • Utilities
The Role
Build and ship customer-facing AI features for Scout, including agentic LLM workflows, tool calling, RAG pipelines, evaluations, guardrails, and prompt engineering. Develop full-stack services and interfaces using backend languages, TypeScript, React, and mobile technologies. Deploy scalable, secure systems on AWS and Kubernetes, with monitoring, testing, and CI/CD. Own features end-to-end, collaborate with stakeholders, make product decisions, and contribute to reliable AI infrastructure and engineering practices.
Summary Generated by Built In
The Opportunity

This is more than a full-stack role — it's your chance to build the AI layer of the platform the world's infrastructure runs on. Sitetracker is building Scout, our AI product line: production LLM systems and agentic workflows embedded in the software companies like Cox, Telefónica, and EVgo use to deploy critical infrastructure. As a Product Engineer, you'll take AI capabilities from idea to production agent orchestration and model integration on the backend, and the web and mobile experiences that put them in customers' hands.

This is shipping real, customer-facing AI  , not prototypes or research demos. You'll own features end-to-end, work with frontier models (Anthropic, OpenAI), and see your work land in the hands of enterprise users deploying telecom networks, EV chargers, and renewable energy around the world.

What You’ll do:

As a Product Engineer on Scout, you'll hit the ground running and ship customer-facing AI from day one. You'll design, build, test, deploy, and monitor AI product features end-to-end  , building agentic LLM systems with multi-agent workflows, tool/function calling, RAG pipelines, and prompt engineering over frontier models from Anthropic and OpenAI.

You'll work across the full stack: backend services in Python, Java, Node.js, or Go, and TypeScript/React frontends spanning both web and mobile app experiences. You'll make AI dependable  by building automated evaluation pipelines, guardrails, and testing strategies for non-deterministic outputs — and running it on production infrastructure: scalable, fault-tolerant services on AWS and Kubernetes.

You'll think like a product engineer, not a ticket-taker: dig into user needs, absorb the problem space, make smart calls about what to build, keep stakeholders informed, and find ways to unblock yourself.

The Skills You’ll Have:

Full-Stack Product Engineering

●   Build production backend services in one or more of Python (FastAPI or similar), Java, Node.js, or Go.
●   Ship production web interfaces in TypeScript and React; mobile app development (React Native or similar) is a plus.
●   Design REST APIs and data models across relational and NoSQL databases.
●  Own features end-to-end: implementation, testing, deployment, and monitoring.
 

AI / LLM Engineering

● Build with LLM APIs (Anthropic, OpenAI): agentic workflows, tool/function calling, RAG pipelines, and prompt engineering. Production experience preferred; substantial personal or open-source projects considered.
●  Write evaluation pipelines and testing strategies for non-deterministic AI outputs.
●  Bonus: agent frameworks (LangChain, LangGraph, LlamaIndex, CrewAI), Model Context Protocol (MCP), LLMOps tooling (LangSmith, Langfuse), vector databases, or model serving (vLLM, GPU inference).
 

Production Systems & AI Infrastructure

● Deploy and operate services on AWS with Docker, Kubernetes, and CI/CD (Scout runs on AWS).
● Instrument systems with observability and handle customer data securely in AI systems.
● Design fault-tolerant, scalable services that serve AI workloads reliably.
● Salesforce platform and Apex — Scout integrates with the Sitetracker Salesforce platform.
 

Product Thinking & Communication

● Dig into user needs and use that context to decide what to build and how.
● Explain technical decisions and AI concepts clearly to technical and non-technical audiences.
● Break challenges into iterative solutions, keep stakeholders informed, and unblock myself.

Within 90 Days, You’ll:

    ●   Ramp up on Scout's architecture, codebase, and AI tooling.
    ●   Ship your first AI-driven product features with support from senior engineers.
    ●   Build a working knowledge of our evaluation pipelines and deployment workflow on AWS.

Within 180 Days, You’ll:

    ● Independently deliver AI product features end-to-end, with increasing complexity.
    ● Contribute to design discussions and team best practices for secure, scalable AI development.
    ● Own the quality of your features in production: monitoring, evals, and iteration.

Within 365 Days, You’ll:

    ● Consistently deliver well-crafted, end-to-end AI product capabilities that increase velocity and throughput.
    ● Elevate team quality through strong technical work, thoughtful code reviews, and knowledge sharing.
    ● Serve as a go-to contributor for agentic systems on Scout.

Skills Required

  • Production backend development experience with Python, Java, Node.js, or Go
  • Production web development experience with TypeScript and React
  • Experience designing REST APIs and data models across relational and NoSQL databases
  • Experience owning features through implementation, testing, deployment, and monitoring
  • Experience building with LLM APIs, including agentic workflows, tool or function calling, RAG pipelines, and prompt engineering
  • Experience creating evaluation pipelines and testing strategies for nondeterministic AI outputs
  • Experience deploying and operating services on AWS with Docker, Kubernetes, and CI/CD
  • Experience building scalable and fault-tolerant services
  • Ability to instrument systems with observability and securely handle customer data in AI systems
  • Ability to understand user needs, make product decisions, and communicate technical concepts clearly
  • React Native or similar mobile application development experience
  • Experience with LangChain, LangGraph, LlamaIndex, CrewAI, MCP, LangSmith, Langfuse, vector databases, vLLM, or GPU inference
  • Salesforce platform and Apex experience
  • Production LLM experience, with substantial personal or open-source projects considered
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
301 Employees
Year Founded: 2013

What We Do

Our Mission: Power the successful deployment of critical infrastructure Sitetracker, Inc. is the global standard for deploying, operating and servicing critical infrastructure and technology. The Sitetracker Platform enables growth-focused innovators to optimize the entire asset lifecycle through native platform inclusions like AI, automation, and actionable analytics. From the field to the C-suite, Sitetracker enables stakeholders to optimize how they plan, deploy, maintain, and grow their capital asset portfolios. Market leaders in the telecommunications, alternative energy, and utility industries — such as Ericsson, Fortis, Google, British Telecom, and Vodafone — rely on Sitetracker to manage millions of sites and projects representing over $25 billion of portfolio holdings globally.

Similar Jobs

Coursera + Udemy  Logo Coursera + Udemy

LLMops Engineer

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees
In-Office or Remote
2 Locations
175633 Employees

Hilton Logo Hilton

Assistant Manager Housekeeping

Software • Hospitality
In-Office
New Delhi, Delhi, IND
121228 Employees
In-Office or Remote
2 Locations
175633 Employees

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
60 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account