Senior Software Engineer - AI

Posted 7 Days Ago
Be an Early Applicant
2 Locations
Hybrid
Senior level
Artificial Intelligence • Software • Analytics • Utilities
The Role
Build and ship production AI/LLM features end-to-end: design and implement agentic LLM systems, RAG pipelines, and backend services (Python/Java/Node/Go) plus TypeScript/React frontends. Deploy, monitor, and secure services on AWS with Docker/Kubernetes, create evaluation pipelines and guardrails, and collaborate with product and stakeholders.
Summary Generated by Built In
The Opportunity

This is more than a full-stack role — it's your chance to build the AI layer of the platform the world's infrastructure runs on. Sitetracker is building Scout, our AI product line: production LLM systems and agentic workflows embedded in the software companies like Cox, Telefónica, and EVgo use to deploy critical infrastructure. As a Product Engineer, you'll take AI capabilities from idea to production agent orchestration and model integration on the backend, and the web and mobile experiences that put them in customers' hands.

This is shipping real, customer-facing AI  , not prototypes or research demos. You'll own features end-to-end, work with frontier models (Anthropic, OpenAI), and see your work land in the hands of enterprise users deploying telecom networks, EV chargers, and renewable energy around the world.

What You’ll do:

As a Product Engineer on Scout, you'll hit the ground running and ship customer-facing AI from day one. You'll design, build, test, deploy, and monitor AI product features end-to-end  , building agentic LLM systems with multi-agent workflows, tool/function calling, RAG pipelines, and prompt engineering over frontier models from Anthropic and OpenAI.

You'll work across the full stack: backend services in Python, Java, Node.js, or Go, and TypeScript/React frontends spanning both web and mobile app experiences. You'll make AI dependable  by building automated evaluation pipelines, guardrails, and testing strategies for non-deterministic outputs — and running it on production infrastructure: scalable, fault-tolerant services on AWS and Kubernetes.

You'll think like a product engineer, not a ticket-taker: dig into user needs, absorb the problem space, make smart calls about what to build, keep stakeholders informed, and find ways to unblock yourself.

The Skills You’ll Have:

Full-Stack Product Engineering

●   Build production backend services in one or more of Python (FastAPI or similar), Java, Node.js, or Go.
●   Ship production web interfaces in TypeScript and React; mobile app development (React Native or similar) is a plus.
●   Design REST APIs and data models across relational and NoSQL databases.
●  Own features end-to-end: implementation, testing, deployment, and monitoring.
 

AI / LLM Engineering

● Build with LLM APIs (Anthropic, OpenAI): agentic workflows, tool/function calling, RAG pipelines, and prompt engineering. Production experience preferred; substantial personal or open-source projects considered.
●  Write evaluation pipelines and testing strategies for non-deterministic AI outputs.
●  Bonus: agent frameworks (LangChain, LangGraph, LlamaIndex, CrewAI), Model Context Protocol (MCP), LLMOps tooling (LangSmith, Langfuse), vector databases, or model serving (vLLM, GPU inference).
 

Production Systems & AI Infrastructure

● Deploy and operate services on AWS with Docker, Kubernetes, and CI/CD (Scout runs on AWS).
● Instrument systems with observability and handle customer data securely in AI systems.
● Design fault-tolerant, scalable services that serve AI workloads reliably.
● Salesforce platform and Apex — Scout integrates with the Sitetracker Salesforce platform.
 

Product Thinking & Communication

● Dig into user needs and use that context to decide what to build and how.
● Explain technical decisions and AI concepts clearly to technical and non-technical audiences.
● Break challenges into iterative solutions, keep stakeholders informed, and unblock myself.

Within 90 Days, You’ll:

    ●   Ramp up on Scout's architecture, codebase, and AI tooling.
    ●   Ship your first AI-driven product features with support from senior engineers.
    ●   Build a working knowledge of our evaluation pipelines and deployment workflow on AWS.

Within 180 Days, You’ll:

    ● Independently deliver AI product features end-to-end, with increasing complexity.
    ● Contribute to design discussions and team best practices for secure, scalable AI development.
    ● Own the quality of your features in production: monitoring, evals, and iteration.

Within 365 Days, You’ll:

    ● Consistently deliver well-crafted, end-to-end AI product capabilities that increase velocity and throughput.
    ● Elevate team quality through strong technical work, thoughtful code reviews, and knowledge sharing.
    ● Serve as a go-to contributor for agentic systems on Scout.

Skills Required

  • Build production backend services in one or more of Python (FastAPI), Java, Node.js, or Go
  • Ship production web interfaces in TypeScript and React
  • Design REST APIs and data models across relational and NoSQL databases
  • Build with LLM APIs (Anthropic, OpenAI): agentic workflows, tool/function calling, RAG pipelines, and prompt engineering
  • Production experience with LLM systems (preferred; substantial personal or open-source projects considered)
  • Write evaluation pipelines and testing strategies for non-deterministic AI outputs
  • Deploy and operate services on AWS with Docker, Kubernetes, and CI/CD
  • Instrument systems with observability and handle customer data securely in AI systems
  • Experience with agent frameworks, LLMOps tooling, vector databases, or model serving (vLLM, GPU inference)
  • Salesforce platform and Apex integration experience
  • Mobile app development (React Native or similar)
  • Strong product thinking and communication skills to work with technical and non-technical stakeholders
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Palo Alto, CA
301 Employees
Year Founded: 2013

What We Do

Our Mission: Power the successful deployment of critical infrastructure Sitetracker, Inc. is the global standard for deploying, operating and servicing critical infrastructure and technology. The Sitetracker Platform enables growth-focused innovators to optimize the entire asset lifecycle through native platform inclusions like AI, automation, and actionable analytics. From the field to the C-suite, Sitetracker enables stakeholders to optimize how they plan, deploy, maintain, and grow their capital asset portfolios. Market leaders in the telecommunications, alternative energy, and utility industries — such as Ericsson, Fortis, Google, British Telecom, and Vodafone — rely on Sitetracker to manage millions of sites and projects representing over $25 billion of portfolio holdings globally.

Similar Jobs

G2i Logo G2i

Senior Software Engineer

HR Tech • Other • Professional Services
In-Office or Remote
164 Locations
201 Employees
50-200 Hourly

AlphaSense Logo AlphaSense

Senior Software Engineer

Artificial Intelligence • Fintech • Machine Learning • Natural Language Processing • Business Intelligence
Hybrid
Delhi, Connaught Place, New Delhi, Delhi, IND
2000 Employees

Vercel Logo Vercel

Sr. Manager, Accounting (India)

Artificial Intelligence • Cloud • Software
Easy Apply
Remote or Hybrid
India
7M-9M Annually

Vercel Logo Vercel

Senior Accountant

Artificial Intelligence • Cloud • Software
Easy Apply
Remote or Hybrid
India
4M-5M Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account