Forward Deployed Engineer

Posted 18 Hours Ago
Be an Early Applicant
Arlington, VA, USA
In-Office
Entry level
Mobile • Software
The Role
Build, deploy, and operate a secure test and evaluation harness for language models, agentic systems, benchmarks, and multi-agent workflows in Azure Government IL5. Develop containerized microservices, integrations, CI/CD pipelines, observability, and automated testing. Gather requirements with government stakeholders, troubleshoot evaluations, manage technical debt and defects, coordinate technical initiatives, conduct demos, and transfer operational knowledge to government teams.
Summary Generated by Built In

540 is seeking a Forward Deployed Engineer to support a high-impact Department of War (DoW) initiative focused on testing and evaluating advanced SI capabilities before they reach mission-critical environments. The program is building a secure, repeatable environment to evaluate agentic systems and language models across the DoW.

In this role, you will build, deploy, and operate a test and evaluation (T&E) harness inside a government-hosted environment. This harness will route evaluation traffic to models through a controlled gateway, orchestrate benchmark test runs, and produce auditable, verifiable results that government decision-makers can trust.

You will own the software from code to production and work directly with government and industry testers to evaluate large language models, distilled small language models, and multi-agent workflows. Ultimately, you will serve as the core technical partner who turns testing needs into working evaluations, delivering a robust reference implementation that the government will own and operate over the long term.

Location: Primarily remote (DC metro area preferred), with occasional onsite meetings as needed
Citizenship & Clearance Requirement: per client requirements, candidates must be U.S. Citizens with an active DoW Secret (or higher) clearance
Education Requirement: Bachelor’s Degree
540 Internal Thrive Level: Forward Deployed Engineer III

WHY 540?

540 is a forward-thinking company that the government turns to in order to #getshitdone. We don’t just talk about innovation – we deliver it. We break down barriers, build impactful technology, and solve mission-critical problems.

HOW YOU’LL DRIVE IMPACT

  • Build, extend, and manage the T&E harness in a Microsoft Azure Government environment at Impact Level 5 (IL5) while meeting strict privacy and regulatory requirements
  • Onboard new models, benchmarks, and datasets to support test campaigns for agentic systems, LLMs, and small language model (SLM) distillation
  • Design and deploy secure, containerized microservices and AI-enabled systems using automated CI/CD pipelines, leveraging GenAI tools to accelerate your own development workflow
  • Act as a forward-deployed engineer to gather requirements, design evaluations, troubleshoot runs, and interpret results alongside government stakeholders
  • Coordinate multi-team technical initiatives and manage complex cross-organizational dependencies to ensure shared engineering outcomes
  • Manage defect backlogs, prioritize technical debt, and drive rigorous root-cause analysis to tackle architectural challenges
  • Conduct live demos, translate complex technical concepts for non-technical stakeholders, and transfer knowledge so the government team can eventually run the harness independently

REQUIRED SKILLS & EXPERIENCE

  • Strong programming expertise (e.g., Python, TypeScript, or Go) with a track record of deploying, operating, and maintaining secure and scalable software in production environments
  • Experience developing and deploying containerized microservices and/or serverless applications using automated CI/CD pipelines
  • Experience designing, building, and deploying production-grade LLM applications, retrieval-augmented generation (RAG) pipelines, and/or multi-agent workflows
  • Proficiency building resilient integrations with enterprise platforms, ideally using Model Context Protocol (MCP) or similar tool-calling frameworks for AI models
  • Experience acting in a forward-deployed or solutions engineering capacity, actively leading requirement gathering and adapting solutions to fit specific customer environments
  • Experience with automated testing, ensuring enterprise-grade security and privacy, and implementing comprehensive observability for distributed systems
  • Experience managing defect backlogs, prioritizing technical debt, and driving rigorous root cause analysis to continuously improve product quality
  • Skilled at conducting live demos, delivering presentations, and translating highly technical AI and software concepts for both technical and non-technical audiences
  • Demonstrated skills in at least one specialized domain (Solutions Architecture, Cloud Infrastructure, Platform Engineering, Security, Data Engineering) in addition to Full Stack or QA development

NICE TO HAVE

  • DoD Information Assurance Technical (IAT) Level II qualification
  • Professional-level certification from a commercial CSP (e.g., AWS, Google Cloud, Azure)
  • Experience designing, deploying, and operating secure applications that handle controlled or classified information
  • Background instrumenting services for SLIs/SLOs, participating in on-call incident response, and contributing to postmortems
  • Familiar with ML model architectures (beyond LLMs) and understands their specific data input requirements
  • Working knowledge of LLM evaluation: benchmark harnesses, scoring, prompt and response handling, model API gateways
  • Experience deploying and operating applications on a commercial cloud service
  • Experience with GitOps and either GitLab CI/CD or GitHub Actions

BENEFITS & PERKS

  • Flexible PTO + all Federal holidays off
  • Health, dental and vision insurance plans
  • Flexible Spending Account (FSA)
  • 401k with employer match
  • Company-sponsored life insurance, short- and long-term disability 
  • Professional development (training, certifications, conferences)
  • Paid cloud developer accounts
  • Referral bonuses
  • HQ office perks (parking / metro reimbursement, nitro coffee & lunches) 
  • Annual social events (540 Week, hackathon, charity golf tournament, etc.)
  • Access to 540’s Washington Capitals & Nationals tickets

EQUAL EMPLOYMENT OPPORTUNITY (EEO)

540's policy is to provide equal employment opportunity to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation and training.

Skills Required

  • U.S. citizenship
  • Active Department of War Secret or higher security clearance
  • Bachelor's degree
  • Strong programming expertise in Python, TypeScript, Go, or similar
  • Experience deploying, operating, and maintaining secure, scalable production software
  • Experience developing and deploying containerized microservices or serverless applications with automated CI/CD pipelines
  • Experience building production-grade LLM applications, RAG pipelines, or multi-agent workflows
  • Experience building resilient enterprise-platform integrations using MCP or similar tool-calling frameworks
  • Forward-deployed engineering or solutions engineering experience, including requirements gathering and customer-environment adaptation
  • Experience with automated testing, enterprise security and privacy, and distributed-system observability
  • Experience managing defect backlogs, technical debt, and root-cause analysis
  • Ability to conduct demonstrations, presentations, and technical knowledge transfer
  • Specialized expertise in Solutions Architecture, Cloud Infrastructure, Platform Engineering, Security, or Data Engineering in addition to Full Stack or QA development
  • DoD Information Assurance Technical IAT Level II qualification
  • Professional certification from AWS, Google Cloud, Azure, or another commercial cloud provider
  • Experience operating secure applications handling controlled or classified information
  • Experience with SLIs, SLOs, on-call incident response, and postmortems
  • Knowledge of machine-learning model architectures beyond LLMs
  • Working knowledge of LLM evaluation, benchmark harnesses, scoring, prompt and response handling, and model API gateways
  • Experience deploying and operating applications on a commercial cloud service
  • Experience with GitOps, GitLab CI/CD, or GitHub Actions
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Arlington, VA
64 Employees
Year Founded: 2013

What We Do

540 is a technology consulting firm who helps our government and business clients innovate like start-ups. Through hard work, perseverance, and deep commitment we remove barriers to innovation which enables us to build impactful tech for the government. Contact us for: - Tech Strategy - Software Development - API Design / Dev - DevOps Email us: [email protected]

Similar Jobs

Mastercard Logo Mastercard

Artificial Intelligence Engineer

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Arlington, VA, USA
38800 Employees
140K-266K Annually
In-Office or Remote
7 Locations
800 Employees
360K-425K Annually
In-Office or Remote
7 Locations
800 Employees
360K-425K Annually

BetterUp Logo BetterUp

Staff Forward Deployed Engineer

Artificial Intelligence • HR Tech • Professional Services
In-Office
4 Locations
510 Employees
190K-270K Annually

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account