Senior ML Serving Engineer

Reposted 15 Days Ago
Be an Early Applicant
3 Locations
In-Office
Senior level
Artificial Intelligence • Cloud • Information Technology • Security • Software
The Role
Responsible for model-runtime deployment in AI serving environments, ensuring secure and efficient model delivery for the Department of War, while collaborating and maintaining operational readiness.
Summary Generated by Built In
Job Summary & Responsibilities

Everforth ECS is seeking a Senior ML Serving Engineer to work in the National Capital Region covering the Pentagon, Falls Church, and Fairfax. Please Note: This position is contingent upon contract award.

The War Data Platform (WDP) is a key initiative within the U.S. Department of War’s (DoW) AI-First strategy introduced in early 2026. The WDP focuses on operational warfighting data and aims to accelerate the deployment of artificial intelligence (AI) on the battlefield. The WDP extends to Unclassified, Secret, and Top Secret environments, and supports collaboration between Combatant Commands, Joint Staff directorates, Senior Executive Service leaders, and operational analysts.

This role implements the model-runtime deployment pattern used across WDP Core Integration AI and machine learning serving environments, ensuring consistent, secure, and high-performance model delivery to DoW missions and senior leaders.

• Implements the model-runtime deployment pattern used across WDP Core Integration artificial intelligence and machine learning serving environments supporting DoW missions, Joint Staff analysts, Combatant Command elements, and Senior Executive Service leadership.
• Develops service templates, runtime configurations, scaling behaviors, and deployment specifications consumed by enterprise pipelines and API access patterns.
• Applies Kubernetes, Helm, Docker, GitLab Continuous Integration, VMware environments, Prometheus, Grafana, Elastic Stack, and hardened deployment workflows to establish consistent runtime behavior for production-ready model artifacts.
• Conducts performance tuning, latency optimization, and resource-allocation refinement to maintain operational stability across serving surfaces.
• Validates runtime patterns and operational readiness across higher-domain enclaves, including SIPR and JWICS, by resolving enclave-specific runtime constraints, adapting deployment templates, and aligning runtime behavior with cross-domain security architectures.
• Supports automated scanning workflows, cross-domain transfer validation, and API endpoint configuration activities to maintain readiness for model serving operations.
• Produces mission-critical deliverables including runtime configuration packages, deployment templates, performance reports, operational readiness assessments, and enclave-specific runtime documentation.
• Collaborates with Platform One, Cloud One, multi-national engineering teams, and cross-service mission partners to strengthen operational readiness, reinforce deployment consistency, and advance program value commitments across all enclaves.
• Participates in Tier-4 incident response actions to maintain service-level agreements, operational continuity, and mission performance for enterprise AI model serving capabilities.
• Performs other duties as assigned.

Preferred Qualifications

• Current Secret security clearance with the ability to obtain and maintain a Top Secret (TS) security clearance with Sensitive Compartmented Information (SCI).
• 10–12 years of experience implementing and managing model serving and runtime environments in secure DoW or equivalent settings.
• CNCF‑Certified Kubernetes Administrator (CKA) or equivalent Kubernetes certification.
• Proven proficiency with Kubernetes, Helm, Docker, GitLab CI, VMware, Prometheus, Grafana, and Elastic Stack for hardened deployment workflows.
• Successful track record of performance tuning, latency optimization, and resource‑allocation refinement for production‑grade AI/ML models.
• Strong problem‑solving and decision‑making capabilities, with a proven ability to weigh the relative costs and benefits of potential actions and identify the most appropriate solution.
• Highly developed interpersonal and oral/written communication skills, with the ability to effectively and professionally interact with a diverse set of stakeholders (from peers to end‑users to executive management).

Skills Required

  • 10-12 years of experience in model serving and runtime environments
  • CNCF-Certified Kubernetes Administrator (CKA) or equivalent
  • Current Secret security clearance; ability to obtain Top Secret clearance
  • Proficiency with Kubernetes, Helm, Docker, GitLab CI, VMware, Prometheus, Grafana, Elastic Stack

ECS Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about ECS and has not been reviewed or approved by ECS.

  • Healthcare Strength ECS advertises multiple national-network medical plan options with HSA eligibility alongside dental and vision coverage. Coverage generally begins quickly and is paired with company-paid short- and long-term disability, adding stability to the health package.
  • Retirement Support A 401(k) with Safe Harbor and immediate vesting on employer contributions is emphasized, with an employer match available. Access to an employee stock purchase plan via the parent company provides an additional savings avenue.
  • Parental & Family Support Paid parental leave up to 30 days, adoption assistance, and other family-oriented leaves are highlighted. Feedback suggests these offerings add meaningful value beyond base pay for many roles.

ECS Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Elkhorn, NE
2,129 Employees
Year Founded: 1993

What We Do

ECS, a segment of ASGN (NYSE: ASGN), delivers advanced solutions and services in cloud, cybersecurity, artificial intelligence (AI), machine learning (ML), application and IT modernization, and science and engineering. The company solves critical, complex challenges for customers across the U.S. public sector, defense, intelligence and commercial industries. ECS maintains partnerships with leading cloud, cybersecurity, and AI/ML providers and holds specialized certifications in their technologies. Headquartered in Fairfax, Virginia, ECS has more than 3,400 employees throughout the U.S. and has been recognized as a Top Workplace by The Washington Post for the last five years.

Similar Jobs

Remote or Hybrid
US
15100 Employees
164K-241K Annually

Vantor Logo Vantor

DeskSide Support Specialist

Aerospace • Artificial Intelligence • Computer Vision • Software • Analytics • Defense • Big Data Analytics
In-Office
Herndon, VA, USA
2500 Employees
26-39 Hourly

CrowdStrike Logo CrowdStrike

Security Advisor I, Falcon Complete GovCloud (Remote)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
10000 Employees
85K-120K Annually

CrowdStrike Logo CrowdStrike

Technical Recruiter

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
9 Locations
10000 Employees
86K-135K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account