Sr. AL/ML Engineer

Posted 3 Days Ago
Be an Early Applicant
Annapolis Junction, MD, USA
In-Office
120K-200K Annually
Senior level
Information Technology • Professional Services • Cybersecurity
The Role
Designs and integrates LLM and agent orchestration workflows, model routing, RAG pipelines, vector databases, memory services, and MCP tool integrations. Evaluates and tunes models, builds automated AI evaluation pipelines, implements governance guardrails, and transitions research prototypes into production AI capabilities. The role also researches emerging AI technologies and requires collaboration with data scientists and mission analysts in a DoD mission environment.
Summary Generated by Built In
Description

PLEX Solutions, A Part of Markon is looking for a Sr. AI/ML Engineer to support a program in the Annapolis Junction, MD area.

Responsibilities
  • Design and integrate LLM/agent orchestration workflows using agentic frameworks such as LangGraph, Agno, and the NVIDIA NeMo Agent Toolkit.
  • Tune model gateway routing logic to select, evaluate, and optimize across multiple frontier and open-weight models for cost, performance, and mission fit.
  • Develop and integrate RAG pipelines, vector databases, and memory services to give agents access to mission knowledge and context.
  • Implement MCP (Model Context Protocol)-based tool-broker integrations so agents can safely and securely access enterprise tools and data.
  • Evaluate, benchmark, and tune models and agent behaviors; build automated evaluation pipelines to track quality, safety, and performance over time.
  • Partner with data scientists and mission analysts to translate research and prototypes into production-grade AI capabilities for the command.
  • Implement AI governance guardrails — content/safety filters, policy enforcement, and approval gates — for agentic workflows, and document model/agent architectures and evaluation results for reuse.
  • Research and evaluate emerging LLM, agent, and AI tooling to keep the command's AI capability current and adaptable.
Qualifications
  • Active TS/SCI w/ Polygraph
  • Bachelor’s degree from an accredited college or university in Computer Science, Data Science, or a related discipline

  • 8+ years of experience in engineering related discipline

  • Advanced proficiency in Python for AI/ML application development

  • Demonstrated experience building or integrating LLM/agent-based systems in production

  • Experience with retrieval-augmented generation (RAG), vector databases, and prompt/context engineering

  • Ability to manage competing priorities in fast-paced mission environments and identify/escalate operational risks early


Desired Qualifications

  • Experience supporting DoD cyber operations, or related mission environments
  • Experience with frameworks such as LangGraph, Agno, or the NVIDIA NeMo Agent Toolkit
  • Experience with model inference/serving platforms (NVIDIA NIM, vLLM, Ollama, LiteLLM)
  • Experience with MCP (Model Context Protocol) or similar tool-broker/integration standards
  • Experience with AI evaluation frameworks, model benchmarking, and observability (logs/metrics/traces) for AI workloads
  • Experience supporting DoD AI/cyber mission environments
Salary RangeUSD $120,000.00 - USD $200,000.00 /Yr.The Markon pay range for this position is a general guideline only and not a guarantee of compensation or salary. Additional factors considered in extending an offer include (but are not limited to) responsibilities of the job, education, experience, knowledge, skills, and abilities, as well as internal equity, alignment with market data, applicable bargaining agreement (if any), or other law. Overview

Eager to join a team where your skills are valued, your growth is nurtured, and your impact is profound? Look no further than Markon, a premier consulting firm deeply dedicated to advancing our nation's most critical missions.


At Markon, we don't just offer jobs – we offer opportunities for personal and professional transformation. Empowering our employees to lead, innovate, and excel, we foster an environment where new ideas are not just welcomed but celebrated. As a perennial Washington Post Top Workplace, we prioritize the well-being and success of our team members, ensuring they can bring their best selves to work.


Headquartered in Falls Church, Virginia, Markon has garnered national recognition for our unwavering dedication to excellence in serving the intelligence community, as well as federal civilian and defense agencies. Our growing reach extends across 17 states, 116 countries, and 5 continents, where our team of dynamic professionals collaborates to deliver unparalleled program and project management services.


Markon values people and the tremendous impact each individual can make – which is why we’re consistently recognized as one of the best places to work in federal government consulting. Here, you can help solve the nation’s most important challenges, surrounded by colleagues who help you grow, advance, and succeed. We are deeply dedicated to what matters – bringing out the best in each other to advance our clients’ missions.Join us and make a meaningful impact.


Markon is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, national origin, age, protected veteran status, or disability status. This job posting will remain open until the position is filled.


Benefits Offered: Medical, Dental, Vision, Life Insurance, Short-Term Disability, Long-Term Disability, 401(k) match, Flexible Spending Accounts, EAP, Training and Tuition Assistance, Paid Time Off, and Holidays.

Skills Required

  • Active TS/SCI with Polygraph security clearance
  • Bachelor's degree from an accredited college or university in Computer Science, Data Science, or a related discipline
  • 8+ years of experience in an engineering-related discipline
  • Advanced proficiency in Python for AI/ML application development
  • Demonstrated experience building or integrating LLM- or agent-based systems in production
  • Experience with retrieval-augmented generation, vector databases, and prompt/context engineering
  • Ability to manage competing priorities in fast-paced mission environments and identify or escalate operational risks early
  • Experience supporting DoD cyber operations or related mission environments
  • Experience with LangGraph, Agno, or the NVIDIA NeMo Agent Toolkit
  • Experience with model inference or serving platforms such as NVIDIA NIM, vLLM, Ollama, or LiteLLM
  • Experience with MCP or similar tool-broker and integration standards
  • Experience with AI evaluation frameworks, model benchmarking, and observability for AI workloads
  • Experience supporting DoD AI or cyber mission environments
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Salinas, CA
506 Employees
Year Founded: 2007

What We Do

Markon is a professional services firm and mission integrator serving national-security and federal clients. It delivers full-spectrum cyber operations, digital transformation, and critical intelligence solutions, combining cyber exercises, defensive operations, training, threat analysis, modernized architectures, secure software delivery, data, cloud, automation, operational leadership, infrastructure alignment, process engineering, and software optimization to strengthen secure, resilient mission readiness across complex federal environments and national missions.

Similar Jobs

CrowdStrike Logo CrowdStrike

Principal Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
195K-290K Annually

CrowdStrike Logo CrowdStrike

Security Advisor II, Falcon Complete (Remote)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
100K-155K Annually

CrowdStrike Logo CrowdStrike

Security Advisor II, Falcon Complete (Remote)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
100K-155K Annually

CrowdStrike Logo CrowdStrike

Senior Software Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
140K-215K Annually

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account