Principal AL/ML Data Scientist - AI, Vector Search & Agentic AI Platforms

Posted 4 Days Ago
Be an Early Applicant
Reston, VA, USA
In-Office
270K-325K Annually
Expert/Leader
Software
The Role
Lead design and implementation of enterprise-scale AI data platforms powering vector search, RAG, LLMs, and agentic AI. Architect data governance, pipelines, observability, and integrations across cloud, security, and engineering teams. Provide technical leadership, mentor engineers, evaluate emerging technologies, and communicate program risks and tradeoffs to senior leadership.
Summary Generated by Built In
ROLE OVERVIEWRed Arch Solutions is seeking a highly experienced, senior-level AI/ML Data Engineer to lead the design and implementation of enterprise-scale data platforms supporting a large-scale Agentic AI transformation initiative.
With extensive experience delivering AI and machine learning solutions in complex enterprise environments, you will serve as a technical leader responsible for architecting the data ecosystem that powers vector search, Retrieval-Augmented Generation (RAG), large language model (LLM) applications, and emerging Agentic AI capabilities. You will work across infrastructure, cybersecurity, software engineering, and mission stakeholders to rapidly deliver scalable, secure, and reliable AI solutions.
This role requires a seasoned engineer capable of communicating complex technical concepts and architectural tradeoffs to senior leaders, helping leadership teams understand the operational, mission, security, and business implications of emerging AI technologies while driving successful implementation of enterprise capabilities.
The Red Arch Distinction: People First
Red Arch Solutions is a flat, highly collaborative organization where your voice is heard. We prioritize work/life balance and individualized professional growth, backed by a 100% company-paid healthcare model, a robust annual training allocation, and an elite technical community solving our nation's most urgent national security challenges.


 KEY RESPONSIBILITIES 
  • Enterprise AI Platform Engineering: Architect, build, and maintain enterprise-scale data platforms supporting vector databases, semantic search, Retrieval-Augmented Generation (RAG), Agentic AI systems, and large language model applications.
  • Data Architecture & Strategy: Establish and implement controls for data quality, lineage, source attribution, prompt and context traceability, explainability, and evaluation of AI system outputs.
  • AI Data Governance: Establish and implement controls for data quality, lineage, source attribution, prompt and context traceability, explainability, and evaluation of AI system outputs.
  • Technical Leadership: Lead architectural decision-making for AI-supporting data infrastructure, balancing performance, scalability, security, reliability, maintainability, and cost considerations.
  • Cross-Functional Integration: Partner with Data Scientists, Machine Learning Engineers, Architects, Cybersecurity teams, and Software Engineers to translate AI requirements into production-grade capabilities.
  • Executive Communication: Translate highly technical AI, machine learning, and data architecture concepts into clear operational impacts, risks, opportunities, and implementation considerations for senior leadership.
  • Enterprise Coordination: Coordinate with stakeholders across multiple organizations to align AI initiatives, maximize reuse of enterprise capabilities, and eliminate duplication of effort.
  • Operational Excellence: Implement monitoring, observability, and alerting to ensure the reliability, performance, and continuous improvement of AI-supporting data platforms.
  • Mentorship & Engineering Excellence: Provide technical leadership and mentorship to engineers while promoting engineering best practices and innovation across the organization.
  • Technology Evaluation: Assess emerging AI technologies, vector database platforms, retrieval frameworks, and engineering approaches to improve organizational AI capabilities.
 REQUIRED QUALIFICATIONS
  • Clearance: Active, current Top Secret / SCI with Polygraph is mandatory.
  • Education: Bachelor’s degree in computer science, Engineering, Mathematics, Data Science, or a related quantitative discipline. Equivalent experience may be considered.
  • Experience:
  • 20+ years of progressive experience in software engineering, data engineering, distributed systems, cloud architecture, or AI/ML platform development.
  • Proven experience designing and delivering enterprise-scale AI, machine learning, generative AI, or Agentic AI solutions.
  • Demonstrated success architecting and implementing production cloud-native data systems supporting advanced analytics and AI workloads.
  • Proven experience working within complex enterprise environments managing security, infrastructure, technology dependencies, governance requirements, and competing priorities.
  • Extensive experience designing data pipelines supporting machine learning models, vector databases, semantic search capabilities, and generative AI applications.
  • Proven experience delivering complex technical solutions from strategic requirements through operational deployment while balancing schedule, performance, capability, and cost objectives.
  • Technical Expertise
  • Expert proficiency in Python, SQL, and modern software engineering practices.
  • Deep experience with Azure, AWS, or Google Cloud data and AI platforms.
  • Strong understanding of distributed systems, cloud-native architectures, MLOps, and AI platform engineering.
  • Experience implementing vector databases, embedding pipelines, retrieval systems, and Retrieval-Augmented Generation architectures.
  • Experience with CI/CD pipelines, orchestration platforms, infrastructure automation, and observability tooling.
  • Communication & Leadership
  • Exceptional written and verbal communication skills.
  • Ability to communicate complex technical concepts to both technical and non-technical audiences.
  • Proven ability to explain AI, machine learning, and data architecture concepts in terms of mission impact, operational outcomes, technical risk, and implementation tradeoffs.
  • Experience influencing decisions and driving consensus among diverse technical and business stakeholders.
 DESIRED SKILLS & FRAMEWORKS 
  • Experience serving as a Principal Engineer, Lead Data Engineer, Solution Architect, or Technical Lead.
  • Experience building and operating enterprise-scale vector search, RAG, knowledge management, and LLM-based platforms.
  • Hands-on experience with large-scale distributed data processing frameworks.
  • Experience leading engineering teams and mentoring junior and mid-level engineers.
  • Experience supporting AI adoption efforts within large government, defense, intelligence, or highly regulated organizations.
  • Familiarity with AI governance, model evaluation frameworks, explainability, and responsible AI implementation practices.
Salary Range for this role 270-325K #CJ 

Skills Required

  • Active, current Top Secret / SCI with Polygraph
  • Bachelor's degree in Computer Science, Engineering, Mathematics, Data Science, or related quantitative discipline (or equivalent experience)
  • 20+ years progressive experience in software engineering, data engineering, distributed systems, cloud architecture, or AI/ML platform development
  • Proven experience designing and delivering enterprise-scale AI, machine learning, generative AI, or Agentic AI solutions
  • Experience architecting and implementing production cloud-native data systems supporting advanced analytics and AI workloads
  • Extensive experience designing data pipelines for machine learning models, vector databases, semantic search, and generative AI applications
  • Expert proficiency in Python and SQL and modern software engineering practices
  • Deep experience with Azure, AWS, or Google Cloud data and AI platforms
  • Experience implementing vector databases, embedding pipelines, retrieval systems, and RAG architectures
  • Experience with CI/CD pipelines, orchestration platforms, infrastructure automation, and observability tooling
  • Exceptional written and verbal communication skills; ability to present technical concepts to senior leadership
  • Experience serving as a Principal Engineer, Lead Data Engineer, Solution Architect, or Technical Lead
  • Hands-on experience with large-scale distributed data processing frameworks
  • Experience supporting AI adoption in government, defense, intelligence, or highly regulated organizations
  • Familiarity with AI governance, model evaluation frameworks, explainability, and responsible AI practices
  • Experience leading and mentoring engineering teams
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Columbia, MD
48 Employees
Year Founded: 2004

What We Do

Red Arch Solutions is a premier U.S. small business providing its customers with state-of-the-art tactical and strategic intelligence, systems, and software engineering solutions, solving some of the most pressing and unique intelligence community challenges related to National Security. Our employees are exceptionally skilled professionals; individuals who are dedicated to collecting, analyzing, creating and engineering the best solutions in support of critical missions. Red Arch Solutions takes pride in the success of our customers. The depth of our engineers’ experience combined with our breadth of exposure across the intelligence community enables us to provide value added, synergistic analytical and engineering support. Unique to Red Arch Solutions is the focus on its employees. Our guiding principle is “People First.” We offer employees career mobility and stability, work-life balance flexibility, and individualized career paths. The loyalty of highly trained, skilled professionals is our key corporate asset. Red Arch Solutions is an Equal Opportunity Affirmative Action Employer.

Similar Jobs

STR Logo STR

Principal Software Engineer

Machine Learning • Security • Software • Analytics • Defense
Easy Apply
In-Office
Arlington, VA, USA
800 Employees
220K-280K Annually

Optum Logo Optum

Manager, Payment Model Operations (CMS/CMMI) - Remote

Artificial Intelligence • Big Data • Healthtech • Information Technology • Machine Learning • Software • Analytics
In-Office or Remote
Reston, VA, USA
160000 Employees
113K-193K Annually

CrowdStrike Logo CrowdStrike

Analyst I, Falcon Complete (Hybrid, San Antonio)

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
USA
11000 Employees
85K-120K Annually

Tempus AI Logo Tempus AI

Genomic Science Liaison I, HCT (South Central region): Remote, USA

Artificial Intelligence • Big Data • Healthtech • Machine Learning • Analytics • Biotech • Generative AI
Remote or Hybrid
3 Locations
3775 Employees
110K-130K Annually

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account