Senior Software Engineer - Machine Learning (Remote US)

Reposted 2 Days Ago
Hiring Remotely in United States
Remote
160K-200K Annually
Senior level
Software
The Role
Design, build, and operate core AI capabilities and reusable model integrations for an enterprise platform. Integrate foundation models into production, optimize performance and reliability, prototype new techniques, and support scalable backend services and distributed AI systems in collaboration with cross-functional teams.
Summary Generated by Built In

About Legion

Let’s be real, AI isn’t magic; Legion was built to move beyond AI hype—delivering secure, reliable systems that work alongside the people tackling the world’s most critical challenges.

Born from a Department of Defense partnership and trusted by leaders across government and enterprise, Legion embeds intelligence inside complex systems, unlocking data, accelerating human workflows, and strengthening mission-critical systems. We don’t replace workflows—we optimize them, ensuring quality, efficiency, and reliability inside the platforms our partners already use.

With world-class collaborators like Palantir, Nvidia, HPE, and Oracle, we’re building intelligent infrastructure that enhances human capability and drives impact at the edge and across a range of enterprises.

We’re looking for bold thinkers and doers to join us in shaping the future of AI that’s secure, grounded, and built to work.

Staff Applied Machine Learning Engineer (Remote USA)

***This role requires expert level in development and deployment of machine learning models***

***US Citizenship or Greencard (Permanent US Residency) is required due to US Government contract requirements***

***You must be domiciled in the U.S. (must live permanently and maintain home address in the US)***

***As a step in the application process you will be required to provide legally authorized Identification to show verification of eligibility through third party provider CLEAR ID***

Senior Software Engineer, Machine Learning

As a Senior Software Engineer, Machine Learning, you will design, build, and evolve the core AI capabilities that power intelligent experiences across our enterprise AI platform. You will integrate modern foundation models into production systems, develop reusable AI capabilities, and continuously improve their quality, reliability, and performance. Working closely with cross-functional teams, you will transform advances in AI into secure, scalable, and production-ready capabilities that accelerate innovation across the platform.

Responsibilities
  • Design, build, and maintain the core AI capabilities that power intelligent experiences across the platform.
  • Develop reusable capabilities for model integration, reasoning, multimodal understanding, structured generation, evaluation, and other foundational AI functionality.
  • Optimize the AI systems that power these capabilities through experimentation, quantitative evaluation, context engineering, and iterative refinement.
  • Apply your production software engineering experience to build backend services, APIs, and distributed AI systems.
  • Partner closely with cross-functional partners to deploy scalable AI services that enable product teams to rapidly build AI-powered experiences.
  • Rapidly prototype emerging AI techniques and translate successful experiments into production-ready platform capabilities.
  • Support production systems by debugging failures and continuously improving latency, reliability, observability, and operational performance.
  • Stay current with advances in AI engineering, foundation models, and applied machine learning, applying them where they create meaningful customer value.
  • Optimize AI systems for performance, latency, reliability, scalability, and cost.
  • Contribute to a collaborative engineering culture focused on ownership and continuous learning.
Required Skills and Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related technical field, or equivalent practical experience.
  • 5+ years of experience building production software systems.
  • Strong software engineering skills with experience in Rust, Python, or similar programming languages.
  • Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications.
  • Hands-on experience integrating large language models or other foundation models into production applications.
  • Ability to design, evaluate, and improve AI systems through experimentation, quantitative evaluation, and continuous iteration.
  • Familiarity with modern AI engineering patterns such as structured outputs, tool calling, context engineering, multimodal systems, or AI workflows.
  • Strong understanding of software engineering best practices, including testing, observability, reliability, and maintainability.
  • Demonstrated ability to take ownership of technically ambiguous projects from design through production.
  • Excellent communication and collaboration skills with the ability to work effectively across cross-functional teams.
  • Growth mindset and low ego, with a willingness to learn, adapt, and collaborate.
Preferred Skills and Qualifications
  • Experience building reusable AI capabilities or shared AI services.
  • Familiarity with deploying, optimizing, or serving open-source foundation models.
  • Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications.
  • Experience with Kubernetes, cloud-native infrastructure, or distributed systems.
  • Experience developing production software in Rust.
  • Familiarity with retrieval-augmented generation (RAG), multimodal AI, AI agents, or model orchestration.
  • Domain expertise building complex AI systems such as multimodal reasoning, long-running inference workflows, AI agents, or model orchestration.
Compensation Information
$160,000$200,000 USD

Equal Opportunity Statement

Legion provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Skills Required

  • US Citizenship or Green Card required due to US Government contract requirements
  • Bachelor's or Master's degree in Computer Science, Machine Learning, or related field, or equivalent experience
  • 5+ years of experience building production software systems
  • Strong software engineering skills with experience in Rust, Python, or similar languages
  • Proven ability to build scalable backend services, distributed systems, APIs, or data-intensive applications
  • Hands-on experience integrating large language models or other foundation models into production applications
  • Ability to design, evaluate, and improve AI systems through experimentation and quantitative evaluation
  • Familiarity with modern AI engineering patterns (structured outputs, tool calling, context engineering, multimodal systems, AI workflows)
  • Strong understanding of software engineering best practices including testing, observability, reliability, and maintainability
  • Demonstrated ability to take ownership of technically ambiguous projects from design through production
  • Excellent communication and collaboration skills
  • Growth mindset and willingness to learn, adapt, and collaborate
  • Experience building reusable AI capabilities or shared AI services
  • Familiarity with deploying, optimizing, or serving open-source foundation models
  • Knowledge of evaluation frameworks, benchmarks, or datasets for AI applications
  • Experience with Kubernetes and cloud-native infrastructure
  • Experience developing production software in Rust
  • Familiarity with RAG, multimodal AI, AI agents, or model orchestration
  • Domain expertise building complex AI systems (multimodal reasoning, long-running inference workflows, model orchestration)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: SAN FRANCISCO, CALIFORNIA
34 Employees
Year Founded: 2022

What We Do

Yurts streamlines your daily tasks by seamlessly integrating AI assistance into your workflow. With Yurts, say hello to: * Real-time AI-guided insights into your processes * Seamless understanding of context, without interrupting your workflow * Efficient processes and verification * Smooth integration with diverse business environments * Cross-application compatibility checks, and more! We are the go-to AI assistant for Fortune companies and leaders in high-security organizations, such as the Departments of Defense and Energy. Yurts delivers increased productivity and enhances outcomes without the fluff. Ready for immediate impact in your operations? Join the leading enterprises using Yurts today.

Similar Jobs

Afterpay Logo Afterpay

Program Manager

Fintech • Payments • Software • Financial Services
Remote or Hybrid
2 Locations
900 Employees
136K-245K Annually

TIDAL Logo TIDAL

Creative Director

Consumer Web • Information Technology • Mobile • Music • News + Entertainment • Software
Remote or Hybrid
New York, NY, USA
450 Employees
252K-377K Annually

Square Logo Square

Account Executive

eCommerce • Fintech • Hardware • Payments • Software • Financial Services
Remote or Hybrid
Everett, WA, USA
12000 Employees
129K-233K Annually

Liberty Mutual Insurance Logo Liberty Mutual Insurance

Inside Sales Representative

Artificial Intelligence • Fintech • Insurance • Marketing Tech • Software • Analytics
Remote or Hybrid
9 Locations
40000 Employees
45K-85K Annually

Similar Companies Hiring

Kepler  Thumbnail
Artificial Intelligence • Fintech • Software
New York, New York
9 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account