AI System Architect

Posted 5 Days Ago
Be an Early Applicant
Herzliya, ISR
Hybrid
Entry level
Cloud • Information Technology
The Role
Design and build enterprise AI infrastructure, including air-gapped LLM inference clusters, RAG pipelines, chatbot interfaces, model routing, MCP/Skills ecosystems, and developer tooling. Architect AI hardware and software roadmaps, evaluate server and storage reliability, integrate local models with coding assistants, and establish secure, reproducible, maintainable operational practices. Collaborate with Product, R&D, Operations, and validation teams to optimize performance, cost, power, and data governance.
Summary Generated by Built In
Description

At Infinidat, a Lenovo company, we empower enterprises and service providers with cutting-edge storage platforms that redefine performance, reliability, and cyber resilience at scale.

As an AI System Architect, you will design and build the AI infrastructure that powers Infinidat's internal engineering and data platforms. Working alongside our AI platform lead, you will architect the full stack - from air -gapped LLM inference clusters and RAG pipelines to the chatbot front door and MCP/Skills ecosystem that put these capabilities in the hands of R&D teams. This is a hands-on role for someone who thrives at the intersection of systems engineering, data infrastructure, and applied AI.

Responsibilities
  • Architect the Infinidat AI offering roadmap, in terms of HW, SW and AIOps
  • Design the future products of Infinidat to maximize the AI offering in terms of performance, cost and power
  • Architect and design on-premises LLM inference infrastructure, including multi-model serving on GPUs, high-core-count servers, systemd-managed services, context/throughput tuning, and network isolation for air-gapped deployments
  • Design and extend Retrieval-Augmented Generation (RAG) pipelines - document parsing, chunking, embedding, governance definition, and hybrid vector storage - for both document and source-code collections
  • Build and maintain the internal AI platform architecture, including the chatbot front-door layer, model routing, an MCP/Skills marketplace, and data-sanitization boundaries between on-prem and cloud
  • Develop internal developer tooling and agentic coding workflows, integrating local model endpoints with editor and CLI-based coding assistants - Contribute to hardware evaluation and reliability modeling for server and storage platforms, informing infrastructure decisions with quantitative analysis
  • Establish operational discipline around security, reproducibility, and maintainability - favoring durable architectural solutions over per-case patches
Requirements
  • System-level, end-to-end architecture view of the technical requirements and trade-offs
  • Ability to lead and interact with cross-functional teams in Product, R&D, OPS, SV&V
  • Deep hands-on experience with LLMs, agents, MCPs and the architecture of deploying a production-worthy AI system
  • Linux systems engineering expertise
  • Familiarity with enterprise storage and server hardware
  • Proficiency in Python and experience building data pipelines, internal tooling, and service integrations
  • Working knowledge of data science and analytics tooling (ETL, data warehouses, BI platforms)
  • A precise, measurement-first working style with the ability to analyze, and clearly present, complex architectures and concepts
  • An autodidact with strong communication skills

About Infinidat

Infinidat’s enterprise storage portfolio provides global Fortune 500 enterprises and service providers with best-in-class solutions for primary storage, next-generation data protection, disaster recovery, business continuity, and cyber resilience. Infinidat’s acclaimed InfuzeOS is the one of the most flexible and complete enterprise software-defined storage architectures in the industry. We recently announced powerful enhancements, an extensive expansion, and the dynamic evolution of our award-winning G4 enterprise cyber and AI storage solutions! Not only did Infinidat win over 40 awards in 2025, but was named a Gartner® Peer Insights™ Voice of the Customer Award for Primary Storage for the 7th time!

Skills Required

  • End-to-end system architecture experience with the ability to evaluate technical requirements and trade-offs
  • Ability to lead and collaborate with cross-functional Product, R&D, Operations, and SV&V teams
  • Deep hands-on experience with LLMs, agents, MCPs, and production AI system architecture
  • Linux systems engineering expertise
  • Familiarity with enterprise storage and server hardware
  • Proficiency in Python and experience building data pipelines, internal tooling, and service integrations
  • Working knowledge of data science and analytics tooling, including ETL, data warehouses, and BI platforms
  • Precise, measurement-first working style with the ability to analyze and present complex architectures and concepts
  • Strong communication skills and ability to learn independently
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Herzliya
515 Employees
Year Founded: 2011

What We Do

Infinidat's portfolio of primary and secondary storage platforms provides best-in-class performance with guaranteed 100% availability, built in InfiniSafe®️ cyber resilience, and the industry's lowest total cost of ownership

Similar Jobs

NVIDIA Logo NVIDIA

Architect

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
3 Locations
21960 Employees

NVIDIA Logo NVIDIA

Software Architect

Artificial Intelligence • Computer Vision • Hardware • Robotics • Metaverse
In-Office
3 Locations
21960 Employees

Tufin Logo Tufin

Architect

Security • Cybersecurity
Hybrid
Tel Aviv, ISR
500 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account