LLM Architect & AI Assistant Engineer

Welcome to Healthee, where healthcare meets simplicity. It's 2025, and our mission is to empower employees to take control of their health benefits with clarity and confidence - navigating complex systems in under 27 seconds. Using cutting-edge AI, we personalize and streamline the experience of understanding, using, and optimizing health coverage.
We're not just building a product. We're crafting an intelligent platform that transforms lives through data-driven insights and seamless digital experiences.
We're seeking an experienced LLM expert to lead the design and development of AI assistant systems.The ideal candidate has a deep understanding of generative model architecture, retrieval methodologies (including RAG), and performance evaluation.This role is pivotal in developing intelligent systems that make healthcare navigation easier, faster, and more efficient for millions of users. You will work at the intersection of healthcare data, machine learning, and conversational AI to create solutions that deliver real value to users.
We're looking for someone who lives and breathes data science, thrives on diving deep into complex healthcare datasets, and loves solving problems that directly impact people's healthcare decisions. You are driven by the desire to build AI systems that truly understand and help users navigate their health benefits, and you do so with a hands-on, pragmatic approach. You thrive in a fast-paced, hypergrowth startup environment, and demonstrate curiosity, humility, and a user-first mindset.
Key Responsibilities:
• Design and optimize LLM-based architectures and RAG pipelines
• Develop production-grade AI assistants with multi-turn, grounded interaction
• Monitor and improve LLM performance, latency, and hallucination control
• Implement and analyze embedding strategies and vector search systems
• Solve complex engineering challenges related to LLM scaling and integration
Requirements:
• Proven experience with OpenAI, HuggingFace, or similar LLM ecosystems
• Deep knowledge of transformer internals, embeddings, attention, and prompt engineering
• Experience with evaluation frameworks, retrieval systems, and performance monitoring
• Strong Python skills and familiarity with LangChain, LlamaIndex, or equivalent tools - but also ability to implement vanilla code.
• Hands-on experience deploying AI assistants or LLM features in production
Requirements:

• 5 years of hands-on experience in data science, machine learning, or AI development roles
• Bachelor's or Master's degree in Engineering, Data Science, Computer Science, Statistics or related field.
• Strong proficiency in Python, with experience in pandas, scikit-learn, and other ML libraries
• Understanding of machine learning fundamentals including model evaluation and deployment
• Experience with NLP techniques and working with LLM APIs to build AI-powered solutions
• Familiarity with RAG systems, vector databases, and retrieval mechanisms
• Knowledge of cloud platforms (AWS, Azure, or GCP) and containerization technologies
• Experience with data visualization tools (matplotlib, seaborn, Tableau, or similar)
• Strong analytical thinking and problem-solving skills with attention to detail
• Excellent communication skills with ability to explain technical concepts clearly
• Being a decent human being with a passion for improving healthcare accessibility

Why Join Healthee:
At Healthee, we're changing the health benefits experience by making it easier, faster, and more efficient to use your health insurance and get care. You'll have the opportunity to:

• Make a direct impact on improving healthcare accessibility and decision-making for millions of users
• Work with cutting-edge AI technology in a rapidly growing healthtech company
• Collaborate with a world-class team that values innovation, user-first thinking, and technical excellence
• Be part of building the future of healthcare navigation through intelligent AI systems
• Enjoy competitive compensation, comprehensive benefits, and significant growth opportunities
• Salary range: Competitive compensation package commensurate with experience

Salary range: 35,000-40,000 (will be determined based on level of experience)
**At Healthee, we welcome candidates with varying levels of experience for this role, which is reflected in the flexible salary range. The final salary will be determined through a professional assessment during the interview process, in line with our internal development levels . As an equitable employer, we prioritize transparency and are committed to offering fair and competitive salaries that align with those of our current employees.
Check us out on Geektime: https://insider.geektime.co.il/company/healthee/
18 Top Tech Companies in Israel | Built In