Senior Software Engineer

Hippocratic AI is developing the first safety-focused Large Language Model (LLM) for healthcare. Our mission is to dramatically improve healthcare accessibility and outcomes by bringing deep healthcare expertise to every person. No other technology has the potential for this level of global impact on health.

• Innovative mission: We are creating a safe, healthcare-focused LLM that can transform health outcomes on a global scale.

• Visionary leadership: Hippocratic AI was co-founded by CEO Munjal Shah alongside physicians, hospital administrators, healthcare professionals, and AI researchers from top institutions including El Camino Health, Johns Hopkins, Washington University in St. Louis, Stanford, Google, Meta, Microsoft and NVIDIA.

• Strategic investors: We have raised a total of $278 million in funding, backed by top investors such as Andreessen Horowitz, General Catalyst, Kleiner Perkins, NVIDIA’s NVentures, Premji Invest, SV Angel, and six health systems.

• Team and expertise: We are working with top experts in healthcare and artificial intelligence to ensure the safety and efficacy of our technology.

For more information, visit www.HippocraticAI.com.

We value in-person teamwork and believe the best ideas happen together. Our team is expected to be in the office five days a week in Palo Alto, CA unless explicitly noted otherwise in the job description.

As a Software Engineer, you will join a collaborative team of engineers, applied scientists, and healthcare professionals working on cutting-edge generative AI technologies. Your role will focus on building and enhancing the backend infrastructure that powers scalable, secure, and reliable data processing for AI-driven healthcare solutions.

• Develop and maintain scalable backend systems to support high-performance AI applications in healthcare.

• Collaborate with cross-functional teams, including data scientists and ML engineers, to design and build efficient data pipelines for large-scale healthcare datasets.

• Build and manage APIs and microservices that enable smooth data retrieval, processing, and interaction with AI models.

• Contribute to the implementation of data security and privacy protocols to protect sensitive patient data.

• Monitor and improve backend systems to optimize performance, reliability, and uptime.

• Work closely with product managers to understand healthcare requirements and help transform them into technical solutions.

• Engage in team discussions and knowledge sharing to promote a collaborative and innovative engineering culture.

Must-Have:

• Bachelor’s degree in Computer Science, Computer Engineering, or a related field (or equivalent practical experience).

• 5+ years of experience in backend development using programming languages like Python, Golang, or similar.

• Strong problem-solving skills and a willingness to learn and grow.

• Familiarity with SaaS control planes, relational database systems and RESTful APIs.

• Strong understanding of cloud infrastructure (e.g. AWS, GCP, Kubernetes, S3 etc.)

  Experience with one of the following:

• Building modern agentic frameworks and orchestration platforms that enable LLM-based agents.

• Designing and deploying conversational AI systems, whether leveraging third-party platforms or custom in-house technology.

• Developing and scaling production-grade LLM applications or autonomous agents used in real-world workflows.

Preferred:

• Exposure to AI/ML concepts or experience working with LLMs.

• Experience working in teams that handle sensitive or regulated data.

• Familiarity with SQLAlchemy, Flask, and asynchronous programming.

We encourage applications from engineers who are eager to develop their skills and contribute to impactful AI solutions in healthcare. Whether you have prior experience in this field or are excited to explore it, we welcome your interest!