Research Scientist/Research Engineer

Welcome systems thinkers. System builds software to help the world see and solve anything as a system, starting in healthcare. We are a Public Benefit Corporation driven by purpose and shaped by values. We hire systems thinkers who are motivated by our purpose, share our values, and have the skills to advance our mission. 

We are seeking a highly skilled Research Scientist/Engineer to join our team. The ideal candidate will have a strong technical background in machine learning, extensive work experience with clinical healthcare data, and a working knowledge of producing Real-World Evidence using data from Electronic Health/Medical Records. You will work closely with other engineers and scientists on the team to design and implement solutions to difficult applied problems. This is a role for someone who is ready to make an impact on the future of science and data. This person will report to the Director of AI and Engineering.

As Research Scientist/Engineer, you will:

• Work on cutting edge solutions in healthcare data modeling and contribute to innovation in AI/ML for Healthcare
• Keep abreast of the latest developments in the field of machine learning, and work with engineers to incorporate these developments into our technology stack
• Develop leadership skills and help to foster a culture of collaboration and continuous learning
• Influence culture and shape a rapidly growing startup
• Design and implement benchmarking frameworks to evaluate the performance, robustness, and efficiency of algorithms, models, or systems.
• Develop and maintain evaluation metrics tailored to specific domains (e.g., NLP, computer vision, multi-modal systems, distributed systems)
• Collaborate with cross-functional teams (researchers, engineers, product managers) to define success criteria and validate new methods or architectures
• Lead or contribute to experimental design, A/B testing, and statistical analysis of large-scale system behaviors
• Analyze performance trade-offs, failure cases, and corner scenarios to improve model and system quality
• Author internal technical reports and, where appropriate, contribute to peer-reviewed publications or open-source benchmarks
• Stay current with advancements in evaluation methodologies, datasets, and benchmarking best practices in your field

The ideal candidate has:

• M.S. or Ph.D. in Computer Science, Electrical Engineering, Statistics, or a related field; or equivalent industry experience. 
• Expertise in at least one major programming language (e.g., Python, C++, or Java), as well as strong experience with relational databases
• Experience with common machine learning frameworks, NLP and LLM toolkits
• Experience applying machine learning models to very large, complex datasets
• Strong expertise in scientific methods, experimental design, statistical analysis, and evaluation methodology.
• Experience with benchmarking tools, evaluation libraries, and relevant frameworks (e.g., HuggingFace, OpenAI Evals, MLPerf, SciKit-learn, TensorFlow Model Analysis, or custom pipelines).
• Familiarity with ML/DL model evaluation (e.g., accuracy, F1, BLEU, ROUGE, fairness metrics, latency) and human-in-the-loop processes
• Excellent communication and collaboration skills, with a proven ability to communicate results clearly to technical and non-technical audiences.
• Understanding of how to push your code “beyond the notebook”, i.e. writing production quality code, API development, containerization, inference at scale. 
• Strong problem-solving abilities and attention to detail
• Ability to be flexible, rational and open-minded

Bonus if the candidate has:

• Experience generating real-world evidence from electronic medical record (EMR) data using LLM-based workflows (entity resolution, normalization, extraction)
• Startup experience

The salary range for this position is $190,000 to $205,000 per year.

About System

We aspire to help the world see itself differently and build a more responsible and values-driven model of a tech company. We are backed by top-tier VCs in Silicon Valley and New York and leading angel investors and founded by the former VP Data at Spotify. To learn more about what motivates our social mission, we invite you to read our blog here.

We believe in the power of autonomous, interdisciplinary, and diverse teams; in agile development; and in leading with values, first principles, and clear high-level priorities backed by data.  We believe in cultivating a growth mindset for our team — always learning, improving, being challenged, and having opportunities for professional and personal development.

System Inc. is an equal opportunity employer. We are proud to foster a workplace, in person and online, free from discrimination. We strongly believe that diversity of experience, perspectives, and backgrounds will lead to a better environment for our employees and a better product for our users. We are committed to providing access, equal opportunity and reasonable accommodation for individuals with disabilities in employment, its services, programs, and activities. Job applicants must be legally authorized to work in the United States of America and must maintain ongoing work authorization during employment.