Software Engineer - LLM Systems

Posted Yesterday
Be an Early Applicant
Hiring Remotely in USA
Remote
180K-220K Annually
Mid level
Artificial Intelligence • Information Technology • Professional Services • Software
NewtonX is the world’s leading B2B research company.
The Role
Build and own core LLM infrastructure for two products: self-serve research workflows and automated syndicated intelligence. Implement full-stack features (React/TypeScript front end, Python/Node.js back end), integrate LLMs (OpenAI/Anthropic), design semantic search and RAG pipelines, ensure cloud deployment (AWS, Docker), maintain testing and code quality, and translate user needs into scalable, research-grade AI systems.
Summary Generated by Built In

About NewtonX

NewtonX is a B2B insights company trusted by the world's most innovative companies to make high-stakes decisions with confidence. We combine a verified network of business professionals with AI-powered research tools to deliver research intelligence faster, more precise, and more defensible than traditional methods.
Our clients include Google, Microsoft, TikTok, DoorDash, Stripe, and Coinbase. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek, and the Wall Street Journal.
NewtonX has raised $47M from investors including Two Sigma Ventures, Third Prime, XFund, and Citi Ventures.

About The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub – The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows.

Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you’ll do the most important work of your career.

What We're Looking For

Required

  • You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment

  • Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar

  • AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.

  • Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices

  • Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards

  • Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices

Nice To Have

  • RAG systems, embeddings, semantic search

  • Real-time data processing or streaming architectures

  • Open-source contributions in AI/ML

What Actually Matters
We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs- a side project, an open-source contribution, a blog post that shows how you think- put that at the top of your application.

Why Join NewtonX?
  • Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications

  • Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms

  • World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft

  • High velocity: Ship features that directly impact how billion-dollar decisions are made

  • Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement

  • Impact: Your work will directly shape how the world's leading organizations make critical business decisions

What We Offer
  • Excellent medical, dental, and vision insurance.

  • 401k match with immediate vesting.

  • Generous Paid time off, holidays, and parental leave.

  • A diverse, collaborative, and positive culture where we invest in and celebrate each other’s success.

Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Skills Required

  • 3-4 years of experience shipping production code in a fast-paced environment
  • Full-stack expertise with React and TypeScript
  • Backend experience with Python or Node.js
  • Hands-on experience integrating LLMs and using OpenAI or Anthropic APIs
  • Experience with AWS and Docker and modern deployment practices
  • Experience with testing, code reviews, and maintaining high code quality standards
  • Ability to translate user needs into technical solutions (customer-focused)
  • Experience with RAG systems, embeddings, and semantic search
  • Experience with real-time data processing or streaming architectures
  • Open-source contributions in AI/ML
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: New York, NY
Year Founded: 2016

What We Do

NewtonX matches the world’s toughest questions with the only minds who know the answers. We find the right subject matter expertise from an open network of 1.1 billion professionals. To do this, we use the most sophisticated search engine in the research industry– the NewtonX Graph. It identifies the exact audience for our clients’ business questions. We ensure every professional is 100% verified, so you can ground your work in true expertise and make strides with confidence. As the world’s leading B2B research company, we field large-scale quantitative surveys, facilitate qualitative interviews, engage in long-term consultations, and create customized research plans. NewtonX partners with the world’s top consultancies, marketers, and technology companies. Together with our clients, we’re ushering in a new standard of truth in B2B research.

Similar Jobs

GitLab Logo GitLab

Vice President, Legal Commercial

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
US
2500 Employees

GitLab Logo GitLab

Manager, Professional Services Engineers (EMEA)

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
Remote
United States
2500 Employees

DraftKings Logo DraftKings

Customer Experience Associate, Temporary

Digital Media • Gaming • Information Technology • Software • Sports • Esports • Big Data Analytics
Remote or Hybrid
New Jersey, USA
6400 Employees
19-19 Hourly

Toast Logo Toast

Senior Software Engineer

Cloud • Fintech • Food • Information Technology • Software • Hospitality
Remote
USA
5000 Employees
159K-254K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account