LLM Platform Engineer

Reposted 12 Days Ago
2 Locations
Hybrid
160K-190K Annually
Mid level
Enterprise Web • Hardware • Information Technology • Productivity • Software
AllSpice helps hardware teams communicate effectively, reduce prototype errors, and accelerate time to market.
The Role
The Data & LLM Systems Engineer will design and maintain data pipelines, backend services, and LLM integration while ensuring data reliability and performance.
Summary Generated by Built In

Help define the future of hardware development! At AllSpice, we're building the automation engine that powers the next generation of circuit design, enabling breakthroughs in smart vehicles, robotics, rockets, IoT, medical devices, and more.

We're creating the agile development environment for hardware engineers with a Git-friendly translation layer and automated CI/CD framework for native circuit designs. Think GitHub/GitLab + Copilot for electronics.

Our mission is to bring the same modern workflows that revolutionized software: version control, automation, and collaboration to the hardware world.

Learn more about our journey in TechCrunch and our recent Series A announcement.

If you're passionate about building tools that empower teams and delight customers, and you want to shape the foundation of modern hardware DevOps, we'd love to meet you!

Read more at https://allspice.io

What will you do?

This is a high-impact, cross-functional role at the intersection of engineering, data, and customer experience. You will build and maintain the internal tooling, analytics platforms, and customer-facing applications that power AllSpice's Generative AI team.

You will:

  • Collaborate closely with product and engineering teams to understand workflows and build tools that solve real problems.

  • Own the evaluation and observability layer for our AI products — building dashboards, analytics pipelines, and reporting tools that give the Gen AI team and stakeholders visibility into model performance, usage, and customer outcomes.

  • Develop customer-facing tooling and lightweight web applications that surface AI-powered insights and enable seamless interaction with AllSpice's products.

  • Build and maintain scripts, data pipelines, and integrations that connect internal systems, third-party services, LLMs, and MCPs.

  • Write clear documentation and communicate findings to both technical and non-technical audiences, including leadership and customers.

  • Champion code quality, testing, and reliability across the tooling stack through reviews, mentorship, and thoughtful design.

Example Projects
  • Build interactive internal dashboards to track DRCY performance metrics, customer usage patterns, and model quality over time.

  • Develop a lightweight web application that allows customers to explore AI-generated design review results, drill into findings, and provide feedback.

  • Create and maintain data pipelines that aggregate evaluation results, customer feedback, and telemetry into a unified analytics layer.

  • Build scripting tools and automations to streamline the Gen AI team's development and testing workflows (e.g., batch evaluation runs, report generation).

  • Design and implement RAG-based information repositories and tooling to capture component data and domain knowledge for use by our suite of AI products.

  • Integrate with CI/CD systems (GitHub Actions) to surface AI insights directly in engineering workflows.

  • Work with infrastructure to maintain appropriate reporting for centralized cache service.

Our stack
  • Languages: Python, TypeScript/JavaScript, SQL

  • Analytics & Data: SQL databases (Postgres), Jupyter Notebooks, business intelligence/analytics tools

  • AI/LLM: Langchain, Pydantic AI, Langfuse

  • Web: Vue/TypeScript front-end, common web architectures and APIs

  • Infrastructure: GitHub Actions for CI/CD, Docker Swarm & Terraform, AWS

  • Our Hub application is a soft fork of Gitea

    • Go [server-side]

    • Vue/TypeScript Front-end

Expectations

Our ideal candidate should have the following:

  • 4+ years of software engineering experience with a focus on tooling, analytics, or full-stack web development.

  • Strong SQL skills and experience working with data/analytics tools (e.g., Jupyter, Metabase, Looker, or similar BI platforms).

  • Proficiency in Python scripting and automation for data pipelines, integrations, and internal tools.

  • Experience building web applications or customer-facing tools using modern frameworks (e.g., Vue, React, TypeScript).

  • Familiarity with LLM-enabled applications and frameworks such as Langchain, including prompt construction and evaluation best practices.

  • Excellent communication skills — you can translate technical findings into clear insights for engineers, product managers, and customers alike.

  • A customer-first mindset: you think about the end-user experience and proactively seek feedback to improve the tools you build.

  • Bachelor's degree or higher in a technology-related field, or equivalent practical experience.

  • Project management skills with the ability to lead and collaborate with varied stakeholders to move projects forward.

  • Comfort with ambiguity, autonomy, and being self-directed in a fast-moving environment.

  • (Preferred) Availability to work out of our flex offices in San Francisco or Boston on a hybrid basis (2–3 times/week), but we are flexible for the right candidate.

Relevant Skills

You don't necessarily have to be proficient in all of these, but the more you know, the better:

  • Python, TypeScript, SQL

  • Business analytics and data visualization tools

  • Langchain, Pydantic AI, and LLM evaluation frameworks

  • GitHub Actions development and CI/CD

  • Common web architectures, APIs, and front-end frameworks (Vue, React)

  • Monitoring and observability tools (e.g., Langfuse, DataDog, Grafana)

  • Project management and stakeholder communication

Benefits
  • Supportive and smart colleagues, flexible work, opportunity to make a big impact, competitive salary & equity, health, dental, vision, generous PTO, home office stipend.

Skills Required

  • Strong experience building backend systems and APIs
  • Solid understanding of data modeling, databases, and data pipelines
  • Experience analyzing applications that leverage LLMs in production systems
  • Comfort analyzing data and drawing actionable conclusions
  • Ability to reason about system performance, reliability, and cost
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Sommerville, MA
10 Employees
Year Founded: 2020

What We Do

What if we could design hardware with the ease and speed of software? AllSpice is building the first ever developer-led platform for collaborating on and seamlessly validating hardware designs. The world around us is enabled by novel circuit designs. Consider the seemingly trivial act of hailing a taxi from the comfort of your home. This simple process (for you) relies on a 3 million light-emitting diode display with a user interface that is logically routed to a capacitive sensor capable of tracking your finger at sub-millimeter resolution, an antenna capable of transmitting to a radio tower kilometers away at a rate of 20 Gb/s, repeated 35,000 km to a satellite, which is able to use it’s own integrated sensors and drivers to maintain geosynchronous orbit over decades without human interference. The infrastructure we've taken for granted wasn't designed overnight and isn't staying put. It's constantly evolving to enable the next generation of life-changing products. But this evolution is currently hamstrung by incumbent and proprietary development infrastructure built for waterfall project management (mostly in the 90s), requiring manual pdf exports, emails, and in-person meetings at each design revision. The next generate of human innovation, like putting the first human colonies on Mars, requires a step-change in how hardware designs are managed. At AllSpice, we've experienced this problem as hardware engineers and we've seen the solutions as software leaders. Today, AllSpice Hub is allowing electrical engineering teams to dramatically accelerate their development by enabling a truly agile workflow. They can seamlessly push a new design update in git, open a design review, tag stakeholders, notify them by email and slack, all while AllSpice automatically collects review artifacts, like visual diffs and review checklists. See it live at https://hub.allspice.io/AllSpice/Archimajor What now? This is just the tip of the iceberg. Our users are adding collaborators from firmware, software, mechanical engineering, management, and logistics begging for even more ways connect their design data to revolutionize their workflow and connect their teams.

Why Work With Us

We encourage exploration and growth in all areas of our work. We never put a pin in something we don't understand. As a team, we set priorities more often than processes. We enjoy the freedom from overbearing bureaucracy that comes with being part of a small team. We're a remote-first team, and believe amazing progress can happen from anywhere.

Gallery

Gallery

Similar Jobs

Capital One Logo Capital One

Artificial Intelligence Engineer

Fintech • Machine Learning • Payments • Software • Financial Services
Hybrid
5 Locations
55000 Employees
197K-246K Annually

HiBob Logo HiBob

Director of Enablement

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
United States
1350 Employees
210K-265K Annually

HiBob Logo HiBob

Senior Back-end Engineer

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
United States
1350 Employees
170K-220K Annually

HiBob Logo HiBob

Product Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
United States
1350 Employees
140K-180K Annually

Similar Companies Hiring

Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account