AI Engineer: Post-Training

Posted 6 Days Ago
Be an Early Applicant
London, Greater London, England, GBR
In-Office
Entry level
Machine Learning • Software
Build beyond human imagination.
The Role
Own the development and productionization of LLM post-training capabilities. Build data, training, evaluation, reward, verifier, and deployment pipelines; improve open models for engineering and agent benchmarks; manage customer-controlled model customization across SaaS, VPC, and air-gapped environments; and define the product roadmap in partnership with research, platform, and product teams.
Summary Generated by Built In
About us
Re-architecting Engineering for the Age of Intelligence

PhysicsX is the physics AI company for industrials. The company’s mission is to accelerate hardware innovation by overhauling what industrial engineering and manufacturing look like today. PhysicsX is building a new simulation software stack to deliver deep physics AI enablement across the entire engineering lifecycle. The company partners with leading organisations in aerospace & defence, automotive, semiconductors, materials, and energy & renewables, supporting them on some of their most critical and complex challenges. PhysicsX is headquartered in the United Kingdom, with offices in London, New York, and Singapore and an expanding presence in the Bay Area.
The role

You will own the product capability that lets PhysicsX and its customers improve LLMs for their specific work.

You will be a hands-on product ML engineer embedded deeply with our Research group and accountable for turning post-training methods into something customers can use. The first goal is to make open models perform strongly on the evals and benchmarks that matter to us. The longer-term goal is a repeatable platform capability through which customers can train models on their own workflows keeping their data, learned behaviour and intellectual property under their control.

The remit is broader than supervised fine-tuning. You will choose and apply the right post-training methods, including preference optimisation, reinforcement learning, distillation, synthetic data and verifier-based approaches. You will own the capability roadmap and production outcome; Research will be a close partner in developing methods, and platform product teams will be partners in integrating the experience.

What you will do
  • Own the path from a base model and customer workflow to a measured, deployable model improvement.
  • Build reliable post-training harnesses covering data preparation, training, evaluation, model artifacts and hand-off to serving.
  • Improve open models against PhysicsX's agent and engineering benchmarks, using evidence to decide whether training is better than changes to prompts, tools or the agent design.
  • Develop and operate methods spanning SFT, preference optimisation, RLHF/RLAIF, RL with verifiable rewards, distillation, rejection sampling and related techniques.
  • Build reproducible synthetic-data and expert-data pipelines, including quality filtering, provenance, licensing and contamination controls.
  • Design reward signals, verifiers and rollout workflows while detecting reward hacking, benchmark overfitting, model collapse and unintended regressions.
  • Make post-training available through a mix of managed workflows and expert-facing interfaces.
  • Ensure customer data and resulting model artifacts can remain within the customer's platform environment across SaaS, VPC and air-gapped deployments.
  • Work on cross-product and public benchmarks. Own experiment diagnostics with Research, with shared approval where results support product or external claims.
  • Work with the LLM Self-Hosting & Model Routing Lead to move trained models into supported production serving and routing.
  • Set the product roadmap for model improvement, balancing research opportunity with customer value, operability and time to production.
  • Help determine how this capability should grow and, over time, shape the team around it.
What you bringWhere you need to be strongest
  • You have measurably improved model behaviour through post-training and turned that work into a capability used in production.
  • You are deeply hands-on across data, training, evaluation and debugging; you can take an experiment from hypothesis to deployed artifact.
  • You understand modern post-training methods well enough to choose among them based on the task and evidence rather than fashion.
  • You have built high-quality training datasets from expert, behavioural or synthetic sources and understand that data design is part of model design.
  • You can diagnose training and behavioural failures, including instability, drift, reward exploitation, leakage and overfitting to evals.
  • You are product-minded: you start from a user workflow, define success, make trade-offs and build an experience others can operate.
  • You can work as the accountable product owner of a technical capability while collaborating closely with research scientists, platform engineers and product teams.
Foundations
  • Strong Python and PyTorch or equivalent model-training frameworks.
  • Distributed training, accelerator utilisation, checkpointing, recovery, experiment tracking and reproducibility.
  • Evaluation of model and agent behaviour, including controlled experiments and ablations.
  • Data governance, privacy, provenance and safe handling of customer-owned training data and artifacts.
  • Model packaging and the operational path from training to evaluation and production serving.
  • Clear technical writing and communication across research, product, engineering, delivery and customer teams.
Nice to have
  • Experience post-training open-weight models for tool use, reasoning or long-horizon agent workflows.
  • Experience with large-scale rollout generation, reward models, verifiers or online reinforcement learning.
  • Experience building managed and expert-facing model customisation products.
  • Contributions to post-training research or open-source training frameworks.
  • Experience with engineering, simulation, design, manufacturing or other expert workflows.
  • Experience operating in regulated, customer-controlled or air-gapped environments.
 
We value diversity and are committed to equal employment opportunity regardless of sex, race, religion, ethnicity, nationality, disability, age, sexual orientation or gender identity. We strongly encourage individuals from groups traditionally underrepresented in tech to apply. To help make a change, we sponsor bright women from disadvantaged backgrounds through their university degrees in science and mathematics. 
 
We collect diversity and inclusion data solely for the purpose of monitoring the effectiveness of our equal opportunities policies and ensuring compliance with employment and equality legislation. This information is confidential, used only in aggregate form, and will not influence the outcome of your application. 
 

Skills Required

  • Measurable experience improving model behavior through post-training and deploying the resulting capability to production.
  • Hands-on experience across data preparation, model training, evaluation, debugging, and deployment.
  • Strong understanding of modern post-training methods and ability to select methods based on task requirements and evidence.
  • Experience building high-quality training datasets from expert, behavioral, or synthetic sources.
  • Ability to diagnose instability, drift, reward exploitation, leakage, overfitting, and evaluation regressions.
  • Product-minded approach to defining user workflows, success criteria, trade-offs, and operable experiences.
  • Strong Python and PyTorch or equivalent model-training framework skills.
  • Experience with distributed training, accelerator utilization, checkpointing, recovery, experiment tracking, and reproducibility.
  • Experience evaluating model and agent behavior using controlled experiments and ablations.
  • Understanding of data governance, privacy, provenance, and safe handling of customer-owned data and model artifacts.
  • Experience with model packaging and the path from training through evaluation to production serving.
  • Clear technical writing and communication across research, product, engineering, delivery, and customer teams.
  • Experience post-training open-weight models for tool use, reasoning, or long-horizon agent workflows.
  • Experience with large-scale rollout generation, reward models, verifiers, or online reinforcement learning.
  • Experience building managed and expert-facing model customization products.
  • Contributions to post-training research or open-source training frameworks.
  • Experience with engineering, simulation, design, manufacturing, or other expert workflows.
  • Experience operating in regulated, customer-controlled, or air-gapped environments.
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: London
330 Employees

What We Do

PhysicsX is a deep-tech company of scientists and engineers, developing machine learning applications to accelerate physics simulations and enable a new frontier of optimization opportunities in design and engineering. Born out of numerical physics, we help our customers radically improve their concepts and designs, transform their engineering processes and drive operational product performance. We do this in some of the most advanced and important industries of our time – including Space, Aerospace, Medical Devices, Additive Manufacturing, Electric Vehicles, Motorsport, and Renewables. Our work creates positive impact for society, be it by improving the design of artificial hearts, reducing CO2 emissions from aircraft and road vehicles, and increasing the performance of wind turbines. We are currently recruiting for multiple positions, however please only apply for the role that best aligns with your skillset and career goals. We do not currently offer work experience

Similar Jobs

Tether.io Logo Tether.io

AI Research Engineer (Agentic Post-training) - 100% Remote Worldwide

Blockchain • Software • Analytics • Financial Services • Cryptocurrency
In-Office or Remote
35 Locations
292 Employees

Lovable Logo Lovable

AI Research Engineer, Post-Training

Artificial Intelligence • Software
In-Office
London, Greater London, England, GBR
351 Employees

Graphcore Logo Graphcore

Senior Software Engineer

Artificial Intelligence • Semiconductor
Hybrid
Cambridge, Cambridgeshire, England, GBR
903 Employees

CSC Logo CSC

Manager of Technology

Fintech • Legal Tech • Software • Financial Services • Cybersecurity • Data Privacy
Hybrid
3 Locations
8500 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
US
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account