Technical Operations Analyst, Automation & Evaluations

Posted Yesterday
Be an Early Applicant
Dublin, IRL
In-Office
Entry level
Artificial Intelligence • Machine Learning • Generative AI
The Role
Uses SQL and Python to analyze Trust and Safety operations, build datasets, dashboards, automation scripts, API integrations, and evaluation workflows. Defines metrics, assesses data quality, measures process improvements, and partners with domain experts to translate ambiguous requirements into reliable tools. Documents and hands off workflows for ongoing maintenance, with potential exposure to sensitive content.
Summary Generated by Built In

About the Team

At OpenAI, our User Safety & Risk Operations (USRO) team helps protect our products and users from abuse, fraud, safety risks, and other forms of misuse. We translate real-world user and operational signals into timely decisions, practical interventions, and improvements to our products and systems.

This role sits on the Risk Incubation & Systems (RIS) vertical in USRO, which investigates emerging risks, builds data and automation capabilities, and develops workflows that can scale into durable operational homes.

About the Role

As part of the Automation & Analytics function within RIS, you’ll partner with teams across USRO to support their data, analysis, measurement, and automation needs. You’ll build tools and workflows that help teams make informed decisions and improve how they operate. You’ll work with domain experts to turn judgment into testable criteria, then help take promising prototypes into reliable operation.

You will work hands-on with Trust & Safety domain experts, investigators, operational leads, and engineers to turn ambiguous requirements into practical systems. You’ll test and document the tools and workflows you build, and agree with partner teams who will monitor and maintain them.

Please note: This role may involve exposure to sensitive or concerning content. Strong discretion, good judgment, and resilience are essential.

In This Role, You Will

  • Work with teams across USRO to define the questions they need answered and identify work that could benefit from automation.

  • Use SQL and Python to investigate operational problems and turn findings into recommendations teams can act on.

  • Build and maintain datasets and dashboards that teams can use for recurring analysis.

  • Define metrics to assess the quality and impact of USRO’s work, and measure whether changes produce the expected improvements.

  • Build scripts and API integrations to automate recurring tasks, using LLMs where they improve the workflow.

  • Evaluate automated workflows against expert-reviewed examples and existing processes to understand errors and measure their practical value.

  • Hand off workflows with clear ownership, maintenance instructions, and a feedback loop for reviewers.

You Might Thrive in This Role If You

  • Have strong SQL skills and can use Python to analyze data and build tools that solve practical problems.

  • Have worked with messy (operational) data and can assess its quality and explain how gaps affect your findings.

  • Can turn a loosely defined request into a clear problem and choose a practical way to solve it.

  • Have built and maintained datasets, dashboards, scripts, or API integrations that other people use in their work.

  • Know how to define useful metrics and measure whether changes to a process or tool improve outcomes.

  • Can explain the trade-offs involved in workflow automation, including where human judgment is needed.

  • Can work with domain experts to define clear assessment criteria and work through disagreements about ambiguous cases.

  • Have experience designing evaluations or quality checks and using the results to decide when to launch a tool and how to improve it.

Nice to Have

  • Experience transferring prototypes or new workflows into reliable, scaled operations.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. We push the boundaries of the capabilities of AI systems and seek to safely deploy them to the world through our products. AI is an extremely powerful tool that must be created with safety and human needs at its core, and to achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. 

We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic.

For additional information, please see OpenAI’s Affirmative Action and Equal Employment Opportunity Policy Statement.

Background checks for applicants will be administered in accordance with applicable law, and qualified applicants with arrest or conviction records will be considered for employment consistent with those laws, including the San Francisco Fair Chance Ordinance, the Los Angeles County Fair Chance Ordinance for Employers, and the California Fair Chance Act, for US-based candidates. For unincorporated Los Angeles County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: protect computer hardware entrusted to you from theft, loss or damage; return all computer hardware in your possession (including the data contained therein) upon termination of employment or end of assignment; and maintain the confidentiality of proprietary, confidential, and non-public information. In addition, job duties require access to secure and protected information technology systems and related data security obligations.

To notify OpenAI that you believe this job posting is non-compliant, please submit a report through this form. No response will be provided to inquiries unrelated to job posting compliance.

We are committed to providing reasonable accommodations to applicants with disabilities, and requests can be made via this link.

OpenAI Global Applicant Privacy Policy

At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Skills Required

  • Strong SQL skills and Python experience for data analysis and tool building
  • Experience working with messy operational data and assessing data quality
  • Ability to turn loosely defined requests into clear problems and practical solutions
  • Experience building and maintaining datasets, dashboards, scripts, or API integrations used by others
  • Experience defining metrics and measuring whether process or tool changes improve outcomes
  • Ability to explain workflow automation trade-offs and identify where human judgment is needed
  • Ability to work with domain experts to define assessment criteria and resolve ambiguous cases
  • Experience designing evaluations or quality checks and using results to guide tool launches and improvements
  • Experience transferring prototypes or new workflows into reliable, scaled operations

OpenAI Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about OpenAI and has not been reviewed or approved by OpenAI.

  • Healthcare Strength — Feedback suggests comprehensive medical, dental, and vision coverage for employees and families, with employer-covered premiums in key hubs. Health benefits are frequently described as robust and a core part of the package.
  • Retirement Support — Observations indicate access to a 401(k) alongside substantial total compensation structures. This pairing is positioned as attractive for long-term financial planning.
  • Equity Value & Accessibility — Employee packages are portrayed as heavily weighted toward equity and profit-participation components. Feedback suggests these long-term incentives can be a significant upside in a high-growth environment.

OpenAI Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
4,500 Employees
Year Founded: 2015

What We Do

OpenAI is an AI research and deployment company dedicated to ensuring that general-purpose artificial intelligence benefits all of humanity. AI is an extremely powerful tool that must be created with safety and human needs at its core. OpenAI is dedicated to putting that alignment of interests first — ahead of profit. To achieve our mission, we must encompass and value the many different perspectives, voices, and experiences that form the full spectrum of humanity. Our investment in diversity, equity, and inclusion is ongoing, executed through a wide range of initiatives, and championed and supported by leadership. At OpenAI, we believe artificial intelligence has the potential to help people solve immense global challenges, and we want the upside of AI to be widely shared. Join us in shaping the future of technology.

Similar Jobs

JPMorganChase Logo JPMorganChase

Architect

Financial Services
Hybrid
2 Locations
289097 Employees

Pfizer Logo Pfizer

Director, AI Product Lead

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Associate, AI Engineering

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
28 Locations
121990 Employees

Pfizer Logo Pfizer

Global Head, Site Contracting

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
30 Locations
121990 Employees
215K-358K Annually

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account