Policy Advisor

The Machine Intelligence Research Institute (MIRI) is a nonprofit based in Berkeley, California, focused on reducing existential risks from the transition to smarter-than-human AI. We've historically been very focused on technical alignment research. Since summer 2023, we have shifted our focus towards communication and AI governance. See our strategy update post for more details.

We are looking to build a dynamic and versatile team that can lead to implementation of our governance research. Our technical governance team focuses on researching and designing technical aspects of regulations and policy that could lead to safe AI. The team works on:

• Creation of policies that would decrease the probability of unsafe AI while preserving the ability to create safe AI

• Inputs into regulations, requests for comments by policy bodies (e.g. NIST/US AISI, EU, UN)

• Technical research to improve international coordination, such as research about verification mechanisms

• Communicating with and consulting for policymakers and governance organizations

Our previous publications are available on our website if you would like to read them. See our research agenda for the kinds of future projects we are excited about.

In this role, you would have the chance to work on all of the above areas. The work will primarily be engaging with collaborators and policymakers, with a mixture of researching and writing in support. Some specific tasks that you might do:

• Brief government offices on topics related to AI risk and AI policy, representing MIRI's focus.

• Take existing policy ideas from MIRI and others and identify implementation details to make these plans more concrete.

• Network in the AI policy community and broader space.

• Provide feedback on draft legislation.

• Do the full stack of AI policy research. For example, identify gaps in existing policy proposals based on other MIRI research and develop the relevant policies from broad idea to draft legislation.

There are no formal degree requirements to work on the team, however we are especially excited about applicants who have a strong background in government or a proven track record at advocating for policy changes. We don’t require significant previous engagement with AI safety, but you should be familiar enough with MIRI’s worldview as described in If Anyone Builds It, Everyone Dies to know whether you want to push hard for the team.

We are also excited about candidates who are particularly strong in the following areas:

• Agency – You get things done without someone constantly looking over your shoulder. You notice problems and are motivated to fix them. You focus on solving the problem, not waiting to be told what to do. You know when to defer to another’s decision, and when to ask for guidance. You are an active member of the team, not a mindless cog in the machine.

• Conscientiousness – You are diligent and hard-working, and complete your work reliably and dependably. You desire to do tasks well and effectively. You pay attention to details and are organized, and able to manage lots of small tasks and projects.

• Comfort learning on the job – You enjoy and are able to quickly acquire new skills and knowledge as needed. You feel comfortable working on underspecified tasks where part of your job is to further develop the research questions appropriately.

• Generative thinking – You enjoy coming up with and iterating on new ideas. You can generate original work as well as extend others’ thoughts. You aren’t afraid to suggest things, or point out flaws in your or others’ thoughts.

• Communication (Internal) – You are a team player who is excited to work together with others and willing to attend several weekly meetings. You proactively keep teammates/manager in the loop about the status of projects you manage, when things are falling behind, when you need more information. You voice your confusions.

• Communication (External) – You are able to communicate effectively to external stakeholders who have a range of technical expertise, including policymakers. You can produce concise, clear, and compelling writing, and deliver presentations on the team's research and ideas.

In addition, we are looking for candidates who:

• Are broadly aligned with MIRI's values and willing to work toward MIRI’s goals, and the Technical Governance Team’s research directions (e.g., those described in our research agenda)

• Are passionate about MIRI’s mission and excited to support our work in reducing existential risks from AI.

• Application deadline - No current deadline, we will evaluate applications as they come in.

• Location – Prefer in-office (in Washington DC).

• Compensation – $100–300k.

  • The range is due to the wide possibility space of experience and skills that candidates may bring.

  • We strive to ensure that all staff are paid an appropriate and comfortable living wage such that they feel fairly compensated and are able to focus on doing great work.

• Benefits – MIRI offers a variety of benefits including:

  • Health insurance (the best available plans from Kaiser and Blue Shield) as well as dental and vision coverage.

  • “No vacation policy” – staff are encouraged to take vacation when they want/need to in coordination with their manager.

• Visas – We can potentially sponsor visas for particularly promising candidates.