Senior Backend Engineer- Evaluations

Reposted Yesterday
Hiring Remotely in USA
Remote
160K-205K Annually
Senior level
Artificial Intelligence • Edtech
The Role
As a Senior Backend Engineer, you will enhance MagicSchool's AI Evaluations capabilities, ensuring product safety and quality while collaborating with team members across disciplines.
Summary Generated by Built In

WHO WE ARE: MagicSchool is the premier generative AI platform for teachers. We're just over 2 years old, and more than 6 million teachers from all over the world have joined our platform. Join a top team at a fast growing company that is working towards real social impact. Make an account and try us out at our website and connect with our passionate community on our Wall of Love.

As a Senior Backend Engineer- Evaluations, you will work with the Trust, Safety and Quality team as a strong individual contributor to expand our Generative AI Evaluations capabilities. This work involves both application and data engineering. You will feel a sense of ownership over the space far beyond just taking tickets. You will obsess over safety, quality, speed and user impact. You will know when it's time to build versus time to buy and integrate. You will be passionate about building resilient scalable systems to ensure our users have the best experience possible.

What You Will Do:
  • Ensure we're building the safest product MagicSchool can build.

    • Build tools and processes for evaluating MagicSchool output at scale

    • Stay up to date on the latest tools and literature

    • Passionate about solving education problems with technology

  • Work closely with Evaluations product manager, team lead, data scientist and engineer and deliver high quality features

  • Design, architect, and write high quality code to expand our Evaluations framework's capabilities

    • Debug complex code and applications in a cloud environment

    • Build software that is easy for others to understand and easy to maintain

  • Data modeling in a relational database, data warehouse, and object stores.

  • Assess and help the team choose appropriate third party solutions to problems when building doesn't make sense

  • Work cross-functionally to integrate MagicSchool's evaluations platform with the larger application

Qualifications/Competencies/Skills:
  • Working knowledge of SQL (PostgreSQL) and database design / data modeling

  • Expert knowledge of Python

    • Modern Python features like typehints and asyncio

    • Python Multiprocessing to support evaluation jobs in the 10s to 100s of thousands per run.

    • Familiarity with Pydantic

  • Strong communication skills: team-first mindset, highly collaborative, can articulate decisions within team's context

  • Experience working with and deploying docker applications

  • Builds relationships easily: emotionally intelligent, communication, warm

  • Gets a lot done: Works hard, resourceful, do whatever it takes

  • Adaptable: Smart, learns fast, curious

  • Nice to Have:

    • Experience with evaluating generative AI systems

    • TypeScript and React (useful for internal tooling and cross-team contributions)

    • AWS experience (bedrock, E(C|K)S)

Experience:
  • 7+ years as an engineer, 2 of which were at senior level or above

  • Start up experience

  • Experience with LLMs and Generative AI APIs and systems

Why Join Us?

  • Work on cutting-edge AI technology that directly impacts educators and students.

  • Join a mission-driven team passionate about making education more efficient and equitable.

  • Flexibility of working from home, while fostering a unique culture built on relationships, trust, communication, and collaboration with our team - no matter where they live.

  • For full time employees:

  • Unlimited time off to empower our employees to manage their work-life balance. We work hard for our teachers and users, and encourage our employees to rest and take the time they need.

  • Choice of employer-paid health insurance plans so that you can take care of yourself and your family. Dental and vision are also offered at very low premiums.

  • Every employee is offered generous stock options, vested over 4 years.

  • 401k match & monthly wellness stipend.

Our Values:

  • Educators are Magic:  Educators are the most important ingredient in the educational process - they are the magic, not the AI. Trust them, empower them, and put them at the center of leading change in service of students and families.

  • Joy and Magic: Bring joy and magic into every learning experience - push the boundaries of what’s possible with AI.

  • Community:  Foster community that supports one another during a time of rapid technological change. Listen to them and serve their needs.

  • Innovation:  The education system is outdated and in need of innovation and change - AI is an opportunity to bring equity, access, and serve the individual needs of students better than we ever have before.

  • Responsibility: Put responsibility and safety at the forefront of the technological change that AI is bringing to education.

  • Diversity: Diversity of thought, perspectives, and backgrounds helps us serve the wide audience of educators and students around the world.

  • Excellence:  Educators and students deserve the best - and we strive for the highest quality in everything we do.

Top Skills

AWS
Docker
Postgres
Python
React
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Denver, Colorado
95 Employees
Year Founded: 2023

What We Do

MagicSchool is the leading generative AI platform in education, boasting over 2 million educators on the platform in less than a year. It fights educator burnout by providing them AI assistance and creates responsible and safe AI experiences for students to prepare them for the future of work.

Similar Jobs

NBCUniversal Logo NBCUniversal

Systems Engineer

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
New York, NY, USA
68000 Employees
125K-155K Annually

NBCUniversal Logo NBCUniversal

Data Engineer

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
Orlando, FL, USA
68000 Employees

NBCUniversal Logo NBCUniversal

Director, Data Engineering & Analytics, Fandango

AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Remote or Hybrid
Orlando, FL, USA
68000 Employees

Rula Logo Rula

Head of FP&A (Remote)

Healthtech • Other • Social Impact • Software • Telehealth
Remote
United States
595 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Software • Information Technology • Artificial Intelligence
New York, NY
10 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees
Idler Thumbnail
Artificial Intelligence
San Francisco, California
6 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account