Engineering Manager, Workers AI Platform

Job Posted 12 Days Ago Reposted 12 Days Ago
Be an Early Applicant
London, England
Hybrid
Mid level
Cloud • Information Technology • Security • Software • Cybersecurity
Helping Build a Better Internet
The Role
Lead the Workers AI platform team in enhancing model scheduling and request routing within the AI inference service, utilizing Rust and Typescript.
Summary Generated by Built In

Available Locations: Austin (Hybrid)
About the Department
Emerging Technologies & Incubation (ETI) is where new and bold products are built and released within Cloudflare. Rather than being constrained by the structures which make Cloudflare a massively successful business, we are able to leverage them to deliver entirely new tools and products to our customers. Cloudflare's edge and network make it possible to solve problems at massive scale and efficiency which would be impossible for almost any other organization.
About The Team
Workers AI is Cloudflare's AI inference service, enabling customers to use a wide variety of AI models both within Cloudflare's Workers developer platform and via API. The Workers AI team owns the whole stack that powers the product, from front-end development all the way to low-level inference code. Accordingly we're a team with a diverse array of technical skills, but everyone on the team is curious and passionate about the possibilities of generative AI
What You'll Do
The Workers AI platform team is responsible for scheduling models and routing requests to the best model instance to handle it. Our stack is built using Rust and Typescript and takes advantage of Cloudflare's internal container platform. You will lead the team to use quantitative metrics to deliver improved flexibility and performance across the platform. This is a distributed systems role, and you will bring experience and expertise to the team in the areas of load balancing, scheduling, and resource sharing. This is a small team and the ideal candidate is capable of high-level technical contributions as well as team leadership.
This role is based in Austin, Texas and requires at least two days a week in-office.
Examples of desirable skills, knowledge, and experience

  • Experience leading high performing teams
  • Strong communication skills
  • Comfortable with tight deadlines and short release cycles
  • Strong systems-level programming skills
  • Experience building large-scale distributed systems
  • Expert-level knowledge in a modern compiled language like Go, Rust or modern C++


Equity
This role is eligible to participate in Cloudflare's equity plan.
Benefits
Cloudflare offers a complete package of benefits and programs to support you and your family. Our benefits programs can help you pay health care expenses, support caregiving, build capital for the future and make life a little easier and fun! The below is a description of our benefits for employees in the United States, and benefits may vary for employees based outside the U.S.
Health & Welfare Benefits
Medical/Rx InsuranceDental InsuranceVision InsuranceFlexible Spending AccountsCommuter Spending AccountsFertility & Family Forming BenefitsOn-demand mental health support and Employee Assistance ProgramGlobal Travel Medical Insurance
Financial Benefits
Short and Long Term Disability InsuranceLife & Accident Insurance401(k) Retirement Savings PlanEmployee Stock Participation Plan
Time Off
Flexible paid time off covering vacation and sick leaveLeave programs, including parental, pregnancy health, medical, and bereavement leave

Top Skills

Rust
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
3,900 Employees
Hybrid Workplace
Year Founded: 2010

What We Do

Cloudflare, Inc. (NYSE: NET) is the leading connectivity cloud company on a mission to help build a better Internet. It empowers organizations to make their employees, applications and networks faster and more secure everywhere, while reducing complexity and cost. Cloudflare’s connectivity cloud delivers the most full-featured, unified platform of cloud-native products and developer tools, so any organization can gain the control they need to work, develop, and accelerate their business.

Powered by one of the world’s largest and most interconnected networks, Cloudflare blocks billions of threats online for its customers every day. It is trusted by millions of organizations – from the largest brands to entrepreneurs and small businesses to nonprofits, humanitarian groups, and governments across the globe.

Why Work With Us

Cloudflare employees come from all walks of life. We are mission-driven, and our team is energized by a collaborative, creative environment that celebrates our differences and fosters new ways to grow together.

Gallery

Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery
Gallery

Cloudflare Offices

Hybrid Workspace

Employees engage in a combination of remote and on-site work.

We are committed to developing a global team that is distributed with a flexible working approach. Doing this equitably and inclusively is essential to our success. Visit our careers site for more on 'How & Where We Work.'

Typical time on-site: Flexible
HQSan Francisco, CA
Singapore
Austin, TX
Bengaluru, Karnataka
Boston, MA
Champaign, IL
Denver, Colorado
Lisbon, PT
London, GB
Los Angeles, CA
New York, NY
Seattle, WA
Washington, DC
Learn more

Similar Jobs

Cloudflare Logo Cloudflare

Engineering Manager, Media Platform

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
2 Locations
3900 Employees

Cloudflare Logo Cloudflare

Network Engineer

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
2 Locations
3900 Employees

Cloudflare Logo Cloudflare

Software Engineer, Security Posture Management

Cloud • Information Technology • Security • Software • Cybersecurity
Hybrid
2 Locations
3900 Employees

Cloudflare Logo Cloudflare

Principal VM Engineer - Workers Runtime Team

Cloud • Information Technology • Security • Software • Cybersecurity
Remote
Hybrid
5 Locations
3900 Employees
Not Eligible
Save
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account