Database Engineer

Posted 4 Hours Ago
Be an Early Applicant
4 Locations
In-Office
Entry level
Software
The Role
Build and operate Ahrefs’ large-scale database and storage infrastructure across approximately 1,200 servers and hundreds of petabytes. Responsibilities include developing ClickHouse, MooseFS, and SeaweedFS features; managing TiDB and Elasticsearch clusters; diagnosing performance and data corruption; conducting fault testing; automating operations; and executing production releases and migrations without downtime.
Summary Generated by Built In
Own the data layer behind one of the biggest crawlers on the web.

Ahrefs helps marketers get their brands found in search, in AI answers and on social. Under the product sits one of the largest datasets on the web, and someone has to keep it fast, correct and alive. 

The team

The Database team owns our databases and storage end to end, from the source code to production. We run ClickHouse, MooseFS, SeaweedFS, TiDB and Elasticsearch on about 1,200 servers holding hundreds of petabytes, in data centres in Singapore, the US and the UK.

We don’t file tickets with vendors and wait. When a system doesn’t do what we need, we change its source, prove the change on production data and roll it out ourselves.

The job

You’ll build and run our data layer: ClickHouse, the MooseFS and SeaweedFS storage under it, and the TiDB and Elasticsearch clusters beside it. You write the code, you ship it, and you’re there when it meets production. You’ll work with AI coding agents as a normal part of the job.

Examples of what you’ll work on
  • Build storage and query features in ClickHouse, such as replication over a shared file system, and storage policies that place data by its merge history.
  • Keep up with upstream ClickHouse LTS releases, keep CI green and ship our own releases regularly.
  • Make MooseFS and SeaweedFS highly available and durable: Raft-based metadata servers, follower reads, an intent log, automatic re-replication.
  • Find performance problems in production profiles and fix them in the code, from query plans to FUSE clients.
  • Trace data corruption to its root cause, even when it’s in compression, the memory allocator or the compiler, and repair the damaged data.
  • Roll out releases and storage migrations across about 1,200 servers in three regions, without downtime.
  • Run and tune TiDB, TiKV, TiCDC and Elasticsearch: scheduling, replication lag, backups, disk balance.
  • Check risky designs with TLA+ and fault injection, and automate whatever repeats with watchdogs, balancers and dashboards.
  • Build an SRE agent that watches our database clusters, diagnoses incidents and proposes fixes.
You’re probably right for this if
  • You write strong C++, C and Rust, can work in Go, and feel at home in codebases of millions of lines.
  • You know database storage engines deeply: merges or compaction, replication logs, query execution.
  • You understand distributed consensus (Raft or Paxos) and what happens when things fail.
  • You know Linux storage internals: page cache, fsync, FUSE, file systems, and how NVMe and HDDs really behave.
  • You’ve run databases or storage on hundreds of nodes, and led the recovery when an incident hit.
  • You debug with gdb, perf and sanitizers.
  • You measure a change on production data before you call it a win.
Good to have
  • Contributions to an open-source database or file system.
  • OCaml. Much of our backend is written in it.
  • Puppet or a similar configuration management tool.
Why Ahrefs?

We give smart people real ownership and don’t micromanage them. Here that means a few hundred petabytes and the source code of the systems that hold them. Small team, no layers of process, and the hardware to do the job properly. We value honesty, results and simple solutions over complicated ones.

Ahrefs does not engage with agencies or third-party recruitment providers for the roles we hire for. If we need help, we’ll let you know.

Location: Singapore, Tokyo, Palo Alto (CA) or Cambridge (MA). On-site; you’ll need the right to work in the office you choose.

Ahrefs does not engage with agencies or third party recruitment solutions for the roles we hire for. If at any point we need help, we'll let you know! 

Skills Required

  • Strong C++, C, and Rust programming skills
  • Ability to work with Go
  • Deep knowledge of database storage engines, including compaction, replication logs, and query execution
  • Understanding of distributed consensus systems such as Raft or Paxos
  • Knowledge of Linux storage internals, including page cache, fsync, FUSE, file systems, NVMe, and HDD behavior
  • Experience running databases or storage systems across hundreds of nodes
  • Experience leading recovery from production incidents
  • Proficiency debugging with gdb, perf, and sanitizers
  • Ability to measure changes using production data
  • Open-source database or file-system contributions
  • OCaml experience
  • Puppet or similar configuration management experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Singapore
165 Employees
Year Founded: 2010

What We Do

Ahrefs Pte. Ltd. is a software company that develops online SEO tools and free educational materials for marketing professionals. Ahrefs is an all-in-one SEO toolset for growing search traffic and optimizing websites. To do that, Ahrefs crawls the web, stores tons of data and makes it accessible via a simple user interface. When Ahrefs launched its first tool, Site Explorer, it disrupted the stagnant field of backlink analysis and kickstarted a new round of competition among SEO tool providers. It quickly became one of the world’s best backlink analysis tools. Since then, Ahrefs has grown into a complete SEO suite by developing tools like Keywords Explorer for keyword research, Content Explorer for analyzing content, Rank Tracker for monitoring keyword rankings, and Site Audit for auditing and optimizing websites.

Similar Jobs

MetLife Logo MetLife

Senior Database Engineer

Fintech • Information Technology • Insurance • Financial Services • Big Data Analytics
Hybrid
Tokyo, JPN
43000 Employees

SailPoint Logo SailPoint

Sales Executive

Artificial Intelligence • Cloud • Sales • Security • Software • Cybersecurity • Data Privacy
Remote or Hybrid
Japan
2461 Employees

Hilton Logo Hilton

【Hilton Tokyo】Front Desk Agent

Events • Food • Travel • Hospitality • Hotels & Resorts
In-Office
Tokyo, JPN
500000 Employees

Wise Logo Wise

Workplace Adviser

Fintech • Mobile • Payments • Software • Financial Services
Hybrid
Tokyo, JPN
9000 Employees

Similar Companies Hiring

Ford Energy Thumbnail
Automotive • Software • Energy • Utilities • Manufacturing • Renewable Energy
Glendale, Kentucky
55 Employees
Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account