Backend Infrastructure Engineer

Posted Yesterday
Be an Early Applicant
San Francisco, CA, USA
In-Office
235K-260K Annually
Senior level
Professional Services • Consulting
The Role
Own and operate production infrastructure for large-scale automated web data collection. Design proxy pools, session handling, isolated outbound traffic, browser identity systems, and automated challenge handling. Improve request success rates against anti-bot defenses, manage reliability and costs, investigate intermittent failures, and provide full production ownership including on-call responsibilities.
Summary Generated by Built In

About the company

Our client is a fast-growing software company.

The role

Raydar is recruiting for this role on behalf of our client. Own production infrastructure that supports large-scale automated data collection from websites that try to restrict it. The work spans network routing, session handling and troubleshooting stubborn intermittent faults, with full ownership from the first day.

What you'll do

- Design and run proxy pools, session handling and isolated outbound traffic at scale.

- Maintain a high rate of successful requests even when target sites deploy strong anti-automation protections.

- Develop and maintain systems that manage browser identity signals and handle verification challenges.

- Oversee the reliability and cost profile of the proxy layer.

- Investigate elusive, intermittent failures across the stack and resolve them permanently.


Requirements

What we're looking for

- Hands-on, production-scale experience building proxy systems or data extraction pipelines that operate against hostile website defenses.

- Recent experience, within the last 2 years, working around strong anti-bot protections as a hands-on individual contributor.

- Production experience managing browser and TLS identity signals and automated challenge handling.

- Proficiency in Go and/or Python.

- Strong grounding in core networking, such as transport and application protocols, connection reuse and proxy coordination.

- Full ownership of production systems, including on-call duty.

- A commitment to reliability and comfort working on messy, adversarial problems.

- A preference for shipping, measuring and iterating quickly.

Bonus points

- Experience with monitoring and alerting tools such as Prometheus and Grafana.


Benefits

Compensation and benefits

- Base salary: USD 235,000 to 260,000 per year

- Equity

- Health, dental and vision coverage

- Life and disability insurance

- Paid parental leave

- Flexible time off

- Retirement plan

Location and work model

- San Francisco Bay Area, California, United States

- Hybrid

- Full-time

Skills Required

  • Hands-on production-scale experience building proxy systems or data extraction pipelines operating against hostile website defenses
  • Recent hands-on individual contributor experience working around strong anti-bot protections within the last two years
  • Production experience managing browser and TLS identity signals and automated challenge handling
  • Proficiency in Go and/or Python
  • Strong knowledge of core networking, including transport and application protocols, connection reuse, and proxy coordination
  • Experience owning production systems, including on-call duty
  • Commitment to reliability and comfort solving messy, adversarial problems
  • Experience with monitoring and alerting tools such as Prometheus and Grafana
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
28 Employees
Year Founded: 2021

What We Do

Raydar is a talent acquisition and business consulting firm that connects world-class and emerging talent with growing organizations. It supports companies through team development, strategic hiring, and customized growth solutions, helping clients recruit roles such as engineers, product managers, executives, legal counsel, and quantitative traders. Raydar focuses on understanding each organization’s needs, culture, and long-term goals to build high-impact teams.

Similar Jobs

Rubrik Logo Rubrik

Senior Software Engineer

Artificial Intelligence • Big Data • Cloud • Information Technology • Software • Cybersecurity • Data Privacy
In-Office
Palo Alto, CA, USA
3000 Employees
189K-283K Annually
Hybrid
San Francisco, CA, USA
45 Employees
175K-250K Annually

Kira Learning Logo Kira Learning

Senior Software Engineer

Artificial Intelligence • Information Technology • Software
Hybrid
San Francisco, CA, USA
50 Employees
180K-250K Annually

Vinci4D.ai Logo Vinci4D.ai

Infrastructure Engineer

Hardware • Information Technology • Design
Hybrid
Palo Alto, CA, USA
20 Employees
165K-180K Annually

Similar Companies Hiring

Fora Thumbnail
Agency • On-Demand • Professional Services • Sales • Software • Travel • Hospitality
New York, NY
250 Employees
Energy CX Thumbnail
Greentech • Professional Services • Business Intelligence • Consulting • Energy • Financial Services • Utilities
Chicago, IL
150 Employees
Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account