Software Engineer – Web Crawling

Job Posted 8 Days Ago Posted 8 Days Ago
Hiring Remotely in USA
Remote
Mid level
Machine Learning • Marketing Tech • Software
The Role
The Software Engineer will develop and maintain web crawlers, optimize scraping techniques, and collaborate with a distributed team to ensure data reliability and integration of AI solutions.
Summary Generated by Built In

Woflow is a technology startup creating products and solutions to support a high-growth, on-demand economy. Our flagship product is an end-to-end platform that allows our customers to request and receive merchant data (think structured menu data, images, store information, etc) through a combination of web applications and public APIs. Behind the scenes, that data is created through a series of ML/AI models and workflow products along with a fully automated distributed workforce management platform. We are the world’s first Merchant Data Platform.

Our customers include food delivery companies, online ordering platforms, and ecommerce marketplaces. We provide the data infrastructure to help these companies scale and grow.

About the Role

We are looking for a Software Engineer with at least 3 years of experience to join our Web Crawling team. This team plays a critical role in our infrastructure, ensuring high-quality data collection at scale. The right candidate will work closely with both the Web Crawling and Application teams but will primarily focus on writing and optimizing web crawlers.

Our ideal candidate is someone who enjoys solving complex web scraping challenges, has strong reverse engineering skills, and thrives in a fast-paced, high-growth environment. This role is a great opportunity for an engineer looking to make a significant impact at a company where data is the product.

What You’ll Do

  • Develop, enhance, and maintain web crawlers and scraping infrastructure.

  • Optimize scraping techniques to handle anti-bot mechanisms, performance, and security challenges.

  • Collaborate with a geographically distributed team to identify and resolve issues.

  • Ensure high availability, efficiency, and reliability of crawling operations.

  • Integrate AI solutions to enhance automation and data extraction accuracy.

What We’re Looking For

  • 3+ years of experience in software engineering with a focus on web crawling and data extraction.

  • Strong expertise in Node.js (preferred) for web crawling applications.

  • Deep understanding of HTML, JavaScript, and reverse engineering techniques.

  • Hands-on experience with Playwright, Puppeteer, and Cheerio for automation and scraping.

  • Knowledge of security and performance best practices related to web crawling.

Nice to Have

  • Experience with Apify or Crawlee for large-scale crawling solutions.

  • Proficiency in TypeScript.

Benefits:

  • Unlimited PTO (we mean it!)

  • Comprehensive medical, dental, and vision insurance plans

  • STD, LTD, AD&D, and life insurance coverage

  • Free membership to TalkSpace, Teladoc and Health Advocate

  • Free annual membership to One Medical in participating regions

  • 401(k) retirement plan with company matching

  • Pre-tax commuter benefits

  • Free equipment: laptop and home office stipend

*Please note: the only valid application forms are via woflow.com and jobs.ashbyhq.com/woflow

Top Skills

Apify
Cheerio
Crawlee
HTML
JavaScript
Node.js
Playwright
Puppeteer
Typescript
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: San Francisco, CA
204 Employees
Hybrid Workplace
Year Founded: 2017

What We Do

Woflow automates merchant data onboarding for the world's fastest growing platforms and marketplaces. Food ordering apps, POS systems and eCommerce companies trust our data infrastructure to manage their merchant data at scale.

Woflow's technology is powered by the Woflow Engine, a sophisticated ML-powered task automation system that structures data from anywhere.

Woflow has raised over $10M to date and is backed by top investors including Base 10 Partners, Craft Ventures and Construct Capital.

Similar Jobs

Accuris Logo Accuris

Remote SAP Solution Architect

Information Technology • Machine Learning • Software • Conversational AI • Generative AI • Manufacturing
Remote
CO, USA
1200 Employees
170K-210K Annually

Samsara Logo Samsara

Senior Software Engineer I - Mobile Platform

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote
United States
2800 Employees
126K-212K Annually

Samsara Logo Samsara

Senior Software Engineer II - Mobile Platform

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote
United States
2800 Employees
150K-253K Annually

Liftoff Logo Liftoff

Staff Software Engineer, Infrastructure Team

AdTech • Big Data • Machine Learning • Marketing Tech • Mobile • Software
Easy Apply
Remote
3 Locations
645 Employees

Similar Companies Hiring

True Anomaly Thumbnail
Software • Machine Learning • Hardware • Defense • Artificial Intelligence • Aerospace
Colorado Springs, CO
131 Employees
Caliola Engineering Thumbnail
Software • Machine Learning • Hardware • Defense • Data Privacy • App development • Aerospace
Colorado Springs, CO
53 Employees
Red 6 Thumbnail
Virtual Reality • Software • Hardware • Defense • Aerospace
Orlando, Florida
113 Employees
By clicking Apply you agree to share your profile information with the hiring company.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account