Web Scraping Engineer

Posted 21 Days Ago
Be an Early Applicant
Vilnius, Vilniaus miesto savivaldybė, Vilniaus apskritis, LTU
Hybrid
4K-7K Annually
Mid level
Big Data • Information Technology
Oxylabs is a web intelligence collection platform, enabling companies worldwide to unlock the power of big data.
The Role
Build and maintain high-scale web crawlers, scrapers, parsers, and supporting infrastructure handling millions of requests. Own client projects end to end, develop reusable Python or Go solutions, integrate with data platforms, and adapt internal tools to changing requirements. Perform code reviews, justify technical decisions, and collaborate with the team. Experience with web scraping, headless browsers, databases, cloud hosting, and AI-assisted development is expected; data engineering experience is beneficial.
Summary Generated by Built In

Enterprise-grade web data infrastructure, purpose-built for organizations operating at global scale. It helped define what public web data access could look like and still sets the standard others build against. 
That same ambition runs through the culture: engineers take ownership of problems no one else has solved and push each other to raise the bar.


The team waiting for you:
The Web Intelligence team is responsible for building and delivering large-scale, custom datasets for clients who need end-to-end scraping solutions. As a Web Scraping Engineer, you will jump right into building high-scale crawlers and parsers, bringing strong Python or Go skills to our primarily data engineering-focused group. With a rapidly growing influx of project-based requests, we need someone who can take immediate ownership and leverage AI tools to build solutions from scratch. Your main challenge will be navigating a fast-paced environment where speed and delivery are prioritized over absolute perfection.

In this role, you will:

    • Design and build high-scale crawlers, scrapers, and the surrounding infrastructure capable of handling thousands to millions of requests.
    • Take client requirements and own projects end-to-end, building custom solutions from scratch without waiting for detailed specifications.
    • Write functional, reusable code in Python or Go, heavily leveraging AI-driven IDEs to maximize output and efficiency.
    • Work within our data platform to enable the seamless building and delivery of large datasets.
    • Use internal scraping tools or build new ones as priorities and client routes change.
    • Justify technical decisions, perform code reviews, and collaborate closely with the team to ensure quality solutions.

Your skills & experiences:

    • Multiple years of backend development experience with Python or Go (or strong web scraping expertise driven by AI tools).
    • Familiarity with web scraping fundamentals, parsing, headless browsers, and databases like PostgreSQL or BigQuery.
    • High level of independence—you can align on an approach in a discussion and then fully own the delivery.
    • A business-first mentality that prioritizes speed and delivery over perfection, with a "thick skin" for direct feedback.
    • Hands-on experience and a strong comfort level with AI-driven development tools (such as Cursor, Claude Code, or Antigravity).

Nice to have:

    • Experience in data engineering: ETL/ELT pipelines, Spark, Airflow, Dagster, etc.

Tech stack:

    • Python, Go
    • Databases: PostgreSQL, BigQuery
    • Hosting: Google Cloud, Hetzner, private cloud
    • Scraping tools: Playwright, internal APIs, Camoufox, headless browsers
    • Data Engineering: Airflow
    • AI tools: Claude Code, Cursor

Salary & Benefits

    • Gross salary: 4400 - 7000 EUR/month. Keep in mind that we are open to discuss a different salary based on your skills and competencies.
    • Growth & Learning: 40+ internal learning options, external conferences, mentorship, and year-round knowledge-sharing.
    • Health & Well-being: Private health insurance, psychotherapy, on-site well-being consultants, 24/7 gym access, and a wellness app.
    • Celebration & Community: Team events, an overseas workation, quarterly team-building budgets, and plenty of ways to mark milestones together.
    • Plus bonus vacation days, paid life-moment days off, barista coffee, and all the tools you need. See the full list of benefits here: https://career.oxylabs.io/blog/our-work-benefits/

Oxylabs is part of Source, a data ecosystem for a world built on intelligence. One of five independent technology companies connected by shared standards, expertise, and a belief in responsible access to web data.
 
Up for the challenge? Let’s talk! 

Skills Required

  • Multiple years of backend development experience with Python or Go, or strong web scraping expertise using AI tools
  • Familiarity with web scraping fundamentals and parsing
  • Experience with headless browsers
  • Familiarity with PostgreSQL or BigQuery
  • Ability to work independently and own delivery end to end
  • Business-first mentality prioritizing speed and delivery
  • Comfort with direct feedback
  • Hands-on experience with AI-driven development tools such as Cursor, Claude Code, or Antigravity
  • Experience with data engineering, ETL/ELT pipelines, Spark, Airflow, or Dagster
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Vilniaus miesto, Lithuania
500 Employees
Year Founded: 2015

What We Do

Established in 2015, Oxylabs is a web intelligence acquisition solution and premium proxy provider, enabling companies of all sizes to utilize the power of big data. Constant innovation, an extensive patent portfolio, and a focus on ethics have allowed Oxylabs to become a global leader in the web intelligence collection industry and forge close ties with dozens of Fortune Global 500 companies. In 2022 and 2023, Oxylabs was named Europe's fastest-growing web intelligence acquisition company in the Financial Times’ FT 1000 list. Unlocking the power of web intelligence with Oxylabs! As businesses look for ways to create and optimize revenue streams, internal data is being exhausted, forcing companies to turn outwards. Organizations are now competing over external data insights that are fueling the digital economy's growth. Oxylabs proudly stands as a leading force in the web intelligence collection industry. Our innovative and ethical scraping solutions make web intelligence insights accessible to those that seek to become leaders in their own domain. Why choose us? Industry Leaders: As one of the market-leading companies, we offer cutting-edge web scraping solutions backed by the world's largest ethical proxy network. Partnering for success: We view our clients as partners, working hand in hand to maximize the benefits of our collaboration. Your success is our success. Elevate your business with our services: - Market Research: Gain insights that drive informed decisions. - Ad Verification: Ensure real audiences see your ads. - Brand Protection: Safeguard your online reputation. - Travel Fare Aggregation: Optimize travel-related pricing. - SEO Monitoring: Stay ahead in search engine rankings. - Pricing Intelligence: Make data-driven pricing decisions and more. Curious about how Oxylabs can supercharge your business? We're here to help! Drop us a line at [email protected].

Similar Jobs

Oxylabs Logo Oxylabs

Web Scraping Engineer - Python (Mid/Senior)

Big Data • Information Technology
Hybrid
Vilnius, Vilniaus miesto savivaldybė, Vilniaus apskritis, LTU
500 Employees
42K-73K Annually

SearchApi Logo SearchApi

Ruby Engineer - Web Scraping (Remote)

Information Technology • Software
In-Office or Remote
59 Locations
5 Employees

Pfizer Logo Pfizer

Platform Engineer

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
Remote or Hybrid
33 Locations
121990 Employees

Airwallex Logo Airwallex

Operations Manager

Artificial Intelligence • Fintech • Payments • Business Intelligence • Financial Services • Generative AI
Hybrid
Vilnius, Vilniaus miesto savivaldybė, Vilniaus apskritis, LTU
2300 Employees

Similar Companies Hiring

Axle Health Thumbnail
Artificial Intelligence • Healthtech • Information Technology • Logistics
Santa Monica, CA
25 Employees
NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Sydney, AU
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account