Senior Data Acquisition Engineer at JoomPulse

Posted 12 Hours Ago
Be an Early Applicant
Lisbon, PRT
In-Office
Senior level
Artificial Intelligence • eCommerce • Logistics
The Role
Own and develop production-grade distributed crawlers for Mercado Livre, Shopee, and other marketplaces. Build scalable, observable acquisition pipelines; reverse engineer private APIs; monitor anti-bot changes; develop bypass and behavioral simulation logic; manage proxies, queues, alerts, and failure recovery. Use LLMs and experimental techniques to solve novel data acquisition challenges, identify valuable product data, and collaborate with an international team.
Summary Generated by Built In

JoomPulse is an AI analytics tool for Mercado Livre and Shopee sellers, providing insights into the most profitable products and fastest-growing categories — helping sellers boost their profits with data-driven decisions.

JoomPulse is one of the key businesses of Joom Group, an international tech-centric group of e-commerce companies that was founded in 2016 in Latvia. Joom Group also includes the following businesses: Joom, a global cross-border marketplace; JoomPro, the first and only end-to-end cross-border B2B marketplace; and Onfy, a pharmaceutical marketplace in Germany. Joom Group has offices in Latvia, China, Germany, and Brazil, with its headquarters in Lisbon, Portugal. We work as one international team, sharing knowledge and collaborating across countries, businesses and products.

We are looking for an experienced Senior Data Acquisition Engineer who will own the data acquisition pipelines behind JoomPulse analytics. Marketplaces keep raising their anti-bot defences, so this is a role about solving problems that have no ready answers yet — hands-on, experimental, and with full freedom in tooling.

Responsibilities

  • Own and develop the scraping of Mercado Livre, the main data source behind JoomPulse, and extend it to new marketplaces such as Shopee
  • Build and maintain distributed crawlers running in production
  • Monitor target marketplaces for changes, detect them early and update bypass logic proactively
  • Reverse engineer private APIs to get data faster and more reliably than through HTML
  • Keep crawlers scalable and observable: distributed queues, success-rate monitoring, alerting on anti-bot regressions
  • Investigate pipeline failures caused by new anti-bot checks and restore the data flow
  • Use LLMs and any other tooling to research and solve problems that have no ready answers
  • Spot data that can be useful for the product and bring these insights to the team

Requirements
  • 3+ years of building distributed crawlers running in production
  • Strong Python (Scrapy / Playwright) or Node.js (Puppeteer / Crawlee)
  • Behavioral simulation: human-like mouse trajectories, realistic timing, scroll and click patterns, bypassing behavioral biometrics
  • Security research mindset: monitoring target sites for changes, change detection, proactive updates of bypass logic
  • Experience with proxy infrastructure: residential, mobile, ISP, and rotating proxies
  • Reverse engineering of private APIs via mitmproxy, Charles, or Burp
  • Scaling crawlers on distributed queues: Redis, Kafka or SQS
  • Active use of LLMs and an experimental mindset — you try every available tool until the result is there
  • Proactivity: you notice useful data and bring it yourself, without a detailed specification
  • English sufficient for daily work in an international team

Preferred

  • Direct experience with Mercado Livre, Amazon, Shopee or TikTok Shop
  • Public GitHub: marketplace crawlers, or contributions to Scrapy, Playwright, curl-impersonate, undetected-chromedriver
  • Experience with anti-detect browsers and stealth tooling: Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, tls-client
  • Experience running a project end-to-end or managing other engineers

Benefits
  • Compensation package: base salary and performance-based bonuses
  • Office-first: flexible hours with the possibility to work remotely 52 days per year, and 22 days of paid annual leave
  • Care & Wellbeing: health insurance (including dental care) for employees and their children, daily meal allowance, and 100% paid sick leave
  • AI-first approach: licenses and access to a wide range of AI tools
  • Team & Growth: collaboration with colleagues across Portugal, Brazil, Latvia and China, with opportunities for promotions, professional training, and English courses
  • Community & Engagement: annual team-building activities, knowledge-sharing workshops, and a strong sense of teamwork

Before applying for the above position, please review our Candidate Privacy Notice here: https://legal.joom.com/recruitment/Joom_Unipessoal_LDA_Job_Applicant_Privacy_Notice.pdf
By responding to the vacancy, you acknowledge that you have read our Privacy Notice.

Skills Required

  • 3+ years of building distributed crawlers running in production
  • Strong Python with Scrapy or Playwright, or Node.js with Puppeteer or Crawlee
  • Experience with behavioral simulation, including human-like mouse trajectories, realistic timing, scrolling, clicking, and bypassing behavioral biometrics
  • Security research mindset involving site monitoring, change detection, and proactive bypass updates
  • Experience with residential, mobile, ISP, and rotating proxy infrastructure
  • Reverse engineering private APIs using mitmproxy, Charles, or Burp
  • Experience scaling crawlers with distributed queues such as Redis, Kafka, or SQS
  • Active use of LLMs and an experimental problem-solving mindset
  • Proactivity in identifying useful data without detailed specifications
  • English sufficient for daily work in an international team
  • Direct experience with Mercado Livre, Amazon, Shopee, or TikTok Shop
  • Public GitHub featuring marketplace crawlers or contributions to Scrapy, Playwright, curl-impersonate, or undetected-chromedriver
  • Experience with anti-detect browsers and stealth tooling such as Multilogin, GoLogin, Kameleo, puppeteer-extra-stealth, curl-impersonate, or tls-client
  • Experience running a project end-to-end or managing other engineers
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
500 Employees
Year Founded: 2016

What We Do

Joom is an international commerce technology group operating a global consumer marketplace and a suite of business-to-business trade services. Its marketplace connects cross-border merchants and suppliers with consumers, especially in Europe. For businesses, Joom provides sourcing and importing, marketplace analytics, financing, and logistics-related services, using trade data and AI to support cross-border commerce. The group’s mission is to make global trade more efficient, transparent, and accessible through technology.

Similar Jobs

Bose Logo Bose

Scientist

Automotive • eCommerce • Hardware • Music • Retail • Software • Wearables
Remote or Hybrid
Lisbon, PRT
2900 Employees
165K-228K Annually

Takeda Logo Takeda

Project Manager

Healthtech • Software • Analytics • Biotech • Pharmaceutical • Manufacturing
Hybrid
Lisbon, PRT
50000 Employees
38K-52K Annually

Qualtrics Logo Qualtrics

Paralegal

Artificial Intelligence • HR Tech • Information Technology • Software • Business Intelligence
Remote or Hybrid
27 Locations
7500 Employees

Navan Logo Navan

Consultant

Fintech • Information Technology • Payments • Productivity • Software • Travel • Automation
Easy Apply
Remote or Hybrid
Portugal
3300 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
85 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account