Senior Software Engineer(Scraping)

Posted 14 Days Ago
Be an Early Applicant
Hiring Remotely in Ukraine
Remote
5-7 Years Experience
Software
The Role
Design and implement scalable and efficient services for a web scraping system using Python and relevant libraries. Lead the development team in overcoming anti-scraping measures and mentor junior engineers. Automate scraper development processes, monitor system performance, and apply microservices architecture and Domain-Driven Design principles.
Summary Generated by Built In

In Competera, we are building a place where optimal pricing decisions can be made easily. We believe that AI technologies will soon drive all challenging decisions and are capable of helping humans be better. We are now looking for a Senior Software Engineer to help us turn business ideas into cutting-edge tech solutions that explicitly drive the product and the company towards its strategic direction.
Our stack:
Programming Languages: Python.

Tech Stack: PostgreSQL, asyncio, FastAPI, Apache Kafka, ClickHouse, BigQuery, GCS, Scrapy, Selenium, Pyppeteer

Infrastructure: Kubernetes, Helm, ArgoCD, Grafana, Prometheus, Sentry, OpsGenie.

You could be a perfect match for the position if

You want to:

  • Design and implement scalable and efficient services for a web scraping system using Python and relevant libraries.
  • Lead the development team in overcoming anti-scraping measures such as CAPTCHAs, rate limiting, and dynamic content loading.
  • Mentor and guide junior engineers in the team, fostering their growth and development.
  • Automate existing scraper development processes using tools and frameworks to improve efficiency and maintainability.
  • Monitor system performance and proactively identify and address any issues.
  • Design and implement microservices architecture for modularity and scalability.
  •  Apply Domain-Driven Design (DDD) principles to ensure clean and maintainable code.
  • Stay up-to-date with the latest advancements and best practices in web scraping.

You have: 

  • 5+ years of experience as a Software Engineer with a strong track record in web scraping.
  • Proven expertise in Python and relevant libraries like Scrapy, Selenium, Pyppeteer, Playwright.
  • In-depth understanding of web protocols and how modern web works (SSL, proxies, cookies, headers, browsers).
  • Experience with anti-scraping detection and bypass techniques.
  • Experience with Kafka, Redis, and microservices architecture.
  • Familiarity with Domain-Driven Design (DDD) principles.
  • Eng - interm +

Pleasant extras:

  • Experience with cloud platforms like AWS or GCP.
  • Experience with data quality and cleaning techniques.
  • Knowledge of machine learning and data analysis techniques.

Soft skills:

  • Ability to lead and mentor junior engineers in overcoming technical challenges.
  • Proactive approach to identifying and solving problems, seeking out new opportunities.
  • Ability to work independently and as part of a team in a fast-paced environment.
  • Ability to learn new technologies and adapt to changing web scraping landscapes.

You’re gonna love it, and here’s why:

  • Rich innovative software stack, freedom to choose the best suitable technologies.
  • Remote-first ideology: freedom to operate from the home office or any suitable coworking.
  • Flexible working hours (we start from 8 to 11 am) and no time tracking systems on.
  • Regular performance and compensation reviews.
  • Recurrent 1-1s and measurable OKRs.
  • In-depth onboarding with a clear success track.
  • Competera covers 70% of your training/course fee.
  • 20 vacation days, 15 days off, and up to one week of paid Christmas holidays.
  • 20 business days of sick leave.
  • Partial medical insurance coverage.
  • We reimburse the cost of coworking. 


Drive innovations with us. Be a Competerian.

Top Skills

Python
The Company
HQ: West Hollywood, CA
70 Employees
On-site Workplace
Year Founded: 2014

What We Do

We at Competera don't believe in luck when it comes to pricing. That's why we deliver last-gen solutions to retailers across the globe to help them set optimal prices and increase customer trust.

Our robust deep learning algorithms continuously calculate and re-quantify billions of possible price combinations so that the enterprise clients' can increase their gross margin by 6%.

Competera ensures high matching quality with up to 98% accuracy and delivers optimal price recommendations based on 20+ pricing and non-pricing factors.

Our mission is to automate pricing and make it more effective. We help pricing specialists focus on meaningful tasks rather than waste time on routine calculations.

By choosing Competera, retailers opt for innovative solutions to deal with current challenges and adapt to new market demands!

Jobs at Similar Companies

Cencora Logo Cencora

Engineer II - Quality & Testing (IN)

Healthtech • Logistics • Software • Pharmaceutical
Pune, Maharashtra, IND
46000 Employees
Louisville, CO, USA
69 Employees
80K-134K Annually

Similar Companies Hiring

TrainHeroic (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
23 Employees
TrainingPeaks (A Peaksware Company) Thumbnail
Software • Fitness
Louisville, CO
69 Employees
Cencora Thumbnail
Software • Pharmaceutical • Logistics • Healthtech
Conshohocken, PA
46000 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account