In this role, you’ll:
- Develop scalable scrapers.
- Define resilient scraping strategies, unblock websites for scrapingImprove observability in the system.
- Develop back-end solutions for scraping & parsing problems of various magnitudes.
- Maintain the current system and develop new features related to scraping & parsing.
Your skills & experience:
- Experience working with Python.
- Understanding of computer science, including data structures, algorithms, computability and complexity.
- Version Control skills using Git.
- Knowledge on how to unblock websites for scraping.
- Is able to use different scraping techniques & open-source tools to build scrapers.
- Is comfortable with using Dev Tools.
- Network (TLS/SSL) knowledge.
- Worked with browser automations.
- Knows their way around asynchronous programming.
Nice to have:
- Web development knowledge.
- Knows how to use CSS Selectors / XPaths for parsing.
- Experience working with Go & C++.
- Worked on browser source code.
- Knowledge of any front-end framework.
- Experience working with Pydantic, FastAPI, SQLAlchemy.
- Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
- Experience with machine learning that is scraping domain-specific.
- Has experience in building scalable systems.
Salary:
- Gross salary: from 5000 eur/month. Keep in mind that we are open to discussing a different salary based on your skills and experience.
Skills Required
- Experience working with Python
- Understanding of computer science, including data structures, algorithms, computability, and complexity
- Version control skills using Git
- Knowledge of techniques for unblocking websites for scraping
- Ability to use different scraping techniques and open-source tools
- Comfort using browser developer tools
- Knowledge of computer networking and TLS/SSL
- Experience with browser automation
- Knowledge of asynchronous programming
- Web development knowledge
- Experience with CSS selectors and XPath
- Experience with Go and C++
- Experience working on browser source code
- Knowledge of a front-end framework
- Experience with Pydantic, FastAPI, and SQLAlchemy
- Experience with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana, Grafana, and Prometheus
- Machine learning experience relevant to web scraping
- Experience building scalable systems
What We Do
Established in 2015, Oxylabs is a web intelligence acquisition solution and premium proxy provider, enabling companies of all sizes to utilize the power of big data. Constant innovation, an extensive patent portfolio, and a focus on ethics have allowed Oxylabs to become a global leader in the web intelligence collection industry and forge close ties with dozens of Fortune Global 500 companies. In 2022 and 2023, Oxylabs was named Europe's fastest-growing web intelligence acquisition company in the Financial Times’ FT 1000 list. Unlocking the power of web intelligence with Oxylabs! As businesses look for ways to create and optimize revenue streams, internal data is being exhausted, forcing companies to turn outwards. Organizations are now competing over external data insights that are fueling the digital economy's growth. Oxylabs proudly stands as a leading force in the web intelligence collection industry. Our innovative and ethical scraping solutions make web intelligence insights accessible to those that seek to become leaders in their own domain. Why choose us? Industry Leaders: As one of the market-leading companies, we offer cutting-edge web scraping solutions backed by the world's largest ethical proxy network. Partnering for success: We view our clients as partners, working hand in hand to maximize the benefits of our collaboration. Your success is our success. Elevate your business with our services: - Market Research: Gain insights that drive informed decisions. - Ad Verification: Ensure real audiences see your ads. - Brand Protection: Safeguard your online reputation. - Travel Fare Aggregation: Optimize travel-related pricing. - SEO Monitoring: Stay ahead in search engine rankings. - Pricing Intelligence: Make data-driven pricing decisions and more. Curious about how Oxylabs can supercharge your business? We're here to help! Drop us a line at [email protected].
