About Us:
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data.
For over a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
About the role:
You would be involved in developing our recently released SaaS offering - Zyte API, which provides a single ML-powered API to power all web data extraction use cases.. Zyte API is a distributed application written in Java, C++, Python and Nodejs components communicating via HTTP, web sockets and Apache Kafka, and orchestrated using Kubernetes.
Roles & Responsibilities:
- Work on the core platform that will improve and scale the platform to achieve 100k QPS and beyond. .
- Develop and troubleshoot distributed applications, write and change components implemented in Java, Scala and Nodejs and manage concerns such as scalability, transparency, failure handling, security and multi-tenancy.
- Work on new features, including requirements gathering, design and implementation. You should be able to own and be responsible for the complete lifecycle of your features and code.
Requirements
- 5+ years of experience building large scale data processing systems or high load services
- Strong background in algorithms and data structures.
- Strong track record in Java with 3+ years of experience.
- Knowledge of networking protocols and network programming.
- Strong knowledge of any event-driven (Event loop, future and reactor patterns) framework.
- Strong knowledge of at least one RDBMS.
- Experience working with Linux and Docker.
- Good communication skills in English.
- Experience of collaboration in a remote-first team.
- Computer Science, other engineering degree or equivalent working experience
Bonus points for:
- Kubernetes experience
- Experience in Netty and/or Vert.x
- Knowledge of JNI
- Strong foundational understanding of functional programming paradigm and 2+ years of experience working in Erlang, Scala or Haskell.
- Experience with service chassis and template-based approaches for building and scaling services.
- Apache Kafka experience
- Understanding of web browser internals
- Knowledge of today's cloud provider offerings: GCP, AWS, OCI etc.
- Web data extraction experience: web crawling, web scraping.
- History of open source contributions
Benefits
As a new Zytan, you will:
Become part of a self-motivated, progressive, multicultural team.
Have the freedom and flexibility to work from where you do your best work.
Attend conferences and meet with team members from across the globe.
Work with cutting-edge open-source technologies and tools.
Top Skills
What We Do
At Zyte, we’re all about empowering data-driven organizations to ethically and accurately collect web data to power their business. With over 14 years experience and our early authorship and ongoing maintenance of Scrapy, we’ve shaped the web scraping industry from Day 1.
We help our clients…
- With easy-to-use ways to collect, format and deliver web data, quickly, dependably and at scale,
- Spend more time gleaning insights from highly accurate, business-critical data, and
- Spend less money on the total cost of ownership in web data extraction.
Zyte API abstracts away a historically disparate web data extraction tech stack into a single tool. Zyte API automates most anti-bot and proxy management, so developers can spend more time on strategy.
Zyte API is a full-stack solution that crawls, unblocks and extracts data in minutes with the power of AI. Developers skip the hassle of creating manual parsing code and extract public data at unlimited scale.
Zyte Data is an expert web data extraction team in your pocket. Our white glove service extracts any web data your business needs, regardless of project size and complexity. This includes a dedicated team and round-the-clock support.
Zyte’s legal team is our backbone and is made up of the leading minds in web data extraction compliance. They stay on top of the ever-changing and opaque laws that loom over the industry. They evaluate compliance risks and inform customers about best practices.
Zyte is certified by and a co-founder of the Ethical Web Data Collection Initiative (EWDCI) which recognizes web data providers operating with the highest level of ethical and legal standards.
Come work for us!
We encourage a flexible and diverse work environment, so we embraced the benefits of remote work from our very early beginnings. Our team includes over 200 employees in over 30 countries. All sharing the same drive, to do more with web data.
