About Us
At Zyte, we eat data for breakfast and you can eat your breakfast anywhere and work for Zyte. Founded in 2010, we are a globally distributed team of over 250 Zytans working from over 28 countries who are on a mission to enable our customers to extract the data they need to continue to innovate and grow their businesses. We believe that all businesses deserve a smooth pathway to data.
For more than a decade, Zyte has led the way in building powerful, easy-to-use tools to collect, format, and deliver web data, quickly, dependably, and at scale. And today, the data we extract helps thousands of organizations make smarter business decisions, secure competitive advantage, and drive sustainable growth. Today, over 3,000 companies and 1 million developers rely on our tools and services to get the data they need from the web.
About the job:
As a Senior DevOps engineer you'll work with a small team of engineers dedicated to maintain, grow and constantly improve our Platform infrastructure.
This team's responsibilities are key to keeping our core infrastructure up and running 24/7 without glitches, and takes care of all the infrastructure supporting our internal applications which accounts for a very broad and large set of technologies. While we don't expect you to know all technologies as you step in, we need you to be comfortable working with all our stack, which includes: Apache Mesos, Kubernetes, HAProxy, Nginx, Consul, Percona XtraDB cluster, RabbitMQ, Apache Kafka, ELK, Prometheus/Grafana, Hadoop/HBase, ProxySQL and others.
As a Senior DevOps Engineer you'll be working closely with developers to transform and migrate to our next generation infrastructure.
This team is mainly responsible for all the underlying infrastructure of our Platform which runs on rented bare metal servers on prem. One of our largest clusters contains more than 150 worker nodes so automation and tooling to support/maintain it is a must.
Open Source is in our DNA and we embrace it as much as possible within our toolkit.
Roles & Responsibilities:
- Improve and maintain our Platform infrastructure to meet the expectations from other technical teams and their associated stakeholders.
- Plan, build and execute legacy infrastructure migrations.
- Provide recommendations and solutions for existing Platform infrastructure to improve reliability, security and performance.
- Proactively ensure our Platform runs with minimal interruptions.
- Creatively solve scalability challenges in a rapidly expanding cloud & on prem environment.
- Help improve monitoring and identify key performance metrics.
- Proactive research and development, discovering and implementing new tools, emerging technology, etc.
- Own assigned trouble cases, managing and keeping up with all cases assigned, follow up and resolve cases in accordance with SLAs.
- Troubleshooting and resolution of server/network and application issues.
- 5+ years experience working as a DevOps engineer at reasonable scale (hundreds of systems) and designing/deploying ‘highly available’ solutions.
- Experience and demonstrated knowledge with: Apache Mesos/Marathon, HAProxy, Nginx, Percona XtraDB/MySQL clusters, Salstack
- Bonus points for: Kubernetes, RabbitMQ, ELK, Prometheus, Grafana, Hadoop/HBase, ProxySQL and CircleCI.
- Proficiency on these programming languages: Python and Bash/Shell scripting. Bonus points for Golang/Java experience.
- Experience running microservice applications on containers.
- Highly organized, able to multitask, able to work individually, as well as within a team, and across teams.
- Strong oral and written communication skills in English.
- Flexibility around working hours - if there is an issue you should use your initiative and help resolve it.
- Maintaining and respecting confidentiality of large amounts of information you have access to.
- Quick and avid learner of previously unknown technologies/stacks.
By joining the Zyte team, you will:
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom & flexibility to work remotely.
- Get the chance to work with cutting-edge open source technologies and tools.
- Allocated hours for Open Source contributions
- 35 paid time off per year.
Similar Jobs
What We Do
At Zyte, we’re all about empowering data-driven organizations to ethically and accurately collect web data to power their business. With over 14 years experience and our early authorship and ongoing maintenance of Scrapy, we’ve shaped the web scraping industry from Day 1.
We help our clients…
- With easy-to-use ways to collect, format and deliver web data, quickly, dependably and at scale,
- Spend more time gleaning insights from highly accurate, business-critical data, and
- Spend less money on the total cost of ownership in web data extraction.
Zyte API abstracts away a historically disparate web data extraction tech stack into a single tool. Zyte API automates most anti-bot and proxy management, so developers can spend more time on strategy.
Zyte API is a full-stack solution that crawls, unblocks and extracts data in minutes with the power of AI. Developers skip the hassle of creating manual parsing code and extract public data at unlimited scale.
Zyte Data is an expert web data extraction team in your pocket. Our white glove service extracts any web data your business needs, regardless of project size and complexity. This includes a dedicated team and round-the-clock support.
Zyte’s legal team is our backbone and is made up of the leading minds in web data extraction compliance. They stay on top of the ever-changing and opaque laws that loom over the industry. They evaluate compliance risks and inform customers about best practices.
Zyte is certified by and a co-founder of the Ethical Web Data Collection Initiative (EWDCI) which recognizes web data providers operating with the highest level of ethical and legal standards.
Come work for us!
We encourage a flexible and diverse work environment, so we embraced the benefits of remote work from our very early beginnings. Our team includes over 200 employees in over 30 countries. All sharing the same drive, to do more with web data.
