Senior Big Data Engineer

Posted Yesterday
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Senior level
Information Technology • Security • Cybersecurity
The Role
Design, build, and operate high-throughput data platform components and pipelines using Spark and Kafka. Debug, tune, and optimize jobs for massive transaction volumes, collaborate on architecture and standards, and mentor junior engineers.
Summary Generated by Built In

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!

Senior Big Data Engineer

Job Description: We are seeking a Senior Big Data Engineer to design, build, and operate core components of the data platform and pipeline architecture behind Qualys' Enterprise TruRisk Platform, processing billions of daily transactions.

Responsibilities:

  • Design, build, and maintain high-throughput data platform and pipeline components using Spark and Kafka.
  • Debug, tune, and optimize Spark jobs and Kafka pipelines to manage growing data volumes.
  • Collaborate with product, professional services, and sales engineering teams on architecture design and technical trade-offs.
  • Establish and refine technical standards, system documentation, and best practices across the engineering team.
  • Mentor junior and mid-level engineers on complex technical issues and pipeline performance.

Required Qualifications:

  • Minimum 5 years of experience in data engineering or big data platform development.
  • Bachelor's degree in Computer Science, Computer Engineering, or a related technical field.
  • Demonstrated experience designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka.
  • Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads.

Preferred Qualifications:

  • Experience working with high-volume, multi-tenant enterprise platform environments.
  • Proficiency in Scala, Java, or Python for data processing applications.
  • Proven experience mentoring junior or mid-level engineering team members.

Skills Required

  • Minimum 5 years of experience in data engineering or big data platform development
  • Bachelor's degree in Computer Science, Computer Engineering, or a related technical field
  • Designing, building, and optimizing distributed pipelines using Apache Spark and Apache Kafka
  • Hands-on experience scaling data platform infrastructure to process high-volume/high-throughput transaction workloads
  • Experience working with high-volume, multi-tenant enterprise platform environments
  • Proficiency in Scala, Java, or Python for data processing applications
  • Proven experience mentoring junior or mid-level engineering team members

Qualys Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Qualys and has not been reviewed or approved by Qualys.

  • Affordable Benefits Benefits costs are widely viewed as low for employees and dependents, with healthcare often described as almost fully paid for. Feedback suggests this affordability helps offset perceptions of lower base pay in some roles.
  • Healthcare Strength Healthcare offerings are broad, including multiple medical plan options, dental and vision coverage, mental health support, and disability insurance. Benefits are described as “pretty amazing” or “great,” reinforcing perceived quality and coverage depth.
  • Equity Value & Accessibility Equity participation is accessible through company stock plans and an employee stock purchase plan. Compensation packages commonly include equity alongside salary and bonus, which some consider a meaningful part of total rewards.

Qualys Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Foster City, CA
2,736 Employees
Year Founded: 1999

What We Do

Qualys, Inc. (NASDAQ: QLYS) is a pioneer and leading provider of disruptive cloud-based security, compliance and IT solutions with more than 10,000 subscription customers worldwide, including a majority of the Forbes Global 100 and Fortune 100. Qualys helps organizations streamline and automate their security and compliance solutions onto a single platform for greater agility, better business outcomes, and substantial cost savings. The Qualys Cloud Platform leverages a single agent to continuously deliver critical security intelligence while enabling enterprises to automate the full spectrum of vulnerability detection, compliance, and protection for IT systems, workloads and web applications across on premises, endpoints, servers, public and private clouds, containers, and mobile devices. Founded in 1999 as one of the first SaaS security companies, Qualys has strategic partnerships and seamlessly integrates its vulnerability management capabilities into security offerings from cloud service providers, including Amazon Web Services, the Google Cloud Platform and Microsoft Azure, along with a number of leading managed service providers and global consulting organizations. For more information, please visit http://www.qualys.com

Similar Jobs

Citi Logo Citi

Big Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Citi Logo Citi

Big Data Engineer

Fintech • Financial Services
In-Office
Pune, Mahārāshtra, IND
223850 Employees

Qualys Logo Qualys

Big Data Engineer

Information Technology • Security • Cybersecurity
In-Office
Pune, Mahārāshtra, IND
2736 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account