Lead Software Engineer - Performance

Posted 4 Days Ago
Be an Early Applicant
Pune, Mahārāshtra, IND
In-Office
Senior level
Information Technology • Security • Cybersecurity
The Role
Lead performance engineering for a real-time, large-scale data platform: design and run performance tests, identify bottlenecks, tune Spark, Kafka, Elasticsearch, microservices, build test frameworks integrated with CI/CD, create dashboards, and collaborate with engineering and infra teams to meet SLAs and optimize cost.
Summary Generated by Built In

Come work at a place where innovation and teamwork come together to support the most exciting missions in the world!

Job Description Summary :
We are seeking a talented Lead Software Engineer – Performance to deliver roadmap features of Unified Asset Inventory ETM Platform which would help customers to Measure, Communicate and Eliminate Cyber Risks.  

You will lead the performance engineering efforts across Java microervice, Spark, Kafka, Elasticsearch, and Middleware APIs, ensuring that our real-time data pipelines and services meet enterprise-grade SLAs. 

As part of our high-performing engineering team, you will design and execute performance testing strategies, identify system bottlenecks, and work with development teams to implement performance improvements that support billions of cyber security events processing in a day across our data platform. 
 

Responsibilities: 

  • Own the performance strategy across distributed systems which includes Spring Boot microservices, Hadoop, Spark, Kafka, Elasticsearch/OpenSearch, Big Data Components and APIs for each release. 
  • Strong expertise in performance engineering, including analysis of Heap Dumps, Thread Dumps, GC Logs, and CPU Profiling Reports; hands-on experience with Apache JMeter, AppDynamics, Grafana, and Prometheus; and deep understanding of JVM Architecture, Garbage Collection, Threading, and Concurrency.
  • Define, develop, and execute performance test plans, load tests, stress tests, and soak tests. 
  • Create realistic performance test scenarios for data pipelines and microservices based on production-like workloads. 
  • Proactively identify bottlenecks, resource contention, and latency issues using tools such as JMeter, Spark UI, Kafka Manager, Elastic Monitoring and App Dynamics. 
  • Provide deep-dive analysis and recommendations on tuning and scaling Spark jobs, Kafka topics/partitions, ES queries, and API endpoints. 
  • Collaborate with developers, architects, and infrastructure teams to integrate performance feedback into design and implementation. 
  • Simulate and benchmark real-time and batch data flow at scale using synthetic and production-like datasets and own this framework end to end for synthetic data generator. 
  • Lead the initiative to build a performance testing framework that integrates with CI/CD pipelines. 
  • Establish and track SLAs for throughput, latency, CPU/memory utilization and Garbage collection. 
  • Create performance dashboards and visualization using Prometheus/Grafana, Kibana, or equivalent. 
  • Document performance test findings and create technical reports for leadership and engineering teams. 
  • Recommend performance optimization to Dev and Platform groups. 
  • Responsible for optimizing the overall cost. 
  • Contribute to feature development and fixes apart from performance benchmarking. 

Qualifications

  • Bachelor's degree in computer science, Engineering, or related field. 
  • 8+ years of overall experience in distributed systems and backend performance engineering. 
  • 4+ years of JAVA development experience with Microservices architecture.   
  • Proficient in scripting (Python, Bash) for automation and test data generation. 
  • 4+ years of hands-on experience with Apache Spark – performance tuning, memory management, and DAG optimization. 
  • 3+ years of experience with Kafka – topic optimization, producer/consumer tuning, and lag monitoring. 
  • 3+ years of experience with Elasticsearch/OpenSearch – query profiling, indexing strategies, and cluster optimization. 
  • 3+ years of experience with performance testing tools such as JMeter or similar. 
  • Excellent programming and designing skills and Hands-on experience on Spring, Hibernate. 
  • Deep understanding of middleware and microservices performance including REST APIs. 
  • Strong knowledge of profiling, debugging, and observability tools (e.g., Spark UI, Athena, Grafana, ELK). 
  • Experience designing and running benchmarks at scale for high-throughput environments in PBs. 
  • Experience with containerized workloads and performance testing in Kubernetes/Docker environments. 
  • Solid understanding of cloud-native architecture (OCI) and distributed systems design. 
  • Strong knowledge of Linux operating systems and performance related improvements. 
  • Familiarity with CI/CD integration for performance testing (e.g., Jenkins, GitHub). 
  • Knowledge of data lake architecture, caching solutions, and message queues. 
  • Strong communication skills and experience influencing cross-functional engineering teams. 

Additional Plus Competencies:
Prior experience in any analytics platform on Big Data would be a huge plus

Skills Required

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • 8+ years experience in distributed systems and backend performance engineering.
  • 4+ years Java development experience with Microservices architecture.
  • Proficient in scripting (Python, Bash) for automation and test data generation.
  • 4+ years hands-on Apache Spark experience (performance tuning, memory management, DAG optimization).
  • 3+ years experience with Kafka (topic optimization, producer/consumer tuning, lag monitoring).
  • 3+ years experience with Elasticsearch/OpenSearch (query profiling, indexing strategies, cluster optimization).
  • 3+ years experience with performance testing tools such as JMeter or similar.
  • Experience with JVM performance analysis: Heap Dumps, Thread Dumps, GC Logs, CPU profiling.
  • Hands-on experience with observability and APM tools (AppDynamics, Grafana, Prometheus, ELK, Spark UI, Athena).
  • Excellent programming and design skills; hands-on experience with Spring and Hibernate.
  • Experience designing and running large-scale benchmarks for high-throughput environments (PB-scale).
  • Experience with containerized workloads and performance testing in Kubernetes/Docker.
  • Solid understanding of cloud-native architecture (OCI) and distributed systems design.
  • Strong knowledge of Linux OS and performance-related improvements.
  • Familiarity with CI/CD integration for performance testing (e.g., Jenkins, GitHub).
  • Knowledge of data lake architecture, caching solutions, and message queues.
  • Strong communication skills and experience influencing cross-functional engineering teams.
  • Prior experience in analytics platforms on Big Data.
  • Experience optimizing operational costs related to performance and scale.

Qualys Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Qualys and has not been reviewed or approved by Qualys.

  • Affordable Benefits Benefits costs are widely viewed as low for employees and dependents, with healthcare often described as almost fully paid for. Feedback suggests this affordability helps offset perceptions of lower base pay in some roles.
  • Healthcare Strength Healthcare offerings are broad, including multiple medical plan options, dental and vision coverage, mental health support, and disability insurance. Benefits are described as “pretty amazing” or “great,” reinforcing perceived quality and coverage depth.
  • Equity Value & Accessibility Equity participation is accessible through company stock plans and an employee stock purchase plan. Compensation packages commonly include equity alongside salary and bonus, which some consider a meaningful part of total rewards.

Qualys Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Foster City, CA
2,736 Employees
Year Founded: 1999

What We Do

Qualys, Inc. (NASDAQ: QLYS) is a pioneer and leading provider of disruptive cloud-based security, compliance and IT solutions with more than 10,000 subscription customers worldwide, including a majority of the Forbes Global 100 and Fortune 100. Qualys helps organizations streamline and automate their security and compliance solutions onto a single platform for greater agility, better business outcomes, and substantial cost savings. The Qualys Cloud Platform leverages a single agent to continuously deliver critical security intelligence while enabling enterprises to automate the full spectrum of vulnerability detection, compliance, and protection for IT systems, workloads and web applications across on premises, endpoints, servers, public and private clouds, containers, and mobile devices. Founded in 1999 as one of the first SaaS security companies, Qualys has strategic partnerships and seamlessly integrates its vulnerability management capabilities into security offerings from cloud service providers, including Amazon Web Services, the Google Cloud Platform and Microsoft Azure, along with a number of leading managed service providers and global consulting organizations. For more information, please visit http://www.qualys.com

Similar Jobs

Qualys Logo Qualys

Lead Software Engineer

Information Technology • Security • Cybersecurity
In-Office
Pune, Mahārāshtra, IND
2736 Employees

TransUnion Logo TransUnion

Sr Analyst - FP&A

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Pune, Mahārāshtra, IND
13000 Employees

CrowdStrike Logo CrowdStrike

Artificial Intelligence Engineer

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Remote or Hybrid
India
11000 Employees

LogicMonitor Logo LogicMonitor

Scripting Specialist

Artificial Intelligence • Cloud • Information Technology • Machine Learning • Software
Easy Apply
Hybrid
2 Locations
1100 Employees

Similar Companies Hiring

Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account