Lead Confluent Kafka Engineer

Posted 15 Days Ago
Be an Early Applicant
Karachi, Sindh, PAK
In-Office
Senior level
Artificial Intelligence • Information Technology • Software • Analytics
The Role
Lead production deployment and operations for Apache Kafka and Confluent Platform across multiple environments. Responsibilities include cluster provisioning, upgrades, security configuration, performance tuning, troubleshooting, application integration, CI/CD automation, capacity planning, incident management, disaster recovery, and operational documentation. The role collaborates with application, infrastructure, DevOps, and security teams to maintain highly available and secure data-streaming platforms.
Summary Generated by Built In
Job Description: Lead Confluent Kafka EngineerRole Summary

We are looking for an experienced Lead Confluent Kafka Engineer to support the deployment, configuration, administration, and production operations of Apache Kafka / Confluent Platform. The role requires strong hands-on expertise in Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming, with responsibility for maintaining reliable, secure, and highly available Kafka environments.

Position Details
  • Job Title: Lead Confluent Kafka Engineer
  • Employment Type: Full-Time
  • Work Arrangement: Onsite
  • Location: Islamabad
  • Experience Required: 5 to 10 years
  • Education: Minimum Bachelor’s degree in a relevant field
Responsibilities
  • Deploy, configure, and maintain Apache Kafka / Confluent Platform across development, UAT, and production environments.
  • Support Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management.
  • Perform Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion with minimal production impact.
  • Support deployment of Kafka components such as Schema Registry, Kafka Connect, Control Center, and supporting services.
  • Troubleshoot production issues involving brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity.
  • Manage Kafka security configuration, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
  • Support Java/Spring Boot Kafka application deployments, including producer/consumer configuration and integration troubleshooting.
  • Work with application, DevOps, infrastructure, and security teams to onboard new Kafka use cases and promote changes across environments.
  • Support CI/CD pipelines, deployment automation, configuration management, and release activities for Kafka and Kafka-based applications.
  • Perform health checks, capacity planning, performance tuning, incident management, and root-cause analysis.
  • Maintain operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation.
  • Support high availability, disaster recovery, backup/restore, and multi-cluster replication requirements where applicable.
Must-Have Skills
  • Strong hands-on experience with Apache Kafka / Confluent Platform in production.
  • Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
  • Hands-on experience with Kafka deployment, configuration, upgrades, patching, and operational maintenance.
  • Strong Java and Spring Boot experience for Kafka producer/consumer integrations.
  • Strong Linux, networking, JVM, troubleshooting, and production-support skills.
  • Experience with Kafka security, particularly TLS/mTLS, SASL, ACLs, and certificates.
  • Confluent Kafka experience.
  • Data streaming experience.
Good-to-Have Skills
  • Experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments.
  • Experience with Kafka Connect, Schema Registry, and Confluent Control Center.
  • CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent.
  • Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools.
  • Experience with Kafka DR, multi-cluster architectures, replication, and migration activities.
  • Experience supporting Kafka in banking, telecom, or other mission-critical environments.

Skills Required

  • 5 to 10 years of relevant professional experience
  • Bachelor's degree in a relevant field
  • Production experience with Apache Kafka and Confluent Platform
  • Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics
  • Hands-on experience deploying, configuring, upgrading, patching, and maintaining Kafka environments
  • Strong Java and Spring Boot experience for Kafka producer and consumer integrations
  • Strong Linux, networking, JVM, troubleshooting, and production-support skills
  • Experience with Kafka security, including TLS/mTLS, SASL, ACLs, and certificates
  • Experience with data streaming
  • Experience with Kubernetes, OpenShift, Anthos, Helm, or containerized Kafka deployments
  • Experience with Kafka Connect, Schema Registry, and Confluent Control Center
  • CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent
  • Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools
  • Experience with Kafka disaster recovery, multi-cluster architectures, replication, and migration activities
  • Experience supporting Kafka in banking, telecom, or other mission-critical environments

Datamatics Technologies Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Datamatics Technologies and has not been reviewed or approved by Datamatics Technologies.

  • Flexible Benefits — Feedback suggests flexible timings and work-from-home options are available in some roles. This flexibility is highlighted as part of the employment experience across certain postings and materials.
  • Wellbeing & Lifestyle Benefits — Feedback suggests flexibility around time off and remote work supports work-life balance. These elements can help offset leaner cash components for some individuals.

Datamatics Technologies Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Dubai
65 Employees
Year Founded: 2016

What We Do

Datamatics Technologies (DMT) was established in Dubai. We specialize in providing onsite and offshore professional services, covering the full spectrum of Data Analytics and Data Science domains. Our experience of working with diverse industry sectors such as Telecoms, Finance, Government and Manufacturing, across multiple regions enables us to engage and deliver for our clients with confidence. We can offer our full portfolio of services through resource augmentation, managed services, both on T&M or fixed price financial arrangements. Through our end-to-end managed services offering we enable our clients to cut down costs, increase profitability and focus on value addition to their core business activities. Our project and delivery management team are certified in Agile, PMI and ITIL to ensure the planning and execution are carried out using industry best practices. We are working with our clients across Middle East and Africa Region.

Similar Jobs

Mastercard Logo Mastercard

Manager, Account Management

Blockchain • Fintech • Payments • Consulting • Cryptocurrency • Cybersecurity • Quantum Computing
Hybrid
Karachi, Sindh, PAK
38800 Employees

Pfizer Logo Pfizer

Brand Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office
Karachi, Sindh, PAK
121990 Employees

Proto Logo Proto

DevOps

Artificial Intelligence • Digital Media • Fintech • Hospitality
In-Office or Remote
Karachi, Sindh, PAK
150 Employees

Capco Logo Capco

PMO Analyst

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
10 Locations
6000 Employees

Similar Companies Hiring

Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
33 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
65 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account