We are looking for an experienced Lead Confluent Kafka Engineer to support the deployment, configuration, administration, and production operations of Apache Kafka / Confluent Platform. The role requires strong hands-on expertise in Kafka, Java, Spring Boot, Linux, security, troubleshooting, and data streaming, with responsibility for maintaining reliable, secure, and highly available Kafka environments.
Position Details- Job Title: Lead Confluent Kafka Engineer
- Employment Type: Full-Time
- Work Arrangement: Onsite
- Location: Islamabad
- Experience Required: 5 to 10 years
- Education: Minimum Bachelor’s degree in a relevant field
- Deploy, configure, and maintain Apache Kafka / Confluent Platform across development, UAT, and production environments.
- Support Kafka cluster provisioning, broker configuration, topic creation, partitioning, replication, retention, and capacity management.
- Perform Kafka upgrades, patches, rolling restarts, configuration changes, and cluster expansion with minimal production impact.
- Support deployment of Kafka components such as Schema Registry, Kafka Connect, Control Center, and supporting services.
- Troubleshoot production issues involving brokers, partitions, ISR, replication, consumer lag, throughput, latency, storage, and connectivity.
- Manage Kafka security configuration, including TLS/mTLS, SASL, ACLs, certificates, keystores, and truststores.
- Support Java/Spring Boot Kafka application deployments, including producer/consumer configuration and integration troubleshooting.
- Work with application, DevOps, infrastructure, and security teams to onboard new Kafka use cases and promote changes across environments.
- Support CI/CD pipelines, deployment automation, configuration management, and release activities for Kafka and Kafka-based applications.
- Perform health checks, capacity planning, performance tuning, incident management, and root-cause analysis.
- Maintain operational documentation, deployment procedures, configuration standards, and recovery/runbook documentation.
- Support high availability, disaster recovery, backup/restore, and multi-cluster replication requirements where applicable.
- Strong hands-on experience with Apache Kafka / Confluent Platform in production.
- Strong knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics.
- Hands-on experience with Kafka deployment, configuration, upgrades, patching, and operational maintenance.
- Strong Java and Spring Boot experience for Kafka producer/consumer integrations.
- Strong Linux, networking, JVM, troubleshooting, and production-support skills.
- Experience with Kafka security, particularly TLS/mTLS, SASL, ACLs, and certificates.
- Confluent Kafka experience.
- Data streaming experience.
- Experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments.
- Experience with Kafka Connect, Schema Registry, and Confluent Control Center.
- CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent.
- Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools.
- Experience with Kafka DR, multi-cluster architectures, replication, and migration activities.
- Experience supporting Kafka in banking, telecom, or other mission-critical environments.
Skills Required
- 5 to 10 years of relevant experience
- Bachelor's degree in a relevant field
- Production experience with Apache Kafka and Confluent Platform
- Knowledge of Kafka architecture, brokers, partitions, replication, ISR, consumer groups, offsets, retention, and delivery semantics
- Hands-on experience deploying, configuring, upgrading, patching, and maintaining Kafka environments
- Strong Java and Spring Boot experience for Kafka producer and consumer integrations
- Strong Linux, networking, JVM, troubleshooting, and production-support skills
- Experience configuring Kafka security, including TLS/mTLS, SASL, ACLs, and certificates
- Data streaming experience
- Experience with Kubernetes, OpenShift, Anthos, Helm, and containerized Kafka deployments
- Experience with Kafka Connect, Schema Registry, and Confluent Control Center
- CI/CD experience with Jenkins, GitLab CI, Azure DevOps, or equivalent
- Monitoring experience with Splunk, AppDynamics, Prometheus, Grafana, or Confluent monitoring tools
- Experience with Kafka disaster recovery, multi-cluster architectures, replication, and migration activities
- Experience supporting Kafka in banking, telecom, or other mission-critical environments
Datamatics Technologies Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Datamatics Technologies and has not been reviewed or approved by Datamatics Technologies.
-
Flexible Benefits — Feedback suggests flexible timings and work-from-home options are available in some roles. This flexibility is highlighted as part of the employment experience across certain postings and materials.
-
Wellbeing & Lifestyle Benefits — Feedback suggests flexibility around time off and remote work supports work-life balance. These elements can help offset leaner cash components for some individuals.
Datamatics Technologies Insights
What We Do
Datamatics Technologies (DMT) was established in Dubai. We specialize in providing onsite and offshore professional services, covering the full spectrum of Data Analytics and Data Science domains. Our experience of working with diverse industry sectors such as Telecoms, Finance, Government and Manufacturing, across multiple regions enables us to engage and deliver for our clients with confidence. We can offer our full portfolio of services through resource augmentation, managed services, both on T&M or fixed price financial arrangements. Through our end-to-end managed services offering we enable our clients to cut down costs, increase profitability and focus on value addition to their core business activities. Our project and delivery management team are certified in Agile, PMI and ITIL to ensure the planning and execution are carried out using industry best practices. We are working with our clients across Middle East and Africa Region.
