Lead Engineer (Kafka)
Important Information
Location: Pune
Experience: 8-12 years
Job Mode: Full-time
Work Mode: Hybrid
Job Summary
Kafka Expert:
Standing up and administer on-premises Kafka cluster.
Ability to architect and create reference architecture for Kafka Implementation standards
Provide expertise in Kafka brokers, zookeepers, Kafka connect, schema registry, KSQL, Rest proxy and Kafka Control center.
Ensure optimum performance, high availability and stability of solutions.
Create topics, set up redundancy cluster, deploy monitoring tools, alerts and have good knowledge of best practices.
Provide administration and operations of the Kafka platform like provisioning, access lists Kerberos and SSL configurations.
Use automation tools like provisioning using Rancher, Docker, and BitBucket.
Ability to perform data related benchmarking, performance analysis and tuning.
Involve in design and capacity review meetings to provide suggestion in Kafka usage.
Solid knowledge of open telemetry monitoring tools and fine-tuning alerts on Prometheus, Grafana, Jaeger.
Setting up security on Kafka.
Providing naming conventions, Backup Recovery, and problem determination strategies for the projects.
Monitor, prevent and troubleshoot security related issues.
QUALIFICATIONS:
8-12 years demonstrated proficiency and experience in design, implementation, monitoring, and troubleshooting Kafka messaging infrastructure.
Hands on experience on recovery in Kafka.
5 or more years of experience in developing/customizing messaging related monitoring tools/utilities.
Experience implementing and administering/managing technical solutions in major, large-scale system implementations.
High critical thinking skills to evaluate alternatives and present solutions that are consistent with business objectives and strategy.
Ability to manage tasks independently and take ownership of responsibilities
Ability to learn from mistakes and apply constructive feedback to improve performance
Ability to adapt to a rapidly changing environment.
Proven leadership abilities including effective knowledge sharing, conflict resolution, facilitation of open discussions, fairness and displaying appropriate levels of assertiveness.
Ability to communicate highly complex technical information clearly and articulately for all levels and audiences.
Willingness to learn new technologies/tool and train your peers.
Proven track record to automate.
About Encora
Encora is the preferred digital engineering and modernization partner of some of the world’s leading enterprises and digital native companies. With over 9,000 experts in 47+ offices and innovation labs worldwide, Encora’s technology practices include Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering.
At Encora, we hire professionals based solely on their skills and qualifications, and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Top Skills
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries.
With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology