We are seeking a Kafka Integration Engineer to lead and execute data integration initiatives between our customers’ Kafka streams and internal APIs. This is a hands-on engineering role that requires a strong understanding of real-time data processing, microservices, and cloud-native technologies. You will collaborate closely with customer engineering teams and internal DevOps to build scalable, efficient, and secure data pipelines.
Key Responsibilities
- Design, build, and maintain Kafka consumers to ingest and batch-process customer event data.
- Implement message parsing and transformation logic (JSON, Avro, Protobuf) to align with Captain Up’s event structure.
- Develop and configure provider-specific customer integrations.
- Manage secure credentials using AWS Secrets Manager and handle per-application configurations.
- Deploy and monitor services in Kubernetes using Helm.
- Work with DevOps to troubleshoot deployments, monitor performance, and ensure system reliability.
Requirements
- Proficient in Node.js and TypeScript.
- Strong experience with Apache Kafka and libraries like KafkaJS or similar.
- Familiarity with message schemas (Avro, Protobuf) and relevant parsing libraries.
- Hands-on experience with Kubernetes, Helm, and AWS services, especially Secrets Manager.
- Ability to write robust, testable, and maintainable code for high-throughput and low-latency data pipelines.
- Excellent debugging, problem-solving, and communication skills.
Top Skills
What We Do
Commit is a global tech services company with offices in Israel, US, Canada, UK, and Europe.
The company was founded in 2005 and has over 700 multi-disciplinary innovation experts who serve a broad range of companies, from small startups to large enterprises in multiple business sectors.
Commit specializes in advanced technologies and applications with dedicated practices in Cloud, GenAI, Software, IoT, Big Data, Cyber, Collaboration, Data center migration projects, and more.
Commit offers innovative, end-to-end technology solutions by developing custom software and IoT platforms for clients looking to build their next-gen products within the modern ICT world.
Commit’s complete and comprehensive engineering powerhouse of resources, and proprietary Flexible R&D methodology helps transform its clients’ technology visions into high-quality products while reducing costs and improving time-to-market.
