We are looking for an experienced Senior Kafka/AWS Integration Engineer to join a project focused on building and productionizing an event-driven middleware platform using Apache Kafka and AWS.
This is a highly hands-on engineering role where you will build the AWS side of the integration platform, with Salesforce serving as the initial event source. You will work alongside the Lead Integration Architect and within the Agile sprint process, implementing solutions based on an established architecture and prioritized backlog.
You will work across Apache Kafka, Amazon MSK, Java, Kafka Connect, Change Data Capture (CDC), AWS serverless technologies, and Infrastructure as Code, while helping establish reliable, testable, and maintainable event-driven integrations.
Responsibilities:
- Provision and configure Amazon MSK clusters, Kafka topics, and schema registry.
- Configure and maintain Kafka Connect and CDC source connectors.
- Build REST-based event ingress using Amazon API Gateway and AWS Lambda to receive Salesforce events and publish them to Kafka.
- Develop Java stream-processing applications to transform data between Kafka topics.
- Build Java-based integration pipelines to deliver events from outbound topics to downstream systems.
- Implement dead letter queues and error-handling patterns for reliable event processing.
- Develop and maintain CI/CD pipelines, automated tests, and code coverage.
- Build and maintain infrastructure using AWS CloudFormation, enabling the client's operations team to redeploy and manage the environment.
- Work within the client's Agile/sprint process and collaborate closely with the Lead Integration Architect.
- Create clear technical documentation and provide ongoing knowledge transfer to the client's engineering and operations teams.
Requirements:
- 5+ years of professional software engineering experience.
- Strong hands-on experience developing backend and integration solutions with Java.
- Professional experience building event-driven and Kafka-based systems.
- Hands-on experience working with AWS services and cloud-based integrations.
- Experience building and supporting production-grade integration pipelines.
- Strong understanding of automated testing, CI/CD, and production-quality software development practices.
- Comfortable working within an Agile/sprint environment under the direction of a client architect.
- Strong communication and technical documentation skills.
- Ability to transfer technical knowledge effectively to client engineering and operations teams.
- Advanced written and verbal English communication skills.
Must Have:
- Strong Java development experience, including stream processing and API components.
- Strong hands-on experience with Apache Kafka and Amazon MSK, including:
- Kafka clusters and topics
- Kafka Connect
- Change Data Capture (CDC)
- Experience with Schema Registry, including schema versioning and evolution.
- Strong experience with AWS serverless technologies, including:
- API Gateway
- AWS Lambda
- Infrastructure-as-Code experience with AWS CloudFormation.
- Experience building and maintaining CI/CD pipelines.
- Experience with automated testing and code coverage.
- Experience building or supporting event-driven integration systems.
- Comfortable working in an Agile/sprint environment under a client architect's direction.
- Strong communication and documentation skills for technical knowledge transfer.
- Advanced written and verbal English communication skills.
Nice to Have:
- Experience with Salesforce CDC or Salesforce event integrations.
- Experience implementing dead letter queues (DLQs) and error-handling patterns in event-driven systems. Kafka-AWS-Integration-Engineer.
Skills Required
- 5+ years of professional software engineering experience
- Strong professional Java development experience, including stream processing and API components
- Professional experience building event-driven and Kafka-based systems
- Hands-on experience with AWS services and cloud-based integrations
- Experience building and supporting production-grade integration pipelines
- Strong understanding of automated testing, CI/CD, and production-quality software development practices
- Strong hands-on experience with Apache Kafka and Amazon MSK, including clusters, topics, Kafka Connect, and CDC
- Experience with Schema Registry, schema versioning, and schema evolution
- Strong experience with AWS serverless technologies, including API Gateway and AWS Lambda
- Infrastructure-as-Code experience with AWS CloudFormation
- Experience building and maintaining CI/CD pipelines
- Experience with automated testing and code coverage
- Comfort working in an Agile or sprint environment under a client architect's direction
- Strong communication and technical documentation skills for knowledge transfer
- Advanced written and verbal English communication skills
- Experience with Salesforce CDC or Salesforce event integrations
- Experience implementing dead-letter queues and event-driven error-handling patterns
What We Do
We are on a mission to give every company, no matter the size, the opportunity to innovate and help build a better future. Our Services: Dedicated Tech (full/partial) Squads: we create multi-disciplinary, remote (near-shore) Tech Squads that become part of your team. They adapt to your workflows and are trained on Agile methodologies to deliver continuous value. We believe that well-trained remote teams bring clients the opportunity to increase innovation output by accessing a greater / more diverse pool of talent, while reducing the cost of development. On-Demand Software Development: at our core, we are software developers excited about building digital products and solutions using the latest technologies and agile methodologies. We provide end-to-end capabilities to deliver on your technical requests. Product Management, Tech Architecture, Front / Back End Development, Devops & QA Venture Building: we partner with companies to co-launch new digital businesses that leverage core assets of the company (distribution channels, customer base, industry knowledge, proprietary technology, etc). We take the co-created ideas into MLP’s (Most Lovable Product) aiming to find product market fit and scale in the leanest possible way. As startup founders ourselves, we love getting things from 0 to 1. We are End-To-End Innovation Enablers, helping your company unlock it's full innovation potential.
