Kafka Platform Engineer

Posted 10 Days Ago
Be an Early Applicant
Carmel, IN, USA
In-Office
130K-180K Annually
Expert/Leader
Artificial Intelligence • Information Technology • Software • Consulting
The Role
Architects, deploys, and operates enterprise Apache Kafka and Confluent streaming platforms. Responsibilities include cluster design, performance tuning, security, Kafka ecosystem management, infrastructure automation, high availability, disaster recovery, observability, Kubernetes and cloud deployments, troubleshooting, governance, architecture reviews, and mentoring engineering teams.
Summary Generated by Built In
Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.
Job Title: Kafka Platform Engineer
Location: 100% Remote (U.S.)

Position Type: Full-time, Direct W2
Salary Range: $130,000–$180,000 Annually (based on experience)
Experience Required: 10+ Years

Sponsorship: U.S. Citizens, Green Card Holders, EAD Holders, and H-1B transfer candidates are encouraged to apply. We are unable to sponsor new H-1B visa petitions for this position.

Job Summary

Bright Vision Technologies is seeking a highly experienced Kafka Platform Engineer with 10+ years of experience in distributed systems, event streaming, and platform engineering, including extensive expertise with Apache Kafka and the Confluent Platform. The ideal candidate will architect, deploy, and manage enterprise-scale streaming platforms that power mission-critical, real-time data processing across the organization. This role requires deep technical expertise in Kafka internals, platform automation, security, observability, and cloud-native infrastructure, along with the ability to mentor engineering teams and define enterprise event-streaming standards.

Key Responsibilities
  • Architect, deploy, and manage highly available Apache Kafka and Confluent Platform environments supporting enterprise-scale event-driven applications.
  • Design Kafka cluster topology, broker configuration, partitioning strategies, replication, capacity planning, and performance optimization for high-throughput workloads.
  • Implement enterprise-grade security using SASL, SSL/mTLS, ACLs, RBAC, encryption, and authentication mechanisms.
  • Design and manage Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and event streaming pipelines for real-time data integration.
  • Develop and maintain Infrastructure as Code using Terraform, Ansible, or similar automation frameworks to provision and manage Kafka infrastructure.
  • Design and implement High Availability (HA), Disaster Recovery (DR), backup, failover, and cross-region replication strategies.
  • Build comprehensive monitoring, alerting, logging, and observability solutions using Prometheus, Grafana, OpenTelemetry, ELK, and Confluent monitoring tools.
  • Optimize cluster performance, troubleshoot production issues, conduct root cause analysis, and implement long-term platform improvements.
  • Support Kafka deployments on Kubernetes using Strimzi, Confluent Operator, or managed cloud services including AWS MSK, Azure Event Hubs (Kafka API), and Confluent Cloud.
  • Collaborate with application developers, data engineers, DevOps, SRE, and enterprise architects to establish event-driven architecture standards and best practices.
  • Conduct architecture reviews, establish platform governance, perform code reviews, and mentor engineers on Kafka development and operations.
Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related technical discipline.
  • 10+ years of professional experience in distributed systems, platform engineering, or infrastructure engineering, including 5+ years of hands-on Apache Kafka or Confluent Platform experience.
  • Expert-level knowledge of Kafka internals, including partitions, replication, brokers, ISR, consumer groups, offset management, and performance tuning.
  • Extensive experience implementing Kafka security using SASL, SSL/mTLS, ACLs, RBAC, and enterprise authentication mechanisms.
  • Strong hands-on experience with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and real-time event streaming architectures.
  • Experience implementing High Availability (HA), Disaster Recovery (DR), multi-cluster replication, and cross-region failover strategies.
  • Advanced scripting skills using Python, Bash, or Go, along with Infrastructure as Code experience using Terraform, Ansible, or similar tools.
  • Strong experience with observability platforms including Prometheus, Grafana, OpenTelemetry, ELK, and distributed tracing solutions.
  • Excellent troubleshooting, communication, documentation, stakeholder management, and technical leadership skills.
Preferred Qualifications
  • Confluent Certified Administrator or Confluent Certified Developer certification.
  • Experience operating Kafka on Kubernetes using Strimzi, Confluent Operator, or similar operators.
  • Hands-on experience with managed Kafka services including AWS MSK, Confluent Cloud, Azure Event Hubs (Kafka API), or Google Cloud Managed Kafka.
  • Experience with stream processing technologies such as Apache Flink, Apache Spark Structured Streaming, or Apache Beam.
  • Knowledge of data governance, schema evolution, metadata management, and data lineage for streaming platforms.

How to Apply
Would you like to know more about this opportunity?
For immediate consideration, please send your resume to [email protected] or contact us at (908) 505-3545. Learn more about Bright Vision Technologies at www.bvteck.com.
Bright Vision Technologies is an Equal Opportunity Employer.

Skills Required

  • Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related technical discipline
  • 10+ years of professional experience in distributed systems, platform engineering, or infrastructure engineering
  • 5+ years of hands-on Apache Kafka or Confluent Platform experience
  • Expert knowledge of Kafka internals, including partitions, replication, brokers, ISR, consumer groups, offset management, and performance tuning
  • Experience implementing Kafka security using SASL, SSL/mTLS, ACLs, RBAC, and enterprise authentication mechanisms
  • Experience with Kafka Connect, Schema Registry, Kafka Streams, ksqlDB, and real-time event streaming architectures
  • Experience implementing high availability, disaster recovery, multi-cluster replication, and cross-region failover strategies
  • Advanced scripting skills using Python, Bash, or Go
  • Infrastructure as Code experience using Terraform, Ansible, or similar tools
  • Experience with observability platforms including Prometheus, Grafana, OpenTelemetry, ELK, and distributed tracing solutions
  • Strong troubleshooting, communication, documentation, stakeholder management, and technical leadership skills
  • Confluent Certified Administrator or Confluent Certified Developer certification
  • Experience operating Kafka on Kubernetes using Strimzi, Confluent Operator, or similar operators
  • Experience with managed Kafka services including AWS MSK, Confluent Cloud, Azure Event Hubs, or Google Cloud Managed Kafka
  • Experience with Apache Flink, Apache Spark Structured Streaming, or Apache Beam
  • Knowledge of data governance, schema evolution, metadata management, and data lineage for streaming platforms
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Bridgewater, NJ
53 Employees
Year Founded: 2020

What We Do

Bright Vision Technologies is a minority-owned organization founded in July 2020 and based in New Jersey, USA. The company specializes in delivering top-tier staffing and IT consulting services, including custom computer programming and systems design. Additionally, they are a product engineering firm with a flagship AI-powered talent intelligence and enterprise automation platform called Lumina, which helps transform IT into a strategic asset for their valued partners.

Similar Jobs

Bright Vision Technologies Logo Bright Vision Technologies

Platform Engineer

Artificial Intelligence • Information Technology • Software • Consulting
In-Office
Fishers, IN, USA
53 Employees
130K-180K Annually

Upside Logo Upside

Strategic Account Manager

Artificial Intelligence • Fintech • Machine Learning • Mobile • Payments • Retail • Software
Remote or Hybrid
USA
275 Employees
151K-180K Annually

People Inc. Logo People Inc.

Head of Brand Marketing, CPG

AdTech • Consumer Web • Digital Media • eCommerce • Marketing Tech
Remote or Hybrid
US
3500 Employees
130K-150K Annually

Tapestry - Coach and Kate Spade Logo Tapestry - Coach and Kate Spade

Temporary Associate

eCommerce • Fashion • Retail • Sales • Wearables • Design
Remote or Hybrid
14 Locations
16000 Employees
15-20 Hourly

Similar Companies Hiring

Revel Thumbnail
Aerospace • Hardware • Robotics • Software
Marina Del Rey, California
70 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software
New York, New York
30 Employees
Vega Thumbnail
Artificial Intelligence • Automotive • Insurance • Transportation
US
43 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account