Important Information
Experience: +6 years
Job Mode: Full-time
Work Mode: Work from home
Job Summary
We are looking for a Data Engineer who has experience with data pipelines, real-time APIs, and scalable cloud infrastructure. In this role, you will work with technologies like Kotlin, Kafka/Pulsar, Azure, and Kubernetes to build reliable, high-throughput systems for data movement and access.
Responsibilities and Duties
- Design, build, and maintain ELT pipelines in Kotlin and Python that ingest and transform data from real-time sources like Kafka and Pulsar.
- Develop and maintain high-performance APIs to serve real-time data from databases, services, and caches.
- Collaborate with internal users and microservice consumers to ensure reliable access to up-to-date data.
- Architect and implement scalable solutions to handle growing traffic and data volume across services.
- Work with Azure cloud services, including Databricks, for data processing and analytics.
- Manage containerized workloads using Kubernetes, with a focus on high availability and auto-scaling.
- Participate in CI/CD, observability, and performance tuning across the platform.
Qualifications and Skills
- 4+ years of experience building ELT or streaming data pipelines.
- Strong Kotlin, Python development skills (or experience with JVM languages and willingness to learn Kotlin).
- Deep understanding of distributed systems and real-time data processing.
- Proven experience with microservices architecture and API development.
- Solid understanding of Kubernetes concepts: pods, services, autoscaling, Helm charts, etc.
- Cloud deployment experience, ideally on Azure with exposure to Databricks or similar platforms.
- Excellent communication skills and user-first mindset.
Tech Stack
- Languages: Kotlin, Python, SQL/Oracle
- Data Pipelines: Kafka, Pulsar
- APIs: REST
- Cloud: Azure (preferred), Databricks
- Deployment: Kubernetes, Helm, Docker
About Encora
Encora is a global company that offers Software and Digital Engineering solutions. Our practices include Cloud Services, Product Engineering & Application Modernization, Data & Analytics, Digital Experience & Design Services, DevSecOps, Cybersecurity, Quality Engineering, AI & LLM Engineering, among others.
At Encora, we hire professionals based solely on their skills and do not discriminate based on age, disability, religion, gender, sexual orientation, socioeconomic status, or nationality.
Similar Jobs
What We Do
Headquartered in Santa Clara, California, and backed by renowned private equity firms Advent International and Warburg Pincus, Encora is the preferred technology modernization and innovation partner to some of the world’s leading enterprise companies. It provides award-winning digital engineering services including Product Engineering & Development, Cloud Services, Quality Engineering, DevSecOps, Data & Analytics, Digital Experience, Cybersecurity, and AI & LLM Engineering. Encora's deep cluster vertical capabilities extend across diverse industries, including HiTech, Healthcare & Life Sciences, Retail & CPG, Energy & Utilities, Banking Financial Services & Insurance, Travel, Hospitality & Logistics, Telecom & Media, Automotive, and other specialized industries.
With over 9,000 associates in 47+ offices and delivery centers across the U.S., Canada, Latin America, Europe, India, and Southeast Asia, Encora delivers nearshore agility to clients anywhere in the world, coupled with expertise at scale in India. Encora’s Cloud-first, Data-first, AI-first approach enables clients to create differentiated enterprise value through technology
