Experience:
L2: 4–5 Years
L4: 8–12 Years
Mode: FTE (Full-Time Employment)
Job Location: Bangalore
Work Mode: Hybrid
Notice Period:
L2: Immediate to 15 days
L4: Immediate to 15 days
Drive Type: F2F
Drive Location: Bangalore
CTC Band:
L2: Up to 21 LPA
L4: Up to 42 LPA
We are hiring Data Software Engineers with strong expertise in Apache Spark, Python, and AWS/Azure Databricks. The ideal candidates will have deep Big Data engineering experience, strong distributed systems knowledge, and the ability to work on complex end-to-end data platforms at scale.
Big Data Engineering
Design and build distributed data processing systems using Spark and Hadoop.
Develop and optimize Spark applications, ensuring performance and scalability.
Create and manage ETL/ELT pipelines for large-scale data ingestion and transformation.
Build and manage real-time streaming systems using Spark Streaming or Storm.
Work with Kafka / RabbitMQ for event-driven ingestion and messaging patterns.
Develop & optimize workloads on AWS Databricks or Azure Databricks.
Perform cluster management, job scheduling, performance tuning, and automation.
Integrate data from diverse sources: RDBMS (Oracle, SQL Server), ERP, file systems.
Work with query engines like Hive and Impala.
Experience with NoSQL stores: HBase, Cassandra, MongoDB.
Strong hands-on coding in Python for data transformations and automations.
Strong SQL skills for data validation, tuning, and complex queries
Provide technical leadership and mentoring to junior engineers.
Drive solution design for Big Data platforms end-to-end
Ways of Working
Work in Agile teams, participate in sprint ceremonies and planning.
Collaborate with engineering, data science, and product teams.
Apache Spark – Expert level (core, SQL, streaming)
Python – Strong hands-on
Distributed computing fundamentals
Hadoop ecosystem: Hadoop v2, MapReduce, HDFS, Sqoop
Streaming systems: Spark Streaming / Storm
Messaging: Kafka or RabbitMQ
SQL – Advanced (joins, stored procedures, query optimization)
NoSQL: HBase, Cassandra, MongoDB
ETL frameworks & data pipeline design
Hive / Impala querying
Performance tuning of Spark jobs
AWS or Azure Databricks
Experience working in Agile
Skills: Spark, Python, AWS
Notice Period: Immediate – 20 Days
CTC Band: Up to 21 LPA
Skills: Spark, Python, Azure Databricks
Notice Period: 15 Days (Nov joiners) OR Jan joiners
CTC Band: Up to 42 LPA
Skills Required
- 4-5 years of experience for L2 or 8-12 years of experience for L4
- Expert-level Apache Spark expertise, including Spark Core, Spark SQL, and streaming
- Strong hands-on Python programming
- Distributed computing fundamentals
- Experience with Hadoop v2, MapReduce, HDFS, and Sqoop
- Experience with Spark Streaming or Storm
- Experience with Kafka or RabbitMQ
- Advanced SQL skills, including joins, stored procedures, and query optimization
- Experience with HBase, Cassandra, or MongoDB
- ETL frameworks and data pipeline design experience
- Experience querying Hive or Impala
- Experience tuning Spark job performance
- Experience with AWS Databricks or Azure Databricks
- Experience working in Agile teams
- Technical leadership, mentoring, and end-to-end Big Data solution design for L4
- Immediate to 15 or 20-day notice period, depending on level
- Ability to work hybrid in Bangalore and attend face-to-face hiring drives in Bangalore
What We Do
Talpro India Private Limited is a technology-driven recruitment and staffing company serving businesses across industries. It specializes in sourcing, vetting, and hiring top-tier technology talent, while providing innovative, sustainable, and cost-effective recruitment solutions. The company develops comprehensive hiring strategies intended to meet immediate recruitment demands and support longer-term workforce needs, acting as a human-resources services provider in India for employers.
.jpeg)
