This role is for one of the Weekday's clients
Salary range: Rs 500000 - Rs 2000000 (ie INR 5-20 LPA)
Experience: 4+ yrs
Location: Bengaluru, Pune, Hyderabad, NCR, Chennai
Job Type: full-time
We are seeking a Data Engineer / Senior Data Engineer to design, build, and optimize large-scale cloud-based data platforms that support business intelligence, analytics, and data-driven decision-making. This role focuses on developing modern data pipelines, data lakes, and warehouse solutions while working with real-time and batch processing systems in a cloud environment. You will collaborate with cross-functional teams to deliver scalable, high-quality data architectures that enable actionable insights across the organization.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines for processing large volumes of structured and unstructured data.
- Build and manage cloud-based data platforms, including data lakes, data warehouses, and analytics solutions.
- Develop and optimize data pipelines using Spark, PySpark, and cloud-native data services.
- Work with real-time and batch data processing frameworks to ensure reliable and efficient data delivery.
- Design robust data models and implement best practices for data quality, governance, and performance.
- Optimize SQL queries, database performance, and large-scale analytics workloads.
- Develop and maintain reporting and visualization solutions to support business stakeholders.
- Collaborate with business, engineering, analytics, and product teams to define data requirements and solutions.
- Support CI/CD processes, automation, monitoring, and deployment of data engineering solutions.
- Create technical documentation and ensure adherence to modern engineering and data management standards.
What Makes You a Great Fit
- 7+ years of experience in Data Engineering, ETL development, and cloud-based analytics solutions.
- Strong expertise in Azure Data Factory, Databricks, Azure Synapse Analytics, Spark, and PySpark.
- Hands-on experience with data lakes, Delta Lake architecture, and modern big data technologies.
- Strong SQL development, query optimization, and performance tuning skills.
- Experience designing scalable cloud-hosted data platforms and enterprise-grade data architectures.
- Knowledge of reporting and analytics tools, including data modeling and dashboard development.
- Familiarity with CI/CD pipelines, DevOps practices, and cloud security concepts such as RBAC.
- Strong problem-solving, communication, and stakeholder management skills.
- Ability to translate business requirements into scalable technical data solutions while maintaining high standards of quality and reliability.
Skills Required
- 4+ years of experience in Data Engineering
- 7+ years of experience in Data Engineering
- Expertise in Azure Data Factory
- Hands-on experience with Databricks
- Experience with Azure Synapse Analytics
- Experience with Spark and PySpark
- Experience with Delta Lake and data lake architectures
- Strong SQL development, query optimization, and performance tuning skills
- Experience designing data warehouses and enterprise-grade data architectures
- Familiarity with CI/CD pipelines and DevOps practices
- Knowledge of cloud security concepts such as RBAC
- Experience with reporting, analytics tools, data modeling, and dashboard development
What We Do
Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.
