This role is for one of the Weekday's clients
Salary range: Rs 800000 - Rs 2000000 (ie INR 8 - 20 LPA)
Min Experience: 5+ years
Location: Bengaluru, Hyderabad, Telangana, India, Pune, Kolkata, West Bengal, India, Chennai, Tamil Nadu, India
JobType: full-time
Mandatory Skills: Python, PySpark, Etl, Sql, Azure Databricks, Azure Datafactory.
Primary Roles and Responsibilities:
● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
● Ability to provide solutions that are forward-thinking in data engineering and analytics space
● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow
Requirements
Skills and Qualifications:
● Bachelor's and/or master’s degree in computer science or equivalent experience.
● Must have total 6+ yrs. of IT experience and 3+ years' experience in Data warehouse/ETL projects.
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in AWS/ Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)
● Experience working with structured and unstructured data including imaging & geospatial data.
● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
● Should have experience working in Agile methodology
● Strong verbal and written communication skills.
● Strong analytical and problem-solving skills with a high attention to detail.
Azure Databricks, PySpark, SQL
Good-to-have skillsPython, Azure Data Factory, ETL
Skills Required
- Bachelor's or Master's degree in Computer Science or equivalent experience
- Total 6+ years IT experience
- 3+ years experience in Data Warehouse/ETL projects
- Must-have skills: Azure Databricks, PySpark, SQL
- Hands-on experience in Python, Spark (PySpark)
- Experience with Azure and/or AWS cloud stack
- Deep understanding of Star and Snowflake dimensional modeling
- Strong knowledge of Data Management principles
- Good understanding of Databricks Data & AI platform and Databricks Delta Lake architecture
- Experience building ETL / data warehouse transformation processes
- Orchestrate data pipelines using Airflow
- Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshooting
- Experience working in Agile methodology
- Strong verbal and written communication skills
- ETL with batch and streaming (Kinesis)
- Experience with Apache Kafka for streaming/event-based data
- Experience with Hadoop ecosystem (Hive, Pig, Impala)
- Experience with NoSQL databases (MongoDB, Cassandra, Neo4j)
- Experience working with structured and unstructured data including imaging & geospatial data
- Experience in DevOps tools such as Terraform, CircleCI, GIT
- Databricks Certified Data Engineer Associate/Professional (desirable)
What We Do
Weekday is an AI-powered recruitment platform that helps startups hire top-tier engineering and product talent. By leveraging a massive database of white-collar professionals and advanced outreach tools, the company streamlines the hiring process through automated sourcing, AI-driven resume screening, and white-glove contingency services. Their mission is to modernize recruitment by enabling companies to discover and engage passive candidates efficiently, ensuring high-quality hires for critical roles.
.png)
