Location: Indore, MP
Experience: 5+ Years
Must have:
- ETL/Data Testing/Azure Databricks + Azure Data Factory: 4 years (Required)
- Strong SQL + Python/Py Spark: 3 years (Required)
- Perform ETL testing on large-scale data pipelines built using Azure Databricks and Azure Data Factory
- Validate data flow from multiple source systems to target databases
- Test complex data transformation and consumer merge business rules
- Execute API test scenarios and validate JSON/XML responses
- Write and execute complex SQL queries for data validation
- Perform data validation using SQL, Python, and PySpark
- Validate source, staging, and target tables in Databricks
- Design, build, and maintain automated test frameworks using PyTest
- Automate recurring data quality and regression test cases
- Log, track, and validate defects using Jira
- Create and manage test cases in TestRail
- Work closely with development teams to recreate and validate defects
- Participate in daily agile stand-ups and update task status in Jira
- Maintain code quality using Git and SonarQube
- 5+ years of experience in ETL / Data Testing projects
- Strong hands-on experience with Azure Databricks
- Working experience with Azure Data Factory
- Excellent SQL skills with ability to write complex queries
- Strong experience in Python or PySpark for data validation
- Experience in test automation for data pipelines
- Knowledge of data formats such as JSON, Parquet, Avro
- Experience working with Git repositories, branches, and pull requests
- Familiar with Jira, TestRail, and Agile methodology
- Strong analytical and problem-solving skills
- Ability to work independently in a remote, fast-paced environment
- Quick learner with strong attention to data quality and accuracy
Top Skills
What We Do
Driving Innovation through Advanced Data and AI Services. We offer next-level data and AI services to help you transform your data into actionable insights for a competitive edge. To augment your teams, we offer full-time/contract resources & consulting, design and development services for turnkey projects in the following areas: 01 DATA MODERNIZATION Define Cloud strategy, architecture & roadmap Identify current landscape & catalog data sources Data warehouse design & setup Develop data governance & data quality framework Implement data management technologies Build data analytics capabilities Inculcate data driven culture A future-ready framework to serve all business use cases 02 DATA INTEGRATION & CLOUD MIGRATION Design & develop Optimized data models and data pipelines ETL/ELT workloads & monitoring Processes that scale up and down without performance problems Automate data migration between upstream/downstream (on-prem) systems and Cloud 03 DATA ANALYTICS & AI Data analytics consulting – use-case exploration and building analytics roadmap Data preparation and creating a single version of truth Dashboard & report development AI/ML model selection and development AI/ML model tuning and validation AI/ML model scaling, integration and deployment
