ETL/ Bigdata Tester

Posted 4 Days Ago
Be an Early Applicant
Indore, Madhya Pradesh, IND
In-Office
Senior level
Information Technology
The Role
Design, build, and maintain automated testing frameworks for large-scale data platforms and web applications. Validate ETL/ELT pipelines, data transformations, data quality, schema migrations, APIs, databases, and user workflows. Develop Java and Python automation using Selenium, Cucumber, and Pytest; write advanced SQL for data reconciliation; integrate tests into CI/CD pipelines; and manage defects through root cause analysis and issue tracking.
Summary Generated by Built In

We are seeking an experienced Big Data Test Automation Engineer to design, build, and maintain robust test automation frameworks across our large-scale data platforms and web applications. In this role, you will validate complex data pipelines (ETL/ELT), ensure high data integrity across distributed data stores, and automate both back-end data processing and front-end interface workflows using modern test frameworks.

Location: Indore, Gurugram, Raipur

Key Responsibilities
  • Test Framework Development: Design, implement, and maintain scalable test automation frameworks from scratch using Java and Python.
  • ETL & Big Data Validation: Formulate automated test suites to validate complex ETL pipelines, data transformations, data quality, data completeness, and schema migrations across distributed environments.
  • UI & BDD Automation: Automate functional, regression, and end-to-end user workflows using Selenium WebDriver integrated with BDD Cucumber.
  • Service & Pipeline Testing: Build and execute test suites using Pytest for data scripts, API services, and scheduled pipeline jobs.
  • Database & Query Verification: Author advanced SQL queries to extract, reconcile, and validate high-volume data sets across relational databases, data warehouses, and data lakes.
  • Functional & Integration Testing: Partner with product managers and data engineers to derive comprehensive test scenarios, edge cases, and acceptance criteria from functional requirements.
  • CI/CD Integration: Integrate automated test suites into CI/CD pipelines (e.g., Jenkins, GitHub Actions, GitLab CI) to ensure continuous quality gates across all release cycles.
  • Defect Management: Identify, report, trace, and isolate defects using issue tracking tools (e.g., JIRA), performing thorough root cause analysis on pipeline or automation failures.
Required Qualifications
  • Experience: 5 years of hands-on experience in Quality Assurance and Test Automation, with significant focus on Data Platform or Big Data testing.
  • Programming Languages: Strong proficiency in both Java and Python.
  • Automation Tools & Frameworks:
    • Hands-on expertise with Selenium WebDriver.
    • Strong working knowledge of BDD frameworks (Cucumber / Gherkin syntax).
    • Deep experience with Pytest for Python-based test development.
  • Database & ETL Skills:
    • Advanced SQL skills (joins, window functions, aggregations, subqueries) for large-scale data validation.
    • Proven experience in ETL/ELT Testing, validating source-to-target data mappings, reconciliation, and schema integrity.
  • Testing Methodologies: Solid foundation in Functional Testing, Regression Testing, End-to-End Testing, and Data Quality Assurance best practices.
  • Education: Bachelor’s or Master’s degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline (or equivalent practical experience).


Why Join Us?

  • Work on cutting-edge cloud data projects.
  • Leadership opportunity with high ownership.
  • Dynamic and growth-oriented work environment.

Skills Required

  • At least 5 years of hands-on experience in Quality Assurance and Test Automation, including significant Data Platform or Big Data testing
  • Strong proficiency in Java and Python
  • Hands-on expertise with Selenium WebDriver
  • Working knowledge of BDD frameworks, including Cucumber and Gherkin syntax
  • Deep experience with Pytest for Python-based test development
  • Advanced SQL skills, including joins, window functions, aggregations, and subqueries
  • Proven experience with ETL/ELT testing, source-to-target mappings, reconciliation, and schema integrity validation
  • Experience with functional, regression, end-to-end, and data quality testing
  • Bachelor's or Master's degree in Computer Science, Software Engineering, Information Technology, or a related technical discipline, or equivalent practical experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Phoenix, AZ
500 Employees
Year Founded: 2018

What We Do

We Empower & Transform customers’ business through the use of digital technologies. Our core focus areas are Big-Data, Cloud, Analytics (AI, ML), Blockchain, Automation & Mobility. We enable navigation of digital transformation for several fortune 1000 clients in USA, Canada, UK & India. NucleusTeq is a software services, solutions & products company empowering & transforming customers’ business through the use of digital technologies such as Big-Data, Analytics (AI, ML), Cloud, Enterprise Automation, Block-chain, Mobility, CRM & ERP.

Similar Jobs

The Aerospace Corporation Logo The Aerospace Corporation

Sr Advanced Software Engr

Aerospace • Artificial Intelligence • Cloud • Machine Learning • Software • Cybersecurity • Defense
Remote or Hybrid
India
4600 Employees

Coursera + Udemy  Logo Coursera + Udemy

LLMops Engineer

Artificial Intelligence • Consumer Web • Edtech • Enterprise Web • HR Tech • Social Impact • Generative AI
Remote or Hybrid
India
1500 Employees

Pfizer Logo Pfizer

Sustainability & Environmental Footprint Manager

Artificial Intelligence • Healthtech • Machine Learning • Natural Language Processing • Biotech • Pharmaceutical
In-Office or Remote
8 Locations
121990 Employees
Remote or Hybrid
2 Locations
289097 Employees

Similar Companies Hiring

NODA AI Thumbnail
Artificial Intelligence • Information Technology • Software • Cybersecurity
Austin, TX
54 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
567 Employees
RapidScale Thumbnail
Cloud • Information Technology • Consulting
Raleigh, NC
600 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account