Senior QA Data Engineer

Posted 2 Hours Ago
Be an Early Applicant
Hiring Remotely in India
Remote
Senior level
Software
The Role
Validate data platforms, ETL/ELT pipelines, transformations, and analytical models. Design and run data test plans, execute SQL checks, use Databricks/Delta Lake/Spark for verification, and build automated data tests with Python/PySpark/Pandas. Collaborate with engineers, product owners, and SMEs to find root causes and ensure data quality across delivery.
Summary Generated by Built In

Orion Innovation is a premier, award-winning, global business and technology services firm.  Orion delivers game-changing business transformation and product development rooted in digital strategy, experience design, and engineering, with a unique combination of agility, scale, and maturity.  We work with a wide range of clients across many industries including financial services, professional services, telecommunications and media, consumer products, automotive, industrial automation, professional sports and entertainment, life sciences, ecommerce, and education.

Job Title: QA Data Engineer

Location: Any Orion Innovation office in India(Pune/Mumbai/Kochi/Coimbatore/Chennai/Hyderabad)

Work type: Hybrid 

Role Description / Responsibilities

A technically skilled QA professional specialising in validating data platforms, ETL pipelines, analytical models, and large‑scale data transformations. The QA Engineer works closely with developers, data engineers, product teams, and business SMEs to ensure the quality, reliability, and accuracy of data assets across the delivery lifecycle. of our digital data audit products.

Core Responsibilities

Data Testing & Quality Assurance

  • Design, develop, and execute test plans for data & analytics products, including ingestion pipelines, transformations, data models, and dashboards.
  • Apply robust testing techniques for data completeness, consistency, accuracy, timeliness, and lineage.

Technical & Platform Responsibilities

  • Write and execute SQL/PL‑SQL queries for data verification, profiling, and root‑cause analysis.
  • Use Databricks to inspect data, validate notebook logic, execute test scripts, and investigate transformation failures.
  • Work with Delta Lake, Spark DataFrames, and related components to test scalable data processing.

ETL/ELT and Pipeline Testing

  • Validate end‑to‑end ETL/ELT workflows.
  • Ensure correctness of data transformations and seamless movement between data layers.
  • Conduct regression testing following schema evolution, code updates, or pipeline refactoring.

Collaboration & Delivery Practices

  • Work closely with Data Engineers, Developers‑in‑Test, Business SMEs, and Product Owners to ensure high‑quality delivery.
  • Provide clarity on data issues, identify root causes, and support resolution.
  • Participate in refinement sessions to assess testability of new features and data logic.
  • Contribute to automation frameworks, promoting continuous integration of data tests.

Automation & Scripting (Desirable)

  • Develop automated test scripts using Python, PySpark, or Pandas.
  • Contribute to automated test frameworks that validate transformations and data quality at scale.

Skills & Experience

Mandatory

  • Proven experience testing data and analytics platforms.
  • Advanced SQL and PL/SQL skills.
  • Hands‑on experience with Databricks (notebooks, Delta Lake, Spark).
  • Strong understanding of ETL concepts and data transformation methodologies.
  • Experience validating large datasets, data pipelines, and data models.

Desirable

  • Python for test automation and data manipulation.
  • PySpark for distributed data testing.
  • Pandas for lightweight automation and exploratory validation.
  • Exposure to CI/CD, data observability tools, or version control (Git).

Orion is an equal opportunity employer, and all qualified applicants will receive consideration for employment without regard to race, color, creed, religion, sex, sexual orientation, gender identity or expression, pregnancy, age, national origin, citizenship status, disability status, genetic information, protected veteran status, or any other characteristic protected by law.

Candidate Privacy Policy

Orion Systems Integrators, LLC and its subsidiaries and its affiliates (collectively, “Orion,” “we” or “us”) are committed to protecting your privacy. This Candidate Privacy Policy (orioninc.com) (“Notice”) explains:

  • What information we collect during our application and recruitment process and why we collect it;
  • How we handle that information; and
  • How to access and update that information.

Your use of Orion services is governed by any applicable terms in this notice and our general Privacy Policy.


Skills Required

  • Proven experience testing data and analytics platforms.
  • Advanced SQL and PL/SQL skills.
  • Hands-on experience with Databricks (notebooks).
  • Experience with Delta Lake and Spark (Spark DataFrames).
  • Strong understanding of ETL/ELT concepts and data transformation methodologies.
  • Experience validating large datasets, data pipelines, and data models.
  • Python for test automation and data manipulation.
  • PySpark for distributed data testing.
  • Pandas for lightweight automation and exploratory validation.
  • Exposure to CI/CD processes.
  • Experience with data observability tools.
  • Version control (Git).

Orion Innovation Compensation & Benefits Highlights

The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Orion Innovation and has not been reviewed or approved by Orion Innovation.

  • Wellbeing & Lifestyle Benefits Orion highlights health and well-being initiatives such as fitness, mindfulness, and flexibility/remote options, reinforced by recognition like Cigna’s Healthy Workforce Designation. Flexibility via hybrid/remote work is positioned as a consistent part of the overall rewards experience.
  • Fair & Transparent Compensation Pay is characterized as moderately satisfactory overall, with pockets where compensation is viewed as fair, particularly for some software engineering and certain U.S. roles. Public snapshots also indicate that competitiveness can be stronger in specific markets and functions.
  • Career-Linked Recognition & Rewards Performance-linked outcomes are implied through mentions that hikes can be good when performance is demonstrated. Learning and development programs are also emphasized as part of the broader value proposition tied to career growth.

Orion Innovation Insights

Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Edison, NJ
3,410 Employees
Year Founded: 1993

What We Do

Orion is a leading digital transformation and product development services firm. Headquartered in Edison, NJ, we have a global team of 6,200+ associates, with engineers in 14 major delivery centers across North America, Europe, Asia Pacific and Latin America. For over 25 years, Orion has been solving complex business problems for our clients. Our transformative business solutions are rooted in digital strategy, experience design, and engineering, empowering our clients to operate with agility at scale.​ Our mission is to serve as an agile and trusted partner for business transformation initiatives, providing deep emerging technology, experience design, and domain expertise.​ Our business has more than tripled over the last three years. ​ We have grown aggressively both organically and inorganically, adding new clients, complementary skills, domain expertise, and strengthening our global footprint.

Similar Jobs

GitLab Logo GitLab

Manager, Engineering, Nonlinear Productivity (Friction Elimination & Solutions)

Cloud • Security • Software • Cybersecurity • Automation
Easy Apply
In-Office or Remote
Bangalore, Bengaluru Urban, Karnataka, IND
2500 Employees

JumpCloud Logo JumpCloud

Senior Channel Revenue Operations - India

Cloud • Information Technology • Security • Software
Easy Apply
In-Office or Remote
Bangalore, Bengaluru, Karnataka, IND
800 Employees

ServiceNow Logo ServiceNow

Senior Manager, Software Engineering

Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Remote or Hybrid
Hyderabad, Telangana, IND
29000 Employees

Capco Logo Capco

Managing Principal - Data

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
India
6000 Employees

Similar Companies Hiring

Hanover Park Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
42 Employees
Kepler  Thumbnail
Fintech • Software
New York, New York
6 Employees
Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account