Senior QA Engineer (SQL, Big Data (Spark, Hive), Automation & ETL Support)

Sorry, this job was removed at 04:13 p.m. (CST) on Sunday, Jun 08, 2025
Be an Early Applicant
2 Locations
In-Office
Fintech • Financial Services
The Role
Job Summary

Synechron is seeking a detail-oriented and experienced Senior Quality Assurance Engineer to join our team supporting data engineering, ETL, and analytics initiatives. In this role, you will oversee data validation processes, develop and optimize complex data pipelines, and collaborate with cross-functional teams to ensure data integrity and reliability. Your expertise in big data tools, SQL, and automation frameworks will play a key role in improving data accuracy, operational efficiency, and supporting strategic data-driven decision-making across the organization.

This position offers an opportunity to lead quality efforts in a fast-paced, cloud-enabled environment, contributing directly to the organization’s success in managing large datasets with precision.

Software Requirements

Required Skills:

  • Proficiency in writing, optimizing, and troubleshooting SQL queries (including complex joins, aggregations, and filters)
  • Strong familiarity with big data tools such as Spark, Hive, Hadoop, and Kafka
  • Experience designing, developing, and maintaining ETL pipelines to support data ingestion and transformation
  • Hands-on experience in creating automation frameworks using tools like Selenium and Cucumber
  • Programming knowledge in Java, Shell scripting, Python (Optional), and experience with Behavior-Driven Development (BDD)
  • Familiarity with data warehousing platforms, especially Teradata and Oracle

Preferred Skills:

  • Exposure to cloud data services such as AWS (Redshift, S3, Athena, EMR) and integration
  • Knowledge of cloud-based tools for data processing and storage
Overall Responsibilities
  • Develop, implement, and optimize complex SQL queries for data extraction, validation, and transformation
  • Design and manage scalable ETL workflows ensuring data quality, accuracy, and completeness
  • Validate data through comprehensive testing and scripting automation to improve efficiency
  • Write and execute detailed test plans, test scenarios, and automate testing using Selenium and Cucumber
  • Collaborate with data engineers, business analysts, and QA teams to identify gaps and improve data pipelines
  • Support data ingestion, processing, and transformation activities in Hadoop ecosystems and cloud environments
  • Monitor, troubleshoot, and resolve issues in data workflows, pipelines, and related infrastructure
  • Document processes, testing procedures, and incident resolutions to promote knowledge sharing
  • Drive process improvements, best practices, and automation initiatives to enhance data quality and operational efficiency

Strategic objectives:

  • Ensure high data quality and integrity across all critical data pipelines
  • Automate routine validation and testing activities to reduce manual effort
  • Support reliable, timely, and scalable data delivery for analytics and reporting

Performance outcomes:

  • Minimal data discrepancies and pipeline failures
  • Faster turnaround for data validation and issue resolution
  • Clear documentation and proactive communication with stakeholders
Technical Skills (By Category)

Data Processing & ETL (Essential):

  • Deep experience building and maintaining large-scale ETL pipelines and data workflows
  • Proficiency with Spark, Hive, Hadoop, and related big data tools
  • SQL query development and optimization for diverse data sources

Programming & Scripting (Essential):

  • Shell scripting (Bash/sh) for automation tasks and troubleshooting
  • Experience with Java, Python (Optional) for automation and testing frameworks
  • Knowledge of BDD tools like Cucumber and automation frameworks such as Selenium

Data Warehousing & Databases (Essential):

  • Experience working with Teradata and Oracle data warehouses
  • Data validation, reconciliation, and quality assurance practices

Tools & Methodologies (Preferred):

  • Agile methodologies for software development, testing, and deployment
  • Use of collaboration tools like Jira and Confluence for managing requirements, test cases, and documentation

Cloud Technologies (Preferred):

  • Basic experience with AWS services such as Redshift, S3, Athena, and EMR
Experience Requirements
  • 6-8 years supporting data engineering, data validation, or ETL processes in production environments
  • Extensive hands-on experience in designing and testing data pipelines, especially in big data ecosystems
  • Proven experience with automation testing, scripting, and data validation scripting
  • Prior experience in financial services or data-intensive industries is a plus
  • Experience working within Agile teams and supporting cloud deployment models
Day-to-Day Activities
  • Develop and optimize SQL queries and scripts for data validation and testing
  • Build, maintain, and monitor ETL workflows in Hadoop and cloud environments
  • Automate routine testing, validation, and data quality checks
  • Collaborate with data engineers, business teams, and QA to address data discrepancies and pipeline issues
  • Perform root cause analysis on data pipeline failures and recommend improvements
  • Document testing procedures, incidents, and best practices
  • Support deployment activities, ensuring minimal disruption during upgrades or changes
  • Participate in daily stand-ups, planning sessions, and review meetings
Qualifications
  • Bachelor’s or Master’s degree in Computer Science, Data Science, Engineering, or related field
  • Strong proficiency in SQL and big data tools such as Spark, Hive, and Hadoop
  • Hands-on scripting experience in Shell and programming languages like Java and Python (preferred)
  • Experience in test automation frameworks such as Selenium and Cucumber (preferred)
  • Knowledge of cloud data services (AWS, Redshift, S3, Athena, EMR) is a plus
  • Excellent analytical, troubleshooting, and communication skills
  • Ability to work independently and collaboratively in an agile environment
Professional Competencies
  • Strong analytical and problem-solving skills focused on data integrity
  • Effective communication with technical teams and non-technical stakeholders
  • Leadership qualities to support knowledge sharing and process improvements
  • Organizational and time management skills to prioritize tasks efficiently
  • Adaptability and eagerness to learn emerging data technologies and tools
  • Capacity to work in fast-paced, evolving environments supporting continuous delivery

S​YNECHRON’S DIVERSITY & INCLUSION STATEMENT
 

Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.

All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

Candidate Application Notice

Similar Jobs

TransUnion Logo TransUnion

Lead Software Engineer

Big Data • Fintech • Information Technology • Business Intelligence • Financial Services • Cybersecurity • Big Data Analytics
Hybrid
Pune, Mahārāshtra, IND
13000 Employees

CrowdStrike Logo CrowdStrike

Sales Operation Intern

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
10000 Employees

CrowdStrike Logo CrowdStrike

Sr. Manager, Engineering

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
10000 Employees
100K-150K Annually

CrowdStrike Logo CrowdStrike

Engineering Manager

Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Hybrid
Pune, Mahārāshtra, IND
10000 Employees
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
Maharashtra
12,827 Employees
Year Founded: 2001

What We Do

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our FinLabs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more. Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 14,700+, and has 48 offices in 19 countries within key global markets. For more information on the company, please visit our website: www.synechron.com.

Similar Companies Hiring

Camber Thumbnail
Social Impact • Healthtech • Fintech
New York, NY
53 Employees
Rain Thumbnail
Web3 • Payments • Infrastructure as a Service (IaaS) • Fintech • Financial Services • Cryptocurrency • Blockchain
New York, NY
40 Employees
Scotch Thumbnail
Software • Retail • Payments • Fintech • eCommerce • Artificial Intelligence • Analytics
US
25 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account