- Design and execute comprehensive data quality and testing strategies for cloud-based data platforms, pipelines, APIs, and applications.
- Validate end-to-end data pipelines, including data ingestion, transformation, processing, storage, and downstream consumption.
- Perform data validation across streaming and batch-processing pipelines, ensuring data accuracy, completeness, consistency, and integrity.
- Develop and maintain Python-based automation frameworks for backend, REST API, and data validation testing.
- Develop UI automation tests using Playwright and perform manual validation where required.
- Perform RESTful API testing, including functional, integration, negative, regression, and end-to-end validation.
- Design and execute performance, load, stress, latency, and throughput testing using tools such as k6.
- Validate data across relational, document, analytical, and columnar databases, including PostgreSQL/AlloyDB, MongoDB, BigQuery, and optionally ClickHouse.
- Work extensively within the Google Cloud Platform (GCP) ecosystem, including Pub/Sub, GCS, Dataflow, Dataproc, and Cloud Composer.
- Troubleshoot data discrepancies, pipeline failures, API issues, and performance bottlenecks, collaborating closely with Data Engineering, Development, DevOps, and Product teams.
- Build automated reconciliation and data-validation checks to identify missing, duplicate, inconsistent, incorrect, or delayed data.
- Contribute to CI/CD processes by integrating automated data, API, and application quality checks into deployment pipelines.
- Support data profiling, governance, cataloging, lineage, and automated data-quality controls, preferably using Dataplex.
- Strong experience as a Data Quality Engineer, SDET, Data Test Engineer, or QA Automation Engineer working with modern data platforms.
- Strong hands-on experience with Python-based test automation.
- Strong experience testing RESTful APIs and backend services.
- Experience with Playwright or similar UI automation frameworks.
- Hands-on experience with GCP data technologies, particularly Pub/Sub, GCS, Dataflow, Dataproc, Cloud Composer, and BigQuery.
- Strong SQL and data-validation skills with experience working across large and complex datasets.
- Experience with PostgreSQL/AlloyDB, MongoDB, and BigQuery.
- Hands-on performance testing experience using k6 or comparable modern load-testing tools.
- Strong understanding of ETL/ELT, batch and streaming pipelines, data reconciliation, schema validation, and data-quality principles.
- Strong analytical, debugging, problem-solving, and cross-functional communication skills.
- Experience with ClickHouse or other high-performance columnar databases.
- Experience with Dataplex for data profiling, cataloging, governance, and automated data-quality controls.
- Experience integrating automated tests into CI/CD pipelines.
- Knowledge of data observability, data lineage, metadata management, and cloud-native monitoring
Skills Required
- 7+ years of experience in Data Quality, Data Analysis, Data Governance, or Business Intelligence.
- Advanced SQL and hands-on experience profiling and validating large, complex datasets across ETL pipelines and cloud data warehouses.
- Solid grounding in data governance, lineage, metadata management, and master data concepts.
- Experience working with both relational and non-relational data stores.
- Strong analytical rigor, attention to detail, and stakeholder communication skills.
- Experience supporting AI/ML or advanced analytics initiatives, including validating data that feeds forecasting or optimization models.
- Experience with data quality automation or monitoring frameworks.
- Experience working within Agile delivery environments.
- Background in logistics, supply chain, retail, financial services, or healthcare data.
- Knowledge of relevant regulatory or data compliance frameworks.
What We Do
@TechBlocks we power the software defined industries (SDI) of today and tomorrow. We are a software engineering and consulting firm. We build modern digital value chains and businesses reimagined to create frictionless experiences for innovative monetization methods and drive unforeseen efficiencies. We are known to build world class custom platforms and products that are cloud native for some of the worlds largest brands. We are the go to technology partners for born in digital businesses that grew with us from "Concept to Commercialization" and have revenues between $100M - $10B. We help modern businesses transition just from a technology outsourcing mentality to help create globally distributed digital COEs and mature them. Our converged COEs that we create in partnership with our clients help power software factories that are extremely dynamic. We have created modern digital COEs and factories that are created with a single minded goal to future proof our clients businesses. Everything we do is centred around two philosophies and practices - Design Thinking and Lean Engineering. Whether it is building digital commerce platforms, marketplace for worlds largest retailers or smart utilities applications and products or digital health products/platforms that power wearables, patches or devices across healthcare landscape; we do it all with speed and sophistication that is unmatched in the industry
