The Role
Tests AWS Glue data pipelines and file-processing interfaces across functional, integration, reconciliation, regression, performance, resiliency, security, and production scenarios. Defines and validates data quality rules for completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, business rules, and schema consistency. Reviews AWS configurations, parameters, logs, metrics, execution history, authentication, connectivity, retries, timeouts, and delivery validation across S3, SFTP/FTPS, AWS Transfer Family, APIs, and partner endpoints.
Summary Generated by Built In
The candidate should be able to define and validate data quality rules covering:
- Completeness
- Accuracy
- Consistency
- Validity
- Uniqueness
- Timeliness
- Referential integrity
- Conformity to business rules
- Schema and metadata consistency
Testing Areas
The role will include the following types of testing:
- Functional testing
- End-to-end integration testing
- Data validation testing
- Source-to-target reconciliation
- Parallel Testing with legacy interfaces testing.
- Regression testing
- System integration testing
- User acceptance testing support
- Negative testing
- Exception and error-path testing
- Performance and volume testing
- Scalability testing
- Restart and recovery testing
- Failover and resiliency testing
- Security and access testing
- Production smoke testing
- Operational and monitoring validation
Requirements
- AWS Glue Jobs
- AWS Glue Workflows
- Amazon S3
- Amazon CloudWatch
- AWS IAM
- Amazon EventBridge
- AWS Lambda
- Amazon SNS
- Amazon SQS
- AWS Secrets Manager
- AWS Step Functions
- AWS KMS
- Ability to review AWS Console configurations, job parameters, logs, metrics, and execution history.
- Data Pipeline and File Processing Interface Testing
- Strong understanding of Inbound and Outbound Data File Processing / Data Pipeline.
- Experience testing inbound/outbound file transfers across S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints, including authentication, connectivity, retry, timeout, and delivery validation.
Skills Required
- Ability to define and validate data quality rules covering completeness, accuracy, consistency, validity, uniqueness, timeliness, referential integrity, business rules, and schema or metadata consistency.
- Experience with AWS Glue Jobs and AWS Glue Workflows.
- Experience with Amazon S3, Amazon CloudWatch, AWS IAM, Amazon EventBridge, AWS Lambda, Amazon SNS, Amazon SQS, AWS Secrets Manager, AWS Step Functions, and AWS KMS.
- Ability to review AWS Console configurations, job parameters, logs, metrics, and execution history.
- Experience with data pipeline and file-processing interface testing.
- Strong understanding of inbound and outbound data file processing and data pipelines.
- Experience testing inbound and outbound file transfers across S3, SFTP/FTPS, AWS Transfer Family, APIs, and external partner endpoints.
- Experience validating authentication, connectivity, retries, timeouts, and delivery outcomes.
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
ProArch was founded on the belief that a future where change is ‘business as usual’ is fundamentally more exciting than one where it is not. We accelerate value and increase resilience for our clients with consulting and technology - enabled by cloud, guided by data, fueled by apps, and secured by design
