The Role
The Business Analyst - Verification Engineer role involves validating AI-generated outputs, collaborating with teams to ensure alignment with systems, developing test cases, and improving QA processes in an Agile environment.
Summary Generated by Built In
Job Title: Business Analyst – Verification Engineer (QA)
Company: BLN24
About Us: We find strength in teamwork-a better you is a better us
BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client’s end-state, and then seamlessly integrating within each Agency’s organization to improve and enhance strategic and technical operations and deployments.
Position Overview:
BLN24 is seeking a Business Analyst – Verification Engineer (Quality Assurance)
to support human-level validation activities associated with Gen-AI led test-
driven design processes. In this role, you will ensure AI-generated outputs are
thoroughly evaluated, validated, and consistently aligned with established system
expectations, business requirements, and operational workflows.
The ideal candidate will collaborate closely with cross-functional teams, including
developers, business analysts, product owners, and AI engineering teams to
identify discrepancies, analyze AI-generated results, and refine verification
processes that uphold system integrity and quality. This position requires strong
analytical skills, attention to detail, and the ability to design and execute
validation scenarios that challenge both AI-driven outputs and underlying system
logic.
Key Responsibilities:
Required Qualifications:
Preferred Qualifications:
Technical Skills:
What BLN24 brings to the Game:
BLN24 benefits are game changing. We like our team to play hard and that means they need to be taken care of — physically, financially, and emotionally. We make sure to keep them in the game by giving them access to generous medical, dental, and vision plans.
Company: BLN24
About Us: We find strength in teamwork-a better you is a better us
BLN24 is an award-winning Management Consulting Firm that supports the U.S. Federal Government in successfully achieving their mission and goals. Our service and solutions delivery start with understanding each client’s end-state, and then seamlessly integrating within each Agency’s organization to improve and enhance strategic and technical operations and deployments.
Position Overview:
BLN24 is seeking a Business Analyst – Verification Engineer (Quality Assurance)
to support human-level validation activities associated with Gen-AI led test-
driven design processes. In this role, you will ensure AI-generated outputs are
thoroughly evaluated, validated, and consistently aligned with established system
expectations, business requirements, and operational workflows.
The ideal candidate will collaborate closely with cross-functional teams, including
developers, business analysts, product owners, and AI engineering teams to
identify discrepancies, analyze AI-generated results, and refine verification
processes that uphold system integrity and quality. This position requires strong
analytical skills, attention to detail, and the ability to design and execute
validation scenarios that challenge both AI-driven outputs and underlying system
logic.
Key Responsibilities:
- Support human-level validations for Gen-AI led test-driven design processes.
- Ensure AI-generated output consistently aligns with business and system expectations.
- Collaborate with cross-functional teams to refine and validate AI-driven solutions.
- Identify, analyze, document, and report discrepancies between AI outputs and expected system behaviors.
- Develop and execute test cases, validation scenarios, and quality assurance procedures.
- Support continuous improvement of verification methodologies, validation frameworks, and QA processes.
- Participate in requirements analysis, workflow validation, and user acceptance testing activities.
- Assist with tracking validation results, defects, and remediation activities using issue management tools.
- Analyze system behaviors, AI responses, and operational outcomes to improve solution accuracy and reliability.
- Support Agile development and iterative testing processes within AI-enabled environments.
Required Qualifications:
- Bachelor’s degree in information systems, Computer Science, Business, Engineering, or related field.
- 1+ year of experience in Quality Assurance, Verification & Validation (V&V), Business Analysis, or software testing.
- Experience supporting human-level validation or QA processes for AI-driven or automated systems.
- Familiarity with test-driven development methodologies and QA best practices.
- Knowledge of automated testing tools, validation frameworks, or AI model evaluation concepts.
- Experience with defect tracking and collaboration tools such as Jira, Azure DevOps, or similar platforms.
- Strong analytical, troubleshooting, and communication skills.
- Ability to work collaboratively within cross-functional Agile teams.
Preferred Qualifications:
- Experience with AI/ML-enabled systems or Gen-AI validation processes.
- Experience supporting Federal or enterprise environments preferred.
Technical Skills:
- Quality Assurance (QA)
- Verification & Validation (V&V)
- Gen-AI Output Validation
- Test Case Development
- Defect Tracking and Analysis
- Agile Methodologies
- Jira / Azure DevOps
- Data Analysis and Troubleshooting
- Continuous Improvement Processes
What BLN24 brings to the Game:
BLN24 benefits are game changing. We like our team to play hard and that means they need to be taken care of — physically, financially, and emotionally. We make sure to keep them in the game by giving them access to generous medical, dental, and vision plans.
- You can join one of the fastest growing companies headquartered in the Washington DC Metro Area. We give you the opportunity to work in different sectors, so you have the chance at variety while maintaining stability.
- Flexibility at BLN24 allows each individual the opportunity to balance quality work and their personal lives. Depending on projects, we allow remote working opportunities so you can always be in the game no matter where you call home.
Skills Required
- Bachelor's degree in information systems, Computer Science, Business, Engineering, or related field
- 1+ year of experience in Quality Assurance, Verification & Validation (V&V), Business Analysis, or software testing
- Experience supporting human-level validation or QA processes for AI-driven or automated systems
- Familiarity with test-driven development methodologies and QA best practices
- Knowledge of automated testing tools, validation frameworks, or AI model evaluation concepts
- Experience with defect tracking and collaboration tools such as Jira, Azure DevOps, or similar platforms
- Strong analytical, troubleshooting, and communication skills
- Ability to work collaboratively within cross-functional Agile teams
- Experience with AI/ML-enabled systems or Gen-AI validation processes
- Experience supporting Federal or enterprise environments
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
BLN24 is a digital creative agency that is an 8(a) minority-owned small disadvantaged business (SDB). We add value by merging our commercial and government experience to create award-winning solutions for clients with the most important missions globally. BLN24 is a first-class communication, marketing, and technology agency for federal agencies and Fortune 500 companies. Founded by two former Booz Allen Hamilton employees, BLN24’s industry-lead marketing and communications strategies along with production and visual design has been on web and print advertisement campaigns as well as television networks across the nation.
