The Role
The AI Quality Assurance Analyst will validate and improve AI-driven solutions in mortgage processes, ensuring compliance and performance reliability through testing and cross-team collaboration.
Summary Generated by Built In
We are seeking an AI Quality Assurance (QA) Analyst to support the testing, validation, and continuous improvement of AI-driven solutions within our mortgage platform. This role ensures that AI models, automation tools, and system integrations function accurately, compliantly, and efficiently across the loan lifecycle.
The ideal candidate has experience in mortgage operations (e.g., underwriting, processing, or closing) combined with strong QA/testing skills and an interest in AI technologies.
The ideal candidate has experience in mortgage operations (e.g., underwriting, processing, or closing) combined with strong QA/testing skills and an interest in AI technologies.
Responsibilities and Duties:
- Validate AI-driven outputs related to loan processing, underwriting, document recognition, and decisioning.
- Design and execute test cases for AI models, automation workflows, and system enhancements.
- Identify, document, track defects, inconsistencies, and performance issues.
- Perform regression, functional, and user acceptance testing (UAT) for mortgage systems.
- Collaborate with product, engineering, and data science teams to improve AI accuracy and reliability.
- Analyze AI model behavior and flag potential risks, biases, or compliance concerns.
- Ensure alignment with mortgage industry regulations and investor guidelines (e.g., Non-QM with the future agency).
- Support data validation efforts, including OCR (optical character recognition) and document classification tools.
- Monitor production performance and provide feedback for ongoing AI model training and optimization.
- Assist in developing QA standards and best practices for AI implementations.
Education and Experience:
- 3+ years of experience in QA, software testing, or mortgage operations
- Strong understanding of the mortgage lifecycle, including origination, processing, underwriting, and closing
- Experience with Loan Origination Systems (LOS), such as Vesta, LauraMac, or similar platforms
- 2+ years of ServiceNow ticketing experience required
- Familiarity with QA methodologies, including test planning, execution, and defect tracking
- Strong analytical and problem-solving skills with a high level of attention to detail
- Ability to analyze system behavior and validate expected versus actual results
Preferred Qualifications:
- Experience with AI/ML tools, automation platforms, or intelligent document processing
- Understanding of OCR, NLP, or decisioning engines
- Knowledge of mortgage compliance and regulatory requirements
- Experience with SQL, data validation, or basic scripting is a plus
- Exposure to Agile or Scrum development environments
- Ability to work in a hybrid office setting in Bloomington, MN
Key Competencies:
- AI & QA Testing Expertise: Designs and executes test cases to validate AI models, automation workflows, and system functionality.
- Analytical & Critical Thinking: Evaluates AI outputs, identifies discrepancies, and assesses model behavior for accuracy and risk.
- Mortgage Domain Knowledge: Applies understanding of loan lifecycle, documentation, and regulatory requirements to testing scenarios.
- Attention to Detail & Data Validation: Ensures precision in testing, defect tracking, and validation of OCR and document classification outputs.
- Cross-Functional Collaboration: Works effectively with product, engineering, and data science teams to improve AI performance.
How This Role Demonstrates Our Values:
- Integrity: Ensures AI-driven decisions and outputs are accurate, compliant, and aligned with regulatory and investor requirements.
- Collaboration: Partners with cross-functional teams to enhance AI solutions and support seamless system performance.
- Excellence: Maintains high standards in testing, validation, and continuous improvement of AI-driven processes.
- Critical Curiosity: Investigates AI behavior, identifies potential risks or biases, and seeks opportunities to improve model accuracy and efficiency.
Benefits
- Competitive compensation package, including base salary and performance-based bonus opportunities
- 401(k) plan with 100% company match up to 4%
- Comprehensive health coverage: medical, dental, vision, HSA, and FSA options
- Generous paid time off: 20 days PTO, company holidays, and sick time
- Paid parental leave
- Company-paid life insurance and disability coverage
- Employee Assistance Program (EAP): mental health, financial, and wellness support
- Professional development: tuition reimbursement and growth opportunities
- Commuter and transit benefits
Successful applicants will exemplify strong ethics, integrity, respect for others, accountability for decisions and actions, and good citizenship.
Maintaining a reliable, uninterrupted high speed internet connection is a requirement of hybrid or remote positions.
All job duties and responsibilities must be performed within the guidelines of the Verus Residential Mortgage Employee Handbook and established company policies and procedures. It is the responsibility of each employee to maintain confidentiality of the company, its clients and to follow applicable laws and regulations in the performance of duties.
Verus Mortgage Capital is an equal opportunity employer. All qualified applicants are welcomed to apply and will receive consideration for employment without unlawful discrimination because of a person’s race, religious creed, color, national origin, citizenship status, ancestry, marital status, sex, age, or sexual orientation, or because of a person’s disability or medical condition.
About
Invictus Capital Partners, LP (“Invictus”), a leading investment firm, and its subsidiary Verus Residential Loanco, LLC (“Verus,” and together with Invictus, the “Companies”), manage and oversee investments in Non-Agency single family residential mortgage loans. Invictus is located in Washington, D.C. and has approximately 50 employees, and Verus is located in Minneapolis and has approximately 200 employees. The Companies have overseen the acquisition of over $38 billion of mortgage loans since their inception. In addition, Invictus manages over $19 billion in gross assets and has completed over 70 rated securitizations. Interested candidates can learn more about the Companies by visiting www.invictuscp.com and www.verusmc.com.
Skills Required
- 3+ years of experience in QA, software testing, or mortgage operations
- Strong understanding of the mortgage lifecycle, including origination, processing, underwriting, and closing
- Experience with Loan Origination Systems (LOS), such as Vesta, LauraMac, or similar platforms
- 2+ years of ServiceNow ticketing experience required
- Familiarity with QA methodologies, including test planning, execution, and defect tracking
- Strong analytical and problem-solving skills with a high level of attention to detail
- Ability to analyze system behavior and validate expected versus actual results
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Invictus Capital Partners is a real estate credit focused alternative asset manager and investment management firm, established in 2008, specializing in opportunistic credit strategies and managing portfolios of real estate debt securities and loans.
