Quality Assurance Analyst/Conversational AI Testing

Posted 10 Days Ago
Be an Early Applicant
Adelphi, MD, USA
In-Office
Senior level
Information Technology • Business Intelligence • Consulting
Ignite innovation from within and deliver leading-edge solutions.
The Role
Lead QA for a conversational AI platform: define test strategies, design and run functional, performance, usability, integration, security, and UAT tests. Report defects and metrics, analyze results, collaborate with developers to improve models, and refine training data and model parameters.
Summary Generated by Built In

       Business Technology Integrators (BTI) is a Service-Disabled Veteran-Owned Small Business (SDVOSB) with more than 25 years of experience delivering innovative IT solutions to the Federal Government. We are committed to excellence, innovation, and supporting mission-critical programs that serve our nation.
We are seeking a skilled Quality Assurance Analyst to join our team and support testing activities for Kore AI's conversational AI platform. The ideal candidate will have a strong background in software testing, with a focus on AI and natural language processing technologies. 

Responsibilities

· Define functional and non-functional test strategies for the conversational AI platform.

· Collaborate with AI developers and product owner to design comprehensive test cases covering various user scenarios, edge cases, and potential failure points.

· Conduct rigorous testing of conversational AI models, including:

o Functional testing to verify correct behavior, assess the accuracy, relevance, and coherence of AI-generated responses.

o Performance testing to evaluate response times, system load, and resource utilization.

o Usability testing to assess the user experience and identify areas for improvement.

o Coordinate security testing with the Information Technology Security team to identify and mitigate potential vulnerabilities.

o Integration testing to ensure the product is integrated with various platforms and that data integrity is maintained between various back-end systems.

o Coordinate with cross-functional quality assurance resources to conduct end to end testing between other systems/platforms.

· Generate detailed reports on test executions, including bug reports, performance metrics, and user experience insights.

· Analyze test results to identify trends, patterns, and areas requiring improvement and work with the product owner for prioritization in the product backlog.

· Track and manage bug resolution and feature enhancements.

· Provide actionable feedback to AI developers to improve model performance, accuracy, and user satisfaction.

· Collaborate with the team to refine training data, adjust model parameters, and optimize algorithms.

· Own User Acceptance Testing (UAT) and facilitate by providing demos and test data of the product to the UAT testers.

· Keep up to date with the latest developments in conversational AI, natural language processing, and machine learning.

· Research and explore new testing methodologies and tools to enhance the QA process.

Requirements

· Bachelor’s degree in computer science, information technology, or related field.

· At least 5 years of experience in software testing and quality assurance methodologies.

· Knowledge of AI and machine learning concepts, particularly in natural language processing.

· Expertise in testing conversational AI or chatbot systems.

· Excellent analytical and problem-solving abilities.

· Strong communication and collaboration skills.

Preferred Qualifications

· Experience in testing Chatbots such as Microsoft Bot and Kore AI platform.

· Certifications in software testing or AI (e.g., ISTQB, AI Testing certification).

Skills Required

  • Bachelor's degree in computer science, information technology, or related field
  • At least 5 years of experience in software testing and quality assurance methodologies
  • Knowledge of AI and machine learning concepts, particularly in natural language processing
  • Expertise in testing conversational AI or chatbot systems
  • Excellent analytical and problem-solving abilities
  • Strong communication and collaboration skills
  • Experience in testing Chatbots such as Microsoft Bot and Kore AI platform
  • Certifications in software testing or AI (e.g., ISTQB, AI Testing certification)
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Washington, DC
71 Employees
Year Founded: 1999

What We Do

Business Technology Integrators (BTI) is a Service-Disabled Veteran-Owned Small Business (SDVOSB) whose vision is to ignite innovation from within and deliver leading-edge solutions. At Business Technology Integrators (BTI), human capital is our most important asset. We are committed to the provision of a progressive environment where innovative, modernized, solutions are created by the best and brightest in our industry. Our team focuses on customer engagement by ensuring we deliver quality-assured results.

Similar Jobs

Sprout Social Logo Sprout Social

Director of GTM System and Applied AI

Marketing Tech • Social Media • Software • Analytics • Business Intelligence
Easy Apply
Remote or Hybrid
US
1400 Employees
200K-330K Annually

Collectors Logo Collectors

Senior Software Engineer

Consumer Web • eCommerce • Machine Learning • Software • Sports • Analytics
Remote or Hybrid
US
2246 Employees
141K-229K Annually

HiBob Logo HiBob

Business Development Representative

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
United States
1350 Employees
64K-64K Annually

HiBob Logo HiBob

Customer Experience Manager

HR Tech • Information Technology • Professional Services • Sales • Software
Remote or Hybrid
United States
1350 Employees
140K-170K Annually

Similar Companies Hiring

Amplify Platform Thumbnail
Fintech • Financial Services • Consulting • Cloud • Business Intelligence • Big Data Analytics
Scottsdale, AZ
62 Employees
Standard Template Labs Thumbnail
Artificial Intelligence • Information Technology • Software
New York, NY
25 Employees
Golden Pet Brands Thumbnail
Digital Media • eCommerce • Information Technology • Marketing Tech • Pet • Retail • Social Media
El Segundo, California
178 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account