Quality Assurance Automation Analyst

Posted 2 Days Ago
11 Locations
Remote
35K-38K Annually
Mid level
Big Data • Edtech • Analytics
The Role
Develop and maintain Playwright end-to-end automation within an AI-assisted QA lifecycle. Design test scenarios, validate AI-generated artifacts, manage test cases, debug failures, log defects, query PostgreSQL databases with SQL, perform regression testing, and coordinate testing activities. Collaborate with engineering to improve coverage, shorten test cycles, and report automation progress, risks, and issues.
Summary Generated by Built In

Civitas Learning is seeking a Quality Assurance Automation Analyst to join a talented, mission-driven team building powerful tools that greatly increase student success. Our QA team is collaborative, encouraged to bring new ideas, and pragmatic about tooling — we use the right tool for the job. We are problem solvers who want teammates passionate about our mission and eager to be part of a rapidly expanding, high-performance team.

This is not a traditional manual-only QA role. We run an AI-agent-orchestrated QA lifecycle: test specs are drafted from Jira tickets and PR diffs, test cases and Playwright automation are generated with AI assistants, tests execute through browser automation with agentic failure triage, and results flow back to Jira and our test-management system automatically. You will not just write and run tests — you will curate, review, and improve the AI-assisted pipeline that produces them.

What you'll do as a Quality Assurance Automation Analyst:
  • Design detailed, comprehensive, well-structured test scenarios and test cases; analyze manual scenarios for automation candidacy.
  • Build and maintain Playwright end-to-end automation, using AI assistants to accelerate test-script generation and applying self-healing locator strategies.
  • Review, validate, and correct AI-generated test artifacts (specs, cases, automation) for correctness and coverage — treat AI output as a draft to verify, not a finished result.
  • Manage test cases and cycles in a test-management system and keep automation status reconciled.
  • Debug, reproduce, and log bugs using QA tooling; triage automation failures (confirmed bug vs. flaky vs. environment).
  • Write SQL to validate back-end data and support data-model QA (day-to-day querying; deeper SQL is a growth path here).
  • Perform regression testing with awareness of cross-module system impact; estimate, prioritize, plan, and coordinate testing activities.
  • Test current products, identify deficiencies, and proactively suggest solutions and process improvements that shorten test cycles.
  • Collaborate closely with software engineering, following best practices with a focus on improving test coverage; contribute clear status reports on automation progress, issues, and risks.
What we are looking for:

Required Qualifications

  • College degree or equivalent.
  • 3–5 years of experience in software QA methodologies, tools, and processes.
  • Strong knowledge of software QA best practices.
  • Experience in an Agile/Scrum development process.
  • Hands-on Playwright (or equivalent modern automation framework, e.g. Selenium/Cypress) with a clear willingness to work primarily in Playwright.
  • Fluency with AI coding/testing assistants (e.g. GitHub Copilot, Cursor, Claude) for test generation and debugging — and the judgment to verify their output.
  • Working (intermediate) SQL and comfort querying relational databases (PostgreSQL) — you'll write queries regularly; advanced SQL is a plus, not a screen-out.
  • Intermediate English level.
  • Strong interpersonal and communication skills; a genuine team player.

Preferred Qualifications

  • Experience with test-management tools (e.g. AIO, Zephyr, or TestRail).
  • Accessibility testing experience — accessibility standards (WCAG), including screen-reader and keyboard testing.
  • Experience using LLMs for synthetic test-data generation.
  • Exposure to CI/CD test pipelines (GitHub Actions/workflows, JUnit reporting) and Jira automation.
  • Performance and/or security testing experience. 
Remote - LATAM
$35,000—$38,000 USD

WHY WE LOVE WHAT WE DO:

At Civitas Learning, we seek to help colleges and universities apply their vast student data to maximize institutional impact and improve the student outcomes that matter most.

Civitas Learning’s flexible,  all-in-one Student Impact Platform creates actionable insights that surface in a connected workflow, enabling higher education institutions to pinpoint students at risk of missing important milestones, explain why, take action, and evaluate which policies and programs are making a difference. With adaptable analytics based on models built for each institution and higher education expertise, we empower leaders and teams to turn insights into action to support students in reaching their full potential
Civitas Learning is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, protected veteran status, or any other status protected by applicable law.

 
#LI-Remote

Skills Required

  • College degree or equivalent
  • 3–5 years of experience in software QA methodologies, tools, and processes
  • Strong knowledge of software QA best practices
  • Experience in an Agile/Scrum development process
  • Hands-on experience with Playwright or an equivalent modern automation framework such as Selenium or Cypress, with willingness to work primarily in Playwright
  • Fluency with AI coding and testing assistants such as GitHub Copilot, Cursor, or Claude, including the ability to verify generated output
  • Intermediate SQL skills and comfort querying relational databases, particularly PostgreSQL
  • Intermediate English level
  • Strong interpersonal and communication skills and a collaborative team orientation
  • Experience with test-management tools such as AIO, Zephyr, or TestRail
  • Accessibility testing experience, including WCAG, screen-reader, and keyboard testing
  • Experience using LLMs for synthetic test-data generation
  • Exposure to CI/CD test pipelines, GitHub Actions, JUnit reporting, and Jira automation
  • Performance and/or security testing experience
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Austin, TX
148 Employees
Year Founded: 2011

What We Do

Civitas Learning is a student success company that helps colleges and universities harness the power of their student data to improve outcomes. Our connected infrastructure and software ensure that higher education can better coordinate student success strategies, deliver proactive, collaborative care, power holistic advising, and quickly measure what’s working for whom. Through our work together, our customers are empowering leaders, advisors, faculty, & students—and measurably improving enrollment, persistence, and graduation outcomes. Today, we work with 375 colleges and universities, serving nearly 8 million students. Together with our growing community of customers, we are making the most of the world’s learning data to help graduate a million more students per year by 2025. For more information, visit: www.civitaslearning.com.

Similar Jobs

Circle (circle.so) Logo Circle (circle.so)

Lead Product Designer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
32 Locations
250 Employees
140K-170K Annually

Circle (circle.so) Logo Circle (circle.so)

Creative Director

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
32 Locations
250 Employees

Circle (circle.so) Logo Circle (circle.so)

Growth Lead, Discover

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
32 Locations
250 Employees
140K-160K Annually

Circle (circle.so) Logo Circle (circle.so)

Designer

Artificial Intelligence • Consumer Web • Digital Media • Information Technology • Social Impact • Software
Remote
32 Locations
250 Employees
100K-120K Annually

Similar Companies Hiring

Northslope Thumbnail
Artificial Intelligence • Information Technology • Software • Analytics • Consulting • Generative AI
London, GB
100 Employees
Scotch Thumbnail
Artificial Intelligence • eCommerce • Fintech • Payments • Retail • Software • Analytics
US
35 Employees
Milestone Systems Thumbnail
Artificial Intelligence • Security • Software • Analytics • Big Data Analytics
Lake Oswego, OR
1500 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account