Everforth ECS is seeking an AI Testing Engineer to work minimum of 3 business days onsite at our Fairfax, VA corporate office and/or our Ashburn, VA customer site.
Please Note: This position is contingent upon contract award.
The Artificial Intelligence (AI) Test Engineer will be part of a team of experts charged with providing support in the areas of model analysis and model development capabilities in response to Custom and Border Protection’s (CBP) Project Outrider. Program scope includes model analyses and assessments to identify mission and operational impacts and make appropriate performance enhancement recommendations. You will be responsible for:
- The development and execution of test plans for AI models and applications, identifying, documenting, and analyzing defects, inconsistencies, and anomalies in AI outputs.
- Collaboration with development teams to improve AI model performance and ensure quality standards.
- Implementing automation frameworks for AI evaluation, including dataset checks, API testing, and CI/CD integration.
- Defining AI quality metrics and KPIs such as accuracy, latency, cost, and fairness.
Salary Range: 125,000-150,000
General Description of Benefits
Preferred Qualifications
- U.S. Citizenship; Must be able to obtain and maintain a Public Trust determination.
- Bachelor’s degree in Computer Science, Electrical Engineering, or a related technical field.
- 2-4+ years of AI Test and Validation experience.
- Experience working on custom development software projects.
- Strong collaboration with cross-functional teams to identify testing requirements and optimize test coverage.
- Experience with system testing metrics, best practices, and methodologies.
- Utilization of Python and Selenium for automated testing of machine learning models.
- Experience working with software development teams.
- Experience analyzing test results and providing actionable insights to improve model accuracy.
- Experience designing and implementing comprehensive test strategies for AI-driven applications.
- Experience participating in requirements and design reviews, developing test plans, writing and executing test cases in a fast-paced software development environment.
- Experience conducting data analysis, data verification and problem-solving.
- Experience with statistical reporting and analysis.
- Competency in developing and executing test plans for various AI applications, ensuring compliance with industry standards.
- Expertise in one or more scripting languages (e.g., Unix/Linux, PERL, Java script) and relational database technologies (SQL, schema design).
- Ability to work as a member of a self-organizing team without daily direct supervision.
- Ability to communicate effectively within a large, dynamic team environment.
- Ability to support three days in-office.
- Willingness to try new things and grow.
Skills Required
- U.S. Citizenship
- Able to obtain and maintain a Public Trust determination
- Bachelor's degree in Computer Science, Electrical Engineering, or related technical field
- 2-4+ years of AI test and validation experience
- Experience with custom software development projects
- Collaboration with cross-functional teams to identify testing requirements
- Experience with system testing metrics, best practices, and methodologies
- Utilization of Python for automated testing of ML models
- Utilization of Selenium for automated testing
- Implementing automation frameworks including dataset checks, API testing, and CI/CD integration
- Defining AI quality metrics and KPIs (accuracy, latency, cost, fairness)
- Analyzing test results and providing actionable insights to improve model accuracy
- Designing and implementing comprehensive test strategies for AI-driven applications
- Participating in requirements and design reviews; developing test plans and executing test cases
- Conducting data analysis, data verification, and problem solving
- Experience with statistical reporting and analysis
- Expertise in scripting languages and environments (Unix/Linux, PERL, JavaScript)
- Experience with relational database technologies (SQL, schema design)
- Ability to work as a member of a self-organizing team without daily direct supervision
- Ability to communicate effectively within a large, dynamic team environment
- Support minimum three days in-office in Fairfax/Ashburn, VA
- Willingness to try new things and grow
ECS Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about ECS and has not been reviewed or approved by ECS.
-
Healthcare Strength — ECS advertises multiple national-network medical plan options with HSA eligibility alongside dental and vision coverage. Coverage generally begins quickly and is paired with company-paid short- and long-term disability, adding stability to the health package.
-
Retirement Support — A 401(k) with Safe Harbor and immediate vesting on employer contributions is emphasized, with an employer match available. Access to an employee stock purchase plan via the parent company provides an additional savings avenue.
-
Parental & Family Support — Paid parental leave up to 30 days, adoption assistance, and other family-oriented leaves are highlighted. Feedback suggests these offerings add meaningful value beyond base pay for many roles.
ECS Insights
What We Do
ECS, a segment of ASGN (NYSE: ASGN), delivers advanced solutions and services in cloud, cybersecurity, artificial intelligence (AI), machine learning (ML), application and IT modernization, and science and engineering. The company solves critical, complex challenges for customers across the U.S. public sector, defense, intelligence and commercial industries. ECS maintains partnerships with leading cloud, cybersecurity, and AI/ML providers and holds specialized certifications in their technologies. Headquartered in Fairfax, Virginia, ECS has more than 3,400 employees throughout the U.S. and has been recognized as a Top Workplace by The Washington Post for the last five years.
