Work Location: Mountain View, CA; (on-site 4 days a week)
Duration: 12-month contract; hybrid role
Pay Range: $85/hr to $100/hr
**No C2C resumes are considered**
Responsibilities:
- Design, implement, and maintain test automation suites for the Bixby voice assistant on multiple devices.
- You will be responsible for testing devices on different operating systems, testing services, and background products.
- Create test plans and test cases driven by requirements/specifications.
- Participate in sprint planning activities and daily standups; help ensure comprehensive test coverage by working closely with the product and engineering teams to prioritize testing execution and report on test execution progress and results.
- Assist release engineering in managing releases.
- Replace manual test suites with test automation when possible.
- Work with partner teams to ensure smooth project execution.
- 70-80% of the work is mostly on coding, research, & evaluation; QA work is less
- A bachelor's or higher degree is preferred.
- A minimum of 3 years of experience with Natural Language evaluation is required
- 7+ years of working experience in software quality assurance is preferred.
- Programming in Python - 5+ years
- Experience with Bixby evaluation on Natural language and testing is needed.
- Experience with technologies like LLM and API is a must.
- Experience with generative AI (GenAI) is mandatory.
- Experience with a matrix evaluation & reporting, and an extensive framework is required.
- Must have experience with SW testing techniques and approaches; Ownership of test plan development and execution for customer-facing applications.
- Candidates with coding and API testing skills will be preferred.
- Experience in App testing on mobile phone/ tablet/ PCs, etc. is preferred.
- Experience with Voice Assistants preferred.
- Self-motivated individual with the ability to thrive in a team-based or independent environment.
- Detail-oriented with strong organization skills.
- Ability to work in a fast-paced environment.
- Limited supervision and the exercise of discretion.
- Good knowledge of generic SQA tools (e.g., JIRA, Wiki, Git, Selenium, TestNG, Pytest, etc.) is required.
- Sound knowledge of CI-CD tools like Jenkins is expected.
- Should have good verbal communication skills.
- A person who is like an evaluation specialist, knows how to set up a framework on natural language, and has front-end and chatbot experience would also be considered.
- The top skills for an ideal candidate include coding experience (Python), analytics, Generative AI, LLM, frameworks, and API.
**No C2C resumes are considered**
Thank you!
FocusKPI Hiring Team
Founded in 2010, FocusKPI, Inc. (FocusKPI) is a data science and technology firm specializing in predictive analytics practice and methodologies. FocusKPI is a US company headquartered in Silicon Valley, California, with an East Coast office in Boston, Massachusetts.
Similar Jobs
What We Do
FocusKPI brings deep domain experience in business and marketing analytics to enable our clients to unlock growth-driving insights from data. We help our clients develop action-oriented analytics and data science products that are customized to company-specific needs and integrated into their platforms for ongoing use. Our Accelerators, a toolbox of frameworks and models built over 10+ years, fast-track projects by capitalizing on our experience.
Capabilities:
Predictive Analytics
AI / Machine Learning
Measurement
Text Analysis
Key Industries Served:
Retail Media
B2B & B2C Sales, Marketing, and Merchandising
Software & Applications






