At Qualtrics, we create software the world’s best brands use to deliver exceptional frontline experiences, build high-performing teams, and design products people love. But we are more than a platform—we are the creators and stewards of the Experience Management category serving over 18K clients globally. Building a category takes grit, determination, and a disdain for convention—but most of all it requires close-knit, high-functioning teams with an unwavering dedication to serving our customers.

When you join one of our teams, you’ll be part of a nimble group that’s empowered to set aggressive goals and move fast to achieve them. Strategic risks are encouraged and complex problems are solved together, by passing the mic and iterating until the best solution comes to light. You won’t have to look to find growth opportunities—ready or not, they’ll find you. From retail to government to healthcare, we’re on a mission to bring humanity, connection, and empathy back to business. Join over 6,000 people across the globe who think that’s work worth doing.

Software Developer in Test II , DICE - Seattle

Why We Have This Role

The Core Machine Learning Team works on the cutting edge of technology employing Machine Learning to build highly scalable, accurate models which are consumed by many of our product teams. We seek a creative quality engineer to lead the quality initiatives of this team. The ideal candidate would evaluate and drive the testing approach for machine learning projects, develop automation at scale and collaborate with peer quality engineers, software developers, and research scientists.

How You’ll Find Success

• Proficiency with a broad range of data structures, algorithms, and design patterns, and knowing when it's appropriate to use them (and when it's not).
• Experience applying different software testing techniques, such as equivalence class partitioning, boundary value testing, pairwise testing, etc.
• Experience with SOA (Service Oriented Architecture) and distributed systems.
• Familiar with front-end technologies (including Selenium-based automation), REST web services and/or constructing database queries
• Experience applying different software testing techniques, such as equivalence class partitioning, boundary value testing, pairwise testing, etc.
• Ability to work both independently on ambiguous problems and in highly collaborative team environments
• CI/CD deployment automation experience with scripting, Chef, Jenkins, Puppet, etc.
• Strong critical thinking and root cause analysis

How You’ll Grow

1. Deep Technological Expertise: As you work alongside our team of experts, including machine learning engineers and data scientists, you'll have the opportunity to deepen your expertise in advanced software testing within the realm of machine learning and artificial intelligence. You'll gain hands-on experience with the latest ML tech stacks and methodologies that can elevate your skill set to the next level.
2. Leadership and Mentorship Skills: This role is designed not just for you to excel technically but also to grow as a leader. As you mentor peers and drive quality initiatives, you'll develop valuable leadership and mentorship skills. These experiences will enable you to take on increasingly senior roles in the future, potentially leading teams or departments.
3. Cross-Disciplinary Collaboration: Through cross-functional collaboration with product managers, tech-ops, and other stakeholders, you'll learn how to effectively communicate and drive product decisions from a quality perspective. This will help you to become an influencer in product development cycles and broaden your understanding of different areas of the business.
4. Automation and Process Innovation: With an emphasis on creating and improving test automation frameworks, you'll be at the forefront of process innovation. You'll learn to evaluate and implement cutting-edge tools and practices that can scale and improve efficiency, which is key for professional growth in any technology landscape.
5. Quality Strategy Development: In driving quality processes and defining acceptance criteria, you'll learn to think strategically about product quality and customer satisfaction. This holistic view of the software development lifecycle will prepare you for roles that require both tactical execution and strategic planning, ensuring you're well-placed for career advancement.

Things You’ll Do

• Work in a multi-disciplinary team to implement, tune, and productize cutting-edge machine learning models to meet the demands of our rapidly growing business
• Work closely with, and incorporate feedback from scientists, machine learning engineers, tech-ops, and product managers.
• Develop and design test frameworks, test tools, and automation for complex, distributed SaaS systems and Machine Learning models.
• Research, share, recommend, and drive adoption of new technologies, standard methodologies, and trends across the Machine Learning spectrum.
• Help your team evolve by actively participating in the code review process, design discussions, planning, and post-mortems.
• Define, implement, and analyze metrics to resolve test effectiveness and the overall quality of software.
• Investigate test failures and customer reports using your technical understanding of the product and tools (such as logs) to narrow down repro issues steps and isolate the root problem
• You ensure the product is tested at the appropriate level (unit vs integration vs end to end, API vs UI), reducing unnecessary test cases, intermittent failures, and decreasing execution time.
• Drive quality processes like bug triage, release decisions, and feature completion criteria
• Mentor and develop your other team members.
• Iteratively test the AI models and verify that the incremental predictions are improving and meeting the benchmarks as set by the Development team. 
• Communicate with cross functional teams as to how the Machine Learning platform is consumed by other downstream teams. Based on this understanding, collaborate with them and make suggestions to their test plans and test strategies.

What We’re Looking For On Your Resume 

• Bachelor's degree in Computer Science or related field.
• 3+ years of professional coding experience with any programming language (Prefer experience in Python/JavaScript)
• 3+ years professional experience building test automation frameworks and tools from scratch.
• (Preferred) Basic understanding of Machine Learning concepts such as deep learning, categorization, classification and data mining

What You Should Know About This Team

• Our Engineering team is a group of deeply passionate engineers who are breaking new ground in cloud computing and web scalability. We organize and sort terabytes of data and develop solutions used by millions of users every single day. We design products that make sophisticated research simple. Engineering focuses on these tenets; Platform-oriented, API First, Secure, One Product (Our customers shouldn’t have to learn two different ways of solving the same problem), and Quality (Our customers rely on our products to drive their businesses. Our software must work. If a feature is buggy, don’t release it (if it hasn’t been released yet), fix it or take it out.)
• Our Quality Engineering organization’s mission is to build a quality culture championing a delightful customer experience while enabling teams to efficiently bring high quality software to all markets. We do this by engaging early to ensure customer use cases are tested AND fully automated. We also automate the release process to save human effort, reduce mistakes, and speed overall delivery. Our environment is primarily Selenium, PyTest, Jira, TestRail, Python, Jenkins, Nomad and Docker. In our collaborative culture, you find plenty of opportunities to improve the quality of our software.

Our Team’s Favorite Perks and Benefits

• Work–life integration is deeply important to us - we have regular office events, team outings, and happy hours.
• We take pride in our offices’ design aiming at cultivating creativity from our rooftop views to an open and collaborative work space.
• On top of standard benefits package (medical, dental, vision, life insurance, etc) we provide snacks, drinks, and free lunches in our office.
• Qualtrics Experience Program - $1,800 for an experience of your choosing (eligible after a year)

The Qualtrics Hybrid Work Model: Our hybrid work model is elegantly simple: we all gather in the office three days a week; Mondays and Thursdays, plus one day selected by your organizational leader. These purposeful in-person days in thoughtfully designed offices help us do our best work and harness the power of collaboration and innovation. For the rest of the week, work where you want, owning the integration of work and life.

Qualtrics is an equal opportunity employer meaning that all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other protected characteristic.

​​​​​​​Applicants in the United States of America have rights under Federal Employment Laws:Family & Medical Leave Act,Equal Opportunity Employment,Employee Polygraph Protection Act

Qualtrics is committed to the inclusion of all qualified individuals. As part of this commitment, Qualtrics will ensure that persons with disabilities are provided with reasonable accommodations. If reasonable accommodation is needed to participate in the job application or interview process, to perform essential job functions, and/or to receive other benefits and privileges of employment, please let your Qualtrics contact/recruiter know.

Not finding a role that’s the right fit for now? Qualtrics Insiders is the one-stop shop for all things Qualtrics Life. Sign up for exclusive access to content created with you in mind and get the scoop on what we have going on at Qualtrics - upcoming events, behind the scenes stories from the team, interview tips, hot jobs, and more. No spam - we promise! You'll hear from us two times a month max with fresh, totally tailored info - so be sure to stay connected as you explore your best role and company fit.