Join Our Professional Community: Forge Connections, Shape Futures, Together, Powering Businesses Worldwide!
Are you ready to be part of a professional community that's powering businesses globally to save, grow and transform? Do you want to work with innovative technology, alongside talented professionals who share your passion for excellence? Look no further - hammerjack has the perfect opportunity for you!
Role: Power Platform and AI Tester
Location: Makati | Hybrid — 2-3x a week onsite
About Us:
At hammerjack, we're not just another outsourcing company - we bring together skilled professionals from the Philippines with businesses worldwide, leveraging expert operations and the latest technology to create connections that empower our community. Our mission? To improve lives by fostering meaningful professional relationships and driving success on a global scale.
Our Impact:
Over the years, we've built workplaces that empower employees to thrive, contributing in meaningful ways to the success and culture of companies around the globe. With our focus on professional services and our people-first culture, hammerjack has become a trusted partner for businesses and professionals alike, humanizing the outsourcing industry one connection at a time.
JOB OVERVIEW
The Power Platform & Copilot Studio Tester is responsible for validating, assuring, and improving the quality of AI-driven solutions built on Microsoft Power Platform and Copilot Studio. This role ensures conversational AI agents, automations, and integrations function correctly, securely, and in line with business and responsible AI requirements. The Tester plays a critical role in reducing risk, improving reliability, and supporting enterprise-grade deployment of Copilot Studio and Power Platform solutions.
DUTIES AND RESPONSIBILITIES
- Test Planning & Design
- Develop and maintain comprehensive test plans, test cases, and test scripts for Power Platform and Copilot Studio solutions.
- Define testing approaches covering functional, regression, integration, performance, and AI behavior validation.
- Copilot & AI Testing
- Validate conversational flows, intent recognition, prompt behavior, and AI-generated responses.
- Test large language model (LLM) outputs for accuracy, grounding, safety, and hallucination risks.
- Execute responsible AI testing including bias checks, content safety, and compliance controls.
- Automation & Workflow Validation
- Test Power Automate flows, triggers, approvals, and error-handling scenarios.
- Validate integrations with Dataverse, SharePoint, Teams, Dynamics 365, and external APIs.
- Quality Assurance & Defect Management
- Identify, log, and manage defects using agreed defect management tools and processes.
- Work closely with developers to reproduce issues and validate fixes.
- Support UAT cycles and provide clear quality sign-off recommendations.
- Governance, Security & Compliance
- Validate environment configuration, data access controls, and security role enforcement.
- Ensure solutions adhere to Power Platform governance standards and deployment policies.
- Continuous Improvement
- Contribute to QA standards, reusable test assets, and AI testing best practices.
- Continuously improve testing approaches for AI-driven and low-code solutions.
QUALIFICATIONS
- Bachelor’s degree in Information Technology, Computer Science, or related discipline.
- 5+ years experience in software testing or quality assurance roles.
- Hands-on experience testing Microsoft Power Platform and/or Copilot Studio solutions.
- Experience validating AI-driven or conversational applications.
- Strong understanding of testing methodologies within Agile and DevOps environments.
Skills and Personal Attributes
- Copilot Studio Testing: Conversational flow, prompt behavior, and AI response validation.
- Power Platform Knowledge: Power Apps, Power Automate, Dataverse, environments and solutions.
- AI Quality Assurance: LLM behavior testing, hallucination detection, and responsible AI checks.
- Test Design & Documentation: Strong attention to detail and structured thinking.
- Analytical Mindset: Ability to identify patterns, risks, and edge cases.
- Communication: Clearly articulates issues to technical and non-technical audiences.
- Collaboration: Works effectively with developers, architects, and business users.
- Adaptability: Comfortable testing rapidly evolving AI and low-code platforms.
What's in It for You:
- Flexibility: Work hybrid (remotely and from one of our inspiring offices) and enjoy a better work-life balance!
- Inspiring Workspaces: Our offices are strategically located and designed to fuel your best work.
- Free Unlimited Barista Coffee and Booze: Enjoy refreshments from our cafe and beverage bar.
- Dynamic Open Spaces: Conducive for productivity and creativity.
- State-of-the-Art Security: Ensuring your safety and peace of mind.
- Game Rooms: Take a break and unwind with our recreational facilities.
- Competitive Compensation: Your talents deserve to be rewarded! We help you negotiate with our clients.
- Professional Growth: Access to ongoing training and development opportunities to help you reach your full potential.
- A Supportive Community: Join a diverse and inclusive team that's dedicated to your success.
- Global Impact: Be part of something bigger and make a difference on a global scale.
Ready to Make a Difference?
If you're ready to join a dynamic team and be part of something truly special, we want to hear from you! Apply directly on this job ad, and let's forge a brighter future together!
hammerjack is an equal-opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.
Top Skills
What We Do
Outsource Solutions For Business hammerjack is an Australian & Philippine owned and operated offshore outsourcing services provider. Headquartered in Sydney with multiple operating offices in Makati, Manila, and Pampanga, Philippines. We specialise in providing dedicated, high performing teams and outsourced services to the global small and midsize business market. Our solutions deliver quality and consistent outcomes and are helping businesses to focus on their core competencies, reduce operating costs and deliver more value to their customers. hammerjack has been a major player in developing the new Knowledge Process Outsourcing (KPO) industry in the Philippines servicing the Australian, U.S.A and U.K markets. Over the last 7 years we have sourced trained and developed top talent focussed on the Finance, Accounting, Bookkeeping, IT and Virtual Assistant services space. Our knowledge and experience in implementing the latest technologies and systems to support the best people has led to continued success for our clients and their remote teams, all while placing information and cyber security at the forefront. Our operating model was born in the enterprise services space and has been specifically developed to cater for the small, midsize market. This experience and collaborative customer approach set business up for success, no matter where they are on their journey. We offer an enterprise level approach to continuous improvement, high performance & quality, and world class customer experience. Our ability to deliver this level of service across multiple lines of business and industry verticals is a product of our investment in people, technology and the governance that sits behind it all.
