The Role
Lead QA for LLM-based consumer products: design and execute end-to-end testing, verify LLM correctness, consistency, stability, and safety, perform regression and risk assessments for model updates, and build automated QA tooling, leveraging AI/LLM to enhance test design and defect analysis.
Summary Generated by Built In
Binance is a leading global blockchain ecosystem behind the world’s largest cryptocurrency exchange by trading volume and registered users. We are trusted by 300+ million people in 100+ countries for our industry-leading security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio of digital-asset products. Binance offerings range from trading and finance to education, research, payments, institutional services, Web3 features, and more. We leverage the power of digital assets and blockchain to build an inclusive financial ecosystem to advance the freedom of money and improve financial access for people around the world.
Responsibilities:
- AI / LLM application quality assurance
- Design and execute end-to-end testing strategies for LLM-based consumer products (functionality, data, model behavior)
- Verify the correctness, consistency, stability, and safety of LLM outputs
- Regression testing and risk assessment for model updates / prompt iterations / data changes
- Automation and tooling capabilities
- Design and develop automated testing and QA tools to improve testing efficiency and coverage
- Use or introduce AI technologies (such as LLM) to enhance test design, defect analysis, and test case generation capabilities
Requirements:
- Bachelor or Master in computer science, computer engineering or related area.
- At least 3+ years of software QA engineering experiences.
- Full cycle testing with test planning and both manual/automation execution.
- Solid Java coding skills, and experienced in automation or QA tools development.
- Good understanding in AI applications and LLM prompt engineering techniques. Experiences in LLM development or eval is a plus.
- Excellent self-driven and ownership with good deliverables.
- Eager to learn, be curious about AI and new technologies of LLM.
- Good communication and collaboration skills.
Why Binance
• Shape the future with the world’s leading blockchain ecosystem
• Collaborate with world-class talent in a user-centric global organization with a flat structure
• Tackle unique, fast-paced projects with autonomy in an innovative environment
• Thrive in a results-driven workplace with opportunities for career growth and continuous learning
• Competitive salary and company benefits
• Work-from-home arrangement (the arrangement may vary depending on the work nature of the business team)
Binance is committed to being an equal opportunity employer. We believe that having a diverse workforce is fundamental to our success.
By submitting a job application, you confirm that you have read and agree to our Candidate Privacy Notice.
Skills Required
- Bachelor or Master in computer science, computer engineering, or related area
- At least 3+ years of software QA engineering experience
- Full cycle testing with test planning and both manual and automation execution
- Solid Java coding skills and experience in automation or QA tools development
- Good understanding of AI applications and LLM prompt engineering techniques
- Experience in LLM development or evaluation
- Strong ownership, self-driven with reliable deliverables
- Good communication and collaboration skills
Binance Compensation & Benefits Highlights
The following summarizes recurring compensation and benefits themes identified from responses generated by popular LLMs to common candidate questions about Binance and has not been reviewed or approved by Binance.
-
Career-Linked Recognition & Rewards — Performance-linked bonuses can be sizable in favorable crypto cycles, lifting total compensation. Attractive packages in engineering and specialized roles indicate strong rewards for in-demand skills.
-
Flexible Benefits — Remote-first flexibility and work-from-anywhere options add meaningful value to the overall rewards package. Flexible schedules and location independence are presented as core perks.
-
Retirement Support — Binance.US includes a 401(k) as part of its benefits. This provides a conventional retirement pillar alongside cash and bonus components.
Binance Insights
Am I A Good Fit?
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.
Success! Refresh the page to see how your skills align with this role.
The Company
What We Do
Binance is the world’s leading blockchain and cryptocurrency infrastructure provider with a financial product suite that includes the largest digital asset exchange by volume. Trusted by millions worldwide, the Binance platform is dedicated to increasing the freedom of money for users, and features an unmatched portfolio of crypto products and offerings, including: trading and finance, education, data and research, social good, investment and incubation, decentralization and infrastructure solutions, and more. For more information, visit: https://www.binance.com
