AI Quality Engineer

Reposted 7 Days Ago
Be an Early Applicant
Warsaw, Warszawa, Masovian, POL
In-Office
Senior level
Information Technology • Software
The Role
Design and execute comprehensive test cases; perform functional, integration, API (REST/OpenRTB), database, exploratory and UAT testing; create clear bug reports with reproduction steps; participate in test planning and reviews; collaborate with developers to resolve defects.
Summary Generated by Built In

Start.io is a sell-side omnichannel advertising platform powered by real-time mobile audiences. We deliver hundreds of millions of ads per day across thousands of global leading apps and websites. Our platform uses AI to deliver more efficient, effective and precise digital advertising campaigns. Our direct integration with thousands of mobile publishers gives us access to more than 50 billion first-party data signals per day across the globe. Marketers use these anonymized signals to understand and predict consumer behavior, identify new opportunities and fuel business growth.

We are looking for a hands-on AI QA Technical Lead to drive the technical evolution of our QA organization through AI. Your mission will be to identify opportunities across the QA lifecycle and turn them into practical, scalable AI-powered capabilities that help the entire QA team work faster, smarter and with higher quality. You will design and build AI-powered tools, agents, workflows and integrations used by QA engineers across the testing lifecycle - from test design and automation to test data generation, debugging and failure investigation. This is a hands-on technical leadership role with a strong focus on building, experimentation and innovation.

Requirements
  • 5+ years of hands-on experience in Software Quality Engineering, Test Automation or Software Engineering.
  • Strong experience with test automation frameworks such as Playwright, Cypress or similar.
  • Strong programming skills in JavaScript/TypeScript or Python.
  • Hands-on experience building AI-powered tools, applications, workflows or agents using LLMs.
  • Practical understanding of agentic workflows, prompt and context engineering, tool calling, MCP and API integrations.
  • Experience turning experimental solutions into reliable and maintainable engineering products.
  • Strong QA fundamentals, including test design, regression testing and exploratory testing.
  • Experience with APIs, databases and distributed systems.
  • Experience with CI/CD systems such as GitHub Actions, Jenkins or similar.
  • Strong problem-solving skills and ability to independently drive technical initiatives.
Will be a plus
  • Experience evaluating LLM or agent output and measuring AI solution quality.
  • Experience building internal developer, engineering or QA platforms.
  • Experience with observability and distributed systems.
  • Experience integrating AI with tools such as GitHub, Jira, Confluence or CI/CD platforms.
  • Experience with Kubernetes or cloud infrastructure.
  • AdTech or programmatic advertising experience.
Responsibilities
  • Design, build and evolve AI-powered tools, agents and workflows that improve the efficiency and quality of the QA team.
  • Identify repetitive or high-impact QA activities and turn them into scalable AI-enabled solutions.
  • Build integrations between AI capabilities and our testing, engineering and internal systems.
  • Define technical standards and best practices for AI-powered QA solutions, including prompts, context, tools, agent workflows and human-in-the-loop processes.
  • Build mechanisms to evaluate AI output, measure quality and detect regressions.
  • Monitor and improve the reliability, performance and cost of AI-powered solutions.
  • Act as the technical focal point for AI within the QA team and help drive adoption, knowledge sharing and experimentation.
  • Work closely with QA engineers and engineering teams to turn real-world challenges into practical solutions.
What we offer
  • Dedicated help and support from our caring HR team.
  • 20 days of paid vacation.
  • Multisport membership coverage.
  • Comprehensive health insurance.
  • And, last but not least, competitive compensation that reflects your contribution and efforts.

Skills Required

  • 5+ years of experience in manual software testing
  • Solid understanding of software testing methodologies and best practices
  • Excellent analytical and problem-solving skills
  • Hands-on experience in API testing (REST/OpenRTB)
  • Experience working with relational and non-relational databases (SQL-based systems, MongoDB, Aerospike)
  • Strong English communication skills
  • Knowledge in the programmatic advertising landscape (DSPs, SSPs, exchanges)
  • Familiarity with ad tech concepts (SSP, DSP, RTB auctions)
  • Understanding of automation testing concepts
  • Experience with SDK testing
  • Understanding of microservices architecture
Am I A Good Fit?
beta
Get Personalized Job Insights.
Our AI-powered fit analysis compares your resume with a job listing so you know if your skills & experience align.

The Company
HQ: Kadima
294 Employees

What We Do

Globaldev Group provides end-to-end software development services and builds skillful teams of specialists to fuel your business’ growth. Leveraging our extensive 12-year background and deep industry knowledge, we have established ourselves as a reliable partner for numerous enterprises, SMEs, and startups. Globaldev Group is an ISO/IEC 27001 certified company. ▪️️ Global Teams ▪️ Globaldev offers R&D team extensions to both emerging technology companies and global corporations. Empowered by our global talent pool, we excel at connecting our clients with high-skilled specialists. Hiring, onboarding, and continuous management are all included in our comprehensive set of services, enabling our clients to quickly scale their teams and achieve their product development and implementation goals. ▪️ Global Engineering ▪️ - Obtain a custom-designed solution from scratch - Scale or enhance your current software infrastructure - Stay ahead with the latest cutting-edge technologies - Access a comprehensive range of services from a single vendor As a full-stack development company, we are equipped to fulfill all your business requirements. Whether it's product discovery, proof of concept, UX design, or development, Globaldev serves as your all-in-one solution provider.

Similar Jobs

Colibrix One Logo Colibrix One

Quality Assurance Engineer

Fintech • Payments • Software • Financial Services
In-Office or Remote
5 Locations
71 Employees

Samsara Logo Samsara

Senior Software Engineer

Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
Easy Apply
Remote or Hybrid
Poland
4000 Employees
Remote or Hybrid
2 Locations
289097 Employees

Capco Logo Capco

Integration Engineer

Fintech • Professional Services • Consulting • Energy • Financial Services • Cybersecurity • Generative AI
Remote or Hybrid
Poland
6000 Employees

Similar Companies Hiring

Onshore Thumbnail
Artificial Intelligence • Fintech • Software • Financial Services
New York, New York
60 Employees
Revel.io Thumbnail
Aerospace • Hardware • Robotics • Software
US
50 Employees
Blee Thumbnail
Artificial Intelligence • Marketing Tech • Software • Productivity
US
15 Employees

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account