Search

Home > TestTalks | Automation Awesomeness | Helping YOU Succeed with Test Automation > AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman
Podcast: TestTalks | Automation Awesomeness | Helping YOU Succeed with Test Automation
Episode:

AI Testing: How to Ensure Quality in Non-Deterministic Systems with Adam Sandman

Category: Technology
Duration: 00:43:20
Publish Date: 2026-03-10 22:33:00
Description:

How do you ensure software quality when the system you're testing doesn't give the same output twice? That's the core challenge facing every QA team building or testing AI-powered applications today and it's breaking all the rules we've relied on for decades.

In this episode of the TestGuild Automation Podcast, I sit down with Adam Sandman, co-founder of Inflectra, to get into what non-deterministic AI testing actually means in practice, why traditional pass/fail testing no longer cuts it, and what quality professionals need to do differently right now.

We cover:

  • Why AI-generated code is raising the stakes for QA teams while budgets stay flat
  • The fundamental difference between deterministic and non-deterministic systems — and why it changes everything about how you test
  • How to set acceptable risk thresholds for AI systems (hint: it depends on whether you're building an e-commerce chatbot or an air traffic control system)
  • Why testers who embrace AI as a tool — not a threat — will be the ones leading their organizations forward
  • How a live demo failure at a conference inspired Inflectra's new non-deterministic testing tool, SureWire

If you're a tester, QA manager, or automation engineer trying to figure out how to keep up with AI-driven development without losing your mind — or your job — this one's for you.

Total Play: 0