604 episodes
Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight
04/08/2026 | 38 mins.Your developers just got supercharged by AI coding agents. Your test coverage did not. So how do you keep quality high when product code is shipping faster than any test team can follow?
In this episode Andrew Knight, the Automation Panda and Senior Director of Product and Engineering at Cycle Labs, shares how his six person team is running the biggest release quarter in company history using AI coding agents, spec driven development, and Playwright.
You will discover:
How Playwright turned itself into an AI automation platform with the MCP server, the planner, generator, and healer agents, and the new CLI and skills approach that cuts your token usage way down.
Why Andy uses Spec Kit to codify his testing strategy once, in markdown, so quality standards get baked into every single pull request instead of being caught in review.
How to decide which AI generated tests are actually worth running when compute time and budget are finite.
What AI slop looks like from a manager's seat, and how to build a team culture that catches it before it ships.
Why Andy believes AI coding tools are the new compiler and markdown is the new programming language, plus my pushback on what that means for everything testers were trained to care about.
What Andy really thinks about token costs, subscription tiers, and what happens when the AI subsidies run out.
Plus the one piece of advice he gives to any tester still sitting on the sidelines of the AI shift.
Whether you are an automation engineer, a QA lead, or an engineering manager trying to figure out where testing fits in an AI first workflow, this episode gives you a practical playbook you can start using this week.Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain
28/07/2026 | 45 mins.Keith Klain has spent 25+ years leading enterprise quality programs in financial services and is one of the testing industry's most respected voices. In this episode, he joins Joe to discuss his BrowserStack talk, "The Death of Test Engineering," why testing isn't dying—but outdated testing roles are—and how AI is reshaping the future of software quality.
In this episode:
Why "The Death of Test Engineering" isn't what you think
The difference between checking and testing
Will AI replace software testers?
Why confidence engineering matters
How to communicate testing in business terms
Where automation adds real value
Why agentic AI testing is overhyped
Notable Quotes
"If you look at AI as a competitor, you're screwed. If you look at it as just another tool... it's not a threat."
"Uncertainty in testing is a feature, not a bug."
"If an organization doesn't value testing, you're doing it wrong."
"You can be incredibly confident about something and incredibly wrong."
One Thing to Try This Week
Ask yourself after every critical defect:
"What would the business impact have been if this had gone live?"
It's a simple way to shift conversations from test cases to business risk.
Resources Mentioned
Rethinking Expertise — Harry Collins
How Complex Systems Fail — Richard Cook
Measuring and Managing Performance in Organizations — Robert Austin
Emily Bender
Alex Hanna
Timnit Gebru
Dagmar Monett
Olivia Gambelin
Ed Zitron
Joe's Recommendation: ProphecyAI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan
22/07/2026 | 36 mins.Nandini Srinivasan has spent 25 years in the quality industry and leads a global QA organization of over 150 engineers across the US, Canada, India, and Pakistan.
In this episode, she breaks down exactly how she built a QA AI acceleration charter, ran a train-the-trainer model, and used a phased proof-of-concept approach to separate real AI from what she calls "powerful automation dressed up as AI.
We get into:
How she frames quality metrics for executives
Using language around revenue protection
Risk mitigation
Feature velocity instead of test coverage percentages.
She talks about the four pillars she uses to present her team's value: quality, scalability, performance, and availability.
Nandini also shares her take on the future of QA hiring, why the judgment layer will always require a human, and what skills testers need to stay relevant as AI agents take over the more mechanical parts of automation.
She is also writing a five-part LinkedIn series called "The Voice of QA in the AI Era" if you want to follow along.How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne
14/07/2026 | 39 mins.Matt Wynne, co-creator of Cucumber and BDD practitioner, joins Joe for the first time in over a decade to talk about what two years inside a Silicon Valley AI startup taught him about the future of software testing.
Matt spent time at Mechanical Orchard working alongside experienced XP practitioners to modernize legacy COBOL mainframes using LLMs, and then spent a week with the team that coined the term "software factory," where the rule was simple: humans never write the code, never read the code.
In this episode, Matt breaks down what harness engineering actually means, why shared understanding is still the real bottleneck even in an agentic world, and how testers can use multiple LLMs to review AI-generated pull requests without reading every line.
He also gets honest about the grief that comes with realizing you can encode years of hard-won expertise into a Markdown file, and why that does not mean your skills are worthless.
If you are working in a brownfield codebase, wondering how to handle the flood of agentic PRs, or trying to figure out where testers fit in a world where agents write the code, this conversation is worth your time.
Find Matt at:
mattwynne.net
leansoftware.ai
Also check out his course:
Build a Software Factory: Hands-off agentic coding for experienced engineers
https://testgld.link/mattcourseAgentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat
07/07/2026 | 43 mins.Amit Rawat is an agentic engineer who spent two decades in QA before shifting fully into building AI agents. He's the creator of PromptWright, a desktop tool that turns natural language prompts into automated Playwright browser tests, complete with screen recording, Gherkin scenario generation, and self-healing locators.
In this episode, Amit and Joe get into what it actually takes to work with AI agents at a high level, starting with why the planning phase matters more than the prompt itself. Amit breaks down his own workflow, brainstorming with AI, building a detailed plan in HTML before ever executing, and why curiosity and technical depth still matter even as AI gets more capable.
They also cover why Amit believes QA professionals, more than developers or DevOps engineers, are best positioned to thrive in the agentic era, how he tracks the ROI on his $200-a-month Claude subscription, the "Chief of Staff," "Chief Health Officer," and "Chief Financial Officer" AI agents he's built to help manage different aspects of his personal life, and how he uses a memory layer so those agents understand his preferences and become more useful over time.
If you're a tester, automation engineer, or QA leader trying to figure out where AI agents fit into your workflow and your career, this conversation is a practical look at what's already working today.
More Education podcasts
Trending Education podcasts
About TestGuild Automation Podcast
TestGuild Automation Podcast (formally Test Talks) is a weekly podcast hosted by Joe Colantonio, which geeks out on all things software test automation. TestGuild Automation covers news found in the testing space, reviews books about automation, and speaks with some of the thought leaders in the test automation field. We'll aim to interview some of today's most successful and inspiring software engineers, and test automation thought leaders.
Podcast websiteListen to TestGuild Automation Podcast, Everyday Māori and many other podcasts from around the world with the radio.net app

Get the free radio.net app
- Stations and podcasts to bookmark
- Stream via Wi-Fi or Bluetooth
- Supports Carplay & Android Auto
- Many other app features
Get the free radio.net app
- Stations and podcasts to bookmark
- Stream via Wi-Fi or Bluetooth
- Supports Carplay & Android Auto
- Many other app features


TestGuild Automation Podcast
Scan code,
download the app,
start listening.
download the app,
start listening.
TestGuild Automation Podcast: Podcasts in Family
























