Does AI Coaching Actually Work? What the Evidence Shows and Where It Fails
AI coaching works, but in a narrower band than the category markets itself in. The strongest evidence available is a randomised controlled trial that found a statistically significant improvement in goal attainment and non-significant results on wellbeing, resilience, and stress, which is a real finding rather than a null one, and it points at the specific job AI coaching is good at: structured, goal-directed, repeatable support at a volume no human team can staff. That is the job Vocaliv’s AI Coach is built for, and it is worth being clear about what falls outside it. Key Takeaways 🖥️ Sign In to Access Your Dashboard What the Research Actually Found Most vendor claims in this category trace back to one study, so it is worth reading it properly. In 2022, a team led by Nicky Terblanche published a randomised controlled trial of an AI coaching chatbot called Vici. It was designed as a replication of an earlier human-coach trial. An experimental group of 75 used the chatbot for six months, measured against a control group of 94, with eight measurement points on goal attainment, resilience, psychological wellbeing, and perceived stress. The result: goal attainment improved significantly. Everything else did not. Measure Result Goal attainment Statistically significant improvement Resilience Non-significant Psychological wellbeing Non-significant Perceived stress Non-significant The researchers’ own conclusion was that AI coaching is effective in a narrow application, and that it could democratise coaching in a cost-effective, scalable way. That is a genuinely positive finding. It is also considerably more specific than “AI coaching works”. A follow-up trial has since compared accredited human coaches against automated AI coaches head to head, with 114 coachees inside a global organisation, measured across goals, motivation, resilience, and wellbeing using validated psychometrics. The evidence base is expanding, but it remains small enough that anyone quoting a definitive verdict is overreaching. Checked September 2026. Note that “AI coaching” in this research means life and organisational coaching, which is related to but not identical to AI support inside a training programme. Where AI Coaching Reliably Works Reading across the evidence and our own operational data, the pattern is consistent. AI coaching performs where the task is structured and repeatable. Where It Does Not Work This is the part most vendor content omits, and it is the part worth being honest about. Anything depending on the relationship: Coaching research consistently identifies the working alliance between coach and client as a driver of effectiveness. Whether that transfers to AI is an open research question, not a settled one. Wellbeing, resilience, and stress: The trial found no significant effect on any of these. If your reason for buying is employee wellbeing, the evidence does not currently support the purchase. Novel or ambiguous problems: A learner question that has never been asked, or that depends on your organisation’s unwritten context, is where an AI coach should escalate rather than answer. High-stakes judgment: Career decisions, performance conversations, and anything with a compliance consequence need a human accountable for the outcome. Motivation that comes from being seen: Part of why cohort programmes outperform self-paced ones is that a human notices when you are absent. An AI noticing is not obviously the same thing, and nobody has demonstrated that it is. 📄 Generate a Free PDF Sample Course in Your Cloned Voice The Question Corporate Buyers Should Actually Ask Most training providers evaluating AI coaching are not trying to replicate an executive coaching engagement. They are trying to solve a capacity problem. A cohort of 40 learners generates roughly 200 questions a week, and most of them repeat questions already answered in a previous cohort. Those questions consume instructor hours regardless of whether they require instructor expertise. There is a hard ceiling on how many trainees one trainer can support, and repetitive support is what sets it. That reframes the evaluation. The question is not whether an AI coach is as good as a human coach at coaching. It is whether it can absorb the share of support volume that does not need a human, and whether the effect on completion is measurable. For a provider running two 40-learner cohorts: Metric Before After Learner questions per cohort per week ~200 ~200 Handled without instructor 0% 70%+ Instructor support hours per week 20 6 Learner confusion rate Unmeasured Under 15%, tracked Completion, 12-week programme 45% 60%+ These are operational outcomes, and they are the ones you should ask any vendor to evidence on your own content during a trial. A vendor who cannot show you the confusion data is asking you to take the completion claim on faith. How to Evaluate a Claim in This Category Frequently Asked Questions If a vendor tells you AI coaching is as effective as human coaching, ask which measure they mean. The research supports one of them and is silent on the rest, and knowing which is which is the difference between a purchase that works and one that disappoints. 👉 Book a Live Platform Demo with an EdTech Expert