In this episode of Future Ready Lawyer, hosts Alex, Armin, and Mark, are joined by Vicki McNamara, Senior Research Associate at the UNSW Centre for the Future of the Legal Profession, to discuss the growing global trend of generative AI misuse in litigation.

The conversation centers on Vicki’s upcoming research, which identifies over 470 cases across common law jurisdictions where AI has generated "hallucinated" citations or procedurally flawed documents. The panel explores the resulting strain on court resources, the phenomenon of "verification drift" where users become too confident in AI outputs to verify them, and the potential long-term risks of eroding critical legal thinking and creativity among junior lawyers.

They conclude by discussing the necessity of better public education and the "average effect" of AI on legal excellence, looking ahead to a future where AI errors may become more subtle than blatant hallucinations.

Show Notes & Links

Guest & Organizations

• Vicki McNamara: UNSW Staff Profile; LinkedIn
• UNSW Centre for the Future of the Legal Profession: Website
• GenAI, Fake Law & Fallout Report Website

Cases & Legal Resources Mentioned

• Mata v. Avianca: The "ChatGPT Lawyer" Case (The US case regarding fake citations mentioned early in the episode)
• May v Costaras [2025] NSWCA 178: Case Judgment (The NSW Court of Appeal case mentioned involving Chief Justice Bell)
• New Zealand Courts - Generative AI Guidelines: Guidelines for Lawyers, Judges, and Non-Lawyers
• Fair Work Commission (Australia): Website (Cited for good plain language material)

NZ Parliamentary Counsel Office: AI Chatbot Initiative

This episode of "Future Ready Lawyer: AI and the Evolution of Legal Practice" explores the rapidly shifting landscape of AI in legal education and practice. The conversation covers the impact of generative and agentic AI on legal job roles, the prospect of "AI-first" companies, the productivity paradox of AI tools, the changing nature of graduate legal work, and the enduring need for deep expertise and human judgment in law. We review recent empirical research, legal market hiring trends, sector skepticism about full automation, and the new skills required as legal workflows evolve.

Show note sources:

Thomson Reuters, 2025 Generative AI in Professional Services Report https://legal.thomsonreuters.com/blog/how-ai-is-transforming-the-legal-profession/

Luis von Ahn (Duolingo), Duolingo "AI-first" company coverage (2025) https://www.nytimes.com/2025/08/17/business/duolingo-luis-von-ahn.html

Financial Review (AFR), LinkedIn, Law firms take more graduates even as AI does the grunt work https://www.afr.com/companies/professional-services/law-firms-take-more-graduates-even-as-ai-does-more-grunt-work-20250626-p5malv

Princeton researchers (Knight First Amendment Institute) AI as Normal Technology https://knightcolumbia.org/content/ai-as-normal-technology

Gary Marcus Generative AI's most prominent skeptic https://www.project-syndicate.org/magazine/generative-ai-fundamentally-unreliable-and-with-no-apparent-solution-by-gary-marcus-2025-06

METR: Becker, J., Rush, N., Barnes, B., & Rein, D. Measuring the impact of early-2025 AI on experienced open-source developer productivity https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/

Centre for Legal Innovation, Women + AI APAC Summit Women + AI APAC Summit 2025 (panel and conference) https://events.humanitix.com/women-ai-summit-apac-2025

In the second episode of 'Future Ready Lawyer: AI and the Evolution of Legal Practice,' the discussion revolves around the adoption and challenges of generative AI in legal practice. The episode touches on the current state of AI use in legal firms and specific applications of generative AI. Hosts discuss the varied adoption rates, the effectiveness of AI tools, and the impact of AI on legal efficiency. They point out issues related to cost and training that hinder widespread adoption.

Show note sources: Damien Charlotin ‘AI Hallucination Cases’ https://www.damiencharlotin.com/hallucinations/ Thomson Reuters ‘2025 Generative AI in Professional Services Report’ https://www.thomsonreuters.com/en/reports/2025-generative-ai-in-professional-services-report Dye & Durham ‘Lawyers face work-life paradox as AI adoption soars across the profession’ https://dyedurham.com.au/lawyers-face-work-life-paradox-as-ai-adoption-soars-across-the-profession/ Clayton Utz ‘Clayton Utz adopts Harvey in next step of AI journey’ https://www.claytonutz.com/about/media-releases/2025/september/media-release-clayton-utz-adopts-harvey-in-next-step-of-ai-journey Webb, Julian and Paterson, Jeannie Marie, THE EVOLUTION OF LEGAL KNOWLEDGE WORK IN AN AGE OF BRILLIANT(?) TECHNOLOGIES: FROM ROBO-LAWYER TO DIGITAL LAW CLERK (April 02, 2025). Available at SSRN: https://ssrn.com/abstract=5371536 or http://dx.doi.org/10.2139/ssrn.5371536 Open AI ‘How we’re responding to The New York Times’ data demands in order to protect user privacy’ https://openai.com/index/response-to-nyt-data-demands/

The first episode of 'Future Ready Lawyer: AI and the Evolution of Legal Practice,' sets the stage for a series of in-depth discussions on AI's role in transforming legal processes, education, and professional practice. In this episode, Mark Bennett, Alex Vost, and Armin Alimardani discuss the impact of artificial intelligence on the legal field. They analyse the challenges of AI literacy among lawyers, instances of AI misuse in courtrooms, and the future of legal education and practice. They also explore how AI can enhance efficiency, the role of law firms in training graduates on new technology, and the shifting landscape of legal work.