← All editions
Edition 5 Thursday, 9 October 2025

Legal AI Policies Are Theatre

Legal AI demos are easy. Adoption isn’t.

The Legal AI Brief MPL Legal Tech Advisors
Edition 5 · Thursday, 9 October 2025

This Week’s Theme

Legal AI demos are easy. Adoption isn’t.

Some legal teams have a PDF “AI policy” and most a graveyard of pilots.

That’s what happens when leadership writes rules but no one installs the loop that runs AI week after week.

This edition is the fix:

Evaluate >> Approve >> Deploy >> Measure >> Refine

If it isn’t happening on a recurring cadence, your AI is theatre.

1. Evaluate on your own matters

Pick one workflow. Script 6-10 steps. Build a small evaluation set from past files. Score accuracy, auditability, speed, repeat use.

2. Approve by rule

One table. Thresholds. Red / amber / green. Who signs off. What happens on failure.

3. Deploy into tasks

Extraction. Classification. Checklists. Citations. No “act like a lawyer” prompts.

4. Measure weekly

Usage. Edit rate. Time saved. Exception count. Matter coverage.

5. Refine (tight feedback loop)

Review miss cases. Update prompts or rules. Push wins from pilot → practice.

This rhythm turns policy compliance into observable behavior. It also tells you, fast, whether to scale or kill a tool, before it becomes “shelfware”.

🎬 The 90-Day AI Operating Rhythm

The process that turns AI from initiative into routine.

The BEST Way to Upskill Your Legal Team in AI (Step-by-Step Guide)

🎬 Case study: 2-week consulting audit

How structure and governance were designed before choosing tools.

Setting Up the UK's First CIC for Harassment in the Workplace (LIVE Case Study)

Red Flag of the Week

Across calls with a litigator managing eDiscovery, a legal tech investor, and a 20-year enterprise legal ops lead:

AI is still being “approved” via policy but not run through process.

Pilots launch without owners, exceptions stay in inboxes, and usage flatlines after week one.

AI isn’t failing on capability, it’s failing on cadence.

1. Rhythm beats policy

A written rule changes nothing without a weekly loop to enforce it.

2. Tables beat committees

Approval needs thresholds and ownership, not debate.

3. Usage is the only proof

If it isn’t tracked on live matters weekly, it’s already dead.

Looking Ahead

🎙 This Saturday at 2pm CET!

This week’s guest on Rok’s Legal AI Conversations is Srinidhi Ranganathan, Founder of AgreePro. Her lesson from building AI for contracting: tools don’t move deals forward, process and rhythm do.

Podcast guest cover
AI adoption efforts are downplayed

Each edition of Legal AI Brief brings practical lessons from firms using AI safely.

← Previous Edition 4: Stop the Legal AI Tool Roulette Next → Edition 6: Audit Trail Your AI Policy Forgot
More editions

Get the next edition in your inbox.

Every Thursday. No noise, no pitch — just what's worth knowing about AI risk in legal practice this week.