
Edition 4: Stop the Legal AI Tool Roulette
The headlines look good. Big funding, big partnerships. But inside firms, the story is different: legal AI tools don’t match workflows, don’t earn trust, and don’t save time.

Rok Popov Ledinski
Founder | MPL Legal Tech Advisors
Oct 2, 2025
MPL Legal Tech Advisors: The Legal AI Brief
Thursday, 2 October 2025 - 4th Edition
This Week’s Theme
The headlines look good. Big funding, big partnerships. But inside firms, the story is different: legal AI tools don’t match workflows, don’t earn trust, and don’t save time.
The real problem isn’t the AI itself. Buying platforms before fixing data and processes guarantees failure.
This edition is the antidote. Clean your data, define the workflow, and run short, defensible pilots that prove value on your matters before rollout.
Insight of the Week: Stop the AI Tool Roulette
When tools underdeliver, it’s rarely because “AI doesn’t work.” It’s because the firm bought software before doing the groundwork.
Here’s the sequence that consistently works:
1. Fix the data first
One repository. Clear names, versions, folders. If the structure is messy, every output will be messy.
2. Map one workflow
Choose a common matter. Write the 6–10 steps. Mark what’s judgment and what can repeat. That’s your script.
3. Run a 30-day pilot
Use live but low-risk work. Log inputs and outputs. Senior review weekly. Decide: scale or stop.
4. Test vendors on your script
Same documents, same steps, same checks. Score on accuracy, auditability, speed, security, and repeat use.
5. Slot AI into tasks, not roles
Extraction, classification, checklists. Keep it narrow, supervised. No “act like a lawyer” prompts.
This turns hype into numbers. You’ll either reclaim hours and reduce errors, or you won’t. Either way, you stop paying for hope.
Legal AI in Action
🎬 Upskill: Future Proof Yourself as a Lawyer
Build the skills to judge tools, spot weak workflows, and lead adoption decisions, so you’re not reacting to hype.
🎬 Client Conversation: Building Confidence Step by Step
Hoorntje Legal’s managing partner on why we mapped workflows, triaged risk, and built confidence with small, controlled steps, before buying new platforms.
This Week’s Big Risk Signal
Firms keep buying AI licenses before fixing their foundations. The result? Shelfware.
Expensive seats go unused because workflows weren’t mapped first.
Budgets get burned, and leadership assumes “AI doesn’t work” when the real issue is misfit, not the technology.
What The Legal AI Frontlines Are Saying
1. Usage beats logos
ARR and partnerships don’t prove reliance. Track repeat usage and matter coverage, or it doesn’t count.
2. Small wins > big platforms
Narrow, measurable tasks on your own documents beat “do everything” claims on accuracy, speed, and auditability.
3. Evaluation is a lawyer skill
Teams that scope, standardize, and score pilots make faster, safer buy/kill calls, and stop paying for "shelfware".
Looking Ahead
🎙 Airing this Saturday!
Episode 3 of Legal AI Conversations airs Saturday at 2 PM CET with Jason Marett, former Am Law Attorney, Founder and Researcher of The Recurial Codex Project.


Rok Popov Ledinski
Founder | MPL Legal Tech Advisors
Share




