BDO's Legal Tech TalkFrom Fear to Fluency: Using Lawyer-to-Lawyer Learning in AI Adoption
About this episode
Recorded live at CLOC in Chicago, Daniel Gold and Eric Derk talk with Kim Wolf, Senior Vice President and Chief Administrative Officer for Legal at State Street. Kim describes AI as a superpower, explains how State Street's lawyers teach other lawyers to use it, and shows how tools like Copilot can turn static playbooks into living documents.
Key takeaways
- Kim treats AI as a superpower that makes her better, smarter and quicker, and she worries about how the next generation will learn the fundamentals.
- In a regulated bank, lawyers are cautious about AI. Peer-to-peer learning from lawyers who already use it moves adoption faster than top-down mandates.
- State Street's contracts center of excellence became the source of its internal AI experts.
- Success for the program is measured through feedback from the lawyers using it.
- Playbooks go stale the moment they are published. AI can keep them current as living documents.
Full transcript
Transcript from BDO's published episode, edited for transcription errors. Speaker labels added by Gold Standard Leadership.
Welcome to BDO's Legal Tech Talk podcast. We're joined by judges and legal professionals to discuss emerging trends, regulatory updates, and the latest headlines. We'll provide tips to help your law firms and legal departments make the most out of legal technology.
I'm Daniel Gold, BDO principal and eDiscovery managed services leader.
And I'm Eric Derk, BDO's managing director of legal operations. Let's get started with this episode's exciting discussion.
And welcome to a special BDO Legal Tech Talk podcast. Eric and I are here live in Chicago at CLOC, and this is actually a very exciting CLOC because it's one of the first times that I can remember that it's actually not in Vegas.
So this is good. Well, this is right at the very beginning. We're gonna see how this goes here in Chicago. And we are joined right now with Kim Wolf, who is the senior vice president and chief administrative officer for Legal at State Street Bank. Kim, thanks so much for joining us.
Thanks. I'm really thrilled to be here and also thrilled to be in Chicago and not paying twelve dollars for a hotdog in Vegas.
I think we could all say that we agree with you on that one. Also, it smells much better in here than it does in the hallways in Vegas.
Kim, you know, I'm excited to talk to you because you are actually gonna be doing one of the sessions here that I think is gonna be really interesting called operational maturity and legal ops turning innovation into execution. But one of the things that we started talking about, I think is almost more interesting is this conversation around you said AI AI. Everyone's talking about it. But you said something really interesting that I wanna talk about right now and that is this notion of everyone that is roughly been working for twenty plus years, we've all basically gotten our battle wounds of doing it the old way so to speak and so we save plenty of time. Right? We save lots of time, we're becoming much more efficient, but the folks that are coming in from school now, it's much different. Talk to me about, like, what is that like now in your mind of, like, how AI is working for us versus kids coming out of college?
Yeah. And it's particularly relevant because I've got a daughter starting college in August, and she's asking me for all sorts of advice, and I don't even know where to begin. But, you know, when I think about it now, for me, AI is my superpower. It makes me better, smarter, quicker.
It brings to life ideas that are turning around in my head and that I just didn't know how to maybe articulate the right way. It just I love working with it. But then I think about these kids who are in college or maybe even only, like, junior associates or so, you know, in the legal space. And if they're not gonna cut their teeth learning all of this stuff at the level of detail they can spot an error because AI does make lots of mistakes and I can catch them, who's going to catch them when I'm retired?
Right? And it's gonna come down to our educational approach, it's gonna come down to the way we train people, but it's definitely something on my mind right now.
Yeah, you talked about leadership as as really the number one thing that needs to be kind of brought forward when enabling AI. Tell me a little bit about what what you're up to with leadership and how you're actually teaching and coaching and training people so they actually do the fact checking and the quality control before they just push out a document?
Yeah, so I'm not quite at the point, I would say, of quality control currently. What I'm more focused on is getting people comfortable to experiment with the technology and not be afraid to use it, especially lawyers. I mean, I'm not a lawyer, but I've spent over a decade now supporting them. And I understand how lawyers are trained to be skeptical and are expected to be perfect. So using AI when you know it can make mistakes must be terrifying. There's so much on the line.
And interestingly, in a corporate in house department, you'll have the full spectrum of folks, like some who are warriors and are using it for everything, and others who are, like, afraid to type, you know, into the copilot cursor area. And for me, I wanna bring all of them along. And so one of the ideas we recently had is spitting up a program we're calling lawyer to lawyer. And I'm taking my lawyer warriors who are really good at this stuff and matching them up with the lawyers who are more reticent about it.
Do you think that there are some folks at the bank that are less likely or less willing to utilize AI because you're in a very highly regulatory industry?
Yes. I would absolutely say there's that concern about how do the regulators feel, you know, how it's being used. And there's this pressure because you've got regulators who wanna make sure that banks are safe, right, and well controlled. But then you've got shareholders who wanna bank to be as efficient as possible and increase margins. So there's this healthy tension, and lawyers are right in the middle of it.
So back to the peer to peer scenario, which I love. Can you tell us a little bit about the profile of people that are the teachers and the profile of people that are the learners?
Yeah. So this is really interesting. My AI experts are a group of lawyers from Poland, believe it or not, who are our center of excellence for contracts.
And they have been working with contracts, and they've really focused on standardizing, understanding the work itself, and they've just completely run towards AI. And they've become our experts where they're now creating prompts for us on all sorts of things. And it's a really interesting contrast because when you think about a center of excellence, it's typically a team of people that you say, we're gonna give you a playbook, and you follow that playbook. And if you deviate from that playbook, make sure you call us to, you know, that it's okay. But they've grown beyond that in the eight years, and they've really become very proficient. And it's so neat for me and for them to say, hey. You guys are our experts at something now, and we're gonna help the entire organization with the skills you've developed.
I love that. How do you end up measuring what success looks like with that program?
You know, for me, it's going to be feedback.
You know? It's not I know we all like to have these numerical measurements, and so do I. I'm a math and statistics, you know, major in college. But what it really comes down to is if I take ten people, and all ten walk away saying, I use it now, I try it now, that was great. I mean, to me, that's the best kind of output of all.
Yeah. I have to ask you about playbooks because we've written a few in our day.
They tend to get old the minute you publish them. Right?
So how did you foster this spirit of iteration kind of like continuous improvement?
Playbooks are guidelines, procedures are step by steps. I've also grown up in operations, know, not being a lawyer, investment banking operations to be specific.
And so I completely appreciate an organization where you follow these ten steps to get x done. And while there is part of that in legal, we can't forget that legal is very judgment based. So and that's why I started, like, a playbook as a guideline. And if a lawyer is using a playbook, it's not to dictate, but to guide.
Legal teams are struggling to manage resources, maintain compliance, and adopt new technologies. BDO's legal operations team can help. We enhance efficiency, reduce costs, and support compliance so you can run your legal department like a business. Schedule a meeting with us today at bdo.com.
And Daniel and I talk about this all the time, we learn stuff almost every day in the use of AI. So when your teams are trying to figure out what the highest and best indemnity or liability clause is and they're going through four different iterations, that can be an actual creative process based on jurisdiction of the clause. So like you might have to get a lawyer in there to think through what it means to have this clause officiated in Germany. So how did you guys break free of just that manual prod I mean, do you have a lot of written procedures or is it like everybody just kinda has a good understanding of how to operate and they get it done?
I've been in three different organisations in a legal department now and I would say playbooks are always there to different degrees of specificity and usage. But I'll tell you how I'm personally thinking about contracting.
You know, one of the things that I'm focused on right now in my role is how do I completely reimagine contracting on so many levels with AI and agents, and that's probably a whole other podcast.
But coming back to the playbooks, like, the way I'm thinking about contracting is if I've got, you know, fifty contracts with client a that I've had over the past ten years, I can write a playbook just for that client, quite frankly, using Microsoft Copilot, the corpus of documents. And then when something happens or is proposed, bump it up against that, like Copilot completely unleashes.
It eliminates the need to have outdated playbooks if you know how to use it the right way, and they can become living, breathing documents.
So there's something there that it is not my phrase, and I heard you used it earlier, I love it though. We talk about this all the time, thought leader versus thought partner.
And that idea, an iteration of it came out by Jeff Woods in a book called the AI Thought Leader and I've recommended it to literally everybody I know and I don't get paid or endorsed or any royalties or that, I just think it's a fantastic book. One of the things that Jeff says in that book is that we need to be able to treat like the copilot of the world, you know, all these Gen AI tools as being a thought partner and not let it lead. And when you talk about that, that's so interesting because you are basically eliminating the need to have a separate software. Right? You are leveraging with one AI tool to throw all these documents and all these contracts out to basically create a playbook for yourself.
It's definitely possible and I talk about one tool because that's what I have at my disposal. There are plenty of tools out there now that could probably do it in a more sophisticated manner and I'm looking at them.
Tell us about what AI is doing to the CAO's role and like, your day to day, like, you know, you could wake up every morning and have an alert with your top ten emails or the stuff you gotta reply to the GC about. Give us some practicals about how you're using AI every day to essentially improve your workflows.
I'm probably gonna disappoint you with my response, honestly. My biggest use of AI right now is my writing of emails. And I'm a really good writer, but what it helps me do is refine my tone to the audience. So I know what I wanna say, and I can say it eloquently, but now I can say, I'm writing to the general counsel, and it knows the voice I should be using for the general counsel, or I'm presenting to the executive committee, or I'm talking to my team, and so I can start with my ideas and write a draft and then use Copilot to rewrite it so that it'll resonate better with my audience.
See, I think that that is you know, we talk a lot about using AI tools to do something like that to write emails, but I don't think that people really talk about it in great detail, practical use cases like this one, right? There's managing up and there's managing down, right? And being able to provide it with the tone or that this is who the audience is very helpful. I happen to go harking back to my old school days of when I used to have a dictaphone and I would dictate my briefs and with a micro cassette recorder and all of a sudden, I feel like I'm back in those days again because I like to be able to have my headset connected to my laptop and dictate and then have it change the tone of what I would normally say or frankly just make me sound intelligent, whichever one you wanna go with, but it's interesting.
A little bit of lighter topic. So, you know, we said on the outset we're here in Chicago and you said pre recording this is definitely not your first clock, say you've been to other clock conferences. How many have you been to altogether?
I think I've lost count but it's definitely five or more.
Yeah. Yeah. And so when you've been to five or more, what is it that you, I guess, historically have walked out? Do you feel like rejuvenated? Do you feel exhausted by all the vendors here? And and what's been your feeling year to year? Does each one have a different feel to it?
I would definitely say that every CLOC has a different feel. And I think as I've matured as a leader, I've taken away something different each time.
And I think the biggest growth area for me coming to CLOC over the years aside from, you know, better understanding legal operations is really appreciating the value that vendors can bring. I embrace the vendors whether I'm gonna buy a few or not because you're a wealth of information.
And so I just really have come to appreciate that exchange of ideas and thought leadership and so on. So it's just given me a very different perspective on a part of the ecosystem that I probably didn't have as much appreciation for that I should have.
I wanted to ask you about this vendor thing because I think at Legal Week Have you ever been to Legal Week in New York?
Oh, I love Legal Week. Yeah.
Yeah. And remember we used to go there and it would be like three floors and just vendor after vendor after vendor and now, when you come to Clock, it's a lot more refined. But with AI, like, didn't used to spend a lot of time on the floors. And Daniel and I both spent a lot of time in the last two conferences walking the floors and actually looking at See what are doing. Every everything is AI.
Yes.
I love your email writing thing because I think it's an unsung writing in general is a lost art, but being able to write articulately to a specific audience is super cool.
What's next? What are you looking for?
With AI?
Yeah. You got the email thing asked and answered. So what's?
You know, you asked me how am I using it in my day to day, and it's less so about my day to day as much as where I wanna take in house legal. And I think about how can I use AI to help lawyers do their jobs even better?
For me, it's not about how do I do it more efficiently and go from twenty lawyers to ten lawyers? Like, honestly, I don't think that's the smartest way to think about AI for the legal industry because there's so much work that's needs to be done. There's more demand than there is supply. So let's think about how do we be efficient, redeploy that capacity rather than shrink a department.
But putting that to the side, how can I help them do their jobs even better? And for me, it's about what are the various data sets around an organization that if I were able to pull them together and put them at the lawyer's fingertips would help them make better decisions, write better contracts, whether that be, you know, not the obvious ones like, you know, what are the laws and regulations that are changing and horizon scanning? We know we need that. But what's happened historically inside the organization?
What errors and losses have we had in the past because we agreed to a clause in a contract that we keep, you know, re agreeing to, and I'm not saying this has happened, but hypothetically, right, and we lose money over it because salespeople are trying to cut a deal, and the operations people can't execute on the contract.
So it's like, how do I pull together all of these pieces of data that sit across an organisation in such a way that they help lawyers give better advice?
So if you were to walk out of here with one thing that can really help them do that, what are you hoping that's gonna be?
Oh my gosh. I wish there was one piece of software that would do all of that for me, but that's not realistic. But, yeah, like for me, from a vendor perspective, I will walk the floor several times and, you know, scout out what's there to get ideas. And are there pieces of different platforms that I can string together, or is there something we can build ourselves?
I'm always on the hunt for, you know, what can help. But on top of that, you know, just me personally, I love the newbie legal ops person too. Like, I wanted to be a teacher when I was five years old and I never pursued that, but I absolutely love helping people develop and bringing them along. So I also just love the pure energy that's here.
Alright. Kim, thank you so much for joining us here on BDO's Legal Tech Talk. Good luck on the panel and enjoy the conference.
Thanks for joining us on BDO's Legal Tech Talk podcast.
If you're enjoying our podcast, don't forget to rate, review, and subscribe for more episodes.
On bdo.com, you'll find all of our episodes, transcripts, and ways to continue the conversation.
Until next time, this has been another episode of BDO's Legal Tech Talk.
Daniel Gold is an attorney and a Principal at BDO USA, where he leads eDiscovery managed services. He hosts BDO's Legal Tech Talk, co-hosts the NeLI Pod and founded Gold Standard Leadership.
More about DanielGet the next one in your inbox
Daniel Gold writes weekly on leadership, legal technology and eDiscovery.
Subscribe on Substack