BDO's Legal Tech TalkGenAI and Prompt Engineering at Legal Week
About this episode
Recorded live at Legalweek in New York, Daniel Gold and Jared Crafton talk with Andrea D'Ambra of Norton Rose Fulbright at her thirteenth Legalweek. Andrea explains why she has loved TAR for years, how she experiments with Midjourney and ChatGPT, why prompt engineering is a skill, why law firms should embrace generative AI openly with validation, and what she wants to learn on the exhibit floor.
Key takeaways
- Norton Rose Fulbright has used predictive AI and TAR for over a decade, which made generative AI a natural next step.
- Writing prompts is a skill. Andrea calls herself enthusiastic, not yet expert.
- Use generative AI for a first draft, then rewrite and verify it yourself.
- Firms should embrace generative AI openly and build ways to validate and defend its use.
- Andrea's plan at Legalweek: see enough demos to understand what is actually out there.
Full transcript
Transcript from BDO's published episode, edited for transcription errors. Speaker labels added by Gold Standard Leadership.
Welcome to BDO's Legal Tech Talk podcast. We're joined by judges and legal professionals to discuss emerging trends, regulatory updates, and the latest headlines.
We'll provide tips to help your law firms and legal departments make the most out of legal technology.
Hi, everyone. I'm Jared Crafton, BDO's forensic technology practice leader.
And I'm Daniel Gold, forensics principal and leader of the eDiscovery managed services practice.
Let's get started with this episode's exciting topic.
Alright. Welcome to another edition of BDO's Legal Tech Talk.
This is live. This is exciting.
Very exciting.
Well, with that being said, why don't we go ahead and have you start off. Andrea, why don't you tell us who you are, where you work, and a little bit about yourself.
Hi. I'm Andrea D’Ambra. I am a partner at Norton Rose Fulbright in the New York office.
I am Norton Rose Fulbright's US head of technology and US head of eDiscovery and information governance.
I am not the head of IT to be clear. And, basically, what I do is cyber security did privacy, eDiscovery, and information governance in varying amounts on any particular day.
Andrea, I don't think that you have enough to do it in a day. My gosh. I mean, like, you literally have everything under the umbrella, with your name.
Yeah. Yeah.
So what brings you to New York this week?
Oh, I think it must be legal week.
Oh, is it? Decided. And how many legal weeks in a row is this for you?
So this is thirteen for me. I started in 2011. And back then it was called legal tech.
Oh, yes. I do remember.
I missed I missed that actually. LTNY. I miss it.
I still call it that if I'm being honest. Yeah.
Yeah. Yeah.
I'm just starting to adjust to saying legal week now.
Mhmm. Mhmm. It's much broader than technology now. Right? Yeah.
Yep. So you've been coming forward, you said about thirteen years? Yeah. That's amazing. And so what are you hoping to get out of this week? What makes this year different than the other for you?
This year, what I've been really excited about and really wanted to start talking to a lot of the technology providers out there is about AI because everybody's talking about it. But I'm very interested to hear. I've heard a lot about how they're leveraging it in the eDiscovery space, but I haven't actually, I mean, seen it. And by that, I mean, like, generative AI. Right? We've been using predictive AI for years.
TAR models, love that stuff. Norton has been using that for ten years or so, maybe more, like fourteen.
But generative AI is really interesting to me and I'm really interested to see how people are are using it to make the eDiscovery processes much easier, cheaper, faster, better. Right?
That's fantastic. It's nice to hear somebody say, like I love TAR.
I mean I do.
You're right. And you're right, you know you're talking about fourteen years, so twenty ten was when it really became like the, no pun intended, the gold rush. Yep. Right?
TAR, like everyone came out with their patents around roughly around two thousand eight to twenty ten. TReC was came out with their massive study back then talking about the advantages over a manual review. And it's just, it's refreshing being amongst folks that are like minded like this to say like, yes, We love using TAR and we're looking for more efficient ways of being able to do it with generative AI. So I think that's fantastic.
Definitely sounds like your firm is ahead of the curve.
We I feel like we always have been. Florinda Baldridge and David Kessler have been sort of driving that train from the very beginning.
We've always been able to leverage it to make things work faster, better.
Even when people at the time were sort of like, oh, I don't know about this.
We've been fairly successful in convincing our clients that it's the best way to, you know, get through whatever it is we had to get through.
Absolutely. Now, personally, have you played around with generative AI at all?
Yes. I'm a huge Midjourney fan and I'm also a huge, ChatGPT fan.
Okay.
ChatGPT is my friend.
And it's been really interesting to see both of those evolve over the last year. I started using Midjourney probably September twenty twenty two, and it's a very different tool now than it was back then. And ChatGPT, I guess, I started using Ruby in March of last year, maybe a little bit earlier than that.
So for our listeners who aren't familiar, what can you describe what Midjourney is?
Yeah. So Midjourney is a generative AI tool, but it's for images. So you will write a prompt, and it will come up with an image, and then you can tweak your prompt.
The actual drafting of the prompt is an art form all of its own. Right? And it's really interesting to see people who are really, really good at it. I am not really, really good at it, but I'm enthusiastic.
So it's just like how I am in regular art. Not good, but enthusiastic.
So to see it develop over the last, I guess, almost year and a half now has been fascinating.
Well, prompt engineering is a whole expertise now. Right? And it's you have a lot of experience now, it sounds like.
And so I have some experience.
I don't have any skill.
Now is this on the personal side you're playing around with this? Or is this okay.
Yeah. I haven't I haven't done any images for my clients yet.
Then you're not selling the artwork. This isn't No. No. No. This isn't a side hustle that you have going.
Oh, I wish. No. Just, you know, personally interested unbelievable and interesting and beautiful and trying to get what you have in your head to come out on the screen.
Yep.
Right? That's amazing. Do you know, I just read that, there's about four thousand open jobs across the United States for prompt engineers. No college degree required. They're like six figure jobs. So it's interesting to see, because that's the magic, right?
Yeah.
The magic is, can you be a good prompt engineer in order to get good results?
So in some way, some people have criticized generative AI as like it's just, you know, it's a search engine on steroids, Right? But it's not, it really is Yeah. The magic behind like how you enter prompts. Are you starting to see that at your firm that there's folks that, or is that a direction that you guys wanna go into say, hey, in order to gain better results, we need people who really understand this whole prompt engineering thing.
So, yes. I think that we all understand that there is great value in being able to, leverage generative AI.
I think law firms like, it's gonna come as a surprise to no one here, that we tend to be more conservative in how we're using it and we're always very worried about, you know, client confidential information and not, you know, creating something that's gonna create risk for the firm, either from a privilege standpoint or from IP standpoint.
We are using it.
I sort of personally, when I use it, I usually use it for things that aren't client related.
But, you know, if I have to come up with a panel description for some, you know, panel I'm gonna be on ChatGPT.
ChatGPT. I put it in there.
I look at it.
I rewrite.
It's like the first draft.
Right? I'm gonna tweak it. Eventually, I'm gonna have it write my bio.
Love it.
Or rewrite my bio because I'm like, oh, I bet I could do way better than I can. But, you know, trying to use it for things like that. But it's interesting. I went to William and Mary Law School, and our law school dean, Benjamin Spencer, amazing, and one of the things he said really early on was that they were not gonna discourage the use of check GPT and other generative AI because the people who can leverage that stuff are going to be the leaders of the future. Right? They're gonna be the ones who are gonna be out there sort of in the forefront.
I think that's the right approach. I mean, it's we have to embrace this technology. We have to embrace these tools. I mean, that's the future.
Right? We need to learn how to use it. We need to get good at it. It's the building blocks for the future.
If you're ready to take on the biggest challenges in eDiscovery, then access BDO's latest ebook, how to tackle and manage five common eDiscovery challenges.
BDO developed this ebook to provide actionable insights and strategies tailored for legal professionals.
Dive into essential topics such as data privacy, cost management, and advanced technologies to streamline your eDiscovery process. Download the ebook on BDO's Legal Tech Talk podcast page.
So if the cat's out of the bag, the question becomes really as to whether or not law firms want to hide it, or law firms want to embrace it. Right? So is there an approach that you personally feel like it's a good approach to take?
Oh, absolutely embrace. I think hiding it is probably the worst idea ever from any number of standpoints. So, yeah, I think law firms have to embrace it. They have to understand it, and they have to figure out how to use it in ways that can be validated.
That was one of the problems I saw with TAR originally, right, was that everybody wanted to use it, but so many people didn't understand it and they didn't know how to validate the results, Right? So they were just like, I'm gonna put it in this black box and it's gonna be fine. You can't do that. Right?
You have to have ways to validate it. So that's what I'm really interested to see out there. See, you know, how they're gonna do the validation of, these new tools and, we'll see how it goes.
What are the strategies around defensibility and how do we explain it and yeah. Absolutely. I mean, that's I think we all wanna see some of that this weekend. So what are you gonna walk the exhibit halls? Do you have demos set up?
I have a few demos set up. I'm definitely walking the exhibit halls. Mhmm.
Definitely gonna try and get a few more demos. But I really just wanna understand what's out there. I've heard, like, I've heard tell of things. Right? But it's gotten mixed reviews. I've heard one tool that I won't name, you know, somebody said, well, it's like c plus law student. Right?
I don't know.
First level.
Yeah. First level.
Sure.
You know, at the same time, it's we're gonna get better. I honestly do believe that.
That's the excitement. Right? We're just at the beginning of this. Right?
Absolutely.
Well, that leads me to last question, Andrea. So, you know, I look at the education that you're gonna get here at Legal Week, your thirteenth one. Right? The education you're gonna get here is being really being a gift. And a gift that I think is worth sharing with everyone else. So all this education that you're gonna get, how are you gonna go back to your firm, go back to the rest of the eDiscovery community and sort of share that gift with everyone else of what you learned so that you can enable everyone to get better.
Couple different ways. I mean, I we at Norwood's Fulbright in our, eDiscovery Information Governance group, We have monthly get togethers with the group, and we all the partners will come in and we'll do training and talk about different things, and we've started doing generative AI training. One of my partners, Steve Rosa, is absolutely brilliant at all this stuff. He was teaching us all these, you know, sort of the back end stuff, which I still do not completely understand about how it works and how it's easy to leverage it in ways that I didn't know about.
Like, you know, you tell it to write something. Right? And you say, you know, write, a paragraph about x. And then instead of being like rewriting the prompt, you can just say, come on, ChatGPT.
Make it not so wordy. And it literally will change it and condense it. Right? And you're like, I can just talk to it like a normal human being.
So I'm, you know, gonna definitely go back and, continue to sort of share that knowledge there. Obviously, I'd love to speak, at different conferences and being able to be here and speak intelligently about how these tools actually work as opposed to sort of the, you know, theoretical, I think is gonna be very helpful.
Particularly because when you're trying to assess risk, it's important to understand the actual as opposed to the theoretical.
That's amazing. I love it. Andrea, so nice to have you here. You are more than welcome to come back to our virtual recording studio for a full fledged, you know, thirty minute podcast. We'd love to have you back.
Well, thank you.
Alright. Thank you so much for joining us. Thanks for joining us on BDO's ilLegal Tech Talk podcast.
If you're enjoying these podcasts, don't forget to rate, review, and subscribe for more episodes.
Head over to www.bdo.com for a list of all of our episodes, transcripts, resources, and how to get in touch with us to continue the conversation.
Until next time, this has been another episode of BDO's Legal Tech Talk.
Daniel Gold is an attorney and a Principal at BDO USA, where he leads eDiscovery managed services. He hosts BDO's Legal Tech Talk, co-hosts the NeLI Pod and founded Gold Standard Leadership.
More about DanielGet the next one in your inbox
Daniel Gold writes weekly on leadership, legal technology and eDiscovery.
Subscribe on Substack