AI's Drafting Accuracy Makes Strides, but Lawyers Want a More Personalized Voice
Text generated by artificial intelligence has made strides in grammatical accuracy and overall coherency, but law firms and attorneys may be more concerned that AI-powered drafting tools are able to capture their own unique styles or voices.
May 04, 2020 at 01:30 PM
4 minute read
The biggest challenge facing developers of artificial intelligence-powered legal drafting software may not be the technical but the personal. While the accuracy rate of AI drafting tools that can help lawyers churn out documents such as pleadings, briefs or discovery requests and responses is steadily improving, getting those finished products to align with the varying standards of an array of law firms and attorneys may still be an ongoing process.
James Lee, CEO and co-founder of LegalMation, indicated that accuracy can be something of a roaming target, not just because of limitations in still-developing AI technology, but individual preferences or stylistic flourishes of attorneys. He believes the problem with AI in legal is that there are often clusters of possible right answers, rather than one clear choice.
"Lawyers consider themselves to be artists. I can put 10 lawyers in a room and tell them to draft something, and I will have 20 different versions of it. And it's because lawyers like to put their stamp of uniqueness on a work product, their preferences," Lee said.
LegalMation isn't the only purveyor of AI drafting software to notice attorneys' penchant for individualistic flair. Casetext, for example, released an automated legal brief-writing software titled Compose in February. CEO Jake Heller told LTN that some lawyers are still feel some hesitation when it comes to automation.
"Some people hear automation and their initial reaction is, 'Oh, that's impossible or will that take away from my voice,'" Heller said.
But the reality is that text generation has continued to make strides over the past five years, even if it is still building to successfully replicating a person's style or voice in writing. Dan Roth, a professor in the Department of Computer and Information Science at the University of Pennsylvania, indicated that AI-generated text can now be counted on for grammatical correctness, while overall coherency can still begin to wane, depending on the length of the document.
Overall accuracy also remains something of an issue, for example, with AI-generated contracts, running the risk of omitting certain key conditions. "So you really have to be careful with how this is going to be used and what is the context," Roth said.
However, the accuracy issue that may still prove the most difficult for legal tech providers to overcome is conforming AI drafting tools to an individual client's stylistic expectations. Instilling that kind of purposeful bias or direction would most likely require the ability for a lawyer or law firm to be able to feed a product their own training samples rather than relying on "factory settings."
LegalMation has already performed similar work for clients in a beta testing form and tracked the feedback. "The accuracy scores go way up from the general out-of-the-box model, because [the product] is literally trying to mimic what those lawyers are doing at that firm," Lee said.
So will those kinds of tailor-made AI products become commonplace? There could be both technical and marketplace limitations that slow the development of such features.
Lee thinks that a "one-size-fits-all" product with limited customization likely covers more users and thus would be friendlier to the mass market. But for legal tech companies attempting to reach larger, more sophisticated entities, a higher degree of customization and integration may be required.
At least the AI should be up to the challenge. Per Roth at the University of Pennsylvania, AI can capability identify an individual person's writing style based on factors such as the use of prepositions or frequency of punctuation. That ability has now extended to being able to generate text mimicking that person's style.
"That's something that we've made a lot of progress in," Roth said.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2024 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllTrending Stories
- 1Gibson Dunn Sued By Crypto Client After Lateral Hire Causes Conflict of Interest
- 2Trump's Solicitor General Expected to 'Flip' Prelogar's Positions at Supreme Court
- 3Pharmacy Lawyers See Promise in NY Regulator's Curbs on PBM Industry
- 4Outgoing USPTO Director Kathi Vidal: ‘We All Want the Country to Be in a Better Place’
- 5Supreme Court Will Review Constitutionality Of FCC's Universal Service Fund
Who Got The Work
Michael G. Bongiorno, Andrew Scott Dulberg and Elizabeth E. Driscoll from Wilmer Cutler Pickering Hale and Dorr have stepped in to represent Symbotic Inc., an A.I.-enabled technology platform that focuses on increasing supply chain efficiency, and other defendants in a pending shareholder derivative lawsuit. The case, filed Oct. 2 in Massachusetts District Court by the Brown Law Firm on behalf of Stephen Austen, accuses certain officers and directors of misleading investors in regard to Symbotic's potential for margin growth by failing to disclose that the company was not equipped to timely deploy its systems or manage expenses through project delays. The case, assigned to U.S. District Judge Nathaniel M. Gorton, is 1:24-cv-12522, Austen v. Cohen et al.
Who Got The Work
Edmund Polubinski and Marie Killmond of Davis Polk & Wardwell have entered appearances for data platform software development company MongoDB and other defendants in a pending shareholder derivative lawsuit. The action, filed Oct. 7 in New York Southern District Court by the Brown Law Firm, accuses the company's directors and/or officers of falsely expressing confidence in the company’s restructuring of its sales incentive plan and downplaying the severity of decreases in its upfront commitments. The case is 1:24-cv-07594, Roy v. Ittycheria et al.
Who Got The Work
Amy O. Bruchs and Kurt F. Ellison of Michael Best & Friedrich have entered appearances for Epic Systems Corp. in a pending employment discrimination lawsuit. The suit was filed Sept. 7 in Wisconsin Western District Court by Levine Eisberner LLC and Siri & Glimstad on behalf of a project manager who claims that he was wrongfully terminated after applying for a religious exemption to the defendant's COVID-19 vaccine mandate. The case, assigned to U.S. Magistrate Judge Anita Marie Boor, is 3:24-cv-00630, Secker, Nathan v. Epic Systems Corporation.
Who Got The Work
David X. Sullivan, Thomas J. Finn and Gregory A. Hall from McCarter & English have entered appearances for Sunrun Installation Services in a pending civil rights lawsuit. The complaint was filed Sept. 4 in Connecticut District Court by attorney Robert M. Berke on behalf of former employee George Edward Steins, who was arrested and charged with employing an unregistered home improvement salesperson. The complaint alleges that had Sunrun informed the Connecticut Department of Consumer Protection that the plaintiff's employment had ended in 2017 and that he no longer held Sunrun's home improvement contractor license, he would not have been hit with charges, which were dismissed in May 2024. The case, assigned to U.S. District Judge Jeffrey A. Meyer, is 3:24-cv-01423, Steins v. Sunrun, Inc. et al.
Who Got The Work
Greenberg Traurig shareholder Joshua L. Raskin has entered an appearance for boohoo.com UK Ltd. in a pending patent infringement lawsuit. The suit, filed Sept. 3 in Texas Eastern District Court by Rozier Hardt McDonough on behalf of Alto Dynamics, asserts five patents related to an online shopping platform. The case, assigned to U.S. District Judge Rodney Gilstrap, is 2:24-cv-00719, Alto Dynamics, LLC v. boohoo.com UK Limited.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250