'Moneyball' and Litigation: The Importance of a Standard Structure
Many litigation industry players are trying to be the Billy Beane of litigation, unlocking the "Moneyball" value of data that others miss.
June 04, 2020 at 09:35 PM
9 minute read
Litigation has a data problem. Ask anyone who has ever looked at the existing litigation billing codes. One code is "analysis and strategy." Of what? Of everything. That's why this code alone accounts for a massive number of hours billed by outside litigation counsel.
Every year in-house counsel pay millions of dollars for this code. It infuriates them, but they have no other option. Outside counsel who enter these codes are equally frustrated. To them, it's like being handed a wooden ruler with all of the numbers sanded off and told to measure 3 5/8 inches. So they do their best and pick a code (often one that doesn't really capture the work being delivered).
With this shaky foundation, the technology being built on top of it is just as shaky. The litigation market continues to layer new technologies on top of flawed data, to parse and repurpose it into marginally more useful constructs.
Many litigation industry players are trying to be the Billy Beane of litigation, unlocking the "Moneyball" value of data that others miss. "Moneyball" analogies are frequent. In fact, a quick Google search for "Moneyball and law" or "Moneyball and litigation" yields countless results.
So why hasn't baseball's "Moneyball" reality been realized by litigators? Why does "Moneyball" work for baseball but not litigation?
Released by author Michael Lewis in 2003, "Moneyball" profiled Billy Beane, general manager of the Oakland A's. Lewis showed how Beane and a team of data analysts in the back office of the Oakland A's obsessively gathered and applied data. They sliced and diced data into untraditional statistics (focusing on "on base percentage" rather than the popular "slugging percentage" or "batting average") to win far more Major League Baseball (MLB) games than they should have.
Indeed, with a third of the budget of other teams, like the New York Yankees, the Oakland A's repeatedly reached the playoffs. Oakland had a team of players who looked underwhelming but consistently outperformed their opponents, time and again. Beane was able to spot talent that others missed because he was looking at data, not physical appearance or conventional wisdom.
The book and movie (starring Brad Pitt as Beane) were wildly successful and remain relevant. And rightfully so. "Moneyball" captured the data revolution in baseball, showing how, for decades, MLB teams had been mismanaging and undervaluing baseball talent.
Baseball teams and their old-school scouts had been fixated on physical appearances of players, not their performance on the field. The scouts used their own subjective assessments and "gut feelings." They looked for "the good face" and how players behaved; this had gone on for decades.
Beane exposed and corrected those mistakes. He dominated MLB by making player decisions and selecting draft picks by using cold data, ignoring physical appearances and gut feelings. In fact, he refused to watch the A's play live because he knew it would cloud his objective thinking.
Beane silenced the biases of the scouts. Armed with data, Beane was able to cut through the noise and consistently identify baseball talent that others missed.
As Lewis points out, the data revolution took off in baseball because of the explosion of player salaries. No longer could a team afford to blow money on a draft pick, with players being paid six- and seven-figure salaries. Sound familiar? Litigation has the exact same challenge, with outside litigation counsel hourly billing rates now climbing into the four-figure range.
Today, 20 years later, "Moneyball" has spread far beyond baseball. The data obsession of "Moneyball" permeates every sport, oftentimes down to the Little League or junior level. And within the legal industry, for those who want to make the case for using data, "Moneyball" is a popular citation.
On the surface, it seems impossible to argue against the point that more data results in better decisions, improved performance, and increased efficiency. The answer to the legal industry's problems (and the problems of all other industries, too) is more data.
Or is it? What if the data is bad data? Or, as Lewis calls it in the book, "sloppy data."
Not all data is equal. There is good (accurate and reliable) data and bad data. Data is not fungible, nor is it inherently accurate or reliable.
And if data is gathered using an inconsistent set of instruments, or if it is measured using a shifting series of metrics and benchmarks, should we be basing our decision-making on it? Should we really run an industry that is worth hundreds of billions of dollars and determines the fates of companies and their employees using bad data?
No. But in our view, the advocates of applying "Moneyball" to litigation have missed this point. They have skipped first base in their haste to import data into the law, ignoring one major difference. Overlooked and taken for granted is that baseball has always had what litigation is missing: a standard and reliable structure.
Dating back to the mid-1800s, baseball is played using the same architecture every time: every game of baseball has nine innings, each inning has three outs, and each batter is allotted four balls and three strikes.
Baseball runs on a pure octane of baseball data because of this standard structure. This does not mean baseball statistical analysis is simple. Far from it. "Moneyball"'s most interesting parts (in our view) describe how baseball data analysis has evolved in the last few decades. Lewis explains how new statistics have been recognized as far more insightful than the popular "batting average" or "slugging percentage." But that evolution was possible only because the structure of baseball didn't vary when these new statistics were being gathered. It was possible because the standard structure of baseball stayed the same.
Baseball's structure is super simple. Thousands of young children master the game of baseball every summer. And, yet, from this structure baseball analysts are able to draw mind-bending calculations and devise categories of statistics that are still being invented to this day. The individual, subjective whims of the players and coaches are allowed to surface in many ways, but they are never allowed to change the structure of the game.
And that, more than anything else, is why "Moneyball" is possible. That is why "Moneyball" works in baseball. If that structure were removed, baseball analytics would implode. Baseball statistics would quickly become just as unhelpful and incoherent as litigation billing records. Litigation has no such structure. This lack of structure is the root cause of several major gaps. It is the real reason why litigation training, case tracking, and time and billing are so inconsistent and shallow. The rules of civil procedure do not align with how litigation is actually practiced, and law schools do little to prepare new lawyers with the practical skills they need or any acclimation to the field of play. The benchmarks and metrics are always changing, and the billing codes do not match up with how litigators practice.
The outcome of all this is a mish-mash of MacGyver-like devices and coping mechanisms that law firms, in-house clients, and individual lawyers use just to get by. There are no systems in place because systems require consistency; they require repeatable events.
Without any systems in place, barely keeping one's head above the water is seen as part of the job. It's this struggle that, in part, makes litigation both a badge of honor for those who excel at it and the most derided legal practice for those that have to pay for litigation.
None of this is the fault of any individual litigation industry player. Nobody has offered a way to put numbers on the wooden ruler or to convert the yard stick into something that measures feet and inches, too. Nobody has offered a standard structure.
As a result, the incessant talk of artificial intelligence and data analytics is all puffery. It will remain an aspirational pitch without a standard structure. Bad data in equals bad data out. This is the elephant in the data room that everyone ignores, trying instead to graft solutions dependent on structure to our own unstructured industry.
Like other industries, litigation needs a structure upon which we can layer the tools to deliver, track, measure, and assess litigation training, management, billing and, ultimately, outcomes. We need the equivalent of innings, outs, balls, and strikes from which we can make litigation repeatable, trackable and meaningful.
Those litigators who are the first-movers will become to litigation what Beane was to baseball. Those who embrace this simple truth—that structure is required to make any activity meaningful—will discover profound insights, effective artificial intelligence, and actionable data analytics.
Baseball is a game. Litigation is anything but that. Both baseball and litigation have been prominent in America for hundreds of years. In 2020, it is long past time for the litigation industry to have a standard structure. The data revolution will remain aspirational so long as litigation continues to avoid solving this fatal flaw.
Vivek Hatti is the head of legal operations consulting at Element Standard. He has over 10 years of experience helping organizations build, implement and operate innovative solutions for corporate legal departments and law firms.
Ryan Hudson is a co-founder/strategic adviser at Element Standard. He has litigated complex cases for over 15 years with and against many of the country's largest and most sophisticated law firms. He routinely works on major class actions from coast to coast and repeatedly sees the gaping structural gaps that make litigation so expensive, risky and hard to track.
Jaron Luttich is a co-founder/CEO at Element Standard. He has spent over a decade consulting on litigation processes and technology. Having worked as a litigator, a sales leader and a consultant, Luttich brings a unique perspective to the organization.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2024 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllThe Buzbee Law Firm Accused of Client Abuse in Two Louisiana Lawsuits
4 minute readSalaries for Marketing, Business Development Professionals in Texas, Nationally Are Growing
4 minute readTrending Stories
- 1Mental Health Issues Don’t Get a Holiday
- 2'It's Got to Be a Wake-Up Call:' Atlanta Attorney Hopes $16M Verdict Spurs Training Changes at Hotels
- 3FTC Bans 'Junk Fees' in Live-Event Tickets and Short-Term Lodging
- 4California Legal Awards Moving to Mid-Summer Date in 2025, Adds New Categories
- 5Law Student Sues NY Attorney Grievance Officials, Seeking Materials Over Sexual Assault Claims
Who Got The Work
Michael G. Bongiorno, Andrew Scott Dulberg and Elizabeth E. Driscoll from Wilmer Cutler Pickering Hale and Dorr have stepped in to represent Symbotic Inc., an A.I.-enabled technology platform that focuses on increasing supply chain efficiency, and other defendants in a pending shareholder derivative lawsuit. The case, filed Oct. 2 in Massachusetts District Court by the Brown Law Firm on behalf of Stephen Austen, accuses certain officers and directors of misleading investors in regard to Symbotic's potential for margin growth by failing to disclose that the company was not equipped to timely deploy its systems or manage expenses through project delays. The case, assigned to U.S. District Judge Nathaniel M. Gorton, is 1:24-cv-12522, Austen v. Cohen et al.
Who Got The Work
Edmund Polubinski and Marie Killmond of Davis Polk & Wardwell have entered appearances for data platform software development company MongoDB and other defendants in a pending shareholder derivative lawsuit. The action, filed Oct. 7 in New York Southern District Court by the Brown Law Firm, accuses the company's directors and/or officers of falsely expressing confidence in the company’s restructuring of its sales incentive plan and downplaying the severity of decreases in its upfront commitments. The case is 1:24-cv-07594, Roy v. Ittycheria et al.
Who Got The Work
Amy O. Bruchs and Kurt F. Ellison of Michael Best & Friedrich have entered appearances for Epic Systems Corp. in a pending employment discrimination lawsuit. The suit was filed Sept. 7 in Wisconsin Western District Court by Levine Eisberner LLC and Siri & Glimstad on behalf of a project manager who claims that he was wrongfully terminated after applying for a religious exemption to the defendant's COVID-19 vaccine mandate. The case, assigned to U.S. Magistrate Judge Anita Marie Boor, is 3:24-cv-00630, Secker, Nathan v. Epic Systems Corporation.
Who Got The Work
David X. Sullivan, Thomas J. Finn and Gregory A. Hall from McCarter & English have entered appearances for Sunrun Installation Services in a pending civil rights lawsuit. The complaint was filed Sept. 4 in Connecticut District Court by attorney Robert M. Berke on behalf of former employee George Edward Steins, who was arrested and charged with employing an unregistered home improvement salesperson. The complaint alleges that had Sunrun informed the Connecticut Department of Consumer Protection that the plaintiff's employment had ended in 2017 and that he no longer held Sunrun's home improvement contractor license, he would not have been hit with charges, which were dismissed in May 2024. The case, assigned to U.S. District Judge Jeffrey A. Meyer, is 3:24-cv-01423, Steins v. Sunrun, Inc. et al.
Who Got The Work
Greenberg Traurig shareholder Joshua L. Raskin has entered an appearance for boohoo.com UK Ltd. in a pending patent infringement lawsuit. The suit, filed Sept. 3 in Texas Eastern District Court by Rozier Hardt McDonough on behalf of Alto Dynamics, asserts five patents related to an online shopping platform. The case, assigned to U.S. District Judge Rodney Gilstrap, is 2:24-cv-00719, Alto Dynamics, LLC v. boohoo.com UK Limited.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250