The defendants’ inability to protect their clients’ privileged information was a direct result of their failure to heed these best practice points. Defendants did not appreciate the inherent complexity of the electronic discovery process, understand the nature or format of the electronic documents they reviewed, or verify the results of their work. They also inexplicably withdrew their request for a clawback agreement.

Explaining the Search Rationale: In addition to confirming what should have been obvious to any practitioner — that a poorly designed keyword search would not suffice to overcome a claim of waiver — Victor Stanley adds to the growing number of decisions calling upon lawyers to demonstrate that the search methodology chosen was appropriate. Here, when instructed to supply support, the defense attorneys, who (along with their client) selected the keywords used for searching, offered nothing.

The defendants did not offer a defense of the search terms chosen or provide background to establish their qualifications “for designing a search and information retrieval strategy that could be expected to produce an effective and reliable privilege review.”[FOOTNOTE 8]

Those omissions were compounded by the fact that the defendants had failed to sample the results of their privilege search, leaving them with no indication of effectiveness, when “[c]ommon sense dictates that sampling and other quality assurance techniques must be employed to meet requirements of completeness.”[FOOTNOTE 9] This led the court to conclude that the keyword searching relied upon by the defendants was insufficient, because “simple keyword searches end up being both over- and under-inclusive in light of the inherent malleability and ambiguity of spoken and written English (as well as all other languages).”[FOOTNOTE 10]

That Magistrate Judge Grimm would require defense counsel to explain its search methodology and the rationale underlying it is unexceptional. But in so doing, he raises some interesting questions about how a party should explain its methodology. The judge, although cautious in his dicta, raises the specter of requiring expert testimony to support search methodology. In a lengthy footnote, he delves into two opinions by U.S. Magistrate Judge John M. Facciola of the U.S. District Court for the District of Columbia, U.S. v. O’Keefe[FOOTNOTE 11] and Equity Analytics, LLC v. Lundin.[FOOTNOTE 12 ]

These opinions proceed from the premise that “determining whether a particular search methodology … will or will not be effective certainly requires knowledge beyond the ken of a lay person (and a lay lawyer).” [FOOTNOTE 13] And as such, “this topic … requires that any conclusion be based on evidence that, for example, meets the criteria of Rule 702 of the Federal Rules of Evidence.” [FOOTNOTE 14]

O’Keefe and Equity Analytics unnerved some commentators, who worry that “engraft[ing] Rule 702 … into discovery would multiply the costs of discovery.” [FOOTNOTE 15] Magistrate Judge Grimm, however, reads his colleague’s opinions in a rather narrow manner. He observes: “Viewed in its proper context, all that O’Keefe and Equity Analytics required was that the parties be prepared to back up their positions … with reliable information from someone with the qualifications to provide helpful opinions.”

So, although the requisite “reliable information” may include a “qualified expert,” it is not so limited. In summarizing his position, Grimm again specifically notes that in choosing a methodology, parties should be “aware of literature describing the strengths and weaknesses of various methodologies, such as The Sedona Conference Best Practices.” Then, if the search methodology is ultimately challenged, the party “should expect to support their position with affidavits or other equivalent information from persons with the requisite qualifications and experience, based on sufficient facts or data and using reliable principles or methodology.”

The takeaway point seems to be that when formulating a search, a party must have some cogent rationale. If the methodology cannot be supported with reference to industry standards, a treatise, or other previously tested rationales, an expert may be required to overcome the burden of showing that the search was reasonable.

Need for Transparency: Above all, the opinion in Victor Stanley highlights the need for transparency and collaboration in the e-discovery process.[FOOTNOTE 16] As Grimm notes, the parties should confer and agree on a search and retrieval method and thus “minimize[] cost because if the method is approved, there will be no dispute resolving its sufficiency.”

Lawyers should identify the information that exists, determine the sources and format of the information, consider the burdens and costs of production, and come to an agreement on a reasonable search protocol to be approved by the court. Throughout this process, lawyers must recognize that the search for electronic documents is an inexact science; inevitably, no search methodology will produce every responsive document or identify every potentially privileged one.

CONCLUSION

Victor Stanley highlights the need for lawyers to think carefully about their approach to e-discovery. The search for electronic information is not a task that can be accomplished quickly or haphazardly. The protection of client confidences requires that lawyers carefully plan and implement their searches, mindful of the potential need to explain their methodology to the court; and that they work with opposing counsel to identify a search methodology that will be effective and cost-efficient.

H. Christopher Boehning and Daniel J. Toal are litigation partners at Paul, Weiss, Rifkind, Wharton & Garrison. Daniel S. Kirschbaum, an associate at the firm, and Jeffrey J. Recher, a summer associate, assisted in the preparation of this article.

:::::FOOTNOTES:::::

FN1 232 F.R.D. 228 (D. Md. 2005). For a discussion of Hopson, see John F. Baughman and H. Christopher Boehning, “‘Hopson’ Is a Good Reminder That There Are No Short Cuts,” NYLJ (Feb. 28, 2006).

FN2 2007 WL 1300739 (D.Md. May 4, 2007).

FN3 See 232 F.R.D. at 235.

FN4 For cases in the Second Circuit that adopt a balancing test consisting of several factors, see Hydraflow Inc. v. Enidine Inc., 145 F.R.D. 626 (W.D.N.Y. 1993); Local 851 of the Int’l Brotherhood of Teamsters v. Kuehne & Nagel Air Freight Inc., 36 F. Supp.2d 127 (E.D.N.Y. 1999); Large v. Our Lady of Mercy Medical Center, No. 94 Civ. 5986 (JGK)THK, 1998 WL 65995 (S.D.N.Y. Feb. 17, 1998).

FN5 For a discussion by the authors of the recent literature and findings on various search methodologies, see H. Christopher Boehning and Daniel J. Toal, “Assessing Alternative Search Methodologies,” NYLJ (April 22, 2008).

FN6 See Victor Stanley, 2008 WL 2221841 at *6 (citing The Sedona Conference Best Practices Commentary on the Use of Search & Information Retrieval Methods in E-Discovery, 8 Sedona Conf. J. 189 (2007)).

FN7 See id. (citing 8 Sedona Conf. J. at 194-95, 201-02).

FN8 Id. at *3.

FN9 Id. at *5 (quoting In re Seroquel Prods. Liab. Litig., 244 F.R.D. 650, 662 (M.D. Fla. 2007)).

FN10 Id. (quoting 8 Sedona Conf. J. at 194-95).

FN11 537 F. Supp. 2d 14 (D.D.C. 2008).

FN12 248 F.R.D. 331 (D.D.C. 2008).

FN13 Equity Analytics, 248 F.R.D. at 333.

FN14 O’Keefe, 537 F. Supp. 2d at 24.

FN15 Ronald J. Hedges, Rule 702 and Discovery of Electronically Stored Information, 8 Digital Discovery and E-Evidence (BNA) No. 5, at p. 4 (April 11, 2008).

FN16 See also John F. Baughman and H. Christopher Boehning, “Benefits of Transparency: Discussing What Will Be Produced With Your Adversary,” NYLJ (April 25, 2006).