Machine Learning Technology Can Help Agencies Handle New FOIA Request Standard
Following yet another D.C. court ruling, government agencies and their partners must be prepared to conduct defensible searches and show that they have made a good faith effort to respond.
November 08, 2018 at 07:00 AM
4 minute read
In October 2018, U.S. District Judge Christopher Cooper ruled that “FOIA requests are not a game of Battleship. The requester should not have to score a direct hit on the records sought based on the precise phrasing of his request.” In an opinion which cites Summers v. Department of Justice and Bagwell v. Department of Justice, Cooper ordered the Department of Homeland Security to conduct an additional search of agency records in response to the Government Accountability Project's FOIA request. The judge ordered a new meet-and-confer within two weeks of the ruling to “engage in a good faith effort to arrive at a reasonably limited set of additional search terms that rectify the under-inclusivity of the 'ideological tests' and 'cellphone' search terms without being too over-inclusive.”
The opinion forms the third ruling in the District Court for the District of Columbia which upholds the Freedom of Information Act and orders expansion of search terms from FOIA requests issued to government agencies. As a result, we can expect that other agencies will be subject to the same standard in the future. This means government agencies and their partners must be prepared to conduct defensible searches and show that they have made a good faith effort to respond.
As Cooper noted in his opinion, under-inclusive terms may be tantamount to asking the responding party to prove or disprove your case through the search, which is a tough standard for any organization. Both parties should think expansively about what defines the issue at question—in this case, an “ideological test.” Define a universe of terms which are relevant to the query—what you might be looking for may need to broaden beyond the specific language used in the request to could include words that suggest conversations about, for instance, political viewpoints, religious affiliations, worldviews, etc.
There are some relatively basic technologies available to accomplish this query expansion. Parties can use software tools to augment the defined terms—political, religious, etc. Identify the word roots for those words (Islam vs. Islamic) and stem the terms to find every variant (Islamophobe, Islamicization, etc). Next, expand into synonyms (Muslim in addition to Islam, Progressive in addition to Liberal, etc.) to cover potentially relevant words or phrases.
An unsupervised machine learning technique known as “clustering” uses patterns in language to identify related topics/domains. Clustering technology will organize documents into high-level themes, making it easier to isolate irrelevant docs, such as internal HR matters, etc., which are divorced from the cause of action. Clustering can help identify thematically related documents, such as discussions of criteria for entry, and hone in on those patterns. Clustering technology is increasingly available to get a quick sense of the query or relevance.
Applying these technologies demonstrates to the court that you have applied all available resources to the FOIA request, while ensuring that the search terms don't incur the burdensome cost associated with being too over-inclusive, or being asked to prove the requesting party's argument.
Once the clusters and query expansion techniques have been applied, and responsive documents are identified, supervised machine learning tools like predictive coding may be applied. These machine learning tools can be trained to identify other potentially responsive documents and help to further weed out the irrelevant documents. Even if your team has not used this technology before, predictive coding may be worth applying for a highly-defensible search. This will further show that the search team has left no stone unturned, and that human error has been minimized.
When these technologies or the budget requirements aren't available to conduct this more comprehensive search, an alternative (or complementary) good-faith response is to ask the requestor for a more carefully-defined FOIA request, and negotiate a list of reasonable terms. Parties who run a search on a limited and under-inclusive list of terms may expect that a judge will recognize when they are being purposely obtuse. Whatever approach you take, make a visible effort to understand the requesting party and their intent at a deeper level. Ensure the search reflects how real people discuss the issue at hand, to validate that your search and response are conducted in a defensible manner.
Jon Kerry-Tyerman is Vice President of Business Development & Intelligence for Everlaw. Previously, he served as a Senior Director in the Innovation practice at LexisNexis, where he chaired the Digital Culture Task Force. Jon served over eight years as a Professor of Law at the University of San Francisco, where he worked in the Internet and Intellectual Property Justice Clinic.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2025 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllTrending Stories
- 1Decision of the Day: Judge Dismisses Defamation Suit by New York Philharmonic Oboist Accused of Sexual Misconduct
- 2California Court Denies Apple's Motion to Strike Allegations in Gender Bias Class Action
- 3US DOJ Threatens to Prosecute Local Officials Who Don't Aid Immigration Enforcement
- 4Kirkland Is Entering a New Market. Will Its Rates Get a Warm Welcome?
- 5African Law Firm Investigated Over ‘AI-Generated’ Case References
Who Got The Work
J. Brugh Lower of Gibbons has entered an appearance for industrial equipment supplier Devco Corporation in a pending trademark infringement lawsuit. The suit, accusing the defendant of selling knock-off Graco products, was filed Dec. 18 in New Jersey District Court by Rivkin Radler on behalf of Graco Inc. and Graco Minnesota. The case, assigned to U.S. District Judge Zahid N. Quraishi, is 3:24-cv-11294, Graco Inc. et al v. Devco Corporation.
Who Got The Work
Rebecca Maller-Stein and Kent A. Yalowitz of Arnold & Porter Kaye Scholer have entered their appearances for Hanaco Venture Capital and its executives, Lior Prosor and David Frankel, in a pending securities lawsuit. The action, filed on Dec. 24 in New York Southern District Court by Zell, Aron & Co. on behalf of Goldeneye Advisors, accuses the defendants of negligently and fraudulently managing the plaintiff's $1 million investment. The case, assigned to U.S. District Judge Vernon S. Broderick, is 1:24-cv-09918, Goldeneye Advisors, LLC v. Hanaco Venture Capital, Ltd. et al.
Who Got The Work
Attorneys from A&O Shearman has stepped in as defense counsel for Toronto-Dominion Bank and other defendants in a pending securities class action. The suit, filed Dec. 11 in New York Southern District Court by Bleichmar Fonti & Auld, accuses the defendants of concealing the bank's 'pervasive' deficiencies in regards to its compliance with the Bank Secrecy Act and the quality of its anti-money laundering controls. The case, assigned to U.S. District Judge Arun Subramanian, is 1:24-cv-09445, Gonzalez v. The Toronto-Dominion Bank et al.
Who Got The Work
Crown Castle International, a Pennsylvania company providing shared communications infrastructure, has turned to Luke D. Wolf of Gordon Rees Scully Mansukhani to fend off a pending breach-of-contract lawsuit. The court action, filed Nov. 25 in Michigan Eastern District Court by Hooper Hathaway PC on behalf of The Town Residences LLC, accuses Crown Castle of failing to transfer approximately $30,000 in utility payments from T-Mobile in breach of a roof-top lease and assignment agreement. The case, assigned to U.S. District Judge Susan K. Declercq, is 2:24-cv-13131, The Town Residences LLC v. T-Mobile US, Inc. et al.
Who Got The Work
Wilfred P. Coronato and Daniel M. Schwartz of McCarter & English have stepped in as defense counsel to Electrolux Home Products Inc. in a pending product liability lawsuit. The court action, filed Nov. 26 in New York Eastern District Court by Poulos Lopiccolo PC and Nagel Rice LLP on behalf of David Stern, alleges that the defendant's refrigerators’ drawers and shelving repeatedly break and fall apart within months after purchase. The case, assigned to U.S. District Judge Joan M. Azrack, is 2:24-cv-08204, Stern v. Electrolux Home Products, Inc.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250