Nervous System: Taking Biometrics at Face Value
The process of identifying criminals through photographs dates back to the 19th century, but the introduction of software took Bertillon-style databases to the next level.
November 02, 2018 at 07:00 AM
7 minute read
With the aggressive pace of technological change and the onslaught of news regarding data breaches, cyber-attacks, and technological threats to privacy and security, it is easy to assume these are fundamentally new threats. The pace of technological change is slower than it feels, and many seemingly new categories of threats have actually been with us longer than we remember. Nervous System is a monthly blog that approaches issues of data privacy and cybersecurity from the context of history—to look to the past for clues about how to interpret the present and prepare for the future.
In 1887, Warden R.W. McClaughry of the Illinois State Penitentiary at Joliet (now Joliet Correctional Center) introduced a radical new idea. To keep track of recidivist offenders and identify prisoners of extra-special concern due to past crimes, he implemented a “database” of criminals. The database consisted of a collection of paper-based records containing pictures of prisoners' faces, along with a set of facial and bodily measurements. McClaughry got the idea from a French policeman and pioneer of biometrics, Alphonse Bertillon.
As described in Signaletic Instructions Including the Theory and Practice of Anthropometrical Identification, his landmark book of 1885, Bertillon sought to apply a rigorous scientific framework to the then-haphazard practice of tracking and cataloging criminals. The use of photography to document arrests was nothing new—in Victorian England, the camera was ironically called the “angel copier” and was seen as a humane alternative for keeping track of former offenders, as opposed to physically branding them. Bertillon's innovation was to pair photography with a set of specific measurements he presumed to be immutable attributes of the person: head length, head breadth, length of the middle finger, length of the left foot, and length of the cubit (the forearm from the wrist to the elbow). Bertillon posited that the combination of these measurements together with his “mugshot” of face-on and sideways views of the subject would provide a definitive identification of a unique individual.
The photos and biometric measurements would then be printed onto a “Bertillon Card” to be stored with other Bertillon Cards as a virtual library of criminals. This manually searchable database was an enormous boon to the field of criminology, and the “Bertillon System” quickly took hold across Europe and the United States. It had a couple of notable drawbacks, however. For one, even Bertillon himself agreed that it was a grueling and time-consuming task to find a single face “if you have no other means but your eyes to search for the photograph among the thousands in an ordinary collection.” Second, the system was designed to be reactive, to help identify suspects and monitor repeat offenders, but did little to proactively prevent crime.
The computer age offered solutions to both problems. If a machine could become as adept as a person at recognizing faces, that machine could sort and filter its way through a Bertillon-style database faster than any person could—and if such a machine were paired with surveillance cameras, it might be possible to identify known troublemakers in a crowd before they even did anything. Setting aside the many privacy rights concerns about whether such a Big Brother-style surveillance state would be socially desirable, the technical question was: Would it even be doable?
Woodrow Wilson Bledsoe was a gifted computer scientist with a particular knack for pattern recognition. He had previously worked on Defense Department research funded by the Atomic Energy Commission to teach computers to recognize letters, both printed and handwritten (this was early research into what became optical character recognition). In the mid-1960s, Bledsoe led a team of researchers at Panoramic Research to teach computers to try to recognize faces. It was only years later that curious researchers discovered Bledsoe's facial recognition work was in fact financed by the Central Intelligence Agency. Much of his work remains classified today.
Following the lead of Bertillon, Bledsoe started by dividing up the human face into subsections to be classified. By measuring details like the distance from the hairline to the eyebrows, the distance between the eyes, or the width of the mouth, he could create a facial map from which to draw statistical conclusions about how closely another photograph matched that dimensional model of a given face. Bledsoe's researchers painstaking coded photographs by hand using a grid and a handheld stylus that emitted electromagnetic pulses to mark the coordinates of 20 critical biometric distances.
The software was designed to proceed down a decision tree from larger categories to smaller—for example, deciding the gender of the subject first, and then making broad racial categorizations, before proceeding to analyze more specific details.
Bledsoe published his first study, A Proposal for a Study to Determine the Feasibility of a Simplified Face Recognition Machine, on January 30, 1963—the first known work in facial recognition software. In this project, Bledsoe and his team encoded high-quality, high-resolution photographs of various faces taken from the same angle of view. They then fed the new photos of the same faces into the system to evaluate how the program matched them to the known faces.
On March 6, 1964, Bledsoe's second paper, A Facial Recognition Project Report, reported the results using photographs taken from a variety of angles and lighting conditions. Glumly, Bledsoe declared “picture recognition by machines for a large sample of people is beyond the state of the art of the present pattern recognition and computer technology at this time.” The problem was rooted in the variations introduced by different camera angles, lighting conditions, tilt and rotation of the subject's head, and other differences that would exist between pictures irrespective of the differences of the subject face itself. Computing power in 1964 was stretched to the limit to try to account for those differences.
A few years after Bledsoe left the project, Peter Hart continued the research at the Stanford Research Institute in 1966. In the spirit of John Henry pitting his mettle against the steam drill, Hart tested the software against humans in face-recognition trials using a database of 2,000 photographs. Hart found his computer consistently outperformed the humans, exclaiming, “It really worked!” It should be emphasized, however, that this “success” rested on the surprisingly poor performance of the human testers, which left a fairly low bar for the computer to clear to do better by comparison.
The inherent challenges in using biometrics and facial recognition for identification is perhaps illustrated by the incident that brought the Bertillon System to an end in 1903. Officials at Leavenworth Penitentiary in Kansas were processing a new inmate, named Will West, and performed the usual Bertillon procedure of capturing mugshots and biometric measurements. Vexingly, his measurements matched exactly an existing Bertillon Card for someone named “William West.” This was especially puzzling because William West was already incarcerated at Leavenworth and had been for two years serving a conviction for murder. Here were two men, with basically the same name, strikingly similar appearances, and identical Bertillon measurements—yet they were indeed two different people, unrelated and unknown to one another. The prison officers fingerprinted both men to show their fingerprints differed, thereby ushering in a new era of identification—but that's another story.
David Kalat is Director, Global Investigations + Strategic Intelligence at Berkeley Research Group. David is a computer forensic investigator and e-discovery project manager. Disclaimer for commentary: The views and opinions expressed in this article are those of the author and do not necessarily reflect the opinions, position, or policy of Berkeley Research Group, LLC or its other employees and affiliates.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2024 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllTrending Stories
Who Got The Work
Michael G. Bongiorno, Andrew Scott Dulberg and Elizabeth E. Driscoll from Wilmer Cutler Pickering Hale and Dorr have stepped in to represent Symbotic Inc., an A.I.-enabled technology platform that focuses on increasing supply chain efficiency, and other defendants in a pending shareholder derivative lawsuit. The case, filed Oct. 2 in Massachusetts District Court by the Brown Law Firm on behalf of Stephen Austen, accuses certain officers and directors of misleading investors in regard to Symbotic's potential for margin growth by failing to disclose that the company was not equipped to timely deploy its systems or manage expenses through project delays. The case, assigned to U.S. District Judge Nathaniel M. Gorton, is 1:24-cv-12522, Austen v. Cohen et al.
Who Got The Work
Edmund Polubinski and Marie Killmond of Davis Polk & Wardwell have entered appearances for data platform software development company MongoDB and other defendants in a pending shareholder derivative lawsuit. The action, filed Oct. 7 in New York Southern District Court by the Brown Law Firm, accuses the company's directors and/or officers of falsely expressing confidence in the company’s restructuring of its sales incentive plan and downplaying the severity of decreases in its upfront commitments. The case is 1:24-cv-07594, Roy v. Ittycheria et al.
Who Got The Work
Amy O. Bruchs and Kurt F. Ellison of Michael Best & Friedrich have entered appearances for Epic Systems Corp. in a pending employment discrimination lawsuit. The suit was filed Sept. 7 in Wisconsin Western District Court by Levine Eisberner LLC and Siri & Glimstad on behalf of a project manager who claims that he was wrongfully terminated after applying for a religious exemption to the defendant's COVID-19 vaccine mandate. The case, assigned to U.S. Magistrate Judge Anita Marie Boor, is 3:24-cv-00630, Secker, Nathan v. Epic Systems Corporation.
Who Got The Work
David X. Sullivan, Thomas J. Finn and Gregory A. Hall from McCarter & English have entered appearances for Sunrun Installation Services in a pending civil rights lawsuit. The complaint was filed Sept. 4 in Connecticut District Court by attorney Robert M. Berke on behalf of former employee George Edward Steins, who was arrested and charged with employing an unregistered home improvement salesperson. The complaint alleges that had Sunrun informed the Connecticut Department of Consumer Protection that the plaintiff's employment had ended in 2017 and that he no longer held Sunrun's home improvement contractor license, he would not have been hit with charges, which were dismissed in May 2024. The case, assigned to U.S. District Judge Jeffrey A. Meyer, is 3:24-cv-01423, Steins v. Sunrun, Inc. et al.
Who Got The Work
Greenberg Traurig shareholder Joshua L. Raskin has entered an appearance for boohoo.com UK Ltd. in a pending patent infringement lawsuit. The suit, filed Sept. 3 in Texas Eastern District Court by Rozier Hardt McDonough on behalf of Alto Dynamics, asserts five patents related to an online shopping platform. The case, assigned to U.S. District Judge Rodney Gilstrap, is 2:24-cv-00719, Alto Dynamics, LLC v. boohoo.com UK Limited.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250