Morrison on Metrics: Synthetic Indices
How law departments can use synthetic indices to understand and quantify both legal domains and operational concerns.
February 13, 2011 at 07:00 PM
7 minute read
The original version of this story was published on Law.com
What some people call “synthetic indices” combine (synthesize) several related measures into a single number – the index. For example, everyone knows the Consumer Price Index: The aggregated and weighted prices of a basket of common goods and services.
In the law department context, to illustrate, we could envision a synthetic index of “corporate IP prowess,” constructed from (1) the number of patents applied for in a year, (2) R&D spending as a percentage of revenue, (3) the number of references in the annual report to innovation and intellectual property, and (4) licensing revenue from patents. For a group of companies, if you could collect those four related measures from each of them, put them on a comparable scale such as deviation from the average, and sum them, you would create an index of corporate IP prowess.
I created a different index with my benchmark rankings of industries and countries. I call it an index of legal intensity. With four key benchmark metrics I fashioned an overall ranking (an index) for the industries and countries. Email me if you would like a copy.
General counsel could create and encourage indices for many of their operational concerns, such as engagement of employees and talent, which could be measured by teamwork, diversity and camaraderie. Or think of the possibilities with contract complexity or outside counsel usage.
What can you do with a synthetic index? Of immediate use is to help you understand a complicated situation with some quantification. Related to that, with several participants you can benchmark yourselves against the median figure. Then too, a thoughtful index with reliable numbers resembles a dashboard for something important. Individual components can be shifted but the total set – the index – is harder to alter. Alternatively, once you have an index, you can show how other metrics correlate to that index. Keeping with IP prowess, is there a relationship between where a company ranks on it total legal spending? If you want to add sophistication to an index, you can assign different weights to the components. If number of patents granted seems much more significant, for instance, you can double its contribution to the overall score.
You do have to be careful with synthetic indices. Among the methodological difficulties, those who interpret relative standing may ignore margins of error: they regard tiny differences between rankings as significant. Also, minor changes in components can have magnified effects on the outcomes. An irregular surge one year in licensing revenue from patents would disproportionately alter the index. Another problem arises if the narrow components are mistakenly treated like a proxy for a broader measure. IP prowess might best be measured by the percentage of revenue that comes from products or services less than five years old.
By the way, a second use of the term “index” is when someone puts every metric on the same basis, such as is done by the Economist's Big Mac index. It converts the local price of a Big Mac to the prevailing exchange rate and shows whether the currency is relatively over- or under-priced. A third meaning of “index” is as a mathematical formula. For example I have written on my blog about Herfindahl's index of industry complexity, an entropy index of diversification and a general-purpose heterogeneity index.
Synthetic indices, when used skillfully, can help us understand and quantify a domain better than we did before.
What some people call “synthetic indices” combine (synthesize) several related measures into a single number – the index. For example, everyone knows the Consumer Price Index: The aggregated and weighted prices of a basket of common goods and services.
In the law department context, to illustrate, we could envision a synthetic index of “corporate IP prowess,” constructed from (1) the number of patents applied for in a year, (2) R&D spending as a percentage of revenue, (3) the number of references in the annual report to innovation and intellectual property, and (4) licensing revenue from patents. For a group of companies, if you could collect those four related measures from each of them, put them on a comparable scale such as deviation from the average, and sum them, you would create an index of corporate IP prowess.
I created a different index with my benchmark rankings of industries and countries. I call it an index of legal intensity. With four key benchmark metrics I fashioned an overall ranking (an index) for the industries and countries. Email me if you would like a copy.
General counsel could create and encourage indices for many of their operational concerns, such as engagement of employees and talent, which could be measured by teamwork, diversity and camaraderie. Or think of the possibilities with contract complexity or outside counsel usage.
What can you do with a synthetic index? Of immediate use is to help you understand a complicated situation with some quantification. Related to that, with several participants you can benchmark yourselves against the median figure. Then too, a thoughtful index with reliable numbers resembles a dashboard for something important. Individual components can be shifted but the total set – the index – is harder to alter. Alternatively, once you have an index, you can show how other metrics correlate to that index. Keeping with IP prowess, is there a relationship between where a company ranks on it total legal spending? If you want to add sophistication to an index, you can assign different weights to the components. If number of patents granted seems much more significant, for instance, you can double its contribution to the overall score.
You do have to be careful with synthetic indices. Among the methodological difficulties, those who interpret relative standing may ignore margins of error: they regard tiny differences between rankings as significant. Also, minor changes in components can have magnified effects on the outcomes. An irregular surge one year in licensing revenue from patents would disproportionately alter the index. Another problem arises if the narrow components are mistakenly treated like a proxy for a broader measure. IP prowess might best be measured by the percentage of revenue that comes from products or services less than five years old.
By the way, a second use of the term “index” is when someone puts every metric on the same basis, such as is done by the Economist's Big Mac index. It converts the local price of a Big Mac to the prevailing exchange rate and shows whether the currency is relatively over- or under-priced. A third meaning of “index” is as a mathematical formula. For example I have written on my blog about Herfindahl's index of industry complexity, an entropy index of diversification and a general-purpose heterogeneity index.
Synthetic indices, when used skillfully, can help us understand and quantify a domain better than we did before.
This content has been archived. It is available through our partners, LexisNexis® and Bloomberg Law.
To view this content, please continue to their sites.
Not a Lexis Subscriber?
Subscribe Now
Not a Bloomberg Law Subscriber?
Subscribe Now
NOT FOR REPRINT
© 2025 ALM Global, LLC, All Rights Reserved. Request academic re-use from www.copyright.com. All other uses, submit a request to [email protected]. For more information visit Asset & Logo Licensing.
You Might Like
View AllFrom Reluctant Lawyer to Legal Trailblazer: Agiloft's GC on Redefining In-House Counsel With Innovation and Tech
7 minute readLegal Tech's Predictions for Legal Ops & In-House in 2025
Lawyers Drowning in Cases Are Embracing AI Fastest—and Say It's Yielding Better Outcomes for Clients
Trending Stories
- 1No Two Wildfires Alike: Lawyers Take Different Legal Strategies in California
- 2Poop-Themed Dog Toy OK as Parody, but Still Tarnished Jack Daniel’s Brand, Court Says
- 3Meet the New President of NY's Association of Trial Court Jurists
- 4Lawyers' Phones Are Ringing: What Should Employers Do If ICE Raids Their Business?
- 5Freshfields Hires Ex-SEC Corporate Finance Director in Silicon Valley
Who Got The Work
J. Brugh Lower of Gibbons has entered an appearance for industrial equipment supplier Devco Corporation in a pending trademark infringement lawsuit. The suit, accusing the defendant of selling knock-off Graco products, was filed Dec. 18 in New Jersey District Court by Rivkin Radler on behalf of Graco Inc. and Graco Minnesota. The case, assigned to U.S. District Judge Zahid N. Quraishi, is 3:24-cv-11294, Graco Inc. et al v. Devco Corporation.
Who Got The Work
Rebecca Maller-Stein and Kent A. Yalowitz of Arnold & Porter Kaye Scholer have entered their appearances for Hanaco Venture Capital and its executives, Lior Prosor and David Frankel, in a pending securities lawsuit. The action, filed on Dec. 24 in New York Southern District Court by Zell, Aron & Co. on behalf of Goldeneye Advisors, accuses the defendants of negligently and fraudulently managing the plaintiff's $1 million investment. The case, assigned to U.S. District Judge Vernon S. Broderick, is 1:24-cv-09918, Goldeneye Advisors, LLC v. Hanaco Venture Capital, Ltd. et al.
Who Got The Work
Attorneys from A&O Shearman has stepped in as defense counsel for Toronto-Dominion Bank and other defendants in a pending securities class action. The suit, filed Dec. 11 in New York Southern District Court by Bleichmar Fonti & Auld, accuses the defendants of concealing the bank's 'pervasive' deficiencies in regards to its compliance with the Bank Secrecy Act and the quality of its anti-money laundering controls. The case, assigned to U.S. District Judge Arun Subramanian, is 1:24-cv-09445, Gonzalez v. The Toronto-Dominion Bank et al.
Who Got The Work
Crown Castle International, a Pennsylvania company providing shared communications infrastructure, has turned to Luke D. Wolf of Gordon Rees Scully Mansukhani to fend off a pending breach-of-contract lawsuit. The court action, filed Nov. 25 in Michigan Eastern District Court by Hooper Hathaway PC on behalf of The Town Residences LLC, accuses Crown Castle of failing to transfer approximately $30,000 in utility payments from T-Mobile in breach of a roof-top lease and assignment agreement. The case, assigned to U.S. District Judge Susan K. Declercq, is 2:24-cv-13131, The Town Residences LLC v. T-Mobile US, Inc. et al.
Who Got The Work
Wilfred P. Coronato and Daniel M. Schwartz of McCarter & English have stepped in as defense counsel to Electrolux Home Products Inc. in a pending product liability lawsuit. The court action, filed Nov. 26 in New York Eastern District Court by Poulos Lopiccolo PC and Nagel Rice LLP on behalf of David Stern, alleges that the defendant's refrigerators’ drawers and shelving repeatedly break and fall apart within months after purchase. The case, assigned to U.S. District Judge Joan M. Azrack, is 2:24-cv-08204, Stern v. Electrolux Home Products, Inc.
Featured Firms
Law Offices of Gary Martin Hays & Associates, P.C.
(470) 294-1674
Law Offices of Mark E. Salomone
(857) 444-6468
Smith & Hassler
(713) 739-1250