90% of your data is never touched a second time

90% of your data is never touched a second time

I heard recently on a podcast that 95% of all the art New York's Metropolitan Museum of Art collects is never actually displayed in the museum. It's stored in a warehouse in New Jersey!

Which got me to thinking; how much of the data that we collect do we actually use? I would estimate that 90% of the data we collect never gets used more than once.

Think about it: most of the data we collect on a day to day basis is transactional. We track when Wes joined, when he renewed, when he attended a conference, which sessions he attended, and so on. The vast majority of transactional data is used for the transaction itself and then never touched again.

So what does this mean for data management? I think there are several significant implications:

  1. We need very clear and specific processes for collecting transactional data, so that the data is collected consistently and uniformly throughout the organization.
  2. We need clear data governance for identifying and managing the data that we will use again (beyond the transaction).
  3. We need clear policies in place for regularly cleaning/purging the database so that we're not continuing to store data that is no longer used.

I've written many times before that, because of technology, data is easy to collect and cheap to store. Data accretes. But managing data has a cost, even if that data is not being actively used. (Think of the costs involved for storing all that art no one ever sees!)

So be sure you have policies in place to regularly review the data you're managing.

Wes's Wednesday Wisdom Archives

Daylight savings and business rules

March 11, 2020

Daylight savings and business rules This past Sunday, most of the US observed Daylight Savings […]

It’s always about priorities

March 4, 2020

It’s always about priorities No matter the size or type of technology project, you will […]

Only one can be best

February 26, 2020

Only one can be best One of my (many) pet peeves with software vendor marketing […]

Seek to simplify

February 19, 2020

Seek to simplify When I work with my clients on system selection or implementation, one […]

Some problems are not problems

February 12, 2020

Some problems are not problems “A problem with no solution is not a problem, it’s […]

UI Matters!

January 29, 2020

UI Matters! Almost since I began consulting over 20 years, I’ve noted how important the […]

Be careful with absolutes

January 28, 2020

Be careful with absolutes When I speak with clients I try to be careful about […]

New Year’s Resolutions

January 22, 2020

New Year’s Resolutions Why do New Year’s Resolutions fail? Research suggests that part of the […]

Why Process is So Important

January 15, 2020

Why Process is So Important One of my favorite business authors is James Clear, who writes all […]

The Significant Change of SaaS Software

January 7, 2020

The Significant Change of SaaS Software One of the most significant technological changes in the […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top