90% of your data is never touched a second time

90% of your data is never touched a second time

I heard recently on a podcast that 95% of all the art New York's Metropolitan Museum of Art collects is never actually displayed in the museum. It's stored in a warehouse in New Jersey!

Which got me to thinking; how much of the data that we collect do we actually use? I would estimate that 90% of the data we collect never gets used more than once.

Think about it: most of the data we collect on a day to day basis is transactional. We track when Wes joined, when he renewed, when he attended a conference, which sessions he attended, and so on. The vast majority of transactional data is used for the transaction itself and then never touched again.

So what does this mean for data management? I think there are several significant implications:

  1. We need very clear and specific processes for collecting transactional data, so that the data is collected consistently and uniformly throughout the organization.
  2. We need clear data governance for identifying and managing the data that we will use again (beyond the transaction).
  3. We need clear policies in place for regularly cleaning/purging the database so that we're not continuing to store data that is no longer used.

I've written many times before that, because of technology, data is easy to collect and cheap to store. Data accretes. But managing data has a cost, even if that data is not being actively used. (Think of the costs involved for storing all that art no one ever sees!)

So be sure you have policies in place to regularly review the data you're managing.

Wes's Wednesday Wisdom Archives

Be concise!

July 10, 2024

Be concise! I started a monthly newsletter almost 25 years ago (which I recently discontinued). […]

A great example of a data integrity report!

June 26, 2024

A great example of a data integrity report! A couple months back I discussed the […]

“If you keep doin’ what you’re doin’, you’ll keep gettin’ what you’re gettin’.”

June 5, 2024

“If you keep doin’ what you’re doin’, you’ll keep gettin’ what you’re gettin’.” I saw […]

Rather than adding something new, try subtracting

May 29, 2024

Rather than adding something new, try subtracting I read recently that sociological research suggests, when presented […]

It’s always people, process, and technology

May 22, 2024

It’s always people, process, and technology I speak and write a lot about people, process, […]

Once it’s lost, trust can be difficult to regain

May 15, 2024

Once it’s lost, trust can be difficult to regain I recall hearing once long ago […]

Share your successes!

May 8, 2024

Share your successes! I was speaking at an association meeting recently and one of the points […]

What are YOUR data integrity reports?

May 1, 2024

What are YOUR data integrity reports? Sitting in an AMS demo with a client recently, […]

You might have to do SOME of the work yourself!

April 24, 2024

You might have to do SOME of the work yourself! Many, many years ago I […]

Don’t manage to the exception!

April 17, 2024

Don’t manage to the exception! One of the universal truths about data management is, wherever possible, […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top