You need a PLAN to deal with duplicates

You need a PLAN to deal with duplicates

Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.

And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:

  1. Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  2. Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  3. And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?

Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.

Wes's Wednesday Wisdom Archives

Be concise!

July 10, 2024

Be concise! I started a monthly newsletter almost 25 years ago (which I recently discontinued). […]

A great example of a data integrity report!

June 26, 2024

A great example of a data integrity report! A couple months back I discussed the […]

“If you keep doin’ what you’re doin’, you’ll keep gettin’ what you’re gettin’.”

June 5, 2024

“If you keep doin’ what you’re doin’, you’ll keep gettin’ what you’re gettin’.” I saw […]

Rather than adding something new, try subtracting

May 29, 2024

Rather than adding something new, try subtracting I read recently that sociological research suggests, when presented […]

It’s always people, process, and technology

May 22, 2024

It’s always people, process, and technology I speak and write a lot about people, process, […]

Once it’s lost, trust can be difficult to regain

May 15, 2024

Once it’s lost, trust can be difficult to regain I recall hearing once long ago […]

Share your successes!

May 8, 2024

Share your successes! I was speaking at an association meeting recently and one of the points […]

What are YOUR data integrity reports?

May 1, 2024

What are YOUR data integrity reports? Sitting in an AMS demo with a client recently, […]

You might have to do SOME of the work yourself!

April 24, 2024

You might have to do SOME of the work yourself! Many, many years ago I […]

Don’t manage to the exception!

April 17, 2024

Don’t manage to the exception! One of the universal truths about data management is, wherever possible, […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top