You need a PLAN to deal with duplicates

You need a PLAN to deal with duplicates

Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.

And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:

  1. Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  2. Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  3. And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?

Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.

Wes's Wednesday Wisdom Archives

Some things are unknowable

October 29, 2025

Some things are unknowable One of the most challenging aspects of moving to a new […]

Do we have access to that data?

October 22, 2025

Do we have access to that data? When I work with my clients on a […]

The three “buckets” of contact data

October 8, 2025

The three “buckets” of contact data Broadly speaking, when collecting data on contacts (individuals or organizations), […]

Balancing what is possible with what is realistic

October 1, 2025

Balancing what is possible with what is realistic When I work with clients on technology […]

“Humans want to be surrounded by beauty.”

September 24, 2025

“Humans want to be surrounded by beauty.” “Humans want to be surrounded by beauty.” – […]

Data managers vs data consumers

September 17, 2025

Data managers vs data consumers When I work with clients on any data management project, […]

Another universal truth

September 10, 2025

Another universal truth There are many universal truths in data management. Some examples: You will […]

Don’t miss this year’s DAN Science Fair!

September 3, 2025

Don’t miss this year’s DAN Science Fair! I’m taking a break from my weekly tips […]

Just start. And it’s never done.

August 27, 2025

Just start. And it’s never done. Last week I had the opportunity to lead a […]

Don’t ask if you’re not going to answer!

August 20, 2025

Don’t ask if you’re not going to answer! In the past week, on three different […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top