You need a PLAN to deal with duplicates

You need a PLAN to deal with duplicates

Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.

And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:

  1. Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  2. Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
  3. And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?

Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.

Wes's Wednesday Wisdom Archives

Data managers vs data consumers

September 17, 2025

Data managers vs data consumers When I work with clients on any data management project, […]

Another universal truth

September 10, 2025

Another universal truth There are many universal truths in data management. Some examples: You will […]

Don’t miss this year’s DAN Science Fair!

September 3, 2025

Don’t miss this year’s DAN Science Fair! I’m taking a break from my weekly tips […]

Just start. And it’s never done.

August 27, 2025

Just start. And it’s never done. Last week I had the opportunity to lead a […]

Don’t ask if you’re not going to answer!

August 20, 2025

Don’t ask if you’re not going to answer! In the past week, on three different […]

Seek forgiveness rather than permission

August 6, 2025

Seek forgiveness rather than permission “Seek forgiveness, not permission.” I can’t remember when I first […]

Is a 360 degree view necessary?

July 30, 2025

Is a 360 degree view necessary? “A 360 degree view of our members should NOT […]

Why data matters

July 23, 2025

Why data matters I write about data because managing our data effectively will help us […]

It’s about process

July 16, 2025

It’s about process I’m in the midst of adding an AI agent to my website […]

Data integrity reports

July 9, 2025

Data integrity reports I speak and write a lot about data integrity reports. So I […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top