You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
Using the Pomodoro Technique for data management
Using the Pomodoro Technique for data management I’m a huge fan of the Pomodoro Technique, […]
Asking for more is a good sign…
Asking for more is a good sign… A client who had recently implemented a new […]
Take action…
Take action… “The greatest wisdom not applied to action and behavior is meaningless data.” – […]
The Rule of 100 and 1,000 revisited
The Rule of 100 and 1,000 revisited I’m finding that the “Rule of 100 and […]
You gotta wanna
You gotta wanna Long ago I heard a training consultant say you can’t train people […]
Be careful not to overbuy
Be careful not to overbuy I recently spoke with an association of ten staff that was […]
When is the best time to clean your data?
When is the best time to clean your data? One of the most common questions […]
Do the benefits outweigh the risks?
Do the benefits outweigh the risks? As the economist Thomas Sowell points out, there are […]
Painting the Bridge
Painting the Bridge According to this article, the Golden Gate Bridge is painted continuously year-round. […]
Maintenance isn’t sexy
Maintenance isn’t sexy I remember reading once long ago that one of the reasons our […]
