You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
Dashboards for Data Integrity
Dashboards for Data Integrity I’ve written a bunch on data integrity reports. (Click here for […]
Next-to-Nothing Goals
Next-to-Nothing Goals I saw a Ted Talk by Christine Carter recently discussing the concept of […]
Just because you can…
Just because you can… In response to a recent Wednesday Wisdom on averages hiding the […]
Always ask “Why?”
Always ask “Why?” Little kids ask “Why?” all the time, because they are sponges for […]
Averages hide the extremes
Averages hide the extremes I can’t remember where I first heard it, but “averages hide […]
Look up PARTIAL names!
Look up PARTIAL names! Train your staff to do look ups on partial names, not full […]
Not Just Technology
Not Just Technology There was recently a discussion on the ASAE online community about project management […]
Consider quitting
Consider quitting Patient: “Doctor, it hurts when I do this.” Doctor: “Then stop doing that.” […]
There is nothing so permanent as business rules
There is nothing so permanent as business rules Nobel Prize-winning economist Milton Friedman said, “There’s nothing […]
Budget for feature discovery and adoption
Budget for feature discovery and adoption When developing a budget for implementation of a new […]
