You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
The best choice given the information you have
The best choice given the information you have “Hindsight is 20/20” is a cliché because, […]
Action isn’t the same as progress
Action isn’t the same as progress I’ve written before that not taking action is an […]
Start with the end in mind
Start with the end in mind Like so many, I probably first heard the phrase […]
It’s quiet in here…maybe TOO quiet…
It’s quiet in here…maybe TOO quiet… One of the truisms of data management is that […]
It’s ALWAYS about expectations
It’s ALWAYS about expectations The headline reads: “Tesla sets record for vehicle deliveries, an increase […]
It’s hard to get UNangry
It’s hard to get UNangry I often emphasize to my clients the importance of testing […]
Some history IS important!
Some history IS important! When I’m advising clients on data conversion (moving data from one […]
“Many mickles make a muckle.”
“Many mickles make a muckle.” “Many mickles make a muckle.” – George Washington Apparently, this […]
It’s easy to collect; it’s harder to manage
It’s easy to collect; it’s harder to manage The beauty of today’s highly configurable AMS […]
Tell them why you want the data
Tell them why you want the data Because data is so easy to collect these […]
