You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
“We run the report three times and get three different results.”
“We run the report three times and get three different results.” “We run the same […]
How do you know if you’re making progress?
How do you know if you’re making progress? We all want to improve our data management, […]
Don’t move too quickly OR too slowly
Don’t move too quickly OR too slowly This may sound like a big “duh!” but I’ll […]
“Your current habits are perfectly designed to deliver your current results.”
“Your current habits are perfectly designed to deliver your current results.” “Your current habits are […]
There is value in just going through the exercise
There is value in just going through the exercise I was working with a client […]
Daylight savings and business rules
Daylight savings and business rules This past Sunday, most of the US observed Daylight Savings […]
It’s always about priorities
It’s always about priorities No matter the size or type of technology project, you will […]
Only one can be best
Only one can be best One of my (many) pet peeves with software vendor marketing […]
Seek to simplify
Seek to simplify When I work with my clients on system selection or implementation, one […]
Some problems are not problems
Some problems are not problems “A problem with no solution is not a problem, it’s […]
