You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
When “overcommunicating” becomes overwhelming
When “overcommunicating” becomes overwhelming There is a common belief in project management and general business management that overcommunicating […]
Communicating when there is a major technology change
Communicating when there is a major technology change For those of you who are ASAE […]
Everything works, until it doesn’t.
Everything works, until it doesn’t. “If something cannot go on forever, it will stop.” – […]
Some things are unknowable
Some things are unknowable One of the most challenging aspects of moving to a new […]
Do we have access to that data?
Do we have access to that data? When I work with my clients on a […]
The three “buckets” of contact data
The three “buckets” of contact data Broadly speaking, when collecting data on contacts (individuals or organizations), […]
Balancing what is possible with what is realistic
Balancing what is possible with what is realistic When I work with clients on technology […]
“Humans want to be surrounded by beauty.”
“Humans want to be surrounded by beauty.” “Humans want to be surrounded by beauty.” – […]
Data managers vs data consumers
Data managers vs data consumers When I work with clients on any data management project, […]
Another universal truth
Another universal truth There are many universal truths in data management. Some examples: You will […]
