You need a PLAN to deal with duplicates
Here's the thing about duplicate records: No matter what you do, you'll never get rid of them completely, because humans are human. Whether it's a staff member creating a duplicate record because they forgot to check if the record exists, or it's a customer who doesn't want to take the time to reset his password and just creates another record with a different email address, duplicates are going to happen.
And because duplicates are inevitable, you have to have a plan for dealing with them. Here are some suggestions:
- Create data integrity reports that will help you identify potential duplicate records, and run those reports consistently. ("Consistently" means at least once a month, if not more often.) And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- Make it everyone's job on staff to identify potential duplicates whenever they are using the database and make sure you have a clear process for how those duplicate records are reported. And make sure someone (or several someones) on staff has responsibility for cleaning up this data.
- And did I mention to make sure someone (or several someones) on staff has responsibility for cleaning up this data?
Managing duplicate records is a journey, not a destination. No matter how good your technology is, like weeds in a garden, duplicate records are going to appear. So you have to have a plan for dealing with them, not just now, but always.
![]()
Wes's Wednesday Wisdom Archives
Seek forgiveness rather than permission
Seek forgiveness rather than permission “Seek forgiveness, not permission.” I can’t remember when I first […]
Is a 360 degree view necessary?
Is a 360 degree view necessary? “A 360 degree view of our members should NOT […]
Why data matters
Why data matters I write about data because managing our data effectively will help us […]
It’s about process
It’s about process I’m in the midst of adding an AI agent to my website […]
Data integrity reports
Data integrity reports I speak and write a lot about data integrity reports. So I […]
The most important training tip
The most important training tip I’ve been sitting in a lot of database training sessions […]
Be careful about getting tangled
Be careful about getting tangled “We had done a lot to tangle ourselves up.” – […]
Discipline. Always discipline.
Discipline. Always discipline. I’ve been producing a newsletter in some form for over 25 years […]
Simpler is better
Simpler is better Recently, a client of mine was discussing how they manage membership reinstatements. […]
Baby steps
Baby Steps A journey of a thousand miles begins with a single step. You have […]
