“As good or better than me.”
I was recently speaking with a software developer working on AI and we were discussing using natural language querying in an AMS. I told him, "The biggest challenge you face is that the first time the AI is wrong, staff will never use it again."
He agreed but then added: "The standard for using AI should be 'Is it as good or better than me?' not 'Is it perfect?'"
And while that may be difficult for some to accept (especially when it comes to counting how many members we have!), I think that standard makes a lot of sense.
The truth is, humans make mistakes. And we've probably all had experiences where we reported on data that turned out to be in error.
The question isn't a matter of if errors will occur, but what we can do to minimize them, and what we can do to identify them when an error does occur.
The ultimate lesson is that when we use AI for anything, we ought to "trust but verify." And if the AI can do it as good or better than I can, why not use it?
![]()
Wes's Wednesday Wisdom Archives
Be careful about “solutioning” too quickly
Be careful about “solutioning” too quickly One of the great things about software developers is […]
What’s our next action?
What’s our next action? As you can imagine, I spend a lot of time in […]
Don’t automate for the sake of automation
Don’t automate for the sake of automation I’m the laziest person in the world. I […]
Don’t forget about what got better
Don’t forget about what got better Negativity bias is the tendency to focus on only […]
Give a little at a time rather than taking away
Give a little at a time rather than taking away I’m sure there’s research somewhere […]
First, you gotta have the data
First, you gotta have the data When I work with clients on a new AMS […]
Work on your relationship with your AMS vendor
Work on your relationship with your AMS vendor It is no coincidence that my most […]
Dashboards for Data Integrity
Dashboards for Data Integrity I’ve written a bunch on data integrity reports. (Click here for […]
Next-to-Nothing Goals
Next-to-Nothing Goals I saw a Ted Talk by Christine Carter recently discussing the concept of […]
Just because you can…
Just because you can… In response to a recent Wednesday Wisdom on averages hiding the […]
