“As good or better than me.”
I was recently speaking with a software developer working on AI and we were discussing using natural language querying in an AMS. I told him, "The biggest challenge you face is that the first time the AI is wrong, staff will never use it again."
He agreed but then added: "The standard for using AI should be 'Is it as good or better than me?' not 'Is it perfect?'"
And while that may be difficult for some to accept (especially when it comes to counting how many members we have!), I think that standard makes a lot of sense.
The truth is, humans make mistakes. And we've probably all had experiences where we reported on data that turned out to be in error.
The question isn't a matter of if errors will occur, but what we can do to minimize them, and what we can do to identify them when an error does occur.
The ultimate lesson is that when we use AI for anything, we ought to "trust but verify." And if the AI can do it as good or better than I can, why not use it?
![]()
Wes's Wednesday Wisdom Archives
Training and testing
Training and testing I’ve written before that the best form of training follows this process: […]
How to save a “failing” project
How to save a “failing” project It is not unusual for me to receive a […]
How to avoid the “IT black hole”
How to avoid the “IT black hole” Going all the way back to my days […]
The “People” are important!
The “People” are important! I’ve written a lot about people, process, and technology over the […]
Always look for the MVP
Always look for the MVP I first wrote about minimum viable product (MVP) just three […]
The longer you take, the longer it will take
The longer you take, the longer it will take It may sound like a tautology, […]
Data is for action
Data is for action When deciding whether or not to collect a piece of data, […]
Have you shopped yourself?
Have you shopped yourself? I’ve always been fascinated by the “secret shopper” concept. (Maybe it’s […]
To improve adoption, decrease the friction
To improve adoption, decrease the friction “Before you try to increase your willpower, try to […]
“Is this normal?”
“Is this normal?” ne of the greatest parts about my job is that I get […]
