“As good or better than me.”
I was recently speaking with a software developer working on AI and we were discussing using natural language querying in an AMS. I told him, "The biggest challenge you face is that the first time the AI is wrong, staff will never use it again."
He agreed but then added: "The standard for using AI should be 'Is it as good or better than me?' not 'Is it perfect?'"
And while that may be difficult for some to accept (especially when it comes to counting how many members we have!), I think that standard makes a lot of sense.
The truth is, humans make mistakes. And we've probably all had experiences where we reported on data that turned out to be in error.
The question isn't a matter of if errors will occur, but what we can do to minimize them, and what we can do to identify them when an error does occur.
The ultimate lesson is that when we use AI for anything, we ought to "trust but verify." And if the AI can do it as good or better than I can, why not use it?
Wes's Wednesday Wisdom Archives
Documenting Process is Critical
When it comes to managing data successfully, process is critical. For example, a client of […]
Motion vs. Action
In James Clear’s book Atomic Habits (I recommend it!), he discusses the concept of motion vs. action. […]
Are You Answering Your Calls?
I’ve written about this before, but apparently I have to keep repeating it. If you’ve […]
Who do you trust?
Who Do You Trust I was reading an article recently about Warren Buffet’s “rules” for […]
Set benchmarks to measure progress
It’s impossible to measure progress if you don’t know your starting point. This sounds axiomatic, […]
You’ll make incorrect decisions. Acknowledge them and fix it.
A client of mine recently wrote the following to me: “It’s so hard to set […]
"Experience is unobservable to everyone except the person who it happens to."
In Dan Gilbert’s book Stumbling on Happiness, he writes: “Experience is unobservable to everyone except […]
Know Your Audience Before You Speak
This one may seem obvious, but when you’re speaking to anyone, whether it’s one person, […]
"Behavior is a function of the person in their environment."
Lewin’s equation says “behavior is a function of the person in their environment.” (He was […]
Signal-to-noise ratio
Signal-to-noise ratio Signal-to-noise ratio, formally used, applies to electricity and engineering, and refers to how […]