"The first time it lies to me is the last time I'll use it."
Over the years, I've often chuckled under my breath when a client would tell me: "The system is giving me different answers to the same query. I think it's making thing up!" In almost every case, what the client perceived to be "the same query" was in fact two different queries. The underlying logic was different. Sure, they both said "Member count" but one was counting only active records while the other was counting all records (or something to that effect).
But AI queries are different, because as we all know, AI WILL make things up (hallucinations!).
And so, at the moment, one of the greatest deterrents to AI adoption within the AMS is the potential for it to make up data! As someone put it to me recently, "The first time it lies to me is the last time I'll use it."
There are still plenty of other ways AI is and will be useful within the AMS. But solving the hallucination challenge will be critically important. I don't think we're there yet.
![]()
Wes's Wednesday Wisdom Archives
Take action…
Take action… “The greatest wisdom not applied to action and behavior is meaningless data.” – […]
The Rule of 100 and 1,000 revisited
The Rule of 100 and 1,000 revisited I’m finding that the “Rule of 100 and […]
You gotta wanna
You gotta wanna Long ago I heard a training consultant say you can’t train people […]
Be careful not to overbuy
Be careful not to overbuy I recently spoke with an association of ten staff that was […]
When is the best time to clean your data?
When is the best time to clean your data? One of the most common questions […]
Do the benefits outweigh the risks?
Do the benefits outweigh the risks? As the economist Thomas Sowell points out, there are […]
Painting the Bridge
Painting the Bridge According to this article, the Golden Gate Bridge is painted continuously year-round. […]
Maintenance isn’t sexy
Maintenance isn’t sexy I remember reading once long ago that one of the reasons our […]
“Will I still have a job when this is done?”
“Will I still have a job when this is done? While working with a client […]
Evolution, not revolution
Evolution, not revolution I don’t recall where I first heard it many decades ago, but […]
