“The first time it lies to me is the last time I’ll use it.”

"The first time it lies to me is the last time I'll use it."

Over the years, I've often chuckled under my breath when a client would tell me: "The system is giving me different answers to the same query. I think it's making thing up!" In almost every case, what the client perceived to be "the same query" was in fact two different queries. The underlying logic was different. Sure, they both said "Member count" but one was counting only active records while the other was counting all records (or something to that effect).

But AI queries are different, because as we all know, AI WILL make things up (hallucinations!).

And so, at the moment, one of the greatest deterrents to AI adoption within the AMS is the potential for it to make up data! As someone put it to me recently, "The first time it lies to me is the last time I'll use it."

There are still plenty of other ways AI is and will be useful within the AMS. But solving the hallucination challenge will be critically important. I don't think we're there yet.

Wes's Wednesday Wisdom Archives

Take action…

July 19, 2023

Take action… “The greatest wisdom not applied to action and behavior is meaningless data.” – […]

The Rule of 100 and 1,000 revisited

July 12, 2023

The Rule of 100 and 1,000 revisited I’m finding that the “Rule of 100 and […]

You gotta wanna

July 5, 2023

You gotta wanna Long ago I heard a training consultant say you can’t train people […]

Be careful not to overbuy

June 14, 2023

Be careful not to overbuy I recently spoke with an association of ten staff that was […]

When is the best time to clean your data?

June 7, 2023

When is the best time to clean your data? One of the most common questions […]

Do the benefits outweigh the risks?

May 31, 2023

Do the benefits outweigh the risks? As the economist Thomas Sowell points out, there are […]

Painting the Bridge

May 24, 2023

Painting the Bridge According to this article, the Golden Gate Bridge is painted continuously year-round. […]

Maintenance isn’t sexy

May 17, 2023

Maintenance isn’t sexy I remember reading once long ago that one of the reasons our […]

“Will I still have a job when this is done?”

May 10, 2023

“Will I still have a job when this is done? While working with a client […]

Evolution, not revolution

May 3, 2023

Evolution, not revolution I don’t recall where I first heard it many decades ago, but […]

Leave a Comment

Your email address will not be published. Required fields are marked *

Scroll to Top