Be Aware of Selection Bias

Be Aware of Selection Bias

I wrote recently about the mistaken perception of older members not being tech savvy. (You can read that here.)

One of my astute readers, Will Slade at Protech, pointed out the following (I'm paraphrasing): "It's possible that the reason many associations perceive older members to be not tech savvy is that the older members will complain while the younger members will just walk away."

This is an important point! Which leads us to selection bias.

Selection bias occurs when we don't have a truly "random" selection of data points under consideration. In the case above, only the older people are complaining and so the assumption is "Our older members are having more trouble." This may or may not be true, but because they're the only ones we're hearing from, we're drawing conclusions based on incomplete data.

I believe associations (and ALL humans) make this mistake quite frequently. Between selection bias and recency bias, too often we're making decisions about design, programs, pricing, and more, based on faulty or incomplete data.

So be careful about how you're using the data you have on hand to make decisions. If the data is incomplete or poorly collected, it may steer you in the wrong direction!

Wes's Wednesday Wisdom Archives

“Working with you is like going to therapy.”

October 20, 2021

“Working with you is like going to therapy.” I was working with a client last …

“Working with you is like going to therapy.” Read More »

The best ideas are stolen

October 13, 2021

The best ideas are stolen I don’t remember where I first heard it, but someone said …

The best ideas are stolen Read More »

It’s all about expectations

October 7, 2021

It’s all about expectations One of the most critical contributors to the success of a …

It’s all about expectations Read More »

Either you test, or your members will

September 29, 2021

Either you test, or your members will If I was forced to choose the single …

Either you test, or your members will Read More »

But are you really willing to change?

September 22, 2021

But are you really willing to change? When any organization is making a change in data management …

But are you really willing to change? Read More »

Two tips for data conversion

September 15, 2021

Two Tips for Data Conversion I’ve written a lot about data conversion over the years …

Two tips for data conversion Read More »

Who should “own” the database?

September 8, 2021

Who should “own” the database? One of the most common questions I get from my …

Who should “own” the database? Read More »

What makes you weird?

September 1, 2021

What makes you weird? When I work with clients on selecting a new association management system, one …

What makes you weird? Read More »

Why “AMS Consortiums” Don’t Work

August 25, 2021

Why “AMS Consortiums” Don’t Work About once a year I will get a call from …

Why “AMS Consortiums” Don’t Work Read More »

Your vendor will disappoint you

August 18, 2021

Your vendor will disappoint you I follow politics as a hobby. A past publisher from …

Your vendor will disappoint you Read More »

Scroll to Top