Be Aware of Selection Bias

Be Aware of Selection Bias

I wrote recently about the mistaken perception of older members not being tech savvy. (You can read that here.)

One of my astute readers, Will Slade at Protech, pointed out the following (I'm paraphrasing): "It's possible that the reason many associations perceive older members to be not tech savvy is that the older members will complain while the younger members will just walk away."

This is an important point! Which leads us to selection bias.

Selection bias occurs when we don't have a truly "random" selection of data points under consideration. In the case above, only the older people are complaining and so the assumption is "Our older members are having more trouble." This may or may not be true, but because they're the only ones we're hearing from, we're drawing conclusions based on incomplete data.

I believe associations (and ALL humans) make this mistake quite frequently. Between selection bias and recency bias, too often we're making decisions about design, programs, pricing, and more, based on faulty or incomplete data.

So be careful about how you're using the data you have on hand to make decisions. If the data is incomplete or poorly collected, it may steer you in the wrong direction!

Wes's Wednesday Wisdom Archives

It’s all about managing expectations

September 28, 2022

It’s all about managing expectations I placed an order online on a Friday and the …

It’s all about managing expectations Read More »

Experience is the best teacher

September 21, 2022

Experience is the best teacher Experience is the best teacher. Every one of us has …

Experience is the best teacher Read More »

Don’t ask for what you don’t need!

September 14, 2022

Don’t ask for what you don’t need! Recently I received a bill from a doctor’s …

Don’t ask for what you don’t need! Read More »

It is never done – so celebrate!

September 7, 2022

It is never done – so celebrate! A client of mine recently had their official …

It is never done – so celebrate! Read More »

MDR (Minimum Data Required)

August 31, 2022

MDR (Minimum Data Required) I’ve written about minimum viable product (MVP) in software development in the …

MDR (Minimum Data Required) Read More »

Simpler and Faster is Better

August 24, 2022

Simple and Faster is Better Earlier this week I was fortunate enough to attend a …

Simpler and Faster is Better Read More »

Patience and grace

August 17, 2022

Patience and grace A past client of mine recently told me: “You inspire confidence and …

Patience and grace Read More »

Sometimes you just have to try it and see what happens

August 10, 2022

Sometimes you just have to try it and see what happens The single greatest key …

Sometimes you just have to try it and see what happens Read More »

Training and testing

August 3, 2022

Training and testing I’ve written before that the best form of training follows this process: …

Training and testing Read More »

How to save a “failing” project

July 27, 2022

How to save a “failing” project It is not unusual for me to receive a …

How to save a “failing” project Read More »

Scroll to Top