“We run the report three times and get three different results.”

"We run the report three times and get three different results."

"We run the same report three times and get different results."

In my 21 years of consulting, I've probably heard this (or something similar) dozens, if not hundreds, of times.

What the user is usually saying is that when they run two different reports or queries that are called the same thing (e.g., "All Members"), the result set is different. The perception is that the data is bad or the software has a bug. But what's really happening is they are running two different reports, with different selection criteria behind it. While both reports are labeled "All Members," they are actually using different criteria, and thus getting different results.

This problem is widespread among associations of all sizes. The challenge is twofold:

  1. We need our queries and reports to be completely transparent. It has to be absolutely clear to the user what data the report is looking at and outputting.
  2. The "catalog" of reports and queries needs to be curated and cleaned up consistently and frequently.

As data managers, we need to be better at both of these things.

A timeless challenge of data management is the perception that the system or the data (or both!) is bad. When staff believes that running the same report three times produces different results, you've got a BIG problem on your hands. You have to work at keeping your queries and reports as clean as the data itself.

Wes's Wednesday Wisdom Archives

Data Management Strategy

January 12, 2022

Data Management Strategy Do you know what your data management strategy is? If you have …

Data Management Strategy Read More »

It’s always about trust

January 5, 2022

It’s always about trust When I work with clients on almost any data management project, …

It’s always about trust Read More »

You can’t outsource buy-in

December 16, 2021

You can’t outsource buy-in One factor consistent with all of my most successful projects is …

You can’t outsource buy-in Read More »

Use it or lose it!

December 8, 2021

Use it or lose it! I’m referring here to the data you collect. If you …

Use it or lose it! Read More »

“If I could only do one thing…”

December 1, 2021

“If I could only do one thing…” Managing data throughout your organization can be overwhelming. Do …

“If I could only do one thing…” Read More »

Gratitude

November 24, 2021

Gratitude As Thanksgiving in the US approaches, I’m reminded of the importance of gratitude, in …

Gratitude Read More »

“It’s more than I have, but less than I want.”

November 17, 2021

“It’s more than I have, but less than I want.” “It’s more than I have, …

“It’s more than I have, but less than I want.” Read More »

Don’t forget Parkinson’s Law

November 10, 2021

Don’t forget Parkinson’s Law “Work expands so as to fill the time available for its …

Don’t forget Parkinson’s Law Read More »

Just Respond

November 3, 2021

Just Respond Growing up my father used to tell my many siblings and me that …

Just Respond Read More »

People fear uncertainty, not change

October 27, 2021

People fear uncertainty, not change If you’ve ever worked on any big project that was …

People fear uncertainty, not change Read More »

Scroll to Top