Posts tagged “question”

What you asked/What they heard

In this video from 2016, basketball player Taurean Prince, in a post-game press conference, responds to a question about the team’s rebound performance with an explanation of how rebounds work.


I can’t tell from this clip if there’s an actual miscommunication or if Prince is being intentional, and for my purposes here, I don’t suppose it really matters.

It’s not uncommon to ask a question and get an answer to a different question, and while it can throw the conversation off, it can be a visceral reminder that we have different basic assumptions and that we need to work to overcome those, to bridge that gaps. Those miscommunications are awkward but they invite us to make the effort to realign.

The other day I met with a group over Zoom. As happens on video meetings, people adjust their video to communicate something about themselves, manage their privacy, etc. One person stood right in front of a heavily blurred background. Another was in front of a block of color with their company logo in the corner. Another person was clearly in a garage converted to a home office, and one person was in front of (what I assumed was) a painted scene, perhaps from some artwork. We each took turns introducing ourselves.

When we got to the person with the painted scene, I asked a followup question: “Can I ask about your background?”

They proceeded to describe a bit of their educational experience and how it led to the nickname that they go by nowadays.

My question should have been “Can I ask about your Zoom background?” but what they heard was “Can I ask about your personal background?” Given the nature of a video-platform-mediated conversation, I had forgotten that what they are showing of themselves doesn’t actually match how they see themselves (e.g, if they have turned off self-view, they aren’t even seeing that painted scene themselves).

I was mortified because the question they heard might have been too personal, perhaps asking them to explain or justify an unconventional nickname. I’m curious, of course, but I also have no right to start asking personal questions in the first few minutes of meeting someone! This is not how I want to start off our relationship!

I laughed in embarrassment, and tried to create a teaching moment, modeled by me and my own mistake, but even explaining that I asked the question poorly, the other person felt apologetic for misunderstanding me! Perhaps we established some rapport through this misunderstanding, if I’m idealistic I can imagine that we both worked together to find our shared space of understanding after this mistake (my mistake, for sure!).

The answer, by the way, is that what I assumed was “art” was an image from a video game. Of course video games can be art!

Son of Survey Madness

We’ve posted any number of survey design critiques over the years, and here’s the latest, a close read of a question and the cues associated with different responses.

In response to the prompt How closely do you agree or disagree with this statement: “We saw business strengthening in the Spring, but it seems to be stagnant or falling off again. We thought we had seen the bottom, but now we are not sure.” we’re asked to move a slider between Agree Completely and Disagree Completely.
smiley
frowny

As we move the slider, the expression on the little green character changes, supposedly to provide an additional cue to ensure that our response is accurate.

But when we agree (a positive emotion), the guy is frowning. Because we are agreeing with a negative in which case we making a negative observation? So we feel negative? But the green dude isn’t mapping our feeling about the situation, he’s mapped to our response – our degree of agreement. We can feel positive about agreeing, even if the thing we agreeing about is negative (haven’t you ever exclaimed enthusiastically at someone that expresses a similar frustration to you? That’s being positive about a negative). The mapping here is wrong.

It’s further complicated by the indirectness of the prompt – that situation you are agreeing or disagreeing with – describing a situation going from positive to uncertain. How much do you agree or disagree with: something was positive but now it’s negative? In fact, besides being indirect and somewhat abstract, it’s also a compound question. You might agree that things were positive, or you might now. You might agree that things have gone downhill, or you might not. The question is asking you to agree ONLY to the cause where i) things were positive and ii) things have gone downhill. If you don’t agree with both of those, then what do you do? And since you can indicate the strength of agreement/disagreement, how will people interpret the question? I would suggest not very reliably!

Ironically, this is a survey aimed at providers of market research services, who should absolutely know better.

Series

About Steve