Posts tagged “interviewing”

Excerpt from Interviewing Users on Core77

core77-logo

Core77 has posted an excerpt from Interviewing Users.

From my introduction to the excerpt:

I’ve talked to a lot of practitioners about their own experiences in doing fieldwork and often they try to address challenges when they experience the symptoms, but that’s usually not the right time. Consider this analogy: if you have insomnia, the best solutions are not those that you roll out at 3am when you can’t sleep. To effectively counteract insomnia you have to make specific choices during the day, before you go to bed. Doing research with people is the same thing and ideally you approach this sort of work with a well-defined perspective that will inform all of the inevitable detailed, specific, tactical problem solving.

Interviewing without questions, eye contact or rapport

interviewing-users

Interviewing Users is now available. Get your copy here!

Here’s a really interesting project about How People Talk to Themselves in Their Heads.

He would ask them to wear a microphone headset attached to a digital recorder and speak aloud their thoughts as he followed closely behind with a camera. He would not be able to hear what they were saying…[The] videos are simultaneously naturalistic and as objective as possible. In the lab, in front of a researcher, people are often reluctant to reveal exactly what they are thinking. Writing a diary of inner speech is somewhat more private, but many people find it annoying to regularly drop everything and make an entry; sometimes it’s difficult to remember what one was thinking about even minutes earlier. In Irving’s videos people are living their lives more or less as usual, walking and talking to themselves as though they were unaccompanied. Of course, people who are not completely comfortable with the scenario sometimes speak into the microphone as though trying to entertain someone else. And getting people’s inner speech on tape captures only linguistic forms of thought, neglecting the kind of thinking that happens in images and scenes, for example.

The notion that unfettered, deeper self-exploration and self-expression can come when not interacting with the interrogator – to the point here of nearly eliminating the interrogation entirely – evokes the (I presume mostly obsolete) approach to therapy where the patient does not face the therapist.

I find the videos compelling (and voyeuristic to the extreme). Check out the other videos at the link – the ones that take place without the strolling seem more like a diary and less like a peek into the stream of consciousness. But for each of them, see if they pass the sniff-test for you: is the person talking the way they are because of the experiment (they know they are being recorded; they feel they need to come up with something to say, they are aware of their own “voice”, etc.) or is it really getting as deep as the researcher claims? I was mostly convinced but a sliver of doubt remains.

In the research we do, we make no claim of naturalism; we certainly want to direct and influence what is being shared, and we build rapport to facilitate openness and honesty. This approach isn’t likely to be appropriate for us, but it’s certainly provocative to look at the output of an opposite approach – where the interviewer is effectively absented and rapport is not a consideration.

Overture, curtain, lights!

bugs
Today Interviewing Users: How to Uncover Compelling Insights is finally released! I’m so excited; last night was like the night before my birthday (or at least the way that felt when I was a kid).

I’m grateful for all the enthusiasm and am looking forward to people’s thoughts when they’ve had a chance to read and digest and reflect.

People Like Us

People Like Us was a mockumentary that ran on BBC radio in the late 90s before becoming a TV show. The radio shows are hilarious and a great illustration of what can and does go wrong in fieldwork. Each episode is essentially a total War Story.

The shows follow a hapless reporter, Roy Mallard, investigating the lives and work of ordinary people: a bank manager, an artist, a stay-at-home mom, an actor and so on. Things go awry: despite being married (Really? You?) he finds himself awkwardly attracted to an interviewee, only to realize that another interviewee is her bitter ex-boyfriend. He’s a passenger in a recklessly driven car. He’s witness to firings, incompetency, violence, relationship hassles. He trips, drops things, is sneezed upon, breaks a washing machine, and more.

At the same time, his attempts to interview people and get to the heart of what their lives are about are thwarted. If not by circumstances, then by the inarticulateness of his interviewees, or by their sheer misinterpretation of his questions (e.g., Q: You’ve been here for a long time. What kind of things have changed? A: My hair.)

People Like Us manages to be completely absurd yet with an eye-rolling kind of truth that any user researcher (and journalist, I imagine) will identify with.

The radio series has been posted to YouTube and I’m embedding all the episodes as a playlist below. Check ’em out and let me know what you think.

Sharon’s War Story: Broken Windows Theory

Sharon Cartwright, a consultant with Optimal Experience, shares her story about uncovering context.

We were surprised that Anna wasn’t at home when we arrived at her house. We could see through the lounge windows that the house was empty of furniture and personal belongings, adding further to the intrigue. We had followed our usual protocol of sending an email confirmation clearly stating the time of the research session and Anna had been called the day before to confirm.

We decided to try calling Anna. She picked up our call as she was coming up her driveway. She was running late and seemed a bit agitated, telling us that she had locked herself out an hour earlier. She was just moving into this house and didn’t have a spare key yet. She’d decided, in the interest of proceeding, that she was going to smash a window to get in and had just called around to her brother’s house to pick up the appropriate tools.

Anna seemed like a practical woman, and smashing her front door window didn’t seem to daunt her. I indicated that there was no need to take such drastic action for our sakes. But she was adamant and was soon taking a hammer to the glass panel in the kitchen door.

Once inside, Anna, myself and the client (who’d come along for the ride) began the clean-up. I manned the vacuum cleaner and mused over the start to the session. There is something bonding about a shared clean-up!

We were there to observe Anna set up wireless broadband. On a good day the process wasn’t straightforward; we had already seen several participants struggle through it. Over the next two hours we observed Anna encountering several technical issues with hardware and software. She managed to resolve some issues on her own. Many times she resorted to calling the contact centre, although their advice was mixed – sometimes helping Anna, sometimes complicating matters.

We had scheduled the session for 1.5 hours expecting this to be sufficient, but many sessions – including Anna’s – extended over this. After two hours Anna had not succeeded in setting up her wireless broadband connection. Unable to stay any longer, we were disappointed to leave without seeing Anna ultimately succeed. We wished her luck, as she was clearly going to need it.

During the two hours Anna revealed a few things to us. Her long-term relationship had recently ended, explaining her move to Auckland. She was also looking for work. Her ex-partner’s teenage son had generally taken the lead on the technology front in their home, and it was dawning on her that this was now her role.

With the significant life stresses she was facing it was hard to watch her struggle through a technology set-up that should have been easier, dare I say simple. While we learned that setting up wireless internet often happens during a time of stress, as it’s one task of many when you move house, I felt for Anna and the difficult time she was going through.

Interruption or Interjection?

Deborah Tannen writes in the New York Times about interruptions. She’s riffing on this week’s presidential debate but I thought this part was relevant to interviewing:

You might think it’s obvious that an interruption is when a second person starts talking before another has stopped. But how long a pause means “I’m done” rather than “I’m catching my breath”? This, too, varies by region and culture – and the difference can lead to unintended interruptions. In 1978, I tape-recorded a Thanksgiving dinner conversation involving two Christians raised in California, three Jews of Eastern European ancestry from New York and a British woman. At times the Californians felt interrupted when their Jewish friends mistook a pause for breath as a turn-relinquishing one. At other times, exclamations like “Wow!” or “That’s impossible!” which were intended to encourage the conversation, stopped it instead. An interruption takes two – one to start, the other to stop. The New Yorkers in my study assumed that a speaker who wasn’t finished wouldn’t stop just because someone else started. If she does, then she creates the interruption.

In my book I look at interruptions and turn-taking in interviews. If someone is going on and on and we need to redirect them, how to do so elegantly? If we are having trouble not talking over someone, what are the sources of those missed pauses and cues? Tannen’s exploration of interruption is useful fodder for thinking about this.

Henry Thomas and the Power of Silence

Henry Thomas’s audition for E.T. is making the rounds in the blogosphere this week. It’s a pretty incredible bit of emoting, improvising, acting. I’d like to highlight one thing that struck me: as the scene begins, the offstage actor sets up the conflict with his first line, and then turns it over to Henry (aka Elliot). And Henry doesn’t say a word. But he does a lot. His silence is very active, even his minimal facial movement is highly active.

In interviewing users, those small moments where we choose to be quiet are powerful. We can maintain an active engagement with the participants even though we aren’t talking. We can move the interview forward without using our mouths.

Dark Patterns for Interviewing

How to Win at Conversation is a humorous New Yorker article that frames conversation as a competition and offers up strategies (including Seed of Doubt, Barrage of Interruptions, Intentional Mishearing and Unfulfilled Intimations of Actual Gossip) for winning. You’ll likely recognize when you’ve been on the receiving end, or maybe when you’ve done it yourself. The piece can be read as a set of dark patterns for good interviewing.

OPPONENT: We just got some pretty good news.
YOU: I can’t believe it! They finally gave you a five-hundred-thousand-dollar raise, didn’t they?
OPPONENT: Er…no.
YOU: Oh. Sorry. So what’s the good news?
OPPONENT: Our little Jimmy just got into his first-choice preschool.
YOU: Oh. That’s good, too. Certainly nothing to sneeze at!

Strategy used: Intentional Overstatement of Expectations.

Come to Steve’s UX Australia workshop on interviewing


I’ll be teaching Immersive field techniques: Interviewing and observing for user research, a full-day workshop at UX Australia in Brisbane, in August 29th.

Interviewing is undeniably one of the most valuable and commonly used user research tools. Yet sometimes we forget that it’s a skill we need to learn, because:

  • It’s based on skills we think we have (talking or even listening)
  • It’s not taught or reflected on
  • People tend to ‘wing it’ rather than develop their skills

Without good interviewing skills, research results may be inaccurate or reveal nothing new, suggesting the wrong design or business responses, or they may miss the crucial nuance that points to innovative breakthrough opportunities.

In this day-long session, we’ll focus on the importance of rapport-building and listening and look at techniques for both. We will review different types of questions, and why you need to have a range of question types. This session will explore other contextual research methods that can be built on top of interviewing in a seamless way. We’ll try some practice exercises for improving your own interviewing skills. Through a homework exercise and a field trip during the workshop, we’ll also practice observation of users in an environment.

This workshop is an evolution of something I’ve been teaching for a number of years (and continue to refine). Over the past couple of years I’ve led forms of this session in Istanbul, Vancouver, Savannah, Toronto, Lisbon, Barcelona, Hong Kong, and San Francisco. Now it’s Australia’s turn.

I believe some of the conference workshops have already sold out, so if you might be going, please sign up soon! I look forward to seeing you there!

Our latest article: Never Eat Anything Raw


Our latest interactions column (written by Steve Portigal and Julie Norvaisas) Never Eat Anything Raw: Fieldwork Lessons from the Pros has just been published.

Interviewing is based on asking questions. As children we all learned to ask questions (perhaps more than the adults around us were ready for!), but it takes work to become a skilled interviewer-the kind of interviewer with whom a natural exchange is almost inevitable and for whom asking questions is as effortless as Roger Federer’s forehand. Great interviewers are made, not born. We’ve had the ongoing opportunity to think even more about the experiences that have shaped us as interviewers. Of course, as researchers we are compelled to look outside ourselves, so we asked some people we admire to tell us about how they improve their interviewing skills. We have synthesized our findings into four key areas: practice, reflect,
critique, and exchange.

Get the PDF here, and check out (and add to) the fieldwork War Stories here.

Previous articles also available:

Well, thank you for joining us

For a little Friday Fun, here’s Mike Birbiglia‘s new short film from This American Life LIVE (if you are in the US, Canada, or Australia, I highly encourage you to find a screening near you for this next Tuesday; truly a wonderful entertainment and storytelling experience).

In this short and gently comedic film, Birbiglia pokes fun at some the norms of interviewing (and being interviewed).

Fresh Air 2: 2 Fresh 2 Furious

This Week @ Portigal

It’s sunburn weather this week (well, today at least), perfect for zipping from place to place, which is indeed what we are doing

  • It’s a busy fieldwork week, as we are going into the homes of (mostly young, mostly male) gamers to see what they’re doing and get their reactions to a prototype.
  • No sooner do we finish fieldwork than our clients come to our office at the end of this week to help untangle the data and identify the key takeaways
  • I’m putting the final details together my sold-out workshop (as well as a short talk) for User Experience Lisbon next week.
  • We’ve launched a new series devoted to fieldwork War Stories.
  • What we’re consuming: Frittle, Aguirre, the Wrath of God, scopa (the game), Scopa (the restaurant).

Tamara’s War Story: What the Hell? Don’t you knock?

My first trip to New Jersey for fieldwork involved two memorable events: a blizzard and a bathroom blitz.

Two days before we departed for New Jersey I received an email request from my client to rent the biggest SUV available. A huge snowstorm was pounding the Northeast and he wanted to feel safe as we ventured into the streets and highways of various townships for a week of in-home interviews. I obliged and was glad I did. The evening we arrived we found the streets covered with snow and the plows were evidently having trouble keeping up.

I kept getting rescheduling calls from the recruiter. Participants were cancelling because of the weather. This seemed strange given the fact that WE were the ones travelling to their homes and they didn’t have to go anywhere! It felt like a game of musical chairs as we continually shifted and rescheduled. It was impossible to predict if we would be able to complete the targeted number of interviews during our weeklong visit. In fact, it was even difficult to predict if we would be able to leave town at the end of the week because the airport was cancelling flights every day.

There were three of us in the field: myself, a videographer, and the client. We all met for breakfast the first morning while the car warmed up. It took 30 minutes to melt the layers of ice that had accumulated overnight on the windshield. Fortunately the heater had kicked in by the time we all piled into the SUV and headed out for our first interview of the week, giving ourselves ample time to arrive at our destination.

Instead of the 30 minutes suggested by Google Maps, we arrived an hour later at our destination, a narrow residential street of two-story beige brick duplexes still decorated for the Christmas holiday. Plows had left six foot tall snowbanks on either side of the street and cars were parked in tight spaces carved out by the residents. Sadly it appeared that most of those residents didn’t have an SUV as big as our rental. We circled the area for fifteen minutes before we found a gap large enough to park in.

We were there to interview a young woman in her 20s, a nurse. She welcomed us into the living room where we set up our cameras and found places to sit among the teddy bear collection and floor-to-ceiling cabinet containing an homage to Michael Jackson. Her mother appeared in a short fuzzy black robe. “I’ve been doing focus groups for years. No one ever asked to come to this house before. Why do you want to go to people’s houses?” We explained the nature of our visit and commenced with the interview.

For the first half hour of the interview the mother came in and out of the room, answering and asking questions and reiterating her concerns about our presence and intentions. Each time, the daughter would suspend her responses to address the interruption, urging her mother out of the room. “We always meet at Dunkin’ Donuts. That’s the place to go…MA! They’re here to talk to me. Let me do this!”, “I always stop on my way to work to pick up an iced tea…MA! Go get dressed already!”, “I love those little facts on the lid. They are so cute…MA! Enough! Quit interrupting us!” No matter what the daughter said, the mother would return every few minutes to listen and contribute.

I realized shortly into the interview that, in our flurry of inclement travel, I had neglected to honor one of the cardinal rules of interviewing: “Go before you arrive.” I ignored my biological needs as long as I could but the morning’s coffee didn’t help. I finally had to excuse myself for a restroom break.

“It’s just there in the hall, on the right” said the nurse, pointing down the mirrored hallway.

I excused myself and walked up to bathroom door. It was open a few inches so I pushed it. There in the bright pink and black tiled bathroom stood the mother, facing the toilet with her little black robe hiked up above the waist, her backside completely exposed. She turned before I could retreat. “What the Hell? Don’t you knock?” I felt blood rush warmly to my face.

“I’m so sorry” I said, backing out and closing the door behind (or rather, in front of) me. “I’m so sorry” I continued, “the door was open. I didn’t realize anyone was in there. I’m so sorry.”

I swiftly returned to the living room.

“I’m so sorry,” I told the nurse. “The door was open a crack so I just went in and I walked in on your mother. I am sure I’ve upset her.”

“Ha! Don’t worry. She’ll be fine” she consoled me. “Maybe she’ll leave us alone now.”

I wasn’t sure I would be fine. I tried to concentrate on the interview, the purpose of our visit, the friendly nurse who gave us a detailed tour of the kitchen drawers. But images of her mother’s bare behind kept flashing in my mind. She was right, sort of, about her mother leaving us alone. For the remaining hour we didn’t hear a word from the woman, though she kept appearing (now fully clothed) wherever we were. She said nothing. She just looked at me with a glare that felt as icy as the windshield that awaited us outside.

Our first stop was a Dunkin’ Donuts where I was finally able to relieve myself.

Interviewing past the platitudes

From this past Sunday’s New York Times, a review of Craig Taylor’s “Londoners”:

Taylor devoted five years to collecting the material for “Londoners.” He gathered stories from all 32 boroughs, conducting formal interviews with more than 200 people, running through 300 tape-recorder batteries and taking down enough notes to generate transcripts of more than 950,000 words. Fewer than half the people he talked to made the final cut. Some interviews took months to set up and lasted just a few minutes. Others went on for hours.

The reviewer, a journalist herself, makes an excellent point about the challenges in interviewing:

Anyone who conducts interviews for a living knows how hard it can sometimes be to get subjects to move past cant and cliché, to leave the platitudes and drive on to the good stuff. (How many articles feature people expressing “shock and sadness” at their neighbors’ personal tragedies or noting that a murder victim “kept to himself”?)

Collecting soundbites is easy; the trope of the soundbite is so well-entrenched that most anyone will perform one in the right circumstances. Sometimes those soundbites feel – to the interviewer – like nuggets. It’s up to us to understand the difference between performance that we’re eliciting and a comment or observation that leads us towards insight.

Note: For more “Londoners” Taylor himself has an essay elsewhere in Sunday’s paper.

Series

About Steve