interviewing posts

I, For One, Welcome Our New Robot Interviewer Overlords June 11th, 2013

blabdroid1-100034076-medium

From Wired, comes These Adorable Robots Are Making a Documentary About Humans. Really.

Created by artist and roboticist Alex Reben for his master’s thesis at MIT, the BlabDroids are tiny, adorable robotic cinematographers who will be filming interviews at this week’s Tribeca Film Festival in New York as part of the the film festival’s transmedia Storyscapes program. At least 20 BlabDroids will zip around to attendees–they’re self-propelled via motorized wheels– and ask them often very personal questions like, “Tell me something that you’ve never told a stranger before,” “What’s the worst thing you’ve done to someone,” and “Who do you love most in the world?”

Each droid carries a digital camera, a speaker that asks a series of pre-programmed questions to ask whomever it encounters and a button to be pushed to prompt new queries.

“We plan to give the robots to some interesting New Yorkers,” filmmaker Brent Hoff, who is working on the BlabDroid project with Reben, said in an email to Wired. “Hopefully Anthony Weiner and some Broadway types.” The robots, which are very adorable and voiced by a 7-year-old boy, are intended to test the theory of MIT computer scientist Joseph Weizenbaum’s “ELIZA effect,” which found that people are inclined to anthropomorphize computers and thus engage emotionally with artificial intelligence. Although this initially lead Weizenbaum to worry about AI’s potential to manipulate, Reben and Hoff have created the BlabDroids to appear comforting and non-judgmental, and to capture meaningful interactions with their subjects.

This is a fascinating experiment. I’d love to see the results, as well as the raw footage and of course to get to talk to someone about their experience being interviewed like this would be very interesting. Similar to Interviewing without questions, eye contact or rapport, the notion of freeing up people from human interactions in order to liberate them to reveal more deeply is a curious (and certainly valid) idea. No doubt the clips will be great; people are pretty interesting and curious, so pointing a camera at them will be entertaining.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Lena’s War Story: The Researcher and the Banana Thief May 31st, 2013
Part 53 of 54 in the series War Stories

Lena Blackstock (@lenacorinna) recently graduated with a Master’s in Design Ethnography from the University of Dundee, Scotland. She is currently a Creative Contextualiser at Point-Blank International in Berlin.

While getting my Master of Design Ethnography at the University of Dundee I was able to dive head first into full-on ethnographic research projects with actual clients. We were asked to do research on self-service usage in Scotland. After the first few interviews and shop-alongs I met one of my last participants in a nearby coffee shop. Initially she was only going to do an interview but then agreed to also do a shop-along the next day. She offered to invite her roommate along, which was especially interesting as I was trying to understand more about how groups use self-service technology. I jumped at this opportunity.

I met the participant and her roommate in front of a large grocery store in town and we moved through the aisle as they stocked up on groceries for the week. They were sharing a cart throughout the shopping trip but when we came up to the self-service checkout area, they each took out their groceries and separated them on the checkout counter. They each managed to navigate through the self-service process without any major glitches (aside from the occasional “unexpected item in bagging area”), even with the loose fruits and vegetables they had to weigh and scan.

After the shopping trip we went back to their home and I wrapped up with a few informal questions to get feedback on their experience during this shopping trip. As I was finishing my last questions my participant’s roommate said something that caught me by surprise. I asked them about any issues they may have encountered during scanning or weighing items at the checkout, and almost as an afterthought, she mentions: “Well no, not really…but you can trick those machines when you weigh stuff, you know? For example, when I buy bananas, like today, I hold them up a bit when I weigh them so that the machine only charges for a smaller amount than it really is.”

Yikes! Had I just gotten myself into one of those ethical dilemmas that we had talked about in Uni? I had unintentionally captured a self-service banana thief. In one of our previous modules, we had conversations about dealing with these dilemmas, but those were theories. I was now in the real position of having to make a choice as a researcher. Should I stay true to the data and include the information in the final report for the client, even if I didn’t directly observe it or ask for it? And what about the fact that the banana thief wasn’t even the actual participant whom I had recruited, but her roommate? Does that make a difference? On the off chance that the client wants more details on this fact, how will I handle this? Surely I have to hold true to the confidentiality agreement with the participants, right? Or should I just leave that one tiny bit of information out of the report? Is it really that important to the report if I wasn’t asking for it? But what if this piece of information, which got me into this conundrum in the first place, is actually pertinent to the research project and addresses some of the client’s challenges and pain-points?

In addition to these concerns, I also had to work within the University Ethical Guidelines. And as an ethnographer-in-training, I had to make a decision on how to handle this information. Not only this once, but from this point forward if I was going to go out into the world and work as a researcher. I realized this was as good of a time as any to ask myself: What kind of values am I going to live by as a researcher?

In this case, I chose to include the findings in my report and stay true to what I observed. I made a very conscious decision that no matter what, I would not share the confidential information of my participant. In the end the client was happy to hear the ‘real story,’ as it confirmed some of the security issues of this technology that they were suspecting. Now, would I make this same decision the exact same way in a project today? I can’t say. Many factors play into the decisions we make as researchers and often, we have to rely on some sort of gut feeling. But, encountering this situation at the beginning of my ‘life as an ethno’, forced me to internalize the challenges and to make a choice.

Most research projects have their own version of a ‘banana thief’, an unexpected observation or something overheard, something that challenges our approach, our assumptions and our moral code for conducing research.

In the end, my chance encounter with the self-service banana thief didn’t provide me with answers for future encounters, but presented a first instance to ask myself questions and to begin shaping my personal approach to research. And that is a good start…

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Empathy begets empathy May 16th, 2013

interviewing-users

Interviewing Users is now available. Get your copy here!



20121002-marc-maron-306x-1349215211
In Chapter 1, I argue that in addition to gaining valuable information through interviewing, the process also builds empathy which in turn increases our overall capacity for empathy.

Marc Maron (describing his journey with the WTF podcast), in this Rolling Stone interview, says the same thing in his own way.

But once I started talking to people, I evolved a capacity I never had before, which was to be an empathetic listener. I still step on people a lot, and I interrupt them with my own bullshit. But I was a better person. I was humbled.

Also0 see yesterday’s Maron example here.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Interviewing without questions, eye contact or rapport May 3rd, 2013

interviewing-users

Interviewing Users is now available. Get your copy here!

Here’s a really interesting project about How People Talk to Themselves in Their Heads.

He would ask them to wear a microphone headset attached to a digital recorder and speak aloud their thoughts as he followed closely behind with a camera. He would not be able to hear what they were saying…[The] videos are simultaneously naturalistic and as objective as possible. In the lab, in front of a researcher, people are often reluctant to reveal exactly what they are thinking. Writing a diary of inner speech is somewhat more private, but many people find it annoying to regularly drop everything and make an entry; sometimes it’s difficult to remember what one was thinking about even minutes earlier. In Irving’s videos people are living their lives more or less as usual, walking and talking to themselves as though they were unaccompanied. Of course, people who are not completely comfortable with the scenario sometimes speak into the microphone as though trying to entertain someone else. And getting people’s inner speech on tape captures only linguistic forms of thought, neglecting the kind of thinking that happens in images and scenes, for example.

The notion that unfettered, deeper self-exploration and self-expression can come when not interacting with the interrogator – to the point here of nearly eliminating the interrogation entirely – evokes the (I presume mostly obsolete) approach to therapy where the patient does not face the therapist.

I find the videos compelling (and voyeuristic to the extreme). Check out the other videos at the link – the ones that take place without the strolling seem more like a diary and less like a peek into the stream of consciousness. But for each of them, see if they pass the sniff-test for you: is the person talking the way they are because of the experiment (they know they are being recorded; they feel they need to come up with something to say, they are aware of their own “voice”, etc.) or is it really getting as deep as the researcher claims? I was mostly convinced but a sliver of doubt remains.

In the research we do, we make no claim of naturalism; we certainly want to direct and influence what is being shared, and we build rapport to facilitate openness and honesty. This approach isn’t likely to be appropriate for us, but it’s certainly provocative to look at the output of an opposite approach – where the interviewer is effectively absented and rapport is not a consideration.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
People Like Us December 13th, 2012

People Like Us was a mockumentary that ran on BBC radio in the late 90s before becoming a TV show. The radio shows are hilarious and a great illustration of what can and does go wrong in fieldwork. Each episode is essentially a total War Story.

The shows follow a hapless reporter, Roy Mallard, investigating the lives and work of ordinary people: a bank manager, an artist, a stay-at-home mom, an actor and so on. Things go awry: despite being married (Really? You?) he finds himself awkwardly attracted to an interviewee, only to realize that another interviewee is her bitter ex-boyfriend. He’s a passenger in a recklessly driven car. He’s witness to firings, incompetency, violence, relationship hassles. He trips, drops things, is sneezed upon, breaks a washing machine, and more.

At the same time, his attempts to interview people and get to the heart of what their lives are about are thwarted. If not by circumstances, then by the inarticulateness of his interviewees, or by their sheer misinterpretation of his questions (e.g., Q: You’ve been here for a long time. What kind of things have changed? A: My hair.)

People Like Us manages to be completely absurd yet with an eye-rolling kind of truth that any user researcher (and journalist, I imagine) will identify with.

The radio series has been posted to YouTube and I’m embedding all the episodes as a playlist below. Check ‘em out and let me know what you think.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Sharon’s War Story: Broken Windows Theory November 16th, 2012
Part 36 of 54 in the series War Stories

Sharon Cartwright, a consultant with Optimal Usability, shares her story about uncovering context.

We were surprised that Anna wasn’t at home when we arrived at her house. We could see through the lounge windows that the house was empty of furniture and personal belongings, adding further to the intrigue. We had followed our usual protocol of sending an email confirmation clearly stating the time of the research session and Anna had been called the day before to confirm.

We decided to try calling Anna. She picked up our call as she was coming up her driveway. She was running late and seemed a bit agitated, telling us that she had locked herself out an hour earlier. She was just moving into this house and didn’t have a spare key yet. She’d decided, in the interest of proceeding, that she was going to smash a window to get in and had just called around to her brother’s house to pick up the appropriate tools.

Anna seemed like a practical woman, and smashing her front door window didn’t seem to daunt her. I indicated that there was no need to take such drastic action for our sakes. But she was adamant and was soon taking a hammer to the glass panel in the kitchen door.

Once inside, Anna, myself and the client (who’d come along for the ride) began the clean-up. I manned the vacuum cleaner and mused over the start to the session. There is something bonding about a shared clean-up!

We were there to observe Anna set up wireless broadband. On a good day the process wasn’t straightforward; we had already seen several participants struggle through it. Over the next two hours we observed Anna encountering several technical issues with hardware and software. She managed to resolve some issues on her own. Many times she resorted to calling the contact centre, although their advice was mixed – sometimes helping Anna, sometimes complicating matters.

We had scheduled the session for 1.5 hours expecting this to be sufficient, but many sessions – including Anna’s – extended over this. After two hours Anna had not succeeded in setting up her wireless broadband connection. Unable to stay any longer, we were disappointed to leave without seeing Anna ultimately succeed. We wished her luck, as she was clearly going to need it.

During the two hours Anna revealed a few things to us. Her long-term relationship had recently ended, explaining her move to Auckland. She was also looking for work. Her ex-partner’s teenage son had generally taken the lead on the technology front in their home, and it was dawning on her that this was now her role.

With the significant life stresses she was facing it was hard to watch her struggle through a technology set-up that should have been easier, dare I say simple. While we learned that setting up wireless internet often happens during a time of stress, as it’s one task of many when you move house, I felt for Anna and the difficult time she was going through.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Interruption or Interjection? October 19th, 2012

Deborah Tannen writes in the New York Times about interruptions. She’s riffing on this week’s presidential debate but I thought this part was relevant to interviewing:

You might think it’s obvious that an interruption is when a second person starts talking before another has stopped. But how long a pause means “I’m done” rather than “I’m catching my breath”? This, too, varies by region and culture – and the difference can lead to unintended interruptions. In 1978, I tape-recorded a Thanksgiving dinner conversation involving two Christians raised in California, three Jews of Eastern European ancestry from New York and a British woman. At times the Californians felt interrupted when their Jewish friends mistook a pause for breath as a turn-relinquishing one. At other times, exclamations like “Wow!” or “That’s impossible!” which were intended to encourage the conversation, stopped it instead. An interruption takes two – one to start, the other to stop. The New Yorkers in my study assumed that a speaker who wasn’t finished wouldn’t stop just because someone else started. If she does, then she creates the interruption.

In my book I look at interruptions and turn-taking in interviews. If someone is going on and on and we need to redirect them, how to do so elegantly? If we are having trouble not talking over someone, what are the sources of those missed pauses and cues? Tannen’s exploration of interruption is useful fodder for thinking about this.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Henry Thomas and the Power of Silence October 17th, 2012

Henry Thomas’s audition for E.T. is making the rounds in the blogosphere this week. It’s a pretty incredible bit of emoting, improvising, acting. I’d like to highlight one thing that struck me: as the scene begins, the offstage actor sets up the conflict with his first line, and then turns it over to Henry (aka Elliot). And Henry doesn’t say a word. But he does a lot. His silence is very active, even his minimal facial movement is highly active.

In interviewing users, those small moments where we choose to be quiet are powerful. We can maintain an active engagement with the participants even though we aren’t talking. We can move the interview forward without using our mouths.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Dark Patterns for Interviewing September 14th, 2012

How to Win at Conversation is a humorous New Yorker article that frames conversation as a competition and offers up strategies (including Seed of Doubt, Barrage of Interruptions, Intentional Mishearing and Unfulfilled Intimations of Actual Gossip) for winning. You’ll likely recognize when you’ve been on the receiving end, or maybe when you’ve done it yourself. The piece can be read as a set of dark patterns for good interviewing.

OPPONENT: We just got some pretty good news.
YOU: I can’t believe it! They finally gave you a five-hundred-thousand-dollar raise, didn’t they?
OPPONENT: Er…no.
YOU: Oh. Sorry. So what’s the good news?
OPPONENT: Our little Jimmy just got into his first-choice preschool.
YOU: Oh. That’s good, too. Certainly nothing to sneeze at!

Strategy used: Intentional Overstatement of Expectations.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Come to Steve’s UX Australia workshop on interviewing July 10th, 2012


I’ll be teaching Immersive field techniques: Interviewing and observing for user research, a full-day workshop at UX Australia in Brisbane, in August 29th.

Interviewing is undeniably one of the most valuable and commonly used user research tools. Yet sometimes we forget that it’s a skill we need to learn, because:

  • It’s based on skills we think we have (talking or even listening)
  • It’s not taught or reflected on
  • People tend to ‘wing it’ rather than develop their skills

Without good interviewing skills, research results may be inaccurate or reveal nothing new, suggesting the wrong design or business responses, or they may miss the crucial nuance that points to innovative breakthrough opportunities.

In this day-long session, we’ll focus on the importance of rapport-building and listening and look at techniques for both. We will review different types of questions, and why you need to have a range of question types. This session will explore other contextual research methods that can be built on top of interviewing in a seamless way. We’ll try some practice exercises for improving your own interviewing skills. Through a homework exercise and a field trip during the workshop, we’ll also practice observation of users in an environment.

This workshop is an evolution of something I’ve been teaching for a number of years (and continue to refine). Over the past couple of years I’ve led forms of this session in Istanbul, Vancouver, Savannah, Toronto, Lisbon, Barcelona, Hong Kong, and San Francisco. Now it’s Australia’s turn.

I believe some of the conference workshops have already sold out, so if you might be going, please sign up soon! I look forward to seeing you there!

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Our latest article: Never Eat Anything Raw June 25th, 2012


Our latest interactions column (written by Steve Portigal and Julie Norvaisas) Never Eat Anything Raw: Fieldwork Lessons from the Pros has just been published.

Interviewing is based on asking questions. As children we all learned to ask questions (perhaps more than the adults around us were ready for!), but it takes work to become a skilled interviewer—the kind of interviewer with whom a natural exchange is almost inevitable and for whom asking questions is as effortless as Roger Federer’s forehand. Great interviewers are made, not born. We’ve had the ongoing opportunity to think even more about the experiences that have shaped us as interviewers. Of course, as researchers we are compelled to look outside ourselves, so we asked some people we admire to tell us about how they improve their interviewing skills. We have synthesized our findings into four key areas: practice, reflect,
critique, and exchange.

Get the PDF here, and check out (and add to) the fieldwork War Stories here.

Previous articles also available:

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Well, thank you for joining us May 11th, 2012

For a little Friday Fun, here’s Mike Birbiglia‘s new short film from This American Life LIVE (if you are in the US, Canada, or Australia, I highly encourage you to find a screening near you for this next Tuesday; truly a wonderful entertainment and storytelling experience).

In this short and gently comedic film, Birbiglia pokes fun at some the norms of interviewing (and being interviewed).

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
This Week @ Portigal May 7th, 2012

It’s sunburn weather this week (well, today at least), perfect for zipping from place to place, which is indeed what we are doing

  • It’s a busy fieldwork week, as we are going into the homes of (mostly young, mostly male) gamers to see what they’re doing and get their reactions to a prototype.
  • No sooner do we finish fieldwork than our clients come to our office at the end of this week to help untangle the data and identify the key takeaways
  • I’m putting the final details together my sold-out workshop (as well as a short talk) for User Experience Lisbon next week.
  • We’ve launched a new series devoted to fieldwork War Stories.
  • What we’re consuming: Frittle, Aguirre, the Wrath of God, scopa (the game), Scopa (the restaurant).
  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Tamara’s War Story: What the Hell? Don’t you knock? May 7th, 2012
Part 3 of 54 in the series War Stories

My first trip to New Jersey for fieldwork involved two memorable events: a blizzard and a bathroom blitz.

Two days before we departed for New Jersey I received an email request from my client to rent the biggest SUV available. A huge snowstorm was pounding the Northeast and he wanted to feel safe as we ventured into the streets and highways of various townships for a week of in-home interviews. I obliged and was glad I did. The evening we arrived we found the streets covered with snow and the plows were evidently having trouble keeping up.

I kept getting rescheduling calls from the recruiter. Participants were cancelling because of the weather. This seemed strange given the fact that WE were the ones travelling to their homes and they didn’t have to go anywhere! It felt like a game of musical chairs as we continually shifted and rescheduled. It was impossible to predict if we would be able to complete the targeted number of interviews during our weeklong visit. In fact, it was even difficult to predict if we would be able to leave town at the end of the week because the airport was cancelling flights every day.

There were three of us in the field: myself, a videographer, and the client. We all met for breakfast the first morning while the car warmed up. It took 30 minutes to melt the layers of ice that had accumulated overnight on the windshield. Fortunately the heater had kicked in by the time we all piled into the SUV and headed out for our first interview of the week, giving ourselves ample time to arrive at our destination.

Instead of the 30 minutes suggested by Google Maps, we arrived an hour later at our destination, a narrow residential street of two-story beige brick duplexes still decorated for the Christmas holiday. Plows had left six foot tall snowbanks on either side of the street and cars were parked in tight spaces carved out by the residents. Sadly it appeared that most of those residents didn’t have an SUV as big as our rental. We circled the area for fifteen minutes before we found a gap large enough to park in.

We were there to interview a young woman in her 20s, a nurse. She welcomed us into the living room where we set up our cameras and found places to sit among the teddy bear collection and floor-to-ceiling cabinet containing an homage to Michael Jackson. Her mother appeared in a short fuzzy black robe. “I’ve been doing focus groups for years. No one ever asked to come to this house before. Why do you want to go to people’s houses?” We explained the nature of our visit and commenced with the interview.

For the first half hour of the interview the mother came in and out of the room, answering and asking questions and reiterating her concerns about our presence and intentions. The daughter kept urging her mother out of the room. “We always meet at Dunkin Donuts. That’s the place to go. MA! They’re here to talk to me. Let me do this!”…”I always stop on my way to work to pick up an iced tea. MA! Go get dressed already!”…”I love those little facts on the lid. They are so cute. MA! Enough! Quit interrupting us!” No matter what the daughter said, the mother would return every few minutes to listen and contribute.

I realized shortly into the interview that, in our flurry of inclement travel, I had neglected to honor one of the cardinal rules of interviewing: “Go before you arrive.” I ignored my biological needs as long as I could but the morning’s coffee didn’t help. I finally had to excuse myself for a restroom break.

“It’s just there in the hall, on the right” said the nurse, pointing down the mirrored hallway.

I excused myself and walked up to bathroom door. It was open a few inches so I pushed it. There in the bright pink and black tiled bathroom stood the mother, facing the toilet with her little black robe hiked up above the waist, her backside completely exposed. She turned before I could retreat. “What the Hell? Don’t you knock?” I felt blood rush warmly to my face.

“I’m so sorry” I said, backing out and closing the door behind (or rather, in front of) me. “I’m so sorry” I continued, “the door was open. I didn’t realize anyone was in there. I’m so sorry.”

I swiftly returned to the living room.

“I’m so sorry,” I told the nurse. “The door was open a crack so I just went in and I walked in on your mother. I am sure I’ve upset her.”

“Ha! Don’t worry. She’ll be fine” she consoled me. “Maybe she’ll leave us alone now.”

I wasn’t sure I would be fine. I tried to concentrate on the interview, the purpose of our visit, the friendly nurse who gave us a detailed tour of the kitchen drawers. But images of her mother’s bare behind kept flashing in my mind. She was right, sort of, about her mother leaving us alone. For the remaining hour we didn’t hear a word from the woman, though she kept appearing (now fully clothed) wherever we were. She said nothing. She just looked at me with a glare that felt as icy as the windshield that awaited us outside.

Our first stop was a Dunkin Donuts where I was finally able to relieve myself.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post    
Interviewing past the platitudes March 5th, 2012

From this past Sunday’s New York Times, a review of Craig Taylor’s “Londoners”:

Taylor devoted five years to collecting the material for “Londoners.” He gathered stories from all 32 boroughs, conducting formal interviews with more than 200 people, running through 300 tape-recorder batteries and taking down enough notes to generate transcripts of more than 950,000 words. Fewer than half the people he talked to made the final cut. Some interviews took months to set up and lasted just a few minutes. Others went on for hours.

The reviewer, a journalist herself, makes an excellent point about the challenges in interviewing:

Anyone who conducts interviews for a living knows how hard it can sometimes be to get subjects to move past cant and cliché, to leave the platitudes and drive on to the good stuff. (How many articles feature people expressing “shock and sadness” at their neighbors’ personal tragedies or noting that a murder victim “kept to himself”?)

Collecting soundbites is easy; the trope of the soundbite is so well-entrenched that most anyone will perform one in the right circumstances. Sometimes those soundbites feel – to the interviewer – like nuggets. It’s up to us to understand the difference between performance that we’re eliciting and a comment or observation that leads us towards insight.

Note: For more “Londoners” Taylor himself has an essay elsewhere in Sunday’s paper.

  • Twitter
  • Facebook
  • LinkedIn
  • del.icio.us
Comments Off  |   Email This Post