In the final episode of the season I speak with Monal Chokshi, Head of User Experience Research at Lyft. We discuss traditional paths to a user research career, creating routines for meeting different types of users, and the emergence of leadership roles in user research.
13. Kate Lawrence of EBSCO
In this episode I speak with Kate Lawrence, Vice President of User Research at EBSCO Information Services. Our conversation covers where to place user research in the organization, emotions in fieldwork, and empowering others to advocate for information literacy.
12. Pree Kolari of eBay
This episode features Pree Kolari, the Senior Director of Design Strategy and Research at eBay. We talk about the career arc of a researcher, having impact on the product, and breaking down organizational walls.
11. Gabe Trionfi of Pinterest
This episode features Gabe Trionfi, the Manager of Research at Pinterest. We discuss the evolution of user research, collaboration between disciplines and the journey versus the destination.
10. Elizabeth Kell of Comcast
In this episode I chat with Elizabeth Kell, the Senior Director of User Research at Comcast. We talk about the growth of Comcast’s user research practice, essential soft skills for research candidates, and putting a human face on the people that use your products.
9. Kavita Appachu of Kelley Blue Book
Today I chat with Kavita Appachu, the Senior Manager of User Experience Research at Kelley Blue Book. She describes the different roles she’s had in different organizations, moving from design to research, and explains the change effort underway at Kelley Blue Book.
8. Aviva Rosenstein of DocuSign
In today’s episode I speak with Aviva Rosenstein, the Senior Manager of User Experience Research at DocuSign. We explore how to make all types of research actionable, the benefit of doing your own recruiting, and the evolution from building a usability lab to having an in-house research capability.
7. Judd Antin of Airbnb
We kick off the second season with Judd Antin, the Director of Experience Research at Airbnb. Judd and I speak about their model for embedding talented generalists with product teams, skill-sharing among researchers, and just what exactly makes research “sexy.”
6. Carol Rossi of Edmunds.com
Today’s guest is Carol Rossi. She’s the Senior Director of UX Research at Edmunds.com. In our conversation, we discuss her small-but-mighty team, Edmund.com’s collaborative workplace culture, and the personal driver of “doing good.”
5. Kerry McAleer-Forte of Sears Holdings
Today’s guest is Kerry McAleer-Forte, the Director of User Experience Research for Sears Holdings. We discuss how researchers need to think like storytellers, getting at the underlying need behind a research request, and the risk of using research to make recommendations.
4. Nancy Frishberg of Financial Engines
My guest today is Nancy Frishberg, the manager of user research at Financial Engines. We discuss recruiting participants in an enterprise setting (where users are customers of your customers), finding the generative in the evaluative and how to think about collaborative workspace as entirely separate from reporting structure.
3. Frances Karandy of Citrix
Today’s guest is Frances Karandy, a senior manager within the Customer Experience Group at Citrix. We discuss doing product-focused research in a company with a large number of products, what to look for when hiring researchers, and how to select projects that not only support the business but also help team members to develop.
2. Alex Wright of Etsy
Today’s guest is Alex Wright, who is the director of research at Etsy. We discuss the partnership between qualitative and quantitative research at Etsy and how his background in journalism helps him with the storytelling aspects of managing the research function.
1. Gregg Bernstein of MailChimp
Welcome to the debut episode of Dollars to Donuts. Today’s guest is Gregg Bernstein, who manages customer research at MailChimp. We discuss how MailChimp uses research to uncover new product opportunities, how the right research artifacts can best provide value to different internal audiences and how humility is an essential soft skill for successful researchers.
Why you should encourage bad ideas in your organization
Why you should encourage bad ideas in your organization One of the things that I’ve been thinking about a lot lately is idea generation, especially related to how large companies innovate. I bet more than half the articles I’ve saved in Pocket are in some way related to bringing great ideas to life in this world (the other half are about Ponies… just kidding… the other half are about really technical topics, I am still a geek at heart).
Museum of Failure
Opening next month in Helsingborg, Sweden.
Museum of Failure is a collection of interesting innovation failures. The majority of all innovation projects fail and the museum showcases these failures to provide visitors a fascinating learning experience.
The collection consists of over sixty failed products and services from around the world. Every item provides unique insight into the risky business of innovation.
Video and slides from my O’Reilly Design war stories talk
Last month I spoke at the O’Reilly Design Conference about user research war stories. The video is now online and I’ve also embedded it below.
Here are the slides
Devika’s War Story: The Young Men Of Najafgarh
Last year, I was in Delhi doing fieldwork about a smartphone news app. The primary users for this study were male college students in their early 20s, who regularly read English news on their smartphones.
One of the participants scheduled for an interview lived in Najafgarh, a place I did not know much about. I checked on Google and what I found was not encouraging: it was more than an hour away from my hotel, near the Delhi-Haryana border (possibly even longer with traffic); It was also home to the Indian capital’s most polluted water body, the Najafgarh drain!
Meanwhile, the clients who were to have accompanied me on the interview dropped out at the last minute. I was apprehensive about travelling to Najafgarh and conducting the interview on my own. The state of Haryana is notorious for being lawless and is known to be particularly unsafe for women. Men from Haryana are stereotyped as aggressive and misogynistic. I wasn’t sure if they would be comfortable being interviewed by a lone woman. Moreover, the village of Dichaon where my participant lived is infamous for its ongoing gang wars.
Despite these initial concerns, I decided to go ahead with the interview. Realistically, how unsafe could a pre-arranged hour-long meeting be? At the worst, I thought that it might be a challenging interview to conduct, but felt I would be able to manage.
Driving into Najafgarh, we passed a dead cow lying on some rubbish on the side of the road. The city looked markedly different from urban Delhi – all the women I saw on the road were traditionally dressed, scooters and public transport prevailed rather than cars, and all vehicles on the roads were driven by men.
It was difficult to find the participant’s home, though I was on the phone with him, getting directions. There were hardly any significant landmarks to guide us. Eventually, my participant asked me to park near a huge open sewage drain – He would come and find me.
My heart sank as a particularly scruffy looking young man approached the car. He confirmed that I was the person he was looking for, and got into the front seat to direct the driver to his home. We meandered our way through narrow roads and a crowded marketplace and eventually reached our destination.
His home was a multi-story building in the midst of commercial establishments; So narrow that there was only about 1 room on each floor. The steep staircase was cemented but not tiled, it didn’t have any railings.
As I followed him up to the third floor I wondered if I was being foolhardy going into his house alone. Perhaps I should have asked my driver to accompany me? And even worse, I was skeptical that this guy read English news on his smartphone!
We finally reached the top, and the room did nothing to reassure me. There were a number of rough wooden benches (typical to Indian government schools) placed in rows. Sitting there waiting for us was a very snazzy young man, with a prominent pompadour and reflective sun glasses! He greeted me with a cheery “Hi Ma’am!”
I had to now quickly decide who to interview. The first young man was the one we had originally screened and recruited. He did not seem promising: he was very quiet, his English was sketchy and I doubted that he read English news on the phone.
On the other hand, the snazzy young man spoke good English and possibly read English news. But I wasn’t certain he was a primary user or even genuinely interested in the topic since we hadn’t screened him.
It turned out that they were cousins. When the snazzy one heard about the interview, it seemed that he decided his cousin was not cool enough to be interviewed. He said to me incredulously “Why would anyone want to talk to him when they could talk to me instead?”
I decided to stick with the guy I had originally recruited, but told the snazzy cousin he could sit in and speak up if he had something interesting to add.
This interview led to some of the richest insights for this study – Such as the aspirational aspects of reading English news, where reading local language news is seen as infra dig and can invite ridicule.
The time I spent getting to know these young men also put all stereotypical thoughts I had about them to shame. I eventually learned that the room we were in was a classroom and that they worked with other young men to tutor school kids in their area. Throughout our interview, the guy I had recruited looked after his sister’s toddler son while she was busy with chores around the house. When I was done with the interview, they insisted on waiting with me on the road till my driver came to pick me up, pointing out that it was “not a good area” for women to stand on the road unaccompanied.
This experience strongly reinforced the guidelines I always need to remind myself about, even after years of being a researcher: Never judge a book by it’s cover. Never be dismissive or judgmental. Openness can lead to the best insights.
Video and slides from my Interaction 17 war stories talk
Last month I spoke at Interaction 17 about user research war stories. They’ve put the video online and I’ve also embedded it below.
Here are the slides
and a sketchnote by Chris Noessel
Update: Here’s the text of my talk, in Spanish.
David’s War Story: The Well-lit Redhead
Standing in front of a house in a quiet suburban street, my phone buzzed and a text from my note-taking partner popped up: “Sorry can’t make interview, something urgent has come up.” We had spent the past week researching allied health professionals who worked from home. This was the fifth or sixth interview, I doubted my colleague would be missing much. I knocked on the door. It opened and a burly man with a soft gaze greeted me in a thick German accent, “Hello, I’m Herman”.
Herman the German invited me inside and led me into his home office. Against the wall was a treatment table. Adjacent to that was a desk with a large computer monitor and in the middle of the room were two comfortable office chairs. Herman gestured for me to sit down and small talk commenced.
Herman had just returned from a visit to Germany and for the first time in nearly forty years he had visited his childhood home. Positive muttering and a small nod of my head was enough encouragement for Herman to spin his chair around and bring up holiday photos on the large monitor behind him. As he gave me a personal tour of castles, forests, and medieval villages. I started to become anxious, I didn’t have a lot of time and there was a lot of ground to cover. Yet Herman was so obviously pleased to be sharing these personal stories, I feared that interrupting the holiday slide show might sour his mood.
I asked Herman if he had studied in Germany before coming to Australia and with that, he turned his back on the computer and faced me. As Herman talked a screen saver flickered to life on the monitor behind him. Photos of forests and castles that would not have been out of place in a fairytale drifted by. Herman proved to be an insightful and honest interview subject.
After a few minutes of Q&A, the photos of natural beauties gave way to photos of natural beauties of another kind. A lovely brunette wearing just a smile drifted across the screen behind an oblivious Herman, who sat with his back to the screen. The images were like classic seventies centrefold pictures: soft focus, demure poses and wave perms. They were the kind of pictures a nosey younger brother would find hidden in his older brother’s bedroom.
As Herman spoke, brunette after brunette drifted behind him. My mind started to race, there was nothing in any how-to-interview-users blogs or books to prepare me for this. “Hey look, a redhead!” I thought to myself, losing some of my concentration.
I wanted to hit pause but I also wanted to keep the interview going, Herman was a great interview subject. To bring attention to this would cause immense embarrassment to this gentle man. What if he turned around? I didn’t know how much longer I could keep my focus. I have a terrible poker face.
“Hmm, that redhead is particularly well lit.”
When at last the castles reappeared on the monitor, my brain relaxed slightly. I asked Herman to show me an example of how he organised his notes on his computer. He spun around and showed me. I can’t remember much of what happened in the remainder of the interview. As Herman walked me out, I handed him his incentive and he invited me to come back anytime.
I walked to my car and collapsed into the seat. I had just survived a potentially awkward situation and importantly, I had not negatively impacted Herman. The relief was extraordinary. But there was this nagging thought. Had I really done the right thing? What if the well-lit redhead popped up when he is treating one of his clients? Should I have mentioned something? When is it okay to intervene? I don’t know if there is a right answer but as a person far wiser than me recently told me, asking these types of questions is what’s important, not finding the answer.
Listen to Steve on the Non Breaking Space Show
I was interviewed by Christopher Schmitt for the Non Breaking Space Show. We talked about the history of Doorbells, Danger, and Dead Batteries, the benefit of war stories, as well as user research more generally. Check out the podcast on iTunes, or listen on the Non Breaking Space Show site, or listen below.
From ProductTank, video of The Power of Bad Ideas
A few months back, I spoke at ProductTank SF about The Power of Bad Ideas. They’ve put the video online and I’ve also embdded it below.
Steve Portigal challenges product managers to re-think the idea-generation process by inviting in bad ideas.
In brain-storming sessions, we frequently see two surges in ideas. The first is where the low hanging fruit is identified. The second surge is where more innovative ideas are frequently found. Welcoming bad ideas can be an effective strategy for fast tracking past the low hanging fruit and into innovation.
Steve’s interactive talk encourages product managers to come up with the worst product ideas possible. Not the ideas that are just not that good, but ones that are really, truly terrible. By starting with a bad idea, Steve opens a safe, creative space for ideas sharing. He helps product people to unpack what is good and bad, why and who gets to decide. He encourages us to step away from the binary of good and bad to move around the problem space in a different way. His bad ideas approach also breaks the idea-generation ice – by starting with something terrible, space is opened for all ideas, allowing creativity to flow.
DDD: Link Roundup
It’s been two months since Doorbells, Danger, and Dead Batteries was released. Here’s links to presentations, podcasts and more stuff related to the book.
- Buy from Rosenfeld Media
- Buy from Amazon
- Foreword by Allan Chochinov
- Excerpt from chapter 3
- Excerpt from chapter 11
Noël’s War Story: Truck Stop
Noël Bankston is a UX Research Lead and Human Factors Engineer at Zebra Technologies, currently living in Queens, NY. She told this story live at the Interaction 17 conference.
“So Jim, what would you like to do for lunch? “My treat!” It was the moment I had been dreading all day, ironic since I am a lover of food. I was trying to sound chipper but I was worn through.
It was 2 pm and I was starving. I was sitting in the cab of a 48’ tractor trailer in Lowell, Arkansas. This was my first “ride along” research trip and I had not come prepared with snacks. I was doing in-depth generative research of the pick-up and delivery process for a freight company and hadn’t known that we don’t have lunch until all the deliveries were completed.
I was also not prepared for the weather as I am from up north and I thought the South would be hot in late May. It wasn’t – it was a constant drizzle and cold. So I was sitting in the cab feeling small and tired in the oversized loaner jacket that the dispatcher had given me. We had been on the road since 8:45 am but I had arrived at the trailer dispatch site even earlier to observe the set-up process. And that should have been fine, because on a normal day, Jim finishes around noon. But today we saw all the exceptions – an unprepared customer, incorrect paperwork, an obstructed delivery dock, and poor routing. As a researcher, it was a gold-mine as I observed where problems occurred and how Jim handled them. But as someone who is mildly hypoglycemic, it meant I was getting hangry. It had been a long morning of climbing into and out of that cab, learning which hand to place where to get the right leverage to pull yourself up as you step onto the step that is only wide enough for half your foot. And I don’t know how many of you have ridden inside of a tractor trailer but it is loud and you feel every bump.
In that moment as I asked about lunch, damp, tired, and hungry, I thought back on the the anxiety I had felt earlier in the day about lunch. A co-worker told me that on his previous ride-along they had eaten a burger from a gas station mini-mart. Even on a normal day that would make me uneasy, as gas stations aren’t known for freshness and hygiene. I knew that this type of research means being available for wherever the subject takes you, but I was really hoping that didn’t include food poisoning.
But at this point, 8 hours from my previous meal and having no idea what part of town we were in, who was I to be picky?
“So Jim, what would you like to do for lunch?”
“I just want a salad. I try to eat healthy.” I gave a huge sigh of relief, accompanied by a rumble of rejoicing from my stomach. It seemed that between the two of us, I would be eating the bigger meal. I found a nearby Mexican restaurant on Yelp. While enjoying the flavor combination of fresh cilantro and lime with nary a fryolator in sight, I realized how I had been making assumptions about “truckers” based on stereotypes rather than letting the research reveal the truth. And those assumptions were also judgments about health and lifestyle. Jim was aware of the health effects of his job and wasn’t going to turn down an opportunity to have a healthful meal, especially when a researcher was paying! One of the reasons truckers eat unhealthy food is both cost and convenience. Truck stops get food fast and are less expensive. Unfortunately, our food system is set up in a way that fresh, whole food costs much more than highly processed, industrially produced food.
I won’t be able to eliminate all my biases or preconceived notions but I can grow in my awareness of them. I have been on many more ride-alongs and other types of research trips since then. You better believe I always have a granola bar with me.