Posts tagged “fieldwork”

Video from User Research London keynote: Learning From User Research War Stories

Last summer I went to London to give the opening keynote at User Research London, User Research War Stories. The video is now available and I’ve embedded it below.

Steve Portigal, War Stories - User Research London 2017

The talk features bonus war stories from Kristina Lustig (27:24) and Elizabeth Chesters (31:20)

Alexandra’s War Story: When One Door Closes

Alexandra Wills is an ethnographer working at Fuse by Cardinal Health, an innovation center in Columbus, Ohio. She told this story on stage at Midwest UX 2017.

I’ll never forget when I did ethnographic research for a project aimed at helping a car manufacturer learn what Millennials with small children really needed.

The project was hard. Taking on a project at the height of the Great Recession meant navigating a radical change in client engagement from what I had experienced since starting the work two years prior. “It’s Friday at 5 p.m. in Ohio and you want me in Los Angeles on Monday?” Okay. “We’re doing video diaries and in-home interviews and a post-interview ideation session with participants in two cities, all in two months?” Okay.

Added to all that, I had a nine-month-old and simply didn’t want to leave her for days at a time. Over the past few months of work, I had already breast pumped on an airplane and in dirty airport bathrooms. I had already begged flight attendants and fast food workers for ice to put in the cooler carrying pouches of my “liquid gold.” Did I mention it was my birthday?

At one point in the project, I was hanging out with a family in Austin who had a toddler. I knew nothing about toddlers. After all, I had a nine-month-old. Did I mention I am not a ‘kid person’?

We had just returned from running errands in their car. As we got out of the car, they were showing me some specific details about the vehicle. They had a Honda Element – the car with the interesting doors that open and close like a book. I was paying close, close attention to the parents and I had no idea that the little kid was right near me. So I closed the door. Suddenly, we all heard the kid screaming! His parents rushed to his side and looked him over, examining his hands. All I could do was yell impulsively, “I didn’t do it!” I was horrified. I thought, “I hurt a child! This child! A participant’s child! Oh noooooo this is bad. How am I going to fix this? What am I going to tell Melinda (my boss)?” To this day I don’t know if his finger got caught in the door, or if me closing the door just scared him.

There was no blood, no broken fingers. But inside, I wanted to die. I already felt plagued by my own mommy guilt and that feeling spread throughout my body like lava. So, not only did I feel like a horrible mom for leaving my kid, but here I was in Austin, making someone else’s kid cry. What a moment. Needless to say, any rapport I had developed in my time with the family evaporated in that instant.

I stopped recording, stepped back, apologized to the mom and waited for the parents to finish calming down their kid. I waited for them to say, “This is over.” They didn’t. Miraculously, they continued the interview, even if I could feel all their judgment the entire time as we wrapped things up. “Maybe I didn’t traumatize this family,” I thought insecurely.

The icing on the cake was that we used video to capture all our data, so not only did this happen, but my boss got to see the whole thing when she reviewed the video. Later in the project I mentioned the incident and she said, “Yeah I saw that.”

Joel’s War Story: From Moscow with Love

Joel Kashuba has practiced design for nearly two decades, with a career spanning the practices of architecture, industrial design, branding, UX, and innovation consulting. He currently leads the Innovation & Design functions for Fifth Third Bank located in Cincinnati, Ohio. He told this story on stage at Midwest UX 2017.

While working for a major CPG company I was placed with a cross-functional innovation team assigned to write and vet concepts that would take a well-known women’s shaving brand into several other personal care categories. The focus was on serving the needs of young women in several BRIC countries. The theme we had been asked to unlock was “A Day at the Spa” – a theme the company had uncovered in earlier research within the United States and projected as a fruitful area to mine for opportunities and frame our expansion.

Before going out into the field – specifically, to Moscow – the project team undertook countless hours of concept writing sessions, often with heavily resourced vendor partners. We created roughly 25 concepts, each taking unique inspiration from the theme “A Day at the Spa”. Armed with our concepts we set off to Russia and began collaborating with consumers in the field to vet each concept.

By the noon on the first day, none of our concepts were resonating and we recognized our first challenge. The translator we had been assigned by a local agency was an older Russian gentleman who sounded much like a James Bond villain. As he readied each of our painstakingly word-smithed concepts, they each ended up sounding like the dastardly ideas of a dour old man who may like to cross-dress. To fix this, we recruited a spritely young woman who worked as an assistant concierge at our hotel to read the concepts. She was great! Several of our consumers even mentioned that she had the perfect voice for commercials in this category.

Despite this change, our concepts still weren’t hitting the mark we were aiming for and we couldn’t figure out why. These concepts had been exceptionally well received in our early test back in the States – what was going on here in Moscow that made them such tankers?

Finally, near the morning of day three, one of our consumers asked us plainly, “Why are you trying to make me feel old?”

“Old?” we asked her with sincere confusion, “Can you say more? Is there something in the concepts that makes you feel old?”

“Yes,” she quickly retorted, “you keep talking to me about spending a day at the spa.”

“And what does that mean to you?” we had our translator ask her.

She looked surprised and a little pissed off. She explained, “It means the place we send our grandmothers when they are too old to take care of in their homes. It’s the place people go before they die.”

It hit us like a ton of bricks. In Russian culture, a “spa” is what we’d call a retirement home. As we had been pulling out concept after concept trying to get these young women to fall in love with our theme, all they saw was of tone-deaf Americans shoving the idea of products for a retirement home down their throats.

We were horrified. We called off the rest of the day’s consumers and stayed up all night re-writing the concepts. The young concierge we had hired to translate became an adjunct team member. Constrained by time, we changed our strategy and turned consumer research into consumer co-creation. We had consumers work in teams to read and re-write the concepts, which were passed along to other teams of consumers to be refined. By the time we finished we had three great concepts that all resonated well.

Coming back to our home base, we reflected on the experience as a team. What we had set out to do was valid, but how we remained nimble in the field is what made the clear difference in how we would found success.

Emily’s War Story: Getting To The Point

Emily Mayfield (Twitter, LinkedIn) is a User Experience Researcher at The Kroger Co. in Cincinnati, OH.

Before my current job, I spent six months in Bangalore, India, doing research for a lab that was part of a design school in the northern part of the city. I did not drive while I was in India – I took public transportation and little “autos,” which resemble a golf cart in terms of size and a lawnmower in terms of sound. At that time Uber was barred from India. The driving style in Bangalore struck me as very different from the States: sometimes the traffic lights/stop signs are ignored, sometimes drivers go well beyond oncoming traffic lanes, sometimes when a freeway exit is missed drivers throw their cars into reverse on the freeway. I saw enough daily to get my heart pumping.

I was doing research to understand what the notion of “smart city” might mean in India? As part of the research, I made cold calls to different innovation centers and companies, setting up expert interviews that would inform the research. I learned a lot about how companies had explored the concept of “smartness” in cities. In retrospect, the interview part was easy. Finding the location of the interviews was the challenge.

I had a smart phone. I had a camera. I took photos of the locations on Google maps on my computer or on my phone in case the connection on my phone was lost or hiccuping. One time, I got on the bus headed south and rode it two hours deep into the city to a neighborhood I was unfamiliar with. I hopped off when it seemed like I was close to where I needed to be. There was a queue of auto drivers at the bus stop. I showed my phone and camera screens, with their neat pin-point of my destination on the digital map, to the first driver in the queue. I showed him the address: a building number and street name. The driver waved me in. “No problem!” I thought to myself. I smiled and held on tight to my bag and the rail of the auto. We were off! Turning and bending through little streets and big ones, weaving in between cars and buses. We flew past people crossing the street, animals doing the same, and carts selling food and tea. We drove and drove and drove some more. Minutes led to double-digits. The driver was flying…in what felt like circles. Checking the time, I thought “Oh boy…”

Eventually the driver pulled over to ask other auto drivers for help finding the location. Local folks came to help. A cop or some kind of military person joined in the effort. The mass of people tried to help, pointing around like the scarecrow from the Wizard of Oz guessing all directions to try next. They discussed, pointed, checked and double-checked the address and the maps. At last I got a solid idea: I called my interviewee and he chatted with the driver. We met in a place that the driver could find and then I walked with the interviewee to the building together.

Afterwards, a colleague let me know that the European conventions of maps as we know them don’t make sense to some people in India who have never seen a map in that form. Also, Bangalore is constantly changing, adding streets and changing names of streets. Later on I learned that landmarks are the way to go, as well as calling people sooner rather than later. Still, the worst case scenario was handing my phone to friendly-looking strangers to communicate with a driver when I’m really lost and it worked. A quick shout out to the kind and patient people of Bangalore: Thank you for your constant help getting me to and fro!

Side note: It’s possible my geographical difficulty is just a me thing. More than once I’ve gone to conduct research at the wrong Kroger store on the same street here in Cincinnati!

Krispian’s War Story: If Texas and England Had a Baby

Krispian Emert has over 12 years experience working in UX. She has worked all over the world: for startups, agencies, and companies like Microsoft, The NFL, Thompson Reuters, ING, etc. Currently, she is lead UX Researcher at TELUS digital. She told this story live at Radical Research Summit.

It was my first field study at my new job in Sydney, Australia. I had just uprooted my family and flown to the other side of the world to work for Australia’s largest user experience consultancy. Did I want to do a good job? You bet. Was I nervous? Hell, yes!

I had had a couple of weeks to settle in and explore the city, and to get to know my colleagues. My impression of Australian culture was that it was surprisingly similar to Canadian culture: We both have the Queen on our money, we both drink copious amounts of beer, and we both say “no worries” a lot. The only glaring difference I was able discern up to that point was that for a casual greeting Canadians asked “How’s it going?” and Australians asked, “How’re you going?” So I had experienced little culture shock thus far.

The assignment was for one of the big banks. We were to conduct contextual field studies in the moment while people used the bank’s ATMs. The only problem was that due to privacy constraints we had to recruit people just as they were about to use the ATM. This was made more challenging because the bank gave us very little in the way of official ID.

This meant that I, an extra polite Canadian, was nervously approaching busy Australians and anxiously stammering the first few sentences of my recruitment spiel. To say that I got turned down by my prospective interviewees is an understatement. The fact that I didn’t look “official” or in any way affiliated with the bank made me seem suspect at best, and criminal at worst. ATM users glared at me as though I were panhandling, and time after time, I was told to “Fuck off!”. I was worried that I wouldn’t complete the assignment. I needed 10 participants and after two hours I had exactly none.

As I stood in the street in Sydney, miles from home, failing to secure participants and on the receiving end of some choice language, I had a “Dorothy moment.” I was not in Canada anymore. Despite my initial impression that our countries were similar, I was in whole new culture – one where people were not afraid to say the F-word to a complete stranger. I realized I had to stop assuming people would stop and politely listen to my lengthy recruitment pitch, and that I had to just accept Australians for what they were – blunt and direct. I changed my approach, and went up to prospective participants boldly, waving my gift cards at them. I shortened my pitch to state only the benefits of participating in the research. This produced much better results.

They say that if Texas and England had a baby, it would be Australia. After this experience, I grew to appreciate the unique Australian culture of “wild west gunslinger meets cricket games and meat pies.”

And despite our differences, I guess we’re pretty similar after all.

Joe’s War Story: Clean Break

Joe Moran is a product research scientist at Cogito Corporation in Boston, a startup using AI to decode emotion from voice.

Working as an applied cognitive scientist, I was in the field at Fort Bragg, NC, embedded with an airborne military unit. Our group was tasked with learning about typical soldier maneuvers and the surrounding culture. A few of us (along with a couple of ex-Army handlers) had been invited to watch a “movement-to-contact” drill. This is where a single squad marches to an agreed-upon point, followed by a simulated firefight. I thought this was to be a straightforward observation; it turned out to be a learning experience punctuated by hubris, initiation, and a broken bone.

I had failed to realise what “movement-to-contact” really meant. Assuming we would be safe behind glass surveying a sanitised battlefield, I was wearing a thin jacket, jeans, and decidedly flimsy sneakers. We arrived at the agreed upon start point, and I quickly realised that we were in for a full-on march through woods with no trails (and since it was winter, the ground was muddy and slippery). Nevertheless, I was in reasonably good shape, and confident that I could keep up. After all, how hard it could be to walk and observe at the same time?

I strode off to follow the soldiers. The squad realised we were in tow, and decided to set a pretty quick pace to show us where we belonged; while the officers had brought us in, the rank and file didn’t seem to have much need for us. No matter, we were not weighed down by heavy gear, and we could keep up, even if it meant breaking into a jog every now and then. As we marched along, I managed to get some great photographs of the soldiers in action. After a while, we came upon a small ravine, eight feet wide, with the side nearest us having two ledges that each descended about four feet. The soldiers marched right across, and we soon followed. I stepped down off the first ledge, directly into soft ground and slid down on my butt those four feet. I got right up, and dusted myself off, wiping my hands on my jacket. I looked down and saw my left little finger pointed about 20 degrees off to the left. It was clearly dislocated, and I was clearly past “observation.”

At this point, every fibre in my British being was telling me to keep calm and carry on, ‘tis just a flesh wound. I covered the offending appendage in a coat sleeve and thrust out my other hand for a lift up and out of the ravine. I continued on the march, but soon it was clear this situation was untenable. Either I could continue protecting my darkening finger from catching against anything unruly and risk breaking it, or I could call for help, bring the whole exercise to a crashing halt, and end up branded as the scientist who ruined the researchers’ privileges during our very first observation.

I decided to flag down one of our handlers, who had been a medic. He gave me the classic “Look away, this is going to hurt me more than it does you!”, snapped it back into place, taped it up, and I continued with the observation. I was able to observe the rest of the movement-to-contact, and learned a lot about how this group works.

But this was only day one of a planned five-day trip! If I went to the Army medic, I risked being sent home and unable to complete the research. When I showed the unit commander my injury, he winced, laughed, and gave a broad smile welcoming me to the unit. By seeking treatment in a way that did not impact the mission, I gained the trust of the commander, and our group was invited back for many subsequent observations, leading to lots of fruitful observations about all aspects of the unit’s work.

I got an X-ray when I got home and unfortunately my finger was worse than merely dislocated: there was a clean break through the proximal phalange. Next time I showed up to Bragg, my finger was in a cast after surgery, and the soldiers got a good laugh at the return of “that guy”. From this experience I learned to (a) prepare for the unexpected, (b) not be be headstrong and charge in when I’m not prepared, and (c) improvise quickly when thing do not go to plan!

Have A Nice Day

I’ve just published Have A Nice Day as part of The Human In The Machine, a series about productivity. Excerpted below, but check out the whole piece here.

I interviewed a young couple who were both working in corporate sales (for different companies) out of their shared home office. The goal of this research project was to understand how people worked, outside of traditional offices. I had my own assumptions about what we’d learn, expecting stories about people folding laundry while they were on the call with a colleague (In fact, we met one woman who described being on a web-based teleconference from her laptop while she drove her child to after-school activities). But this couple had a particular approach: they went into the home office at 9 am and focused only on their work, until 5 pm (with a break for lunch). They deliberately maintained a firewall between their work environment (and the associated tasks) and the rest of their lives. This took intentionality and focus.

In this interview, the husband explained to us that he begins every day by making a list of what he wants to accomplish. Beyond managing his productivity, having this list meant he could tell if he had a good day!

Elizabeth’s War Story: Nail Polish for Insights

Elizabeth Chesters is a UX consultant based in London, who volunteers for organizations like EmpowerHack and CodeFirst:Girls. She told this story live at User Research London. Update: the video is here.

I volunteer for EmpowerHack, an organisation dedicated to building technical solutions for refugees. When I joined in 2016, I was working on a project called HaBaby; a mobile app that stores medical records of pregnant refugees and offers symptom cards to help them communicate with doctors. Throughout my time volunteering, I noticed a lot of barriers. One of the biggest was that a lot of people in the organisation did not understand refugees! Many had never spoken to an actual refugee, which led to some wild assumptions (such as how some women had got pregnant or the age they would typically marry).

In April 2016 my team member and I planned a trip to the refugee camps in France. We did not feel comfortable turning up as researchers, as our digital skills didn’t directly help refugees or fit the environment. They needed houses, not interviews. Our plan was to spend as much time as possible observing, in order to better understand issues refugees faced. Our research would then be reported back to the organisation, validating our ideas about what it means to be a refugee and our technical solutions.

The first visit where we were able to talk with refugees was at the Dunkirk camp. Dunkirk was a much cleaner camp than one of the other camps we had been to, The Jungle in Calais. My team member and I met with a volunteer and a group of refugees who were working on an open-source map project. After introductions, we quickly gained the trust of a refugee, who I’ll call “Zach”. We went to his cabin, met the temporary family he had made in the camp and mentioned that we were in the camps to do research.

We walked around the camp, and came across a group of three mothers who were sitting outside with their babies. By the time we communicated to Zach what we were trying to do, so that he could translate for mothers, it was raining. The women looked at us and stood up, gripping their children. Zach explained that the women would not talk to us without trading for makeup. We were testing an app, so we had nothing physical to give them. In the end they went inside to get out of the rain, and we had to walk away… though not without a few marriage proposals from passing men.

On our last day volunteering we were invited to help at a spa day for female refugees in The Jungle. Here we could get close to the women and ask questions in their safe space. This time we also brought makeup to exchange! We turned the top of a donated double-decker bus (with no seats) into a beauty room. Everyone relaxed, leaving their shoes downstairs. We laid out carpet, lined the windows with bunting, and scattered cushions around the room. My friend and I set up our nail polishing stations and settled in for a long day of painting nails.

Throughout the day we were able to meet refugees and ask questions. The women were from all around the world, with the majority from Eritrea, Syria and Afghanistan. Sadly conversations did not flow as well as expected, partly due to my inability to paint nails. Most seemed unamused at my efforts. So, I spent most of my time redoing the same nails and ensuring we still had enough polish for women who would come later.

Halfway through the day journalists from Grazia, a fashion magazine turned up to interview volunteers and refugees about the spa day. They made no effort to ask for help to translate questions. The more questions the journalists asked, the more you could see the women retreat into themselves.

By the end of the day we had no makeup left. I had a makeover done by a little girl and looked like I had two black eyes. My friend also had a bright red face, due to being sat on and having her eyebrows threaded by an Iranian beautician. I walked down to the bottom deck of the bus, to an empty box of shoes. After scanning the whole bottom deck, it became apparent that I no longer had shoes. The other volunteers helped me find something I could wear temporarily. We found a pair of silver slip-on shoes. They were slightly too small, so I had to stand on the back on them. Someone reassured me that I could go to the warehouse to pick a donated pair that fit me. But when I walked outside, the woman we had arrived with (and her car) were gone, our passports along with her. We were now stranded in The Jungle, late in the day, with the warehouse an hour’s walk away. All I could do was pace up and down, frantically phoning volunteers who I knew were at the warehouse. I prayed the woman got my message to stay at the warehouse after dropping off other volunteers, so we could retrieve our passports.

In the end we were rescued by a volunteer called “Superman John”. He drove us back to the warehouse which housed the donations, so we could get our passports back and I could pick out some shoes that fit. I have never been so happy to see that little red book!

Kristina’s War Story: Trampoline Spies

Kristina Lustig is a researcher at Stack Overflow, and is currently based in London. She told this story live at User Research London. Update: the video is here.

Last year, I was in Bangkok with eight members of my product team. For our research, we planned to speak with people who we saw taking videos with their smart phones. We split into a few groups, each with their own interpreters. My group tried – and failed – to find people at an open-air market or around a couple of malls before we got the idea to look for parents taking videos of their children. Our interpreter, Kay, in a flash of genius, suggested that we’d probably see a lot of this behavior at a trampoline park, so off we went.

After riding several long thin escalators far into the interior of an extremely large mall, we arrived at the trampoline park and bought our tickets. Before we went in, we put on the mandatory lime green sticky socks and neon pink wristbands.

Now, I’ve done a good bit of international research in questionable situations, but at this point, this was the strangest research situation I’d been in. Let me paint the picture for you: two white people in business casual with neon pink wristbands and lime green sticky socks, holding notebooks, accompanied by our Thai interpreter, all wandering through a trampoline park full of Thai parents and children. On the 700th floor of an upscale mall on a Wednesday morning.

But really, it was also a research goldmine! We found many mothers with their smart phones out, filming their children. We spent about 30 minutes chatting as casually as possible with a few different women. We learned a lot about how they shared videos on social media. Then we were approached by a trampoline park employee. She began speaking with Kay, and although we couldn’t understand a word, we watched as Kay moved from confident to concerned and finally to incredulous.

As Kay translated for us, the employee was concerned that we could be spies from a rival trampoline park, or that we were we attempting to sell these women passes to a rival trampoline park!

Kay explained to the trampoline park employee that we were from a big company in the US and that we weren’t selling anything, but she didn’t believe us. We gave her our business cards (with potentially impressive or reassuring titles like “UX Researcher” and “Product Designer”) but no dice. She started to kick us out of the trampoline park, but in a last ditch effort, we asked “Well, can we just… stay and jump?”

So, we didn’t get to do too much research, but we did spend a lot of time bouncing around under that employee’s watchful anti-research eye. We observed as much as we could, while bouncing. In retrospect, we probably should have cleared our research with the trampoline park beforehand…but any research endeavor that starts with intercepts and ends with extreme trampolining is a win in my book.

Steve’s War Story: Details Disconnect

This story was originally published on behalf of The Field Study Handbook.

Last year I was working on a project for a financial technology client. Finding participants is often a challenge, but on this project, for small business owners, it was particularly difficult.

We had hoped to base this research on previous studies, but it proved difficult to glean details about how previous studies were done. There were rumors that another team, elsewhere in the country, had developed a segmentation algorithm, but voicemails and emails went unanswered. We heard about great participants from previous studies that we should revisit, but no one would get back to us. The schedule ticked by and the pressure mounted. In the end, we were left with no choice to work around these limitations. Finally, I began to approach recruiting agencies.

My go-to recruiting team refused to take the assignment on as they had, ironically, recruited for one of these previous studies and felt like they had tapped out the local market. Another company had gone out of business, and a third didn’t think they could accomplish the recruit.

I ended up with a recruiter I had never worked with. In the end, I think they did a good job, but a new relationship added stress to the increasingly complex recruiting process.

In our introductory call, one of our recruits expressed surprise and concern that there would two of us visiting his very small office. We eventually agreed that even though it might be cramped, it would be okay. The recruiting agency, when asked about this disconnect, reassured me that they made it clear, as per my instructions, that there would be two of us. I was confused, as the participant had insisted they had never told him anything about this.

Later that day I got an email from the participant, who sought reassurance about the purpose of the interview. He had clicked on my website (seen in my email signature) and was concerned that I was actually going to be pitching him my services. He had been involved in a focus group through this agency before, and presumed this would be something similar. I confirmed that this was not a sales pitch.

A few days later we met with him in his exceptionally cramped one-person workspace. As the interview unfolded, he abruptly stopped and directly, yet politely expressed confusion and discomfort about the interview itself. Why were we asking these questions? Who do we represent? How are we going to use this information?

It took a long, unhurried conversation about the process and our objectives to put him at ease. We resumed the interview and learned a great deal about his truly amazing businesses, past, present, and future.

I emphasize his politeness in stopping the interview, because now, when I go back to the transcript, that’s what I see. But at that time, sitting in that interview, it didn’t feel that way. It felt aggressive and angry and I spent the remainder of the interview feeling uncertain about our rapport. I overcompensated with excessive deference, people-pleasing, and probably flattery. That’s not a comfortable feeling and it’s not conducive to a good interview. I have empathy for someone feeling uncomfortable about something as odd as two strangers with a video camera coming into their office space to ask about their professional history. It’s easy to mischaracterize people that don’t “get it” as difficult. And I assume that I am pretty good at managing expectations at all the common points of failure in establishing rapport.

But boy it’d be nice if we had someone to blame. That guy was a jerkface! The recruiter didn’t do their job (and then lied and insisted they did!). Steve didn’t handle the first call or the interview kickoff properly! Yet it doesn’t seem like any of these are true.

While I felt sheepish at the end of the interview, I was surprised to get a LinkedIn request from the participant immediately afterwards. And, I guess, less surprised when I heard from him a few times weeks later about not receiving his incentive payment (This was one of the very few studies where I asked the agency to send checks after the interview was completed, rather than handing people the incentive directly myself. Mistake? I don’t know). When I followed up with the recruiter about the missing incentive, I heard in some detail how this participant had already called and yelled at the admin staff.

And so it goes.

Devika’s War Story: The Young Men Of Najafgarh

Devika Ganapathy is a design researcher and the founder of Anagram Research, a design research and usability consultancy located in Bangalore, India.

Last year, I was in Delhi doing fieldwork about a smartphone news app. The primary users for this study were male college students in their early 20s, who regularly read English news on their smartphones.

One of the participants scheduled for an interview lived in Najafgarh, a place I did not know much about. I checked on Google and what I found was not encouraging: it was more than an hour away from my hotel, near the Delhi-Haryana border (possibly even longer with traffic); It was also home to the Indian capital’s most polluted water body, the Najafgarh drain!

Meanwhile, the clients who were to have accompanied me on the interview dropped out at the last minute. I was apprehensive about travelling to Najafgarh and conducting the interview on my own. The state of Haryana is notorious for being lawless and is known to be particularly unsafe for women. Men from Haryana are stereotyped as aggressive and misogynistic. I wasn’t sure if they would be comfortable being interviewed by a lone woman. Moreover, the village of Dichaon where my participant lived is infamous for its ongoing gang wars.

Despite these initial concerns, I decided to go ahead with the interview. Realistically, how unsafe could a pre-arranged hour-long meeting be? At the worst, I thought that it might be a challenging interview to conduct, but felt I would be able to manage.

Driving into Najafgarh, we passed a dead cow lying on some rubbish on the side of the road. The city looked markedly different from urban Delhi – all the women I saw on the road were traditionally dressed, scooters and public transport prevailed rather than cars, and all vehicles on the roads were driven by men.

It was difficult to find the participant’s home, though I was on the phone with him, getting directions. There were hardly any significant landmarks to guide us. Eventually, my participant asked me to park near a huge open sewage drain – He would come and find me.

My heart sank as a particularly scruffy looking young man approached the car. He confirmed that I was the person he was looking for, and got into the front seat to direct the driver to his home. We meandered our way through narrow roads and a crowded marketplace and eventually reached our destination.

His home was a multi-story building in the midst of commercial establishments; So narrow that there was only about 1 room on each floor. The steep staircase was cemented but not tiled, it didn’t have any railings.

As I followed him up to the third floor I wondered if I was being foolhardy going into his house alone. Perhaps I should have asked my driver to accompany me? And even worse, I was skeptical that this guy read English news on his smartphone!

We finally reached the top, and the room did nothing to reassure me. There were a number of rough wooden benches (typical to Indian government schools) placed in rows. Sitting there waiting for us was a very snazzy young man, with a prominent pompadour and reflective sun glasses! He greeted me with a cheery “Hi Ma’am!”

I had to now quickly decide who to interview. The first young man was the one we had originally screened and recruited. He did not seem promising: he was very quiet, his English was sketchy and I doubted that he read English news on the phone.

On the other hand, the snazzy young man spoke good English and possibly read English news. But I wasn’t certain he was a primary user or even genuinely interested in the topic since we hadn’t screened him.

It turned out that they were cousins. When the snazzy one heard about the interview, it seemed that he decided his cousin was not cool enough to be interviewed. He said to me incredulously “Why would anyone want to talk to him when they could talk to me instead?”

I decided to stick with the guy I had originally recruited, but told the snazzy cousin he could sit in and speak up if he had something interesting to add.

This interview led to some of the richest insights for this study – Such as the aspirational aspects of reading English news, where reading local language news is seen as infra dig and can invite ridicule.

The time I spent getting to know these young men also put all stereotypical thoughts I had about them to shame. I eventually learned that the room we were in was a classroom and that they worked with other young men to tutor school kids in their area. Throughout our interview, the guy I had recruited looked after his sister’s toddler son while she was busy with chores around the house. When I was done with the interview, they insisted on waiting with me on the road till my driver came to pick me up, pointing out that it was “not a good area” for women to stand on the road unaccompanied.

This experience strongly reinforced the guidelines I always need to remind myself about, even after years of being a researcher: Never judge a book by it’s cover. Never be dismissive or judgmental. Openness can lead to the best insights.

David’s War Story: The Well-lit Redhead

David Bacon is a UX Designer at Telstra Health in Melbourne, Australia. He shared this story at the UX Melbourne Book Club (see video of the group discussion here).

Standing in front of a house in a quiet suburban street, my phone buzzed and a text from my note-taking partner popped up: “Sorry can’t make interview, something urgent has come up.” We had spent the past week researching allied health professionals who worked from home. This was the fifth or sixth interview, I doubted my colleague would be missing much. I knocked on the door. It opened and a burly man with a soft gaze greeted me in a thick German accent, “Hello, I’m Herman”.

Herman the German invited me inside and led me into his home office. Against the wall was a treatment table. Adjacent to that was a desk with a large computer monitor and in the middle of the room were two comfortable office chairs. Herman gestured for me to sit down and small talk commenced.

Herman had just returned from a visit to Germany and for the first time in nearly forty years he had visited his childhood home. Positive muttering and a small nod of my head was enough encouragement for Herman to spin his chair around and bring up holiday photos on the large monitor behind him. As he gave me a personal tour of castles, forests, and medieval villages, I started to become anxious. I didn’t have a lot of time and there was a lot of ground to cover. Yet Herman was so obviously pleased to be sharing these personal stories, I feared that interrupting the holiday slide show might sour his mood.

I asked Herman if he had studied in Germany before coming to Australia and with that, he turned his back on the computer and faced me. As Herman talked a screen saver flickered to life on the monitor behind him. Photos of forests and castles that would not have been out of place in a fairytale drifted by. Herman proved to be an insightful and honest interview subject.

After a few minutes of Q&A, the photos of natural beauties gave way to photos of natural beauties of another kind. A lovely brunette wearing just a smile drifted across the screen behind an oblivious Herman, who sat with his back to the screen. The images were like classic seventies centrefold pictures: soft focus, demure poses and wave perms. They were the kind of pictures a nosey younger brother would find hidden in his older brother’s bedroom.

As Herman spoke, brunette after brunette drifted behind him. My mind started to race, there was nothing in any how-to-interview-users blogs or books to prepare me for this. “Hey look, a redhead!” I thought to myself, losing some of my concentration.

I wanted to hit pause but I also wanted to keep the interview going, Herman was a great interview subject. To bring attention to this would cause immense embarrassment to this gentle man. What if he turned around? I didn’t know how much longer I could keep my focus. I have a terrible poker face.

“Hmm, that redhead is particularly well lit.”

When at last the castles reappeared on the monitor, my brain relaxed slightly. I asked Herman to show me an example of how he organised his notes on his computer. He spun around and showed me. I can’t remember much of what happened in the remainder of the interview. As Herman walked me out, I handed him his incentive and he invited me to come back anytime.

I walked to my car and collapsed into the seat. I had just survived a potentially awkward situation and importantly, I had not negatively impacted Herman. The relief was extraordinary. But there was this nagging thought. Had I really done the right thing? What if the well-lit redhead popped up when he is treating one of his clients? Should I have mentioned something? When is it okay to intervene? I don’t know if there is a right answer but as a person far wiser than me recently told me, asking these types of questions is what’s important, not finding the answer.

Noël’s War Story: Truck Stop

Noël Bankston is a UX Research Lead and Human Factors Engineer at Zebra Technologies, currently living in Queens, NY. She told this story live at the Interaction 17 conference.

“So Jim, what would you like to do for lunch? “My treat!” It was the moment I had been dreading all day, ironic since I am a lover of food. I was trying to sound chipper but I was worn through.

It was 2 pm and I was starving. I was sitting in the cab of a 48’ tractor trailer in Lowell, Arkansas. This was my first “ride along” research trip and I had not come prepared with snacks. I was doing in-depth generative research of the pick-up and delivery process for a freight company and hadn’t known that we don’t have lunch until all the deliveries were completed.

I was also not prepared for the weather as I am from up north and I thought the South would be hot in late May. It wasn’t – it was a constant drizzle and cold. So I was sitting in the cab feeling small and tired in the oversized loaner jacket that the dispatcher had given me. We had been on the road since 8:45 am but I had arrived at the trailer dispatch site even earlier to observe the set-up process. And that should have been fine, because on a normal day, Jim finishes around noon. But today we saw all the exceptions – an unprepared customer, incorrect paperwork, an obstructed delivery dock, and poor routing. As a researcher, it was a gold-mine as I observed where problems occurred and how Jim handled them. But as someone who is mildly hypoglycemic, it meant I was getting hangry. It had been a long morning of climbing into and out of that cab, learning which hand to place where to get the right leverage to pull yourself up as you step onto the step that is only wide enough for half your foot. And I don’t know how many of you have ridden inside of a tractor trailer but it is loud and you feel every bump.

In that moment as I asked about lunch, damp, tired, and hungry, I thought back on the the anxiety I had felt earlier in the day about lunch. A co-worker told me that on his previous ride-along they had eaten a burger from a gas station mini-mart. Even on a normal day that would make me uneasy, as gas stations aren’t known for freshness and hygiene. I knew that this type of research means being available for wherever the subject takes you, but I was really hoping that didn’t include food poisoning.

But at this point, 8 hours from my previous meal and having no idea what part of town we were in, who was I to be picky?

“So Jim, what would you like to do for lunch?”

“I just want a salad. I try to eat healthy.” I gave a huge sigh of relief, accompanied by a rumble of rejoicing from my stomach. It seemed that between the two of us, I would be eating the bigger meal. I found a nearby Mexican restaurant on Yelp. While enjoying the flavor combination of fresh cilantro and lime with nary a fryolator in sight, I realized how I had been making assumptions about “truckers” based on stereotypes rather than letting the research reveal the truth. And those assumptions were also judgments about health and lifestyle. Jim was aware of the health effects of his job and wasn’t going to turn down an opportunity to have a healthful meal, especially when a researcher was paying! One of the reasons truckers eat unhealthy food is both cost and convenience. Truck stops get food fast and are less expensive. Unfortunately, our food system is set up in a way that fresh, whole food costs much more than highly processed, industrially produced food.

I won’t be able to eliminate all my biases or preconceived notions but I can grow in my awareness of them. I have been on many more ride-alongs and other types of research trips since then. You better believe I always have a granola bar with me.

Elizabeth’s War Story: Ramping Up

Elizabeth Allen is a UX Researcher at Shopify, an ecommerce platform based in Canada. She told this story live at the Interaction 17 conference.

A few years ago, I was working at Centralis, a UX research and design consulting firm in the Chicago area. One of our clients was a public transportation agency, and our project involved testing the maps and signage within and between transit stations by accompanying participants as they completed realistic wayfinding scenarios to try to get from station to station and find their correct train or bus.

As part of this testing, my research partner Kathi Kaiser and I included individuals with motor and visual disabilities to make sure they were able to navigate just as well as those who didn’t have these challenges. One participant, Susan, was in a motorized wheelchair, and we began our session with a scenario that had us traveling to a station and accessing an elevated platform where she would wait for a train.

Chicago summers can be very hot and humid, and this was one of the hottest of the year. We were all sweating by the time we got to the station even though it was just a short walk from the coffee shop where we met to start the session. Now, this station had no elevator; instead, outside the station was a very long ramp to reach the platform. This was probably the longest ramp I’d ever seen at a transit station — it had two or three switchbacks just to reach the top!

We started up the ramp, and when we were about halfway up, Susan’s wheelchair started slowing down. “Uh oh”, she said. “I think my battery is about to die. I totally forgot to charge it before I went out, and steep ramps like this always make it run out faster.” Sure enough, a few seconds later, the wheelchair slowed to a halt, completely dead.

At this point, we had to make a decision based on what was best for Susan and for the research: do we end the session early, push Susan’s chair back to our starting point, and explain to our client that we would miss out on gathering valuable accessibility insights, or do we see if we can find a power source and salvage what we can of the session? We explained to Susan that we could either end the session or try to keep going, and luckily, she was still excited about the session and was game to push on — literally.

After wheezing our way up the rest of the ramp, dripping with sweat, we got to the platform and found no electrical outlets in sight. The ticket counter was also closed, but after a lot of roaming around we were able to find the lone janitor. We were very fortunate, because he was extremely kind, and offered to let us plug Susan’s chair into an outlet in one of the back rooms.

This story ends happily. After a half hour or so, Susan’s chair was charged up, and during that time we were able to improvise some interview questions and short scenarios we could talk through with her while we waited. It really helped that we were able to think on our feet and that we had a participant who had a positive attitude and was interested in the session. Overall, we were able to salvage a research session that was difficult to recruit for, and our client was really happy with what we learned.

Jennifer’s War Story: Keeping the Lights on in Vegas

Jennifer Pretti is the Manager of the User Experience Design Team at Christie Digital in Kitchener, Canada.

At Christie Digital, we have a very niche population of users. Opportunities to observe them using our projectors are highly coveted by my UX team. In February 2014, we were invited by a good customer of ours, Staging Techniques, to observe their setup for the keynote address at Microsoft’s SharePoint Conference. The event was taking place at the Venetian Hotel, in Las Vegas, and the keynote speaker was going to be Bill Clinton. Bill Clinton!

Three of us from Christie made the trip: me, Chris (my lead industrial designer), and a software developer, Eric. Although I had conducted many user sessions for Christie before, this was the first time I was going on site to observe a live event setup and I wasn’t sure what to expect. My biggest worry was that, even though we made it clear we were there just to observe, I would be asked to answer a technical question or troubleshoot some problem and not have a clue what to say or do.

Setup was to begin at midnight the day we arrived. Working night shifts is very common for projectionists since it’s the best time to see and calibrate the light as other setup crews are already done and out of the way. The thought of staying up for a night shift wasn’t something I was particularly looking forward to, especially given jet lag was going to make it feel 3 hours later. But I hoped a mix of adrenaline and caffeine would do the trick.

After landing in Vegas, we headed down to the Expo Hall to get our bearings. The scale of everything in Vegas is massive and oversized, and the hall was no exception. It was a gigantic space – at least two football fields long and one football field wide – and it was completely empty and bare. Whatever vision the event planners had for the space seemed hopelessly unattainable in the 5 days left before the show.

When we arrived, big transport trucks were pulling into the hall to start unloading the many tons of equipment that would be needed to run the show. It was clear that they were behind schedule already. Trusses and scaffolding needed for rigging the projectors hadn’t yet been built, so we decided to split up, with Chris covering the first night shift, and Eric and I heading to bed to get some much needed sleep.

Eric and I returned to the site early the next morning to relieve Chris. The first few hours of our observation time were slow and uneventful due to continued delays with the truss work, but eventually things picked up, and soon projectors were being powered on and rigged into position. Excitement peaked when one of the projectors failed to power on. I stood poised to capture an epic story of problem solving and error recovery, but the crew just shrugged, taped an ‘X’ on the top of the projector, and replaced it with a spare one. Even after I got in touch with tech support to help explain the error code (highlighting quite clearly that our error messages need a lot of work), it didn’t change their approach. Time is money and using a functional projector was simply the most efficient option. Whatever the problem was, it could wait until they were back in the office to sort out.

It became clear by the end of the second night that the most interesting portions of the setup would be delayed past our planned departure date. The senior projectionist, Pete, pleaded for one of us to stay a bit longer. I think there was mix of professional pride in his insistence, but (happily for us) a realization of the mutual benefit of our presence, observing their workflows and listening to their wishlists. It was on account of his enthusiasm that I agreed to change my flight and stay an extra night. My fatigued body howled in despair. Another night shift? Are you crazy?!

There is no better place to change your sleeping patterns than Vegas. That city looks the same no matter what the hour: there are always people walking around, always a restaurant open, and enough indoor walkways that it could be any time of day. Hotel rooms come equipped with industrial-strength black-out curtains, whose existence I suddenly appreciated in a whole new light (pun intended), as I tried to convince my body that falling asleep at 10 AM was a totally legit plan.

The little sleep I got left me with major doubts that I could keep up a respectable and coherent state of mind for my last night. However, early into the shift, Pete insisted I help him colour match the displays. Colour matching 26 projectors is a very laborious activity that had us whizzing around on a golf cart, playing with light meters, and debating whether one projector was a fraction more magenta than the other. Shifting from observer to honorary crew member made the night fly by and gave me a more rich perspective of how our products are used.

I didn’t sleep until I was on the airplane later that afternoon. I welcomed the rest, but felt a pang of regret for not extending my trip long enough to see Bill Clinton speak. As social media began to light up with pictures of the event, I cheered for Staging Techniques and Christie for a job well done. And smiled knowing that Bill Clinton was walking on the same stage where I had been, just 24 hours ago.

Series

About Steve