Posts tagged “risk”

Jen’s War Story: Trust your gut, it can save your life!

Jen Iudice is a Senior Design Researcher with Teague. Here is her story about the road not taken.

Having done ethnographic research for nearly 20 years, I’ve definitely seen it all in the field. Fortunately, that includes coming across some very interesting and enthusiastic participants. On occasion however, there are times when the recruiter misses the boat, things slip through the cracks, and wham bam, you are in a painfully uncomfortable (or in rare cases) a dangerous situation. Hence the challenge of screening: striking a balance between actually screening participants while trying not to lead them. As researchers we are aware of the occasional duds who sneak their way into a study in order to make a buck! This is one of those stories.

Recently, I was charged to do some field research for a client about how people use their personal data; a topic that covered a massive amount of sub topics, and could apply to almost anyone. The screener was carefully developed with the client’s input, and the recruit was filled with a great spectrum of participants. Good so far.

The client was very motivated to participate in the research, which is almost always a positive. However, on this particular occasion my colleague and I were ultimately relieved that he could not make it to this interview!

When we arrived at the location, we noticed an old, run down high-rise building with a bail bondsman conveniently located on the bottom floor. There were several “tenants” taking leisurely “naps” in front of the doorway to greet us. At that moment I felt a terrible sinking feeling in my stomach. My colleague half joking/half seriously said, “I don’t want to go in there Jen…I don’t care if he uses!”

As we drove around the building several times I contemplated: Am I being too judgmental? Could this really be a well-qualified participant that I am simply not willing to accept because of the sketchy appearance of his place of residence? Can we risk entering this building with all of our expensive electronic/video equipment?

My colleague and I decided not to risk ignoring the feeling in our guts, and phoned to cancel the interview.

When the participant answered the phone he sounded very strange and out of sorts. I let him know that we would still pay him for his time, but we could not make it to the interview (translation: we are afraid to come into your building!). He then explained that he had just been robbed at gunpoint in his apartment, and that it was a good thing we did not come over! This became even more concerning when we realized that you could not enter this building without going through a security check-in at the front desk (this was another tip-off that we should not go in!). This event would mean either the security precautions were a joke, or that someone that lives in the building had robbed him! Needless to say, I did not ask any details, and he continued to talk to me about how distraught he was. I did my best to try and console the man and wished him luck with his situation. AWKWARD!

It boggles my mind to think about what could have happened if we had followed through with this interview! As one could imagine, I “verbalized my concerns” to the recruiter (i.e., I gave them an earful!), but moving forward, I will always map out my in-home interviews and will always make sure I have a colleague with me on every interview…just to be safe!

Be careful out there, everyone. Always be aware of your surroundings. If it doesn’t feel right, it probably isn’t!

ChittahChattah Quickies

ChittahChattah Quickies

  • PETA (hopefully tongue-in-cheek) attempts to rebrand fish as "Sea Kittens" – Sorta reductio ad absurdum re: my latest interactions column, Poets, Priests, and Politicians
  • Rug company Nanimarquina brings global warming to your living room – "If there is an iconic image that represents the natural devastation of global warming, it is the lone polar bear stuck on a melting ice flow. Now eco rug company Nanimarquina has teamed up with NEL artists to create a beautiful ‘Global Warming Rug’ – complete with stranded polar bear floating in the middle of the sea – to represent the most pressing issue of our time. Rugs have been traditionally used throughout the ages to tell stories and communicate messages, and we think this is a lovely, poignant new take on a time-honored tradition." What effect does it have when an issue like global warming gets iconified and aestheticized like this? Does it drive home the seriousness of the situation, or make it more palatable?
  • Asch conformity experiments – (via Eliezer Yudkowsky) Asch asked people about similarity of height between several lines. Confederates answered incorrectly and this influenced the subject themselves to support this incorrect answer.
  • Confirmation bias: the tendency to seek out information that supports what we already believe – (via Eliezer Yudkowsky) The 2-4-6 problem presented subjects with 3 numbers. Subjects were told that the triple conforms to a particular rule. They were asked to discover the rule by generating their own triples, where the experimenter would indicate whether or not the triple conformed to the rule. While the actual rule was simply “any ascending sequence”, the subjects often proposed rules that were far more complex. Subjects seemed to test only “positive” examples—triples the subjects believed would conform to their rule and confirm their hypothesis. What they did not do was attempt to challenge or falsify their hypotheses by testing triples that they believed would not conform to their rule.
  • Overcoming Bias – Blog by Eliezer Yudkowsky and others about (overcoming) biases in perception, decisions, etc.
  • Hindsight bias: when people who know the answer vastly overestimate its predictability or obviousness, – (via Eliezer Yudkowsky)
    Sometimes called the I-knew-it-all-along effect.
    "…A third experimental group was told the outcome and also explicitly instructed to avoid hindsight bias, which made no difference."
  • Planning fallacy – the tendency to underestimate task-completion times – (via Eliezer Yudkowsky) Asking people what they did last time turns out to be more accurate than what they either hope for or expect to happen this time
  • Cognitive Biases in the Assessment of Risk – (via Eliezer Yudkowsky) Another example of extensional neglect is scope insensitivity, which you will find in the Global Catastrophic Risks book. Another version of the same thing is where people would only pay slightly more to save all the wetlands in Oregon than to save one protected wetland in Oregon, or people would pay the same amount to save two thousand, twenty thousand, or two hundred thousand oil-stroked birds from perishing in ponds. What is going on there is when you say, “How much would you donate to save 20,000 birds from perishing in oil ponds,” they will visualize one bird trapped, struggling to get free. That creates some level of emotional arousal, then the actual quantity gets thrown right out the window.

    [I am not sure that's the reason why; I think there could be other explanations for the flawed mental model that leads to those responses]

  • Conjunction fallacy – (via Eliezer Yudkowsky) A logical fallacy that occurs when it is assumed that specific conditions are more probable than a single general one. Example: Linda is 31 years old, single, outspoken, and very bright. She majored in philosophy. As a student, she was deeply concerned with issues of discrimination and social justice, and also participated in anti-nuclear demonstrations.

    Which is more probable?

    1. Linda is a bank teller.
    2. Linda is a bank teller and is active in the feminist movement.

    85% of those asked chose option 2 [2]. However, mathematically, the probability of two events occurring together (in "conjunction") will always be less than or equal to the probability of either one occurring alone.


About Steve