Posts tagged “ethnography”

Teasing apart meaning

204_mkaymackey.JPG
Economists are talking about repugnance, a crucial, complex, and culturally varied driver of what people will and won’t do, comfortably.

And last week a woman in Ohio whose ad to sell a horse mistakenly appeared under the heading “Good Things to Eat” in a newspaper’s classified section received dozens of calls, some expressing outrage and others from people interested in turning it into dinner. (In Europe and Japan horse meat on a menu would stir no more comment than macaroni and cheese would in an American diner.)

“It’s very hard to predict what’s repugnant and what’s not,” Mr. Roth said. Paul Bloom, a professor of psychology at Yale, agreed. He conducted a two-year study to try to get at why people consider athletes who take steroids to be cheating, but not those who take vitamins or use personal trainers. He and his team offered different possibilities: What if steroids were completely natural? Or were not at all harmful? Or were only effective if the athlete had to work harder than before?

The only change that caused the interviewed subjects to alter their objections to steroids was when they were told that everyone else thought it was all right. “People have moral intuitions,” Mr. Bloom said. When it comes to accepting or changing the status quo in these situations, he said, they tended to “defer to experts or the community.”

Often introducing money into the exchange – putting it into the marketplace – is what people find repugnant. Mr. Bloom asserted that money is a relatively new invention in human existence and therefore “unnatural.”

We’ve written before about how people naturally slip from one idea to the next; our structures for organizing information are not like an Excel spreadsheet. This necessitates a triangulation approach to trying to get at what somebody’s mental models might really be and move beyond monolithic statements like “Steroids are bad!” The example of pulling apart the possible objections to steroids (fairness? composition? safety?) is right on. We might also take the reverse approach and frame it as a participatory-design thought-exercise: “You’re the executive of a pharmaceutical company and you want to find a way to make steroids acceptable to the general public. What could you do?” By looking at what people might change, we can reveal (sometimes more easily) what is stopping them from adopting something now. These barriers are crucial design opportunities that producers must understand and address.

Messaging

trivial2.jpg

In response to Colin McKay’s comment on my last post, I felt impelled to put up this detail of the TRL shirt I was wearing at the PE shoot.

Being the ironic scamp that I am 😉 , I had altered the shirt when I first bought it. (In the original picture, it’s hard to see the alteration–a letter ‘L’ in red marker after the word ‘trivia,’ so no slight on Colin for not having noticed it!)

The interesting thing here is how strongly these kinds of details–T-shirts, logos, cultural touchpoints–broadcast messages, and how easily the messaging can get confused if all the details are not available.

The complexity of messaging and the importance of small details is something worth thinking about in the context of ethnographic research. In any given observation or interaction, are enough of the crucial details coming across? Is the context clear? Are there layers of meaning?

In order to parse what are actual data and what are our own ideas triggered by real world phenomena (which are an important but different kind of artifact), it’s so essential to surface, probe and challenge our interpretations and assumptions.

This probing and clarifying-the separation of observation, analysis, and synthesis–is a significant piece of what makes conducting ethnographic research different from simply going out and watching people.

Raise a glass to the hardworking people

winedrinker.jpg
Unsurprisingly to anyone who knows of the early Louis Cheskin work, a recent Stanford study established that the more wine costs, the more people enjoy it, regardless of how it tastes.

Expectations of quality trigger activity in the medial orbitofrontal cortex, the part of the brain that registers pleasure. This happens even though the part of our brain that interprets taste is not affected. While many studies have looked at how marketing affects behavior, this is the first to show that it has a direct effect on the brain.

“We have known for a long time that people’s perceptions are affected by marketing, but now we know that the brain itself is modulated by price,” said Baba Shiv, an associate professor at the Stanford Graduate School of Business.

When we worked with a wine brand recently, we sought to understand the complete wine “usage” process, from planning, through shopping, to storage, to opening, to serving and drinking. We looked specifically at people who were interested in lower-priced wines and most of them were limited in their knowledge and/or experience.

In other categories when the customer is new and is presented with enormous product choice (the amount of wine choice dwarfs most other categories I can think of) we might feel sympathetic for the learning/selection/usage learning curve they would face; with wine people spoke very enthusiastically about the journey. Each trial experience involved drinking wine…something they liked to do! A social, tasty, and rewarding experience. Even a wine they “didn’t care for” (the typical critique) wasn’t a failure, because it still carried all the symbolic meaning.

The marketers were hampered by a limiting view of their customers; the market had been sliced into ridiculously narrow price points and this inevtiably drove discussions of people characterized exclusively within those $3 slots (as in, “I’m a $7.99 to $10.99 drinker”). While our client no doubt had cash register data to support their segmentation, it was completely at odds with how people saw themselves. They purchased across a much broader price range, and their primary concern was their own knowledge and accumulated experience. We were given a great opportunity to offer this different view and illustrate some of the unmet opportunities this presented.

Peeling The Onion

From our Design Research Methods class, some observations from an interviewing exercise.

The scenario was to conduct interviews in order to uncover opportunities in helping people to manage food, meals, nutrition, etc.

The question asked was
What are the challenges you face in meal preparation?

Of course, that question is flawed because it presumes that there are indeed challenges. This was evident when the respondent struggled with how to answer outside the frame of the question.

An alternative might be
Are there any challenges in meal preparation?
which is is more open-ended.

But better still is
What are your feelings about the experience of meal-preparation?
since it doesn’t put the label challenges into play. It would be important to understand the labels the person being interviewed places on the different aspects of their experience, and to use their terminology to probe further.

Also worth noting is that the original question came right off the sample interview guide I distributed. Sometimes the interview guide is a tool to document “questions you want answers to” rather than “questions you want to ask”; doing fieldwork involves a lot of translation back and forth between the two.

Connecting07: Connecting The Play of Improv with The Work of Ethnographic Research

Here’s the presentation from last week’s IDSA/ICSID conference.

Audio

We spent about 1/3 of the time doing improv games (which may be “you had to be there”) and about 1/3 in discussion (in which the audio favors me over the audience), but maybe you can skip past some of those parts.

img_0646.jpgimg_0670.jpgimg_0676.jpgimg_0682.jpgimg_0734.jpg

Connecting07 – Improv and Ethnography

If you are coming to ICSID/IDSA Connecting 07 in San Francisco later this month, I’ll be giving a presentation entitled Connecting the Play of Improv with the Work of Ethnographic Research on Friday, October 19, from 5:45pm – 6:30pm in the Fairmont Hotel, Crystal Room.

In the meantime, you can read more about an earlier version of this presentation

To the rest of us in the audience, both exercises were quite funny. Most of the participants couldn’t figure out at the time what we were laughing at.

All of which suggests that Improv is a powerful means of engaging with other human beings that is both immersive and “flow-like.”

Portigal then went on to define activities associated with ethnography, focusing on the guided interview process in particular.

He concluded his talk by identifying the key “overlaps” between the two disciplines:

* Balancing a “plan” with being in the moment
* “Yes and…” (Using positive reinforcement of the other’s statements to keep the conversation going.)

Dan Soltzberg and I will be attending the entire conference and we’d love to meet with folks to talk about how our work in uncovering user insights can help drive design and business decisions in your organization. Do let us know!

Tell me how you.. vs. show me how you…

We’re doing a bunch of fieldwork these days looking at how people are using their software and hardware to accomplish some tasks. It’s interesting to see the difference in the flow between the part where we ask people to describe what they do and how they do it, and the part where we ask them to show us how they do it.

The discussion part is hard. It’s a bit abstract to explain a detailed behavior in absence of any props or artifacts. People work to give clear explanations and it takes a lot of follow-up to get the details.

Most of the same people light up when they are asked to show us (although some simply decide to show us without prompting).

But I find myself liking the “tell me how” part of the interviews better; the comfort level is lower, but the struggle to articulate is very insightful. Looking at how people describe things from memory isn’t wholly accurate in capturing their perceptions or usage, but it pulls out some neat contrasts.

And ideally, we’re trying to get stories, not factoids. The discussion (not the demo) is much better for stories. The participant takes over in the demo, and it becomes a semi-hurried list of “this works like this, and this other thing works like that.”

Of course, we’re doing both, and we need to be doing both, and some of the insights will come of the tension or differences between the two.

I think we’ll switch the order on today’s interviews, and maybe try starting with the demo, and then doing a discussion afterwards. I sometimes feel the demo requires time, and rapport, and trust, before we can safely ask for it (especially if the equipment in question rests within an inner sanctum), and so this is a bit of a leap for me.

Of course, there are few “right” answers in evolving one’s technique, it’s about building up a larger palette of approaches and making intelligent choices about when to switch around. I’m not at all unhappy about how the interviews have gone so far; they’ve been fun and fascinating, but I’m thinking hard about how to keep doing better.

Iteration is Innovation

mediamasterfull.jpg
One of our recent clients, MediaMaster just launched their product, that “lets you store all your music on the internet and play it from any internet-connected device.”

Their path from idea to launch has been a fascinating one (and I don’t know most of it, I’m sure). They came to this with a hand-coded technology to rip (via a CD jukebox) many albums in sequence, sort of a mass-scanning technology for CD ripping. But if you are going to rip the same albums over and over again, it’s time- and cost-effective to simply already have a copy of them already ripped and rather than rip, why not just check liner bar codes for proof of ownership and download the songs already on hand? And since the songs are already online, why not tie it to purchase of a new CD, and why not keep the music online permanently?

They dealt with a crazy mess of technological afforandances, changes of behaviors, retail and other partnership challenges and on and on. We did an online survey with some concepts, and then took concept boards out into homes to talk to different types of hypothesized target customers.

The product development process deals with a lot of moving targets, but startup folks deal with an excess of that challenge, collating input and constraints from so many quarters, it must make them crazy.

I’m excited to see the product launch, and to see where they’ve ended up with it, given where we were at during those rounds of research. I don’t know their business model, since the service is free right now. It’ll be fun to watch what happens with it and see if they make it succeed.

This is what happens in user research!

Snipped from an article today about chemical-based cleaners in the home

Cory McKee, 27, a stay-at-home mom of three in Tridell, Utah, started ordering Seventh Generation brand cleaning products online two years ago after learning that her oldest child, now 7, had celiac disease, a gluten intolerance. Ms. McKee said that although the disease is not caused by toxins in the home, dealing with it raised her awareness about other health issues. [italics mine]

“That really woke me up,” Ms. McKee said. “I really need to make sure our home is safe.” She lost confidence in the cleaners she had been using in part because the labels of some products do not list all of their ingredients. That made it impossible to know what her family was being exposed to when she sprayed the windows, she said.

I love this, even after it’s gone through the journalistic clarifying filter. People’s ideas jump from one arena to the next. We conflate different concerns. Ask someone about their eating habits, and they’ll talk about exercise, or ask about being fit and they’ll talk about bedtime, or how to stay calm and deal with stress. We’re not good at compartmentalizing. And so ethnographers, using a conversational tool, encounter this all the time. A decision about one thing is related to a concern about something else. Even though there was no causal relationship between the celiac disease and the cleaners (and not to mention that they child already has celiac disease) the person being interviewed puts forth a causal relationship.

I hear this sort of thing all the time when I talk with people, and it’s usually much less clear than this. Complex purchase decisions, tasks, and lifestyle choices (of which our lives are full) often are told in slippery stories that start off in one place and end up in another. Teasing those apart (as this writer did here), asking for clarification, and being open to understanding how A could possibly connect to B in someone’s mind are crucial to getting at those applicable insights.

ChittahChattah Quickies

  • Put together by my colleague when she was at Cheskin. People on a discussion group were begging for a PDF, but it was only in (yuck) print for a while. Now Cheskin has posted a file for your viewing. It’s definitely “primer” not “text” but fortunately it’s not “brochure”
  • It was developed by psychotherapist Jacob L. Moreno in his studies of the relationship between social structures and psychological well-being. He defined sociometry as “the inquiry into the evolution and organisation of groups and the position of indiv

Mom and Pop as a target for innovation

Earlier this week I met with some young entrepreneurs who are trying to apply their design school education to solve a social/business/design problem. They are interested in ways to help “mom and pop” (i.e., small, independent) businesses in a specific category remain viable. They’ve done a bit of research and ideation, but were feeling stuck, so they asked me to meet them and critique what they had done so far.

The timing was interesting, because I had just writen about my Mom and Pop failure experience (ironically, thinking about this upcoming meeting the whole time). Their response to my story was to comment on the on-demand nature of our culture that seems to be escalating; that’s fair enough, I was certainly looking for my paint right then; we’ve been trained that it’s indeed possible, and we do want that.

There’s a lot of conventional political perspective on why one should shop locally and small, and they are hoping to get beyond that, to motivate people not for moral reasons but to create real benefit. (Virginia Postrel challenges at least one of the shoulds in her comment here.)

We brainstormed for a couple of hours, building up some possible scenarios, solutions, and I think most importantly for them, the research they should do next if they really want to understand their problem in an actionable fashion.

It’s all about triangulation; trying to get enough different perspectives on the situation, to bring differences out as contrasts, and to do that you need to look at different stuff. They had been mostly talking to the types of proprietors they wanted to help, and they had a really nice segmentation that came out of that. But they hadn’t looked at why customers shopped at those smaller stores. Or why customers didn’t shop at those smaller stores. What do people like about mom-and-pops? What do they like about chains? Both in the category they are looking at, but also other ones?

The second area I recommended they focus on is a deeper understanding of success and failure in other categories of retail. Brainstorm a list of different categories where large retailers have come in, but some small businesses remain. Look at what has made them successful, or what has prevented them from being successful.

In each of those ways of pulling back from the problem, they may see some interesting strategies that can be adapted to their target, as well as develop a more nuanced take on the challenge for their target.

I look forward to seeing where they go with it and I will be sure to publish anything that goes live here.

Also: they told me about a new doc called Independent America where the filmmakers drive across the country talking to people in different small businesses. Sounds interesting.

Our readers write

Charles Frith emailed a question that he hoped I could address here

Is ethnography more suited to shedding light and depth on peoples relationships with some products or services over others? Are there times when it’s completely unnecessary?

That’s a two-parter! I’ll take a shot at this all, but I hope that others will jump in to clarify, correct, disagree, or whatever.

Are there times when ethnography is completely unnecessary?! Absolutely. But your second part is about time and your first part is about category. In terms of time, in terms of the process of developing a product or service, there are different types of research that may be more or less appropriate at different points along that process. There’s no overall answer, for me, it always depends.

For example, who is the organization? What do they know about the category, or the customer, or the channel, or the market, at this point? Is it a new product in a new category, or a redesign of something they’ve been doing before that they are improving? These are all facets of “what do you need to know more about?” I guess.

The best times to do any sort of customer research (and sorry if this is obvious) is when you can take some action with the results. If there are decisions to be made and they need informing by a user/customer perspective, then try to do that research ahead of time.

Depending on how you define ethnography, you may wish to see it only as a discovery process, as something that happens early on to define needs so that you can create solutions to match those needs. But putting solutions – prototypes – back into that conversation as a way to further validate the needs or dive deeper into them is a great way to go. You can read a case study of ours here that relates how an early prototype was taken into homes in order to have a more meaningful discussion about what the needs were and how this product could address those needs. You can always hold back your artifact for some portion of your session; that’s a standard technique we use.

As far as categories of products and services go, I don’t see that as a big dividing line in terms of the usefulness of research (and I’m speaking about research in general, whatever methodology you want to consider, some way of bringing customer perspectives into your design and decision process). I’d point again to the organization and its process as the crucial gating factors.

And

Also, are there precedents for ethnographic research in Asia?

Wow – two opportunities to cite DUX conference papers in one blog post. This PDF uses research in Japan (conducted by us, and by Adobe, over several years) as a template for considering research in global locations.

I think there’s two flavors here: Global companies coming to Asia to understand these markets, and Asian companies doing for their own domestic markets something like ethnography. For the first, absolutely. Japan, China, and India have all been high-profile destinations for user research (and in case anyone wonders, we are very keen to go back and do some more). For the second, I hear more about India, specifically, with an increasing drive by Indian companies to understand how their products and services will be received. A colleague in India does a regular audit of teenager attitudes for MTV India. I don’t know in much more detail the market for this sort of thing in any part of Asia, only the different anecdotes I’ve collected from various Asian colleagues.

Should I also re-plug CultureVenture at this point? For companies looking to get a handle on these other markets, this is our service to drive inspiration through immersion. Facilitated hanging out, if you will?

How’s that Charles? I hope you’ll add some follow up questions in the comments.

My UXWeek Session

Here is a link to a podcast page for my recent talk at Adaptive Path’s UXWeek.

Effective user research requires both observation and interviewing. When doing research we strive to get outside our own default expectations and perceptions, in order to better see the details of what we’re looking at, in other words, to understand the cultural context. This third component is the most crucial to innovation. Interesting things happen when we leave our homes and our comfort zone, perhaps in another country where business, language, food, and more is beyond our own frames of reference.

Steve Portigal, founder of Portigal Consulting, offers expert tips in both observation and interviewing, and considers the challenges and opportunities in conducting research abroad. He believes that one way to better understand a different culture is to look at how things in your own culture are handled differently. He gives some examples of how some things are promoted differently in Japan than in the United States. He states that mundane observations reveal important cultural differences.

Here are the slides

I’ll be curious how others fare; I couldn’t get it to go past slide 6, although I could go to the end and page backwards. I’ve reported a bug and hope it gets fixed, but since it’s just been launched and getting some buzz, who knows. I re-uploaded and replaced it with a version that works. They are working on tracking down the problem with the last version.

Series

About Steve