Posts tagged “truth”

Rachel’s War Story: Subject Matter May Be Inappropriate

Rachel Wong, an independent design researcher and strategist, recalls a particularly revealing study participant.

I was working at a design firm, doing a quick photo diary study. The user segment we were studying were young X-Games-types, e.g., risk-takers and thrill-seekers. We were trying to get inspired by their mindset and approach to life. This was back in the days when Polaroids were commonly used in fieldwork studies for people to document aspects of their lives in context. We gave each participant a photo diary kit, which included a Polaroid camera, film, and prompts on sticker labels. They were asked to use the prompts to inspire their picture taking, and then to affix the corresponding prompts to each photo. The prompts for this study were open-to-interpretation statements like: “This gets me excited” or “This is a relief.”

One of the guys I’d recruited for the study was an acquaintance whom I’ll call Bobby – a shy, sweet, young guy big into skating. I was so happy he agreed to participate. A week later I dropped by his house to pick up his completed kit. “Thanks, it was fun,” he said earnestly, and I gave him his incentive and thanked him.

As soon as I was home I reviewed Bobby’s photo diary and did a double take when I saw that for one of the photos Bobby had documented himself in the act of sex with an anonymous partner, associated with the prompt: “This feels good.” For a Polaroid, the photo had an impressive amount of detail, in close-up no less.

Suffice to say, this was much different than the average photo diary entry and shocked and entertained my project team the whole next morning. As I posted all the photo diary responses in a large grid on foamcore, I struggled with whether to include the illicit photo in my display. We ended up turning it around, and then hiding it away when the client came for a meeting.

But when I think about it now, I realize Bobby was communicating something about his life approach that was powerful and honest. It makes me wonder how much we edit our study participants’ responses in light of work appropriateness, and even how many of our study participants edit their own responses, shielding their most real opinions in exchange for what they think we want to hear.

So, thank you Bobby for giving me an ounce of your truth, though I wasn’t really equipped to handle it. And I’m glad it was fun.

ChittahChattah Quickies

Meet Google’s search anthropologist [SF Chron] – While the article still has a bit of the wow-technology-companies-use-social-science-to-watch-people-use-stuff wide-eyedness we see in every popular press piece, I was intrigued by the nice exploration of the gulf between what some people reveal they need and what design changes make it into the product. It’s not a one-to-one match and the article speaks to that reasonably well.

Google has hundreds of millions of users, each with different needs, working styles and levels of search competence. Every change for one subset – like those who occasionally use advanced search – comes at a cost for others – like the vast majority of people who never use it and don’t want it cluttering up the main page. Striking the right balance for the greater good requires listening to the data – and, of course, to the users themselves. “That particular interview didn’t finish off the painting,” Russell said. “But every interview helps fill in a little bit more of the canvas.”

Why Storytellers Lie [The Atlantic] – “Lie” is a perfect headline-grabbing word and it probably pays to read the piece with a less judgmental take on what people tell us. There are many situations that are lies but in research it’s our job to seek a number of possible truths and understand why what we hear may not always be the same as what we identify as true.

Sinister as that may sound, therapy likely helps many of us feel better at least in part because it encourages us to become less truthful autobiographers. As studies have shown, depressives tend to have more realistic-and less inflated-perceptions of their importance, abilities, and power in the world than others. So those of us who benefit from therapy may like it in large part because it helps us to do what others can do more naturally: to see ourselves as heroes; to write (and re-write) the stories of our lives in ways that cast us in the best possible light; to believe that we have grown from helpless orphans or outcasts to warriors in control of our fate…We should remember how much we all have a tendency to fictionalize, whether we realize it or not. We like stories because, as Gotschall puts it, we are “addicted to meaning”-and meaning is not always the same as the truth.

Clickers Offer Instant Interactions in More Venues [NYT] – This continues to be an almost-trend; the desire/opportunity/ability to “like” stuff IRL (“in real life”) the way we do on Facebook (see a previous example here).

The delighted shouts from middle-schoolers and seniors alike suggest that neither group is accustomed to having its opinions solicited. But with a clicker, “suddenly their voices are important,” said Professor James Katz, the director of the Center for Mobile Communication Studies at Rutgers. “If people feel their opinions really count, they’ll be happy and likely to give more opinions.” The dynamic of social comparison – understanding where you stand relative to your tribe – is also a draw. Clicker software satisfies that curiosity by immediately displaying a bar graph of responses in the room. “This is a new form of transparency for crowd psychology,” he said. He added some cautions about using clickers, also called audience response systems. In a society in which checking the crowd’s opinion becomes the norm, Professor Katz said, taking risks or relying on one’s instincts may be devalued. “Those who want to strike out in new directions and challenge the sentiments of a crowd, like artists and writers, have an additional burden with this technology because they can know that no one takes comfort in their vision,” he said. “There goes the Great American Novel.”

The Wizard of Oz Focus Group – Footage from an early focus group for The Wizard of Oz. ‘Nuff said.

Embedding disabled. Drat! Just click on the link above, then.

What Makes People Share Information? [Mozilla UX] – The Mozilla UX team is doing a nice job at sharing their inquiries, their methods, their artifacts and their thinking behind all of ’em.

We’re starting another research study this week. We’re interviewing 8 users in their homes, for 90 minutes each, to understand how people define their online life. It’s purposely broad as we’re trying to learn more about how people discover and organize websites from both online and offline sources. It wouldn’t be a successful interview without some artifacts to help us collect this data, so we came up with a two fun activities – the timeline and “me in the middle”. At the beginning we’ll start with a simple timeline and have the participants walk us through their yesterday – what they did, where they where and we’ll prompt for what tools and devices they used – but that is just a way to get all the raw data on paper quickly. What we are really after is their stories.

ChittahChattah Quickies

  • [from steve_portigal] On The Media: "Debunk This!" (August 27, 2010) – [Pervasive myths affect product adoption as well as political or cultural stories. This is an area we are sometimes asked to explore] BROOKE GLADSTONE: Now, this study is building off previous research that you've done on correcting misperceptions, research. But can you give us just a quick rundown of what those earlier experiments showed?
    BRENDAN NYHAN: My coauthor, Jason Reifler, and I looked at can the media effectively correct misperceptions, which seems like a simple question, but no one had really tested that scientifically.
    BROOKE GLADSTONE: And you found actually that when people had their misperceptions challenged certain people, at least, were more likely to become more firmly entrenched in that belief.
    BRENDAN NYHAN: People were so successful at bringing to mind reasons that the correction was wrong that they actually ended up being more convinced in the misperception than the people who didn't receive the correction. So the correction was making things worse.

ChittahChattah Quickies

  • Consumed – Faux-Authentic Uniforms [NYTimes.com] – The authenticity question is a particularly interesting one to parse. A pair of worn, faded jeans does reflect a history shared by object and owner. For many years now, manufacturers have sold a shortcut to that idea by wearing out and fading jeans before they hit the shelves, by way of a variety of industrial processes (often charging a hefty premium for this outsourcing of the item’s physical past). These Burton pants embrace the worn-denim trope but take it a step further. They’re actually made of a waterproof Gore-Tex fabric and made to look like jeans through “photo sublimation,” according to USA Today: “a photo was taken of a pair of tattered jeans then printed onto the garments via a technical heat process.” So what we have here is a representation of a simulacrum of tattered, faded, authentic pants-with-a-history.
  • Why You Shouldn’t Believe A Company’s Word Lore [NYTimes.com] – By promoting the “sound of the machine” origin for the once-generic kisses, Hershey is engaging in what Kawash calls “strategic corporate forgetting”: “they invent an original story for marketing purposes to make it seem unique to their candy.” Notably, Hershey’s historical whitewash took shape in the late ’90s, just about when the company’s lawyers were beginning an ultimately successful battle to trademark kisses. They didn’t use the story in their legal arguments, but it played right into their efforts to associate kisses uniquely with the Hershey brand. When a company is trying to make its product iconic in the minds of consumers, it doesn’t hurt to inject a pleasant etymological tidbit, no matter how easy it is to disprove.
  • Making Sense of Complexity [NYTimes.com] – Unless the subject is TV remote controls, Americans have a fondness for complexity, for ideas and objects that are hard to understand.We assume complicated products come from sharp, impressive minds, and we understand that complexity is a fancy word for progress….What we need, suggests professor Brenda Zimmerman, is a distinction between the complicated and the complex…Performing hip replacement surgery is complicated. It takes well-trained personnel, precision and carefully calibrated equipment. Running a health care system is complex. It’s filled with thousands of parts and players, all of whom must act within a fluid, unpredictable environment. To run a system that is complex it takes a set of simple principles that guide and shape the system.“We get seduced by the complicated in Western society,” Ms. Zimmerman says. “We’re in awe of it and we pull away from the duty to ask simple questions, which we do whenever we deal with matters that are complex.”

Products with (fake) benefits

Years ago on the Simpsons, the family home is destroyed by fire. An insurance agent appears on the scene and the following exchange ensues…

Agent: Any valuables in the house?
Homer: Well, the Picasso, my collection of classic cars…
Agent: Sorry, this policy only covers actual losses, not made-up stuff.
Homer: [miffed] Well that’s just great!

I had a similar reaction when I saw the recent newspaper advertisements for
SOYJOY Nutrition Bars

wholesoy.jpg

The details:
meetwholesoy.jpg

The Soyjoy site is thick with links to scientific articles that explain the role of soy in disease prevention and the like, but the site (as does the ad) leads with these much softer and (I believe) unreal benefits. But how appealing it is to imagine that eating some product would increase your optimism? Indeed, in preparing this post I had to think for a minute (and look on their site to check myself) about whether or not it is or could be true.

We don’t expect that Red Bull will really give us wings, other than metaphorically. Here Soyjoy is making literal promises, though, as they describe how we, the eater, will feel. Even if we decide intellectually that it’s just advertising, what is the power of association they’ve created, without having to deliver? Where does our culture (and our legal system) draw the line about what claims must be provably true and what claims are so speculative that there is no expectation of belief?

Experienced pollsters know: people “lie”

As I’ve said before, garbage in, garbage out. From Rob Walker’s Consumed

Recently, Stardoll did a study of its own, polling United States users about their brand preferences. Apparently they saw real-world brands on the same plane as the half-dozen or so invented brands that exist only within the site. (Some respondents even made the – clearly impossible – claim that they wear the strictly digital Goth-style brand Fallen Angel to school.)

These sorts of stories always crop up in market research and business case studies. And they are wonderful because they illustrate the depth of meaning the products, services, brands, and stories we create can be to the people that consume them. So meaningful that they will conflate pretend brands online and tangible experiences offline. Wow, we marvel, that tells you how great our stuff is; they will lie about it.

But the flip side to that is that if you are going to ask people what they think and do and want, you better have a way of triangulating their responses against other data. If you don’t know more about the person than their response, how can you contextualize it? If you don’t know what they are really saying when they answer the question – if they understood the question or are answering it in the way you intended – then you must be very careful in what you conclude and how you act on those answers.

The vibration of truth

ff_232_lonelygirl2_f.jpg
The Secret World of Lonelygirl is a pretty interesting summary of much that happened with this YouTube phenom. But separate from that, a passage caught my interest.

When the show started in June with a two-minute YouTube posting by Bree — played by actress Jessica Rose — Flinders would rearrange his room after each shoot. He’d take down the pictures of Rose as a baby, stash the stuffed animals, and swap out the girly bedspread for his more masculine blue-and-white-striped blanket. Now, three months into the project and with hundreds of thousands of regular viewers, he doesn’t bother. It’s too much work, even though it has blown some great opportunities for him. Last week, he spotted his neighbors — two Playboy playmates — and invited them in. They glanced at his room, got suspicious, and quickly left.

That playmate bit…do you believe him? I don’t.

It reads strongly like bluster reported as fact.

I’ve done enough ethnographies over the years to know that often you can tell when someone is embellishing or making up a story. It’s fine that people do that; the goal as an ethnographer is try and filter for that; to try and understand why. But what about for a journalist? Do they have a sensitivity to veracity? For non-hard-news, do they have an ethical journalistic responsibility to question or seek corroboration? Or do they simply need to type into their story, presented as fact, whatever their subjects tell them?

The Media Can’t Get The Right Message About The Medium

Rep. Foley’s Explicit Messages are big news. But ask yourself this, based on what you’ve read so far. Were the inappropriate communications in email? Or IM? Or both? I really can’t tell. What I’ve seen is sloppy reporting, where a non-technical publication doesn’t bother to distinguish between very different technologies. It was a running joke when reporters kept calling Undercover a “chat room” or a “message board” or an “online forum” instead of a mailing list – you don’t expect much accuracy (or interest in accuracy) from entertainment reporters (I think one story in ’97 or so referred to me as Eve Portigal) and those technologies were somewhat newer back then. But now we’ve got front page coverage by hard-news journalists in all the top publications, presumably with fact-checkers and lawyers looking this stuff over.

Don’t these sort of details matter?

Get the story straight

The London Bombing story seems to be evolving crazily, with so much information being revised. First, the bombers were amateurs. Then CNN’s timeline of the explosions was radically revised from the original stories. But timers were used not suicide bombers. Then we were told the bombers were experts, given the quality of the bombs themselves. Then we hear that some people were arrested. Then that is denied, but we hear that the bombers did kill themselves aboard the trains and bus.

I’m sure this post will be out of date before you read it.

Obviously there’s a balance between keeping the public informed and getting the story straight. Personally, I find the shifting facts and emotions that those facts engender to be unsettling, leading to more of a feeling of being out of control – that the authorities are out of control and that we the public are increasingly helpless. Others may take a Law-and-Order like comfort from the narrowing in onto the truth.

Series

About Steve