Posts tagged “methodology”

Reading Ahead: Topline Summary

Reading ahead logo with space above

As soon as possible after concluding fieldwork, we write a Topline Summary, in which we capture our first impressions and the ideas that are top-of-mind from being in the field.

We’re always careful to be clear about what the Topline is and isn’t. There’s synthesis that happens from the fieldwork experience itself (which the Topline captures), and synthesis that happens from working with the data (which we haven’t done yet).

In the Topline we go a step further than the field highlights and start to articulate some of the patterns we think are emerging, but these ideas may change once we do a detailed analysis and synthesis of the data we’ve gathered.

In a client project, we’ll have a discussion with the client team around the Topline Summary. We encourage members of the client team to come out in the field with us, and the Topline discussion is a great opportunity for everyone who did so to share their experiences and tell stories. The Topline discussion is also a good time for our clients to let us know if there are any specific directions they want us to pursue as we analyze and synthesize the data we’ve gathered.

We’ve now finished our fieldwork for Reading Ahead. We conducted six in-depth interviews, with photo diary and participatory design activities (more in our next few posts about these methods).

Here’s our Topline Summary:


Portigal Consulting: Reading Ahead Topline Summary

  1. Reading is not just a solo activity; there are significant social/interpersonal aspects for many people

  • Recommendations, book clubs, lending
  • Books facilitate the interpersonal aspects of reading
  • Can be easily lent or given away
  • Given as gifts
  • People can use a book together: parents and kids, showing someone a passage or illustrations, etc.

  • Reading can be a big part of family life
  • Childhood memories, passing books between generations, reading with one’s own children.
  • Connection between home life and outside world (school)

  1. Reading and Books are not always one and the same

  • Erica buys some books because she likes them as objects. She knows she may not read all of them. “I love books. I almost like books more than reading.”
  • Jeff says if you love to read, you’d like the Kindle. If you love books, you should try it out before you buy one
  • The Kindle facilitates types of reading beyond books: blogs, articles, periodicals

  1. Books do more than carry content

  • Books engage the senses: they are tactile, visual objects, with specific characteristics like smell and weight
  • Become carriers of specific memories
  • Develop a patina that carries meaning
  • An inscribed book becomes a record of an event, interaction, relationship

  • There is an art/collector aspect to books (which is absent in the Kindle)
  • First editions
  • Signed copies
  • Galley proofs
  • Typography
  • Pictures and illustrations
  • Quality of paper, printing, etc.
  • Books say something about a person
  • Others can see what you’re reading; like clothes, etc., this carries meaning
  • “Looking at someone’s bookshelves when you go to their house” (Jeff)
  • When people give books as gifts they are deliberately communicating something about the relationship, the event, themselves, and the recipient

  • Books can create a physical record of someone’s reading activity
  • Chris used to line up all the books he had read to get a sense of accomplishment
  • Annotations, bookmarks, tags all convey the reader’s personal history with that book

  1. Books are easily shared

  • Pass them along to others
  • Donate to library
  • Sell or buy at used book store
  • Borrow from the library rather than purchasing

  1. How books are stored and organized carries meaning

  • Emotion, sense of pride, expression of personality, record of engagement
  • Erica organizes her books by how the content/type of book feels to her: “dusty” classics, modern classics, etc.
  • Julie’s extensive shelves are organized alphabetically to reinforce the idea of library

  1. Libraries and bookstores provide specific experiences

  • As a little girl, Erica visited different libraries with her Mom. This was their daily activity, and Erica retains strong and specific memories
  • Julie and her housemate recreated a library atmosphere in their home
  • A quiet, comfortable space
  • Good lighting
  • Alphabetized bookshelves
  • A unified décor

  • For Jeff and others, spending time browsing in a bookstore represents having leisure time

  1. The Kindle

  • For people whose love of reading is bound up in their love of books, the Kindle loses much of the reading experience; it is only a content carrier
  • Julie has a history of wanting to read on electronic devices as well as from printed books, so to her, the Kindle is a big evolutionary step from her old Palm, the iPhone, etc.
  • For Erica, the Kindle signifies “computer,” so it does not let her “unplug” from the fast-paced connected lifestyle that books provide a refuge from
  • Several people described the kinetics of page-turning as an important aspect of reading books that is absent in the Kindle
  • Books afford ways of navigating content that the Kindle does not: flipping, comparing non-sequential pages, looking at the recipes at the end of each chapter, etc.
  • Peter finds it frustrating that when he buys a Kindle book from Amazon, he can’t share it. When he started working in an environment where people were passing books around, he went back to reading printed books

  1. Participant ideation about the “book of the future” and “reading device of the future”

  • NOTE: The first thing a number of the participants said when asked about what the “book of the future” could be and do was that it’s pretty hard to improve on the book-it works very well the way it is. In addition to all the qualities already mentioned, books are
  • Instant on-off
  • Durable

  • But people did have ideas. Here are some of them:

  • Interactive
  • Put yourself in the story
  • Leave the story for more information
  • Choose from alternate endings, versions

  • Size-shifting
  • Able to morph from bigger size for reading to smaller for transporting
  • Retain the book form while adding functionality
  • Book form with replaceable content: a merging of book and device, with a cover, and page-turning but content is not fixed-it can be many different books
  • Books that contain hyperlinks, electronic annotations, multimedia, etc.
  • Privacy
  • Hide what you’re reading from others, hide annotations, hide your personal book list and lend your device to someone (with content for them)
  • Projecting
  • A device that projects words that float above it, so that the reader doesn’t have to hold the device in their hands

Reading Ahead: Props For The Field

Reading ahead logo with space above

As we get into actual fieldwork this week, we’ll be using (as is typical for us) a mashup of techniques. In addition to interviewing people, we’ll be watching how and where they read books or Kindles. But we’ll also want to get into a discussion of future possibilities. Reading Ahead is not about evaluating existing designs but instead getting inspiration and information that can drive future designs. So we don’t have anything to test, but that doesn’t mean we can’t use testing-like (“What do you think of this?”) activities. In this case, we’ve built extremely simple representations that suggest book and digital reader.

prototyping
Dan building a thing-to-hold for this week’s interviews

The idea (and we’ll learn what happens once we do a couple of interviews) is to have something neutral to put into people’s hands and let them gesture, sketch, or otherwise perform, so the activity of discussing the future isn’t just a verbal one. We’re going to ask people to draw on these props, and then we’ll have an artifact created by the participants themselves. Those artifacts can be compelling, and can also be a much more impactful symbol of what took place in that part of the interview.

We’ve never used this exact prop before, but in just about every project we’ll come up with a range of tools to use in the field. Our interviews are very open-ended so we could use either of the props to explore any emergent themes, depending on what we use them to talk about (From “How would you hold this?” to “Well, if it did come with your Happy Meal, draw what you’d expect to see on the main screen.”

For more, see Moving with a Magic Thing (PDF) and Design the Box

Reading Ahead: The Interview Guide

Reading ahead logo with space above

Before we go out in the field we write an interview guide (or field guide), a list of all the topics we want to cover.

Interview guides end up being very linear and structured, but the interactions we have in the field are looser and more conversational. We’ll let the way we pose our questions flow much more from what the person we’re interviewing is saying than from the sequence and phrasings of the interview guide.

Even though we know this will happen, we’ve still been working hard to hash out our questions ahead of time–even the basic ones. It’s like John McLaughlin said about jazz improvisation: you have to learn all the chords so that you can forget about them.

The interview guide is also something for everyone (including our clients) to look at, to make sure we’re all on the same page as we head into fieldwork.

Our interview guide for Reading Ahead is here.

ChittahChattah Quickies

  • Design Research Methods for Experience Design – Triading is a method that allows a researcher to uncover dimensions of a design space that are pertinent to its target audience. In triading, researchers present three different concepts or ideas to participants and ask them to identify how two of them are different from the third. Participants describe, in their own terms, the dimensions or attributes that differentiate the concepts. Participants follow this process iteratively—identifying additional attributes they feel distinguish two of the concepts from the third until they can’t think of any other distinguishing factors.

    The benefit of this process is that it uncovers dimensions of a particular domain that are important to the target audience rather than the researcher or designer. For example, participants may describe differences in groups as “warm” versus cold” or business-like” versus fun.” Designers can then use the most relevant or common dimensions as inspiration for further design and exploration.

  • Mapping Oakland – Mapping Oakland is a research project aimed at mapping people’s perceptions of neighborhoods and urban space within the City of Oakland. Mental maps have been used in geography to understand individual perceptions of space and place for sometime. The method has proven useful in helping geographers understand how people perceive elements within the landscape for navigational purposes and to understand the cultural value of spaces. This web site provides citizens throughout Oakland access to a survey that measures how people perceive and use public open space in the City of Oakland.
  • How ethnic groups change Oakland neighborhoods – When Robert Lemon, a UC Berkeley landscape architecture grad student, was a community planner in Columbus, Ohio, he noticed that despite the car-oriented landscape, residents of the city's Latino community, for the most part, liked to get around on foot and bicycle and, as a result, were bending the neighborhood to their collective will. Taco trucks and open-air produce markets popped up in vacant parking lots on one of the city's main shopping thoroughfares. The bicycle was a key mode of transportation even though there weren't dedicated bike lanes, and colorful murals appeared on the walls of large buildings. The neighborhood had the feel of small-town Oaxaca, the Mexican state from which many of the city's Latinos hailed.

    In California, he found similar changes occurring in Oakland's Fruitvale and Chinatown neighborhoods. He is conducting a formal survey as part of a fellowship & has gone through Oakland's diverse neighborhoods, walking up and down the streets asking questions.

Our readers write

Charles Frith emailed a question that he hoped I could address here

Is ethnography more suited to shedding light and depth on peoples relationships with some products or services over others? Are there times when it’s completely unnecessary?

That’s a two-parter! I’ll take a shot at this all, but I hope that others will jump in to clarify, correct, disagree, or whatever.

Are there times when ethnography is completely unnecessary?! Absolutely. But your second part is about time and your first part is about category. In terms of time, in terms of the process of developing a product or service, there are different types of research that may be more or less appropriate at different points along that process. There’s no overall answer, for me, it always depends.

For example, who is the organization? What do they know about the category, or the customer, or the channel, or the market, at this point? Is it a new product in a new category, or a redesign of something they’ve been doing before that they are improving? These are all facets of “what do you need to know more about?” I guess.

The best times to do any sort of customer research (and sorry if this is obvious) is when you can take some action with the results. If there are decisions to be made and they need informing by a user/customer perspective, then try to do that research ahead of time.

Depending on how you define ethnography, you may wish to see it only as a discovery process, as something that happens early on to define needs so that you can create solutions to match those needs. But putting solutions – prototypes – back into that conversation as a way to further validate the needs or dive deeper into them is a great way to go. You can read a case study of ours here that relates how an early prototype was taken into homes in order to have a more meaningful discussion about what the needs were and how this product could address those needs. You can always hold back your artifact for some portion of your session; that’s a standard technique we use.

As far as categories of products and services go, I don’t see that as a big dividing line in terms of the usefulness of research (and I’m speaking about research in general, whatever methodology you want to consider, some way of bringing customer perspectives into your design and decision process). I’d point again to the organization and its process as the crucial gating factors.

And

Also, are there precedents for ethnographic research in Asia?

Wow – two opportunities to cite DUX conference papers in one blog post. This PDF

online pharmacy buy augmentin online no prescription pharmacy

uses research in Japan (conducted by us, and by Adobe, over several years) as a template for considering research in global locations.

I think there’s two flavors here: Global companies coming to Asia to understand these markets, and Asian companies doing for their own domestic markets something like ethnography. For the first, absolutely. Japan, China, and India have all been high-profile destinations for user research (and in case anyone wonders, we are very keen to go back and do some more). For the second, I hear more about India, specifically, with an increasing drive by Indian companies to understand how their products and services will be received. A colleague in India does a regular audit of teenager attitudes for MTV India. I don’t know in much more detail the market for this sort of thing in any part of Asia, only the different anecdotes I’ve collected from various Asian colleagues.

Should I also re-plug CultureVenture at this point? For companies looking to get a handle on these other markets, this is our service to drive inspiration through immersion. Facilitated hanging out, if you will?

How’s that Charles? I hope you’ll add some follow up questions in the comments.

Todd calls for “A new framework”

Todd writes, over at the adaptive path blog

Focusing exclusively on tasks and goals means that you tend to ignore or de-emphasize all of the activities that people engage in that are specifically not goal-oriented. It also means that you will often ignore the messy jumble of activities that take place around but are not oriented toward your system. This is not always problematic but it quickly becomes so when you are designing for multiple contexts and mediums. When it comes to designing for the total experience, the activities that have little to do with the system you are designing are often just as important as those that are central to it. More than ever before, people switch from one context to another rapidly and often. They were in the outskirts of Cleveland mowing their lawn then the cell phone rang and suddenly they’re planning a trip to Thailand.

The thesis of the piece, as I read it, is not simply to shift methodologies (do ethnography and forget usability) but to change the fundamental way that we structure and act on the information we gather about the people we are designing for.

It’s a great challenge for organizations, and for consultants, because there’s powerful cultural infrastructure that drives what is an acceptable piece of new knowledge, and of course, what isn’t. In order to see how you might act on something – what do we DO with this information – requires a shift in perspective. And those don’t happen overnight, when they do happen.

Series

About Steve