Posts tagged “analysis”

Reading Ahead: Research Findings

Reading ahead logo with space above

(Updated to include slideshow with synchronized audio track)

We’re very excited today to be posting our findings from the Reading Ahead research project.

Lots more in the deck below, but here’s the executive summary

  • Books are more than just pages with words and pictures; they are imbued with personal history, future aspirations, and signifiers of identity
  • The unabridged reading experience includes crucial events that take place before and after the elemental moments of eyes-looking-at-words
  • Digital reading privileges access to content while neglecting other essential aspects of this complete reading experience
  • There are opportunities to enhance digital reading by replicating, referencing, and replacing social (and other) aspects of traditional book reading

We sat down yesterday in the office and recorded ourselves delivering these findings, very much the way we would deliver them to one of our clients.

Usually, we deliver findings like these to a client team in a half day session, and there’s lots of dialogue, but we tried to keep it brief here to help you get through it. (The presentation lasts an hour and twenty minutes.)

It’s been a great project, and we’ve really appreciated hearing from people along the way. We welcome further comments and questions, and look forward to continuing the dialogue around this work.


Audio

Reading Ahead: Building models

Reading ahead logo with space above

We’ve been hard at work synthesizing the Reading Ahead data. There’s a great deal of writing involved in communicating the results, and sometimes it makes sense to develop a visual model that represents a key idea.

Here are several partial models evolving through paper and whiteboard sketches, and finally into digital form.

We’ll be finishing synthesis soon, and publishing our findings on Slideshare, with an audio commentary.

Stay tuned…

Portigal-Consulting_synth5

Portigal-Consulting_synth4

models

Reading Ahead: Managing recruiting

Reading ahead logo with space above

There’s always something new in every project. Often we encounter a bit of process that we may not know how to best manage it. So we’ll make our best plan and see what happens. We learn as we go and ultimately have a better way for dealing with it next time.

In a regular client project, we write a screener and work with a recruiting company who finds potential research participants, screens them, and schedules them. Every day they email us an updated spreadsheet (or as they call it “grid”) with responses to screener questions, scheduled times, locations, and contact info. It still ends up requiring a significant amount of project management effort on our end, because questions will arise, schedules will shift, people will cancel, client travel must be arranged, etc. etc.

For Reading Ahead, we did all of the recruiting ourselves. Although we’ve done this before, this may be the first time since the rise of social media: we put the word out on LinkedIn, Twitter, Facebook, email to friends, and here on All This ChittahChattah.

While Dan lead the effort, we both used our own networks, and so we got responses in a number of channels, sent to either or both of us, including:

  • @ replies on Twitter
  • direct messages on Twitter
  • Comments on Facebook posts
  • Messages on Facebook
  • Emails (directly to either of us, or forwarded from friends, and friends-of-friends

facebook
A private dialog on Facebook

facebook2
Comments on a Facebook status update. Note that Dan is able to jump in and make contact directly

twitter
Direct Messages in Twitter

Some people were potential participants, some were referrers to other potential participants, and some were both. And given the range of platforms we were using, with their associated restrictions (and unclear social protocols), we had to scramble to figure out who could and should communicate with who to follow up and get to the point where we could see if the people in question were right for the study. We didn’t expect this to happen, and eventually Dan’s inbox and/or his Word document were no longer efficient, and as some participants were scheduled or in negotiation to be scheduled, he ended up with this schedule cum worksheet:

schedule

Being split across the two of us and these different media, eventually we were interacting with people for whom we had to check our notes to trace back how we had connected to them, which was great for our sample, since it meant we weren’t seeing a group of people we already knew.

It was further complicated when we had finished our fieldwork and wanted to go back to everyone who offered help close the loop with them, thanking them for help. Technically, and protocol-wise, it took some work (who are the people we need to follow up with? Who follows up with them? What media do they use), basically going through each instance one-by one.

twitter2

We haven’t figured out what we’ll do next time; we won’t forget the challenges we’ve had but there’s just not time or need right now to plan for the future. If I had to guess, I’d imagine a Google Spreadsheet that includes where we got people from, who owns the contact, whether they are participant-candidate or referrer, etc.). Despite being very pessimistic about the demands of recruiting, we still underestimated the time and complexity required for this project.

Reading Ahead: Looking for the story

Reading ahead logo with space above

I started today by typing up all of the Post-it notes you saw in our recent blog post on Synthesis.

This activity created a 6-page Word document of bullet points.

The next part of the process is something I always find challenging: taking an incredibly detailed list of observations, particpant statements, hypotheses, and ideas; figuring out what the Big Ideas are (there’s a point in the process where many of them seem Big!), and putting those into a form that tells a cogent story.

First step: make a cup of tea.

Ok, then my next steps were:

  • Categorize all those bullet points
  • Synthesize those categories a bit further
  • Write down in as short a paragraph as possible what I would tell someone who asked me, “what did you find out?”

Then I went into PowerPoint, which is what we use when we present findings to our clients. I’ll continue bouncing back and forth between Word and PowerPoint; each piece of software supports a different way of thinking and writing.

I dropped my synthesized categories into a presentation file, sifted all of the bullet points from my Word doc into the new categories, and then started carving and shaping it all so that it started to follow the paragraph I had written. (I’m mixing cooking and sculpting metaphors here.)

I printed out the presentation draft, and laid it out so I could see the whole thing at once.

Portigal-Consulting_synth10

Steve came back from a meeting and I asked him to read over what I’d printed out. He started writing notes on my printouts, pulling out what he saw as the biggest of the Big Ideas.

Portigal-Consulting_synth11

We talked about what he’d written, which led to an energetic discussion in which we really started to breathe life into this. Tomorrow, I’ll start the day by iterating the presentation draft based on our conversation.

Reading Ahead: Analysis and Synthesis

Reading ahead logo with space above

Synthesizing field data into well-articulated, data-driven patterns, themes, and opportunities is a big part of our work, but it’s an aspect that generally has less visibility than the fieldwork.

An essential early step in the synthesis process involves going back over the fieldwork sessions. An hour or two-hour interview creates an incredible amount of information. By going back into a record of the interview, we make sure not to leave anything significant behind.

We go through and make notes on interview transcripts (done by an outside service), watch videos of the sessions, and look over photographs, sketches, maps, and participatory design pieces.

Portigal-Consulting_synth3w
Annotated interview transcript

We made a bulletin board of the people we met, so they’re ever-present while we’re working.

Portigal-Consulting_synth1

Yesterday we came together to share the points we’d each pulled out. We present each interview, like a case study, to the team. Sometimes it’s just us, and sometimes our clients join us for part of this process.

Portigal-Consulting_synth2w

While one of us presented, the other captured the essence onto Post-its. We had a lot of discussion and debate while we did this, pulling together multiple viewpoints.

Portigal-Consulting_synth5w

When we were done presenting the interviews, the board looked like this:

Portigal-Consulting_synth4w

Our next step is to take these notes and start grouping them. We’ll look at different ways the information can be organized, and from there, will start refining our work and writing it up clearly and succinctly into a report.

Reading Ahead: Participatory Design

Reading ahead logo with space above

Portigal-Consulting_PD8_web
Tracy and her younger son thinking about possibilities for books and reading devices

Our fieldwork sessions often include a piece in which we ask participants to brainstorm and fantasize about the future.

In an earlier post, we talked about the simple models we were building for the Reading Ahead interviews.

Portigal-Consulting_PD1_web
Book and device models for participatory design activity

We wanted to put something in people’s hands to help them show us what the “book of the future” and “reading device of the future” could be and do. (This fieldwork approach borrows from participatory design.)

We’ve had clients come out in the field with us and say after an interview, “That person didn’t give us any ideas,” so it’s important to clarify that we don’t expect this kind of activity to directly produce marketable ideas. Rather, it gives people another mode for expressing themselves, and it’s great for helping them communicate things which may not always be easy to verbalize, like:

  • Their desires
  • What they think should exist
  • What problems they are trying to solve
  • What seems acceptable and what seems outlandish to them
  • Preferences and in what ways they would like something to be different

Portigal-Consulting_PD7
Chris uses the device model to help express his thoughts about navigation

Often for us, the very act of making the props for an activity suggests new ways of using them. In this case, while making a blank cover for the “future book” model, we realized that we could also make a blank inner page spread.

Portigal-Consulting_PD2_web
Holding the “book of the future” model

As it turned out, this meant that when we were done with the sessions, people had created very nice book models for us, with a cover and inner spread.

Portigal-Consulting_PD5_web
Portigal-Consulting_PD6_web
Erica’s “telescoping shopping bag” book with digital annotations, hyperlinks, and built-in dictionary

Part of the preparation for each interview session was to get the models ready with new blank paper. Here I am on the trunk of my car, prepping the models before an interview in San Francisco.

Portigal-Consulting_Dan1

Now that the fieldwork is done, we have a great collection of models made by the people we interviewed.

Portigal-Consulting_PD3_web
Artifacts from participants’ “future book” ideation

Portigal-Consulting-PD4_web

The last section (copied below) of our Topline Summary synthesizes some of what we gleaned from this part of the fieldwork. These are just quick hits; we’ll develop any themes and recommendations that come out of these activities much further in the analysis and synthesis phase of the project.


Excerpt from Topline Summary: Participant ideation about the “book of the future” and “reading device of the future”

NOTE: The first thing a number of the participants said when asked about what the “book of the future” could be and do was that it’s pretty hard to improve on the book-it works very well the way it is. In addition to all the qualities already mentioned, books are

  • Instant on-off

  • Durable
  • But people did have ideas. Here are some of them:

  • Interactive
  • Put yourself in the story
  • Leave the story for more information
  • Choose from alternate endings, versions
  • Size-shifting
  • Able to morph from bigger size for reading to smaller for transporting
  • Retain the book form while adding functionality
  • Book form with replaceable content: a merging of book and device, with a cover, and page-turning but content is not fixed-it can be many different books
  • Books that contain hyperlinks, electronic annotations, multimedia, etc.
  • Privacy
  • Hide what you’re reading from others, hide annotations, hide your personal book list and lend your device to someone (with content for them)
  • Projecting
  • A device that projects words that float above it, so that the reader doesn’t have to hold the device in their hands
  • Reading Ahead: Topline Summary

    Reading ahead logo with space above

    As soon as possible after concluding fieldwork, we write a Topline Summary, in which we capture our first impressions and the ideas that are top-of-mind from being in the field.

    We’re always careful to be clear about what the Topline is and isn’t. There’s synthesis that happens from the fieldwork experience itself (which the Topline captures), and synthesis that happens from working with the data (which we haven’t done yet).

    In the Topline we go a step further than the field highlights and start to articulate some of the patterns we think are emerging, but these ideas may change once we do a detailed analysis and synthesis of the data we’ve gathered.

    In a client project, we’ll have a discussion with the client team around the Topline Summary. We encourage members of the client team to come out in the field with us, and the Topline discussion is a great opportunity for everyone who did so to share their experiences and tell stories. The Topline discussion is also a good time for our clients to let us know if there are any specific directions they want us to pursue as we analyze and synthesize the data we’ve gathered.

    We’ve now finished our fieldwork for Reading Ahead. We conducted six in-depth interviews, with photo diary and participatory design activities (more in our next few posts about these methods).

    Here’s our Topline Summary:


    Portigal Consulting: Reading Ahead Topline Summary

    1. Reading is not just a solo activity; there are significant social/interpersonal aspects for many people
    • Recommendations, book clubs, lending

    • Books facilitate the interpersonal aspects of reading

    • Can be easily lent or given away
    • Given as gifts
    • People can use a book together: parents and kids, showing someone a passage or illustrations, etc.

    • Reading can be a big part of family life

    • Childhood memories, passing books between generations, reading with one’s own children.

    • Connection between home life and outside world (school)

    1. Reading and Books are not always one and the same
    • Erica buys some books because she likes them as objects. She knows she may not read all of them. “I love books. I almost like books more than reading.”

    • Jeff says if you love to read, you’d like the Kindle. If you love books, you should try it out before you buy one

    • The Kindle facilitates types of reading beyond books: blogs, articles, periodicals

    1. Books do more than carry content
    • Books engage the senses: they are tactile, visual objects, with specific characteristics like smell and weight

    • Become carriers of specific memories

    • Develop a patina that carries meaning
    • An inscribed book becomes a record of an event, interaction, relationship

    • There is an art/collector aspect to books (which is absent in the Kindle)
    • First editions
    • Signed copies
    • Galley proofs
    • Typography
    • Pictures and illustrations
    • Quality of paper, printing, etc.
    • Books say something about a person
    • Others can see what you’re reading; like clothes, etc., this carries meaning
    • “Looking at someone’s bookshelves when you go to their house” (Jeff)
    • When people give books as gifts they are deliberately communicating something about the relationship, the event, themselves, and the recipient

    • Books can create a physical record of someone’s reading activity
    • Chris used to line up all the books he had read to get a sense of accomplishment
    • Annotations, bookmarks, tags all convey the reader’s personal history with that book

    1. Books are easily shared
    • Pass them along to others

    • Donate to library

    • Sell or buy at used book store

    • Borrow from the library rather than purchasing

    1. How books are stored and organized carries meaning
    • Emotion, sense of pride, expression of personality, record of engagement

    • Erica organizes her books by how the content/type of book feels to her: “dusty” classics, modern classics, etc.

    • Julie’s extensive shelves are organized alphabetically to reinforce the idea of library

    1. Libraries and bookstores provide specific experiences
    • As a little girl, Erica visited different libraries with her Mom. This was their daily activity, and Erica retains strong and specific memories

    • Julie and her housemate recreated a library atmosphere in their home

    • A quiet, comfortable space
    • Good lighting
    • Alphabetized bookshelves
    • A unified décor

    • For Jeff and others, spending time browsing in a bookstore represents having leisure time

    1. The Kindle
    • For people whose love of reading is bound up in their love of books, the Kindle loses much of the reading experience; it is only a content carrier

    • Julie has a history of wanting to read on electronic devices as well as from printed books, so to her, the Kindle is a big evolutionary step from her old Palm, the iPhone, etc.

    • For Erica, the Kindle signifies “computer,” so it does not let her “unplug” from the fast-paced connected lifestyle that books provide a refuge from

    • Several people described the kinetics of page-turning as an important aspect of reading books that is absent in the Kindle

    • Books afford ways of navigating content that the Kindle does not: flipping, comparing non-sequential pages, looking at the recipes at the end of each chapter, etc.

    • Peter finds it frustrating that when he buys a Kindle book from Amazon, he can’t share it. When he started working in an environment where people were passing books around, he went back to reading printed books

    1. Participant ideation about the “book of the future” and “reading device of the future”
    • NOTE: The first thing a number of the participants said when asked about what the “book of the future” could be and do was that it’s pretty hard to improve on the book-it works very well the way it is. In addition to all the qualities already mentioned, books are

    • Instant on-off
    • Durable

    • But people did have ideas. Here are some of them:

    • Interactive
    • Put yourself in the story
    • Leave the story for more information
    • Choose from alternate endings, versions

    • Size-shifting

    • Able to morph from bigger size for reading to smaller for transporting
    • Retain the book form while adding functionality

    • Book form with replaceable content: a merging of book and device, with a cover, and page-turning but content is not fixed-it can be many different books
    • Books that contain hyperlinks, electronic annotations, multimedia, etc.
    • Privacy

    • Hide what you’re reading from others, hide annotations, hide your personal book list and lend your device to someone (with content for them)
    • Projecting

    • A device that projects words that float above it, so that the reader doesn’t have to hold the device in their hands

    ChittahChattah Quickies

    • Steve Portigal presenting "We've Done All This Research: Now What?" at Web 2.0 Expo New York on 11/17 – As designers increasingly are themselves conducting contextual research to inform their design work, they may find they are holding onto a trove of raw data but with little awareness of how to turn it into design. How can designers and researchers work with this type of data to have the most impact on design and business?

      Participants in this workshop, collaborating in teams, will learn an effective framework for synthesizing raw data (to be gathered before and/or during the workshop) into insights, and then creatively using those insights to develop a range of business concepts that respond to those insights.

    ChittahChattah Quickies

    • The Nike Experiment: How the Shoe Giant Unleashed the Power of Personal Metrics – Using a flood of new tools and technologies, each of us now has the ability to collect granular information about our lives—what we eat, how much we sleep, when our mood changes.
      Not only can we collect that data, we can analyze it, looking for patterns, information that might help us change both the quality and the length of our lives. We can live longer and better by applying, on a personal scale, the same quantitative mindset that powers Google and medical research. Call it Living by Numbers—the ability to gather and analyze data about yourself, setting up a feedback loop that we can use to upgrade our lives, from better health to better habits to better performance.
      Nike has discovered that there's a magic number for a Nike+ user: 5. If someone uploads only a couple of runs to the site, they might just be trying it out. But once they hit 5 runs, they're massively more likely to keep running and uploading data. At 5 runs, they've gotten hooked on what their data tells them.
    • To Sleep, Perchance to Analyze Data: David Pogue on the Zeo sleep monitoring system – Just watching the Zeo track your sleep cycles doesn’t do anything to help you sleep better. Plotting your statistics on the Web doesn’t help, either.

      But the funny thing is, you do wind up getting better sleep — because of what I call the Personal Trainer Phenomenon. People who hire a personal trainer at the gym wind up attending more workouts than people who are just members. Why? Because after spending that much money and effort, you take the whole thing much more seriously.

      In the same way, the Zeo winds up focusing you so much on sleep that you wind up making some of the lifestyle changes that you could have made on your own, but didn’t. (“Otherwise,” a little voice in your head keeps arguing, “you’ve thrown away $400.”)

      That’s the punch line: that in the end, the Zeo does make you a better sleeper. Not through sleep science — but through psychology.

    • Baechtold's Best photo series – While they are framed as travel guides, they are really more visual anthropology. A range of topics and places captured and presented in a compelling and simple fashion, illustrating similarities and differences between people, artifacts, and the like.
    • It's girls-only at Fresno State engineering camp – This is the first year for the girls-only engineering camp. Its goal is to increase the number of female engineering majors at Fresno State, which lags behind the national average in graduating female engineers. Nationwide, about 20% of engineering graduates are women. 20 years ago the national average was 25%. At Fresno State, only 13% of engineering graduates are women.

      Jenkins said he hopes the camp will convince girls "who might not have thought about it" that engineering is fun, and entice them to major in engineering.
      (via @KathySierra)

    • Selling Tampax With Male Menstruation – This campaign, by Tampax, is in the form of a story featuring blog entries and short videos. The story is about a 16-year-old boy named Zack who suddenly wakes up with “girl parts.” He goes on to narrate what it’s like including, of course, his experience of menstruation and what a big help Tampax tampons were.

    Only a few spots remain for Steve’s interaction ’09 workshop: Well, we did all this research – now what?

    My workshop at interaction ’09 (with the chatty title of Well, we did all this research – now what?) is almost sold out. It’s happening very soon, February 5, in Vancouver. I’m really looking forward to the workshop (attendees are already off doing their pre-conference homework assignment) and the conference and being in Vancouver as well.

    Many designers and other people who “make stuff” agree that talking to people is essential at many points throughout the process. But even with that agreement it's not always clear what to do with the “data” that comes from those conversations.

    Through exercises, examples, and discussion, Steve will share some best practices before going out in the field, while out in the field, and after being in the field that help transform questions into answers, answers into insights, and insights into actions.

    If you’re interested in attending the workshop, you should sign up quickly for one of the last few spots. Hope to see you there!

    Series

    About Steve