Posts tagged “contextual research”

Contextual research from a bygone era

While listening to This American Life I learned about Roger Barker, a psych professor who turned the small Kansas town of Oskaloosa into a laboratory in the late 1940s.

Barker was one of the most extraordinary — and least known — figures in the history of psychology. Shortly after he became chair of the KU psychology department in the late 1940s, he relocated his family to Oskaloosa to observe and gather data about the residents who lived in the town, population 725.

At that time, psychological research was primarily done in laboratories. “It was the era of running rats through mazes to understand human behavior,” he said. “Barker said you won’t learn about any real human behavior in a laboratory. If psychologists want to understand human behavior in the real world, they must enter the real world.”

More from this article

Among Barker’s more unusual efforts was a 1951 paper he co-wrote under the title “One Boy’s Day.”

It chronicled 14 hours in the life of a local boy with the pseudonym Raymond Birch . He was 7 when Raymond’s parents allowed the Midwest Psychological Field Station to record his every movement, according to Sabar’s book:

7:00. Mrs. Birch said with pleasant casualness, ‘Raymond, wake up. …’
7:01. Raymond picked up a sock and began tugging and pulling it on his left foot. …
7:07. Raymond turned to his dresser and rummaged around among the things on it until he obtained a candy Easter egg for his dog.

The notations, archived at KU, track Raymond on his walk to school. He finds a baseball bat in the grass and swings it, accidentally striking a flagpole.

“This made a wonderful, hollow noise,” researchers wrote, “so he proceeded to hit the flagpole again.”

Barker eschewed academic prose and wanted his charges to record any telling, prosaic detail.

Through the 1950s, Oskaloosans grew accustomed to the sight of a child being shadowed by a note-scribbling adult. In published papers, this was the town of “Midwest,” in keeping with the scientific practice of shielding the identity of the subjects being examined.

Barker’s work differed from other scholarly studies of places such as Muncie, Ind., (Middletown) and Candor, N.Y., (Springdale) in at least two ways.

First, it focused less on class and politics and more on the relationships that made kids feel comfortable.

Second, Barker’s family settled into Oskaloosa as a permanent home. Roger and Louise continued to live there until their deaths, Roger’s in 1990 at age 87 and Louise’s in 2009 at 102.

While Barker used many methods, the part that struck me was his belief that simply documenting in exhaustive detail the ordinary activities throughout the day would somehow provide some additional insight. What would Barker have made of today’s era of personal analytics, data smog, quantified self and beyond?

This week @ Portigal

It’s another busy week here at Portigal as we are aflurry with a webinar, a kickoff, and a retreat:

 

Join me on April 17 for “Championing Contextual Research” webinar

On April 17 I’ll be presenting a UIE webinar about Championing Contextual Research in Your Organization. Sign up here!

To the delight of UX designers everywhere, organizations today increasingly conduct user-centered research methods like surveys, focus groups, and usability testing.

But what can we learn beyond the office environment? Isn’t user observation among the most powerful UX design research techniques we can do?

Yes! So Steve Portigal will describe the techniques, processes, and discussion points you can use to make it happen in your organization. And once you find out how to quell cultural or budgetary resistance to fieldwork, then you can create more analytical designs that make users jump for joy.

You’ll gain user insight before you need it.

  • Identify opportunities to learn about users
  • Conduct specialized interviews beyond just “talking to people”

Advocate for the adoption of contextual research

You’ll become a change agent in your organization.

  • Understand how markets and processes relate to one another
  • Discuss benefits and drawbacks for both stakeholders and users

Maximize the organizational impact of any research you do

You’ll start to establish research agendas from the get-go.

  • Integrate synthesis and analysis in any approved project
  • Create research outputs that are relevant to your stakeholders

Engage the rest of the organization in contextual research

You’ll make your process and outputs more visible.

  • Tackle entrenched belief structures with hands-on techniques
  • Involve teams in identifying patterns and themes

Please sign up here. If you can’t make the scheduled time, you can also get a recording of the event.

Some relevant articles I’ve seen lately that might relate to this topic are
How to tell managers they’re wrong about UX research and Organizational Challenges for UX Professionals

Reading Ahead: Research Findings

Reading ahead logo with space above

(Updated to include slideshow with synchronized audio track)

We’re very excited today to be posting our findings from the Reading Ahead research project.

Lots more in the deck below, but here’s the executive summary

  • Books are more than just pages with words and pictures; they are imbued with personal history, future aspirations, and signifiers of identity
  • The unabridged reading experience includes crucial events that take place before and after the elemental moments of eyes-looking-at-words
  • Digital reading privileges access to content while neglecting other essential aspects of this complete reading experience
  • There are opportunities to enhance digital reading by replicating, referencing, and replacing social (and other) aspects of traditional book reading

We sat down yesterday in the office and recorded ourselves delivering these findings, very much the way we would deliver them to one of our clients.

Usually, we deliver findings like these to a client team in a half day session, and there’s lots of dialogue, but we tried to keep it brief here to help you get through it. (The presentation lasts an hour and twenty minutes.)

It’s been a great project, and we’ve really appreciated hearing from people along the way. We welcome further comments and questions, and look forward to continuing the dialogue around this work.


Audio

Reading Ahead: Building models

Reading ahead logo with space above

We’ve been hard at work synthesizing the Reading Ahead data. There’s a great deal of writing involved in communicating the results, and sometimes it makes sense to develop a visual model that represents a key idea.

Here are several partial models evolving through paper and whiteboard sketches, and finally into digital form.

We’ll be finishing synthesis soon, and publishing our findings on Slideshare, with an audio commentary.

Stay tuned…

Portigal-Consulting_synth5

Portigal-Consulting_synth4

models

Reading Ahead: Managing recruiting

Reading ahead logo with space above

There’s always something new in every project. Often we encounter a bit of process that we may not know how to best manage it. So we’ll make our best plan and see what happens. We learn as we go and ultimately have a better way for dealing with it next time.

In a regular client project, we write a screener and work with a recruiting company who finds potential research participants, screens them, and schedules them. Every day they email us an updated spreadsheet (or as they call it “grid”) with responses to screener questions, scheduled times, locations, and contact info. It still ends up requiring a significant amount of project management effort on our end, because questions will arise, schedules will shift, people will cancel, client travel must be arranged, etc. etc.

For Reading Ahead, we did all of the recruiting ourselves. Although we’ve done this before, this may be the first time since the rise of social media: we put the word out on LinkedIn, Twitter, Facebook, email to friends, and here on All This ChittahChattah.

While Dan lead the effort, we both used our own networks, and so we got responses in a number of channels, sent to either or both of us, including:

  • @ replies on Twitter
  • direct messages on Twitter
  • Comments on Facebook posts
  • Messages on Facebook
  • Emails (directly to either of us, or forwarded from friends, and friends-of-friends

facebook
A private dialog on Facebook

facebook2
Comments on a Facebook status update. Note that Dan is able to jump in and make contact directly

twitter
Direct Messages in Twitter

Some people were potential participants, some were referrers to other potential participants, and some were both. And given the range of platforms we were using, with their associated restrictions (and unclear social protocols), we had to scramble to figure out who could and should communicate with who to follow up and get to the point where we could see if the people in question were right for the study. We didn’t expect this to happen, and eventually Dan’s inbox and/or his Word document were no longer efficient, and as some participants were scheduled or in negotiation to be scheduled, he ended up with this schedule cum worksheet:

schedule

Being split across the two of us and these different media, eventually we were interacting with people for whom we had to check our notes to trace back how we had connected to them, which was great for our sample, since it meant we weren’t seeing a group of people we already knew.

It was further complicated when we had finished our fieldwork and wanted to go back to everyone who offered help close the loop with them, thanking them for help. Technically, and protocol-wise, it took some work (who are the people we need to follow up with? Who follows up with them? What media do they use), basically going through each instance one-by one.

twitter2

We haven’t figured out what we’ll do next time; we won’t forget the challenges we’ve had but there’s just not time or need right now to plan for the future. If I had to guess, I’d imagine a Google Spreadsheet that includes where we got people from, who owns the contact, whether they are participant-candidate or referrer, etc.). Despite being very pessimistic about the demands of recruiting, we still underestimated the time and complexity required for this project.

Reading Ahead: Looking for the story

Reading ahead logo with space above

I started today by typing up all of the Post-it notes you saw in our recent blog post on Synthesis.

This activity created a 6-page Word document of bullet points.

The next part of the process is something I always find challenging: taking an incredibly detailed list of observations, particpant statements, hypotheses, and ideas; figuring out what the Big Ideas are (there’s a point in the process where many of them seem Big!), and putting those into a form that tells a cogent story.

First step: make a cup of tea.

Ok, then my next steps were:

  • Categorize all those bullet points
  • Synthesize those categories a bit further
  • Write down in as short a paragraph as possible what I would tell someone who asked me, “what did you find out?”

Then I went into PowerPoint, which is what we use when we present findings to our clients. I’ll continue bouncing back and forth between Word and PowerPoint; each piece of software supports a different way of thinking and writing.

I dropped my synthesized categories into a presentation file, sifted all of the bullet points from my Word doc into the new categories, and then started carving and shaping it all so that it started to follow the paragraph I had written. (I’m mixing cooking and sculpting metaphors here.)

I printed out the presentation draft, and laid it out so I could see the whole thing at once.

Portigal-Consulting_synth10

Steve came back from a meeting and I asked him to read over what I’d printed out. He started writing notes on my printouts, pulling out what he saw as the biggest of the Big Ideas.

Portigal-Consulting_synth11

We talked about what he’d written, which led to an energetic discussion in which we really started to breathe life into this. Tomorrow, I’ll start the day by iterating the presentation draft based on our conversation.

Reading Ahead: Analysis and Synthesis

Reading ahead logo with space above

Synthesizing field data into well-articulated, data-driven patterns, themes, and opportunities is a big part of our work, but it’s an aspect that generally has less visibility than the fieldwork.

An essential early step in the synthesis process involves going back over the fieldwork sessions. An hour or two-hour interview creates an incredible amount of information. By going back into a record of the interview, we make sure not to leave anything significant behind.

We go through and make notes on interview transcripts (done by an outside service), watch videos of the sessions, and look over photographs, sketches, maps, and participatory design pieces.

Portigal-Consulting_synth3w
Annotated interview transcript

We made a bulletin board of the people we met, so they’re ever-present while we’re working.

Portigal-Consulting_synth1

Yesterday we came together to share the points we’d each pulled out. We present each interview, like a case study, to the team. Sometimes it’s just us, and sometimes our clients join us for part of this process.

Portigal-Consulting_synth2w

While one of us presented, the other captured the essence onto Post-its. We had a lot of discussion and debate while we did this, pulling together multiple viewpoints.

Portigal-Consulting_synth5w

When we were done presenting the interviews, the board looked like this:

Portigal-Consulting_synth4w

Our next step is to take these notes and start grouping them. We’ll look at different ways the information can be organized, and from there, will start refining our work and writing it up clearly and succinctly into a report.

Reading Ahead: Photo Diaries

Reading ahead logo with space above

In addition to our in-person fieldwork, we often ask research participants to do some kind of task on their own. In past projects, these assignments have included a range of activities, from workbooks and journals with specific daily prompts, to fairly open-ended photo diaries.

For Reading Ahead, we asked people to do a short photo diary, and send us five or so digital pictures (before the interview session) that would help us get a sense of how reading fits into their lives.

Diaries like this accomplish several things. They give us access to a person’s world beyond what we might be able to get in just a face-to-face meeting. We’re able to see what they do in more locations, at more different times, and in more situations.

We probably won’t be there to see someone actually reading in bed before they go to sleep at night, but they might well ask a family member to take a picture of it for their photo diary, as Tracy did for this project.

Portigal-Consulting_diary1

Diaries also help us build rapport more quickly with the people we’re meeting, by giving us a common set of stories to begin the conversation with. There’s often a bit of back and forth dialogue between us and the participants during the assignment as well, which helps us establish a relationship.

Having some shared knowledge and possibly interaction prior to the interview means that when we are face-to-face, we can jump right in with that person at a deeper level, which can free up time in the interview session for exploring more areas of the research topic.

When you look at the pictures people sent us for this project, you’ll see that they’ve responded in a variety of ways. Some focused on objects, some took pictures of other people, and some photographed themselves or had other people photograph them. It’s useful to see the different ways people interpret the topic area, and the connections they draw. It helps us understand how each person sees the world, and can point us to additional lines of inquiry.

Below are the photo diaries for Reading Ahead.

Erica

Peter

Tracy

Julie

Series

About Steve