Posts tagged “fieldwork”

Lisa’s War Story: When Rapport Goes Too Far

Lisa Aronson Fitch, a qualitative customer researcher who works in product development, struggles with balancing her personal boundaries with the need to connect with her participant.

While working at a product development consultancy several years ago, I went to Southern California to conduct a series of in-home interviews for a consumer product client. As we all know, it is essential for researchers to develop a rapport with the participants immediately so they feel comfortable having you in their home and opening up about their lives, behaviors, and interests. In one particular interview, a degree of rapport, however questionable, developed quickly.

As soon as the door opened, a five-year-old boy appeared in blue footsie pajamas, asking if he can give me and my colleague kisses. My colleague and I exchanged a quick glance because in the car not minutes before, he mentioned that he isn’t very fond of kids (if I recall, he didn’t say it that nicely). What should we have done? This little boy was waiting with puckered lips. If we said no or that we were uncomfortable letting him kiss us, we risked alienating the mother who was standing there with a smile; if we said yes, we would feel uncomfortable knowing this kid is about to do the exact opposite of what a child should do when meeting a stranger. (Didn’t this parent ever hear of “stranger danger?”) We hadn’t even put our bags down yet and introduced ourselves! To make matters worse, as I started to slowly (very slowly) bend down towards the little boy, his mother says “Remember son, not on the lips!” Needless to say, I was completely confused and disturbed as to why this was all happening. After I received my kiss on the cheek, it was my colleague’s turn. The little footsies-clad kid was then sent to bed and we began the interview with his parents.

While our conversation focused on kitchen routines, my colleague and I struggled with the idea that these parents encouraged their son to kiss strangers. We began to even feel violated as the little boy came running out of his bed six more times through the two-hour interview to give us more kisses. Didn’t he care to ask if I was seeing someone at the time? Following the ordeal, I mean interview, my colleague and I discussed the idea of “when rapport goes too far.” What should a researcher do in this situation? Should we accept kisses from a strange child in the name of developing rapport for a research interview? Should we have suggested to the parents that they teach their child a much different lesson about strangers? Having grown up around New York City, I’ve become properly paranoid about dealing with strangers so the idea of teaching my child it is alright to kiss strangers made me twitch.

Kelly’s War Story: Pictures are language independent

Here’s Kelly Braun, Senior Director, User Insights and Analytics at Walmart.com with a story about shooting fieldwork video and inadvertently getting the money shot.

At eBay we did a lot of field visits. We were always over-prepared with checklists, allergy meds, extra batteries, and everything else we could think of for the unexpected.

For this particular study we were interviewing people who had bought large equipment on eBay. This visit was to a store that had purchased a giant Xerox machine that had been used by big corporations. This video store specialized in Chinese language videos.

I perused the movies as we got set up. Some were American movies that I recognized by the pictures even though the titles were in Chinese. Others were films made specifically for the Chinese-speaking audience.

We interviewed the owner and he told us about the amazing deal he got on the machine and when we asked if we could see it he said “Sure, it’s in the back.” No problem, we had extension cords for the video camera.

I took the camera off the tripod and followed the store owner and my co-researcher into the tiny back office. I couldn’t really get a good shot of the Xerox machine from the door so I went inside and around the machine to get a better angle. At this point the owner says “Oh, I forgot. This is where the porn videos are…but don’t worry – they are all in Chinese”.

I look up and the side of the room I was now facing with my video camera rolling was filled with porn – all with Chinese titles, but let’s just say it really didn’t matter that the titles were in Chinese because…well, a picture is worth a thousand words regardless of the language!

My co-researcher just soldiered on asking questions and all I could think of was “Wow am I supposed to film this guy with all the frolicking nakedness on the video covers behind him?”

Lesson learned: Make sure you know how to override the auto-focus on your camera!

Leo’s War Story: No, We Really Meant the User

Product Design Manager Leo Frishberg underscores the effort required to ensure you’re seeing the right user in the right context.

Our team was embarking on an ambitious, multi-country Contextual Inquiry effort. We had created our sample cells, identified the right industries, established a great relationship with our sales team and done All The Right Things Up Front to make the effort a success.

Working from Oregon with prospective participants in Bangalore is never an easy prospect; introducing a new research technique at the same time raised the stakes.

Several weeks in advance of the interviews we had contacted our sales team in-country explaining the process: we needed individuals who were currently working with our equipment and willing let us observe them working in their labs, in situ.

Everyone claimed to understand. We arrived in-country and I confirmed the arrangements, on the telephone, with the sales team. “Yes,” they confirmed, “we’ve found exactly who you are looking for…”

We arrived at our first interview in a gorgeous sparkling new office building and were led to an upstairs glass-enclosed conference room. Presently, a manager-type entered, clearly expecting to hold court with us.

I began the discussion with a recap of our expectations and a quick sanity check with the individual.

“So,” I began, “we are looking forward to working with an actual user in the lab. Are you going to work with us today?”

“No,” he said, dismissively. “I’m the team manager. I can tell you everything that’s wrong with your equipment. I’ve polled the team and have collected answers from all of them.”

It’s at times like this, having flown 10,000 miles, having spent as much time as I had setting things up, that I lose a part of my conscious brain. I could feel the anger rising, but I knew that couldn’t help improve the situation.

Instead, I signaled to the sales guy sitting next to me that as far as I was concerned, the interview was over and we could pack up to go to our next meeting. Here’s where the details get sketchy, but I know he said something, in English, to the manager, and whatever magic words he uttered, the manager smiled and nodded, suggesting he could definitely get the lead engineer to help us. He left to find the guy.

A few minutes later, the engineer entered the room, curious as to what the group was doing there. We began the front part of the interview, and it was clear he was the right guy. After explaining what we were planning to do, we asked if he had any questions or needed any further explanation.

‘No,” he said, “you want to see me work with the equipment. I don’t have anything to do today, but I could show you what I was doing last week.”

That was fine, we agreed.

“Okay. Just give me a few minutes and I’ll bring you back…”

Imagining what he might be doing in those few minutes I stopped him. “Uhhh, what would you be doing between now and then?”

“Oh,” he assured us, “I’m just going to get the equipment all set up.”

“Great!” We practically shouted. “That would be great! We’d be happy to watch you do that!”

He smiled as if hoping we had taken our medication and led us to his lab. “I’m not sure what you’ll find so interesting about my pulling the machines off the shelf, but come on along…”

The take-aways remain the same:

  • Persistence and staying on track no matter what the situation throws you
  • No matter how much you prepare, nothing will go as planned
online pharmacy buy gabapentin online cheap pharmacy

Our latest article: Never Eat Anything Raw


Our latest interactions column (written by Steve Portigal and Julie Norvaisas) Never Eat Anything Raw: Fieldwork Lessons from the Pros has just been published.

Interviewing is based on asking questions. As children we all learned to ask questions (perhaps more than the adults around us were ready for!), but it takes work to become a skilled interviewer-the kind of interviewer with whom a natural exchange is almost inevitable and for whom asking questions is as effortless as Roger Federer’s forehand. Great interviewers are made, not born. We’ve had the ongoing opportunity to think even more about the experiences that have shaped us as interviewers. Of course, as researchers we are compelled to look outside ourselves, so we asked some people we admire to tell us about how they improve their interviewing skills. We have synthesized our findings into four key areas: practice, reflect,
critique, and exchange.

Get the PDF here, and check out (and add to) the fieldwork War Stories here.

Previous articles also available:

Tom’s War Story: Go with the flow

Tom Williams, Principal of Point Forward is confronted with his own health concerns, and with some unexpected practices for managing bureaucracy.

Our ethnography research team visited a small neighborhood health clinic in Beijing to study its workflow. It was 2009 and concern over H1N1 swine flu was at its peak. There was a special flu screening at the airport and yet the folks at the clinic seemed concerned that we, as Americans, might be seen as potential carriers of the virus that was causing near-panic at the time. To make matters worse, I had awoken that morning with a scratchy throat. It was just a reaction to the hazy air quality in Beijing but still, it would be very bad to be coughing in this situation so in the taxi on the way to the clinic I stuffed multiple cough drops into my mouth.



The Health Services clinic in Beijing where ethnographic research was conducted. Inside, a dispenser for free contraceptives.

Doing field research in China is always a little bit surreal for me, an American. The cultural differences are pretty subtle on paper but can be stark in person. They reveal themselves in that weird way that cultural differences do; unexpected little variations in design, procedures, or personal manners. In this setting in particular, lots of little things stood out when first walking into the clinic: the scale to weigh patients was in the waiting area, not near the exam rooms. Next to the scale was somebody’s bicycle and a broom was propped in the corner. The waiting room chairs were plastic, not upholstered and there was a vending machine offering free contraception. There were brochures but no magazines.



The clinic’s waiting area.

“How long have you been here in China?” the nurse manager asked us through an interpreter. “Three days,” I replied, willing myself not to cough. “Well, we occasionally get unannounced spot-checks by government health officials and, because of the swine flu, if they show up while you’re here doing research we’ll need you to say you arrived in China two weeks ago, not three days ago.” Huh? Wha? Lie to Chinese government officials? Is that in my job description? I’ve seen way too many prison movies to be comfortable with this. Plus, isn’t my time in the country a pretty easy thing to check on by just – oh, I don’t know – looking at the stamp in my passport? And the request was made in such a matter-of-fact, this-is-no-big-deal way that we weren’t exactly given a chance to voice our concerns; it was simply on a list of mundane procedures for the day: “the bathrooms are down the hall, you’re scheduled to interview two nurses, then two doctors, then you’ll do an hour of straight observation, then we’re gonna have you lie to government officials, and by then it’ll be time for lunch.” Ugh! Fidgeting nervously, and imagining what would happen if this were a movie, I glanced around to see if there was a back door for a hasty exit (of course – fleeing from government officials is surely better than lying to them!).

We were taken to a room for our first interview and the oddness continued: we sat in reclining chairs normally used by dialysis patients. They graciously served us tea and watermelon but then placed bucket in the middle of the floor for seeds and rinds. I was wondering what the bucket was normally used for but decided not to ask. We interviewed a very kind and helpful nurse but she kept a surgical mask on her face the whole time.



My colleague Priya mans the video camera near the tea and watermelon while the rest of the team discards seeds and rinds into a bucket.

But then something happened: it was the simple magic of focusing on what I was there to do: field research. I got absorbed in hearing people tell their stories, obsessing about getting good video and good still photos, asking good questions, and listening closely. I enjoyed the watermelon and stopped worrying about how weird it felt to be spitting watermelon seeds into a bucket during an interview. By letting myself go with the flow, I actually forgot about my scratchy throat and even forgot about the possibility of being confronted about the date I arrived in China.

The interviews and observations went very well and for all my initial impressions of differences, we noticed many similar workflow patterns to clinics we had studied in the U.S. and Europe. In the end, there was no surprise visit by health inspectors. After feeling uncomfortable as an outsider at the beginning, by simply sticking to the process and not pushing against prevailing cultural norms, I now felt at ease. We truly bonded with the clinic staff and developed a very solid understanding of their process. We said our goodbyes, left the clinic, and walked to a nearby Buddhist vegetarian place for lunch. When we stepped into the crowded restaurant, all the customers turned in unison to look at the foreigners. I reached in my pocket for a cough drop and the process started all over again.

Dan’s War Story: Focus, no matter what!

Design researcher Dan Soltzberg has a brave and touching story about the best of intentions – and their consequences.

I was doing fieldwork for a project on at-home computer use, and a client and I were at “Richie’s” house–a double-wide in a Mid-Peninsula mobile home park. Richie’s small-to-begin-with mobile home was filled with heavy wooden furniture, boxes of paperwork, and old pieces of technology, making it feel even smaller. We were sitting at the kitchen table, and Richie was saying that he liked to lie on the couch and work on his laptop, so I asked him if we could go into the living room so he could show us.

We re-situated in the living room, and when Richie started opening up emotionally about how meaningful his work was to him, I got down on one knee next to the couch so that I would be on eye level with him, rather than standing over him. As Richie was talking I was totally focused on listening to him and guiding the conversation forward, but in the back of my mind – somewhere really far in the background – I was aware of a strange cold feeling in my leg.

In addition to leading the interview, I was also manning the video camera and shooting stills, so I wasn’t able to give this strange feeling much bandwidth. When we finished our conversation and I stood up, I saw that there was a wet spot on my khaki pants. A wet spot that covered the area from the middle of my shin to above my knee. A massive wet spot.

I hadn’t figured out yet what it was, but I knew I’d kneeled in something liquid that was lurking in Richie’s carpet. One of the cardinal rules is, I don’t make research participants feel bad, and I figured if Richie saw that this had happened, he could only feel bad. So I followed him back into the kitchen, conducted the rest of the interview, paid and thanked him, and left, all the while keeping my wet-spotted leg as much out of Richie’s sight line as possible. As far as I know, he had no idea I’d been befouled.

The day’s next interview was scheduled tightly, and there was little time to take stock of things. I thought about doing a quick pant leg wash in a gas station bathroom, but made a judgement call that showing up at the second interview with a soaking wet pant leg would be worse than whatever was already starting to dry, so I decided to let it be. As I drove, my leg continued to dry, and it became apparent from the emerging smell that the mystery liquid was cat pee.

The 10-inch wet spot dried to a hard, shiny, stinky consistency as I pulled up to our next interview. The woman we were interviewing had a house that was neat as a pin, and let’s say she was not the an easygoing type of person. I sat as far across the living room as I could, but I could only imagine during the whole interview that she could smell my ripening leg. Let’s hope not. Nothing to do but keep calm, and carry on.

This Week @ Portigal

Here’s what’s going on with us!

online pharmacy phenergan no prescription

This Week @ Portigal

It’s sunburn weather this week (well, today at least), perfect for zipping from place to place, which is indeed what we are doing

  • It’s a busy fieldwork week, as we are going into the homes of (mostly young, mostly male) gamers to see what they’re doing and get their reactions to a prototype.
  • No sooner do we finish fieldwork than our clients come to our office at the end of this week to help untangle the data and identify the key takeaways
  • I’m putting the final details together my sold-out workshop (as well as a short talk) for User Experience Lisbon next week.
  • We’ve launched a new series devoted to fieldwork War Stories.
  • What we’re consuming: Frittle, Aguirre, the Wrath of God, scopa (the game), Scopa (the restaurant).

This Week @ Portigal

It’s a gorgeous sunny Monday here in Pacifica (stay away fog, stay away!) and we’re on our way into another interesting week.

  • Later this week we’re taking our clients and their prototype out into the field to meet users. We’re also exploring how people are using a brand new product, something no one on our client team has any idea about, so we’re expecting a very cool experience. Meanwhile, Tamara is printing out materials, putting incentives in envelopes, charging batteries, picking meetup and debrief locations and other organizing the hell out of the whole process.
  • We’ll be launching a new feature here devoted to war stories from field work.
  • Steve gets his revising on, hopefully wrapping up the next iteration of the book manuscript.
  • We’ve put away all the leftover snacks from our event last week and Tamara will be posting some of the highlights (of the discussion, not necessarily the snacks).
  • Out and about: Look for us at the inauguration of the new Orange Silicon Valley office, at SF Service Design Drinks, or the Tangible UX Happy Hour.
  • Steve will be heading over to Mozilla to speak with UX researchers and designers about how to synthesize user research data.
  • We’ll be making at least one announcement about an upcoming conference presentation, and in a wonderful location!
  • While it’s not quite American Idol level of tension and suspense, we’ll be chatting with more people this week about collaborating with and even joining our team.
  • What we’re consuming: Roadie, head rubs, margaritas.

This Week @ Portigal

Together again…

We are all back in the office this week (starting tomorrow).

  • Steve returns today from an enlightening and exhausting experience at Interaction 12 in Dublin. I can’t wait to hear about the Student Design challenge results and every other amazing detail. In the meantime, I am happily consuming the pictures he took in Dublin.
  • Julie and Tamara are back from an inspiring week of fieldwork in LA. We will be busy downloading, uploading, unpacking, repacking, refreshing, etc. as we prepare for round two of fieldwork in NYC next week.
  • Steve is meeting with another studio this week to explore combining forces for a new client opportunity.
  • Tamara continues to search for visual thinking tools and inspiration- focusing this week on reviewing a presentation from Interaction 12 by Jason Mesut and Sam ‘Pub’ Smith about sketching interfaces.
  • Julie is rocking her project management super heroine powers on another project we have kicked off and will be working on this month.
  • Tamara was lamenting the lack of actual dance moves by Madonna during yesterday’s Super Bowl half time show until I revisited her first music video for the song Everybody. Now I’m just thinking the more things change, the more they stay the same.

Here’s to the future. And the past.

Have a great week!

 

 

Series

About Steve