Posts tagged “user research”

Emily’s War Story: Getting To The Point

Emily Mayfield (Twitter, LinkedIn) is a User Experience Researcher at The Kroger Co. in Cincinnati, OH.

Before my current job, I spent six months in Bangalore, India, doing research for a lab that was part of a design school in the northern part of the city. I did not drive while I was in India – I took public transportation and little “autos,” which resemble a golf cart in terms of size and a lawnmower in terms of sound. At that time Uber was barred from India. The driving style in Bangalore struck me as very different from the States: sometimes the traffic lights/stop signs are ignored, sometimes drivers go well beyond oncoming traffic lanes, sometimes when a freeway exit is missed drivers throw their cars into reverse on the freeway. I saw enough daily to get my heart pumping.

I was doing research to understand what the notion of “smart city” might mean in India? As part of the research, I made cold calls to different innovation centers and companies, setting up expert interviews that would inform the research. I learned a lot about how companies had explored the concept of “smartness” in cities. In retrospect, the interview part was easy. Finding the location of the interviews was the challenge.

I had a smart phone. I had a camera. I took photos of the locations on Google maps on my computer or on my phone in case the connection on my phone was lost or hiccuping. One time, I got on the bus headed south and rode it two hours deep into the city to a neighborhood I was unfamiliar with. I hopped off when it seemed like I was close to where I needed to be. There was a queue of auto drivers at the bus stop. I showed my phone and camera screens, with their neat pin-point of my destination on the digital map, to the first driver in the queue. I showed him the address: a building number and street name. The driver waved me in. “No problem!” I thought to myself. I smiled and held on tight to my bag and the rail of the auto. We were off! Turning and bending through little streets and big ones, weaving in between cars and buses. We flew past people crossing the street, animals doing the same, and carts selling food and tea. We drove and drove and drove some more. Minutes led to double-digits. The driver was flying…in what felt like circles. Checking the time, I thought “Oh boy…”

Eventually the driver pulled over to ask other auto drivers for help finding the location. Local folks came to help. A cop or some kind of military person joined in the effort. The mass of people tried to help, pointing around like the scarecrow from the Wizard of Oz guessing all directions to try next. They discussed, pointed, checked and double-checked the address and the maps. At last I got a solid idea: I called my interviewee and he chatted with the driver. We met in a place that the driver could find and then I walked with the interviewee to the building together.

Afterwards, a colleague let me know that the European conventions of maps as we know them don’t make sense to some people in India who have never seen a map in that form. Also, Bangalore is constantly changing, adding streets and changing names of streets. Later on I learned that landmarks are the way to go, as well as calling people sooner rather than later. Still, the worst case scenario was handing my phone to friendly-looking strangers to communicate with a driver when I’m really lost and it worked. A quick shout out to the kind and patient people of Bangalore: Thank you for your constant help getting me to and fro!

Side note: It’s possible my geographical difficulty is just a me thing. More than once I’ve gone to conduct research at the wrong Kroger store on the same street here in Cincinnati!

Krispian’s War Story: If Texas and England Had a Baby

Krispian Emert has over 12 years experience working in UX. She has worked all over the world: for startups, agencies, and companies like Microsoft, The NFL, Thompson Reuters, ING, etc. Currently, she is lead UX Researcher at TELUS digital. She told this story live at Radical Research Summit.

It was my first field study at my new job in Sydney, Australia. I had just uprooted my family and flown to the other side of the world to work for Australia’s largest user experience consultancy. Did I want to do a good job? You bet. Was I nervous? Hell, yes!

I had had a couple of weeks to settle in and explore the city, and to get to know my colleagues. My impression of Australian culture was that it was surprisingly similar to Canadian culture: We both have the Queen on our money, we both drink copious amounts of beer, and we both say “no worries” a lot. The only glaring difference I was able discern up to that point was that for a casual greeting Canadians asked “How’s it going?” and Australians asked, “How’re you going?” So I had experienced little culture shock thus far.

The assignment was for one of the big banks. We were to conduct contextual field studies in the moment while people used the bank’s ATMs. The only problem was that due to privacy constraints we had to recruit people just as they were about to use the ATM. This was made more challenging because the bank gave us very little in the way of official ID.

This meant that I, an extra polite Canadian, was nervously approaching busy Australians and anxiously stammering the first few sentences of my recruitment spiel. To say that I got turned down by my prospective interviewees is an understatement. The fact that I didn’t look “official” or in any way affiliated with the bank made me seem suspect at best, and criminal at worst. ATM users glared at me as though I were panhandling, and time after time, I was told to “Fuck off!”. I was worried that I wouldn’t complete the assignment. I needed 10 participants and after two hours I had exactly none.

As I stood in the street in Sydney, miles from home, failing to secure participants and on the receiving end of some choice language, I had a “Dorothy moment.” I was not in Canada anymore. Despite my initial impression that our countries were similar, I was in whole new culture – one where people were not afraid to say the F-word to a complete stranger. I realized I had to stop assuming people would stop and politely listen to my lengthy recruitment pitch, and that I had to just accept Australians for what they were – blunt and direct. I changed my approach, and went up to prospective participants boldly, waving my gift cards at them. I shortened my pitch to state only the benefits of participating in the research. This produced much better results.

They say that if Texas and England had a baby, it would be Australia. After this experience, I grew to appreciate the unique Australian culture of “wild west gunslinger meets cricket games and meat pies.”

And despite our differences, I guess we’re pretty similar after all.

A user research reading (listening/watching) list

I’m in Chattanooga today, teaching the students at Center Centre today (and tomorrow) about ethnographic research.

In preparation for the class, they asked me to put together a list of readings, so I pulled together a bunch of links that I’d posted in the last few months, some of them on this blog but mostly on the Portigal LinkedIn page. I’m sharing the list below.

Listen to Steve on the Design Your Thinking podcast

I had a fantastic conversation with Karthik of the Design Your Thinking podcast, posted in two separate episodes.

The first episode is Problem Space vs. Solution Space

Listen at that link, or here, or embedded below

The second episode is Master The Art Of Listening

Listen at that link, or here, or embedded below

What’s New: Doorbells, Danger, and Dead Batteries

doorbells-danger-dead-batteries-cover
My new book comes out today and Lou Rosenfeld has an enthusiastic appreciation and a bit of the back story about the book’s journey.
Read it all here

I dipped into about a dozen of the 60+ field research war stories that make up the bulk of the book. The stories do what stories are supposed to do: engage. And the contributors have been through some experiences that will make you laugh, sweat with fear and discomfort, and—let’s face it—enjoy a bit of schadenfreude. But it’s wrong to see Steve’s new book simply as a compilation of user research war stories. In Doorbells, Danger, and Dead Batteries, Steve comes through: he delivers a broader framework that’s useful for making sense of user research—or, actually, situations with people.

A User Research FAQ

In Patterns in design research, Nick Bowmast looks at one of my recent talks and realizes that the Q&A discussion deals with many of the standard questions he often faces. He wrote up a tersely-worded FAQ based on the discussion. Thanks, Nick!

Q: One on one’s or Groups? A = One on ones. (Don’t say the other F word).
Q: How do you know when you’ve done enough interviews? A = Depends, but 30 is a big number.
Q: How do you avoid bias from the client or in the sample? A = Accept and work with it.
Q: When should we do it ourselves vs have other people’s go out and do the interviews for us? A = Depends, and collaboration can work in many ways. [Also see this – SP]
Q: How do you prioritize all the questions to be able to answer all of them right? A = Work with the client to nail it down.
Q: What would be the right team size in the field? A = Two
Q: Can you use something like Skype or Google Hangouts to interview them? A = Yes, but there are significant tradeoffs.
Q: How to deal with users who just keep on talking in an interview? A = Be polite but firm. Cut your losses if necessary.
Q: How do you go about recruiting people / how do you convince strangers to do interviews? A = Use a recruiter. Respect and honour people’s time.

My talk about “How to Interview Users to Uncover Insights”

I recently spoke about How to Interview Users to Uncover Insights the Lean Product Meetup in Silicon Valley. They’ve just posted the video and I’ve embedded it and the slides below.

Steve Portigal on How to Interview Users to Uncover Insights at Lean Product Meetup

It’s a wrap for Dollars to Donuts, Season 2

I just wrapped up the second season of Dollars to Donuts, the podcast where I speak with people who lead user research. Check out all the great interviews this season. Links include transcripts and links for each episode.

An interview about The State of UX Research

I was interviewed by Jen Ignacz of Topp. We spoke about the history of user research (at least how I experienced) and some of my thoughts about the present – and future. Check out the audio and/or read the transcript here.

I remember that we did this project with IBM that was very much like the future of the home PC, so for us that was really, really new and exciting. Maybe a lot of people might be rolling their eyes like yes, we’ve seen that we’ve done that, so that was this watershed moment where we were able to do a sort of an industrial design type of project, but it led with ethnography – it led with rethinking the whole purpose of this thing they were making. And right after that we got approached by a packaged goods companies that wanted to rethink breakfast, and that was the exciting part because their innovation part of the business was getting clients that didn’t look like industrial design clients. It was someone else coming through the door, and that was the moment where I think we thought “this is a real thing” – you know, companies – business is looking into this and we can work on all kinds of stuff. I think that was a huge moment. Fortune, BusinessWeek and other magazines were writing cover stories about ethnography or anthropology, and showing pictures of people in pith helmets or scientists or similar. The conversation turned a lot more serious and specific about how this kind of work was going to help business. I think the work we were getting and we were doing, and this kind of popular press shift, we started to feel like oh, this really is a viable thing for business, a viable service to be offering. We will see products made this way from here on out, so that was kind of the transition.

The Insight at Scale track from Enterprise UX

A couple of months ago I moderated the “Insight at Scale” track at the Enterprise UX conference, which featured three presentations and discussion. The videos for each presentation (and our discussion) are linked to below as well as links to the slide decks. There’s also sketch notes for the whole session.

Video
Insight Types That Influence Enterprise Decision Makers – Christian Rohrer, Vice President and Chief Design Officer, Intel Security (slides)

Video
Data Science and Design: A Tale of Two Tribes – Chris Chapo, Operations at ENJOY (slides)

Video
Emotion Economy: Ethnography as Corporate Strategy – Kelly Goto, author of Web Redesign 2.0 (slides)

Video
Discussion

An inflection point for user research: scandal

A user researcher is front and center in a Silicon Valley competitor-workers legal snarl.

One now-former employee, Ana Rosario, was hired by Fitbit as a user experience researcher around April 16 but did not disclose that she planned to leave Jawbone until April 22, the complaint said. On April 20, according to the complaint, Ms. Rosario held a meeting with Jawbone’s senior director of product management to discuss the company’s future plans and then downloaded what the company said was a “playbook” outlining its future products.During her exit interviews, Ms. Rosario initially denied taking confidential information, but she later acknowledged downloading its “Market Trends & Opportunities” presentation, the complaint said.

I don’t know Ana (although LinkedIn shows me I know many people who do know her); I do know people at Jawbone (and probably people at Fitbit). I’m not sharing this to comment on any of the players or the details of the situation itself, but to note at a meta-level that in the trajectory of user research as a business function, it’s grown in prominence to the point where you can pick up the New York Times one morning and see a story like this.

Steve’s War Story: Giggling and Grunting

I originally posted this in 2006, and revised it slightly for Interviewing Users. I thought it was time to add it to the War Stories archive and so here’s the original version.

As we rang the doorbell, my colleague and I unconsciously straightened, preparing ourselves for that all-important first impression, that moment when our research participant would come to the door and size us up. We waited for a moment, looking at each other as we heard footsteps, mustering a smile as the inside door opened.
“Hello,” I offered, “Are you Brian?”

As I began to state the obvious, that we were here for the interview, he grunted, opened the screen door, and as we took hold, he turned around and walked back into the house. We glanced at each other, and stepped into the foyer. What did we know about Brian? Our recruiting screener told us he was 22, lived with his parents, and his brother, and was employed part-time. The rest would be up to us to discover.

It was 7:30 in the morning and we were taking our shoes off in a strange house. Eventually someone beckoned from the kitchen, and we came in. But already we were out of sync. The kitchen was small, with an L-shaped counter, and a small table for dining. The mother was at the end of the L, working with bowls and dishes and burners on the stove. The father was perched against the counter, while Brian, and his younger brother sat at the table. The father was a small man, while the other three were quite large. The room wasn’t intended for the six of us, so we managed to set ourselves up for our interview in the only place we could; at the far end of the counter, at the far end of the table. We wedged ourselves (one behind the other) on small chairs, pulling our knees in, our paraphernalia of notepads, documents, video cameras, tapes, batteries etc. clutched in close. It wasn’t ideal, but we hoped we could make it work.

But then the real challenge became clear – although Brian had agreed for us to meet and do this interview, he was actively disinterested. We were positioned 45 degrees behind him, in his blind spot. With his physical bulk, he managed to loom over his food in a way that eliminated even any peripheral eye contact; somehow this was something a smaller person couldn’t have done. His brother sat across from him, echoing his posture.

We had recruited Brian specifically, but of course, here we were with the entire family. We pressed ahead, explaining our study, and starting in with our planned questions. Since Brian was the person with whom we had the arrangement, we focused our attention on him. He would not respond, beyond one word answers (which sounded more like grunts), and the occasional glance up to his brother, causing them both to giggle.

My colleague and I avoided looking at each other (it may have not been physically possible, given the tight quarters) for fear of displaying our despair at the situation. Sure, we had arranged this interview, but the cues we were receiving were making it clear the arrangement wasn’t worth much. At this point, we had already woke up quite early to do this interview, so there was no point in giving up. If they changed their mind explicitly, they’d let us know, and we’d leave. Meanwhile, what else was there to do but press on? I asked questions, with very little response. I tried the brother, at which point Brian bolted out of the room for a few minutes, without a word. The brother was only slightly more amenable than Brian, mostly interested in making critical comments about his parents (to Brian’s great grunting enjoyment) as much as provide any actual information.

Indeed, the mother and father seemed not to have been warned that we would be coming; although I directed some of the questioning towards the mom, she reacted with pretty serious hostility, informing us (in the context of an answer to a question) that they did not welcome strangers into their house, and (while she was preparing food) highlighted the intimate nature of food preparation as a symbol, and that was even less open to strangers. The message was very clear.

But again, what could we do? Pressing on, until asked to leave, under the explicit agreement we had made, seemed the best approach. We asked our questions, following up on the information they had shared, listening closely, looking for clarification, offering up as much space as we could for them to talk, all in trying to build some flow and dialog. Even though the message was negative, at least the parents were willing to talk to us. And so, the young men faded out of the conversation, and the interview eventually switched over to the parents. Two hours later it turned out that we had completed an excellent interview with them; they each had great stories about our topic area, and revealed a lot of background about their family, about growing up, about their activities, and even their perspectives on what made the United States the country it had become.

Before we left the house, the mother insisted on cooking up some fried bread fresh and hot for us; admonishing us that “no one comes here and doesn’t get food” – reiterating the intimate nature of food she had mentioned at the beginning, but this time as a compliment rather than a shield.

As soon as we left the house, my colleague turned to me and said “I don’t know how you pulled that off; I thought we were done for and would have to leave.” I was very pleased with how the interview turned out, especially because it began at such a low point, but there was little magic to it. I didn’t try to solve the big problem of the complex dynamic we had walked into; I focused (especially at first) on just the next problem; the immediate challenge of what to say next. I was certainly keeping the larger goals in mind of how to cover all the areas we were interested in, but I was focusing my energy as an interviewer on the next thing. And by working at it in small pieces, bit by bit, the dynamic shifted. As interviewers, we had to compartmentalize the social experience of the event – the extreme discomfort and awkwardness of the early part of the interview, and just stick to our jobs. We didn’t handle the situation that differently than any other interview, and it served as a testament to our approach – listening, following up (and showing that we were listening by the way we followed up), building rapport and trust, bit by bit, until there was a great deal of openness and great information.

Years later, it’s obvious that there are better ways to communicate with the participants ahead of time to screen out unwilling participants. For example, the person who is going to be in the field should always speak live to the person they will be visiting before they day of the interview just to get that person-to-person communication started early, so both parties can get a sense of each other and start to feel comfortable (or agree that it’s not a good fit and move on to someone else). But, given the diversity of people, we will always end up interviewing people who are more or less comfortable with the process, and it’s our job to make them comfortable in order to get the information we are interested in. Doing so may make us uncomfortable ourselves, but with practice we must learn to set aside the social dynamics and focus on the question asking and listening that will make the interview a success.

Designing the Problem, my keynote from ISA14 (now with video)

I gave a (remote) presentation, Designing the Problem, at Interaction South America a few weeks ago.

Too often we assume that doing research with users means checking in with them to get feedback on the solution we’ve already outlined. But the biggest value from research is in uncovering the crucial details of the problem that people have; the problem that we should be solving.

As the design practices mature within companies, they need to play an active role in driving the creation of new and innovative solutions to the real unmet needs that people have. In part, driving towards this maturity means looking at one’s own culture and realizing the value of being open-minded and curious, not simply confident. This is a challenge to each of us personally and as leaders within our teams and communities.

We’ve got video, slides, audio and sketch-notes. Enjoy!

The talk is just over 40 minutes and there are two questions (which you can’t hear but which should be obvious enough from my response).


To download the audio Right-Click and Save As… (Windows) or Ctrl-Click (Mac)

Sketchnote by Kat Davis (click for full size)

Kat-Davis-B3KkgEsCcAE2Jjo

Sketchnote by Thiago Esser
10802698_389325447886104_12

Series

About Steve