Posts tagged “interviewing”

Seventeen types of interviewing questions

I’m cited in Developing Your Interviewing Skills, Part I: Preparing for an Interview, with a set of question types. The article suggests those question types are helpful in preparing an interview guide. I think they are also very helpful in the interview itself, as you will often have to probe a number of different ways to get at what you are think is interesting.

Anyway, I’m not sure where the author found that set of questions, but I’ve recently rewritten and restructured them for the book. This seemed like a great opportunity to share them with everyone. I’d love your feedback: What am I missing? Do you disagree? What else would be more helpful for readers?

Questions to gather context and collect details

  • Ask about sequence “Describe a typical workday. What do you do when you first sit down at your station?-Then what do you do next?”
  • Ask about quantity “How many files would you delete when that happens?”
  • Ask for specific examples “What is the last movie that you streamed?” – Compare this to “What movies do you stream?” The specific is easier to answer than the general and becomes a platform for follow up questions.
  • Ask for the complete list “What are all the different apps you have installed on your smartphone?” – This will require a series of follow up questions, e.g., “What else?” because few people will be able to generate an entire list of something with some prompting.
  • Ask about relationships “How do you work with new vendors?” – This general question is especially appropriate when you don’t even know enough to ask a specific question (e.g. in comparison to the earlier example about streaming movies). Better to start general than to be presumptive with a too-specific question.
  • Ask about organizational structure “Who does that department report to?”

Questions to probe on what’s unsaid

  • Ask for clarification “When you refer to “that” you are talking about the newest server, right?”
  • Ask about code words/native language “Why do you call it the ‘Batcave?'”
  • Ask about emotional cues “Why do you laugh when you mention ‘Best Buy?'”
  • Ask why “I’ve tried to get my boss to adopt this format, but she just won’t do it-” “Why do you think she hasn’t?”
  • Probe delicately “You mentioned a difficult situation that changed your usage. Can you tell us what that situation was?”
  • Probe without presuming “Some people have very negative feelings about Twitter, while others don’t. What is your take?” – Rather than the direct “What do you think about Twitter?” or “Do you like Twitter?” this question introduces options that aren’t tied to the interviewer or the interviewee.
  • Explain to an outsider “Let’s say that I’ve just arrived here from another decade, how would you explain to me the difference between smartphones and tablets?”
  • Teach another “If you had to ask your daughter to operate your system, how would you explain it to her?”


Questions that create contrasts in order uncover frameworks and mental models

  • Compare processes “What’s the difference between sending your response by fax, mail or email?”
  • Compare to others “Do the other coaches also do it that way?”
  • Compare across time “How have your family photo activities changed in the past five years? How do you think they will be different give years from now?” – The second question is not intended to capture an accurate prediction. Rather, the question serves to break free from what exists now and envision possibilities that may emerge down the road. Identify the appropriately large time horizon (a year? Five years? Ten years?) that will help people to think beyond incremental change.

This week @ Portigal

Sometimes I get a good feeling… that it’s gonna be a great week here at Portigal.

Here’s what we are looking forward to…

  • After bidding a fond farewell to Etta James last week, this week we will lovingly remember two completed projects with a team debrief + reflection.
  • Tamara and Julie are preparing for fieldwork next week in LA (woot! woot!). Let us know if there is anything particularly fantastic we should try to squeeze in, though we will of course be pretty darn busy.
  • Steve is in the final week of preparation for Interaction 12 in Dublin (another woot! woot!) and getting everything in order for the Student Design Challenge.
  • Steve is writing his book about the Art and Craft of User Research Interviewing and Tamara will be interviewing him about writing. Stay tuned for highlights…
  • Steve continues some interviews for the Omni project. Did you see the recent interview with Molly Wright Steenson?
  • Julie and Tamara will be out and about learning from fellow practitioners this week at a number of sweet gigs around the city including SF Service Design Drinks at Adaptive Path, Creative Mornings at Typekit, and theWhiteboard at SonicRim. Will you be at any of these? If so, please do say “Hi!” We would so love to meet you!
  • Julie is nose deep in details and planning for some fieldwork for the Omni project. More to come on this.
  • Steve is exploring an exciting project opportunity in partnership with another studio. Viva collaboration!
  • Tamara is ready for a creative fuel injection when she chaperones her son’s school field trip to the Children’s Creativity Museum tomorrow. Fun for all ages!

Hope to see you out and about.

Talking to Strangers: Eugenio and Grace

Where I see boundaries, you see opportunities. – Steve, to me

On Monday Steve and I stumbled into a conversation that surfaced this difference between us in how we think about communicating with people. I’ve been reflecting on it all week and considering how it affects my interviewing practice. Mostly I have been paying more attention to how I am thinking during conversations and what kinds of opportunities I am seeing and looking for. Hot on the heels of Steve’s post with tips to improve interviewing skills, I hoped to surface a new point or two.

Yesterday morning I was walking a trail along the ocean. I heard a woman remark to the man next to her, “Well that was very creative of you!” I tried to keep walking, honestly I did. But I love creativity almost as much as I love talking to strangers so I had to backtrack- two loves in one conversation was irresistible! “Excuse me. Hi, I’m so sorry to interrupt you, but I overheard you say something about him being creative and I’m so curious! What creative thing was he doing?” So began my 20-minute interlude with Grace and her husband Eugenio (as Grace explained, “It’s pronounced ay-you-HEN-ee-oh”).

He is an artist, a painter. “I prefer mostly abstract and figurative painting. But you have to find your own voice-You can’t do too much school. I did some school when I was younger, in Mexico City. But if you are in school too long you become a mannerist. It just gets harder to find your own voice and be honest with it.” He told me about Joseph Beuys and Hockney (who Eugenio insists is overrated). We shared our mutual love of making art in and with nature. “You haven’t seen The Crack by Goldsworthy yet? Oh, you have to take your son to see it.”

Grace is the mother of a 43 year-old and retired from some job that required her to sit in front of a computer all day. “I already spent a lot of my life in front of a screen. I don’t want to do that anymore.” They don’t have email addresses and don’t bother with the Internet. They do walk by the ocean everyday, each one carrying a soft ball to squeeze. Grace has a red ball she kept turning in her gloved hands. Eugenio’s is a faded dark turquoise-y blue. “The hands of an artist require dexterity” he told me, fingers flexing. They laughed when I pulled out my iPhone to take notes so I would remember the names, the words, etc. and agreed that I could take their picture for this story but didn’t care to see it.

At some point early in our chat I became aware that I wanted to blog about my encounter with this couple. This awareness immediately transformed my thinking. I found myself struggling to just listen to their words once I started searching for a story I could later write. I prefer listening to, over listening for when I meet new people. It feels more organic, more natural. It also feels hard to stay present when my mind wants to narrate.

Thanks to a conversation with Steve, I got curious about the art of inquiry and how we have different perceptions of conversational openings. Thanks to Eugenio (and my love of talking to strangers) I got curious about the local work of an artist I admire for his love of the ephemeral. People (and conversations with them) are fleeting opportunities to pique curiosity and learn something new. I guess if any tip emerged from this interaction it would simply be to stay curious. And look for learning.

And that’s what art’s about, isn’t it? … It makes you see things in a different way than you would normally. – Andy Goldsworthy

This Week @ Portigal

We all survived Friday the 13th last week and are ready to take on another week that certainly promises to end less ominously…

So, what’s happening this week at Portigal? Quite a bit…

  • We are up to our ears in interesting opportunities that require some creative thinking about participant engagement. Our research gears are turning!
  • Steve and Tamara will be giving a curtain-call presentation of findings from a recent study.
  • We continue to prepare for upcoming fieldwork (New York!! Los Angeles!!) and Julie is going to be busy making some tools to catalyze conversation.
  • Steve presses on with writing for his forthcoming book, synthesizing fabulous interviews with change agents who have driven the adoption of user research and pulling together the great suggestions people contributed to Tips to Improve Your Interviewing Skills (and a request for more!)
  • We are percolating some sweet ideas for primary research in 2012 for the Omni project and plan to share them soon. Stay tuned…
  • Steve continues to plug away on various tasks related to the upcoming Interaction 12 in Dublin.
  • We are all eagerly awaiting the arrival of Wednesday so we can get our geek on at Nerd Nite SF!
  • Steve is meeting with a big Silicon Valley player to explore how we can deliver design research training to their teams.
  • We continue to search for (and find!) cool opportunities for learning, teaching, and sharing. Julie and Tamara are currently in the throes of submitting proposals for Agile2012 and a few other gigs…
  • Tamara continues to dive deep into the eye-candy-land of visual thinking, doodling, mind mapping, graphic facilitation, etc. and welcomes suggestions for articles, websites, examples or groups of local SFists who like to get together with colored markers, blank paper, and ideas.

Merry Monday and Happy Week to you!

ChittahChattah Quickies

Multi-platform rapport [The Art and Craft of User Research Interviewing] – A little story (on my book blog) about an amusing challenge in leading an interview just the other day.

And this is where I caught myself flicking my eye contact between the two, as a way to (I guess – it was an automatic gesture) demonstrate interest and maintain engagement. Except one person was on the phone. Yes, I was looking back and forth between the guy in the room and the phone. I was projecting all of my rapport building onto a device, using eye contact only. Needless to say this wasn’t very effective!

Microsoft Patents ‘Avoid Ghetto’ Feature For GPS Devices [CBS Seattle] – Oh, media. How you love to incite and to create a crisis where there isn’t one. Ghetto must be a hot-button word, so even though it’s not exactly accurate, let’s go for it. The fact is we are continually adding more context to our digital interactions (only yesterday, Google announced its plans to include your social network in your searchers), and these are obviously creating new challenges around privacy, but this isn’t much less inflammatory than the Siri won’t find abortion clinics non-story.

A GPS device is used to find shortcuts and avoid traffic, but Microsoft’s patent states that a route can be plotted for pedestrians to avoid an “unsafe neighborhood or being in an open area that is subject to harsh temperatures.” Created for mobile phones, the technology uses the latest crime statistics and weather data and includes them when calculating a route.

For some consumers, surveys breed feedback fatigue [AP] – Ironically, an article about quantitative data collecting that suggests we’re experiencing more of something, without any actual numbers to back up their claim. This is an area we’ve done some user research in, and while we didn’t necessarily see fatigue, we did observe a consistent presence of review mechanisms (both creating and consuming) in daily consumption.

While market-research polls have been conducted for decades, customer-satisfaction surveys have proliferated in recent years because of technology, a growing emphasis on getting data to shape decisions and measure results, and a drive to hold onto customers in a difficult economy, experts say. “People care much more about what the customers think today,” said Brian Koma, VP of research at Vovici, firm that conducts surveys and helps businesses integrate the results with views customers express online, in phone calls and elsewhere. There’s no scientific measure of the number of customer-feedback requests, but questionnaires have percolated into such professional settings as law firms and doctor’s offices and become de rigeur for even everyday purchases.

Tips to Improve Your Interviewing Skills (and a request for more!)

I’m working on some of the final chapters of my book about interviewing and am interested in the ways that people have developed their own skills as an interviewer. I’ll list a few but this list can only get better with your input.

  • Practice, man, practice. It’s how you get to Carnegie Hall and it’s how you get better at interviewing.
  • Create your own practice occasions: that chatty seat mate on an airplane, the extroverted cashier – ask them a question and then ask them a follow up questions!
  • Reflect, just like a football coach who reviews the game films; watch your videos, read your transcripts, and look at what worked well and what you might have improved
  • Be interviewed whether it’s for a survey or a usability study or a poll, experience the interview from the other side of the lens
  • Critique the interviews of others (without resorting to your just-got-your-drivers’-license-know-it-all we all were at 16)
  • Observe others at work including great interviewers and poor interviewers – this can be in your work context, or in the media (Marc Maron, Charlie Rose, Terry Gross, and others) 
  • Collect war stories (more on this coming very soon)
  • Try improv 

That’s my starter list, but what have you done to get better as an interviewer?

Flow in the interview

Earlier this week the San Francisco IxDa hosted a talk by Peter Stahl about The Rhythm of Interaction. As part of his presentation , Peter talked about Mih?°ly Cs??kszentmih?°lyi’s notion of Flow – “the mental state of operation in which a person in an activity is fully immersed in a feeling of energized focus, full involvement, and success in the process of the activity.”

Yesterday I came across a podcast I did a few years ago with the folks from Lunar where we talked about how speed, creativity and innovation intertwine in the design process and about getting results through design research. You can listen to the podcast at the bottom of the post; meanwhile I’ve pulled out a snippet where I describe entering a flow state when interviewing users.

And all the power of noticing and stepping back and slowing yourself down and just disengaging yourself from the need to be making things happen, is just sort of creating that space and t hat’s where insights happen. That’s where creativity can happen. And I’m sure you guys have seen that moment when you’re in the field, where you have all this responsibility to be managing a session and managing the other people in the session and making sure you stick to your time, and it’s a lot of, lot of work. Your brain is just firing on all its cylinders. And then sometimes for me there’s that moment where you kind of – it’s almost like a hyperspace moment where the starts start to just stretch out. Things just get really, really quiet in my head and suddenly, I’m just riding it. Things are sort of happening and I’m riding it, and that can be – it’s, I guess, a flow moment, right? Things can be really insightful at that moment. I don’t know that I’m bored, but if I had to contrast that to the stimulation of trying to run everything and run everybody, that seems to be a really kind of creative moment for me when that happens.

Listen to the podcast:

To download the audio Right-Click and Save As… (Windows) or Ctrl-Click (Mac).

Listen to Steve on the User Experience podcast

I was interviewed by Gerry Gaffney for his User Experience podcast. The topic of the interview was, recursively, interviewing. You can listen to the interview below, and read the transcript here.

To download the audio Right-Click and Save As… (Windows) or Ctrl-Click (Mac).

Steve: Yeah there’s something about interviewing. It is such an individual and it’s such a human activity that we can talk best practices, you know, all day. I think there’s something really great that happens when people make it their own. I think this is one of those “find your own style” things. I like to be dictatorial about best practices but I also have to acknowledge very strongly that what people bring is very interesting and different. Along those lines think about introverts versus extroverts and what’s easier or different for introverts or extroverts in these kinds of situations. Extroverts of course get energy from other people, introverts get energy kind of on their own and so that starts to manifest itself in interesting ways or in silence. But also just how much of yourself do you bring to it? And so I’ve seen extroverts be very successful at establishing rapport by talking about themselves, by being very open and genuine and giving.

My tactic as an introvert is to remove a lot of myself from it and really focus on them, express my interest in them, ask questions, ask questions, ask questions, ask follow-up questions, really drive everything towards my focus on them. So my long answer there is I think there’s a personal style thing that kind of comes out. I think if you reveal things about yourself, regardless of your style, I think it needs to be very deliberate. It’s a great tactic to give somebody permission.

Win Your Subjects Over with Genuine Enthusiasm

Parallels to interviewing users crop up all over the place. Just like us, portrait photographers ask their subjects trust them, as they go on a journey that might be uncomfortable at times. I don’t want to overwork the comparison, of course. You’ll see more differences than similarities in this video, but what struck me was the core notion that your own sincere enthusiasm will serve to build that trust.

Chris Buck promotional video

(via PetaPixel)

Steve to lead “Interviewing Users” workshop 9/28 in Seattle

As part of the Rosenfeld Media UX Workshops Fall 2011 Tour, I’ll be leading a full-day workshop – Interviewing Users: Spinning Data into Gold.

You can choose up to 3 workshops, including ones from Lou Rosenfeld and Steve Krug. Early registration (with a decent discount) ends September 9.

Bonus: the event will held at the amazing Seattle Central Library!

I hope to see you there!

Steve leading Immersive Field Research Techniques workshop at UI16

I’ll be presenting a full-day workshop on Immersive Field Research Techniques at User Interface 16 this November in Boston.

Registration gives you

  • Two full-day workshops: The UI16 experts will dive deep and get to the nitty-gritty details that make any designer into a pro.
  • One day of short talks: This is where you’ll discover the latest UX ideas and techniques from each of our expert speakers. Don’t forget Jared Spool’s entertaining and educational keynote.
  • Complete conference materials: We’ll send you the PDFs of every session and workshop just before you leave for the conference. Then you can focus on insights and not note-taking.
  • Recordings of the short talks: The benefits keeping coming after the conference. Through the recordings, you can relive every short talk at your office with your entire team.

Right now they are offering 100 registrations at a sneak-preview price of $1349. They are (as of this posting) down to 79 sneak-spots, after that it goes up $300.

I hope to see you there!

ChittahChattah Quickies

  • [from steve_portigal] New book about recurring technological failures [Pasta&Vinegar] – [Nicolas Nova has written a lot of great articles, presentations, and blog posts about failure, technology, society, and design. Now he's got a book. Let's hope an English version appears before too long?] My new book about recurring technological failures has been released two weeks ago. It’s called “Les flops technologiques: comprendre les échecs pour innover” which obviously means that it’s written in French. Based on the analysis of several cases (the intelligent fridge, the visiophone and e-books), the book describes the notion of recurring technological flops, discusses the very notion of failures and their underlying reasons. It also addresses strategies and design tactics to take them into account.
  • [from steve_portigal] The Art of Garfinkling [Splunderousnoog] – [We tend to conceptualize experiments and research as dispassionate or disconnected endeavors, but there's so much that can happen when we as experiments or researchers risk our presumptions and comfort level in order to get deeper understanding. In describing ethnography, I often refer to the researcher as the "apparatus" who is embedded and gathers data through that experience.] Carry out a simple experiment. When you are on the bus or the train, ask a person to give up her seat. Make sure you're young and fit. To make it easier, ask someone who is as fit or fitter than you. It is a hard thing for most to do. There is emotional distress involved. The fear of opprobrium, the need to be liked, to be nice…This sort of experiment is known as a "breaching experiment". It involves violating social norms. A famous, pioneering exponent of breaching experiments was a chap called Harold Garfinkle. So much so that "breaching experiments" are known as "Garfinkling"!
  • [from steve_portigal] Jeter’s 3,000th Hit Will Bring About as Many Marketing Possibilities [NYTimes.com] – [Merchandising a celebration.] Tablespoonfuls of the dirt will be poured into capsules to dangle on key chains; ladled into disks to be framed with photographs of the hit (in what is called a dirt collage); and glued into the interlocking NY carved into commemorative bats…The selling of Jeter’s hit…is quite a list: T-shirts, caps, jerseys, bobbleheads, decals, cellphone skins, wall murals, patches, bats, balls, license plates and necklaces made by licensees…Jeter will share royalties with M.L.B. and the players’ union; Already, he has designated proceeds from the sale of a silicone bracelet to benefit his Turn 2 Foundation. Everything Jeter touches or wears as he pursues his 3,000th hit carries value. So will the bases he steps on. In deciding what to provide for sale, Jeter controls his cleats, wristbands, bats and batting gloves. The Yankees control what they provide to him, like his uniform, warm-up jackets, and caps, as well as the dirt, the bases and the pitching rubber.

From SXSW – Diving Deep: Best Practices For Interviewing Users

I spoke at SXSW recently about the interviewing process in user research. As I’ve been working on a book about this topic the timing was great for me.

While we know, from a very young age, how to ask questions, the skill of getting the right information from users is surprisingly complex and nuanced. This session will focus on getting past the obvious shallow information into the deeper, more subtle, yet crucial, insights. If you are going to the effort to meet with users in order to improve your designs, it’s essential that you know how to get the best information and not leave insights behind. Being great in “field work” involves understanding and accepting your interviewee’s world view, and being open to what they need to tell you (in addition to what you already know you want to learn). We’ll focus on the importance of rapport-building and listening and look at techniques for both. We will review different types of questions, and why you need to have a range of question types. This session will explore other contextual research methods that can be built on top of interviewing in a seamless way. We’ll also suggest practice exercises for improving your own interviewing skills and how to engage others in your organization successfully in the interviewing experience.

Slides



Audio

Presentation (45 minutes + 15 minutes Q&A):

To download the audio Right-Click and Save As… (Windows) or Ctrl-Click (Mac).

Also see

ChittahChattah Quickies

  • [from steve_portigal] Le Laboratoire des Nouvelles Lectures (LNL) – a community centered around the future of reading – This week Lift is launching a new project: Le Laboratoire des Nouvelles Lectures (LNL) – a community centered around the future of reading. LNL is an open platform designed to inspire and incubate new forms of reading experiences based on all the new technologies now available. The LNL is an initiative of the Salon du Livre et de la Presse de Geneve (the Geneva Book Fair), and is produced by LIFT, Edipresse and Bookapp.com.
  • [from julienorvaisas] Tablets Rekindle Our Love of Reading–Books, Too [Fast Company] – [MFD is used here by the survey companies Brock Associates and iModerate Research Technologies – quite a name, that one! – to signify a Multi-Function Device which includes ebook readers as well as tablets. And possibly smartphones. You know, personal electronic devices. Mobile technology. We don't know what to call things anymore. In any case, here's more research to suggest that though people enjoy reading on and read more on their "MFDs," it's an additive effect, encouraging non-digital reading activity as well. Ereading does not replace non-ereading. Reading begets reading.] Despite the fact that the survey showed MFD users had great "affinity" for their devices, "struggling to to come up with significant shortcomings to reading ebooks on them" they were also inspired to read more old-school books. Perhaps they were reminded of the pleasures of reading, and were reluctant to haul their Kindle into the bath with them for a book-accompanied relaxing soak?

ChittahChattah Quickies

  • [from julienorvaisas] Japan’s Smokestacks Draw Industrial-Strength Sightseers [WSJ.com] – [This sub-culture is exerting economic influence. I'm looking for the American equivalent.] What started as a fringe subculture known as kojo moe, or "factory infatuation," is beginning to gain wider appeal in Japan, turning industrial zones into unlikely tourist attractions. It's the Japanese equivalent of going sightseeing at industrial stretches along the New Jersey Turnpike. Unlike the tourists who visit the factories of Toyota Motor Corp. and other Japanese manufacturers, the kojo moe crowd has little interest in the inner workings of the plants. They get excited by the maze of intricate piping around the exterior of a steel plant or the cylindrical smokestacks sending up steam. [A book on the topic] lists 19 questions to test one's kojo moe credentials, including "Do you like Blade Runner?" and "Can you stare at a factory you like all day long?" Now, industrial regions across Japan are working to create factory sightseeing tours.
  • [from steve_portigal] Stop Blaming Your Culture [Strategy + Business] – [A must-read. This could become the article on the topic, a companion to Porter's classic What is Strategy? REad it and pass it along.] Fortunately, there is an effective, accessible way to deal with cultural challenges. Don’t blame your culture; use it purposefully. View it as an asset: a source of energy, pride, and motivation. Learn to work with it and within it. Discern the elements of the culture that are congruent with your strategy. Figure out which of the old constructive behaviors embedded in your culture can be applied to accelerate the changes that you want. Find ways to counterbalance and diminish other elements of the culture that hinder you. In this way, you can initiate, accelerate, and sustain truly beneficial change — with far less effort, time, and expense, and with better results, than many executives expect.
  • [from steve_portigal] Steve Portigal to write book on interviewing users [Rosenfeld Media] – Interviewing users is fundamental to user experience work but, as Steve Portigal cautions, we tend to take it for granted. Because it's based on talking and listening, skills we think we have, we often wing it. Sadly, we miss out on many of the wonderful opportunities our interviews should reveal. So we're thrilled that Steve, who's contributed regular columns to interactions and Core77, has signed on to write a new Rosenfeld Media book, The Art and Craft of User Research Interviewing, to help UX practitioners really succeed with interviewing. Steve's book will focus on helping practitioners to better understand users' perspectives, and to rely upon rapport as the main ingredient in successful user interviews.
  • [from steve_portigal] Intel Teams with will.i.am, Black Eyed Peas Front Man [Intel] – [Is there a nomenclature convention emerging? If your corporate title is surrounded by quote marks, you may not receive the same HR benefits as others. Although it looks like he's got a badge? See you at Friday's Beer Bust!] He’s best known for being a multi-platinum music artist, producer and front man for The Black Eyed Peas, but will.i.am is also an innovator, technology fan, entrepreneur and philanthropist. With today’s announcement at the Anaheim Convention Center, the seven-time Grammy winner has added another title to his multi-faceted resume: “director of creative innovation.” As an extension of his insatiable fascination with technology, which plays a significant role in his professional and personal lives, will.i.am will engage in a multi-year, hands-on creative and technology collaboration with Intel Corporation. He already sports an Intel ID badge, which he proudly showed off at a news conference in Anaheim, where Intel is holding an internal sales and marketing conference.

Series

About Steve