Superficial, stereotyped user research bullshit.

Screenshot of the landing page for an online AI service that has the headline "user research. without the users."

If you’re at all online, you probably have seen the reactions to SyntheticUsers. I have enjoyed the snark and outrage about this ridiculous ‘service’ but we really benefit from Niloufar Salehi actually trying it and reporting back so the outrage can be founded in the facts. Ironically, this is something that SyntheticUsers doesn’t actually do

This short post, I tried out SyntheticUsers, so you don’t have to is summed up by the sub-head

Using AI as a replacement for interviewing actual users is a brilliant idea if you want to look like you made an effort, but are really looking to fill the page with superficial, stereotyped bullshit.

online pharmacy order advair online with best prices today in the USA
buy clomid online buy clomid online no prescription

Further in, we see that this experiment compared the output of SynthesicUsers with the conclusions from some actual research. In the research itself

Our own in-depth interviews over months with real parents found that the dashboard was a misguided solution and that what was really meeting our participants’ information needs was through trusting relationships that met them where they were and went beyond information about schools.

but SyntheticUsers reports that

Participants said that the dashboard would be “very effective,” “very useful,” and “very helpful” in solving their problems (6/6) and rated it on average 3.4/5.

Again, there’s no surprises here, but there is delight in seeing an actual example. Send this to your bosses, clients, and colleagues who decide to suggest these sorts of tools instead of actually, you know, doing the work.

Watch/read The Evolution of User Research: past, present and future with Steve Portigal

Kritika Oberoi and Looppanel did a great job editing down a long and discursive exchange into a few key takeaways. The full article is here.

I offered my high-level take on the history of user research, especially in tech.

Phase 1 – Research Consultants (aka the Caveman era): The first cohort of User Researchers in the field were primarily consultants—think IDEO, a particularly successful example emerging at this time. But while research consultants could be hired, in-house researchers were still a rare sight.
Phase 2 – Individual Contributors: As organizations started to realize the power of research, the function began to emerge within companies. But although there were individual contributors running research, they weren’t empowered—no big titles, not a lot of access to senior management, and a limited ability to influence crucial decision-making.
Phase 3 – Empowered Research Practices: Today we’ve entered the third phase—a phase where Research leaders have titles like Head of Research and Director of Insights. These leaders are empowered to build practices—hiring their own teams and influencing their peers in senior leadership to make decisions based on actual user insights.
And while every organization may not be at the same level of maturity, Steve sees the field as a whole headed in the direction of greater empowerment and influence, driven by hunger from verticals like Design & Product.

A dramatic shift in the industry


I talked about the two major drivers that have fed research growth in recent years:

#1 Consistent evangelization by industry leaders: Over the last 20 years, industry leaders have been advocating for research, demonstrating the impact of the practice, and teaching others their trade along the way. This consistent advocacy—speaking, writing books, organizing conferences, and so on—has helped organizations understand the value of research and learn how to run it themselves. Of course, the work is far from complete, but it was definitely effective.
#2 The rise of Design: UX Design has grown rapidly over the last decade, and Design leaders understand the need for research. Design teams have opened the door for Research inside companies, hiring talent and building a practice to enable better decision-making.

What has driven the growth in User Research?


In the final clip I talk about the tension between confidence and crises of confidence that happen in many growing companies.

Gaps start to emerge between the company’s vision and what users actually want and need. At some point in the journey, the reliance on vision instead of insight leads to a major failure—maybe a feature release epically fails, or an unexpected competitor that starts to grab market share.

It’s when the inherent confidence of the organization transforms into a crisis of confidence that a tipping point is reached and research emerges to bridge the gap between the company and its customers.

Where's the tipping point for organizations to believe in research?

There’s more in the full article.

Watch Steve present Stop Solving Problems! at CEDIM

I recently presented Stop Solving Problems! as part of the CEDIM Innovation Talk series. The 40 minute video is embedded below, and on YouTube here.

Webinar: Stop Solving Problems! - Steve Portigal

The old maxim says we should “Find a need and fill it;” while at a one level that is certainly true, even in this era of fetishized disruption, organizations seem to easily fall in love with the idea of being in the problem-solving business.

In this webinar, Steve reviews a number of different mindsets for creating products and services, consider their benefits and risks, and challenge you to go beyond a fixing mentality.

Watch Steve on Good Morning UX

Thanks to Rafael Burity and Rodrigo Lemes for having me as a guest on Good Morning UX. The one-hour episode is embedded below and can also be found on the episode home page and YouTube.

Are we really doing research? With Steve Portigal - Good Morning UX

We usually have this life training to ask questions, but it doesn’t make us researchers, to be honest. Especially when we are talking about learning from users, customers, stakeholders, etc.

As designers and researchers, we have this kind of “power” to help companies to avoid mistakes, bad ideas, and guesses. It has been becoming a huge differential in the industry of digital products, but to really take advantage of this ability is important to have some points in perspective.

This show will pass through some questions like:

Are we doing research well with a real impact on the business?

How a designer can be prepared to do it in the real world, in a short time but with quality?

Is there a difference between leaders with research or design backgrounds?

For this, we invited Steve Portigal a researcher who has interviewed hundreds of people and with a huge experience working in telecommunications, banking, media, energy, and e-commerce industries. He is the author of some important books and host of the Dollars to Donuts podcast. He helps companies to think and act strategically when innovating with user insights.

Listen to Steve on The Informed Life

Thanks to Jorge Arango for a great conversation on The Informed Life podcast. The half-hour episode is embedded below, available at the podcast site, and wherever you get yer podcasts. The episode page also has a transcript.

And I have found, over the last few years, that in addition to providing tactics and kind of mindsets and sort of, “here’s what I advise and recommend for you to be successful in doing this work.” In these interactions that we have in kind of these feedback sessions, the role that I’m often playing is in giving people confidence and being able to say, “oh, the thing that you are describing is very common.” Because I think people have some experience, it feels weird, and they’re like, “well, I’ve screwed this up.” And so I’m working hard to give people confidence and say… to affirm their experience, to validate the uncertainty and struggle they felt in it. And then maybe say, “yeah, here’s a thing that you can try,” or, ” you know, there are tactics to kind of address this.”

But they need the confidence as much as they need the tactics. Because they might get to those tactics on their own, but if they feel like, “this is not the right way to do it, I’m screwing this up,” because it is a weird thing, because you may find yourself feeling like you’re screwing up when you actually are succeeding, because you’re dealing with the absolute uncertainty of another person who you don’t know, who you’re spending time trying to get to know a little bit… it’s entirely unpredictable and uncontrollable. And so, all the ways that we expect ourselves to be successful is to be controlling for all that uncertainty, but it’s inherently uncontrollable to some extent.

So yeah, the more you do it, the more you either make mistakes or feel uncertain about an experience that you’re having and reflect on it, whether it’s through listening to a podcast where people are talking about this or reading a book, or, working with someone who’s more experienced, who can reflect back to you. Those are all ways that we do become more confident with these sort of… surprising or unexpected aspects of what the nature of the work is.

online pharmacy fluoxetine buy with best prices today in the USA
online pharmacy buy cytomel with best prices today in the USA

We say we value innovation and creativity…but do we?

It shouldn’t be a big surprise to anyone reading this that the uncertainty of something new and innovative creates a feeling of risk, and can discourage the pursuit of a creative option.

Some research from 2012 (The Bias Against Creativity: Why People Desire but Reject Creative Ideas) delves into that further.

“Prior research shows that uncertainty spurs the search for and generation of creative ideas, yet our findings reveal that uncertainty also makes us less able to recognize creativity, perhaps when we need it most.”

Via the New York Times,

“People actually have strong associations between the concept of creativity and other negative associations like vomit and poison,” said Jack Goncalo, a business professor at the University of Illinois at Urbana-Champaign. “Agony was another one.”

A new study shows how people unfavorably evaluate others who are described as being creative. It appears that even the mention of their creativity (as opposed to experiencing it directly) was sufficient to cause a negative assessment of the creative person.

Like many biases, being aware of their existence can be a first step to addressing them, but like many biases, their baked-in nature can make for a significant challenge to overcome.

Watch Steve on The Service Design Show

Thanks to Marc Fonteijn for having me back on The Service Design Show. The one-hour episode is embedded below and can also be found on YouTube.

User research - what to do when your company doesn't get it / Steve Portigal / Episode #127

Everything in service design starts with user research. But as you’ve probably experienced often it’s challenging to get the time and resources to do proper research.

And when research is already being done by an organisation it’s often not the type of research that we’d like to see.

It can be frustrating to see that user research isn’t making the difference you know it can.

So what does it take to push user research beyond it’s current limitations?

Author and industry icon, Steve Portigal has been thinking about this topic for some time now.

I invited Steve (back) on the Show to share his thinking and together explore what it takes to take user research to the next level.

And also ask the question: What is that next level in the first place?

Without proper user research you can’t do good service design. So it’s our job to make it more relevant and impactful.

This episode will show you how.

Listen to Steve on the Nodes of Design Podcast

Thanks to Ravi Tej for having me on the Nodes of Design podcast. The 35-minute episode is embedded below and can also be found on the podcast site and YouTube.

In this episode, Steve shared wonderful insights on user interviews and why we do user interviews in design; we then discussed the framework of interviews using which we can gain great insights from users and few tips on actively listening and note-taking during interviews. In the latter part, Steve recommended five do’s and don’ts that designers/researchers must avoid while doing user interviews

Series

About Steve