Doorbells, Danger, and Dead Batteries Blog

During our “Ask Me Anything” with Steve Portigal, author of Interviewing Users and Doorbells, Danger, and Dead Batteries, we touched on subjects ranging from how to handle difficult clients, Steve’s favorite band, and his recommended reading, to dealing with “heavy topics” in interviews and how to improve your skills. Read on for a recap of the session, and please join our Slack here to stay informed about when our next #rm-chat author AMA will be!

Q: What book except your own would you recommend to read for UX designer? -Natalia H.

A: There are so many things to learn about. For design, I think this recent book by Scott Berkun is a great examination of how design is everywhere and in everything. It’s a quick read, it’s fun, and it’s empowering for designers I think, telling us again about all that we do, we have done, we can do.

Q: I often deal with “heavy topics” such as life, disability, cancer etc in my line of work, so it is not unheard of that we have someone break down and cry in interviews. We try our best to mitigate and avoid unnecessary stress (participants health and safety is our primary concern and we tell them in advance about the topics that we will be discussing), but can you talk about some advice how to mitigate these situations or what to do when this happens? -Fabian B.

A: Of course the stress and the emotion is going to impact all the people involved, say the participant and the researcher. I think researchers need to keep in mind that they aren’t (in most cases) trained for this, and that they need to find ways to take care of themselves. Often we will emote less in the interview than we might want to, so we want to leave space for ourselves to have feelings, to have reactions, to have someone to talk to. Work out what that is going to be. Who are you going to be able to speak with? When will you be able to speak with them?

For the participant, I learned something new to me from Sarah Fathallah at the Advancing Research conference when she talked about referral paths, something that if you are doing academic research that has an IRB ethical review needs to be put in place (someone correct me if I have this wrong) – where you identify things that might come up, like if someone reveals they are being abused, or is going through addiction, or having suicidal thoughts, you already know what your action is going to be.

I don’t know that we need that level if we aren’t doing say specifically traumatic research, but it’s the idea of planning for that. I’m also not saying that we need to DO anything; I think well-intentioned but under-informed do-gooderism is potentially worse than doing nothing in certain situations.

The complexity here is you can’t come up with every possible thing that might come up. But you can come up with SOME. I am also intrigued by sort of a generational shift in how we see our role; from “we need to observe, listen, empathize, not judge” to “all those, but we must also help.”

Q: I suspect a lot of us always did at least some of our research remotely, but now with covid, we’re seeing way more remote/virtual research. What are a couple of your top best practices for doing remote research well and getting high-quality information from respondents? -Amy B.

A: I think it’s worth co-opting that thing I see tweeted all the time “you aren’t working from home, you are working from home amidst a global pandemic.”  Same for research, right? All the parties are living through an emergency. So yes, there may be dogs and kids, and construction noise, and someone may be in their garage so they can get some privacy. And as we’ve adapted our tolerance for informality in terms of focus, energy, duration, attention in work, we can apply those to these interactions with strangers. A guy I spoke with yesterday put us on pause as his daughter asked for the car keys, she just got her license the day before. It was fine. I didn’t get ruffled like I might have in another time (no that’s crazy I’m nothing if not entirely cool and rolling with the changes). I don’t have a good answer for how fully remote research locks us out of getting to certain people. I just had a brainstorm with a colleague who was thinking about how to understand how people were or will be using transit, given that we can’t go on transit right now, and that the people who he’d want to learn about are possibly not sitting at home with a room with a laptop and a webcam and a good internet connection that is available all the time for them to just get on a call with us over Zoom. So who are we excluding even more so now (as society is excluding people in those circumstances even now) ? I know people are trying hard to deal with this, but I don’t know?

Q: Which musical group has had an interesting impact on your life and how? -Corey B.

A: I’m going to say The Tragically Hip. Being an expat Canadian, when the Hip would come to town it was always an interesting gathering of the community, at least a bunch of fellow Canucks. You’d go to a show and see hockey jerseys and University leather jackets, and just stuff you don’t EVER see in the US. And as time passed, we all got older, the fans got older, the band got older, and how we expressed ourselves and our identity shifted, gradually. I haven’t really moved through an era of my life as clearly in common with other people, not close friends, just strangers, but to feel it so tangibly through ANOTHER experience has impacted me. And of course the ultimate end of aging is death and the loss of Gord Downie still impacts me every day pretty much. I listen to the band and my many bootlegs and think about them and him, constantly. Perpetually.

Q: Do you have any tested tips/tricks on working with difficult clients? I recently had a challenge of convincing the client to use our approach when they wanted to do something else. Curious to hear what you do in such situations. -Kama K.

A: I don’t know enough about the context, and the power dynamic, as I think it often comes down to that. Two big directions, though: Empathy/Walk away. For the first, and I don’t mean to tell you stuff you already probably know and do in all your relationships, but there is that weird power to detoxify some broken interactions when you just listen, when you ask more, when you acknowledge, etc. Probably this has some buzzword for leadership people, I don’t know what that is. It sets you up to say authentically “Yes, And, and not No, But.”

For the second, if someone is a client, then you aren’t in a full-time job with them. Of course as someone who also provides services to clients, I want to do a good job, I want to be appreciated, I want to bring value, I want to be employed, and brought back in, etc. So I don’t like that framing that design people in agencies sometimes like to espouse which is making the client the enemy. But we can walk away. And even if we just hold in our head that we have the OPTION of walking away can making a less desired choice perhaps more tolerable. I’m CHOOSING to do this which I don’t agree with and which distresses me but I could and may at some point choose NOT to do it.

Q: What are your most counter-intuitive insights about research as it propagates through the product development process? -Scott W.

A: I don’t know that I can claim counter intuitive as a goal, if you agree with me then it’s probably not THAT counter intuitive? I think there’s this desire to create models and visuals that say if you are here do this, if you are here do that. Whether that’s the double diamond model or (VERY HELPFUL) recommendations for methods based on a stage in a process like Christian Rohrer’s.

I just am not that organized, I am just not able to constrain myself to a discrete stage, maybe I’m trees and that’s the forest and I just can’t do the forest well enough. That all being said, I think there’s something about how these processes are a continuum, a gradient, and not stages. I know Software Development Lifecycle Methodologies are all about gates, and stages, and review cycles, and (ugh) sprints, but I think in terms of where we are in terms of certainty, of belief, of ideas, it’s a much more creative process, I can’t control what thoughts I have in the shower in that way we have of considering and being inspired about what it means, what to do, what the opportunity is. Some of that is always happening for creative people – and research is ABSOLUTELY a creative process of sense making and understanding.

Q: Are there any topic(s) or technique(s) you hope more places of instruction cover for individuals entering into research? -Randolph D.

A: As you know, I love storytelling, and I think it’s such a powerful tool, but it’s just kind of considered to be something that is maybe part of your personality, your own personal toolbox. But obviously it can be taught, practiced, developed. Research is about gathering stories and creating new stories, and “story” is of course an ENORMOUSLY broad construct so one can take it however one likes.

I mentioned ethics in another question, I think as a field we haven’t reckoned with it sufficiently. I’d like people coming into the field to have a perspective on it. I know a researcher who wrote up their own research philosophy, not even as a document to publish but as a way of working out what they were trying to do. I was extremely impressed with that.

Research as a practice to me is a constant consideration of who we are in the world, as people, how we relate to other people, how we judge and don’t judge, and just how we move around and exist and perhaps make and help. So, being intentional about what you believe and what you want, damn. It’s a brilliant activity. I haven’t ever done that and hadn’t ever thought of doing it. So philosophy isn’t ethics literally but is adjacent?

I’d like something in training – and I don’t know that the places people are learning about research are the right environments to be considering this aspect – about what the researcher’s role is relative to the rest of the people they work with. I do not like the idea of research as “support” – you hear “oh I support three teams” – I know research is a helping profession like say librarians, and I don’t mean to squelch that strength, but I think we are partners and leaders, and if we don’t believe in the value we can bring in the role we can play, no one else will. I think it’s a hard field to break into and there are a lot of entry level people and so if they are told they have to be subservient, that can set a long running pattern for their career and for the practice.

Q: Someone interested in working with us recently asked how we recommend she improve her interview skills. I recommended your books, but are there any classes or seminars you might recommend as well? -Amy B.

A: I’m going to pitch my upcoming workshop. Also very very good is the cycle of “do, observe, reflect.” (which probably has a smarter name than I’m giving it). Listen to Terry Gross – listen to her technique. Reflect on her technique. Print out a transcript and mark it up. What choices did she make? What other choices could she make?

Listen to your own interviews. Print them out. Listen to a colleague’s interviews. Same same. Have someone ELSE listen to your interviews. Have someone else mark up Terry Gross (or anyone who does a lot of interviews).

I think training will get you further than you are, but practice, man practice is the way. Do a lot of interviews. A LOT. Reflect and analyze!

Q: What are some tips for building rapport in remote interviews? (with camera and without camera) -Erika

A: One avenue to explore is pointing to the medium, just acknowledging that you are doing what you are doing. And not pretending that you are as smooth as you are when you are in the same room. I did an interview yesterday where I had to share screen from Google Slides (not what I normally use for giving talks) and see speaker notes and it’s just a mess, and so I stopped and said what was going to happen, and then you heard the “unprofessional” sounds of me, saying, “Okay I’m going to hit share screen…yeah I think it’s shared now, okay, now I’m doing this, can you see this?” It just normalizes the interaction so you are both having a similar experience.

One thing I think needs to be explored is around shared sensory experiences. I saw Alice Waters talk recently and she described how she’d meet with people and she’d put a piece of fruit or something else down in between them and they’d just eat it beforehand and it created these interesting connections and well, rapport.

I don’t know how to operationalize this for remote research but I’m imagining having everyone pet their furry animal before starting and just sharing that moment that is about the senses, even though we are having our own experiences, we are having similar ones together. I think there’s probably some work to do to create that in a non-weird-sounding way.

Join us on Slack for an “Ask Me Anything” with Steve Portigal, author of Interviewing Users and Doorbells, Danger, and Dead Batteries. He’ll be answering your questions live on Thursday, August 13 from 1-1:45pm EDT in our #rm-chat channel. Join our Slack here. Haven’t read his books yet? You can access a discount code once you join.

Tamara Hale leads the research practice at Workday. She presented this story live at the Advancing Research conference. (This post will be updated with videos etc. as available)

As a researcher, I’m quite used to changing my appearance and my bodily practices to fit the circumstances. I’ve donned a headscarf when recruiting door-to-door at the Mosques of East London. I’ve traded my butch boots for kitten heels when interviewing scientists who adhere to biblical beliefs of Creationism. I’ve dyed my hair black and acquired a rural accent to better pass as a Peruvian when conducting research in Peru. From Managua to Caracas, I received instruction from my hosts about how to walk the Latin American city with purpose, and how to develop a second pair of eyes in the back of my head. That’s right, in my research experiences, I have literally relearned how to walk.

A few years ago I was about to embark on a research trip to Tokyo. I knew enough about Japanese business culture to consult the interpreter I had hired about appropriate dress for doing business in a large, traditional Japanese company. I wanted to know specifically should I remove the multitude of visible piercings I had acquired in the last few years? Earlier in my career I’d been a consultant, and had done a lot of work for conservative financial services firms and had been part of large sales pitches. But then I joined a California-casual tech company, in an arguably more casual Colorado office. Over the years, what my business suits accumulated in dust, my ears collected in precious metals. It was probably a good idea to remove the piercings, my interpreter confirmed.

Soon I arrived in Tokyo and in the tiny hotel room I proceeded to carefully remove my jewelry. After my sacrificial act of extraction, I made my way to dinner with the team. I’d only met the product manager a few times, mostly over video conferencing tools, and as soon as she walked in, with her gleaming nose stud, I realized that I’d neglected to share my knowledge about piercings and Japanese business attire with her. What to do now?

To some people (perhaps non-researchers especially?) the acts of bodily modification and change to my bodily practices that I have undergone for research may seem inauthentic, maybe even a betrayal of my unique “self”- that which has come to be called “identity”. The reality is more complex. Other people familiar with fieldwork that crosses cultural boundaries, will understand that at times such modification comes from a place of respect, and an attempt to lessen the distance between ourselves and our research participants. Further, women, people of color, LGBTQ folks and other minorities are deeply familiar with having to modify bodies and bodily practices as steps for protection and self-preservation, necessary acts to go about living in spaces that were not designed with us in mind or deliberately designed to exclude us. Yet other acts of bodily modification are ways to enact agency, to question and subvert the social and cultural constraints imposed on some, even while some bodies’ trespassings are scrutinized more heavily than others.

All of these thoughts went through my head over dinner and I was unsure of what to do with them. I chose not to mention anything to the product manager. The next day over coffee before our first customer visit, I fretted with my interpreter, “What should I do?! Should I ask my colleague to remove her beautiful nose stud?!”

He informed me matter of factly not to worry too much about it since it was going to be obvious to our customers that I was the “serious business lady” and that the PM was the “cool, young California kid”. My heart sank. What the f*&?! Clearly this guy didn’t understand – I’m the one working in the Design department! I’m hip! ‘I have an asymmetrical haircut!’ What’s more, how dare he refer to me as a “lady”? I’m a millennial! Just barely, but still!

But then he added that what was important was that in the eyes of the customer, I, an important, formidable, business leader had been sent to listen to their concerns and relay them back to executives in our company – and that I conveyed the part authentically. I was reminded in that moment, that whatever image I had attempted to craft for myself was at best tenuous and always subject to interpretations that I could not control. At the same time, I realized that many of the bodily adaptations I have undergone over the course of my career have allowed me to discover and come into alternate and new versions of myself. Through practicing research over more than a decade and a half, I’ve learned not to hold on too tightly to the ideas I’ve constructed about myself. And so, at once humbled, and feeling a little more powerful than usual (at least for the day) I stepped into the elevator to meet our customer.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research: Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Randolph Duke II is an Experience Strategist with Cantina. He is always open to connecting on Slack or LinkedIn. He presented this story live at the Advancing Research conference. (This post will be updated with videos etc. as available)

As a researcher, you come to expect the unexpected. But that doesn’t mean you don’t get surprised. I had received my first project as the lead researcher and designer for an internal IT group. The IT group hired me to help them learn about and fix some internal software tool. I agreed to a really tight deadline so the client provided an employee to support and shadow me. We’ll call her “Laura”. Laura was really bright and took well to instruction – the ideal apprentice, if you will. Although I shared some potential questions I might use during employee observations, I warned her that fieldwork could go any which way and that she should try to be ready for anything. I hadn’t realized we were both going to need that advice.

Two days into visiting offices across their different buildings, we were finally scheduled to meet “Carol”. Carol was important to my small data pool; she represented an important team within the company and previously shared unfiltered, critical feedback. Compared to her colleagues more nuanced responses, we knew time with Carol was going to be different. Upon introducing myself and thanking Carol for her time, she immediately responded with “I know who you are and I have opinions.” Before I could even come up with a response I just instinctively smiled and thought I am going to need to bring my A game. I planned to be approachable and responsible in guiding a fruitful conversation instead of just letting her complain. As therapeutic as it might’ve been for Carol, I needed to help Laura and myself understand why Carol felt the ways that she did so we could do something about it later. That’s what I planned, at least.

I first attempted to build rapport by asking Carol to describe how she works which immediately sent us down another path. One of the first things Carol brought up was a coworker she introduced to the company: Flat Carol. Flat Carol was a nearly life-size cardboard cutout of Carol. It was a 10-year old photo of her, smiling and holding a phone to her ear. It had a blank speech bubble encrusted with the remnants of old pieces of Scotch tape. I was caught completely off guard! Was this something that people just did here? I looked to Laura to gauge if something like this was somehow common and the look on her face confirmed that yes, Flat Carol was definitely out of the ordinary. I had warned Laura to be ready for nearly anything but here I was the one who needed to act. I thought to myself: do I find a way to make this conversation more about the software as scheduled or do I show Laura how to react to the unplanned?

In the few seconds I had to collect my thoughts I made my decision: I was going to be as present for Carol as possible. How could I hold onto a well-intended plan of talking about software when Laura and I had the chance to meet “someone” Carol was willing to share? I put down my question guide, and just focused on Carol. She told us how she put Flat Carol in her seat when she was away from her desk, whether she was going on vacation or as far as the restroom. How Flat Carol would have kind words or notes taped to the speech bubble for people passing her desk. We occasionally spoke about company processes connected to the software research, but that wasn’t my priority. Every so often I would look over at Laura to see what she was gaining from this experience and saw several approving nods, smiles, and fervent note taking. By the end, Carol shared that she was grateful for our conversation and Laura was relieved. Once we left Carol, Laura let out a sigh of relief and said “I don’t think I could ever recover the way you did.” That’s what research is about.

In mentoring Laura (who was, after all, still my client), I had spoken generally about being ready for anything, but when we were faced with a real surprise in the field, I had to live up to those words in a way that surely exceeded what either of us had in mind. We all walked away better for it.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research: Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Tamara Hale leads the research practice at Workday. This story is adapted from Hale, T. 2018 People Are Not Users. Journal of Business Anthropology. 7(2):163-183. She will be telling a completely new story at the Advancing Research conference.

A ferry boat is a place of questionable comfort for conducting research. A ferry boat in a storm is an altogether different matter, as I found out several years ago, when I was researching the experience of travelers sailing across the English channel between Dover and Calais, on one of Europe’s biggest ferry companies.

My objective was to inform a complete redesign of the newest fleet of ships, based on an understanding of the needs of ferry travelers: from queuing, to parking and wayfinding to the deck, to using the facilities on board and deboarding, all viewed through the perspective of service design. I spent a week observing and interviewing couples, families, traveling groups, truckers and staff on the ship. With time I felt I had become part of its very inventory: adapting to the ebb and flow of passengers for their three hour crossing. At each port, the ferry emptied itself of people, cars, buses and trucks and grew quiet, as if the ship sighed in relief and then braced in anticipation for the next wave of passengers. While the staff cleaned up from the last crossing and prepared for the next sailing, I would organize my fieldnotes and change the batteries on my audio recorder (yes, we had those back then). With multiple crossings a day I eventually forgot which port we were at, and it was only by locating a flag on the docks outside that I would know whether we were in Dover or Calais at any given time.

In my second week of fieldwork, just as I became accustomed to the daily routine of life aboard the ferry boat, I found myself suddenly in the midst of a formidable storm. As the waters grew rougher, and the ship floor started responding to the undulation of the tempestuous waves, I gave up on asking passengers to show me around the ship because none of us could walk or stand confidently. Instead I wobbled over onto the luxury travel deck, hoping for some relief amidst the red velvet lounge sofas, oak bar, and unobstructed ocean views. There I attempted to interview a retired couple on their vacation, my audio recorder sliding back and forth on the table between us. But I was soon forced to abort the interview, trying my best not to throw up on the red velvet, or worse, my research participants. The ferry staff, seeing my distress, tried to assure me that this weather did not pose a threat to our lives, while simultaneously scooping up the wine and champagne glasses off the bar into the safety of lockable wooden cabinets. At the end of the night, I stumbled off the ship to my hotel, wondering if I could ever set foot on another boat.

After a few nights of rest, I returned to the ship to complete my research over a span of a few much calmer days, this time focusing on truck drivers who regularly made the crossing with different concerns than my holiday travelers. I attempted to regale my research participants with the story of my storm of Titanic proportions days earlier, an endeavor which sparked pity and laughter rather than admiration. I wrapped up fieldwork as I always do, with a sense of deep humility and an expanded sense of different lifeworlds. This time, however, that humility was less intellectual in nature than corporeal.

The storm had added a new layer of complexity to my role in the project and to my personal and bodily relationship with the site of my research, the ship. Through the storm I became acutely aware that, despite my best intentions, I had treated the ship primarily as a backdrop for my interviews instead of considering it as a space and material object that seemingly possessed its own agency. The affordances of the ship when activated by the storm had challenged my sense of safety, comfort, and routine and replaced it with fear, confusion and malaise. Through my own body I learned of the ship’s potential to make its passengers feel a range of emotions and physical sensations. This attuned me more fully to the ship’s design shortcomings, to travelers’ and staff needs, and ultimately enhanced my ability to shape the decisions in the design and funding of the new fleet. While I never did fully find my sea legs on that research trip, I had reached a turning point in my appreciation of the spaces and environments in which research takes place.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research: Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Alexandra Wills is an ethnographer working at Fuse by Cardinal Health, an innovation center in Columbus, Ohio. She told this story on stage at Midwest UX 2017.

I’ll never forget when I did ethnographic research for a project aimed at helping a car manufacturer learn what Millennials with small children really needed.

The project was hard. Taking on a project at the height of the Great Recession meant navigating a radical change in client engagement from what I had experienced since starting the work two years prior. “It’s Friday at 5 p.m. in Ohio and you want me in Los Angeles on Monday?” Okay. “We’re doing video diaries and in-home interviews and a post-interview ideation session with participants in two cities, all in two months?” Okay.

Added to all that, I had a nine-month-old and simply didn’t want to leave her for days at a time. Over the past few months of work, I had already breast pumped on an airplane and in dirty airport bathrooms. I had already begged flight attendants and fast food workers for ice to put in the cooler carrying pouches of my “liquid gold.” Did I mention it was my birthday?

At one point in the project, I was hanging out with a family in Austin who had a toddler. I knew nothing about toddlers. After all, I had a nine-month-old. Did I mention I am not a ‘kid person’?

We had just returned from running errands in their car. As we got out of the car, they were showing me some specific details about the vehicle. They had a Honda Element – the car with the interesting doors that open and close like a book. I was paying close, close attention to the parents and I had no idea that the little kid was right near me. So I closed the door. Suddenly, we all heard the kid screaming! His parents rushed to his side and looked him over, examining his hands. All I could do was yell impulsively, “I didn’t do it!” I was horrified. I thought, “I hurt a child! This child! A participant’s child! Oh noooooo this is bad. How am I going to fix this? What am I going to tell Melinda (my boss)?” To this day I don’t know if his finger got caught in the door, or if me closing the door just scared him.

There was no blood, no broken fingers. But inside, I wanted to die. I already felt plagued by my own mommy guilt and that feeling spread throughout my body like lava. So, not only did I feel like a horrible mom for leaving my kid, but here I was in Austin, making someone else’s kid cry. What a moment. Needless to say, any rapport I had developed in my time with the family evaporated in that instant.

I stopped recording, stepped back, apologized to the mom and waited for the parents to finish calming down their kid. I waited for them to say, “This is over.” They didn’t. Miraculously, they continued the interview, even if I could feel all their judgment the entire time as we wrapped things up. “Maybe I didn’t traumatize this family,” I thought insecurely.

The icing on the cake was that we used video to capture all our data, so not only did this happen, but my boss got to see the whole thing when she reviewed the video. Later in the project I mentioned the incident and she said, “Yeah I saw that.”

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research:  Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Joel Kashuba has practiced design for nearly two decades, with a career spanning the practices of architecture, industrial design, branding, UX, and innovation consulting. He currently leads the Innovation & Design functions for Fifth Third Bank located in Cincinnati, Ohio. He told this story on stage at Midwest UX 2017.

While working for a major CPG company I was placed with a cross-functional innovation team assigned to write and vet concepts that would take a well-known women’s shaving brand into several other personal care categories. The focus was on serving the needs of young women in several BRIC countries. The theme we had been asked to unlock was “A Day at the Spa” – a theme the company had uncovered in earlier research within the United States and projected as a fruitful area to mine for opportunities and frame our expansion.

Before going out into the field – specifically, to Moscow – the project team undertook countless hours of concept writing sessions, often with heavily resourced vendor partners. We created roughly 25 concepts, each taking unique inspiration from the theme “A Day at the Spa”. Armed with our concepts we set off to Russia and began collaborating with consumers in the field to vet each concept.

By the noon on the first day, none of our concepts were resonating and we recognized our first challenge. The translator we had been assigned by a local agency was an older Russian gentleman who sounded much like a James Bond villain. As he readied each of our painstakingly word-smithed concepts, they each ended up sounding like the dastardly ideas of a dour old man who may like to cross-dress. To fix this, we recruited a spritely young woman who worked as an assistant concierge at our hotel to read the concepts. She was great! Several of our consumers even mentioned that she had the perfect voice for commercials in this category.

Despite this change, our concepts still weren’t hitting the mark we were aiming for and we couldn’t figure out why. These concepts had been exceptionally well received in our early test back in the States – what was going on here in Moscow that made them such tankers?

Finally, near the morning of day three, one of our consumers asked us plainly, “Why are you trying to make me feel old?”

“Old?” we asked her with sincere confusion, “Can you say more? Is there something in the concepts that makes you feel old?”

“Yes,” she quickly retorted, “you keep talking to me about spending a day at the spa.”

“And what does that mean to you?” we had our translator ask her.

She looked surprised and a little pissed off. She explained, “It means the place we send our grandmothers when they are too old to take care of in their homes. It’s the place people go before they die.”

It hit us like a ton of bricks. In Russian culture, a “spa” is what we’d call a retirement home. As we had been pulling out concept after concept trying to get these young women to fall in love with our theme, all they saw was of tone-deaf Americans shoving the idea of products for a retirement home down their throats.

We were horrified. We called off the rest of the day’s consumers and stayed up all night re-writing the concepts. The young concierge we had hired to translate became an adjunct team member. Constrained by time, we changed our strategy and turned consumer research into consumer co-creation. We had consumers work in teams to read and re-write the concepts, which were passed along to other teams of consumers to be refined. By the time we finished we had three great concepts that all resonated well.

Coming back to our home base, we reflected on the experience as a team. What we had set out to do was valid, but how we remained nimble in the field is what made the clear difference in how we would found success.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research:  Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Nadav Zohar is a UX researcher at AEP in Columbus, OH.

My first ever user research project was for a healthcare app. Our users were nurses who work with poor and high-risk patients, often called “the under-served.” My supervisor and I had a reserved conference room at the client’s site, and our pre-scheduled users rotated in about one per hour. It was a grueling two days of nonstop interviews. For the first day I took notes while my supervisor moderated.

On the second day, after he moderated the first couple of interviews, my supervisor turned to me and asked if I thought I was ready to take the lead on the next one. I said “Sure” so he handed me the discussion guide. In came our next user, a middle-aged nurse who was very sweet and eager to help us in any way she could. This was my very first user interview and I was ready for a clean, uneventful affair.

As the questions on my discussion guide turned to the technological hurdles she encounters when helping her patients, her frustration mounted. At one point, while discussing how her technology failed to help her manage the stress of the enormous workload placed on her and her colleagues, she mentioned having lost a patient. I watched her relive that pain – she broke down and started sobbing. None of the other users we’d talked to had even come close to that kind of emotional response, even though some of them had lost patients too.

Right then and there I learned there’s an awkward balance between not wanting to seem clinical and cold at that crucial moment, but still wanting to preserve an interviewee’s dignity: I figured weeping in front of strangers at work must be somewhat embarrassing. So I bowed my head and looked down at my notes, or my lap, or at nothing in particular, to give the crying nurse a bit of privacy. I waited a few sobs so it didn’t seem like I was trying to shut her up, and then I warmly and gracefully offered her a box of tissues. I let her know I empathized with her pain (although looking back on it I don’t see how I really could have…but my empathy felt genuine anyway) and she eventually calmed down and we finished out the interview. After that, back at the office I was jokingly known as the guy to call in to make people cry.

I think I deal fairly well with very emotional user research situations and over my career I’ve learned they are not uncommon, but it was interesting to have one right off the bat.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research:  Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Emily Mayfield (Twitter, LinkedIn) is a User Experience Researcher at The Kroger Co. in Cincinnati, OH.

Before my current job, I spent six months in Bangalore, India, doing research for a lab that was part of a design school in the northern part of the city. I did not drive while I was in India – I took public transportation and little “autos,” which resemble a golf cart in terms of size and a lawnmower in terms of sound. At that time Uber was barred from India. The driving style in Bangalore struck me as very different from the States: sometimes the traffic lights/stop signs are ignored, sometimes drivers go well beyond oncoming traffic lanes, sometimes when a freeway exit is missed drivers throw their cars into reverse on the freeway. I saw enough daily to get my heart pumping.

I was doing research to understand what the notion of “smart city” might mean in India? As part of the research, I made cold calls to different innovation centers and companies, setting up expert interviews that would inform the research. I learned a lot about how companies had explored the concept of “smartness” in cities. In retrospect, the interview part was easy. Finding the location of the interviews was the challenge.

I had a smart phone. I had a camera. I took photos of the locations on Google maps on my computer or on my phone in case the connection on my phone was lost or hiccuping. One time, I got on the bus headed south and rode it two hours deep into the city to a neighborhood I was unfamiliar with. I hopped off when it seemed like I was close to where I needed to be. There was a queue of auto drivers at the bus stop. I showed my phone and camera screens, with their neat pin-point of my destination on the digital map, to the first driver in the queue. I showed him the address: a building number and street name. The driver waved me in. “No problem!” I thought to myself. I smiled and held on tight to my bag and the rail of the auto. We were off! Turning and bending through little streets and big ones, weaving in between cars and buses. We flew past people crossing the street, animals doing the same, and carts selling food and tea. We drove and drove and drove some more. Minutes led to double-digits. The driver was flying…in what felt like circles. Checking the time, I thought “Oh boy…”

Eventually the driver pulled over to ask other auto drivers for help finding the location. Local folks came to help. A cop or some kind of military person joined in the effort. The mass of people tried to help, pointing around like the scarecrow from the Wizard of Oz guessing all directions to try next. They discussed, pointed, checked and double-checked the address and the maps. At last I got a solid idea: I called my interviewee and he chatted with the driver. We met in a place that the driver could find and then I walked with the interviewee to the building together.

Afterwards, a colleague let me know that the European conventions of maps as we know them don’t make sense to some people in India who have never seen a map in that form. Also, Bangalore is constantly changing, adding streets and changing names of streets. Later on I learned that landmarks are the way to go, as well as calling people sooner rather than later. Still, the worst case scenario was handing my phone to friendly-looking strangers to communicate with a driver when I’m really lost and it worked. A quick shout out to the kind and patient people of Bangalore: Thank you for your constant help getting me to and fro!

Side note: It’s possible my geographical difficulty is just a me thing. More than once I’ve gone to conduct research at the wrong Kroger store on the same street here in Cincinnati!

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research:  Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.

Krispian Emert has over 12 years experience working in UX. She has worked all over the world: for startups, agencies, and companies like Microsoft, The NFL, Thompson Reuters, ING, etc. Currently, she is lead UX Researcher at TELUS digital. She told this story live at Radical Research Summit.

It was my first field study at my new job in Sydney, Australia. I had just uprooted my family and flown to the other side of the world to work for Australia’s largest user experience consultancy. Did I want to do a good job? You bet. Was I nervous? Hell, yes!

I had had a couple of weeks to settle in and explore the city, and to get to know my colleagues. My impression of Australian culture was that it was surprisingly similar to Canadian culture: We both have the Queen on our money, we both drink copious amounts of beer, and we both say “no worries” a lot. The only glaring difference I was able discern up to that point was that for a casual greeting Canadians asked “How’s it going?” and Australians asked, “How’re you going?” So I had experienced little culture shock thus far.

The assignment was for one of the big banks. We were to conduct contextual field studies in the moment while people used the bank’s ATMs. The only problem was that due to privacy constraints we had to recruit people just as they were about to use the ATM. This was made more challenging because the bank gave us very little in the way of official ID.

This meant that I, an extra polite Canadian, was nervously approaching busy Australians and anxiously stammering the first few sentences of my recruitment spiel. To say that I got turned down by my prospective interviewees is an understatement. The fact that I didn’t look “official” or in any way affiliated with the bank made me seem suspect at best, and criminal at worst. ATM users glared at me as though I were panhandling, and time after time, I was told to “Fuck off!”. I was worried that I wouldn’t complete the assignment. I needed 10 participants and after two hours I had exactly none.

As I stood in the street in Sydney, miles from home, failing to secure participants and on the receiving end of some choice language, I had a “Dorothy moment.” I was not in Canada anymore. Despite my initial impression that our countries were similar, I was in whole new culture – one where people were not afraid to say the F-word to a complete stranger. I realized I had to stop assuming people would stop and politely listen to my lengthy recruitment pitch, and that I had to just accept Australians for what they were – blunt and direct. I changed my approach, and went up to prospective participants boldly, waving my gift cards at them. I shortened my pitch to state only the benefits of participating in the research. This produced much better results.

They say that if Texas and England had a baby, it would be Australia. After this experience, I grew to appreciate the unique Australian culture of “wild west gunslinger meets cricket games and meat pies.”

And despite our differences, I guess we’re pretty similar after all.

Steve Portigal is the founder of Portigal Consulting. He’s written two books on user research:  Interviewing Users and Doorbells, Danger, and Dead Batteries. His work has informed the development of music gear, wine packaging, medical information systems, corporate intranets, videoconferencing systems, and iPod accessories. Follow Steve on Twitter or listen to his podcast Dollars to Donuts.