When Qualitative Research Tells a Different Story – Journal cover

When Qualitative Research Tells a Different Story

During one of our usability sessions, we were observing how small shopkeepers used our payment feature. The transaction success screen had a cheerful animation - a confetti burst with a success sound, followed by a button to close it. On paper, it felt like a nice moment of delight. Something that celebrated the user’s success and made the experience feel more human.

But when we watched it in action at a busy store counter, the reality was different. The shopkeeper had a queue of customers waiting. Every second mattered. And there it was - our delightful animation, slowing them down. They had to wait for it to finish and then tap a button before moving on to the next transaction. What we thought was a positive experience turned out to be a frustration.

That moment taught a powerful lesson - delight is contextual. What feels thoughtful in one setting can become a burden in another. The same animation that brings joy to a relaxed user at home can irritate a shopkeeper managing a rush hour crowd. Without observing users in their real environment, we might never have known.

This is where qualitative insights make all the difference. Analytics might have told us that the transaction flow took five seconds longer than expected, but it wouldn’t explain why. Watching users struggle to dismiss the animation, seeing their facial expressions, and listening to their comments gave us the full story. It wasn’t a usability bug - it was a context mismatch.

Quantitative data gives patterns. Qualitative observation gives meaning. Both are essential, but the latter often reveals truths that numbers alone can’t. Especially in products designed for diverse user groups, the setting - noise, time pressure, environment - changes everything about how an interface feels.

After that discovery, we simplified the interaction. The success message now auto-dismisses, and the visual feedback happens in less than a second. The feature still acknowledges success but respects the user’s pace. It’s a small change, yet it transformed the experience entirely.

The more we design, the more we realize that delight isn’t universal - it’s situational. What users appreciate most is not always what looks the best but what understands their world. That understanding only comes from being there, watching closely, and listening carefully.

ux design research insights usability
Back to all journals