https://dwpdigital.blog.gov.uk/2015/02/19/digital-academy-capturing-user-feedback/

Digital Academy: Capturing user feedback

Natalie Rhoads - User Researcher at DWP
Natalie Rhodes - User Researcher at DWP

Ben Holliday recently posted a Digital Academy blog called ‘Understanding the problem’. It’s an introduction to understanding the problem when you’re working with a team on a service in discovery. As well as developing a research plan to get started, he explained the importance of finding ways to record (and keep a record of) everything you’re learning. In this post, I’ll explain how to do this in more detail.

 

Before you start

Before you start, consider working in a pair. You’ll find it’s much easier if one person is asking questions and someone else is concentrating on capturing feedback.

Capture observations using sticky notes

One of the best tools you can use for capturing observations is the sticky note. They’re great for grouping observations later when you get to your analysis. Use these 5 tips when writing sticky notes - if you don’t want to use sticky notes the same principles apply to keeping research notes.

  1. Write one observation per sticky note

The more information each sticky note holds, the harder it is to understand and organise later. You might miss important information by writing more than one observation or adding too much detail to a single sticky note.

  1. Capture the thing, not your interpretation of the thing

It’s important to capture what’s happening, not what you think it means. Interpretation comes later. Right now, you want an accurate record of what people have said and done.

  1. Make sure you know who said what

Label your observations so you can identify the people taking part in your research. An easy approach is to give each person you speak to a number, then label each observation you write down with the corresponding number.

  1. Don’t use jargon, acronyms, or shorthand

Write observations so other people can understand them. You shouldn’t have to explain these to people if they’re clear and concise.

Make sure other people can read your handwriting – using uppercase for legibility is a good idea.

  1. Personal data

Finally, don’t capture personal information, which could allow someone to be identified. Names, national insurance numbers, addresses, etc., shouldn’t be recorded. You need to think: “If I lost this, could someone identify who this person is?”

Making sense of your observations

Once you have got all your interviews done, the next step is to look for common themes in your observations. A good technique for this is affinity sorting.

As many people from the team as possible should be involved in the analysis stage. Involve everyone who’s been directly involved with your research.

Affinity sorting
Affinity sorting

You’ll need a big space, preferably a wall to post up your observations. Using affinity sorting, organise each sticky note into related groups. This isn’t an exact science so don’t feel that once you have put a sticky somewhere you have to leave it there - that’s the reason we use sticky notes.

To summarise:

  • Read your first sticky note and stick it up on the wall
  • Read the second sticky note. Is it related to the first observation or is it about something different?
  • If it’s different, then stick somewhere else on the wall.
  • If it’s the same, group this with your first sticky note. If you’re not sure put it somewhere close by.

Read out each observation, if this helps. Make sure everyone involved in the room is clear about what happened when the research took place.

Keep going until you’ve sorted through all your observations. This can take as long as a few hours, depending on how many observations you’ve captured during your research.

You should be able to see themes emerging from your groupings. At this stage label your groups as insights – the interpretation of what we think each group of data actually means.

Make your findings visible 

It’s important to make your research as visible as possible to your team. Get a wall, a board, or a window – anywhere you can display user needs or insights from research.

There’s no hard and fast rule about how to write up your research, but concentrate on communicating key themes or insights to your team. Keep records of what you’ve learnt each time you do research so you can go back to it and review it, and compare it with all the new things you are learning.

Share this page

2 comments

  1. Comment by CPG posted on

    One thing that was missing in this piece is the actual capturing of user feedback. I was reading this piece for general interest, looking at how I might bring it back to my team and it did not discuss the various ways of capturing the user data in the first place. It does deal well with what to do with the user feedback, how to categorise it and how to get a sense of common themes. Which I suppose is capturing it in useful way, but does not talk about how to get it in the first place.

    Identifying good ways of capturing user feedback, is difficult. Asking them to comment or use a traffic light system is one way, but has the problem that often only people with strong opinions will comment. The traffic light system and most of the KPIs tend to be quantitative and not qualitative in nature.

    But if you fancy writing another blog I would be interested in this topic.

  2. Comment by Louise Richardson posted on

    I was looking for a quick reminder about what affinity sorting involved, and when it might be useful. a quick google search turned up this page as 4th on the search result. Thanks to your simple and clear explanation, I had all the info I needed in a couple of minutes. Really handy - thanks for posting this Natalie.