Interview highlights

Comfort and transparency

At the beginning of each interview, we informed the participants that there were no right or wrong answers, as we were testing the the UI Toolkit site, and not them specifically. Including this statement allowed us to have a more relaxed and open conversation with the participant. We also asked for consent to screen record the interview, which every participant agreed to.

Qualitative research

We asked qualitative open-ended questions that related to their user behaviour, opinions, and workflow.

“Magic wand” questions allowed participants to give personal suggestions on what changes or improvements they would like to see.

“If you had a magic wand, what would you add, change or remove to this page?”

Quantitative research

We included Likert scale questions in order to gather measurable data about our users’ attitude or understanding towards a certain topic.

“It is easy for me to find what I am looking for in the Graphics Library.”

This statement would be followed by a five-point scale of “Strongly Disagree, Disagree, Neither Disagree or Agree, Agree, or Strongly Agree.”

If the respondent answered with Agree or Disagree, we would follow up by asking what would make their answer Strongly Agree or Strongly Disagree, to identify usability gaps and weaknesses in the existing site.

Usability testing

We tested how our users interacted with certain areas of the website to find out where the user experience was lacking.

We asked them to complete tasks, such as search for a specific icon, or try out a newly implemented feature.

During these testing periods, we asked our participants to speak their thoughts as they completed the tasks and we observed their actions and emotions.