A UX Expert Review is an expert-based evaluation method used to assess the usability of a software product using guidelines, standards, and heuristics. The review can be conducted at any stage of development, regardless of whether the product is a prototype, a wireframe, or an application that is already (partially) functional.
Basic Idea
- Both pragmatic and hedonistic aspects of quality should be taken into account.
- Reviewers should give equal consideration to both positive and negative aspects.
- The aspects that reviewers should focus on are selected based on the application being evaluated.
Advantages:
- more affordable than traditional user testing
- less time required
Disadvantages:
- no real users
Experts
The experts should have knowledge of UX and, ideally, of the product's specific application area as well. Three to four experts are sufficient.
Method
The basic concept behind all usability review methods is to have a product or application evaluated by a small group of experts. The experts’ goal is to identify weaknesses in the product and document them in a structured manner. These weaknesses are then discussed with the application’s developers and (ideally) resolved. Two methods can be used to uncover any usability issues.
Cognitive Walkthrough:
During a cognitive walkthrough, the experts walk through the application together. The most important use cases and wireflows are identified in advance, and the experts then work through and discuss them together. Questions to guide the process can be prepared beforehand, which the experts can ask themselves again for each use case.
Example:
Will the user notice that the correct action is available? (These questions depend on the application)
Heuristic Evaluation:
The heuristic evaluation uses 10 usability heuristics (see. www.nngroup.com). The heuristics are kept very general so that they apply to as many contexts as possible. A more comprehensive list of UX aspects can be found here: www.uer.ueq-research.org (Download: UX Aspects)
However, it is also possible to identify specific context-related usability issues if they are not covered by the provided heuristics. The experts should evaluate the product independently of one another during the review in order to maintain as neutral a perspective on the system as possible and avoid influencing one another. During the subsequent discussion, however, the experts discuss the identified usability issues together. These are evaluated based on their severity and prioritized. At this point, suggestions for potential solutions can already be made and discussed.
Selection of UX aspects/heuristics for the heuristic evaluation:
- Card Sorting aspects involving people who are familiar with the product (UX designers, product owners, customers, etc.)
- or an interview with the people mentioned
It is important to note that UX aspects should also be selected that are in the customer's best interest (not just the user's), e.g., marketing.
Phases During the Review
Analysis
Afterward, the results are reviewed and compared as a group. The usability issues identified are prioritized by severity. Initial suggestions for improvement can be discussed at this stage. It is important to translate the issues into a format that allows them to be communicated to the product team, including the client and developers.
Material:
There is a wide variety of materials available for UX Expert Reviews that can assist with the evaluation. Here's a recommendation: uer.ueq-research.org
Sources:
www.nngroup.com
www.uer.ueq-research.org
www.eresult.de
www.doi.org
