CTFL-UT ISTQB Certified Tester-Foundation Level - Usability Testing Question and Answers

The Web Content Accessibility Guidelines (WCAG) define three levels of conformance for web content accessibility:

Level A (Single A) is the minimum level of compliance.

Level AA (Double A) is the standard recommended for most websites, balancing accessibility and design.

Level AAA (Triple A) is the highest and most comprehensive level of accessibility, covering the widest range of needs.

There is no such level as “Quadruple A (AAAA),” making option D invalid.

Thus, WCAG Triple A (AAA) promises the most accessible content, even though it may not always be practically achievable for all types of content.

Moderating the usability test is a core activity during the actual usability test session. The moderator guides participants through tasks, ensures the session stays on track, and avoids introducing bias. Option A (testing the setup) happens before the session, during preparation. Option C (extracting findings) occurs during analysis, after the test. Option D (talking during task execution) should be minimized unless necessary, to avoid influencing user behavior. Therefore, option B is the only correct answer aligned with best practices in usability testing.

When a customer emphasizes the importance of accessibility, it means they are concerned with ensuring that users with disabilities or limitations are not excluded from using their products or services. Accessibility is about inclusiveness—providing equal access and opportunity to all users regardless of physical or cognitive ability. Option C directly reflects this understanding. The other options (A, B, and D) are aspects of usability or development methodologies but do not relate to addressing the needs of users with disabilities, which is the core focus of accessibility.

A usability test plan is a foundational document created before conducting usability testing. It outlines the objectives, scope, methodology, participants, tasks, and schedule for the testing activities. One of its essential components is the schedule, which details when and how test sessions will occur to ensure proper resource allocation and time management. Including a schedule helps coordinate between test moderators, participants, observers, and stakeholders, making the testing process organized and efficient.

While briefing instructions (Option B) may be related to the usability test, they are typically documented separately or included in participant materials rather than the formal test plan itself. The test plan should be concise and focused; it need not be overly elaborate or lengthy (Option C), as clarity and usability of the plan are more important than length. The results of the test sessions (Option D) are not included in the test plan but rather compiled afterward in a test report or analysis document.

Therefore, the correct statement is that the usability test plan contains a schedule, ensuring a structured timeline for the usability testing activities.

A usability test participant is a person selected to represent the target user group and asked to perform specific tasks in a usability test. Their actions, reactions, and feedback help identify usability issues and evaluate the system’s effectiveness, efficiency, and user satisfaction. This role is strictly observational and does not involve organizing, observing, or setting up the test. Options A, B, and C describe other roles (e.g., technical support, observers, or moderators). Only option D accurately reflects the definition of a usability test participant.

The primary goal of usability testing is to observe and record user behavior while interacting with the system. A location where user actions cannot be seen or recorded (option A) completely undermines the test's purpose and is therefore not suitable.

While options B, C, and D are not ideal in all cases, they can still be valid settings depending on the context. Testing in a user’s natural environment (B) increases ecological validity. Remote testing via video link (C) is widely accepted. Testing in a public setting (D) can be useful for mobile apps or services intended for real-world use.

The System Usability Scale (SUS) is a standardized, reliable tool used to measure perceived usability. It consists of 10 items with five response options (from strongly agree to strongly disagree). It is widely used due to its simplicity and effectiveness in providing a single score to reflect a user’s overall satisfaction with a system. Option A refers to ISO's definition of usability testing, B describes a task in usability testing, and D refers to a usability requirement, not SUS. Therefore, the correct description of SUS is option C.

A best practice in usability reporting (based on ISO/IEC 25062:2006 – Common Industry Format for usability test reports) is to include a clear description of the evaluation method used. This includes how the test was designed, how participants were selected, what tasks were performed, and under what conditions the test was conducted. This ensures the results are credible and reproducible. The provided structure omits this essential information. While the report length is not excessive and positive findings may or may not be present, the key missing component is the method description.

The described issue violates the usability heuristic “User control and freedom,” as defined by Jakob Nielsen. This principle emphasizes that users should have the ability to undo and redo actions and navigate freely without being trapped in irreversible sequences. In the scenario, users are forced into the checkout process without a clear way to return or correct mistakes, except through the unreliable and disruptive back button. This design flaw undermines user autonomy and can result in lost progress or frustration.