CT-UT — Usability Testing glossary

89 terms the exam expects you to know, defined in plain language.

A

Accessibility Risk(accessibility risk): A risk involving barriers that prevent users with disabilities from accessing the product.
Accessibility Testing Integration(integration of accessibility testing, accessibility testing): The practice of performing accessibility checks early and continuously throughout development to reduce rework.
Accessibility Verification vs Validation(verification, validation): Verification checks if a product meets accessibility standards (built correctly), while validation checks if users can actually use it (correct product built).
Accessibility integration in development lifecycle(integration throughout development, continuous accessibility, accessibility should be integrated throughout the development lifecycle, accessibility integration, proactive accessibility): The practice of incorporating accessibility activities throughout the development process to avoid costly retrofits.
Accessibility testing limitations(false positives, false negatives): Automated tools produce false positives and false negatives, requiring manual methods for thorough evaluation.
Accessibility testing methods(accessibility testing, automated tools, manual inspection, user testing): Techniques including automated tools, manual inspection, and user testing with people with disabilities to evaluate accessibility.
Accessibility, Standards, and Legislation(accessibility, standards, legislation): Requirements and guidelines ensuring digital products are accessible, conform to standards, and comply with laws.
Action Sequence(correct sequence of actions): The correct sequence of actions defined for a specific user task that evaluators simulate during a cognitive walkthrough.
Americans with Disabilities Act (ADA)(ada): US law interpreted to cover websites and mobile apps as places of public accommodation.
Assistive technologies(assistive technology, screen readers, voice recognition, assistive technologies, jaws, nvda): Tools like screen readers (JAWS, NVDA), keyboard-only navigation, and magnification software used in accessibility testing.
Assistive technology testing(at testing, assistive technology, assistive technology testing): Evaluation of accessibility using assistive technologies like screen readers to ensure real-world usability.
Automated accessibility testing(automated testing, automated tools, automated accessibility testing limitations, automated accessibility tools): Testing using tools to detect technical accessibility violations, but cannot identify all usability issues.
Automated accessibility testing tools(automated tools): Software that automatically detects common issues like missing alt text or insufficient color contrast.

B

Backup Plan(backup plan): A contingency strategy for technical failures during usability sessions.
Backup plan for usability sessions(backup plan, contingency plan): A contingency plan involving alternative recording methods or offline tasks to ensure data collection continues during technical failures.
Bias in Usability Testing(bias, moderator bias): The influence of moderator actions or expectations on participant behavior, which can invalidate test results.

C

Click-through rate(ctr): A behavioral metric measuring the ratio of users who click on a specific element to the total who view it.
Cognitive walkthrough(cognitive walkthrough): A usability inspection method that focuses on a user's step-by-step reasoning to detect task-flow problems.
Combining usability review methods(combining review methods): The practice of using multiple inspection techniques to leverage their complementary strengths and detect more defects.
Correlation vs causation in UX: Warning that a high perceived usability score does not necessarily imply efficient task completion; survey and behavioral data must be triangulated.
Cost-Effectiveness Analysis(cost-effectiveness analysis): Evaluation of which inspection methods are most cost-effective based on the source of each finding.
Cost-effectiveness Evaluation for Accessibility Testing(cost-effectiveness evaluation): Comparison of the value of issues found against the effort invested to decide future testing techniques.
Cost-effectiveness evaluation(cost-effectiveness of each technique): The later assessment of each technique's cost-effectiveness based on documented findings.
Critical Incident(critical incident, critical incidents): An observable event during a test, such as an error or confusion, that is recorded for analysis.

D

Defect list consolidation(consolidated into a single defect list, defect list consolidation, consolidation): The process of merging findings from different review methods into a single list with duplicates removed.

E

Error rate: A quantitative usability metric reflecting the number or percentage of errors users make during task execution.
European Accessibility Act(european accessibility act, eaa): EU legislation that requires products and services to meet accessibility standards, referencing WCAG.
European Accessibility Act (EAA)(eaa, european accessibility act): EU law setting accessibility requirements for products and services.
Evaluator Assumptions(evaluator's assumptions): The reliance on evaluators' interpretations of user behavior, which is a limitation of cognitive walkthrough.

F

Facilitator Role(facilitator role, moderator's role): The moderator's function to guide the session without teaching, helping, or evaluating the participant.
False positives and false negatives in accessibility testing(false positives, false negatives): Inaccuracies in automated testing where violations are incorrectly flagged or missed.
Finding source documentation(document which method produced each finding): The practice of recording which method produced each finding to enable cost-effectiveness evaluation.
Four Key Questions of Cognitive Walkthrough(four key questions, four key questions of a cognitive walkthrough): A set of four questions evaluators answer for each action to assess whether users will notice, understand, and perform the correct action.

H

Heuristic evaluation(heuristic evaluation, usability heuristics, heuristics, usability principles): A usability inspection method that identifies violations of established design principles.

I

ISTQB context-dependent judgment(x is better than y as universal): The principle that most ISTQB answers depend on context, not absolute statements like 'X is better than Y'.
ISTQB role naming conventions(confusing role names): Specific role names like 'test manager' vs. 'test management role' that are easily confused in exam scenarios.
ISTQB test process activity order(order of activities in a process, test process activity order, reversing the order of activities, istqb test process order): The prescribed sequence of test activities in the ISTQB process, which is a common source of mis-recall in exam questions.
Informed Consent(informed consent): The ethical requirement to obtain participant permission before recording test sessions.
Integration of accessibility testing throughout development(integration of accessibility testing throughout development): Practice of performing accessibility checks early and continuously in the development lifecycle to reduce rework costs.

L

Leading Question(leading question): A question that influences a participant's response by suggesting a desired answer or direction.
Learnability(learnability): The ease with which first-time or infrequent users can accomplish tasks using a system.
Level AA compliance(level aa, aa): The most common legally mandated conformance level for WCAG, representing an acceptable level of accessibility.

M

Manual accessibility testing(manual inspection, manual testing, manual accessibility testing methods, manual accessibility testing, manual testing with assistive technologies): Testing performed by humans using assistive technologies and keyboard-only navigation to find issues automated tools miss.
Method training requirement(training in each technique, method training requirement): The need for reviewers to be properly trained in each technique when combining methods to avoid misleading findings.
Moderator Neutrality(moderator neutrality): The principle that a moderator should guide participants without leading or biasing their behavior.

N

Neutral Prompt(neutral prompt): A scripted or practiced phrase used by a moderator to guide participants without influencing their behavior.
Non-verbal Cue(non-verbal cue, non-verbal behavior): A subtle action such as nodding or smiling that can bias participant behavior during a usability test.

P

POUR principles(pour, four principles, pour principles): Four principles of accessibility: Perceivable, Operable, Understandable, and Robust.
Pilot Test(pilot test): A preliminary trial of a usability test to identify issues before actual sessions.
Pre-defined Script(pre-defined script): A standardized set of responses used by moderators to handle participant requests consistently across sessions.

R

Review time planning(plan the effort accordingly, review time planning): The consideration that combining methods increases total review time and requires effort planning.
Risk Analysis Stages(risk analysis stages): The sequence of identification, assessment, and prioritization of risks in usability testing.
Risk Assessment(risk assessment): The evaluation of the likelihood and impact of identified risks.
Risk Identification(risk identification): The process of listing potential usability, UX, and accessibility issues.
Risk Prioritization(risk prioritization): The ranking of risks to guide test design and focus on the most critical areas.
Risk Prioritization for Accessibility(risk prioritization): Ranking accessibility barriers by impact to focus test design on the most critical areas.

S

Section 508(section 508, 508): A US federal law mandating accessibility of electronic information for people with disabilities.
Section 508 of the Rehabilitation Act(section 508): US law requiring federal agencies to make electronic and information technology accessible.
Severity rating harmonization(severity ratings harmonized, severity rating harmonization, harmonization): The adjustment of severity ratings from different methods to a consistent scale after consolidation.
Severity vs Priority(severity, priority, severity and priority, severity vs priority, severity versus priority in testing): A distinction where severity measures impact on the user, while priority measures urgency for fixing.
Similar methods overlap avoidance(do not combine methods that are too similar, similar methods overlap avoidance, overlap avoidance): The principle of not combining methods that are too similar, as the overlap reduces the benefit.
Software Usability Measurement Inventory (SUMI)(sumi): A standardized questionnaire designed to measure perceived usability of software products.
Source Method Documentation(source, source method): The practice of tagging each finding with its originating evaluation method for cost-effectiveness analysis.
Statistical analysis for UX: Use of means, confidence intervals, and effect sizes to interpret quantitative usability metrics and determine meaningful differences.
System Usability Scale (SUS)(sus): A validated standardized questionnaire that yields a single normalized score from 0 to 100 to quantify perceived usability.

T

Task success rate(task success): A binary usability metric (success/failure) aggregated to a percentage indicating effectiveness.
Test Levels(test levels): Lifecycle phases in software testing such as unit, integration, system, and acceptance testing.
Test Role Confusion(confusing role names, test manager vs. test management role): Common misunderstanding between similar role names in testing, such as test manager vs. test management role.
Test Types(test types, quality characteristics): Targeted quality characteristics tested, such as usability, performance, security, and reliability.
Test level vs. Test type(test level vs. test type, test levels and test types, test level vs test type): Test levels are phases (e.g., component, integration), while test types focus on quality characteristics (e.g., functional, performance).
Think-Aloud Protocol(think-aloud protocol, think-aloud method, think-aloud): A usability testing technique where participants verbalize their thoughts while performing tasks.
Time on task: A quantitative behavioral metric measuring the duration users spend to complete a task, indicating efficiency.
Triangulation of UX data: Combining survey data with behavioral metrics to obtain a complete picture of user experience.

U

Usability Review(usability review, usability inspection): A systematic examination of a user interface by evaluators to identify potential usability problems without involving end users.
Usability Review (Inspection Methods)(usability review, inspection methods): An expert evaluation technique that identifies usability issues without user involvement.
Usability Risk(usability risk): A type of risk related to inefficient task completion by users.
Usability Testing(usability testing): A test type focusing on user-friendliness that can be applied at any test level.
User Surveys and Quantitative Measurement(user surveys, quantitative measurement): A method of collecting user feedback through surveys to obtain numerical data on user experience.
User testing with individuals with disabilities(user testing with disabilities, usability testing with participants with disabilities, user testing with people with disabilities): Involving real users with disabilities to uncover barriers not found by automated or manual testing.

V

Validation vs verification in accessibility(validation vs verification, verification vs validation): Verification checks compliance with standards; validation ensures real-world usability for people with disabilities.
Validation vs. Verification(validation vs. verification): Two distinct test concepts: verification checks if the product is built correctly, validation checks if the correct product is built.
Validity of standardized questionnaires: Requirement to use original wording and scoring procedure exactly to maintain benchmark comparisons and reliability.

W

WCAG conformance levels(conformance levels a, aa, aaa, wcag levels, level a, level aa, level aaa, conformance levels): Three levels of conformance: A, AA, and AAA, with increasing accessibility requirements.
WCAG four principles(perceivable operable understandable robust, pou): The four foundational principles of WCAG: perceivable, operable, understandable, and robust.
WCAG principles (POUR)(pour, perceivable, operable, understandable, robust, wcag pour principles): The four guiding principles of WCAG: Perceivable, Operable, Understandable, and Robust.
Web Accessibility Directive(eu web accessibility directive, web accessibility directive): EU directive requiring public sector websites and mobile apps to be accessible.
Web Content Accessibility Guidelines(wcag): An international standard for web accessibility organized around four principles: perceivable, operable, understandable, and robust.
Web Content Accessibility Guidelines (WCAG)(wcag, web content accessibility guidelines): Widely adopted accessibility standard published by W3C, organized around POUR principles with success criteria at levels A, AA, AAA.
Website Analysis and Measurement Inventory (WAMMI)(wammi): A validated standardized questionnaire for measuring perceived usability of websites.