CTEL-ITP-ATP — Assessing Test Processes glossary

164 terms the exam expects you to know, defined in plain language.

A

Acting Phase(acting, acting phase, phase 4: acting): The fourth phase of the IDEAL framework that executes the plan, implements changes, and monitors progress.
Activity–Effectiveness Confusion(confusing activity with effectiveness): A cognitive bias where one mistakes mere activity or busyness for actual progress or effectiveness.
Agile Adaptation of TPI NEXT(agile contexts): Tailoring TPI NEXT key areas and checkpoints to fit iterative development, CI/CD, and cross-functional teams.
Alignment with strategic goals(strategic alignment): The requirement that the improvement recommendation must align with the organization's strategic goals.
Analytical Approach(analytical approach): An approach that uses data analysis to drive improvement decisions.
Analytical Approaches to Test Process Improvement: Methods that use data analysis to drive test process improvement decisions.
Analytical approaches(analytical approaches, analytical test improvement approaches): Category of test process improvement approaches that includes content-based, causal/defect analysis, metric-driven, and process mining.
Assessment Evidence Collection(collects evidence through interviews and document reviews): The process of gathering data through interviews and document reviews for objective test process assessment.
Assessment Plan(assessment plan, plan): A document detailing the objectives, scope, constraints, schedule, logistics, data collection methods, and scoring criteria for an assessment.
Assessment Scope(scope of an assessment, assessment scope): The clearly defined boundaries of an assessment, including organizational units, test processes, and standards to be evaluated.
Assessment Team(assessment team): A group of individuals with expertise in the assessment model, test processes, and facilitation skills, selected to conduct the assessment.
Automated Regression Testing(automated regression testing): A checkpoint under test automation that ensures existing functionality is not broken by changes.

B

Binary Checkpoint Nature(binary nature, binary): The property that a checkpoint is either fully satisfied or not satisfied, with no partial credit.
Business Goals(business goal): Strategic objectives an organization aims to achieve, such as reducing time-to-market, improving product quality, or lowering costs.

C

CI/CD Integration Checkpoint(integration with ci/cd pipelines): A practice of integrating test automation with continuous integration and delivery pipelines.
CMMI(cmmi): A capability maturity model integration that serves as a foundation for improvement models like TMMi.
Capability Maturity Model Integration (CMMI)(cmmi): A process improvement model that covers organizational processes across multiple disciplines to improve overall maturity, predictability, quality, and efficiency.
Checkpoint Progression(progression, logical progression): The logical ordering of checkpoints from foundational practices at lower levels to optimization and innovation at higher levels.
Checkpoint-Driven Improvement(improvement roadmap, gap analysis): A process of using unmet checkpoints to identify specific weaknesses and prioritize actions for test process improvement.
Checkpoint-based assessment(checkpoint-based assessment): An assessment approach in TPI NEXT using specific checkpoints for granular evaluation and precise improvement actions.
Coach role(coach): A role that requires guidance skills to facilitate improvement.
Common Features(common features): Groupings of generic practices such as commitment to perform, ability to perform, and verifying implementation.
Comparing and Selecting Improvement Approaches: A methodology to evaluate and choose among different test process improvement strategies.
Conducting Test Process Assessments: The activity of evaluating an organization's test processes against a maturity model.
Confirmation bias(confirmation bias): The tendency to search for, interpret, and remember information in a way that confirms one's preexisting beliefs.
Content-Based Analysis(content-based analysis): An analytical technique that reviews test documentation to identify gaps and improvement opportunities.
Content-based analytical approaches(content-based analytical approaches, content-based approaches): Data-driven approaches that examine testing artifacts and outcomes to identify weaknesses and improvement opportunities.
Context Dependency of TPI NEXT(context-dependent, context-dependent assessment): The principle that TPI NEXT assessment and adaptation depend on the organization's specific context and practices.
Context dependence of TPI NEXT(context-dependent, context dependence): The principle that higher maturity levels in TPI NEXT may not be optimal for every organization due to context.
Context of improvement(context of improvement): The organizational, business, and regulatory environment in which test process improvement takes place.
Context-Dependent Improvement Model(context determines the best improvement model): The concept that context determines the best improvement model and quality view.
Context-Dependent Improvement Model Selection(context-dependent principles, no universal best model): The principle that the best improvement model depends on organizational context, not universal superiority.
Context-Dependent Interpretation of TPI NEXT(context-dependent, context): The principle that checkpoints must be interpreted considering organizational size, domain, and risk profile.
Context-Dependent Quality View(context dependent view): The principle that the most relevant view of quality depends on the specific scenario or stakeholder perspective.
Context-Dependent Testing Principles(context dependency, context-dependent answers, context-dependent answers in istqb): The principle that ISTQB answers often depend on context rather than universal statements like 'X is better than Y'.
Context-based model selection(context-based recommendation): The principle that the recommended improvement model must be justified by the organization's context, goals, and constraints.
Context-dependent selection(context-dependent, context dependency, context-dependent selection): The principle that the choice of improvement approach must be tailored to an organization's specific needs and maturity.
Continuous Model(continuous model): An improvement model allowing incremental progress without requiring full maturity levels, like TPI NEXT.
Continuous representation(continuous representation, continuous model): A maturity model representation where key areas are assessed independently on a scale.
Cumulative Maturity Levels(cumulative levels, cannot skip levels): The requirement that each maturity level must be fully satisfied before an organization can move to the next level.

D

Defect causal analysis(defect causal analysis, causal analysis, causal/defect analysis, defect analysis): An analytical technique that identifies root causes of defects to prioritize improvements.
Defect leakage(defect leakage): Measure of defects that escape to later stages, used as a specific improvement goal.
Developer View of Quality(developer view): A perspective on quality that emphasizes code correctness and maintainability as seen by developers.
Diagnosing Phase(diagnosing, diagnosing phase, phase 2: diagnosing): The second phase of the IDEAL framework involving assessment of the current state of the test process against a desired maturity model to identify strengths and weaknesses.

E

EFQM Excellence Model(efqm): A non-prescriptive framework for organizational quality management based on nine criteria of enablers and results.
Establishing Phase(establishing, phase 3: establishing): The third phase of the IDEAL framework where the organization develops a detailed action plan, prioritizes improvements, and sets measurable goals.
Expert Role vs Test Manager Role(expert role is distinct from test manager role): The distinction between a strategic improvement expert and an operational test manager overseeing daily tasks.
Expert as Assessor and Advisor(expert as assessor and advisor): A role combining analytical assessment of test processes with advisory guidance for sustainable improvement.

F

Formal assessment(formal assessment): A model assessment requiring trained assessors, used by TMMi.

G

Generic Goal(generic goal): A goal that applies to multiple process areas and focuses on institutionalizing the process.
Generic Goals(ggs, generic goals (ggs)): Common goals that apply across all process areas at a given maturity level to institutionalize a managed process.
Generic Improvement Framework(generic improvement framework, meta-framework): The IDEAL model's characteristic of being applicable to any process improvement initiative, not limited to testing.
Generic Practice(generic practice): An activity that supports generic goals and is the same across all process areas at a given maturity level.

H

Hybrid approach(hybrid approach, hybrid combination, hybrid approaches): An improvement strategy that combines model-based frameworks and analytical methods to fit organizational context.
Hybrid approaches(hybrid approaches): Approaches that combine model-based and analytical methods for best fit.

I

IDEAL Framework(ideal, ideal framework): A five-phase lifecycle model for process improvement derived from the Software Engineering Institute's work on process improvement.
IDEAL Model(ideal model, initiating diagnosing establishing acting learning model, initiating, diagnosing, establishing, acting, and learning, ideal): A process improvement model with steps: Initiating, Diagnosing, Establishing, Acting, Learning.
IEC 62304(iec 62304): A regulatory standard for medical device software that mandates specific verification and validation activities.
ISO 29119(iso 29119): A standard for software testing that defines terminology, processes, and documentation requirements.
ISTQB Glossary Definition of Quality(quality definition): The degree to which a component, system, or process meets specified requirements and/or user/customer needs and expectations.
ISTQB Glossary definition of a standard(standard): A document established by consensus and approved by a recognized body providing rules, guidelines, or characteristics for activities or their results.
Implementation plan outline(implementation plan): A high-level plan and success metrics included in the recommendation to guide execution.
Improvement Prioritization(prioritized improvement): Selecting improvement actions based on business value and team capacity, not a fixed sequence.
Improvement Prioritization in Agile(prioritized improvement): Prioritizing TPI NEXT improvement actions based on business value and team capacity rather than a fixed sequence.
Improvement Process Sequence(sequence: assess, plan, implement, evaluate): The defined order of activities in process improvement: assess, plan, implement, evaluate.
Improvement models(improvement models): Frameworks like TMMi and TPI NEXT that aim for continuous test process improvement beyond mere compliance with standards.
Improvement planning approach(improvement planning approach): The structured sequential path of TMMi versus the flexible prioritized approach of TPI NEXT.
Incremental improvement (TPI NEXT)(incremental improvement): The ability to prioritize and implement improvements step by step using maturity levels and business goals.
Independence in Assessment(independence, objective and independent): The requirement that assessment team members remain objective and free from bias by not being part of the organizational unit being assessed.
Initiating Phase(initiating, phase 1: initiating): The first phase of the IDEAL framework where the organization establishes business context, secures sponsorship, and sets up infrastructure for improvement.
Institutionalization(institutionalized, institutionalizing the process): The process of making a process repeatable, measured, and controlled, ensured by generic practices.
Iterative Assessment in Agile(iterative assessments): Performing TPI NEXT assessments repeatedly, aligned with Agile ceremonies like sprint retrospectives.
Iterative Nature of IDEAL Model(iterative, ideal model is iterative): The property that after the Learning phase, the cycle returns to Initiating rather than being a one-time linear sequence.

K

Key Areas in TPI NEXT(key areas): Themes such as test strategy and test automation that describe aspects of test processes.
Key areas (TPI NEXT)(16 key areas, key areas): 16 distinct focus areas in TPI NEXT, each with specific checkpoints for evaluating test process maturity.

L

Learning Phase(learning, learning phase, phase 5: learning): The fifth phase of the IDEAL framework that captures lessons learned, updates the process, and institutionalizes improvements.

M

MCQ Distractors in Testing(mcq distractors): Distractors in multiple-choice questions that exploit common mis-recalls related to testing distinctions.
Making Recommendations: The act of proposing specific improvements based on assessment outcomes.
Manager View of Quality(manager view): A perspective on quality that emphasizes defect detection efficiency and coverage as seen by test managers.
Maturity Level(maturity level, levels): The highest level (A, B, C, D) in a key area for which all checkpoints for that level and all lower levels are satisfied.
Maturity Level Achievement Criterion(achievement criterion, level achievement): The requirement that all checkpoints for the target level and all lower levels must be satisfied to achieve that maturity level.
Maturity Levels(maturity levels): Stages of process capability, such as TMMi's five levels from Initial to Optimizing.
Maturity Levels in TPI NEXT(maturity levels): Stages of process capability determined by evaluating checkpoints in selected key areas.
Metric-Driven Improvement(metric-driven improvement): An analytical approach that uses metrics like defect density or test coverage to drive process changes.
Metric-driven analysis(metric-driven analysis): An analytical method that uses quantitative data to guide improvement decisions.
Model Compliance Pitfall: A common mistake of recommending improvements based solely on model compliance (e.g., TMMi level 2) without considering whether that compliance serves a business goal.
Model selection criteria(model selection criteria): Factors such as scope, maturity focus, assessment method, and organizational context for choosing a model.
Model-based approaches(model-based approaches, tmmi, tpi next): Prescriptive approaches that define a set of practices to achieve a maturity level for test process improvement.
Model-based improvement approach(model-based approach, model-based improvement approach): A predefined improvement structure that may not fit all organizations perfectly, requiring experienced guidance for prioritization.
Multi-model approach(multi-model approach, combination of models): Combining elements from multiple improvement frameworks like TMMi, TPI NEXT, or CMMI to tailor improvement to organizational context.

N

Non-cumulative maturity levels(maturity levels are not cumulative): TPI NEXT's feature where maturity levels across key areas do not aggregate, complicating overall progress communication.

O

Objective and Repeatable Assessment(objective and repeatable): The requirement that test process assessments must be unbiased and reproducible across different evaluators.
Order of Activities Misrecall(reversed process order): A common error where test takers reverse the order of activities in a process during ISTQB exams.

P

PDCA Cycle(pdca cycle, plan-do-check-act cycle, deming cycle, pdca): A continuous improvement cycle with steps: Plan, Do, Check, Act.
Process Areas(pas, process areas (pas), process areas): Specific areas of testing that must be satisfied to achieve a given maturity level, each with specific and generic goals.
Process Improvement Lifecycle(process improvement lifecycle): A structured approach to guide test process improvement, of which IDEAL is an example.
Process mining(process mining): An analytical technique that extracts process information from event logs to identify improvement opportunities.

R

Recommendation-to-Business-Goal Alignment(linking recommendations to business goals): The practice of explicitly connecting each recommendation to a specific business goal to increase relevance and likelihood of acceptance.
Regulatory compliance: The adherence to mandatory rules in safety-critical domains.
Regulatory compliance in testing(regulatory compliance): Mandatory requirements imposed on testing processes, especially in safety-critical domains, that must be met during improvement initiatives.
Required trained assessors (TPI NEXT)(trained assessors): TPI NEXT assessments require trained assessors to ensure accurate and reliable results, avoiding self-assessment errors.

S

Selection Criteria for Improvement Approach(selection criteria): Factors such as organizational maturity, data availability, improvement scope, and stakeholder commitment that guide the choice between analytical and model-based methods.
Self-assessment(self-assessment): A model assessment that can be performed by the organization itself, used by TPI NEXT.
Severity vs Priority Distinction(severity vs. priority, severity vs priority, severity and priority, severity and priority distinction, severity vs priority distinction): The distinction between the impact of a defect (severity) and the urgency of fixing it (priority).
Specific Goals(sgs, specific goals (sgs)): Unique goals defined for each process area that must be achieved to satisfy that process area.
Specific Practice(specific practice): An activity that helps achieve a specific goal and is unique to the process area.
Staged Model(staged model): An improvement model with predefined maturity levels that must be fully satisfied, like TMMi.
Staged representation(staged representation, staged model): A maturity model representation with predefined levels, each with specific goals and practices.
Stakeholder Perspectives on Quality(views of quality, stakeholder view, stakeholder perspectives on quality): Different views of quality held by groups such as users, developers, and managers, influencing improvement priorities.
Stakeholder recommendation presentation(recommendation presentation): A clear statement of the chosen model, a comparison summary, expected benefits, and high-level implementation plan.
Standards(standards): Baselines for test processes providing common language, terminology, and benchmarking references.

T

TMMi (Test Maturity Model integration)(tmmi): A staged maturity model with defined process areas for assessing and improving test processes.
TMMi Assessment Report(assessment report, final assessment report): A final report containing the maturity level rating and improvement recommendations.
TMMi Assessment Steps(assessment steps, assessment process steps): The four phases: planning, preparation, on-site assessment, and reporting.
TMMi Assessment Team Composition(assessment team, tmmi assessment team): An independent team including a lead assessor, additional assessors, and a sponsor from the organization.
TMMi Evidence Collection(evidence collection, gathering evidence): Objective and verifiable evidence gathered through interviews, document reviews, and process observations.
TMMi Framework(tmmi): A structured path for test process improvement that assesses maturity levels from initial (Level 1) to optimization (Level 5).
TMMi Lead Assessor(lead assessor, tmmi lead assessor): A certified TMMi Professional who leads the assessment team and must be independent of the assessed unit.
TMMi Maturity Level Determination(maturity level determination, final maturity level): The overall maturity level is the highest level where all process areas are satisfied with no lower-level gaps.
TMMi Maturity Levels(tmmi maturity levels, five maturity levels, maturity levels, tmmi levels): A test process improvement framework describing maturity levels for testing processes.
TMMi Practice Rating Scale(rating scale, practice rating scale): A four-point scale rating each practice as fully, largely, partially, or not achieved.
TMMi Process Area(process area): A defined area in TMMi with specific and generic goals and practices.
TMMi Process Area Satisfaction Criteria(process area satisfaction, satisfied process area): A process area is satisfied only when all its specific and generic practices are at least largely achieved.
TMMi generic goals(generic goals): Goals that apply to multiple process areas focusing on institutionalizing the process.
TMMi generic practices(generic practices): Activities that support generic goals, common across process areas and focusing on institutionalization.
TMMi specific goals(specific goals, specific goal): Unique outcomes that a particular process area must achieve, directly tied to its purpose.
TMMi specific practices(specific practices): Activities that support specific goals, unique to a process area.
TPI NEXT (Test Process Improvement Next)(tpi next): A continuous improvement matrix model for assessing and improving test processes.
TPI NEXT Assessment Profile(assessment profile, profile): A result showing which key areas are at which maturity level, highlighting strengths and weaknesses.
TPI NEXT Checkpoint(checkpoint, checkpoints): A binary statement describing a specific practice or capability required for a given maturity level within a key area.
TPI NEXT Checkpoints(checkpoints, checkpoints in tpi next): Specific descriptions within key areas that indicate maturity levels and practices to evaluate.
TPI NEXT Improvement Path(improvement path, improvement actions): The non-prescriptive sequence of checkpoints guiding improvement, which may skip levels if justified.
TPI NEXT Key Area(key area, key areas): A row in the TPI NEXT Matrix representing a specific area of test process, such as test strategy or organization.
TPI NEXT Key Areas(key areas, key area): Categories within TPI NEXT, such as test strategy and test automation, that define focus areas for assessment.
TPI NEXT Matrix(matrix, tpi next matrix): A visualization tool in TPI NEXT that shows current and target maturity states to guide incremental improvements.
TPI NEXT Maturity Level(maturity level, maturity levels): A column in the TPI NEXT Matrix representing a level of process maturity, typically A through D.
TPI NEXT Maturity Levels(maturity levels, maturity levels a through d): Levels within TPI NEXT that represent the maturity of a key area, guiding process improvement.
TPI NEXT assessment process(tpi next assessment): A goal-driven sequence of identifying improvement areas, conducting the assessment, and defining recommendations.
TPI NEXT vs TMMi(tpi next and tmmi): TPI NEXT uses different key areas and assessment methods compared to TMMi's process areas.
TPI NEXT vs TMMi Distinction(tpi next and tmmi): The difference between TPI NEXT and TMMi, which have different structures, key areas, and assessment methods.
TPI Next(tpi next, tpi next key areas, tpi next model, test process improvement next): A test process improvement model focusing on key areas and checkpoints, reflecting an operational view of quality.
Test Automation Key Area(test automation): A TPI NEXT key area critical in Agile, focusing on automated regression testing and CI/CD integration.
Test Level vs Test Type Distinction(test level vs. test type, test level vs test type, test level vs test type distinction): The distinction between the scope of testing (levels: unit, integration, system, acceptance) and the characteristic being tested (types: functional, non-functional, structural, change-related).
Test Levels(test levels): Categories of testing based on scope, such as unit, integration, system, and acceptance.
Test Management Role(test management role): A broader responsibility encompassing any person or group that performs test management tasks.
Test Manager(test manager): A specific job title responsible for planning, controlling, and reporting testing activities.
Test Manager vs. Test Management Role(test manager vs. test management role, test manager vs test management role): Distinct roles in test management; a test manager is a specific job title, while test management role refers to the broader responsibility.
Test Maturity Model integration (TMMi)(tmmi, test maturity model integration, tmmi (test maturity model integration)): A framework for test process improvement that assesses maturity levels and guides improvement actions.
Test Process Assessment(assessment, test process assessment): A systematic evaluation of an organization's testing processes to identify strengths and areas for improvement.
Test Process Improvement(testing processes improvement, test process improvement): The systematic approach to enhance testing efficiency, effectiveness, and alignment with business goals.
Test Role Confusion(test manager vs. test management role): A common mis-recall involving confusing role names that share words, such as test manager versus test management role.
Test Types(test types): Categories of testing based on characteristics, such as functional, non-functional, structural, and change-related.
Test case effectiveness analysis(test case effectiveness analysis): Evaluation of which test cases find defects and which are redundant.
Test coverage(test coverage): Extent to which test cases cover specified requirements or code.
Test level(test level, test levels): A group of test activities organized and managed together, such as system testing.
Test type(test type, test types): A group of test activities aimed at testing a specific characteristic, such as performance testing.
Testing process focus (TPI NEXT)(testing process focus, focus on the testing process): TPI NEXT's narrow scope on the testing process rather than the entire software development lifecycle.
Traceability Matrix(mapping table): A mapping table or matrix used to document the link between assessment findings, recommendations, and business goals.

U

User View of Quality(user view): A perspective on quality that emphasizes usability and reliability as seen by end users.

V

Validation(validation): Confirmation that the product meets intended use requirements.
Validation vs Verification Distinction(validation vs. verification, validation vs verification, validation and verification): The distinction between ensuring the right product is built (validation) and ensuring the product is built correctly (verification).
Validation vs. Verification(validation vs. verification, validation and verification): Validation asks 'Are we building the right product?' while verification asks 'Are we building the product correctly?'
Verification(verification): Confirmation that specified requirements have been fulfilled.
Views of Quality vs Quality Characteristics(views vs characteristics): The distinction between who is looking (stakeholder perspective) and what is measured (attributes like reliability or usability).