CT-AI Exam Dumps - Certified Tester AI Testing Exam

A. The difficulty of defining criteria for improvement before the model can be accepted.

Defining criteria for improvement is a challenge in the acceptance of AI models, but it is not directly related to the performance drop in real-world scenarios. It relates more to the evaluation and deployment phase rather than affecting the model's real-time performance post-deployment.

B. The fast pace of change did not allow sufficient time for testing.

This can significantly affect the model's performance. If the system is self-learning, it needs to adapt quickly, and insufficient testing time can lead to incomplete learning and poor performance.

C. The unknown nature and insufficient specification of the operating environment might have caused the poor performance.

This is highly likely to affect performance. Self-learning AI systems require detailed specifications of the operating environment to adapt and learn effectively. If the environment is insufficiently specified, the model may fail to perform accurately in real-world scenarios.

D. There was an algorithmic bias in the AI system.

Algorithmic bias can significantly impact the performance of AI systems. If the model has biases, it will not perform well across different scenarios and data distributions.

Given the context of the self-learning nature and the need for real-time adaptability, optionAis least likely to describe the fall in performance because it deals with acceptance criteria rather than real-time performance issues​​.

ï‚· Type of Testing for Stock-Price Prediction Models:Concept drift refers to the change in the statistical properties of the target variable over time. Severe weather storms causing massive losses in coffee production and affecting stock prices would require testing for concept drift to ensure that the model adapts to new patterns in data over time.

 Reference:ISTQB_CT-AI_Syllabus_v1.0, Section 7.6 Testing for Concept Drift, which explains the need to test for concept drift in models that might be affected by changing external factors​​.

A. Feature selection

Feature selection is the process of selecting the most relevant features from the data. While important, it is not directly about handling excess data.

B. Data sampling

Data sampling involves selecting a representative subset of the data for training. When there is more data than needed, sampling can be used to create a manageable dataset that maintains the statistical properties of the full dataset.

C. Data labeling

Data labeling involves annotating data for supervised learning. It is necessary for training models but does not address the issue of having excess data.

D. Data augmentation

Data augmentation is used to increase the size of the training dataset by creating modified versions of existing data. It is useful when there is insufficient data, not when there is excess data.

Therefore, the correct answer isBbecause data sampling is the most relevant activity when dealing with an excess amount of data for training​​.

ï‚· A. This statement is incorrect. Current AI is true AI and there is no reason to believe that this fact will change over time.

AI is an evolving field, and the definition of what constitutes AI can change as technology advances.

ï‚· B. This statement is correct. In general, what is considered AI today may change over time.

The term AI is dynamic and has evolved over the years. What is considered AI today might be viewed as standard computing in the future. Historically, as technologies become mainstream, they often cease to be considered "AI".

ï‚· C. This statement is incorrect. What is considered AI today will continue to be AI even as technology evolves and changes.

This perspective does not account for the historical evolution of the definition of AI. As new technologies emerge, the boundaries of AI shift.

ï‚· D. This statement is correct. In general, today the term AI is utilized incorrectly.

While some may argue this, it is not a universal truth. The term AI encompasses a broad range of technologies and applications, and its usage is generally consistent with current technological capabilities.

Clustering is a form ofunsupervised learning, which groups data points based onsimilarities without predefined labels. According toISTQB CT-AI Syllabus, clustering is used in scenarios where:

The objective is to find natural groupings in data.

The dataset does not have labeled outputs.

Patterns and structures need to be identified automatically​.

Analyzing the answer choices:

A. Associating shoppers with their shopping tendencies → Correct

Shoppers can be grouped based on purchasing behaviors(e.g., luxury shoppers vs. budget-conscious shoppers), which is a typical clustering application in market segmentation.

B. Grouping individual fish together based on their types of fins → Incorrect

If thetypes of fins are labeled, it becomes aclassification problem, which requires supervised learning.

C. Classifying muffin purchases based on packaging attractiveness → Incorrect

Classification, not clustering, because attractiveness scores or labels must be predefined.

D. Estimating the expected purchase of cat food after an ad campaign → Incorrect

This is a prediction task, best suited forregression models, which are part of supervised learning.

Thus,Option A is the best answer, asclusteringis used togroup shoppers based on tendencies without predefined labels​.

Certified Tester AI Testing Study Guide References:

ISTQB CT-AI Syllabus v1.0, Section 3.1.2 (Unsupervised Learning - Clustering and Association)

ISTQB CT-AI Syllabus v1.0, Section 3.3 (Selecting a Form of ML - Clustering)​.

Automation bias, also known as complacency bias, occurs when humans over-rely on automated systems and fail to question or validate the system’s output. In this scenario, the auto-text correction feature of the word processing tool incorrectly suggests "Isle of Eight" instead of "Isle of Wight." The issue arises because multiple UAT testers accept the incorrect suggestion without noticing it, demonstrating a reliance on the AI-based system rather than their own judgment.

Automation bias is commonly seen in:

Text correction systems, where users accept incorrect suggestions without verifying them.

Medical diagnosis AI tools, where doctors may rely too much on AI recommendations.

Autonomous driving systems, where drivers become overly dependent on automation and fail to react in critical situations.

Section 7.4 - Testing for Automation Bias in AI-Based Systemsexplains that automation bias occurs when people accept AI-generated outputs without verifying them, often leading to incorrect decisions​.

Reference from ISTQB Certified Tester AI Testing Study Guide:

The question asks which characteristic is least likely to cause safety-related issues for an AI system. Let's evaluate each option:

Non-determinism (A): Non-deterministic systems can produce different outcomes even with the same inputs, which can lead to unpredictable behavior and potential safety issues.

Robustness (B): Robustness refers to the ability of the system to handle errors, anomalies, and unexpected inputs gracefully. A robust system is less likely to cause safety issues because it can maintain functionality under varied conditions.

High complexity (C): High complexity in AI systems can lead to difficulties in understanding, predicting, and managing the system's behavior, which can cause safety-related issues.

Self-learning (D): Self-learning systems adapt based on new data, which can lead to unexpected changes in behavior. If not properly monitored and controlled, this can result in safety issues.

References:

ISTQB CT-AI Syllabus Section 2.8 on Safety and AI discusses various factors affecting the safety of AI systems, emphasizing the importance of robustness in maintaining safe operation.

Probabilistic and non-deterministic AI-based systemsdo not always produce the same output for identical inputs. This makes traditional testing approaches ineffective. Instead, the best approach is torun tests multiple times and analyze results statistically.

Statistical Validity:Running tests multiple times ensures that observed results are statistically significant. Instead of relying on a single test run,analyzing multiple iterations helps determine trends, probabilities, and outliers​.

Expected Result Tolerance:AI-based systems may produce different results within an acceptable range. Defining acceptable tolerances (e.g., "result must be within 2% of the optimal value") improves test effectiveness​.

A (Run Several Times for the Same Correct Result):AI systems are ofteninherently non-deterministicand may not return the exact same result every time. Expecting identical outputs contradicts the nature of these systems​.

B & C (Decomposing Tests into Data Ingestion Tests):While data ingestion quality is important, it does notdirectlysolve the issue of probabilistic test results. Statistical analysis is the key approach​.

ISTQB CT-AI Syllabus (Section 8.4: Challenges Testing Probabilistic and Non-Deterministic AI-Based Systems)

"For probabilistic systems, running a test multiple times may be necessary to obtain a statistically valid test result."​.

"Where a single definitive output is not possible, results should be analyzed statistically rather than relying on individual test cases."​.

Why Other Options Are Incorrect:Supporting References from ISTQB Certified Tester AI Testing Study Guide:Conclusion:Sinceprobabilistic AI systems do not always return the same result, the best approach is torun multiple test iterations and validate results statistically. Hence, thecorrect answer is D.