CTAL-TM_Syll2012 Exam Dumps - ISTQB Certified Tester Advanced Level - Test Manager [Syllabus 2012]

Question # 4

Reviews

You are the Test Manager of a project that adopts a V-model with four formal levels of testing: unit, integration, system and acceptance testing.

On this project reviews have been conducted for each development phase prior to testing, which is to say that reviews of requirements, functional specification, high-level design, low-level design and code have been performed prior to testing.

Assume that no requirements defects have been reported after the release of the product.

Which TWO of the following metrics do you need in order to evaluate the requirements reviews in terms of phase containment effectiveness?

Number of correct responses: 2

K32 credits

Number of defects found during the requirements review

Total number of defects attributable to requirements found during unit, integration, system and acceptance testing

Total number of defects found during functional specification review, high-level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing

Time to conduct the requirements review

Total number of defects attributable to requirements, found during functional specification review, high-level design review, low-level design review, code review, unit testing, integration testing, system testing and acceptance testing

Full Access

Question # 5

Reviews

Consider the following list of statements about audits and management reviews:

I. Audits are usually more effective than management reviews at finding defects

II. Audits and management reviews have the same main goals, the only difference is related to the roles and level of formality

III. A typical outcome of an audit includes observations and recommendations, corrective actions and a pass/fail assessment

IV. An audit is not the appropriate mechanism to use at the code review in order to detect defects prior to dynamic testing

Which of the following statements is true?

Number of correct responses: 1

K21 credit

I. and III. are true; II. and IV. are false;

II. and III are true; I. and IV. are false;

III. and IV. are true; I and II are false;

I, III and IV are true; II. is false;

Full Access

Question # 6

Reviews

Which of the following factors could negatively influence a review?

Number of correct responses: 1

K21 credit

Include people with the adequate level of knowledge, both technical and procedural

Include people who are detail-oriented and scrupulous at finding issues

Include as many people as possible in order to have more viewpoints about possible problems on the item under review

Include people able to contribute to a clear, thoughtful, constructive and objective discussion

Full Access

Question # 7

Reviews

You are a Test Manager working for a software organization where reviews have never been applied. After a meeting with your managers examining a business case for reviews, (including their costs, benefits, and potential issues), the management finally decides to adopt formal reviews for future projects.

You have been given a budget that you have spent to provide training in the review process and to introduce the review process on a pilot project.

On that pilot project the introduction of reviews has been very positive in terms of positive involvement from all the participants. All the reviews applied to different documents have been very effective for their purposes (especially at revealing defects).

Which of the following answers describes an important success factor for the introduction of formal reviews which is missing in this scenario?

Number of correct responses: 1

K43 credits

Management support

Participant support

Definition and use of metrics to measure the ROI (Return On Investment)

Training in the review process

Full Access

Question # 8

The following are the requirements identified as â€œcriticalâ€:

REQ-SEL-001. The user shall be able to combine all the three products with all the four durations to define an item to purchase

REQ-SEL-002. The user shall be able to add a maximum of six different items to the shopping cart

REQ-PUR-001. The user shall be able to purchase all the items in the shopping cart using a credit voucher

REQ-PUR-002. The user shall be able to purchase all the items in the shopping cart using the available credit already charged on the smartcard

REQ-PUR-003. The user shall be able to purchase all the items in the shopping cart using all the accepted credit cards (Visa, MasterCard and Great Wall Card)

REG-LOGO-001. The user shall be able to logout (by clicking the logout button) from both the â€œselectâ€ and â€œpurchaseâ€ pages going back to the â€œbrowseâ€ page (anonymous navigation)

Moreover the following quality risk item has been identified as â€œcriticalâ€:

QR-P1. The web customer portal might not be able to provide the expected response time (less than 10 sec) for the purchase transactions under a load of up-to 1000 concurrent users

Test analysis for system testing has just begun and the following test conditions have been identified:

TC-SEL-01. Test the combinations of products and durations to define an item to purchase

TC-SEL-02. Test the maximum number of items, which can be added to the shopping cart

TC-PUR-01. Test the purchase of an item

TC-PUR-02. Test the purchase of an item with the credit charged on the smartcard

What is the MINIMUM number of test conditions that must be added to fulfill both the EXCR1 and EXCR2 exit criteria?

Number of correct responses: 1

K32 credits

Full Access

Question # 9

Testing Process

The following are the exit criteria described in the test plan of a software product:

EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases).

EX2. All test cases in the test suite must be run during the execution phase.

EX3. Defects are classified into two categories: â€œCâ€ (critical defect) and â€œNCâ€ (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase.

Which of the following information is useless when the specified exit criteria is evaluated?

Number of correct responses: 1

K21 credit

A traceability matrix showing the relationships between the product risk items and the test cases

A list of all the open defects with the associated classification information extracted from the defect tracking system

A chart, showing the trend in the lag time from defect reporting to resolution, extracted from the defect tracking system

The execution status of all the test cases extracted from the test management tool

Full Access

Question # 10

The following is the unique â€œcriticalâ€ quality risk item that has been identified:

CR-RSK-1. The GUI of the application might accept non-integer values for the input field designed to get the number of bottles from the user

Test analysis for system testing has just begun and the following test conditions have been identified:

TC-SEL-2. Test the selection of the package sizes

TC-SEL-4. Test wrong numbers of bottles for an order

TC-CR-RSK-1. Test the accepted values from the input field designed to get the number of bottles from the user

Assume that you have used traceability to determine the logical test cases that cover all the requirements and the single risk item identified in that scenario.

Which of the following is a positive logical test that is complete and correct, and covers the REQ-SEL-4 requirement?

Number of correct responses: 1

K32 credits

Select a 6-bottles package, then try to insert 5 bottles; verify that no error messages are displayed

Select a 6-bottles package, then try to insert 7 bottles; verify that no error messages are displayed

Select a 6-bottles package, then try to insert 7 bottles; verify that the "Invalid number of bottles" message is displayed

Select a 6-bottles package, then try to insert 7 bottles

Full Access

Question # 11

Which of the following is a factor that is likely to increase the test estimate? [1]

Use of a new technology

A requirement for high level test documentation

Assigned personnel who are experienced on working with similar projects in similar environments

Static test data

Full Access

Answer:

Explanation:

A test estimate is an approximation of the amount of effort, time, and resources required to perform testing activities for a software project1.Â A test estimate can be influenced by various factors, such as the size, complexity, and quality of the software, the scope, objectives, and approach of the testing, the skills, experience, and availability of the test team, the tools, methods, and standards used for testing, and the constraints, risks, and assumptions related to the project2. One of the factors that is likely to increase the test estimate is the use of a new technology.Â A new technology is a technology that is unfamiliar or unproven to the test team or the organization, such as a new programming language, framework, platform, or tool3. The use of a new technology can increase the test estimate because it may require more time and effort to learn, understand, and apply the technology, as well as to deal with potential issues, challenges, or limitations that may arise from the technology. Therefore, option A is the correct answer. Option B is incorrect because a requirement for high level test documentation is not a factor that is likely to increase the test estimate, but rather a factor that is likely to increase the test documentation effort. Test documentation is the set of documents that describe the test basis, test objectives, test design, test procedures, test results, and test evaluation of a software project. A requirement for high level test documentation means that the test documents need to be detailed, comprehensive, and consistent, which may require more time and effort to produce, review, and maintain. However, this does not necessarily affect the test estimate, as the test documentation effort can be considered as a separate or parallel activity to the test execution effort. Option C is incorrect because assigned personnel who are experienced on working with similar projects in similar environments is not a factor that is likely to increase the test estimate, but rather a factor that is likely to decrease the test estimate. Experienced personnel are personnel who have the relevant knowledge, skills, and abilities to perform the testing activities for a software project. Assigned personnel who are experienced on working with similar projects in similar environments can decrease the test estimate because they may require less time and effort to understand, design, implement, and execute the tests, as well as to deal with potential issues, challenges, or limitations that may arise from the project. Option D is incorrect because static test data is not a factor that is likely to increase the test estimate, but rather a factor that is likely to decrease the test estimate. Test data is the data that is used as input or output for the tests. Static test data is test data that is fixed and predefined, and does not change during the test execution.Â Static test data can decrease the test estimate because it may require less time and effort to create, manage, and maintain, as well as to ensure the validity, reliability, and traceability of the test data.Â References:Â 1: ISTQB Glossary, Test EstimateÂ 2: ISTQB Advanced Level Test Manager Syllabus, Section 3.1.1Â 3:Â What is New Technology? - Definition fromTechopediaÂ :Â The Impact of New Technologies on Software TestingÂ : ISTQB Glossary, Test Documentation : ISTQB Glossary, Experienced-Based Test Technique : ISTQB Glossary, Test Data : ISTQB Glossary, Static Test Data :Â Test Manager - ISTQB not-for-profit associationÂ : [ISTQB Foundation Level #38 â€“ Test Estimation Techniques - Software Testing Mentor] : [What are the estimation techniques in software testing?]

Question # 12

The test team is using a distributed model for testing.

What is the primary factor you should consider with this model? [1]

Alignment of methodologies

Co-location of test team

Provision of growth opportunities for the individual testers

Planned vs. actual hours

Full Access

Answer:

Explanation:

A distributed model for testing is a testing model that involves testers working in different locations, time zones, or organizations, such as onshore, offshore, or nearshore1.Â The primary factor that you should consider with this model is the alignment of methodologies, which means that the testers follow the same or compatible testing processes, standards, tools, and techniques, regardless of their location, time zone, or organization2.Â The alignment of methodologies can help to ensure the consistency, quality, and efficiency of the testing activities, as well as to facilitate the communication, coordination, and collaboration among the testers3. Therefore, option A is the correct answer. Option B is incorrect because co-location of test team is not a factor that you should consider with a distributed model for testing, but rather a factor that is contrary to a distributed model for testing.Â Co-location of test team means that the testers work in the same physical location, which can have some advantages, such as easier communication, faster feedback, and stronger team spirit, but also some disadvantages, such as higher costs, limited resources, and less diversity4. Option C is incorrect because provision of growth opportunities for the individual testers is not a factor that you should consider with a distributed model for testing, but rather a factor that is relevant to any testing model. Provision of growth opportunities for the individual testers means that the testers are given the chance to learn new skills, gain new experiences, and advance their careers, which can have some benefits, such as increased motivation, productivity, and retention of the testers. Option D is incorrect because planned vs. actual hours is not a factor that you should consider with a distributed model for testing, but rather a factor that is relevant to any testing model. Planned vs.Â actual hours is a testing metric that compares the estimated and the actual effort spent on the testing activities, which can help to measure the accuracy of the test estimation, the efficiency of the test execution, and the variance of the test schedule.Â References:Â 1: ISTQB Glossary, Distributed TestingÂ 2:Â Distributed Testing - Software Testing FundamentalsÂ 3: ISTQB Advanced Level Test Manager Syllabus, Section 3.2.1Â 4:Â Co-located vs. Distributed Teams: Whatâ€™s the Difference?Â :Â How to Provide Growth Opportunities for EmployeesÂ :Â Software Testing Metrics: What is, Types & Example

Question # 13

Your Project Manager has challenged you to come up with a process improvement strategy using the IDEAL model.

Which step within the process defines the success criteria? [2]

Entrance

Analysis

Diagnosing

Initiation

Full Access

Question # 14

Which of the following organizational structures would be considered unorthodox? [1]

Developers within the same team unit test each others' code prior to handing over to a separate testing team for system testing

Developers and testers are integrated within the same project team, each role focusing on a different level of testing

After developers are done unit testing, business analysts alpha test the system before handing over to a separate testing team for system testing

DBAs confirm the referential integrity of the database and developers complete their unit testing before handing over to

external organization for system testing

Full Access

Question # 15

Your test team has created a custom automation tool that will be used for an upcoming release. Now that the tool has been coded, what

should be the next step? [1]

Create the tool support guide

Perform an ROI study

Compare the new tool to open source tools

Test the tool

Full Access

Question # 16

Improving the Testing Process

Which of the following statements about the STEP test process improvement model is true?

Number of correct responses: 1

K21 credit

In the STEP model, tests validate the requirements and use cases when they are developed

The STEP model stresses defect detection and demonstration of capability, whereas the defect prevention is a secondary potential goal of testing

The STEP model assures that the system requirements specification and the test design specification processes don't overlap

In the STEP model, testware design occurs after coding

Full Access

Question # 17

Improving the Testing Process

Consider the following statements describing the importance of improving the test process:

I. Test process improvement is important because being focused only on the test process it can provide recommendations to improve the test process itself, but it canâ€™t indicate or suggest improvement to areas of the development process

II. Test process improvement is important because it is much more effective than software process improvement to improve the quality of a software system

III. Test process improvement is important because several process improvement models (STEP, TPI Next, TMMi) have been developed over the years

IV. Test process improvement is important because every organization, regardless of the context, should always achieve the maximum level of maturity of testing described in the test improvement models such as TMMi

Which of the following answers is correct?

Number of correct responses: 1

K21 credit

I. and IV. are true; II. and III. are false

I., II., III. and IV are false

I., II. and III are true; IV. is false

I., II. and III. are false; IV. is true

Full Access

Question # 18

Improving the Testing Process

Which of the following statements about the TMMi test process improvement model is true?

Number of correct responses: 1

K21 credit

In TMMi all the process areas at lower levels must be 75% complete by achieving specific and generic goals in order to claim the higher level

TMMi provides an approach for test process improvement such as the IDEAL (Initiating, Diagnosing, Establishing, Acting and Learning) model

TMMi has a staged architecture for process improvement with seven maturity levels

At TMMi level 1 testing is chaotic without a defined process, and it is often seen as the same as debugging

Full Access

Question # 19

People Skills â€“ Team Composition

Which of the following would you expect to be most likely an example of a motivating factor for testers?

Number of correct responses: 1

K21 credit

The resources allocated for the testing activities are not sufficient and donâ€™t allow the testers to contribute to the quality of the product

The testers contribution to the quality of the software products developed from an organization is recognized with increased responsibilities

The same regressions tests are executed manually by the same testers, for every product release, without any progression in content

The testers are asked to perform, in parallel with their testing tasks, other tasks unrelated to their testing responsibilities

Full Access

Question # 20

You are using this skills assessment spreadsheet in order to define a training development plan for your test team.

Your objective is to fill the skill gaps by having at least a team member rated as an expert for each skill identified for the â€œtechnical expertiseâ€ and â€œtesting skillsâ€ sections, and with the ability to train the other team members.

Considering the budget constraints you can send only one person to a training course.

Based only on the given information, which of the following answers would you expect to be the best option to achieve your objective?

Number of correct responses: 1

K43 credits

Send Robert to a performance testing training course

Send Alex to a performance testing training course

Send John to a performance testing training course

Send Mark to a test automation training course

Full Access

Question # 21

Test Tools and Automation

In your organization the following tools of the same vendor are currently in use: a requirements management tool, a test management tool and a bug tracking tool.

You are the Test Manager.

You are currently evaluating a test automation tool of the same vendor (to complete the vendor's tool suite) against an interesting open-source test automation tool under the GNU GPL (General Public License).

There are no initial costs associated to that open-source tool.

Which of the following statements associated to the selection of the open-source tool is correct in this scenario?

Number of correct responses: 1

K21 credit

The open-source tool can be modified but only if the community of developers of that tool gives you the formal permission to modify it

There are no initial costs for the open-source tool but you should carefully consider the costs associated to the integration with the existing tools and also evaluate the recurring costs

There are no initial costs for the open-source tool because open-source tools are usually low-quality, while vendor tools have always a better quality than the corresponding open-source tools

The open-source tool can be modified but it canâ€™t be distributed further in any way

Full Access

Question # 22

Test Tools and Automation

Assume you are managing a test automation project for a mission-critical system.

Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework.

Which of the following management issues associated to the development of this custom automation framework is least likely to manage?

Number of correct responses: 1

K21 credit

Proper testing for the custom automation framework must be performed

The custom automation framework will require an adequate documentation

The changes to the custom automation framework should be communicated to all external users of this tool under the GNU license

The custom automation framework will need proper maintenance

Full Access

Question # 23

Test Tools and Automation

Assume you are the Test Manager in charge of independent testing for avionics applications.

You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):

- a BOOT-X CSCI that must be certified at level B of the DO-178B standard

- a DIAG-X CSCI that must be certified at level C of the DO-178B standard

- a DRIV-X CSCI that must be certified at level A of the DO-178B standard

These are three different software modules written in C language to run on a specific hardware platform.

You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.

Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).

The source code of the tool is available.

Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.

Which of the following are the three main concerns related to that open-source tool selection?

Number of correct responses: 3

K43 credits (2 credits out of 3 credits correct, 1 credit point)

Does the tool support all the types of code coverage required from the three levels A, B, C of the DO-178B standard?

Does the tool have a good general usability?

What are the costs to qualify the tool as a verification tool under the DO-178B?

Is the installation procedure of the tool easy?

Does the tool require a system with more than 4GB of RAM memory?

Is the licensing scheme of the tool compatible with the confidentiality needs of the avionics company?

Full Access

Question # 24

Test Tools and Automation

After a selection process you have selected a test management tool that is going be introduced in your organization and used by your test team in a pilot project.

You have already identified the member of your test team who will be the administrator of the tool, since he/she has a significant experience with the administration of test management tools and so he/she is able to make effective and efficient up-front decisions about "how" the tool will be used. You have also developed a training plan for the other members of your test team.

In collaboration with the administrator of the tool you have also devised standard ways of managing, storing and maintaining the tool and its assets including backup/restore procedures.

You have also analyzed standard formats supported by the tool (CSV, XLS, XML, etc.) to export, import and archive all the information managed by the tool itself (requirements, test case specifications, test plans etc.) for compliance with the most important test management tools, in order to minimize the impacts of migrating this information to a new tool that could replace the existing one in the future.

Which of the following phases in the lifecycle of the new tool has NOT been adequately considered in this description?

Number of correct responses: 1

K21 credit

Acquisition

Support and maintenance

Evolution

Retirement

Full Access

Question # 25

Test Tools and Automation

Assume you are a Test Manager involved in system testing of a CRM application for a Pay-TV company. Currently the application is able to support a proper number of users assuring the required responsiveness. Since the business is expected to grow, you have been asked to evaluate the ability of the application to grow to support more users while maintaining the same responsiveness.

Which of the following tools would you expect to be the most useful at performing this evaluation?

Number of correct responses: 1

K21 credit

Coverage tools

Test management tools

Static analysis tools

Performance tools

Full Access

Question # 26

Defect Management

Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects.

When a defect is found for investigation a defect report is created in â€œOpenedâ€ state that is the unique initial state. The defect report status has also a unique finale state that is the â€œClosedâ€ state.

The following state transition diagram describes the states of this defect management process:

where only the initial (â€œOpenedâ€) and final (â€œClosedâ€) states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named.

Which of the following assignments would you expect to best complete the defect management process?

Number of correct responses: 1

K32 credits

V=Rejected , W=Corrected , X=Validated, Y=Re-Opened, Z=Assigned

V=Assigned, W=Validated , X=Corrected, Y=Re-Opened, Z=Rejected

V=Assigned, W=Corrected , X=Validated, Y=Re-Opened, Z=Rejected

V= Corrected, W=Assigned, X=Validated, Y=Corrected, Z=Rejected

Full Access

Question # 27

Defect Management

Which of the following information would you expect to be the most useful to perform a defect clustering analysis?

Number of correct responses: 1

K21 credit

The trend in the lag time from defect reporting to resolution

The defect component information

The lifecycle phase in which the defect has been introduced

The defect removal efficiency information

Full Access

Question # 28

Defect Management

Consider a defect report and assume that a part of its lifecycle includes the following states:

New: Is the initial state

Working: Means that the developers are addressing the defect in order to produce a fix for the defect

Clarification: Means that the developers need more information from the tester to address the defect and produce a fix for the defect and the tester is working to provide this information to the developers

Verification: Means that a fix for the defect has been produced and the tester is running the adequate tests to verify whether the fix solves the defect

Closed: is the final state

Which of the following answers represents an invalid sequence of states that canâ€™t lead the bug report to the â€œClosedâ€ state?

Number of correct responses: 1

K21 credit

New, Working, Verification, Working, Clarification, Working, Verification, Closed

New, Working, Clarification, Working, Verification, Closed

New, Working, Verification, Working, Clarification, Working, Closed

New, Working, Verification, Closed

Full Access

Question # 29

Defect Management

During the system testing phase a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a â€œnewâ€ state, indicating it needs to be investigated.

Which THREE of the following information items canâ€™t yet be present in the incident report?

Number of correct responses: 3

K32 credits (2 credits out of 3 credits correct, 1 credit point)

The type of defect that caused the failure

The actual and the expected result highlighting the failure

The lifecycle phase in which the defect has been introduced

What really caused the failure (actual cause)

Steps to reproduce the failure, including screenshots, database dumps and logs where applicable

Full Access

Question # 30

Test Management

You are managing the system testing for a SOA based system. The integrated system consists of several subsystems:

- a SOA middleware

- a CRM (Customer Relationship Management) system

- a BRM (Billing and Revenue Management) system

- a SMS (Subscriber Management System) system

and you performed a risk analysis based on these subsystems.

At the end of the scheduled period for test execution you produce a first classical report based on the traditional metrics of testing. Test pass/fail status and bug status (open/resolved) That table provides you a distorted picture of the quality risk, because there is no indication of the risk level of the failed tests, the tests not run, or the open bugs. Thus, you produce the following table to solve this distortion issue:

In the table above, where you have introduced the concept of risk weighting, the highest risk test or bug report has a score of 1, while the lowest risk test or bug report has a score of 0.04.

Which of the following subsystems, based on the risk scores of the table, is most risky?

Number of correct responses: 1

K43 credits

SOA

CRM

BRM

SMS

Full Access