Understanding solution evaluation

Question 1

What is solution evaluation?

Answer 1

Solution evaluation is the process of validating whether a proposed solution effectively solves a problem or meets a business need.

Question 2

What is a solution?

Answer 2

A solution solves a problem or takes advantage of an opportunity to meet a business need.

Question 3

What does the term “validate” mean in the context of solution evaluation?

Answer 3

In this context, “validate” means to confirm that the solution addresses the problem effectively, rather than verifying that the solution works.

Question 4

What are the two key aspects project managers focus on during solution evaluation?

Answer 4

Project managers focus on confirming stakeholder value and measuring organizational impact.

Question 5

How do project managers confirm stakeholder value?

Answer 5

They compare what stakeholders expected with the actual results delivered by the solution.

Question 6

What is the difference between validation and verification?

Answer 6

Validation checks if the solution solves the problem (value), while verification checks if the solution works as intended.

Question 7

What metrics can be used in solution evaluation?

Answer 7

• Project metrics: financial, cost, velocity
• Customer and marketing: satisfaction, market share
• Operational: features and value
• Functionality: Finctional and non functional

Question 8

What is a continuous activity in adaptive approaches to solution evaluation?

Answer 8

In adaptive approaches, solution evaluation is a continuous activity where the solution’s effectiveness is regularly assessed.

Question 9

What is “day-in-the-life testing”?

Answer 9

Day-in-the-life testing is a semi-formal testing method conducted by a domain expert to compare actual results against use case scenarios.

Question 10

What is the role of user stories in adaptive solution evaluation?

Answer 10

User stories are evaluated for their value, and new user stories are assessed for relevance and priority.

Question 11

Techniques for validating solutions

Answer 11

• Surveys, and focus groups
• User, integration and acceptance tests
• Analysing expected benefits vs actuals
• Investigating defects and causes

Question 12

What is a “go/no go” decision?

Answer 12

A go-no-go decision is a critical point where stakeholders decide whether to proceed with the solution based on its evaluation.

Question 13

How does solution evaluation differ between predictive and adaptive projects?

Answer 13

Predictive projects focus on scope acceptance tests and defined requirements, while adaptive projects evaluate implemented user stories and their business value.