Test Results Perspective

The Test Results perspective shows all the fields associated with tests and their results. The Test Results perspective is based on the Test Result relational table that enables reporting on test results as either a property of the tests or as an independent outcome. You can also answer questions about changes to the result outcomes. These ways of reporting on the test results can be to answer the following types of questions:

  • Which tests are failing in the current build?

    In this case, if a test is run multiple times against a build, the answer is based on the latest result for that test using that build.

  • How many failed results have occurred in the current build?

    In this case, if a test is run multiple times against a build, each result is counted separately.

  • What is the latest result for a particular test across a range of builds and test runs?

    In this case, each test can be listed with its corresponding latest result across the selected builds and test runs.

Note

In order to use perspectives with the Team Foundation cube, you must use Microsoft SQL Server 2005 Enterprise Edition or SQL Server 2005 Enterprise (64) Edition on the data tier. SQL Server 2005 Standard Edition that ships as part of Team Foundation Server, does not support the use of perspectives. When you use SQL Server 2005 Standard Edition, the cube elements from all perspectives reside in the Team System data cube.

Measures

The following table describes the measures that are included in the Test Results perspective.

Measure Description

Cumulative Result Count

Counts the latest version of each result in a particular build.

Latest Result

Displays the latest results when you use it together with the Test dimension, and displays the latest result of the test. This calculation requires significant computation and should be used when the number of tests being analyzed is constrained.

Result Count

Counts all the results individually.

Result Transition Count

Counts all the results where the outcome for a result in a particular build changed.

Shared Dimensions

The following table describes the attributes that are included in the Test Results perspective. You can aggregate the measures along each of these attributes.

Dimension Use Dimension Description

Area

Area

The area classification of the test result. If the test result did not specify an area when it was published, the area is set to "Unknown."

Build

Build

Number or name used to uniquely identify the build.

Build Start Time

Build

Date and time the build began.

Build Type

Build

The build type of the build against which the test result was generated. For more information, see Build Perspective.

Date

Date

The date that the test result was generated.

Date

Finished Date

The finish date of the test run that generated the result.

Build Flavor

Flavor

The build flavor of the build against which the test result was generated. For more information, see Build Perspective.

Iteration

Iteration

The area classification of the test result. If the test result did not specify an area when it was published, the area is set to "Unknown."

Alias

Owner

The alias of the author or current owner of the test.

Person

Owner

The name of the author or current owner of the test.

Platform

Platform

The operating system for which the build was made. The possible values include the following:

  • X86

  • X64

  • Itanium

  • Win32

  • Any CPU

  • .NET

  • Mixed Platforms

  • Any valid operating system created by the process template.

  • This value is set in the New Team Build Type Creation Wizard. For more information, see How to: Create a New Build Type.

Team Project

Team Project

The team project referenced when publishing the load test results.

ID

Work Item

The work item's ID, as assigned when the work item was created.

Previous State

Work Item

The previous state of the work item.

Work Item Type

Work Item

The type of the work item.

Reason

Work Item

The reason that the state of the work item changed.

Rev

Work Item

The revision of the work item.

State

Work Item

The state of the work item.

Title

Work Item

The title of the work item.

(other)

Work Item

Other attributes depending on the process template used to create the team project. For more information, see the "The Work Item Dimension" section of Current Work Item Perspective.

Test Result Dimensions

The following table lists all dimensions and attributes specific to the test measures in the cube.

Attribute Dimension Description

Machine

Agent Machine

The computer on which the test was run.

Alias

Assigned To

The alias of the person the test is assigned to.

Person

Assigned To

The name of the person the test is assigned to.

Test Category

Category

This hierarchy categorizes test results according to the test list in which they are run. This is a parent-child hierarchy, and can be used to drill down into sub-categories of tests, if nested test lists are used when tests are executed and published. For more information, see Test Results Reported.

Outcome

Outcome

The outcome of the test, for example, Passed, Failed, or Inconclusive.

Outcome Passing

Outcome

A flag that is set to True if the outcome of a test is passing, or false if the outcome is anything other than passing.

Result

Result

The name of the test result.

Test

Result

The name of the test that generated the result. For more information, see Test Results Reported.

Test Description

Result

A description of the test associated with the result. For more information, see Test Results Reported.

Test Result

Result

A hierarchy of the Test and Result. This enables drill-down from results for a particular test to the individual results of that test.

Test Type

Result

The type of the test result, for example, Unit Test, Web Test, Load Test. For more information, see Test Results Reported.

Run

Run

The Run Name of the Test Run that generated the test result. For more information, see Test Results Reported.

Remote Run

Run

A flag, either True or False. This indicates whether the test run that produced the result was a remote test run. For more information, see Test Results Reported.

Alias

Run By

The alias of the person or account under which the test was run. For more information, see Test Results Reported.

Person

Run By

The name of the person or account under which the test was run. For more information, see Test Results Reported.

See Also

Concepts

Work Item History Perspective
Test Results Schema

Other Resources

Understanding the Structure of the Data Warehouse Cube
Perspectives