Test configurations: specifying test platforms
Your users will probably install or run your app on a wide variety of configurations, such as different operating systems, web browsers, and other variations. You will want to run at least some of your tests in environments that have those different configurations. Use your test plan to decide which tests you want to run on which configurations. You have to make sure that when you run your tests that you have set up your environments for the configurations that you need.
You might draw up a schematic matrix of the combinations that you want to test:
Visual Studio Ultimate, Visual Studio Premium, Visual Studio Test Professional
Connect Microsoft Test Manager to your test project and open your test plan. Open your test plan by opening Testing Center, Plan, Contents.
Select one or more tests, then choose Configurations.
Set the configurations you want to run the tests on.
Don’t see the configurations you want? Choose All configurations. If you still don’t see what you need, learn how to define your own configurations.
I have a test case that appears in several test plans and test suites. Do I have to set the configurations for each of these test points?
Yes. The same test case can have different configuration settings in different test suites and test plans.
When you want to run a test that has multiple configurations, you'll see that it appears more than once in the run list.
Set up a testing platform for a particular configuration, and then sort the list to show the tests to run on that configuration.
When you run a test, a reminder of the required configuration appears on the Test Runner window.
Team Web Access
Microsoft Test Manager
Test Runner doesn't verify that you're actually running on the specified configuration. However, if you use Microsoft Test Manager, system information is stored in the test log.
A few configurations are already defined for you, but you'll probably want to add your own.
A test configuration is a combination of configuration variable values. Your configuration variables could be, for example, operating system, browser, CPU type, database. A configuration might be "Windows 7 + 32-bit CPU" or "Windows 8 + 64-bit CPU."
Choose Testing Center, Organize, Test Configuration Manager.
To add your own configuration variables and values, choose Manage configuration variables:
Create new configurations that your tests can use: