80 out of 117 rated this helpful - Rate this topic

Using the Windows App Certification Kit

To give your app the best chance of getting certified, validate and test it on your computer before you submit it for certification and listing in the Windows Store. This topic shows you how to install and run the Windows App Certification Kit. For more details on specific tests carried out by this kit, refer to the following topics:

For a high level look at the certification process, and where the use of this tool fits in, see Certify your app.

Prerequisites

If you are developing a Windows 8 app

  • You must install and run Windows 8.
  • You must install the latest version of the Windows App Certification Kit, which is included in the Windows Software Development Kit (SDK) for Windows 8.

    Note  Because it is frequently recommended that you test your app on Windows RT, be sure to also install the Windows App Certification Kit for Windows RT (available as a separate download for Windows RT devices).

If you are developing a Windows 8.1 Preview app

  • You must install and run Windows 8.1 Preview.

  • You must install the Windows App Certification Kit 3.0 for Windows 8.1 Preview, which is included in the Windows Software Development Kit (SDK) for Windows 8.1 Preview.

    Note  Because it is frequently recommended that you test your app on Windows RT, be sure to also install the Windows App Certification Kit for Windows RT (available as a separate download for Windows RT devices).

General requirements

  • You must have a valid developer license for your computer. See Get a developer license to learn how.

  • You must deploy the Windows Store app that you want to test to your computer.

    Note  If you're using Visual Studio, you can run the Windows App Certification Kit when you create your app package. See Creating an app package to learn how.

Instructions

Validate your Windows Store app by using the Windows App Certification Kit interactively

  1. From the Start menu, search Apps, find Windows Kits, and click Windows App Cert Kit.

  2. From the Windows App Cert Kit, select the category of validation you would like to perform. For example: If you are validating a Windows Store app, select Validate a Windows Store app.

    The Windows App Certification Kit lists the most commonly used Windows Store apps that you have deployed on your computer. If the app that you want to test is not listed in the list, you can click on "My app isn’t listed." to retrieve a comprehensive list of all the apps that are on your system.

  3. Pick the Windows Store app you want to test, and then click Next.

  4. From the next screen, select the tests you want to run on your Windows store app and click Next.

    The Windows App Certification Kit begins validating the app.

  5. At the prompt after the test, enter the path to the folder where you want to save the test report.

    The Windows App Certification Kit creates an HTML along with an XML report and saves it in this folder.

  6. Open the report file and review the results of the test.

Validate your Windows Store app by using the Windows App Certification Kit from a command line

  1. In the command window, navigate to the directory that contains the Windows App Certification Kit and run appcertui.exe.

    Note   The default path is C:\Program Files\Windows Kits\8.0\App Certification Kit.

  2. From the folder that contains the Windows App Certification Kit, enter these commands in this order.

    appcert.exe reset
    appcert.exe test -apptype windowstoreapp -packagefullname [package full name] -reportoutputpath [report file name]

    where:

    [package full name] is the fully qualified name of the package.

    [report file name] is the fully qualified file name of the XML file that the kit will create to contain the test report.

  3. After the test completes, open the report file named [report file name] and review the test results.

Note   For more info about the Windows App Certification Kit command line, enter the command appcert.exe /?

Remarks

Testing with a low-power computer

The performance test thresholds of the Windows App Certification Kit are based on the performance of a low-power computer.

The characteristics of the computer on which the test is performed can influence the test results. To determine if your app’s performance meets the certification requirements, we recommend that you test your app on a low-power computer, such as an Intel Atom processor-based computer with a screen resolution of 1366x768 (or higher) and a rotational hard drive (as opposed to a solid-state hard drive).

As low-power computers evolve, their performance characteristics might change over time. Refer to the most current certification requirements and test your app with the most current version of the Windows App Certification Kit to make sure that your app complies with the latest performance requirements.

Windows App Certification Kit tests

Tests performed on Windows Store apps

Test namePossible test resultsCertification requirements tested

Crashes & hangs test

Pass

Fail

App reliability

App manifest compliance test

Pass

Fail

Tiles

Package validation

Package details

Windows security features test

Pass

Fail

App security

Supported Windows Store API test

Pass

Fail

App code validation

App termination

Performance test

Pass

Fail

Warning

App performance

App manifest resources test

Pass

Fail

Language validation

Debug configuration test

Pass

Fail

Finished apps

File encoding test

Pass

Fail

Package validation

Direct3D feature level test

Pass

Fail

Direct3D certification requirement

App capabilities test

Pass

Fail

App behavior

Windows Runtime metadata validation

Pass

Fail

Package validation

Package Sanity check

Pass

Fail

Package validation

Resource Usage test

Pass

Fail

App performance

 

Tests performed on Desktop apps

Test namePossible test resultsCertification requirements tested

Clean reversible install

Pass

Fail

App reliability

Install to the correct folders

Pass

Fail

Tiles

Package validation

Package details

Digitally signed file test

Pass

Fail

App security

Support x64 Windows test

Pass

Fail

App code validation

App termination

OS version checking test

Pass

Fail

Warning

App performance

User account control (UAC) test

Pass

Fail

Language validation

Adhere to system restart manager messages

Pass

Fail

Finished apps

Safe mode test

Pass

Fail

Package validation

Multiuser session test

Pass

Fail

Direct3D certification requirement

Crashes and hangs test

Pass

Fail

App reliability

Compatibility and resiliency test

Pass

Fail

App reliability

Windows security best practices test

Pass

Fail

App security

Windows security features test

Pass

Fail

App security

High-DPI support

Pass

Fail

App behavior

 

Testing on ARM devices

If you're creating an app for Windows RT devices, be sure to check out Debugging and testing on Windows RT PCs. It contains info to help you test apps for these devices.

Related topics

Windows App Certification Kit tests

 

 

Build date: 7/1/2013

© 2013 Microsoft. All rights reserved.