Testing your app with the Windows App Certification Kit

72 out of 105 rated this helpful - Rate this topic

To give your app the best chance of getting certified, validate and test it on your computer before you submit it for certification and listing in the Windows Store. Here we tell you how.

Prerequisites

  • You must install and run Windows 8.

  • You must install the latest version of the Windows App Certification Kit, which is included in the Windows Software Development Kit (SDK) for Windows 8.

    Note  Because it is frequently recommended that you test your app on Windows RT, be sure to also install the Windows App Certification Kit for Windows RT (available as a separate download for Windows RT devices).

  • You must have a valid developer license for your computer.

  • You must deploy the Windows Store app that you want to test to your computer.

    Note  If you're using Visual Studio, you can run the Windows App Certification Kit when you create your app package. See Creating an app package to learn how.

Instructions

Validate your Windows Store app by using the Windows App Certification Kit interactively

  1. From the Start menu, search Apps, find Windows Kits, and click Windows App Cert Kit.

  2. From the Windows App Certification Kit, select Validate a Windows Store app.

    The Windows App Certification Kit lists all the Windows Store apps that you have deployed on your computer.

  3. Pick the Windows Store app you want to test, and then click Next.

    The Windows App Certification Kit begins testing the app.

  4. At the prompt after the test, enter the path to the folder where you want to save the test report.

    The Windows App Certification Kit creates an HTML along with an XML report and saves it in this folder.

  5. Open the report file and review the results of the test.

Validate your Windows Store app by using the Windows App Certification Kit from a command line

  1. In the command window, navigate to the directory that contains the Windows App Certification Kit and run appcertui.exe.

    Note   The default path is C:\Program Files\Windows Kits\8.0\App Certification Kit.

  2. From the folder that contains the Windows App Certification Kit, enter these commands in this order.

    appcert.exe reset
    appcert.exe test -apptype windowstoreapp -packagefullname [package full name] -reportoutputpath [report file name]

    where:

    [package full name] is the fully qualified name of the package.

    [report file name] is the fully qualified file name of the XML file that the kit will create to contain the test report.

  3. After the test completes, open the report file named [report file name] and review the test results.

Note   For more info about the Windows App Certification Kit command line, enter the command appcert.exe /?

Remarks

Testing with a low-power computer

The performance test thresholds of the Windows App Certification Kit are based on the performance of a low-power computer.

The characteristics of the computer on which the test is performed can influence the test results. To determine if your app’s performance meets the certification requirements, we recommend that you test your app on a low-power computer, such as an Intel Atom processor-based computer with a screen resolution of 1366x768 (or higher) and a rotational hard drive (as opposed to a solid-state hard drive).

As low-power computers evolve, their performance characteristics might change over time. Refer to the most current certification requirements and test your app with the most current version of the Windows App Certification Kit to make sure that your app complies with the latest performance requirements.

Windows App Certification Kit tests

Tests performed on Windows Store apps

Test namePossible test resultsCertification requirements tested

App manifest policy test

Pass

Fail

Tiles

Package validation

Package details

App manifest resources test

Pass

Fail

Language validation

Crashes & hangs test

Pass

Fail

App reliability

Debug configuration test

Pass

Fail

Finished apps

File encoding test

Pass

Fail

Package validation

Performance test

Pass

Fail

Warning

App performance

Supported Windows Store API test

Pass

Fail

App code validation

App termination

Windows security features test

Pass

Fail

App security

Direct3D feature level test

Pass

Fail

Direct3D certification requirement

 

Tests performed on Desktop apps

Tests the app requirements described in the Certification Requirements for Windows 8 Desktop apps.

Test namePossible test results

Adhere to system restart manager messages

Pass

Fail

Clean reversible install

Pass

Fail

Warning

Compatibility & resiliency test

Pass

Fail

Warning

Digitally signed file test

Pass

Fail

Warning

Install to the correct folders test

Warning

Multiuser session test

Warning

OS version checking test

Pass

Fail

Safe mode test

Pass

Fail

Support x64 Windows test

Pass

Fail

Warning

Test for changes to Windows security features (Attack Surface Analyzer)

Pass

Fail

Test for changes to Windows security features (BinScope Binary Analyzer)

Warning

User account control (UAC) test

Pass

Fail

Warning

 

Testing on ARM devices

If you're creating an app for Windows RT devices, be sure to check out our whitepaper, Windows Store app development for Windows RT PCs. It contains info to help you test apps for these devices.

 

 

Build date: 3/19/2013

Did you find this helpful?
(1500 characters remaining)
© 2013 Microsoft. All rights reserved.