Use Grammar Tuning Advisor Results

Article
08/18/2014

This content is no longer actively maintained. It is provided as is, for anyone who may still be using these technologies, with no warranties or claims of accuracy with regard to the most recent product version or service release.

Use Grammar Tuning Advisor to find user input that is not covered by speech recognition grammars. Grammar Tuning Advisor first performs re-recognition using a dictation language model in parallel with the original grammar. The dictation language model is used to recognize utterances not included in the original grammar. Grammar Tuning Advisor then performs clustering on utterances not found in the original grammar to produce results.

Grammar Tuning Advisor Data

Grammar Tuning Advisor cycles use the data in the current view in Analytics and Tuning Studio. To control the dataset on which to run a Grammar Tuning Advisor cycle, specify filters in the Filters pane or specify a particular turn name in the Grammar Tuning Advisor Settings dialog box. Transcriptions in the data are ignored.

Grammar Tuning Advisor Output

Grammar Tuning Advisor output at the end of a cycle appears as a new view in Analytics and Tuning Studio within two side-by-side panes.

Estimated out-of-grammar input Pane

Each row in the Estimated out-of-grammar input pane represents a cluster of similar results. Clusters are labeled with the phrase that best matches the utterance. For example, the three utterances "six tickets," "two tickets," and "two tickets please" can be clustered and labeled as *tickets*. The asterisk wildcard character indicates other words included in the cluster, with the position of the words indicated by the asterisks. To indicate relative severity, clusters are ranked by frequency of occurrence.

Possible input Pane

The Possible input pane shows, for the selected cluster, the recognized text for each utterance in the cluster. Selecting any of the utterances in this pane starts audio playback for the input.

User Scenarios

Use Grammar Tuning Advisor by repeating a cycle against different grammars. A Grammar Tuning Advisor cycle is defined by the cycle name and the other settings made in the Grammar Tuning Advisor Settings dialog box. To rerun a Grammar Tuning Advisor cycle, enter the name of the previous cycle in the Cycle name box in the Grammar Tuning Advisor Settings dialog box.

Changing Grammar Tuning Advisor Grammars

Rerun a Grammar Tuning Advisor cycle against updated grammars to see the benefit of changes. Change the grammars used in a cycle by deactivating old grammars and adding revised versions as new grammars. For more information, see Grammar Tuning Advisor Settings Dialog Box.

Also consider using Re-recognizer to validate changes to grammars. For more information, see Use Re-recognizer to Validate Tuning Changes.

Share via