Share via


Natural Interaction 

Tablet PC users rely on pen and touch input as primary methods of controlling applications and entering information. This section discusses the use of pen and touch input as substitutes for traditional pointing devices, such as the mouse. Windows Vista provides the following new and enhanced technologies to ensure that users of mobile PCs are able to interact with their computers in mobile scenarios.

Digital Ink Input

Digital ink is important to mobile PC users in two situations:

  • When the tablet pen provides a more task-appropriate method of input than the mouse and keyboard. For example, many users find the tablet pen to be a superior tool for the creation of notes that incorporate mixed text and drawings.

  • When the tablet pen is the only convenient means of input. For example, the user might lack a convenient desktop surface on which to place a Tablet PC. In such an environment, the use of a keyboard or mouse to record information is not an option.

Programming Model Documentation Links

Managed

System.Windows.Ink

Microsoft.Ink

Microsoft.StylusInput

Unmanaged

Core Reference - Tablet PC Automation Library

RealTimeStylus Reference

Gestures and Flicks

Windows Vista provides a set of built-in application gestures offering shapes and functions from which the user can choose. Pen flicks are quick, linear pen movements associated with scrolling actions and commands. Windows Vista includes a set of eight basic pen flicks. Further, application gestures can supplement the functionality offered by pen flicks, extending the range of functions that users can access quickly with the pen.

Programming Model Documentation Links

Concepts

Using Gestures

Managed

Gesture

Unmanaged

IInkGesture interface

Tablet PC Input Panel

In Windows Vista, Tablet PC Input Panel is the standard interface for converting handwriting to text in a Windows-based program. It's the method by which tablet pen users enter text into applications that do not include a custom handwriting interface. Using Input Panel, users can insert text into website forms, word processing and e-mail applications, web browsers, and more.

Windows Vista includes new programming interfaces to help you better integrate Input Panel into your applications. Input Panel is a ubiquitous presence for Tablet PC users. You can now take fuller advantage of its features in your application.

Programming Model Documentation Links

Concepts

Text Input Panel Concepts

Managed

Microsoft.Ink

Unmanaged

Text Input Panel Reference

Touch Input

With touch input, users gain a flexible new input method on the Tablet PC. Touch input has an immediate quality that allows users to start interacting quickly with their information and applications. It is suitable for activities such as recording data; browsing and reading; and playing games, music, and movies. Vista has greatly enhanced touch support for Tablet PCs and Ulta-Mobile PCs (UMPCs) that your application can take advantage of.

Programming Model Documentation Links

Conceptual

Pen and Touch Input in Windows Vista

Designing for Touch Input

Optimizing Touch Command and Control

Unmanaged

Touch Input Support in Windows Vista

Ink Analysis and Recognition

The InkAnalysis APIs provide developers with tools to programmatically examine ink input. The API classifies ink into meaningful categories such as words, lines, paragraphs, and drawings. You can use each classification in a variety of ways, including improving recognition results for handwriting.

Programming Model Documentation Links

Managed

InkAnalyzer (WinFX)

InkAnalyzer (Windows Forms)

System.Windows.Ink.AnalysisCore (RealTimeStylus)

Unmanaged

InkAnalysis Reference

Concepts

Ink Analysis Overview

Hardware Button Support

Hardware buttons provide an important input method for Tablet PC users who are operating without a keyboard. By providing application support for the common functions assigned to hardware buttons, you can enable your users to interact with your application more naturally and efficiently.

Programming Model Documentation Links

Guidelines

Supporting Hardware Buttons

See Also

Other Resources

Programming the Tablet PC
Mobile PC User Experience Guidelines for Developers