Visual Gesture Builder Timeline

Describes the Timeline and Output panes.

Timeline Pane

Use the timeline to perform time tagging of clips.

Dn785532.note(en-us,IEB.10).gifNote
The title of the Timeline pane changes based on the currently selected tag.

Tagging Clips

For machine learning algorithms to train on clips, they must be tagged in some manner. Different machine language algorithms accept different types of tagging but, for a specific frame, some metadata representing the intended gesture is encoded. The following are the allowed tagging types.

  1. In projects using AdaBoostTrigger, mark the range of frames where the gesture takes place. For each part of the clip, set the gesture tag boolean value to either true or false.
  2. In projects using RFRProgress, mark key frames where the gesture takes place. For each part of the clip, set the gesture tag float value to a value that is indicative of the progress over the span of the gesture.

Figure 1.  Tagging Clips

Dn785532.k4w_VisualGestureBuilder_Timeline(en-us,IEB.10).png The following is an example of steps that you can perform to generate training data.
  1. Click on one of the files. You are presented with the file view.
  2. Scroll and select a represented frame.
  3. Add new metadata.
  4. Repeat the previous steps as many times as needed.

Output Pane

This pane displays status and error messages. You can use the results of application operations that are displayed here for debugging purposes.

Keyboard Shortcuts

The following keyboard shortcuts are available to expedite tagging gestures in VGB.

Keyboard ShortcutDescription
LEFT ArrowMove the position marker to the previous frame.
RIGHT ArrowMove the position marker to the next frame.
CTRL + LEFTMove the position marker to the previous key frame.
CTRL + RIGHTMove the position marker to the next key frame.
PAGEUPLoad the tags for the previous gesture listed in the Tags pane.
PAGEDOWNLoad the tags for the next gesture listed in the Tags pane.
Shift + HOMESelect all frames to the left of the position marker to the start of the file.
Shift + ENDSelect all frames to the right of the position marker to the end of the file.
Shift + LEFTSelect the frames to the left of the position marker.
Shift + RIGHTSelect the frames to the right of the position marker.
CTRL + Shift + LEFTSelect all frames left of the position marker to the previous key frame.
CTRL + Shift + RIGHTSelect all frames right of the position marker to the next key frame.
UPIncrease the value of the selected tag.
DOWNDecrease the value of the selected tag.
DeleteDelete the value of the selected tag.
CTRL + DeleteDelete the selected key frame.
EnterSet the tag to the default maximum value (true for discrete gesture types, 1 for continuous gesture types).
SpaceSet the tag to the default minimum value (false for discrete gesture types, 0 for continuous gesture types).
CTRL + ZUndo last tag change.
CTRL + YRedo a previously undone tag.

Community Additions

ADD
Show: