The top menu in the "Navigation window" contains four items:

• File: It includes four sub-items that allow to load a new video sequence, load ground-truth data previously created, create new ground-truth data, and exit or reset the application. These sub-items are described in detail in point 3.1.1.
• Options: It includes three sub-items to save images as images without ground-truth, save the ground-truth in different formats, and show the ground-truth progress. These sub-items are detailed in point 3.1.2.
• View: It includes five sub-items that allow to select the data to visualize on the display area. These sub-items are detailed in point 3.1.3.
• Help: It includes a sub-item to visualize the information concerning the developers and a sub-item to show the usage rights. Details on these two sub-items appear in point 3.1.4.

The panel named "Image selection" allows the following actions:

• Select the image to work with: By entering its number into the white box and clicking the "Go to image" button.
• Go to the next image: By clicking the "Next" button.
• Go to the previous image: By clicking the "Prev." button.
• Label the current image as an image without labels (black RGB image): By clicking the "Save as blank" button.
• Erase the current labels in the image: By clicking the "Clear" button.

Demo video

The panel named "Label selection" allows to create, delete and select labels in the current image.

• "Prev.": Go to the previous label.
• "Next": Go to the next label.
• "Go to label": Go to the label indicated in the white box.
• "New": Create a new label.
• "Clear": Delete a label.
• "Undo": Undo the previous operation (for example, a non-desired delete action).

Demo videos

The panel named "Layer selection" allows to select the layer to edit (VMO, SMO or OMO). By clicking the "Edit" button, the labeling window (described in point 4) opens, where the selected label can be edited.

Demo video

The panel named "Label properties" shows the sequence-level identifier of the selected label. It also allows to modify this identifier by clicking the "Change Id" button.

If the check-box titled "Static" is marked the labeled object is set as static moving object. In this case, the "Select range" button will allow to determine the range of images in which such moving object remains static. Additionally, the field "Static from the frame" indicates the number of frame from which a moving object remains static.

Demo video

The panel named "Display area" shows the original images (in the left) and the images of labels (in the right). The content to visualize in these areas can be modified with the options in the item "View" in the top menu.

Finally, on the right-bottom side of this panel it is displayed a colored square together with text. If the current image has been labeled the color of the square is green and the text says "GT data". If the image has not been labeled the color is red and the text says "No GT data".

It shows the image lo label. The areas inside the contours drawn on this image are added or removed from the label, depending on the mode selected in the "Mode" panel (see point 4.2).

The contours can be created in several ways:

• By selecting points in the image (marked points are automatically stitched).
• By holding down the left button of the mouse and moving the mouse on the image.
• By combining the above two ways.

To finish a contour the right button of the mouse must be clicked. I the "Add" mode is selected, all the pixels inside the contour will be added to the label. If the "Subtract" mode is selected, all the pixels inside the contour will be removed from the label.

Demo video

This panel includes the following three options:

• Add: If selected, the area inside the contours drawn on the display area is added to the label.
• Subtract: If selected, the area inside the contours drawn in the display area is removed from the label.
• Intelligent: If selected, the area added to the label is the intersection of the area inside the contours manually drawn on the display area and those resulting from the application of the motion detection tool. Details concerning the combined use of the intelligent mode and the motion detection tool appear in point 4.6.

Demo video

The buttons in this panel allow to move (left, right, up or down) a previously drawn contour. This is very useful when a contour created in other image is used as starting point to create the current one.

Demo video

This panel contains the following buttons:

• Draw: Click this button to draw contours in the display area (this action is automatic when the modes "Add" or "Subtract" are selected).
• Undo: It allows to undo undesired operations (e.g. redrawing a contour accidentally deleted).
• Redo: Click to redo the previous undo operation.
• Exit & save: For saving the work and exit the window (return to the "Navigation window").
• Exit (no save): To exit the window without saving the work.
• Save: For saving the work done so far.

This panel allows the following actions:

• Zoom: To enlarge or reduce the image size.
• Hand: To scroll the image.
• Reset view: To return to the initial view.
• Prev.: To go to the previous image.
• Next: To go to the subsequent image.
• Go to current: to return to the current image.

When labeling a moving object, sometimes it is not easy to deduce whether an image area belongs to such moving object or to the background. Moreover, it is also difficult to maintain the consistence in labeling along a video sequence (i.e. to take the same criteria for labeling a particular object in different images). However, these problems are simplified thanks to the buttons "Prev." and "Next", which allow to view previous and subsequent images. The video above illustrates a situation in which the use of these buttons is very useful.

Demo video

This panel can be used to estimate a background model to compare with the current image in order to identify the moving objects.

3. Applying the Running Gaussian Average method [2]:
   • Select the check-box "RGA".
   • Introduce the range of images used to construct the background model (in the boxes "From" and "To").
   • Click "Config" to modify the default parameters (more information about these parameters can be found in [2]).
   • Click "Apply" to see the result on the display area.
   • NOTE: The first time this method is executed, an initial background model is created. For subsequent images, if the "Update" checkbox is marked, the initial model will be updated. On the other hand, if "Update" is not marked, a new model will be created.
4. Using Gaussian Mixture Models [3]:
   • Select the check-box "GMM".
   • Introduce the first image to use to construct the background model (in the box "From").
   • Click "Config" to modify the default parameters (more information about these parameters can be found in [3]).
   • Click "Apply" to see the result on the display area.
   • NOTE: The first time this method is executed, an initial background model is created. For subsequent images, if the "Update" checkbox is marked, the initial model will be updated. On the other hand, if "Update" is not marked, a new model will be created.
5. Using a nonparametric modeling [4]:
   • Select the check-box "NPM".
   • Introduce the first image to use to construct the background model (in the box "From").
   • Click "Config" to modify the default parameters (more information about these parameters can be found in [4]).
   • Click "Apply" to see the result on the display area.
   • NOTE: The first time this method is executed, an initial background model is created. For subsequent images, if the "Update" checkbox is marked, the initial model will be updated. On the other hand, if "Update" is not marked, a new model will be created.

Once clicked the "Apply" button, if "Ref. image" or "TMF" was the selected option, the mask that is shown on the display area is the result of the absolute difference between the current image and the background model, thresholded by the value indicated in the first bar in the right of the panel ("Threshold"). The differences higher than the threshold are set as 1, while the rest of differences are set as 0.

Finally, to delete small regions and to make more compact the detected objects, an opening morphology operation followed by a closing morphology operation are applied on the binary mask. The structuring element used to perform these operations can be modified with the bar named "Noise Filter". If the moving object to segment is small this value must be also small, but for large moving objects it can be higher.

The last bar in the panel ("Opacity") allows to determine the opacity level of the color used to represent the mask on the current image.

The following videos show some examples of use of this panel:

• The first one shows how to use all the functionalities in the panel.
• The second one is an example of labeling by combining the motion detection and the intelligent pencil.

Demo videos

By using the options in this panel it is possible to get an initial contour that can be refined or displaced to arrive to the target contour. It offers three options:

• By motion detection: If this option is selected, the initial contour is that obtained from the mask of differences resulting from the use of the background model obtained according to the configuration of the "Motion detection" panel.
• By contour in image: If it is selected, the initial contour is the contour created for the image indicated in the box located to the right.
• Delete contour: This option delete the contours in the image.

In addition, the "Restart" button reverses the changes applied on the initial contour so as to start from zero.

The following videos show two examples of use of this panel:

• The first one shows how to segment an object by starting from the contour created for the previous image.
• The second one illustrates how to start the labeling with a contour created automatically from a mask of differences.

Demo videos