Virtual Touch Screen mode (only for integration partners)

aeroTAP evo virtual touch screen mode ( VT Mode ) provide alternative touchless solution with seamless operation with touch screen..

Important: This feature is expected to be built in to bodies such as a KIOSK device. Therefore the detailed information about the installation is not made public. Please contact us for more information if you are interested.


A virtual touch screen (surface) and a hover surface will be created in the space about 25cm to 50cm from the camera. The operator will use his/her finger to operate the virtual surface like a touch screen.

You can also use the virtual button and other features of aeroTAP evo to operate existing touch screens. In addition, monitors that do not have touch screen features can become a touch panel and you can operate it without touching the monitor.

You can adjust the distance from the monitor freely, which is the difference between palm detection mode.

The size of the virtual surface that can be made is about 5 inch to 80 inch, according to the camera position and the angle.

This feature is supported by 2 types of camera. aeroTAP 3D USB GS camera has a wider view angle which enables you to create a bigger virtual touch surface. Please choose the camera that suits your environment.

*The distance between the camera and the virtual touch panel (space) needs to be at least 25cm.

To setup, calibration will be done using thecalibration tool designed especially designed for aeroTAP camera.

You can set the camera to any desired place. You can also set the distance of the hover surface and the virtual touch screen surface freely.

The following figure shows an example of an installation.

Installation example
The installation of the camera can be above, below, right/left side of the virtual surface or even diagonal as shown in the figure.

Demonstration video

You can use aeroTAP Assist features even in virtual touch screen mode which enables various operations of the application using your finger.
Demonstration video shows the operation in Mouse mode. Virtual scroll for browser is one of the aeroTAP Assist Features.


Virtual touch screen of large and wide-screen displays using aeroTAP 3D USB GS camera



Preference


Content
 Description
Camera Parameters  These parameters will be calculated using the built-in calibration tool.
2D Filter area You can exclude the area outside the operation area by setting values of the corresponding area to crop it from the camera view.
To deactivate this feature, set all values to 0.
Table Filter You can exclude the area outside the operation area by setting values of the corresponding area to crop it from the camera view.
This parameter is used to additionally crop the crop area with a trapezoid. Value 100 will not perform trapezoidal crop.
3D Box filter area You can filter the area within the 3D space.
By filtering 3D space, you can remove extra noise (when someone or something is nearby).
Set the position of the 3D Box you created.
Virtual Touch Screen parameters  
Distance  Distance of the Virtual Touch Screen in milimeters This value is set to 22mm in the figure above.
Hover  The distance for the hover surface calculated from the Virtual Touch screen surface in millimeters. The value shown as 0-100mm in the figure above.
By setting the hover surface, the virtual cursor (gray) will be displayed when the finger reaches that range.
Action Mode  Select the action that will be performed when the finger reaches the virtual touch screen.
Mouse Click: Mouse click will be performed when the finger reaches the virtual touch screen.
Touch event: Touch event will be performed when the finger reaches the virtual touch screen.
   - When you move your finger away from the virtual touch screen right after you reached it, tap will be performed.
   - When you keep you finger on the virtual touch screen, you can perform long-press or a touch and drag action.

Important: After you change the selection, remember to click Apply for the change to be applied.
Minimum hover to tap  At high values, noise and unintended touch actions will be reduced.
Detect top point  This is useful when generating a virtual touch screen surface above table-top monitors and other monitors facing up. Activate this checkbox to avoid false recognitions such as sleeves.
Homograph point pairs  Corresponding point pairs used for projective conversion of the virtual touch screen to the actual screen.
These values will be calculated by the built-in calibration tool.
Camera View The color image or the depth image from the camera will be displayed on a real time basis.
The cursor showing the pointing position (cursor color changes when touched or clicked) will be displayed on the color image.
Detection Status: Hovering, Clicking (Mouse mode), Touching (for touch event) and the coordinates (320X240 coordinate system) will be displayed.
We recommend that you set the distance filter the smallest value possible.

Basic Installation (1)

Camera installation can be above/under the screen or on the right/left of the screen and even with an angle. The only thing you need to remember is that a significant distance for three-dimensional measuring is required.
Target monitor screen size differs in relation with the camera installation position. In this case, it will be about 7 to 22 inches.

Here is an example of the most basic installation; installing the camera above the monitor.
* We are using aeroTAP 3D USB camera that supports WVGA mode.
When operating a monitor set before the operator with a virtual touch screen, it can be difficult to precisely stop the finger at approximately 5cm distance from the actual monitor, where the virtual touch screen is set.
Setting the hover surface 5cm front of the virtual touch screen, the virtual cursor will be displayed when the finger reaches that surface. This will help the operator to check the button position and the distance to point.


Basic Installation (2)

Here is an example of a basic installation; installing the camera for a table-top monitor.

* We are using aeroTAP 3D USB camera that supports WVGA mode.
When operating a table-top monitor with a virtual touch screen, it seems to be pretty easy for the operator to figure out the spacial position, which the distance of the virtual touch screen is about 3cm above the actual screen.
In this case, the hover feature can be turned off and the operator can tap (select) the space above the button. Since the monitor is faced upwards, activate Detect Top Point to avoid false recognitions.



Basic Installation (3)

Here is an example installing the camera under the monitor facing up (the celling).


Recommended Settings according to Usage

The following environment are some possibilities of using the virtual touch screen mode.

 Environment
Recommended Settings

Collaboration with aerial display
 This is a case where image will be projected using methods such as Microlens Array method, Reflecting mirror method. aeroTAP will be used to tap the projected image.
The user will be pressing the buttons in space.
In this case, the accurate calibration for the actual screen and the virtual touch screen space needs to be done beforehand.
Virtual cursor OFF
Hover = 0
Cursor smoothness = x1
Select Mouse mode
Select Grab to Click
 Tap repeat interval = 0
Making standard display (KIOSK devices) touchless
Intended to make 5 inch to 15 inch monitors toucless.

The user can see the virtual cursor which will be a guide to where he/she is pointing.

Please perform calibration using the actual selection area or the area of the buttons, not with the whole screen.
Virtual cursor ON
Hover = about 10
Cursor smoothness = x4
Select Mouse mode
Select Grab to Click
 Tap repeat interval = 0
Making standard display (KIOSK devices) touchless (collaboration with the application)
Intended to make 5 inch to 24 inch monitors touchless.

In this case the feedback of pointing positions (cursor) or button selections will be displayed on the contents application side.

The user will be able to point with the guide of the virtual cursor shown when hovering. With this in mind, please perform calibration for the whole screen or the operation area. The position doesn't have to exactly fit.

Virtual cursor OFF
Hover = about 10cm (long)
Cursor smoothness = x4 or more
Select Mouse mode
Select Grab to Click
 Tap repeat interval = 0

Touch Screen mode

Mouse mode is recommended for operating small monitors such as KIOSK devices. However, when operation of touch events are required, select Touch Screen mode.
In the demo video we used a 10-inch monitor with the virtual touch surface close to the actual monitor screen surface. When your finger reaches the virtual touch surface, the virtual cursor will turn blue, which indicates that you have touched the surface. To perform a tap action, you need to release (pull back) your finger after you touched the surface or when the virtual cursor turns blue.



Installation example



aeroTAP3D USB camera aeroTAP 3D USB GS camera
10-inch display (vertical installation) 10cm above the monitor 22cm above the monitor