General
The gesture detection system enables a comfortable operation of the multimedia system and vehicle functions through the detection of hand motion. To do so, the hand motion sensor in the overhead control panel with camera records the motion of the driver and front passenger hands. Depending on the equipment installed, an additional hand motion sensor in the headliner captures the movements of the hands of the vehicle occupants in the rear passenger compartment. The captured movements are converted into operation signals either by the hand motion sensor itself or by the gesture recognition system control unit.
Function
The first-generation gesture recognition system (telematics unit version NTG 6) enables the following functions:
Activation of functions, e.g. Favorites, through recognition of pre-determined hand gestures.
Highlighting of displays in the multimedia system when a hand is moved in close proximity to the touchpad or display.
Display of functions in the menus when a hand is moved in close proximity to the touchpad or display.
Switches reading lamps on an off by recognition of a hand moving in close proximity to the inside rearview mirror or a gripping motion above the front passenger seat.
The second-generation gesture recognition system (telematics unit version NTG 7) extends the system scope by the following functions:
Actuation of seat belt and buckle extender in the event of seat belt fastening or release movements
Adaptation of light distribution to assignment of seats and movement of vehicle occupants
Automatic adjustment of an ergonomic seat position
Monitoring of driver activity for conditionally automated driving (depending on equipment)
The gesture recognition system detects whether the driver or the front passenger or a vehicle occupant in the rear passenger compartment is making the hand movement.
The gesture recognition system can be switched on and off and configured using a menu in the multimedia system.
Variants
With telematics unit version NTG 6, the hand motion sensor uses a simple camera. It generates the operation signals and forwards them.
With telematics unit version NTG 7, the hand motion sensor uses a stereo camera. The gesture recognition system control unit reads in the hand motion sensors, generates the operation signals and forwards them.