A data processing system having a hand-gesture based display, user communication through the system and interaction with the system being effected by inputting of data signified by a hand code which includes representations of commonly understood natural hand gestures. This enables such communication and interaction to be achieved with compact data formats, represented by displayed hand postures, thereby achieving reduced bandwidth and increased data input speed.

The system of touch pad sensors and the signals generated thereby are integrated with speech recognition and/or facial gesture recognition systems, so that commands may be generated by synchronized multi-mode inputs.

An information processing apparatus can display an object image and a line drawing overlapping each other. An area of the object image can be zoomed (enlarged or reduced) while the line drawing is left the same size, or optionally the line drawing can be zoomed in proportion to the object image zooming, so that the information displayed by the relative positional relationship between the object image and the line drawing is maintained.

Patent application for computer-assisted surgery system using gestures to control workflow and software operation. Gestures detected using 3D localization apparatus.

Recognition of gestures used in Sign Language is disclosed. From the Abstract: Hand gesture recognition is an active area of research in recent years, being used in various applications from deaf sign recognition systems to humanmachine interaction applications. The gesture recognition process, in general, may be divided into two stages: the motion sensing, which extracts useful data from hand motion; and the classification process, which classifies the motion sensing data as gestures.

Sign language gestures can provide information modified by subtleties of the gesture.