NEC Corporation today announced the development of an Augmented Reality (AR) solution to assist users with the selection of items through the use of smart glasses, a smart watch and new ARmKeypad functions. This solution enables users to perform tasks without having to look away from objects, making it ideal for use in manufacturing, logistics and other industries. Currently, NEC is carrying out demonstration tests at a hospital pharmacy and a manufacturing floor, where it has confirmed a reduction in workplace errors and working time thanks to the assistance of the new solution.

Overview of the "eyes-free" ARmKeypad (Image: NEC)

"In contrast to NEC's original ARmKeypad, which created a virtual selection screen on a user's arm, the 'eyes-free' ARmKeypad in this solution displays an input selection screen on a pair of smart glasses. As a result, users can make selections simply by inclining and touching their arm, which allows work to be completed without the need to look away from objects. This is very helpful in workplaces where mistakes are likely to occur due to eye movements or workplaces where working speed is required," said Hiroshi Kuzuno, General Manager, System Integration & Services Market Development Division, NEC Corporation.

The solution capitalizes on AR in order to display work procedures on a pair of smart glasses, such as guiding users to the location of objects stored on a shelf. This improves the efficiency of operations and reduces mistakes, even for inexperienced workers and in workplaces where tasks often change.

ARmKeypad usage scenarios (Image: NEC)

It also enables input operations to take place through the accelerometer of a smart watch worn by users. Changes in the incline of a user's arm can be understood in order to select items from a menu screen displayed on a pair of smart glasses. Finger contact with the arm can also be used to make selections. This allows for confirmation and registration to take place without looking away from an object.

NEC is carrying out demonstration tests of this solution at a hospital pharmacy and a manufacturing floor, where it has confirmed a reduction in workplace errors and working time.

Pharmacy demonstration test (Image: NEC)

The system reads barcodes on prescriptions with a camera on the glasses, displays a drug selection list on the glasses, and provides guidance about which drug on which shelf is to be selected. This is done using AR when the operator looks at the medicine cabinet. As a user of the solution picks up a drug, they are able to confirm and register the item by inclining their arm. This has confirmed that selection errors could be reduced to virtually zero. Using conventional methods, approximately five errors are assumed per 300 operations daily.

The other demonstration test is at NEC Networks & System Integration Corporation in order to ensure efficient management of equipment. The solution assists in locating equipment from cabinets where it is temporarily stored using an AR guidance display. The demonstration test confirmed that work time could be reduced by 18.2% when compared to conventional methods.