IEEE Citation: P. Song, W. Goh, W. Hutama, C. Fu and X. Liu, 'A handle bar metaphor for virtual object manipulation with mid-air interaction', Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 2012.
Introduction
This research gives a novel way to manipulate 3D objects using both hands in mid-air environment. This approach doesn't use any wearable devices . User interaction is achieved by using an image depth sensor and some of the bi-manual and uni-manual gestures are being used and implemented in this approach. This has implemented POINT,OPEN,CLOSE as single hand gestures and they are used to select a particular virtual object or a set of objects. Bi-manual gestures are suggested and implemented for the object manipulation using ROTATION, TRANSITION and SCALE (RTS)
Contribution and Novelty
This paper suggests an effective visual control metaphor between the user's gestures and the corresponding virtual object manipulations. This new metaphor can be use most of the areas where 3D objects are manipulated such as CAD, 3D printing etc.As the researchers designed this for large scale screens, it can be used within small displays too. Since it's mid-air, the use of large screens gives more immersion to the activity. Suggesting a new UI (user interaction) metaphor and Suggesting some real world hand gestures to use inside the metaphor is the novelty of this research. They have successfully evaluated their work as well.
How does it relates in to my work?
As the title describes, this research paper is about bi-manual user interaction metaphor. Since my research idea is to suggest a bi-manual UI metaphor towards Stroke rehabilitation, It' necessary to have a good knowledge about what are the existing bi-manual UI metaphors. I think that content of this will help me a lot to to do my researsh as they have been suggested a new UI metaphor, implemented a software and evaluated it as well. The way they implemented to get rid from immersion syndrome is quite appreciative and it's important thing to be considered about when mid-air interaction, since the sensor continuously detecting the hand. The researchers has used a set of manipulation states and defined them as a state transition diagram of gestures for manipulating objects are given in their paper, This suggests a way to implement a such metaphor using a state transition diagram.
Advantages and Disadvantages
Advantages
the paper itself has mentioned some advantages of the proposed handlebar metaphor as follows,
- Physical familiarity: The most of the bi-manual gestures used to manipulate the virtual handlebar are intuitive for most users since there are some day to day tasks are being done using handle bar such as cycling, and lawn mowing.
- Rich variety of 3D manipulation operations: This metaphor gives the ability to manipulate an object in 7 degrees of freedom (7DOF). allowing users to switch between operations without changing the gestures or operational mode. Multi-object manipulation also can be done as easy as single object as well.
- Supporting both object and non-object centered manipulations: The virtual handlebar pierced inside the 3D object of the scene can be aligned and manipulated seperately. So the users can position the handlebar inside the 3D object (object centered) or outside from it (non - object centered).
- Good semantic mapping: This metaphor has a good semantic mapping with the real physical world. Bi-manual gestures like grabbing and releasing are mapped inside the metaphor for the same task in the scene. When the user clutch two fists, the handlebar is grabbed and when free the palms, the handlebar is released.
- Accommodating sensor limitations: Since kinect sensor has a limited resolution the this method clearly identify the 3D pose information accurately.
Disadvantages
- One of the main disadvantage that the researchers faced that the inability of kinect depth sensor to detect hand orientation. So the researchers had to implement a perpendicular to rotate the handlebar along the x-axis.
- Lack of haptic feedback is also a disadvantage for better immersive environment, only visual feedback is given.
Suggested future work
When a researcher suggest a future work, they suggest them assuming if they had another 6 months (to 1 Year) to continue this research what they would do. In this research, they have not suggested any future works. But, they have suggested some application examples of their model. As a future work, I suggest that the accuracy and the hand orientation detection can be gained using leap-motion depth sensing device.
I found a video explanation of this research from YouTube as well.
Ref: https://www.youtube.com/watch?v=p0EM9Ejv0r0
Ref: https://www.youtube.com/watch?v=p0EM9Ejv0r0
immersion syndrome: This happens where every hand gesture is captured and constantly interpreted by the system. This can lead to undesirable operations due to misinterpretation of the user’s unintended hand gestures.
No comments:
Post a Comment