Camera-based 3D interaction for handheld devices
Author(s)
Advisor
Çapın, TolgaDate
2010Publisher
Bilkent University
Language
English
Type
ThesisItem Usage Stats
158
views
views
49
downloads
downloads
Abstract
Using handheld devices is a very important part of our daily life. Interacting with
them is the most unavoidable part of using them. Today’s user interface designs
are mostly adapted from desktop computers. The result of this was difficulties of
using handheld devices. However processing power, new sensing technologies and
cameras are already available for mobile devices. This gives us the possibility
to develop systems to communicate through different modalities. This thesis
proposes some novel approaches, including finger detection, finger tracking and
object motion analysis, to allow efficient interaction with mobile devices.
As the result of my thesis, a new interface between users and mobile devices is
created. This is a new way of interaction with the mobile device. It enables direct
manipulation on objects. The technique does not require any extra hardware.
The interaction method, maps an object’s motion (such as a finger’s or a predefined
marker’s motion) to a virtual space to achieve manipulation which is
moving in front of the camera.
For Finger Detection, a new method is created based on the usage of the mobile
devices and structure of thumb. A fast two dimensional color-based scene analysis
method is applied to solve the problem.
For Finger Tracking, a new method is created based on the movement ergonomics
of thumb when holding the mobile device on hand. Extracting the three dimensional
movement from the two dimensional RGB data is an important part of
this section of the study.
A new 3D pointer data and pointer image is created for usage with 3D input and
3D interaction of 3D scenes. Also direct manipulation for low cost is achieved.
Keywords
3-D UIFinger tracking
3-D pointer
Camera-based interaction
Handheld devices
User interface