TY - RPRT A1 - Bruns, Erich A1 - Bimber, Oliver T1 - Adaptive Training of Video Sets for Image Recognition on Mobile Phones N2 - We present an enhancement towards adaptive video training for PhoneGuide, a digital museum guidance system for ordinary camera–equipped mobile phones. It enables museum visitors to identify exhibits by capturing photos of them. In this article, a combined solution of object recognition and pervasive tracking is extended to a client–server–system for improving data acquisition and for supporting scale–invariant object recognition. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - Anpassung KW - mobile phones KW - object recognition KW - neural networks KW - museum guidance KW - pervasive tracking KW - temporal adaptation Y1 - 2007 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-8223 ER - TY - RPRT A1 - Bruns, Erich A1 - Brombach, Benjamin A1 - Zeidler, Thomas A1 - Bimber, Oliver T1 - Enabling Mobile Phones To Support Large-Scale Museum Guidance N2 - We present a museum guidance system called PhoneGuide that uses widespread camera equipped mobile phones for on-device object recognition in combination with pervasive tracking. It provides additional location- and object-aware multimedia content to museum visitors, and is scalable to cover a large number of museum objects. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - mobile phones KW - object recognition KW - neural networks KW - museum guidance KW - pervasive tracking Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-6777 ER - TY - RPRT A1 - Bruns, Erich A1 - Brombach, Benjamin A1 - Bimber, Oliver T1 - Mobile Phone Enabled Museum Guidance with Adaptive Classification N2 - Although audio guides are widely established in many museums, they suffer from several drawbacks compared to state-of-the-art multimedia technologies: First, they provide only audible information to museum visitors, while other forms of media presentation, such as reading text or video could be beneficial for museum guidance tasks. Second, they are not very intuitive. Reference numbers have to be manually keyed in by the visitor before information about the exhibit is provided. These numbers are either displayed on visible tags that are located near the exhibited objects, or are printed in brochures that have to be carried. Third, offering mobile guidance equipment to visitors leads to acquisition and maintenance costs that have to be covered by the museum. With our project PhoneGuide we aim at solving these problems by enabling the application of conventional camera-equipped mobile phones for museum guidance purposes. The advantages are obvious: First, today’s off-the-shelf mobile phones offer a rich pallet of multimedia functionalities ---ranging from audio (over speaker or head-set) and video (graphics, images, movies) to simple tactile feedback (vibration). Second, integrated cameras, improvements in processor performance and more memory space enable supporting advanced computer vision algorithms. Instead of keying in reference numbers, objects can be recognized automatically by taking non-persistent photographs of them. This is more intuitive and saves museum curators from distributing and maintaining a large number of physical (visible or invisible) tags. Together with a few sensor-equipped reference tags only, computer vision based object recognition allows for the classification of single objects; whereas overlapping signal ranges of object-distinct active tags (such as RFID) would prevent the identification of individuals that are grouped closely together. Third, since we assume that museum visitors will be able to use their own devices, the acquisition and maintenance cost for museum-owned devices decreases. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - Anpassung KW - Mobiltelefone KW - Museumsführer KW - Adaptive Klassifizierung KW - Ad-hoc Sensor-Netzwerke KW - mobile phones KW - object recognition KW - museum guidance KW - adaptive classification KW - ad-hoc sensor networks Y1 - 2007 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-9406 ER - TY - RPRT A1 - Föckler, Paul A1 - Zeidler, Thomas A1 - Bimber, Oliver T1 - PhoneGuide: Museum Guidance Supported by On-Device Object Recognition on Mobile Phones N2 - We present PhoneGuide – an enhanced museum guidance approach that uses camera-equipped mobile phones and on-device object recognition. Our main technical achievement is a simple and light-weight object recognition approach that is realized with single-layer perceptron neuronal networks. In contrast to related systems which perform computational intensive image processing tasks on remote servers, our intention is to carry out all computations directly on the phone. This ensures little or even no network traffic and consequently decreases cost for online times. Our laboratory experiments and field surveys have shown that photographed museum exhibits can be recognized with a probability of over 90%. We have evaluated different feature sets to optimize the recognition rate and performance. Our experiments revealed that normalized color features are most effective for our method. Choosing such a feature set allows recognizing an object below one second on up-to-date phones. The amount of data that is required for differentiating 50 objects from multiple perspectives is less than 6KBytes. KW - Neuronales Netz KW - Objekterkennung KW - Handy KW - Museum KW - Mobile phones KW - object recognition KW - neural networks KW - museum guidance Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-6500 ER -