TY - RPRT A1 - Föckler, Paul A1 - Zeidler, Thomas A1 - Bimber, Oliver T1 - PhoneGuide: Museum Guidance Supported by On-Device Object Recognition on Mobile Phones N2 - We present PhoneGuide – an enhanced museum guidance approach that uses camera-equipped mobile phones and on-device object recognition. Our main technical achievement is a simple and light-weight object recognition approach that is realized with single-layer perceptron neuronal networks. In contrast to related systems which perform computational intensive image processing tasks on remote servers, our intention is to carry out all computations directly on the phone. This ensures little or even no network traffic and consequently decreases cost for online times. Our laboratory experiments and field surveys have shown that photographed museum exhibits can be recognized with a probability of over 90%. We have evaluated different feature sets to optimize the recognition rate and performance. Our experiments revealed that normalized color features are most effective for our method. Choosing such a feature set allows recognizing an object below one second on up-to-date phones. The amount of data that is required for differentiating 50 objects from multiple perspectives is less than 6KBytes. KW - Neuronales Netz KW - Objekterkennung KW - Handy KW - Museum KW - Mobile phones KW - object recognition KW - neural networks KW - museum guidance Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-6500 ER - TY - RPRT A1 - Exner, David A1 - Bruns, Erich A1 - Kurz, Daniel A1 - Grundhöfer, Anselm A1 - Bimber, Oliver T1 - Fast and Reliable CAMShift Tracking N2 - CAMShift is a well-established and fundamental algorithm for kernel-based visual object tracking. While it performs well with objects that have a simple and constant appearance, it is not robust in more complex cases. As it solely relies on back projected probabilities it can fail in cases when the object's appearance changes (e.g. due to object or camera movement, or due to lighting changes), when similarly colored objects have to be re-detected or when they cross their trajectories. We propose extensions to CAMShift that address and resolve all of these problems. They allow the accumulation of multiple histograms to model more complex object appearance and the continuous monitoring of object identi- ties to handle ambiguous cases of partial or full occlusion. Most steps of our method are carried out on the GPU for achieving real-time tracking of multiple targets simultaneously. We explain an ecient GPU implementations of histogram generation, probability back projection, im- age moments computations, and histogram intersection. All of these techniques make full use of a GPU's high parallelization. KW - Bildverarbeitung KW - CAMShift KW - Kernel-Based Tracking KW - GPU Programming KW - CAMShift KW - Kernel-Based Tracking KW - GPU Programming Y1 - 2009 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20091217-14962 ER - TY - RPRT A1 - Bruns, Erich A1 - Brombach, Benjamin A1 - Zeidler, Thomas A1 - Bimber, Oliver T1 - Enabling Mobile Phones To Support Large-Scale Museum Guidance N2 - We present a museum guidance system called PhoneGuide that uses widespread camera equipped mobile phones for on-device object recognition in combination with pervasive tracking. It provides additional location- and object-aware multimedia content to museum visitors, and is scalable to cover a large number of museum objects. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - mobile phones KW - object recognition KW - neural networks KW - museum guidance KW - pervasive tracking Y1 - 2005 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-6777 ER - TY - RPRT A1 - Bruns, Erich A1 - Brombach, Benjamin A1 - Bimber, Oliver T1 - Mobile Phone Enabled Museum Guidance with Adaptive Classification N2 - Although audio guides are widely established in many museums, they suffer from several drawbacks compared to state-of-the-art multimedia technologies: First, they provide only audible information to museum visitors, while other forms of media presentation, such as reading text or video could be beneficial for museum guidance tasks. Second, they are not very intuitive. Reference numbers have to be manually keyed in by the visitor before information about the exhibit is provided. These numbers are either displayed on visible tags that are located near the exhibited objects, or are printed in brochures that have to be carried. Third, offering mobile guidance equipment to visitors leads to acquisition and maintenance costs that have to be covered by the museum. With our project PhoneGuide we aim at solving these problems by enabling the application of conventional camera-equipped mobile phones for museum guidance purposes. The advantages are obvious: First, today’s off-the-shelf mobile phones offer a rich pallet of multimedia functionalities ---ranging from audio (over speaker or head-set) and video (graphics, images, movies) to simple tactile feedback (vibration). Second, integrated cameras, improvements in processor performance and more memory space enable supporting advanced computer vision algorithms. Instead of keying in reference numbers, objects can be recognized automatically by taking non-persistent photographs of them. This is more intuitive and saves museum curators from distributing and maintaining a large number of physical (visible or invisible) tags. Together with a few sensor-equipped reference tags only, computer vision based object recognition allows for the classification of single objects; whereas overlapping signal ranges of object-distinct active tags (such as RFID) would prevent the identification of individuals that are grouped closely together. Third, since we assume that museum visitors will be able to use their own devices, the acquisition and maintenance cost for museum-owned devices decreases. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - Anpassung KW - Mobiltelefone KW - Museumsführer KW - Adaptive Klassifizierung KW - Ad-hoc Sensor-Netzwerke KW - mobile phones KW - object recognition KW - museum guidance KW - adaptive classification KW - ad-hoc sensor networks Y1 - 2007 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-9406 ER - TY - JOUR A1 - Bruns, Erich A1 - Bimber, Oliver T1 - Phone-to-Phone Communication for Adaptive Image Classification N2 - In this paper, we present a novel technique for adapting local image classifiers that are applied for object recognition on mobile phones through ad-hoc network communication between the devices. By continuously accumulating and exchanging collected user feedback among devices that are located within signal range, we show that our approach improves the overall classification rate and adapts to dynamic changes quickly. This technique is applied in the context of PhoneGuide – a mobile phone based museum guidance framework that combines pervasive tracking and local object recognition for identifying a large number of objects in uncontrolled museum environments. KW - Peer-to-Peer-Netz KW - Bilderkennung KW - Museumsführer KW - Ad-hoc-Netz KW - Phone-to-phone communication KW - adaptive image classification KW - mobile ad-hoc networks KW - museum guidance system Y1 - 2008 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20080722-13685 ER - TY - RPRT A1 - Bruns, Erich A1 - Bimber, Oliver T1 - Adaptive Training of Video Sets for Image Recognition on Mobile Phones N2 - We present an enhancement towards adaptive video training for PhoneGuide, a digital museum guidance system for ordinary camera–equipped mobile phones. It enables museum visitors to identify exhibits by capturing photos of them. In this article, a combined solution of object recognition and pervasive tracking is extended to a client–server–system for improving data acquisition and for supporting scale–invariant object recognition. KW - Objektverfolgung KW - Neuronales Netz KW - Handy KW - Objekterkennung KW - Museum KW - Anpassung KW - mobile phones KW - object recognition KW - neural networks KW - museum guidance KW - pervasive tracking KW - temporal adaptation Y1 - 2007 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-8223 ER - TY - JOUR A1 - Brombach, Benjamin A1 - Bruns, Erich A1 - Bimber, Oliver T1 - Subobject Detection through Spatial Relationships on Mobile Phones N2 - We present a novel image classification technique for detecting multiple objects (called subobjects) in a single image. In addition to image classifiers, we apply spatial relationships among the subobjects to verify and to predict locations of detected and undetected subobjects, respectively. By continuously refining the spatial relationships throughout the detection process, even locations of completely occluded exhibits can be determined. Finally, all detected subobjects are labeled and the user can select the object of interest for retrieving corresponding multimedia information. This approach is applied in the context of PhoneGuide, an adaptive museum guidance system for camera-equipped mobile phones. We show that the recognition of subobjects using spatial relationships is up to 68% faster than related approaches without spatial relationships. Results of a field experiment in a local museum illustrate that unexperienced users reach an average recognition rate for subobjects of 85.6% under realistic conditions. KW - Objekterkennung KW - Smartphone KW - Subobjekterkennung KW - Räumliche Beziehungen KW - Neuronales Netz KW - Museumsführer KW - Subobject Detection KW - Spatial Relationships KW - Neural Networks KW - Museum Guidance Y1 - 2008 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20081007-14296 ER - TY - RPRT A1 - Bimber, Oliver A1 - Iwai, Daisuke T1 - Superimposing Dynamic Range N2 - We present a simple and cost-efficient way of extending contrast, perceived tonal resolution, and the color space of static hardcopy images, beyond the capabilities of hardcopy devices or low-dynamic range displays alone. A calibrated projector-camera system is applied for automatic registration, scanning and superimposition of hardcopies. We explain how high-dynamic range content can be split for linear devices with different capabilities, how luminance quantization can be optimized with respect to the non-linear response of the human visual system as well as for the discrete nature of the applied modulation devices; and how inverse tone-mapping can be adapted in case only untreated hardcopies and softcopies (such as regular photographs) are available. We believe that our approach has the potential to complement hardcopy-based technologies, such as X-ray prints for filmless imaging, in domains that operate with high quality static image content, like radiology and other medical fields, or astronomy. KW - Bildverarbeitung KW - CGI KW - Computergraphik KW - Kontrast KW - Projektor-Kamera Systeme KW - Hoher Dynamikumfang KW - Contrast KW - Projector-Camera Systems KW - High Dynamic Range Y1 - 2008 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20080422-13585 ER - TY - JOUR A1 - Bimber, Oliver A1 - Iwai, Daisuke T1 - Superimposing Dynamic Range JF - Eurographics 2009 N2 - Replacing a uniform illumination by a high-frequent illumination enhances the contrast of observed and captured images. We modulate spatially and temporally multiplexed (projected) light with reflective or transmissive matter to achieve high dynamic range visualizations of radiological images on printed paper or ePaper, and to boost the optical contrast of images viewed or imaged with light microscopes. KW - CGI KW - Computer graphics KW - Image processing KW - Computer vision KW - 54.73 Y1 - 2009 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20120130-15325 ER - TY - JOUR A1 - Bimber, Oliver A1 - Grundhöfer, Anselm A1 - Zollmann, Stefanie A1 - Kolster, Daniel T1 - Digital Illumination for Augmented Studios N2 - Virtual studio technology plays an important role for modern television productions. Blue-screen matting is a common technique for integrating real actors or moderators into computer generated sceneries. Augmented reality offers the possibility to mix real and virtual in a more general context. This article proposes a new technological approach for combining real studio content with computergenerated information. Digital light projection allows a controlled spatial, temporal, chrominance and luminance modulation of illumination – opening new possibilities for TV studios. KW - Studiotechnik KW - Erweiterte Realität KW - Fernsehproduktion KW - Projektion KW - Augmented studio KW - Augmented reality KW - digital light projection Y1 - 2006 U6 - http://nbn-resolving.de/urn/resolver.pl?urn:nbn:de:gbv:wim2-20111215-8576 ER -