Wiedmer, Martin (Ed.) et al.: 10th IEEE International Symposium on Mixed and Augmented Reality 2011 : ISMAR. Science & Technology Proceedings, pp. 15-18

With "House of Olbrich" we present an iPhone Augmented Reality (AR) app that visualizes the compelling history of Darmstadt's unique Jugendstil (Art Nouveau) quarter with video-see through Augmented Reality. We propose methods for enabling high performance computer vision algorithms to deploy sophisticated AR visuals on current generation Smartphones by outsourcing resource intensive tasks to the cloud. This allows us to apply methods on 3D feature recognition for even complex tracking situations outdoors, where lightning conditions change and tracked objects are often occluded. By taking a snapshot of the building, the user learns about the architect, design and history of the building. Historical media, like old photographs and blueprints are superimposed on the building's front, depicting the moved history of the famous House of Olbrich, which was destroyed during World War II and has been only rudimentary restored. Augmented Reality technology allows tourists to jump back in time visually by using their Smartphones: Mixing Realities emphasizes the user's experience and leads his attention to the impressive historical architecture of the Art Nouveau. In addition, we ease interaction means by superimposing snapshots. Tourists may view and read information also in a relaxed position without the need to front-up their mobiles all the time.

Diese Arbeit gibt einen Einblick in die Grundlagen der 3D-Anwendungen im Zusammenspiel mit verschiedenen Customer Devices. In diesem Fall ist die Anwendung ein 3D-Planetarium unseres Sonnensystems für ein Museum. Ziel ist es, ein Konzept zur intuitiven und immersiven Navigation durch das virtuelle Planetarium mittels preiswerte Customer Devices zu erstellen. Die Besucher sollen sich frei und ohne großen Aufwand im Sonnensystem bewegen können. Dabei soll sich der Besucher auf die Simulation konzentrieren können und nicht durch komplexe Steuerung schnell das Interesse an der Anwendung verlieren. Dafür werden vergleichbare Ansätze und der bisherige Forschungsstand untersucht und ein neuer Ansatz beschrieben. Als kostengünstige Customer Devices werden in dieser Arbeit die Controller der Nintendo Wii (Wiimote) und aktuelle Smartphones betrachtet. Eine genaue Analyse dieser Geräte ist Bestandteil dieser Arbeit. Ausgehend von den gewählten Geräten gibt es verschiedene Interaktionsmöglichkeiten und daraus resultierende Interaktionskonzepte. Für jedes Gerät soll ein Konzept entwickelt werden, das die gestellten Ansprüche erfüllt.

Shumaker, Randall (Ed.): Virtual and Mixed Reality - New Trends: Part I : International Conference, Virtual and Mixed Reality 2011. Berlin, Heidelberg, New York: Springer, 2011. (Lecture Notes in Computer Science (LNCS) 6773), pp. 123-132

As the complexity of maintenance tasks can be enormous, the efficient training of technicians in performing those tasks becomes increasingly important. Maintenance training is a classical application field of Augmented Reality explored by different research groups. Mostly technical aspects (e.g tracking, 3D augmentations) have been in focus of this research field. In our paper we present results of interdisciplinary research based on the fusion of cognitive science, psychology and computer science. We focus on analyzing the improvement of AR-based training of maintenance skills by addressing also the necessary cognitive skills. Our aim is to find criteria for the design of AR-based maintenance training systems. A preliminary evaluation of the proposed design strategies has been conducted by expert trainers from industry.

ACM SIGGRAPH: Proceedings Web3D 2010 : 15th International Conference on 3D Web Technology. New York: ACM Press, 2010, pp. 185-193

We present a scalable architecture, which implements and further evolve the HTML/X3D integration model X3DOM introduced in [Behr et al. 2009]. The goal of this model is to integrate and update declarative X3D content directly in the HTML DOM tree. The model was previously presented in a very abstract and generic way by only suggesting implementation strategies. The available opensource x3dom.js architecture provides concrete solutions to the previously open points and extents the generic model if necessary. The outstanding feature of the architecture is to provide a single declarative interface to application developers and at the same time support of various backends through a powerful fallback-model. This fallback-model does not provide a single implementation strategy for the runtime and rendering module but supports different methods transparently. This includes native browser implementations and X3D-plugins as well as a WebGL-based scene-graph, which allows running the content without the need for installing additional plugins on all browsers that support WebGL. The paper furthermore discusses generic aspects of the architecture like encoding and introspection, but also provides details concerning two backends. It shows how the system interfaces with X3D-plugins and WebGL and also discusses implementation specific features and limitations.

Artusi, Alessandro (Ed.) et al.: VAST 2010. Short and Project Papers Proceedings. Goslar: Eurographics Association, 2010, pp. 53-56

With the current generation of smartphones augmented reality (AR) finally gets in the hands of end users. This is a giant leap for cultural heritage presentation. But due to software and hardware limitations of consumer devices the AR experience is still lacking the quality we have seen in research projects over the last years. In this paper we are proposing a scalable method for high quality AR presentations for cultural heritage on a wide range of consumer devices: Snapshot Augmented Reality. Instead of a live video stream superimposed with jittering annotations we are "freezing" the scene and enabling Augmented Reality Photography. The result is an interactive scene superimposed on a still image taken by a visitor. In order to outsource processing power and deliver content for a wide range of smartphones most of the sophisticated software works in the cloud. We are describing a reliable and scalable server infrastructure for tracking objects and environments and delivering context aware content to the visitors' devices.

Institute for Systems and Technologies of Information, Control and Communication (INSTICC): VISIGRAPP 2009. Proceedings : International Joint Conference on Computer Vision and Computer Graphics Theory and Applications [CD-ROM]. INSTICC Press, 2009, GRAPP, pp. 387-392

This paper introduces novel techniques of interacting and controlling 3D content using multi-touch interaction principles for navigation and virtual camera control. Based on applications from GIS and for the architectural design review process, implementation and usage of these interaction techniques are illustrated. A comprehensive hardware and software setup is used, which not only includes tracking, but also an X3D based layer to simplify application development. Therefore it allows designers and other non-programmers to develop multi-touch applications very efficiently, while allowing to focus on user interaction and content.

Ruttkay, Zsófia (Ed.) et al.: Intelligent Virtual Agents : 9th International Conference, IVA 2009. Berlin; Heidelberg; New York: Springer, 2009. (Lecture Notes in Artificial Intelligence (LNAI) 5773), pp. 504-505

In this paper a framework for dynamically parameterizing emotional skin changes like blushing and pallor is outlined. The parameterization is based on physiological and psychological knowledge. Furthermore, an on-surface droplet flow simulation was integrated for simulating a weeping character. The skin color changes and the droplet flow simulation can operate in real-time and thus provide an animation, which is consistent with the facial expression of the virtual character.

Sablatnig, Robert (Ed.) et al.: 15th International Conference on Virtual Systems and Multimedia. Proceedings : VSMM 2009. Los Alamitos, Calif.: IEEE Computer Society, 2009, pp. 193-196

In this paper we are presenting Cultural Heritage Layers, an approach that enables the visualization of historic media like drawings, paintings and photographs of buildings and historic scenes seamlessly superimposed on reality via video see through using X3D. This enables simple, inexpensive and sustainable Augmented Reality applications in the cultural heritage and architectural area based on industry standards. The main idea is to use existing historic media from archives and superimpose them seamlessly on reality at the right spot. These locative layers are context sensitively telling the location's history and create the impression of a virtual time journey. The registration of the virtual objects in the video images is provided by a robust 6DOF tracking framework based on two technologies that work in tandem: an initialization step based on Randomized Trees and a frame-to-frame tracking phase based on KLT. The entire application runs in real time on current Ultra Mobile PCs and MIDs.

Debattista, Kurt (Ed.) et al.: VAST 2009. VAST-STAR, Short and Project Papers Proceedings. Msida: University of Malta, 2009, pp. 112-116

Museums often lack the possibilitiy to present archaeological or cultural heritage sites in a realistic and interesting way. Thus are proposing a new way to show augmented reality applications of cultural heritage sites at remote places like museums. In the exhibition space large wall-filling photographs of the real site are superimposed with interactive contextual annotations like 3D reconstructions, images and movies. Therefore we are using two different hardware setups for visualization: Standard UMPCs and a custom made revolving display. The setup has been installed and tested at SIGGRAPH 2008, Allard Pierson Museum in Amsterdam and CeBIT 2009. Museum visitors could experience Forum Romanum and Saticum in an informative and intuitive way by pointing the video see through devices on different areas of the photographs. The result is a more realistic and entertaining way for presenting cultural heritage sites in museums. Furthermore our solution is less expensive than comparable installations regarding content and hardware.

Cunningham, Paul (Ed.) et al.: Collaboration and the Knowledge Economy: Issues, Applications, Case Studies. Part 2. Amsterdam; Berlin: IOS Press, 2008. (Information and Communication Technologies and the Knowledge Economy 5), pp. 1331-1338

Because of the difficulties in navigating public transport networks and finding out about available activities, cultural tourists tend to follow a pre-planned itinerary and to visit a fairly small set of well known attractions. An analogous situation emerges at the cultural heritage sites themselves: while cultural heritage sites typically have a large amount of archive material, only a small amount of information can be presented, therefore visitors tend not to explore the culturalsignificance of exhibits in depth. Our solution represents a complete mobile information system for travellers intended to encourage exploration. The system consists of three modules: firstly location-based information intended to enhance the cultural tourist's understanding and to suggest exploratory activities based on modelling the users interests; secondly ad-hoc itinerary planning functionality to give the user the confidence to explore and a novel augmented reality system for presenting information in a user friendly way using markerless tracking. This paper covers the research and development aspects of iTACITUS, a sixth framework programme project, reporting on both technical and coordination issues, as well as interaction issues encountered during the project trials.

Spencer, Stephen N. (Ed.): Proceedings WEB3D 2008 : 13th International Symposium on 3D Web Technology. New York: ACM Press, 2008, pp. 27-30

Multi-touch interaction on tabletop displays is a very active field of todays HCI research. However, most publications still focus on tracking techniques or develop a gesture configuration for a specific application setup. Very few explore generic high level interfaces for multi-touch applications. In this paper we present a comprehensive hardware and software setup, which includes an X3D based layer to simplify the application development process. We present a robust FTIR based optical tracking system, examine in how far current sensor and navigation abstractions in the X3D standard are useful and finally present extensions to the standard, which enable designers and other non-programmers to develop multi-touch applications very efficiently.

ACM SIGCHI: Proceedings VRST 2008 : ACM Symposium on Virtual Reality Software and Technology. New York: ACM, 2008, pp. 263-264

Multi-touch interaction on tabletop displays is a very active field of todays HCI research. However, most publications still focus on tracking techniques or develop gesture configurations for a specific application setup using a small set of simple gestures. In this work we present a new approach to easily set up the recognition of even complex gestures for multi-touch applications. Our gesture recognition module is based on Hidden Markov Models, which offer a robust recognition of multiple gestures in real-time. An X3D interface of the recognition module is provided to qualify designers and other non-programmers to apply gesture recognition functionalities to multi-touch applications in an easy and straightforward manner.

5th Intuition 2008. Proceedings : Virtual Reality in Industry and Society: From Research to Application. Turin, 2008, 7 p.

This paper describes the development of a virtual factory application based on multi-touch interaction, high resolution projection technology and industry standards like X3D. The application is a presentation tool to describe hidden complex physical processes inside a plant for bulk material handling. We are covering the project objectives, the scene architecture and the CAD and physical simulation production pipelines.