• Publikationen
Show publication details

Matthiesen, Moritz; Rojtberg, Pavel [1. Gutachten]; Kuijper, Arjan [2. Gutachten]

Interpolation von Kalibrier daten für Zoom und Autofokus Kameras

2019

Darmstadt, TU, Bachelor Thesis, 2019

In dieser Arbeit wird das Problem betrachtet, dass für jede neue Kameraeinstellung eine neue Kalibrierung vorgenommen werden muss.Ziel dabei ist Kalibrierdaten an bestimmten Kameraeinstellungen zu erstellen, um mithilfe vondiesen die Kalibrierdaten von anderen Kameraeinstellungen herzuleiten. Dabei werden die Kalibrierdaten betrachtet und es wird versucht Beziehungen zwischen den einzelnen Parametern der Kalibrierung herzuleiten. Um diese zu ermitteln wird zwischen verschiedenen Parametern der Kalibrierung interpoliert.

Show publication details

Rojtberg, Pavel; Kuijper, Arjan

Efficient Pose Selection for Interactive Camera Calibration

2018

Proceedings of the 2018 IEEE International Symposium on Mixed and Augmented Reality

IEEE International Symposium on Mixed and Augmented Reality (ISMAR) <17, 2018, Munich, Germany>

The choice of poses for camera calibration with planar patterns is only rarely considered — yet the calibration precision heavily depends on it. This work presents a pose selection method that finds a compact and robust set of calibration poses and is suitable for interactive calibration. Consequently, singular poses that would lead to an unreliable solution are avoided explicitly, while poses reducing the uncertainty of the calibration are favoured. For this, we use uncertainty propagation. Our method takes advantage of a self-identifying calibration pattern to track the camera pose in real-time. This allows to iteratively guide the user to the target poses, until the desired quality level is reached. Therefore, only a sparse set of key-frames is needed for calibration. The method is evaluated on separate training and testing sets, as well as on synthetic data. Our approach performs better than comparable solutions while requiring 30% less calibration frames.

978-1-5386-7459-8

Show publication details

Rojtberg, Pavel; Kuijper, Arjan

Efficient Pose Selection for Interactive Camera Calibration

2017

Adjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality

IEEE International Symposium on Mixed and Augmented Reality (ISMAR) <16, 2017, Nantes, France>

The choice of poses for camera calibration with planar patterns is only rarely considered - yet the calibration precision heavily depend on it. This work presents a pose selection method that explicitly avoids singular pose configurations which would lead to an unreliable solution. Consequently camera poses are favoured that reduce the uncertainty of the calibration parameters most. For this purpose the quality of the calibration parameters is continuously estimated using uncertainty propagation. Our approach performs better than comparable solutions while requiring 30% less calibration frames.

Show publication details

Rojtberg, Pavel; Audenrith, Benjamin

X3ogre: Connecting X3D to a State of the Art Rendering Engine

2017

Proceedings Web3D 2017

International Conference on 3D Web Technology (WEB3D) <22, 2017, Brisbane, Australia>

We connect X3D to the state of the art OGRE renderer using our prototypical x3ogre implementation. At this we perform a comparison of both on a conceptual level, highlighting similarities and differences. Our implementation allows swapping X3D concepts for OGRE concepts and vice versa. We take advantage of this to analyse current shortcomings in X3D and propose X3D extensions to overcome those.

Show publication details

Bergmann, Tim Alexander; Kuijper, Arjan [Betreuer]; Rojtberg, Pavel [Betreuer]

Interaktive Echtzeit-Kalibrierung

2016

Darmstadt, TU, Bachelor Thesis, 2016

Diese Arbeit beschäftigt sich mit der Entwicklung einer Heuristik, die unerfahrene Nutzer durch eine flexible Kamerakalibrierung leitet. Hierfür wird ein Qualitätsmaß basierend auf der Arbeit von Hartley und Zisserman [8, S. 138ff] hergeleitet. Dieses Qualitätsmaß wird verwendet, um Nutzern mit Hilfe von Vorschlägen für Kameraposen die Durchführung einer Kalibrierung zu vereinfachen. Durch diese Hilfestellungen gelingt es unerfahrenen Nutzern eine Kamera mit weniger Bildern, aber gleicher Qualität, bezogen auf den Reprojection Error, zu kalibrieren.

Show publication details

Engelke, Timo; Keil, Jens; Rojtberg, Pavel; Wientapper, Folker; Schmitt, Michael; Bockholt, Ulrich

Content First - A Concept for Industrial Augmented Reality Maintenance Applications using Mobile Devices

2015

MMSys '15

ACM Multimedia Systems Conference (MMSys) <6, 2015, Portland, OR, USA>

Although AR has a long history in the area of maintenance and service-support in industry, there still is a lack of lightweight, yet practical solutions for handheld AR systems in everyday workflows. Attempts to support complex maintenance tasks with AR still miss reliable tracking techniques, simple ways to be integrated into existing maintenance environments, and practical authoring solutions, which minimize costs for specialized content generation. We present a general, customisable application framework, allowing to employ AR and VR techniques in order to support technicians in their daily tasks. In contrast to other systems, we do not aim to replace existing support systems such as traditional manuals. Instead we integrate well-known AR- and novel presentation techniques with existing instruction media. To this end practical authoring solutions are crucial and hence we present an application development system based on web-standards such as HTML,CSS and X3D.

978-1-4503-3351-1

Show publication details

Olbrich, Manuel; Franke, Tobias; Rojtberg, Pavel

Remote Visual Tracking for the (Mobile) Web

2014

Proceedings Web3D 2014

International Conference on 3D Web Technology (WEB3D) <19, 2014, Vancouver, BC, Canada>

Augmented Reality is maturing, but in a world where we are used to straightforward services on the internet, Augmented Reality applications require a lot of preparation before they can be used. Our approach shows how we can bring Augmented Reality into a normal web browser, or even browsers on mobile devices. We show how we are, with recent features of HTML5, able to augment reality based on complex 3D tracking in a browser without having to install or set up any software on a client. With this solution, we are able to extend 3D Web applications with AR and reach more users with a reduced usability barrier. A key contribution of our work is a pipeline for remote tracking built on web-standards.

Show publication details

Wientapper, Folker; Wuest, Harald; Rojtberg, Pavel; Fellner, Dieter W.

A Camera-Based Calibration for Automotive Augmented Reality Head-Up-Displays

2013

12th IEEE International Symposium on Mixed and Augmented Reality 2013.

IEEE International Symposium on Mixed and Augmented Reality (ISMAR) <12, 2013, Adelaide, SA, Australia>

Using Head-up-Displays (HUD) for Augmented Reality requires to have an accurate internal model of the image generation process, so that 3D content can be visualized perspectively correct from the viewpoint of the user. We present a generic and cost-effective camera-based calibration for an automotive HUD which uses the windshield as a combiner. Our proposed calibration model encompasses the view-independent spatial geometry, i.e. the exact location, orientation and scaling of the virtual plane, and a view-dependent image warping transformation for correcting the distortions caused by the optics and the irregularly curved windshield. View-dependency is achieved by extending the classical polynomial distortion model for cameras and projectors to a generic five-variate mapping with the head position of the viewer as additional input. The calibration involves the capturing of an image sequence from varying viewpoints, while displaying a known target pattern on the HUD. The accurate registration of the camera path is retrieved with state-of-the-art vision-based tracking. As all necessary data is acquired directly from the images, no external tracking equipment needs to be installed. After calibration, the HUD can be used together with a head-tracker to form a head-coupled display which ensures a perspectively correct rendering of any 3D object in vehicle coordinates from a large range of possible viewpoints. We evaluate the accuracy of our model quantitatively and qualitatively.

Show publication details

Engelke, Timo; Keil, Jens; Rojtberg, Pavel; Wientapper, Folker; Webel, Sabine; Bockholt, Ulrich

Content First - A concept for Industrial Augmented Reality Maintenance Applications Using Mobile Devices

2013

12th IEEE International Symposium on Mixed and Augmented Reality 2013.

IEEE International Symposium on Mixed and Augmented Reality (ISMAR) <12, 2013, Adelaide, SA, Australia>

Although AR has a long history in the area of maintenance and service-support in industry, there still is a lack of lightweight, yet practical solutions for handheld AR systems in everyday workflows. Attempts to support complex maintenance tasks with AR still miss reliable tracking techniques, simple ways to be integrated into existing maintenance environments, and practical authoring solutions, which minimize costs for specialized content generation. We present a general, customisable application framework, allowing to employ AR and VR techniques in order to support technicians in their daily tasks. In contrast to other systems, we do not aim to replace existing support systems such as traditional manuals. Instead we integrate well-known AR- and novel presentation techniques with existing instruction media. To this end practical authoring solutions are crucial and hence we present an application development system based on web-standards such as HTML,CSS and X3D.

Show publication details

Rojtberg, Pavel; Roth, Stefan [Gutachter]; Gao, Qi [Betreuer]

Image Compression Using MRF Priors

2012

Darmstadt, TU, Master Thesis, 2012

Markov Random Field (MRF) models are used in many low-level computer-vision problems like inpainting or denoising. In this work we evaluate the use of MRF natural image priors in the context of image compression. To this end we formulate compression as finding a sparse point representation of the image, while decompression is formulated as MRF based inpainting. For finding a sparse point representation of images we consider using entropy of the prior probability and the variance of the probabilistic expert functions. The results here are competitive with existing methods. For decompression we find the ability to generate structures of the used high order MRF based model to be lacking. However our experiments with a mean modulating model indicate that, generating more structures is possible for inpainting. Furthermore we adapt the binary tree triangular coding for a variance based point selection and use it to evaluate the importance of efficiently storing the sparse point representation of the image. Here we show that using WebP lossless compression is just as adequate to store the sparse point representation in practical cases. An evaluation considering the state of the art lossy JPEG2000 codec however reveals that our MRF prior based method has to be improved further to be competitive in qualitative terms.

Show publication details

Schwarz, Katharina; Rojtberg, Pavel; Caspar, Joachim; Gurevych, Iryna; Goesele, Michael; Lensch, Hendrik P. A.

Text-to-Video: Story Illustration from Online Photo Collections

2010

Knowledge-Based and Intelligent Information and Engineering Systems

International Conference on Knowledge-Based and Intelligent Information and Engineering Systems (KES) <14, 2010, Cardiff, Wales, UK>

We present a first system to semi-automatically create a visual representation for a given, short text. We first parse the input text, decompose it into suitable units, and construct meaningful search terms. Using these search terms we retrieve a set of candidate images from online photo collections. We then select the final images in a user-assisted process and automatically create a storyboard or photomatic animation. We demonstrate promising initial results on several types of texts.

Show publication details

Rojtberg, Pavel; Goesele, Michael [Betreuer]; Gurevych, Iryna [Betreuerin]; Caspar, Joachim [Betreuer]

Generating Storyboards Based on Natural Language Description

2009

Darmstadt, TU, Bachelor Thesis, 2009

This work explores to what extend it is possible to automatically generate films from textual descriptions formulated in natural language today. For this purpose a prototype implementation is presented that explores possibilities and current limitations. The prototype generates a multimedia presentation using photographs friom the web for visualisation and speech synthesis for sound. Thereby the precision of flickr and google images as image providers is evaluated and improving the coherency of the result by user input and post processing is discussed. Finally this work gives suggests directions for future improvements by discussing the current bottlenecks.