Smart Window

With advancing globalization and increasingly interconnected economic regions, the demands on transport and supply infrastructure are rising. Shipping plays a particularly important role, as its inherent spatial constraints differ significantly from those of aviation, rail, and road transport. While rail and road traffic are directly bound to their respective infrastructures, and air traffic is strictly monitored and centrally controlled, shipping is constrained by waterways to a lesser degree. Compared to aviation, ships are monitored less rigorously and are often “on their own” outside port areas. This results in significantly higher requirements for autonomy and forward-looking planning.

To meet these demands, increasingly complex computer-assisted systems and sensor networks are being deployed.

In our “Smart Window” project, we bring advanced sensor and display technologies to the bridges of commercial, container, and passenger ships. This innovative concept transforms conventional ship windows into interactive smart windows, which not only significantly enhance safety at sea but also make navigation more precise and easier. Equipped with cutting-edge laser projection and OLED display technology, these windows show essential navigation information directly in the captain’s and crew’s line of sight without obstructing the view outside. Augmented Reality (AR) overlays real-time data from navigation markers and other vessels onto the real environment. In addition, sensors measure stress from extreme wave conditions and provide data for fast and precise situational analysis, especially under challenging weather conditions.

Within the framework of our project, two prototypes have already been developed and successfully tested in real-world environments, achieving Technology Readiness Level 5. These prototypes use compact projection modules and transparent OLED displays, which produce no stray light and allow an unobstructed view.

To address the specific challenges of the maritime environment, tailored procedures and technologies were developed. Our advanced sensor fusion processes data on 6D ship motion, personnel localization, gaze direction, and integrated window sensor data. This comprehensive data acquisition and analysis allows precise adjustment of the displayed information to match external conditions and the specific requirements of ship operations.

We have developed systems that enable spatially correct augmentation directly in the working area of the navigators, featuring asynchronous processing with microservices for delay-free real-time use.

With Smart Windows, we focus on safety, efficiency, and cutting-edge technology to meet the challenges of high-sea navigation.