Acoustic Eye - Innovative acoustic 3D imaging and surveying system based on bionic principles

User interacting with a VR simulation using handheld controllers and a monitoring screen.

The world's oceans are the backbone of global trade. They serve as transit areas for oil and gas pipelines, power and communication lines, make a central contribution to global food supply, and are storage sites for fossil fuels and mineral resources. They also play a key role in the energy transition as suppliers of wind and tidal power. Nevertheless, these complex ecosystems remain largely unexplored in many areas.

The investigation, protection, and sustainable use of maritime resources depend on advanced sensor systems. These systems must replace the eyes and ears that enable us to perceive our environment on land, operating in the medium of water and at extreme depths. Existing sensor systems based on optical or acoustic sensors still have significant limitations. Often, they can only provide a sufficiently accurate and robust picture of the underwater situation (seabed structures, subsea installations, organism colonization, resource distribution, etc.) when used in combination with various systems and specialized carrier vehicles

Project Goal

To address this gap, the collaborative project aims to develop an innovative acoustic 3D imaging and surveying system. By applying bionic insights from the signal processing of bats and dolphins, the system will enable the extraction and real-time analysis of complex acoustic spatial and spectral information for the first time. The method is based on the use of specially configured ultra-wideband signals and novel evaluation procedures. It involves an innovation chain that encompasses practically all structural and functional levels, ultimately establishing a new system performance in underwater sensing.

Fraunhofer IGD is working on the sub-project "Application-specific ultrasonic transducers as well as real-time data processing and visualization," focusing on the graphical representation and detailed analysis of the collected data. New processing and visualization techniques will be developed and combined with specialized analysis tools. This will enable the operator to navigate in 3D within the (virtual) display space, e.g., through a VR headset, and to focus on specific sectors, shells, and objects in color, as well as to select and examine relevant properties. One potential application could be manganese nodule extraction, which currently requires labor-intensive manual area measurements followed by soil sampling. The "Acoustic Eye," mounted as an intelligent-adaptive sensor system on autonomous carrier vehicles (USVs, AUVs, etc.), will take over and simplify the measurement, detection, and precise definition of manganese deposits.

4o mini

Project Partners

  • EvoLogics GmbH
  • Fraunhofer IBMT
  • GEO-DV GmbH
  • Federal Institute for Geosciences and Natural Resources
  • Federal Maritime and Hydrographic Agency
  • Baltic Taucherei- und Bergungsbetriebt Rostock GmbH

Supported by:

Funding notice from the German Federal Ministry for Economic Affairs and Energy.