Sea Trout Analyzer & Annotator

Preserving nature and the environment in a healthy state is of immense importance to us all. Based on the Red List of endangered species, the sea trout population had become so threatened that, between 1992 and 1999, renaturation programs were required to repopulate certain regions.

Sea trout (Salmo trutta) belong to the group of “anadromous fish,” which means that they migrate from the sea into freshwater to spawn. However, in many places their passage is blocked by dams or weirs. As a result, sea trout have already been eradicated from many rivers.

To monitor sea trout populations, environmental institutes in Europe currently use methods such as counting with electrofishing devices or netting from a reference body of water. These methods are labor-intensive, locally restricted, and sometimes dangerous for the population itself.

As part of our pilot project, environmental institutes built bottlenecks along rivers that sea trout must pass through, in order to observe them with video cameras. However, analyzing the footage is still a labor-intensive process: a single staff member would need 5,664 hours to review the more than 1,360,000 videos recorded over the course of five months at all bottlenecks.

© Uwe Friedrich FIUM GmbH & Co. KG
Camera setups in rivers are used for counting sea trout. The photo was taken at low water levels.

An example of the video images to be evaluated is shown in the figure below. It illustrates that even humans require training to reliably recognize and classify sea trout in video recordings.

Selection of videos that contain no sea trout.
Selection of videos that contain sea trout. The image with the most fish-like features was chosen.

Comprehensive monitoring thanks to AI

Researchers at the Fraunhofer Institute for Computer Graphics Research IGD in Rostock have trained an artificial intelligence (AI) with video snippets to distinguish sea trout from drifting leaves and other fish. Now, for the first time, AI can help to systematically study the migration routes of this salmonid species across wide areas. This lengthy procedure has been significantly shortened: thanks to AI, instead of taking one year, the analysis now requires only two weeks. Another advantage is that, instead of monitoring just five to six rivers for sea trout as before, true large-scale observation is now possible.

 

Maritime Economy

We support the digitalization of the maritime sector. With market-oriented products and new business models, we work together to secure your technological performance. When it comes to sustainably using the oceans as an economic area, you can rely on our innovative strength and our expertise in the specific requirements and conditions of the maritime industry.