A WebGL framework for viewing pre-recorded and live audio data
Supervisor
Suitable for
Abstract
Conservation biologists commonly use passive acoustic recorders, such as AudioMoth (https://www.openacousticdevices.info),
to understand which species of birds, bats and insects are living within an environment. The software tools to analyse these
recordings have traditionally been distributed as native applications. However, support for the File System Access API in
the Chrome and Edge browsers now allows browser-based tools to offer the same functionality. These browser-based tools can
also go further using frameworks such as WebGL to accelerate rendering and computation. In this project, you will be required
to develop a set of WebGL tools to manipulate and visualise acoustic recordings within the browser. The tools will allow the
user to explore wavefom and sonogram views of pre-recorded WAV files, and should be sufficiently optimised to allow live audio,
captured by USB microphones, to be viewed in real-time. A stretch goal is to develop additional tools that allow various filters
and recognition algorithms to be applied in real-time; for example, to automatically annotate and recognise bat calls.