Skip to main content

A WebGL framework for viewing pre-recorded and live audio data

Supervisor

Suitable for

MSc in Advanced Computer Science
Mathematics and Computer Science, Part C
Computer Science and Philosophy, Part C
Computer Science, Part C
Computer Science, Part B

Abstract

Conservation biologists commonly use passive acoustic recorders, such as AudioMoth (https://www.openacousticdevices.info), to understand which species of birds, bats and insects are living within an environment. The software tools to analyse these recordings have traditionally been distributed as native applications. However, support for the File System Access API in the Chrome and Edge browsers now allows browser-based tools to offer the same functionality. These browser-based tools can also go further using frameworks such as WebGL to accelerate rendering and computation. In this project, you will be required to develop a set of WebGL tools to manipulate and visualise acoustic recordings within the browser. The tools will allow the user to explore wavefom and sonogram views of pre-recorded WAV files, and should be sufficiently optimised to allow live audio, captured by USB microphones, to be viewed in real-time. A stretch goal is to develop additional tools that allow various filters and recognition algorithms to be applied in real-time; for example, to automatically annotate and recognise bat calls.