16/09/2020

Audio Target Calibration and Localisation in Augmented Reality (AR)

Categories: News | Funding | AR


This proposal aims to investigate the ability to acoustically conform

the sound in the Experience to the environment that the device is

placing it in. All AR technologies (handheld and head-worn) currently

available have restrictions on the field of view that they have with

their ability to be aware of the room that the device is in. Whether

this is through inside-out tracking or stereo cameras capable of depth

perception. Mobile AR is able to detect surfaces and allow movement

around AR objects with the double-camera array that is included on

iPhone X and AR-ready iPads (2017). Hololens, Meta and other AR headsets

are able to detect the extent and depth of a room. Lower end mobile

devices with only one camera are still able to detect surfaces, but do

not have the same level of depth detection.

 

This work will investigate the efficiency and efficacy of some

capture or calibration of the space to use this data for advanced

acoustical rendering (similar to how a user must calibrate a VR setup to

ensure the external cameras ‘know’ where the headset is in space). This

type of calibration can be either stored on a mobile device to be used

for processing or a real-time geometry-based rendering algorithm can be

executed on non-tethered devices. Currently, physical rendering is only

possible with a small number of software spatialisers (such as

SteamAudio and NVIDIA).

 

This idea could be expanded to:

 

 

 

 

  • Sonification of the world visible through the AR window
  • Haptic feedback in AR / Mobile AR
  • Understanding and modelling the contents in the AR window

Supervisory team:

 

 

 

 

What is funded

 

Self-Funding Students Only

 

Eligibility

 

Academic Criteria:

 

A 2:1 Honours undergraduate degree or a master's degree, in computing

or a related subject. Applicants with appropriate professional

experience are also considered. Degree-level mathematics (or equivalent)

is required for research in some project areas.

 

Applicants for whom English is not their first language must

demonstrate proficiency by obtaining an IELTS score of at least 6.5

overall, with a minimum of 6.0 in each skills component.

 

How to Apply

 

To apply please complete the online application - https://www.cardiff.ac.uk/study/postgraduate/research/programmes/program..., select the ‘self-funding’ option, and state the project title and supervisor name.