Demonstration
Model-based Beamforming for Wearable Microphone Arrays
This page provides listening examples for the evaluation of a MPDR beamformer using a compact model sample covariance matrix (SCM) estimation method, using wearable arrays and presented in this paper.
The simulation experiment considers a dialogue scenario, where a desired speaker is located in front of the listener, while two interfering sources are located on their left, at 45˚ and 90˚ respectively. Babble noise is simulated as originating from 16 azimuth directions, and white Gaussian sensor noise is added to the signals.
The source speech samples are concatenations of anechoic recordings from the the TIMIT [1] database. The signals are simulated at the array through convolution of the source signals with body-related transfer functions from [2].
The beamformers used in the comparison include
- a passthrough system at a pair of in-ear microphones
- an oracle MPDR beamformer having access to the target clean signal
- a classical adaptive MPDR beamformer
- an MPDR beamformer using the compact model SCM estimation from [3].
The audio player is built using the trackswitch.js tool in [4].
Audio examples
Varying interference level
Speech corrupted by interferences at -5 dB SIR, with 20 dB SNR sensor noise, 20 dB SNR babble noise.
Varying babble noise level
Speech corrupted by babble noise at -5 dB SNR, with 20 dB SNR sensor noise, 20 dB SIR interferences.
References
[1] J. S. Garofolo, L. F. Lamel, W. M. Fisher, J. G. Fiscus, D. S. Pallett, N. L.Dahlgren, and V. Zue, “TIMIT acoustic-phonetic continuous speech corpus,” Linguistic Data Consortium (LDC), Philadelphia, USA, Corpus, 1993.
[2] R. M. Corey, N. Tsuda, and A. C. Singer, “Acoustic impulse responses for wearable audio devices,” in Proc. IEEE Int. Conf. on Acoust., Speech and Signal Process. (ICASSP), 2019, pp. 216–220.
[3] A. Moore, P. Naylor, and M. Brookes, “Improving robustness of adaptive beamforming for hearing devices,” in Proc. Int. Symp. on Auditory and Audiological Research. (ISAAR), vol. 7, Nyborg, Denmark, Jul. 2019, pp. 305–316.
[4] N. Werner, S. Balke, F-R Stöter, M. Müller, B. Edler “trackswitch.js: A Versatile Web-Based Audio Player for Presenting Scientifc Results.” 3rd Web Audio Conference, London, UK. 2017.