Presented at 2018 Audio Engineering Society International Conference on Spatial Reproduction (Tokyo, Japan)
The paper can be downloaded at http://www.aes.org/e-lib/browse.cfm?elib=19629
Abstract:
Although musical instrument players may want to learn the spatial impressions of the concert hall beforehand, practicing in the actual hall is not practical due to the geographical and the financial reasons. Hence, it is helpful for players if there is a spatial reproduction system that can recreate the concert hall reverberation in their practice environments. An implementation of crosstalk cancellation method for synthesizing virtual auditory space using loudspeakers called Optimal Source Distribution technique is used to add realistic reverberation of a live venue to a violin performance in real-time. In this research, one of the defining parameters for the timbre of convolved reverberation, microphone placements on and over the instrument, were compared by professional players.
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Comparison of microphone distances for real-time reverberation enhancement system using optimal source distribution technique
1. Comparison of microphone distances
for real-time reverberation enhancement system
using optimal source distribution technique
Atsushi Marui (Tokyo University of the Arts)
Motoki Yairi (Kajima Technical Research Institute)
Toru Kamekawa (Tokyo University of the Arts)
2. Background
• Musicians preparing for a live performance want to experience the spatial
impression of the concert hall
• Difficult to try the actual concert hall before the performance
(geographically, financially, …)
• Reverberation enhancement systems
• Reverberation enhancement by adding artificial reverberation to
microphone captured instrument sounds
August 9th, 2018 Marui, Yairi, Kamekawa 1
3. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
August 9th, 2018 Marui, Yairi, Kamekawa 2
4. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
August 9th, 2018 Marui, Yairi, Kamekawa 3
several subjects, who performed the instruments,
strings, brass or woodwinds.
3.1.1. System
Figure 4: Brock diagram of Experimental system
t
p
3
T
m
p
g
A
t
3
I
v
l
F
s
p
5. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 4
between the objective parameters and musicians’
evaluations. The study also revealed two primary
perceptual dimensions from the musicians’ subjective
judgments on different acoustic aspects: ‘Overall
quality’ and ‘Timbre.’ ‘Overall quality’ judgment was
varied by the fact whether the musicians were familiar
with the halls, however, ‘Timbre’ was an independent
quality that was correlated with the frequency variation
of Early Decay Time (EDT).
The authors reported preliminary subjective evaluation
results in 2012 from an investigation of five string
quartets [11]. The study showed musicians’ significant
preference for augmented acoustics produced by a new
active acoustics system and discovered several
contributing perceptual attributes to their preference.
In this paper, the previous results are combined with a
new set of result from the experiments with six more
string quartets, a total of 44 musicians.
1 BACKGROUND
McGill University’s Virtual Acoustics Technology
(VAT) system utilizes high-resolution impulse
responses of various unique acoustic spaces, measured
since 2005 by the VAT Lab Research Group [12]. The
acoustic responses were measured using a custom sound
source system consisting of 2 subwoofers, 2 super-
tweeters and 8-14 accompanying loudspeakers
space immersing the musicians in a desired acoustic
response. In total, 16 custom dodecahedron
loudspeakers along with 4 sub-woofers are used. Each
dodecahedron unit encloses 12 full range drivers, which
means that 192 speaker drivers are projecting acoustic
responses into the hall. The speakers are carefully
positioned to cover the entire floor area as well as the
vertical space of the room. They have been calibrated
with measurement tools and the ears of expert sound
engineers.
Figure 1: VAT system in MMR at McGill University.
Eight microphones cover the floor area above musicians
and the signals are amplified and converted to the
digital domain at 24bit / 96kHz resolution. Preamplifiers
6. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 5
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
7. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 6
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
Binaural Reproduction
• A small-scale speaker array
implementing crosstalk
cancellation using Optimal
Source Distribution method
8. Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 7
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
Binaural Reproduction
• A small-scale speaker array
implementing crosstalk
cancellation using Optimal
Source Distribution method
Microphone Setting?
• Close mic
• sounds not good
• Far mic
• room reverb makes feedback
9. Playing an instrument in a room
August 9th, 2018 Marui, Yairi, Kamekawa 8
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
10. The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 9
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
11. Questions addressed in this study
• How is the quality of binaural reproduction of room reverberation
• Usable in practice situations?
• Comparable with the actual room?
• How close or far should the microphone be?
August 9th, 2018 Marui, Yairi, Kamekawa 10
12. The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 11
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
Which room?
13. Studio A, Senju Campus, Tokyo University of the Arts
August 9th, 2018 Marui, Yairi, Kamekawa 12
18. The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 17
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
Which room?
28. Microphone setup
August 9th, 2018 Marui, Yairi, Kamekawa 27
DPA 4099
Schoeps CMC641
Schoeps CMC64
Mic 4
Mic 3
Mic 2
Mic 1
29. The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 28
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
30. Experimental Variables
Independent Variable
• 4 mic placements + 1 actual room
• Mic on the instrument,
15cm, 30cm, 75cm above
• Studio A
August 9th, 2018 Marui, Yairi, Kamekawa 29
Dependent Variables
• timbre(音色)
• spatial impression(空間印象)
• reverberation(残響感)
• ease of playing(演奏のしやすさ)
• overall quality(総合的な良さ)
• preference(個人的な好み)
Method
• Scheffé’s Pairwise Comparison
• Take 2 stimuli from 5 stimuli
and rate by how much one is higher in a given attribute (in 11-pts)
• For all possible pairs: 5 x (5–4) = 20 pairs
• All pairs were given in an random order in single blinded manner (except for
the actual room where participant had to walk in and out)
31. Reducing Number of Stimuli Presentations
1
2
3
4
5
6
7
8
9
10
C
A
E
D
B
August 9th, 2018 Marui, Yairi, Kamekawa 30
32. Participants
• 3 professional violinists
• More than 25 years of violin experiences
• Members of Tokyo University of the Arts Philharmonia Symphony
Orchestra
• Native Japanese language users
• Have prior experiences in taking subjective experiments
August 9th, 2018 Marui, Yairi, Kamekawa 31
33. Sample Reponses
August 9th, 2018 Marui, Yairi, Kamekawa 32
timbre
spatial
reverb
ease
quality
pref
timbre
spatial
reverb
ease
quality
pref
The current setting (A) can be rated as… compared to the previous setting (M)
previous better current better
34. Results
August 9th, 2018 Marui, Yairi, Kamekawa 33
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• 1–4 are mic placement
• 1 is the closest
(violin mounted)
• 4 is the furthest
• A is the room
• Bars connecting stimuli show
statistically significant
differences in α=.05 level
36. Results
August 9th, 2018 Marui, Yairi, Kamekawa 35
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
37. Results
August 9th, 2018 Marui, Yairi, Kamekawa 36
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
• No significant differences
between furthest microphone
and actual room on:
• Reverberation
• Ease of Playing
• Overall Quality
• Preference
38. Results
August 9th, 2018 Marui, Yairi, Kamekawa 37
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
• No significant differences
between furthest microphone
and actual room on:
• Reverberation
• Ease of Playing
• Overall Quality
• Preference
39. Summary
• Goal: to provide a realistic reverberation to instruments players
• Method:
• provide real-time binaural convolution reverb
• loudspeaker array using crosstalk cancellation
• Experiment: 5 stimuli were rated on 6 attributes in pairwise comparison
• Stimuli: 4 microphone distances and 1 actual live room
• Attributes: timbre, spatial impression, reverberation, ease of playing,
overall quality, preference
• Results:
• Actual live room was rated highest for all attributes
• Further located microphones are rated higher in most cases
• No significant differences between furthest microphone and actual
room on: Reverberation, Ease of Playing, Overall Quality, Preference
August 9th, 2018 Marui, Yairi, Kamekawa 38
Editor's Notes
The session is on “Signal/Spatial Processing”
The presentations so far, in my point of view, started with theory in the first presentation and then application in the second presentation.
My presentation is going to be actually not the processing itself but an application and evaluation of a signal processing system for musicians.
The focuses of this conference is on science and aesthetics, after all.
This “evaluation of microphone setting” is today’s main topic.
Headphones playback of binaural room reverb? Not good, for example, for violins.
Ear occlusion from the headphones (no direct sound)
Headphone enclosure interferes with the instrument.
We want to recreate the reverberation at the violin player’s ears.
You have to have the binaural room-related impulse response at the violin player’s ears, with the sound source at the instrument.
The room where the concert was held on Monday. RT = 1.0 sec
Had discussion with a violin player so that we can place both sound source and microphones at the instrument and the performer’s ears.
Sound absorbers were placed to reduce floor reflection. The actual floor reflection in the playback room will be used for the floor.
By making the control room into an experiment room, the participants can compare the recreated reverberation against the actual room reverberation at any time if they want to.
Mic 1: DPA 4099 (super-cardioid) on the instrument
Mic 2: Schoeps CMC64 (15cm)
Mic 3: Schoeps CMC641 (30cm)
Mic 4: Schoeps CMC641 (75cm)
Mic 1: DPA 4099 (super-cardioid) on the instrument
Mic 2: Schoeps CMC64 (15cm)
Mic 3: Schoeps CMC641 (30cm)
Mic 4: Schoeps CMC641 (75cm)
…Comparison of 20 pairs makes 40 times of playing and listening. It is rather tough task for participants.
5 stimuli are placed as nodes in Eurelian cycle (directional graph single stroke) where edges denote the comparison number.
For example, edge number 1 shows it is a comparison of A and B.
Participant can remember what she had rated before and move on to the next stimulus comparing with the one before.
Five stimuli were assigned randomly to nodes A through E.
Also, 10 edges in the opposite direction were added to counter-balance the effect of presentation order.
This reduced the number of stimuli to evaluate from 40 to 21.
Scheffe’s method unfolds pairwise comparisons into unidimensional scores.
All attributes were used in similar manner.
This was expected. But the difference between the microphones were rather smaller than what we anticipated. It’s in somewhat comparable range.
Statistically significant differences were seen in Timbre and Spatial Impression.
Not having significant differences do not mean that they were perceived the same way. Still, they are in somewhat comparable range.
All attributes were used in similar manner. We haven’t checked the correlation coefficients since there were only three participants.