SlideShare a Scribd company logo
1 of 39
Comparison of microphone distances
for real-time reverberation enhancement system
using optimal source distribution technique
Atsushi Marui (Tokyo University of the Arts)
Motoki Yairi (Kajima Technical Research Institute)
Toru Kamekawa (Tokyo University of the Arts)
Background
• Musicians preparing for a live performance want to experience the spatial
impression of the concert hall
• Difficult to try the actual concert hall before the performance
(geographically, financially, …)
• Reverberation enhancement systems
• Reverberation enhancement by adding artificial reverberation to
microphone captured instrument sounds
August 9th, 2018 Marui, Yairi, Kamekawa 1
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
August 9th, 2018 Marui, Yairi, Kamekawa 2
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
August 9th, 2018 Marui, Yairi, Kamekawa 3
several subjects, who performed the instruments,
strings, brass or woodwinds.
3.1.1. System
Figure 4: Brock diagram of Experimental system
t
p
3
T
m
p
g
A
t
3
I
v
l
F
s
p
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 4
between the objective parameters and musicians’
evaluations. The study also revealed two primary
perceptual dimensions from the musicians’ subjective
judgments on different acoustic aspects: ‘Overall
quality’ and ‘Timbre.’ ‘Overall quality’ judgment was
varied by the fact whether the musicians were familiar
with the halls, however, ‘Timbre’ was an independent
quality that was correlated with the frequency variation
of Early Decay Time (EDT).
The authors reported preliminary subjective evaluation
results in 2012 from an investigation of five string
quartets [11]. The study showed musicians’ significant
preference for augmented acoustics produced by a new
active acoustics system and discovered several
contributing perceptual attributes to their preference.
In this paper, the previous results are combined with a
new set of result from the experiments with six more
string quartets, a total of 44 musicians.
1 BACKGROUND
McGill University’s Virtual Acoustics Technology
(VAT) system utilizes high-resolution impulse
responses of various unique acoustic spaces, measured
since 2005 by the VAT Lab Research Group [12]. The
acoustic responses were measured using a custom sound
source system consisting of 2 subwoofers, 2 super-
tweeters and 8-14 accompanying loudspeakers
space immersing the musicians in a desired acoustic
response. In total, 16 custom dodecahedron
loudspeakers along with 4 sub-woofers are used. Each
dodecahedron unit encloses 12 full range drivers, which
means that 192 speaker drivers are projecting acoustic
responses into the hall. The speakers are carefully
positioned to cover the entire floor area as well as the
vertical space of the room. They have been calibrated
with measurement tools and the ears of expert sound
engineers.
Figure 1: VAT system in MMR at McGill University.
Eight microphones cover the floor area above musicians
and the signals are amplified and converted to the
digital domain at 24bit / 96kHz resolution. Preamplifiers
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 5
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 6
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
Binaural Reproduction
• A small-scale speaker array
implementing crosstalk
cancellation using Optimal
Source Distribution method
Background
• Supplying reverberation in a smaller
rehearsal hall to recreate a large hall
• E.g., Lokki et al. (2009)
• Supplying reverberation in near
anechoic room
• E.g., Ueno et al. (1996, 2003),
Tsuchikura et al. (2012)
• Controlling reverberation for
musically adequate amount
• E.g., Ko and Woszczyk (2015)
August 9th, 2018 Marui, Yairi, Kamekawa 7
Our Goal
• Realistic reverberation support
in smaller setup
• In an ordinary practice room
Binaural Reproduction
• A small-scale speaker array
implementing crosstalk
cancellation using Optimal
Source Distribution method
Microphone Setting?
• Close mic
• sounds not good
• Far mic
• room reverb makes feedback
Playing an instrument in a room
August 9th, 2018 Marui, Yairi, Kamekawa 8
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 9
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
Questions addressed in this study
• How is the quality of binaural reproduction of room reverberation
• Usable in practice situations?
• Comparable with the actual room?
• How close or far should the microphone be?
August 9th, 2018 Marui, Yairi, Kamekawa 10
The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 11
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
Which room?
Studio A, Senju Campus, Tokyo University of the Arts
August 9th, 2018 Marui, Yairi, Kamekawa 12
Binaural impulse response measurement
August 9th, 2018 Marui, Yairi, Kamekawa 13
Binaural impulse response measurement
August 9th, 2018 Marui, Yairi, Kamekawa 14
Binaural impulse response measurement
August 9th, 2018 Marui, Yairi, Kamekawa 15
Binaural impulse response measurement
August 9th, 2018 Marui, Yairi, Kamekawa 16
The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 17
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
ßß
ß
Which room?
August 9th, 2018 Marui, Yairi, Kamekawa 18
August 9th, 2018 Marui, Yairi, Kamekawa 19
August 9th, 2018 Marui, Yairi, Kamekawa 20
August 9th, 2018 Marui, Yairi, Kamekawa 21
August 9th, 2018 Marui, Yairi, Kamekawa 22
August 9th, 2018 Marui, Yairi, Kamekawa 23
Control Room for Studio A, Senju Campus, Tokyo University of the Arts
August 9th, 2018 Marui, Yairi, Kamekawa 24
Experimental setup
August 9th, 2018 Marui, Yairi, Kamekawa 25
Experimental setup
August 9th, 2018 Marui, Yairi, Kamekawa 26
Microphone setup
August 9th, 2018 Marui, Yairi, Kamekawa 27
DPA 4099
Schoeps CMC641
Schoeps CMC64
Mic 4
Mic 3
Mic 2
Mic 1
The system used for the experiment
August 9th, 2018 Marui, Yairi, Kamekawa 28
ADCDAC
1.5 m
0.75 m
Mic 4
Mic 3
Mic 2
Mic 1
pow.amp.convolvermic.amp.
ß
Experimental Variables
Independent Variable
• 4 mic placements + 1 actual room
• Mic on the instrument,
15cm, 30cm, 75cm above
• Studio A
August 9th, 2018 Marui, Yairi, Kamekawa 29
Dependent Variables
• timbre(音色)
• spatial impression(空間印象)
• reverberation(残響感)
• ease of playing(演奏のしやすさ)
• overall quality(総合的な良さ)
• preference(個人的な好み)
Method
• Scheffé’s Pairwise Comparison
• Take 2 stimuli from 5 stimuli
and rate by how much one is higher in a given attribute (in 11-pts)
• For all possible pairs: 5 x (5–4) = 20 pairs
• All pairs were given in an random order in single blinded manner (except for
the actual room where participant had to walk in and out)
Reducing Number of Stimuli Presentations
1
2
3
4
5
6
7
8
9
10
C
A
E
D
B
August 9th, 2018 Marui, Yairi, Kamekawa 30
Participants
• 3 professional violinists
• More than 25 years of violin experiences
• Members of Tokyo University of the Arts Philharmonia Symphony
Orchestra
• Native Japanese language users
• Have prior experiences in taking subjective experiments
August 9th, 2018 Marui, Yairi, Kamekawa 31
Sample Reponses
August 9th, 2018 Marui, Yairi, Kamekawa 32
timbre
spatial
reverb
ease
quality
pref
timbre
spatial
reverb
ease
quality
pref
The current setting (A) can be rated as… compared to the previous setting (M)
previous better current better
Results
August 9th, 2018 Marui, Yairi, Kamekawa 33
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• 1–4 are mic placement
• 1 is the closest
(violin mounted)
• 4 is the furthest
• A is the room
• Bars connecting stimuli show
statistically significant
differences in α=.05 level
Results
August 9th, 2018 Marui, Yairi, Kamekawa 34
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
Results
August 9th, 2018 Marui, Yairi, Kamekawa 35
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
Results
August 9th, 2018 Marui, Yairi, Kamekawa 36
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
• No significant differences
between furthest microphone
and actual room on:
• Reverberation
• Ease of Playing
• Overall Quality
• Preference
Results
August 9th, 2018 Marui, Yairi, Kamekawa 37
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
-2 -1 0 +1 +2
Timbre
Spatial Impression
Preference
Ease of Playing
Overall Quality
Reverberation
A1 2 3 4
A12 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
A1 2 3 4
• Studio A (actual room) is
rated the highest
• Further microphones are
rated higher in most cases
• No significant differences
between furthest microphone
and actual room on:
• Reverberation
• Ease of Playing
• Overall Quality
• Preference
Summary
• Goal: to provide a realistic reverberation to instruments players
• Method:
• provide real-time binaural convolution reverb
• loudspeaker array using crosstalk cancellation
• Experiment: 5 stimuli were rated on 6 attributes in pairwise comparison
• Stimuli: 4 microphone distances and 1 actual live room
• Attributes: timbre, spatial impression, reverberation, ease of playing,
overall quality, preference
• Results:
• Actual live room was rated highest for all attributes
• Further located microphones are rated higher in most cases
• No significant differences between furthest microphone and actual
room on: Reverberation, Ease of Playing, Overall Quality, Preference
August 9th, 2018 Marui, Yairi, Kamekawa 38

More Related Content

Recently uploaded

Environmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial BiosensorEnvironmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial Biosensorsonawaneprad
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024innovationoecd
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxmalonesandreagweneth
 
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》rnrncn29
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPirithiRaju
 
Neurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trNeurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trssuser06f238
 
Carbon Dioxide Capture and Storage (CSS)
Carbon Dioxide Capture and Storage (CSS)Carbon Dioxide Capture and Storage (CSS)
Carbon Dioxide Capture and Storage (CSS)Tamer Koksalan, PhD
 
Forensic limnology of diatoms by Sanjai.pptx
Forensic limnology of diatoms by Sanjai.pptxForensic limnology of diatoms by Sanjai.pptx
Forensic limnology of diatoms by Sanjai.pptxkumarsanjai28051
 
preservation, maintanence and improvement of industrial organism.pptx
preservation, maintanence and improvement of industrial organism.pptxpreservation, maintanence and improvement of industrial organism.pptx
preservation, maintanence and improvement of industrial organism.pptxnoordubaliya2003
 
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPirithiRaju
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPirithiRaju
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx023NiWayanAnggiSriWa
 
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxTHE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxNandakishor Bhaurao Deshmukh
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfSELF-EXPLANATORY
 
Topic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxTopic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxJorenAcuavera1
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)riyaescorts54
 
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXDole Philippines School
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)Columbia Weather Systems
 
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxSTOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxMurugaveni B
 
Speech, hearing, noise, intelligibility.pptx
Speech, hearing, noise, intelligibility.pptxSpeech, hearing, noise, intelligibility.pptx
Speech, hearing, noise, intelligibility.pptxpriyankatabhane
 

Recently uploaded (20)

Environmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial BiosensorEnvironmental Biotechnology Topic:- Microbial Biosensor
Environmental Biotechnology Topic:- Microbial Biosensor
 
OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024OECD bibliometric indicators: Selected highlights, April 2024
OECD bibliometric indicators: Selected highlights, April 2024
 
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptxLIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
LIGHT-PHENOMENA-BY-CABUALDIONALDOPANOGANCADIENTE-CONDEZA (1).pptx
 
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》《Queensland毕业文凭-昆士兰大学毕业证成绩单》
《Queensland毕业文凭-昆士兰大学毕业证成绩单》
 
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdfPests of soyabean_Binomics_IdentificationDr.UPR.pdf
Pests of soyabean_Binomics_IdentificationDr.UPR.pdf
 
Neurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 trNeurodevelopmental disorders according to the dsm 5 tr
Neurodevelopmental disorders according to the dsm 5 tr
 
Carbon Dioxide Capture and Storage (CSS)
Carbon Dioxide Capture and Storage (CSS)Carbon Dioxide Capture and Storage (CSS)
Carbon Dioxide Capture and Storage (CSS)
 
Forensic limnology of diatoms by Sanjai.pptx
Forensic limnology of diatoms by Sanjai.pptxForensic limnology of diatoms by Sanjai.pptx
Forensic limnology of diatoms by Sanjai.pptx
 
preservation, maintanence and improvement of industrial organism.pptx
preservation, maintanence and improvement of industrial organism.pptxpreservation, maintanence and improvement of industrial organism.pptx
preservation, maintanence and improvement of industrial organism.pptx
 
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdfPests of jatropha_Bionomics_identification_Dr.UPR.pdf
Pests of jatropha_Bionomics_identification_Dr.UPR.pdf
 
Pests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdfPests of Bengal gram_Identification_Dr.UPR.pdf
Pests of Bengal gram_Identification_Dr.UPR.pdf
 
Bioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptxBioteknologi kelas 10 kumer smapsa .pptx
Bioteknologi kelas 10 kumer smapsa .pptx
 
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptxTHE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
THE ROLE OF PHARMACOGNOSY IN TRADITIONAL AND MODERN SYSTEM OF MEDICINE.pptx
 
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdfBehavioral Disorder: Schizophrenia & it's Case Study.pdf
Behavioral Disorder: Schizophrenia & it's Case Study.pdf
 
Topic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptxTopic 9- General Principles of International Law.pptx
Topic 9- General Principles of International Law.pptx
 
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
(9818099198) Call Girls In Noida Sector 14 (NOIDA ESCORTS)
 
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTXALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
ALL ABOUT MIXTURES IN GRADE 7 CLASS PPTX
 
User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)User Guide: Orion™ Weather Station (Columbia Weather Systems)
User Guide: Orion™ Weather Station (Columbia Weather Systems)
 
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptxSTOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
STOPPED FLOW METHOD & APPLICATION MURUGAVENI B.pptx
 
Speech, hearing, noise, intelligibility.pptx
Speech, hearing, noise, intelligibility.pptxSpeech, hearing, noise, intelligibility.pptx
Speech, hearing, noise, intelligibility.pptx
 

Featured

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by HubspotMarius Sescu
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTExpeed Software
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsPixeldarts
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthThinkNow
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfmarketingartwork
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024Neil Kimberley
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)contently
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024Albert Qian
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsKurio // The Social Media Age(ncy)
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Search Engine Journal
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summarySpeakerHub
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next Tessa Mero
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentLily Ray
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best PracticesVit Horky
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project managementMindGenius
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...RachelPearson36
 

Featured (20)

2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot2024 State of Marketing Report – by Hubspot
2024 State of Marketing Report – by Hubspot
 
Everything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPTEverything You Need To Know About ChatGPT
Everything You Need To Know About ChatGPT
 
Product Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage EngineeringsProduct Design Trends in 2024 | Teenage Engineerings
Product Design Trends in 2024 | Teenage Engineerings
 
How Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental HealthHow Race, Age and Gender Shape Attitudes Towards Mental Health
How Race, Age and Gender Shape Attitudes Towards Mental Health
 
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdfAI Trends in Creative Operations 2024 by Artwork Flow.pdf
AI Trends in Creative Operations 2024 by Artwork Flow.pdf
 
Skeleton Culture Code
Skeleton Culture CodeSkeleton Culture Code
Skeleton Culture Code
 
PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024PEPSICO Presentation to CAGNY Conference Feb 2024
PEPSICO Presentation to CAGNY Conference Feb 2024
 
Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)Content Methodology: A Best Practices Report (Webinar)
Content Methodology: A Best Practices Report (Webinar)
 
How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024How to Prepare For a Successful Job Search for 2024
How to Prepare For a Successful Job Search for 2024
 
Social Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie InsightsSocial Media Marketing Trends 2024 // The Global Indie Insights
Social Media Marketing Trends 2024 // The Global Indie Insights
 
Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024Trends In Paid Search: Navigating The Digital Landscape In 2024
Trends In Paid Search: Navigating The Digital Landscape In 2024
 
5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary5 Public speaking tips from TED - Visualized summary
5 Public speaking tips from TED - Visualized summary
 
ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd ChatGPT and the Future of Work - Clark Boyd
ChatGPT and the Future of Work - Clark Boyd
 
Getting into the tech field. what next
Getting into the tech field. what next Getting into the tech field. what next
Getting into the tech field. what next
 
Google's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search IntentGoogle's Just Not That Into You: Understanding Core Updates & Search Intent
Google's Just Not That Into You: Understanding Core Updates & Search Intent
 
How to have difficult conversations
How to have difficult conversations How to have difficult conversations
How to have difficult conversations
 
Introduction to Data Science
Introduction to Data ScienceIntroduction to Data Science
Introduction to Data Science
 
Time Management & Productivity - Best Practices
Time Management & Productivity -  Best PracticesTime Management & Productivity -  Best Practices
Time Management & Productivity - Best Practices
 
The six step guide to practical project management
The six step guide to practical project managementThe six step guide to practical project management
The six step guide to practical project management
 
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
Beginners Guide to TikTok for Search - Rachel Pearson - We are Tilt __ Bright...
 

Comparison of microphone distances for real-time reverberation enhancement system using optimal source distribution technique

  • 1. Comparison of microphone distances for real-time reverberation enhancement system using optimal source distribution technique Atsushi Marui (Tokyo University of the Arts) Motoki Yairi (Kajima Technical Research Institute) Toru Kamekawa (Tokyo University of the Arts)
  • 2. Background • Musicians preparing for a live performance want to experience the spatial impression of the concert hall • Difficult to try the actual concert hall before the performance (geographically, financially, …) • Reverberation enhancement systems • Reverberation enhancement by adding artificial reverberation to microphone captured instrument sounds August 9th, 2018 Marui, Yairi, Kamekawa 1
  • 3. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) August 9th, 2018 Marui, Yairi, Kamekawa 2
  • 4. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) • Supplying reverberation in near anechoic room • E.g., Ueno et al. (1996, 2003), Tsuchikura et al. (2012) August 9th, 2018 Marui, Yairi, Kamekawa 3 several subjects, who performed the instruments, strings, brass or woodwinds. 3.1.1. System Figure 4: Brock diagram of Experimental system t p 3 T m p g A t 3 I v l F s p
  • 5. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) • Supplying reverberation in near anechoic room • E.g., Ueno et al. (1996, 2003), Tsuchikura et al. (2012) • Controlling reverberation for musically adequate amount • E.g., Ko and Woszczyk (2015) August 9th, 2018 Marui, Yairi, Kamekawa 4 between the objective parameters and musicians’ evaluations. The study also revealed two primary perceptual dimensions from the musicians’ subjective judgments on different acoustic aspects: ‘Overall quality’ and ‘Timbre.’ ‘Overall quality’ judgment was varied by the fact whether the musicians were familiar with the halls, however, ‘Timbre’ was an independent quality that was correlated with the frequency variation of Early Decay Time (EDT). The authors reported preliminary subjective evaluation results in 2012 from an investigation of five string quartets [11]. The study showed musicians’ significant preference for augmented acoustics produced by a new active acoustics system and discovered several contributing perceptual attributes to their preference. In this paper, the previous results are combined with a new set of result from the experiments with six more string quartets, a total of 44 musicians. 1 BACKGROUND McGill University’s Virtual Acoustics Technology (VAT) system utilizes high-resolution impulse responses of various unique acoustic spaces, measured since 2005 by the VAT Lab Research Group [12]. The acoustic responses were measured using a custom sound source system consisting of 2 subwoofers, 2 super- tweeters and 8-14 accompanying loudspeakers space immersing the musicians in a desired acoustic response. In total, 16 custom dodecahedron loudspeakers along with 4 sub-woofers are used. Each dodecahedron unit encloses 12 full range drivers, which means that 192 speaker drivers are projecting acoustic responses into the hall. The speakers are carefully positioned to cover the entire floor area as well as the vertical space of the room. They have been calibrated with measurement tools and the ears of expert sound engineers. Figure 1: VAT system in MMR at McGill University. Eight microphones cover the floor area above musicians and the signals are amplified and converted to the digital domain at 24bit / 96kHz resolution. Preamplifiers
  • 6. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) • Supplying reverberation in near anechoic room • E.g., Ueno et al. (1996, 2003), Tsuchikura et al. (2012) • Controlling reverberation for musically adequate amount • E.g., Ko and Woszczyk (2015) August 9th, 2018 Marui, Yairi, Kamekawa 5 Our Goal • Realistic reverberation support in smaller setup • In an ordinary practice room
  • 7. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) • Supplying reverberation in near anechoic room • E.g., Ueno et al. (1996, 2003), Tsuchikura et al. (2012) • Controlling reverberation for musically adequate amount • E.g., Ko and Woszczyk (2015) August 9th, 2018 Marui, Yairi, Kamekawa 6 Our Goal • Realistic reverberation support in smaller setup • In an ordinary practice room Binaural Reproduction • A small-scale speaker array implementing crosstalk cancellation using Optimal Source Distribution method
  • 8. Background • Supplying reverberation in a smaller rehearsal hall to recreate a large hall • E.g., Lokki et al. (2009) • Supplying reverberation in near anechoic room • E.g., Ueno et al. (1996, 2003), Tsuchikura et al. (2012) • Controlling reverberation for musically adequate amount • E.g., Ko and Woszczyk (2015) August 9th, 2018 Marui, Yairi, Kamekawa 7 Our Goal • Realistic reverberation support in smaller setup • In an ordinary practice room Binaural Reproduction • A small-scale speaker array implementing crosstalk cancellation using Optimal Source Distribution method Microphone Setting? • Close mic • sounds not good • Far mic • room reverb makes feedback
  • 9. Playing an instrument in a room August 9th, 2018 Marui, Yairi, Kamekawa 8 ADCDAC 1.5 m 0.75 m Mic 4 Mic 3 Mic 2 Mic 1 pow.amp.convolvermic.amp. ß ßß ß
  • 10. The system used for the experiment August 9th, 2018 Marui, Yairi, Kamekawa 9 ADCDAC 1.5 m 0.75 m Mic 4 Mic 3 Mic 2 Mic 1 pow.amp.convolvermic.amp. ß ßß ß
  • 11. Questions addressed in this study • How is the quality of binaural reproduction of room reverberation • Usable in practice situations? • Comparable with the actual room? • How close or far should the microphone be? August 9th, 2018 Marui, Yairi, Kamekawa 10
  • 12. The system used for the experiment August 9th, 2018 Marui, Yairi, Kamekawa 11 ADCDAC 1.5 m 0.75 m Mic 4 Mic 3 Mic 2 Mic 1 pow.amp.convolvermic.amp. ß ßß ß Which room?
  • 13. Studio A, Senju Campus, Tokyo University of the Arts August 9th, 2018 Marui, Yairi, Kamekawa 12
  • 14. Binaural impulse response measurement August 9th, 2018 Marui, Yairi, Kamekawa 13
  • 15. Binaural impulse response measurement August 9th, 2018 Marui, Yairi, Kamekawa 14
  • 16. Binaural impulse response measurement August 9th, 2018 Marui, Yairi, Kamekawa 15
  • 17. Binaural impulse response measurement August 9th, 2018 Marui, Yairi, Kamekawa 16
  • 18. The system used for the experiment August 9th, 2018 Marui, Yairi, Kamekawa 17 ADCDAC 1.5 m 0.75 m Mic 4 Mic 3 Mic 2 Mic 1 pow.amp.convolvermic.amp. ß ßß ß Which room?
  • 19. August 9th, 2018 Marui, Yairi, Kamekawa 18
  • 20. August 9th, 2018 Marui, Yairi, Kamekawa 19
  • 21. August 9th, 2018 Marui, Yairi, Kamekawa 20
  • 22. August 9th, 2018 Marui, Yairi, Kamekawa 21
  • 23. August 9th, 2018 Marui, Yairi, Kamekawa 22
  • 24. August 9th, 2018 Marui, Yairi, Kamekawa 23
  • 25. Control Room for Studio A, Senju Campus, Tokyo University of the Arts August 9th, 2018 Marui, Yairi, Kamekawa 24
  • 26. Experimental setup August 9th, 2018 Marui, Yairi, Kamekawa 25
  • 27. Experimental setup August 9th, 2018 Marui, Yairi, Kamekawa 26
  • 28. Microphone setup August 9th, 2018 Marui, Yairi, Kamekawa 27 DPA 4099 Schoeps CMC641 Schoeps CMC64 Mic 4 Mic 3 Mic 2 Mic 1
  • 29. The system used for the experiment August 9th, 2018 Marui, Yairi, Kamekawa 28 ADCDAC 1.5 m 0.75 m Mic 4 Mic 3 Mic 2 Mic 1 pow.amp.convolvermic.amp. ß
  • 30. Experimental Variables Independent Variable • 4 mic placements + 1 actual room • Mic on the instrument, 15cm, 30cm, 75cm above • Studio A August 9th, 2018 Marui, Yairi, Kamekawa 29 Dependent Variables • timbre(音色) • spatial impression(空間印象) • reverberation(残響感) • ease of playing(演奏のしやすさ) • overall quality(総合的な良さ) • preference(個人的な好み) Method • Scheffé’s Pairwise Comparison • Take 2 stimuli from 5 stimuli and rate by how much one is higher in a given attribute (in 11-pts) • For all possible pairs: 5 x (5–4) = 20 pairs • All pairs were given in an random order in single blinded manner (except for the actual room where participant had to walk in and out)
  • 31. Reducing Number of Stimuli Presentations 1 2 3 4 5 6 7 8 9 10 C A E D B August 9th, 2018 Marui, Yairi, Kamekawa 30
  • 32. Participants • 3 professional violinists • More than 25 years of violin experiences • Members of Tokyo University of the Arts Philharmonia Symphony Orchestra • Native Japanese language users • Have prior experiences in taking subjective experiments August 9th, 2018 Marui, Yairi, Kamekawa 31
  • 33. Sample Reponses August 9th, 2018 Marui, Yairi, Kamekawa 32 timbre spatial reverb ease quality pref timbre spatial reverb ease quality pref The current setting (A) can be rated as… compared to the previous setting (M) previous better current better
  • 34. Results August 9th, 2018 Marui, Yairi, Kamekawa 33 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 Timbre Spatial Impression Preference Ease of Playing Overall Quality Reverberation A1 2 3 4 A12 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 • 1–4 are mic placement • 1 is the closest (violin mounted) • 4 is the furthest • A is the room • Bars connecting stimuli show statistically significant differences in α=.05 level
  • 35. Results August 9th, 2018 Marui, Yairi, Kamekawa 34 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 Timbre Spatial Impression Preference Ease of Playing Overall Quality Reverberation A1 2 3 4 A12 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 • Studio A (actual room) is rated the highest
  • 36. Results August 9th, 2018 Marui, Yairi, Kamekawa 35 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 Timbre Spatial Impression Preference Ease of Playing Overall Quality Reverberation A1 2 3 4 A12 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 • Studio A (actual room) is rated the highest • Further microphones are rated higher in most cases
  • 37. Results August 9th, 2018 Marui, Yairi, Kamekawa 36 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 Timbre Spatial Impression Preference Ease of Playing Overall Quality Reverberation A1 2 3 4 A12 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 • Studio A (actual room) is rated the highest • Further microphones are rated higher in most cases • No significant differences between furthest microphone and actual room on: • Reverberation • Ease of Playing • Overall Quality • Preference
  • 38. Results August 9th, 2018 Marui, Yairi, Kamekawa 37 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 -2 -1 0 +1 +2 Timbre Spatial Impression Preference Ease of Playing Overall Quality Reverberation A1 2 3 4 A12 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 A1 2 3 4 • Studio A (actual room) is rated the highest • Further microphones are rated higher in most cases • No significant differences between furthest microphone and actual room on: • Reverberation • Ease of Playing • Overall Quality • Preference
  • 39. Summary • Goal: to provide a realistic reverberation to instruments players • Method: • provide real-time binaural convolution reverb • loudspeaker array using crosstalk cancellation • Experiment: 5 stimuli were rated on 6 attributes in pairwise comparison • Stimuli: 4 microphone distances and 1 actual live room • Attributes: timbre, spatial impression, reverberation, ease of playing, overall quality, preference • Results: • Actual live room was rated highest for all attributes • Further located microphones are rated higher in most cases • No significant differences between furthest microphone and actual room on: Reverberation, Ease of Playing, Overall Quality, Preference August 9th, 2018 Marui, Yairi, Kamekawa 38

Editor's Notes

  1. The session is on “Signal/Spatial Processing” The presentations so far, in my point of view, started with theory in the first presentation and then application in the second presentation. My presentation is going to be actually not the processing itself but an application and evaluation of a signal processing system for musicians. The focuses of this conference is on science and aesthetics, after all.
  2. This “evaluation of microphone setting” is today’s main topic.
  3. Headphones playback of binaural room reverb? Not good, for example, for violins. Ear occlusion from the headphones (no direct sound) Headphone enclosure interferes with the instrument.
  4. We want to recreate the reverberation at the violin player’s ears. You have to have the binaural room-related impulse response at the violin player’s ears, with the sound source at the instrument.
  5. The room where the concert was held on Monday. RT = 1.0 sec
  6. Had discussion with a violin player so that we can place both sound source and microphones at the instrument and the performer’s ears.
  7. Sound absorbers were placed to reduce floor reflection. The actual floor reflection in the playback room will be used for the floor.
  8. By making the control room into an experiment room, the participants can compare the recreated reverberation against the actual room reverberation at any time if they want to.
  9. Mic 1: DPA 4099 (super-cardioid) on the instrument Mic 2: Schoeps CMC64 (15cm) Mic 3: Schoeps CMC641 (30cm) Mic 4: Schoeps CMC641 (75cm)
  10. Mic 1: DPA 4099 (super-cardioid) on the instrument Mic 2: Schoeps CMC64 (15cm) Mic 3: Schoeps CMC641 (30cm) Mic 4: Schoeps CMC641 (75cm)
  11. …Comparison of 20 pairs makes 40 times of playing and listening. It is rather tough task for participants.
  12. 5 stimuli are placed as nodes in Eurelian cycle (directional graph single stroke) where edges denote the comparison number. For example, edge number 1 shows it is a comparison of A and B. Participant can remember what she had rated before and move on to the next stimulus comparing with the one before. Five stimuli were assigned randomly to nodes A through E. Also, 10 edges in the opposite direction were added to counter-balance the effect of presentation order. This reduced the number of stimuli to evaluate from 40 to 21.
  13. Scheffe’s method unfolds pairwise comparisons into unidimensional scores.
  14. All attributes were used in similar manner.
  15. This was expected. But the difference between the microphones were rather smaller than what we anticipated. It’s in somewhat comparable range.
  16. Statistically significant differences were seen in Timbre and Spatial Impression. Not having significant differences do not mean that they were perceived the same way. Still, they are in somewhat comparable range.
  17. All attributes were used in similar manner. We haven’t checked the correlation coefficients since there were only three participants.