SlideShare ist ein Scribd-Unternehmen logo
1 von 15
What’s this song?
Music Recognition Pilots 2012-2013
    Technology, Music Rights, Licensing
                21.3.2013
               Turo Pekari
Is it possible to
    create setlists from
    live gigs and clubs
    using automated
    music recognition
    system?
2
Music Recognition Pilots 2012-2013

    • Live Music       •DJ/Club Music
      Recognition      monitoring
    • 15-17.6.2013     • 12/2012-
    • Provinssirock    03/2013
      Finland



3
4
Partners
                 Nightwish
                  PMMP
               Notkea Rotta
                  Darude
                  Orkidea
                 K-System
               Riku Kokkonen


5
                       Kuvat: Yleisradio, OKM, Provinssirock
Live Music Recognition Pilot
 Provinssirock 15-17.6.2012
• 3 gigs, 3 days
• (Friday) Nightwish
• (Saturday) PMMP
• (Sunday) Notkea Rotta



•Recordings: Mixing desk/audience (wav/mp3)
•Reference Data: artist discographies


                                              Kuva: Turo Pekari
Live music recognition is tricky

              • Identification of songs is
              more complex than in mere
              matching of 2 identical
              audio files
              • No commercial solutions
              available




                                      Kuva: Turo Pekari
Why?
1. It’s never been done before!
2. …but it’s possible.
3. Untapped potential?
-More efficient reporting, new services




                                          Kuva: Turo Pekari
PMMP
    NIGHTWISH




                NOTKEA
9                ROTTA
• System works already with some restrictions (genre)
• Identification does not need high quality audio to succeed.
• No significant differences between results from mixing desk and
  audience recordings.
• Restrictions: limited size of reference data




                                                                Kuva: Turo Pekari
DJ/Club Music Monitoring


     •   12/2012-03/2013      • BMAT Vericast Audio
                              Identification technology
     • 4 Finnish DJs
     • Darude, K-System,      • How does broadcast
     Orkidea, Riku Kokkonen   monitoring technology
                              handle DJ/club music
     •   5 DJ sets            identification?
     •   4 line out signal
     •   1 live DJ-set
11
                                                      Kuva: Turo Pekari
Reference Audio Sets
     •   ORIGINAL           •   VERSION          •   BIG DATA

     • 55 songs             •166 songs           • 10K of popular
     • 76% coverage         • Other versions     club music
     • Original reference   (e.g. original,      including the
     collection matched     extended version,    ORIGINAL
     against recordings     club, mix, radio     references
                            edit)                • Performance
                            • Used to bias the   estimations and
                            results and          validation
                            investigate the
                            relation between
                            the different
                            versions.

12
• Good results from identification straight from mixing desk line-out
• Best results from K-System DJ-set
• Mixing and processing live signal and line-out signal in second
     Darude DJ-set caused difficulties




13                                                        Kuva: Turo Pekari
3 scenarios for implementing the
system (live music and club music)

1. Big festivals       2. Integrated           3. Tour/Artist-
                       systems for active      specific service
-Best efficiency       live venues
                                               -An alternative for
-Royalties             - Clubs, cruise ships   manual reporting
distributed vs. cost
of service             - Both live and DJ
                         music recognition
- New services for       offered as one
the audience based       service
on data



                                                       Kuva: Turo Pekari
For more information:
 • Turo Pekari (turo.pekari@teosto.fi)
 • Ano Sirppiniemi (ano.sirppiniemi@teosto.fi)




15

Weitere ähnliche Inhalte

Was ist angesagt?

machine learning x music
machine learning x musicmachine learning x music
machine learning x musicYi-Hsuan Yang
 
Internet radio young people
Internet radio young peopleInternet radio young people
Internet radio young peoplejenhughes
 
Internet Radio Vs Podcasting
Internet Radio Vs PodcastingInternet Radio Vs Podcasting
Internet Radio Vs PodcastingPaul Roberts
 
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR TechniquesLearning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR TechniquesYi-Hsuan Yang
 
Start Your Own Internet Radio Station
Start Your Own Internet Radio StationStart Your Own Internet Radio Station
Start Your Own Internet Radio StationInner Ear
 
Teaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology ResourcesTeaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology Resourcesbradfordswanson
 
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020Yi-Hsuan Yang
 
Sound Basics with Audio Technik
Sound Basics with Audio TechnikSound Basics with Audio Technik
Sound Basics with Audio TechnikColin Richardson
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adam Sporka
 
Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Yi-Hsuan Yang
 

Was ist angesagt? (15)

machine learning x music
machine learning x musicmachine learning x music
machine learning x music
 
楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索楊奕軒/音樂資料檢索
楊奕軒/音樂資料檢索
 
Internet radio young people
Internet radio young peopleInternet radio young people
Internet radio young people
 
Music mobile
Music mobileMusic mobile
Music mobile
 
Internet Radio Vs Podcasting
Internet Radio Vs PodcastingInternet Radio Vs Podcasting
Internet Radio Vs Podcasting
 
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR TechniquesLearning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
Learning to Generate Jazz & Pop Piano Music from Audio via MIR Techniques
 
Audio Recording
Audio RecordingAudio Recording
Audio Recording
 
Start Your Own Internet Radio Station
Start Your Own Internet Radio StationStart Your Own Internet Radio Station
Start Your Own Internet Radio Station
 
Teaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology ResourcesTeaching Music Technology Concepts with Few Music Technology Resources
Teaching Music Technology Concepts with Few Music Technology Resources
 
Beatz
BeatzBeatz
Beatz
 
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
Research on Automatic Music Composition at the Taiwan AI Labs, April 2020
 
Sound Basics with Audio Technik
Sound Basics with Audio TechnikSound Basics with Audio Technik
Sound Basics with Audio Technik
 
Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)Adaptive Music in Video Games (2018)
Adaptive Music in Video Games (2018)
 
Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017Research at MAC Lab, Academia Sincia, in 2017
Research at MAC Lab, Academia Sincia, in 2017
 
Spoy Karaoke (EN)
Spoy Karaoke (EN)Spoy Karaoke (EN)
Spoy Karaoke (EN)
 

Mehr von Teosto ry

Polaris Nordic Digital Music Survey 2017
Polaris Nordic Digital Music Survey 2017Polaris Nordic Digital Music Survey 2017
Polaris Nordic Digital Music Survey 2017Teosto ry
 
Musiikki verkossa
Musiikki verkossaMusiikki verkossa
Musiikki verkossaTeosto ry
 
Media&Message-esitys
Media&Message-esitysMedia&Message-esitys
Media&Message-esitysTeosto ry
 
Teoston kevätseminaari 23.5.2013 Teoston Kari Paananen
Teoston kevätseminaari 23.5.2013 Teoston Kari PaananenTeoston kevätseminaari 23.5.2013 Teoston Kari Paananen
Teoston kevätseminaari 23.5.2013 Teoston Kari PaananenTeosto ry
 
Naistenklinikka 2013
Naistenklinikka 2013Naistenklinikka 2013
Naistenklinikka 2013Teosto ry
 
Mikä biisi tää on? -presentaatio @ MARS-festivaali
Mikä biisi tää on? -presentaatio @ MARS-festivaaliMikä biisi tää on? -presentaatio @ MARS-festivaali
Mikä biisi tää on? -presentaatio @ MARS-festivaaliTeosto ry
 
Treenikämpät nyt!
Treenikämpät nyt!Treenikämpät nyt!
Treenikämpät nyt!Teosto ry
 
Mikä biisi tää on?
Mikä biisi tää on?Mikä biisi tää on?
Mikä biisi tää on?Teosto ry
 

Mehr von Teosto ry (8)

Polaris Nordic Digital Music Survey 2017
Polaris Nordic Digital Music Survey 2017Polaris Nordic Digital Music Survey 2017
Polaris Nordic Digital Music Survey 2017
 
Musiikki verkossa
Musiikki verkossaMusiikki verkossa
Musiikki verkossa
 
Media&Message-esitys
Media&Message-esitysMedia&Message-esitys
Media&Message-esitys
 
Teoston kevätseminaari 23.5.2013 Teoston Kari Paananen
Teoston kevätseminaari 23.5.2013 Teoston Kari PaananenTeoston kevätseminaari 23.5.2013 Teoston Kari Paananen
Teoston kevätseminaari 23.5.2013 Teoston Kari Paananen
 
Naistenklinikka 2013
Naistenklinikka 2013Naistenklinikka 2013
Naistenklinikka 2013
 
Mikä biisi tää on? -presentaatio @ MARS-festivaali
Mikä biisi tää on? -presentaatio @ MARS-festivaaliMikä biisi tää on? -presentaatio @ MARS-festivaali
Mikä biisi tää on? -presentaatio @ MARS-festivaali
 
Treenikämpät nyt!
Treenikämpät nyt!Treenikämpät nyt!
Treenikämpät nyt!
 
Mikä biisi tää on?
Mikä biisi tää on?Mikä biisi tää on?
Mikä biisi tää on?
 

Teosto – What's this song? @finlandiatalo

  • 1. What’s this song? Music Recognition Pilots 2012-2013 Technology, Music Rights, Licensing 21.3.2013 Turo Pekari
  • 2. Is it possible to create setlists from live gigs and clubs using automated music recognition system? 2
  • 3. Music Recognition Pilots 2012-2013 • Live Music •DJ/Club Music Recognition monitoring • 15-17.6.2013 • 12/2012- • Provinssirock 03/2013 Finland 3
  • 4. 4
  • 5. Partners Nightwish PMMP Notkea Rotta Darude Orkidea K-System Riku Kokkonen 5 Kuvat: Yleisradio, OKM, Provinssirock
  • 6. Live Music Recognition Pilot Provinssirock 15-17.6.2012 • 3 gigs, 3 days • (Friday) Nightwish • (Saturday) PMMP • (Sunday) Notkea Rotta •Recordings: Mixing desk/audience (wav/mp3) •Reference Data: artist discographies Kuva: Turo Pekari
  • 7. Live music recognition is tricky • Identification of songs is more complex than in mere matching of 2 identical audio files • No commercial solutions available Kuva: Turo Pekari
  • 8. Why? 1. It’s never been done before! 2. …but it’s possible. 3. Untapped potential? -More efficient reporting, new services Kuva: Turo Pekari
  • 9. PMMP NIGHTWISH NOTKEA 9 ROTTA
  • 10. • System works already with some restrictions (genre) • Identification does not need high quality audio to succeed. • No significant differences between results from mixing desk and audience recordings. • Restrictions: limited size of reference data Kuva: Turo Pekari
  • 11. DJ/Club Music Monitoring • 12/2012-03/2013 • BMAT Vericast Audio Identification technology • 4 Finnish DJs • Darude, K-System, • How does broadcast Orkidea, Riku Kokkonen monitoring technology handle DJ/club music • 5 DJ sets identification? • 4 line out signal • 1 live DJ-set 11 Kuva: Turo Pekari
  • 12. Reference Audio Sets • ORIGINAL • VERSION • BIG DATA • 55 songs •166 songs • 10K of popular • 76% coverage • Other versions club music • Original reference (e.g. original, including the collection matched extended version, ORIGINAL against recordings club, mix, radio references edit) • Performance • Used to bias the estimations and results and validation investigate the relation between the different versions. 12
  • 13. • Good results from identification straight from mixing desk line-out • Best results from K-System DJ-set • Mixing and processing live signal and line-out signal in second Darude DJ-set caused difficulties 13 Kuva: Turo Pekari
  • 14. 3 scenarios for implementing the system (live music and club music) 1. Big festivals 2. Integrated 3. Tour/Artist- systems for active specific service -Best efficiency live venues -An alternative for -Royalties - Clubs, cruise ships manual reporting distributed vs. cost of service - Both live and DJ music recognition - New services for offered as one the audience based service on data Kuva: Turo Pekari
  • 15. For more information: • Turo Pekari (turo.pekari@teosto.fi) • Ano Sirppiniemi (ano.sirppiniemi@teosto.fi) 15