Presented at http://classicalmusichackday.org

1. MUSIC HACK DAY, Vienna 2013
Audiveris
Optical Music Recognition
Presented by Hervé Bitteur
herve.bitteur@audiveris.org February 2, 2013
V1

2. 2www.audiveris.orgVIENNA 2013
Agenda
● User demo
● The big picture
● Audiveris technology
● Current 4.2 release
● Integration
● Future

3. 3www.audiveris.orgVIENNA 2013
User Demo
● User oriented
 Input
 Corrections
 Outputs
● Case
 Input : Dichterliebe01.pdf
 Language : DEU
 Tempo : 80
 Output : Finale Notepad

4. 4www.audiveris.orgVIENNA 2013
Score Transcription « big picture »
Symbolic
Notation
Printed
Scores
OMR
Music
Info
Retrieval
Index
Search
Edition
Scores
Images
Edit
View
Play
Transpose
Pivot Format
Optical Music Recognition
AudiverisAudiveris
MuseScore
PeachNote
Scan
MusicXML

5. 5www.audiveris.orgVIENNA 2013
Music notation
● MusicXML
 Symbol level
 Meant for score interchange
● MIDI
 Note level
 Meant for digital instruments
● MP3
 Sound level
 Meant for recorded music
High level
Low level

6. 6www.audiveris.orgVIENNA 2013
OCR vs OMR
OCR
(text)
OMR
(music)
Complexity Horizontal lines of
characters
Combined horizontal &
vertical directions
Technology Rather mature Several years
behind OCR
Products Many Just a few.
One FOSS: Audiveris

7. 7www.audiveris.orgVIENNA 2013
Basic definitions: Runs & Sections
Black run of 3 pixels
White run of 18 pixels
Section of 6 adjacent runs

8. 8www.audiveris.orgVIENNA 2013
Tech Demo
● Technology oriented
 Runs
 Grid
● Case
 Input : Chula.png
 Language : FRA
 Params : showRuns, showCombs
 Output : MuseScore

9. 9www.audiveris.orgVIENNA 2013
Pixels: Staff Lines & other objects

10. 10www.audiveris.orgVIENNA 2013
Black runs histo. → line thickness

11. 11www.audiveris.orgVIENNA 2013
White runs histogram → interline

12. 12www.audiveris.orgVIENNA 2013
Vertical runs > line thickness

13. 13www.audiveris.orgVIENNA 2013
Vertical runs <= line thickness

14. 14www.audiveris.orgVIENNA 2013
Short horizontal runs put aside

15. 15www.audiveris.orgVIENNA 2013
Long hori. runs → lines skeleton

16. 16www.audiveris.orgVIENNA 2013
Clusters of equidistant lines

17. 17www.audiveris.orgVIENNA 2013
Staff lines detected

18. 18www.audiveris.orgVIENNA 2013
Staff lines removed

19. 19www.audiveris.orgVIENNA 2013
Wavy staff lines: Splines

20. 20www.audiveris.orgVIENNA 2013
Wavy staff lines: Dewarped image

21. 21www.audiveris.orgVIENNA 2013
Stems detected

22. 22www.audiveris.orgVIENNA 2013
Sections → Glyphs → Shapes

23. 23www.audiveris.orgVIENNA 2013
Generated score

24. 24www.audiveris.orgVIENNA 2013
Audiveris version 4.2
● Released in December 2012
● Features:
 Ghostscript integration
– for PDF input
 Adaptive Binarization
– for non-uniform images
 Tesseract OCR V3
– for text handling
 ART-based moments
– for shape recognition
 Plugins
– for MusicXML consumers

25. 25www.audiveris.orgVIENNA 2013
Local OMR Integration
MusicXML
scan
Audiveris
plugin
plugin
MuseScore
display
client

26. 26www.audiveris.orgVIENNA 2013
OMR as a Service (hack of the day)
MusicXML
scan
MuseScore
display
internet
Audiveris
Front
End
client server

27. 27www.audiveris.orgVIENNA 2013
Audiveris evolution
● Technology
 Good building blocks available
 4.2+: iterative approach OK for good-quality scans
 5.x: fuzzy logic needed for poor-quality scans
● Architecture
 Focus on OMR service
● « Freemium » model
 Free for basic features or low volume
 Premium for more serious usage

28. Thank you
www.audiveris.org
Audiveris [latin] := « you will have heard »
herve.bitteur@audiveris.org