SyncPlayer - An Advanced System for Multimodal Music Access
In this research project, we develop the SyncPlayer framework for multimodal presentation of high quality audio and associated music-related data. Using the SyncPlayer client interface, a user may play back an audio recording which is locally available on his computer. The recording is then identified by the SyncPlayer server, a process which is performed entirely content-based. Subsequently, the server delivers music-related data like scores or lyrics to the client, which are then displayed synchronously to audio playback using a multimodal visualization plug-in.
In addition to visualization, the system provides functionality for content-based music retrieval and semi-manual content annotation. To the best of our knowledge, our system is the first to systematically exploit automatically generated synchronization data for content-based symbolic browsing in high quality audio recordings (see our 2004 research paper on automatic Score-Audio synchronization as well as some synchronization results) SyncPlayer already proved to be a valuable tool for evaluating algorithms in MIR research on a larger scale.
SyncPlayer Resources