Título:
Saraga Audiovisual : A large multimodal open data collection for the analysis of Carnatic Music.
Otros títulos:
Coordinador:
Director:
Compilador:
Autor:
Shankar, Adithi
Plaja-Roglans, Genís
Nuttall, Thomas
Rocamora, Martín
Serra, Xavier
Plaja-Roglans, Genís
Nuttall, Thomas
Rocamora, Martín
Serra, Xavier
Tutor:
Tipo de documento:
Ponencia
Editor:
Palabras clave:
Applications
Music videos
Multimodal music systems
Evaluation, datasets, and reproducibility
Novel datasets and use cases
Knowledge-driven approaches to MIR
Computational ethnomusicology
MIR tasks
Pattern matching and detection
Sound source separation
Computational musicology
Music videos
Multimodal music systems
Evaluation, datasets, and reproducibility
Novel datasets and use cases
Knowledge-driven approaches to MIR
Computational ethnomusicology
MIR tasks
Pattern matching and detection
Sound source separation
Computational musicology
Descriptores:
Año de publicación:
2024
Contenido:
Resumen:
Carnatic music is a style of South Indian art music whose analysis using computational methods is an active area of research in Music Information Research (MIR). A core, open dataset for such analysis is the Saraga dataset, which includes multi-stem audio, expert annotations, and accompanying metadata. However, it has been noted that there are several limitations to the Saraga collections, and that additional relevant aspects of the tradition still need to be covered to facilitate musicologically important research lines. In this work, we present Saraga Audiovisual, a dataset that includes new and more diverse renditions of Carnatic vocal performances, totalling 42 concerts and more than 60 hours of music. A major contribution of this dataset is the inclusion of video recordings for all concerts, allowing for a wide range of multimodal analyses. We also provide high-quality human pose estimation data of the musicians extracted from the video footage, and perform benchmarking experiments for the different modalities to validate the utility of the novel collection. Saraga Audiovisual, along with access tools and results of our experiments, is made available for research purposes.
Descripción:
metadata.articulos.dc.description.uri:
Editorial:
ISMIR
EN:
25th International Society for Music Information Retrieval (ISMIR), San Francisco, California, United States, 10-14 nov. 2024, pp. 1-9.
Financiadores:
Este trabajo fue realizado bajo el marco de "IA y Música: Cátedra en Inteligencia Artificial y Música (TSI-100929-2023-1)", financiado por la Secretaría de Estado de Digitalización e Inteligencia Artificial y la European Union-Next Generation EU, en el marco del programa Cátedras ENIA 2022 para la creación de cátedras universidad-empresa en IA.
Citación:
Shankar, A., Plaja-Roglans, G., Nuttall, T. y otros. Saraga Audiovisual : A large multimodal open data collection for the analysis of Carnatic Music [en línea]. EN: 25th International Society for Music Information Retrieval (ISMIR), San Francisco, California, United States, 10-14 nov. 2024, pp. 1-9.
Citación:
metadata.articulos.cc.license.name:
ISBN:
e-ISBN:
ISSN:
ISMN:
Otros identificadores:
Cobertura geográfica:
Asia, Sur de la India
Cobertura temporal:
Departamento académico:
Procesamiento de Señales
Grupo de investigación:
Procesamiento de Audio (GPA)
Licencia:
Licencia Creative Commons Atribución (CC - By 4.0)
Colecciones:
| Ficheros | Descripción | Tamaño | Formato | ||
|---|---|---|---|---|---|
| SPNRS24.pdf | Versión publicada | 6.27 MB | Adobe PDF |