A Real-Time Lyrics Alignment System Using Chroma and Phonetic Features for Classical Singing Performance

A real-time lyrics tracking system for vocal performance.

The source code of the paper A Real-Time Lyrics Alignment System Using Chroma And Phonetic Features For Classical Vocal Performance, accepted by ICASSP 2024.

Data Preparation

The dataset for evaluation is available at here. Please download the dataset and put it under the data folder.

Environment Setup

$ conda env create -f environment.yml
$ conda activate rt-lyrics

Usage

Open the evaluation.ipynb notebook and run the cells.

License

This project is under the CC-BY-NC 4.0 license. See LICENSE for details.

Citation

Please consider citing our paper in your publications if the project helps your research. BibTeX reference is as follow.

@inproceedings{park2024real,
  title={A Real-Time Lyrics Alignment System Using Chroma and Phonetic Features for Classical Vocal Performance},
  author={Park, Jiyun and Yong, Sangeon and Kwon, Taegyun and Nam, Juhan},
  booktitle={ICASSP 2024-2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)},
  pages={1371--1375},
  year={2024},
  organization={IEEE}
}