Official Announcement
We are excited to introduce MusicalityBench, a stateless, continuously updated benchmark for evaluating artificial intelligence-generated songs in real time.
The concept of Musicality as a human evaluation metric was first introduced by Radford (https://arxiv.org/abs/2005.00341), where songs were judged by expert musicians against criteria for enjoyable, human-made music. MusicalityBench builds directly on this foundation, expanding the original definition of Musicality to keep pace with new models, new songs, and an evaluation landscape that never stops moving.