No Access

Music Emotion Intensity Estimation Using Transfer Ordinal Label Learning Under Heterogeneous Scenes

Jilin Normal University, Siping 136000, P. R. China

https://doi.org/10.1142/S0218213024400049Cited by:0 (Source: Crossref)

This article is part of the issue:

Special Issue on Heterogeneous Domain Adaptation Learning and its Applications in Intelligent System
Guest Editors: Fa Zhu, Xiaochun Cheng and Sotiris Kotsiantis

Abstract

Music emotion recognition plays an important role in many applications such as music material library construction and music recommendation system. The current music emotion recognition mainly focuses on discrete emotions or continuous emotions under single scene. However, on the one hand, intensity is one of important aspects of emotion, which can be represented as emotion rank or ordinal class. On the other hand, there may be not enough music emotion data in training set, which needs to transfer music emotion recognition model learnt from the music data in a source domain. The distribution of existing music data in target domain may differ from target music dataset. In order to overcome these two issues, this paper proposes to utilize transfer ordinal label learning (TOLL) to estimate music emotion. Compared with the previous works, TOLL-based music emotion intensity estimation implements music intensity estimation through transferring the knowledge in the existing source domain to unknown target domain. The experiments on several datasets show that TOLL can achieve promising results for emotion intensity estimation in single scene or across different scenes.

Keywords:

Remember to check out the Most Cited Articles!
Check out Notable Titles in Artificial Intelligence.

References

1. J. Wang, A. Sharifi, T. R. Gadekallu and A. Shankar, MMD-MII model: A multilayered analysis and multimodal integration interaction approach revolutionizing music emotion classification, International Journal of Computational Intelligence Systems 17(1) (2024) 99. Crossref, Web of Science, Google Scholar
2. M. Azrour, J. Mabrouki, A. Guezzaz, S. Ahmad, S. Khan and S. Benkirane, IoT, Machine Learning and Data Analytics for Smart Healthcare (CRC Press, 2024). Google Scholar
3. P. Kumar, R. Chauhan, T. Stephan, A. Shankar and S. Thakur, A machine learning implementation for mental health care. Application: Smart watch for depression detection, in 2021 11th Int. Conf. Cloud Computing, Data Science & Engineering (Confluence) (IEEE, 2021), pp. 568–574. Crossref, Google Scholar
4. S. Khan and S. Alqahtani, Hybrid machine learning models to detect signs of depression, Multimedia Tools and Applications 83(13) (2024) 38819–38837. Crossref, Web of Science, Google Scholar
5. Y. Li, Z. Zhang, H. Ding and L. Chang, Music genre classification based on fusing audio and lyric information, Multimedia Tools and Applications 82(13) (2023) 20157–20176. Crossref, Web of Science, Google Scholar
6. S. Kazazis, P. Depalle and S. McAdams, Ordinal scaling of temporal audio descriptors and perceptual significance of attack temporal centroid in timbre spaces, The Journal of the Acoustical Society of America 150(5) (2021) 3461–3473. Crossref, Web of Science, Google Scholar
7. P. P. Mini, T. Thomas and R. Gopikakumari, EEG based direct speech BCI system using a fusion of SMRT and MFCC/LPCC features with ann classifier, Biomedical Signal Processing and Control 68 (2021) 102625. Crossref, Web of Science, Google Scholar
8. G. D. Saxena, N. A. Farooqui and S. Ali, Extricate features utilizing mel frequency cepstral coefficient in automatic speech recognition system, International Journal of Engineering and Manufacturing 12(6) (2022) 14. Crossref, Google Scholar
9. C. Schörkhuber and A. Klapuri, Constant-q transform toolbox for music processing, in 7th Sound and Music Computing Conf., Barcelona, Spain (Zenodo, 2010), pp. 3–64. Google Scholar
10. G. Tzanetakis, G. Essl and P. Cook, Audio analysis using the discrete wavelet transform, in Proc. Conf. in Acoustics and Music Theory Applications, Vol. 66 (ACM, 2001). Google Scholar
11. T. Sgouros, A. Bousis and N. Mitianoudis, An efficient short-time discrete cosine transform and attentive multiresunet framework for music source separation, IEEE Access 10 (2022) 119448–119459. Crossref, Web of Science, Google Scholar
12. E. Schubert, Modeling perceived emotion with continuous musical features, Music Perception 21(4) (2004) 561–585. Crossref, Web of Science, Google Scholar
13. S. Vashishtha and S. Susan, Highlighting keyphrases using senti-scoring and fuzzy entropy for unsupervised sentiment analysis, Expert Systems with Applications 169 (2021) 114323. Crossref, Web of Science, Google Scholar
14. A. Ryczkowska, Positive mood induction through music: The significance of listener age and musical timbre, Psychology of Music 50(6) (2022) 1961–1975. Crossref, Web of Science, Google Scholar
15. K. Trohidis, G. Tsoumakas, G. Kalliris and I. Vlahavas, Multi-label classification of music by emotion, EURASIP Journal on Audio, Speech, and Music Processing 2011 (2011) 1–9. Crossref, Google Scholar
16. A. Aljanaki, Y.-H. Yang and M. Soleymani, Developing a benchmark for emotional analysis of music, PloS One 12(3) (2017) e0173392. Crossref, Web of Science, Google Scholar
17. N. Niu, Music emotion recognition model using gated recurrent unit networks and multi-feature extraction, Mobile Information Systems 2022 (2022) 5732687. Crossref, Web of Science, Google Scholar
18. F. Weninger, F. Eyben and B. Schuller, On-line continuous-time music mood regression with deep recurrent neural networks, in 2014 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2014), pp. 5412–5416. Crossref, Google Scholar
19. X. Li, H. Xianyu, J. Tian, W. Chen, F. Meng, M. Xu and L. Cai, A deep bidirectional long short-term memory based multi-scale approach for music dynamic emotion prediction, in 2016 IEEE Int. Conf. Acoustics, Speech and Signal Processing (ICASSP) (IEEE, 2016), pp. 544–548. Crossref, Google Scholar
20. J. Sangeetha and S. Jothilakshmi, Automatic continuous speech recogniser for dravidian languages using the auto associative neural network, International Journal of Computational Vision and Robotics 6(1–2) (2016) 113–126. Crossref, Google Scholar
21. L. Hussain, I. Shafi, S. Saeed, A. Abbas, I. A. Awan, S. A. Nadeem and B. Rahman, A radial base neural network approach for emotion recognition in human speech, International Journal of Computer Science and Network Security 17(8) (2017) 52. Google Scholar
22. C. Lin, M. Liu, W. Hsiung and J. Jhang, Music emotion recognition based on two-level support vector classification, in 2016 Int. Conf. Machine Learning and Cybernetics (ICMLC), Vol. 1 (IEEE, 2016), pp. 375–389. Crossref, Google Scholar
23. K. Weiss, T. M. Khoshgoftaar and D. D. Wang, A survey of transfer learning, Journal of Big Data 3(1) (2016) 1–40. Crossref, Google Scholar
24. S. Li, W. Deng and J. P. Du, Reliable crowdsourcing and deep locality-preserving learning for expression recognition in the wild, in Proc. IEEE Conf. Computer Vision and Pattern Recognition (IEEE, 2017), pp. 2852–2861. Crossref, Google Scholar
25. R. Zhu, G. Sang and Q. Zhao, Discriminative feature adaptation for cross-domain facial expression recognition, in 2016 Int. Conf. Biometrics (ICB) (IEEE, 2016), pp. 1–7. Crossref, Google Scholar
26. Z. Liu, F. Zhu, K. Zhang, Z. Lai and H. Huo, Manifold transfer subspace learning based on double relaxed discriminative regression, Artificial Intelligence Review 56(1) (2023) 959–981. Crossref, Web of Science, Google Scholar
27. Z. Liu, T. Wang, F. Zhu, X. Chen, D. Pelusi and A. V. Vasilakos, Domain adaptive learning based on equilibrium distribution and dynamic subspace approximation, Expert Systems with Applications 249(B) (2024) 123673. Crossref, Google Scholar
28. G. Badaro, O. E. Jundi, A. Khaddaj, A. Maarouf, R. Kain, H. Hajj and W. El-Hajj, EMA at SemEval-2018 Task 1: Emotion mining for arabic, in Proc. 12th Int. Workshop on Semantic Evaluation (Association for Computational Linguistics, 2018), pp. 236–244. Crossref, Google Scholar
29. S. J. Pan, I. W. Tsang, J. T. Kwok and Q. Yang, Domain adaptation via transfer component analysis, IEEE Transactions on Neural Networks 22(2) (2010) 199–210. Crossref, Google Scholar
30. B. Fernando, A. Habrard, M. Sebban and T. Tuytelaars, Unsupervised visual domain adaptation using subspace alignment, in Proc. IEEE Int. Conf. Computer Vision (IEEE, 2013), pp. 2960–2967. Crossref, Google Scholar
31. G. Schweikert, G. Rätsch, C. Widmer and B. Schölkopf, An empirical analysis of domain adaptation algorithms for genomic sequence analysis, Advances in Neural Information Processing Systems 21 (2008). Google Scholar
32. W. Chu and S. Sathiya Keerthi, Support vector ordinal regression, Neural Computation 19(3) (2007) 792–815. Crossref, Web of Science, Google Scholar
33. W. Chu, Z. Ghahramani and C. K. Williams, Gaussian processes for ordinal regression, Journal of Machine Learning Research 6(7) (2005) 1019–1041. Google Scholar
34. F. Zhu, X. Chen, S. Chen, W. Zheng and W. Ye, Relative margin induced support vector ordinal regression, Expert Systems with Applications 231 (2023) 120766. Crossref, Web of Science, Google Scholar
35. S. Suthaharan, Support vector machine, Machine Learning Models and Algorithms for Big Data Classification: Thinking with Examples for Effective Learning (Springer, 2016), pp. 207–235. Crossref, Google Scholar
36. F. Zhu, J. Yang, J. Gao and C. Xu, Extended nearest neighbor chain induced instance-weights for SVMs, Pattern Recognition 60 (2016) 863–874. Crossref, Web of Science, Google Scholar
37. B. J. Wythoff, Backpropagation neural networks: A tutorial, Chemometrics and Intelligent Laboratory Systems 18(2) (1993) 115–155. Crossref, Web of Science, Google Scholar
38. F. Zhu, X. Chen, X. Gao, W. Ye, H. Zhao and A. V. Vasilakos, Constraint-weighted support vector ordinal regression to resist constraint noises, Information Sciences 649 (2023) 119644. Crossref, Web of Science, Google Scholar