Non-negative matrix factorization (NMF) is an unsupervised algorithm for clustering where a non-negative data matrix is factorized into (usually) two matrices with the property that all the matrices have no negative elements. This factorization raises the problem of instability, which means whenever we run NMF for the same dataset, we get different factorization. In order to solve the problem of non-uniqueness and to have a more stable solution, we propose a new approach that consists on collaborating different NMF models followed by a consensus. The proposed approach was validated on several datasets and the experimental results showed the effectiveness of our approach which is based on the reducing of standard reconstruction error in NMF model.

Keywords:

Remember to check out the Most Cited Articles!
Check out these titles in artificial intelligence!

References

1. F. Shahnaz, M. W. Berry, V. P. Pauca and R. J. Plemmons , Document clustering using nonnegative matrix factorization, Inf. Process. Manage. 42(2) (2006) 373–386. Crossref, Google Scholar
2. A. Cichocki, R. Zdunek, A. H. Phan and S.-I. Amari , Nonnegative Matrix and Tensor Factorizations: Applications to Exploratory Multi-way Data Analysis and Blind Source Separation (John Wiley & Sons, 2009). Crossref, Google Scholar
3. P. Paatero and U. Tapper , Positive matrix factorization: A non-negative factor model with optimal utilization of error estimates of data values, Environmetrics 5(2) (1994) 111–126. Crossref, Google Scholar
4. S. Dudoit and J. Fridlyand , A prediction-based resampling method for estimating the number of clusters in a dataset, Genome Biol. 3(7) (2002) research0036-1. Crossref, Google Scholar
5. A. Ben-Hur, A. Elisseeff and I. Guyon , A stability based method for discovering structure in clustered data, in Biocomputing 2002 (World Scientific, 2001), pp. 6–17. Link, Google Scholar
6. D. Donoho and V. Stodden , When does non-negative matrix factorization give a correct decomposition into parts?, in Proc. 16th Int. Conf. Neural Information Processing Systems (NIPS’03) (MIT Press, 2003), pp. 1141–1148. Google Scholar
7. M. Plumbley , Conditions for nonnegative independent component analysis, IEEE Signal Process. Lett. 9(6) (2002) 177–180. Crossref, Google Scholar
8. H. Laurberg, M. G. Christensen, M. D. Plumbley, L. K. Hansen and H. S. Jensen , Theorems on positive data: On the uniqueness of NMF, Comput. Intell. Neurosci. 2008 (2008) 764206. Crossref, Google Scholar
9. W. Pedrycz , Knowledge-based Clustering: From Data to Information Granules (John Wiley & Sons, 2005). Crossref, Google Scholar
10. G. Forestier, P. Gancarski and C. Wemmert , Collaborative clustering with background knowledge, Data Knowl. Eng. 69(2) (2010) 211–228. Crossref, Google Scholar
11. G. Forestier, C. Wemmert and P. Gancarski , Collaborative multi-strategical classification for object-oriented image analysis, in Workshop on Supervised and Unsupervised Ensemble Methods and Their Applications in Conjunction with IbPRIA, Springer, Berlin, Heidelberg, 2007, pp. 80–90. Google Scholar
12. Y.-L. Xie, P. K. Hopke and P. Paatero , Positive matrix factorization applied to a curve resolution problem, J. Chemom. 12(6) (1999) 357–364. Crossref, Google Scholar
13. D. D. Lee and H. S. Seung , Algorithms for non-negative matrix factorization, in Advances in Neural Information Processing Systems (MIT Press, Cambridge, 2001), pp. 556–562. Google Scholar
14. C. Ding, X. He and H. D. Simon , On the equivalence of nonnegative matrix factorization and spectral clustering, in Proc. 2005 SIAM Int. Conf. Data Mining (SIAM, 2005), pp. 606–610. Crossref, Google Scholar
15. S. Lloyd , Least squares quantization in PCM, Special Issue on Quantization IEEE Trans. Inf. Theory 28(2) (1982) 129–137. Crossref, Google Scholar
16. A. Strehl and J. Ghosh , Cluster ensembles — A knowledge reuse framework for combining multiple partitions, J. Mach. Learn. Res. 3 (2002) 583–617. Google Scholar
17. S. Vega-Pons and J. Ruiz-Shulcloper , A survey of clustering ensemble algorithms, Int. J. Pattern Recognit. Artif. Intell. 25(3) (2011) 337–372. Link, Google Scholar
18. W. Pedrycz , Collaborative fuzzy clustering, Pattern Recognit. Lett. 23(14) (2002) 1675–1686. Crossref, Google Scholar
19. J. Sublime, B. Matei, G. Cabanes, N. Grozavu, Y. Bennani and A. Cornuéjols , Entropy based probabilistic collaborative clustering, Pattern Recognit. 72 (2017) 144–157. Crossref, Google Scholar
20. I. Redko and Y. Bennani , Sparsity analysis of learned factors in multilayer NMF, in 2015 Int. Joint Conf. Neural Networks (IJCNN 2015) (IEEE, 2015), pp. 1–7. Crossref, Google Scholar
21. M. Ghassany, N. Grozavu and Y. Bennani , Collaborative multi-view clustering, in 2013 Int. Joint Conf. Neural Networks (IJCNN 2013) (IEEE, 2013), pp. 1–8. Crossref, Google Scholar
22. N. Grozavu and Y. Bennani , Topological collaborative clustering, Aust. J. Intell. Inf. Process. Syst. 12(3) (2010) 13–18. Google Scholar
23. M. Ghassany, N. Grozavu and Y. Bennani , Collaborative generative topographic mapping, in Proc. 19th Int. Conf. Neural Information Processing (ICONIP 2012), Part II, Lecture Notes in Computer Science, Vol. 7664, eds. T. Huang, Z. Zeng, C. Li and C. Leung (Springer, 2012), pp. 591–598. Crossref, Google Scholar
24. M. Ghassany, N. Grozavu and Y. Bennani , Collaborative clustering using prototype-based techniques, Int. J. Comput. Intell. Appl. 11(3) (2012) 1250017. Link, Google Scholar
25. K. Benlamine, N. Grozavu, Y. Bennani and B. Matei , Collaborative non-negative matrix factorization, in Int. Conf. Artificial Neural Networks (Springer, 2019), pp. 655–666. Crossref, Google Scholar
26. H. W. Kuhn and A. W. Tucker , Nonlinear programming, in Proc. 2nd Berkeley Symp. Mathematical Statistics and Probability (University of California Press, Berkeley, 1951), pp. 481–492. Google Scholar
27. Y. Li and A. Ngom , The non-negative matrix factorization toolbox for biological data mining, Source Code Biol. Med. 8 (2013) 10. Crossref, Google Scholar
28. A. Asuncion and D. Newman, UCI Machine Learning Repository (2007). Google Scholar
29. S. Ben-David, U. von Luxburg and D. Pál , A sober look at clustering stability, in Learning Theory, Lecture Notes in Computer Science, Vol. 4005, eds. G. Lugosi and H. Simon (Springer, Berlin, Heidelberg, 2006), pp. 5–19. Crossref, Google Scholar
30. U. von Luxburg , Clustering stability: An overview, Found. Trends Mach. Learn. 2 (2010) 235–274. Google Scholar