No Access

College of Mathematics and Systems Science, Xinjiang University, Urumqi 830046, P. R. China

E-mail Address: 107552103328@stu.xju.edu.cn

and

Yuhong Sheng

College of Mathematics and Systems Science, Xinjiang University, Urumqi 830046, P. R. China

E-mail Address: shengyh@xju.edu.cn

Corresponding author.

Search for more papers by this author

https://doi.org/10.1142/S0218488525500102Cited by:0 (Source: Crossref)

Abstract

Support vector regression (SVR) has been widely used in academia and industry with excellent performance. Crisp data always be trained by classic SVR and its varieties. However, classic SVR is feeble if data are imprecise or low-quality. Hence, the uncertainty theory emerged as the times require, which can process the imprecise observations well. In this study, a novel SVR model be introduced into uncertainty theory, termed v-SVR with imprecise observations, designed to handle imprecise or low-quality data. Unlike the conventional $ε$ -SVR with imprecise observations approach, v-SVR offers an automated computation of the accuracy parameter $ε$ , thereby eliminating the need for manual selection. This results in improved performance with simplified parameter tuning. The effectiveness of the approach in this paper be demonstrated through a numerical example.

Keywords:

References

1. D. Basak, P. Srimanta and D. Patranbis, “Support vector regression”, Neural Information Processing Letters & Reviews 11 (2007) 203–224. Google Scholar
2. V. Vapnik and A. Lerner, “Pattern recognition using generalized portrait method”, Automation and Remote Control 24 (1963) 774–780. Google Scholar
3. B. Boser, I. Guyon and V. Vapnik, “A training algorithm for optimal margin classifiers”, in Proceedings of the 5th Annual ACM Workshop on Computational Learning Theory (1992), pp. 144–152. Crossref, Google Scholar
4. V. Vapnik, S. Golowich and A. Smola, “Support vector method for function approximation, regression estimation, and signal processing”, Advances in Neural Information Processing Systems 9 (1997) 281–287. Google Scholar
5. V. Vapnik and S. Kotz, The Nature of Statistical Learning Theory (Springer Verlag, 1995). Crossref, Google Scholar
6. B. Schlkopf, P. Bartlett and A. Smola, Support Vector Regression with Automatic Accuracy Control (Springer, 1998). Crossref, Google Scholar
7. H. Drucker, J. Burges, L. Kaufman, J. Chris, A. Smola and V. Vapnik, “Support vector regression machines”, Advances in Neural Information Processing Systems 28 (1997) 779–784. Google Scholar
8. K. Mller, A. Smola, G. Rtsch, B. Schlkopf, J. Kohlmorgen and V. Vapnik, “Predicting time series with support vector machines”, in Artificial Neural Networks—ICANN’97 (1997), pp. 999–104. Crossref, Google Scholar
9. M. Stitson, A. Gammerman, V. Vapnik, V. Vovk, C. Watkins and J. Weston, “Support vector regression with anova decomposition kernel”, Advances in Kernel MethodsSupport Vector Learning (1999) 285–292. Google Scholar
10. B. Schlkopf and A. Smola, Learning with kernels (MIT Press, 2002). Google Scholar
11. K. Chen and C. Wang, “Support vector regression with genetic algorithms forecasting in tourims demand”, Tourism Management 28 (2007) 215–226. Crossref, Web of Science, Google Scholar
12. P. Rivas-Perea, J. Cota-Ruiz and J. Rosiles, “A nonlinear least squares quasi-newton strategy for LP-SVR hyper-parameters selection”, International Journal of Machine Learning & Cybernetics 5 (2014) 579–597. Crossref, Web of Science, Google Scholar
13. K. Smets, B. Verdonk and E. Jordaan, “Evaluation of performance measures for SVR hyperparameter selection”, in International Joint Conference on Neural Networks (2007), pp. 637–642. Google Scholar
14. M. Li, D. Xu, J. Geng and W. Hong, “A hybrid approach for forecasting ship motion using CNNGRUAM and GCWOA”, Applied Soft Computing 114 (2022) 108084. Crossref, Google Scholar
15. B. Schlkopf, A. Smola, R. Williamson and P. Bartlett, “New support vector algorithms”, Neural Computation 12 (2000) 1207–1245. Crossref, Web of Science, Google Scholar
16. H. Shu and Q. Shi, “A combined bias of network RTK based on nu-SVR and the analysis of the model parameter”, in International Conference on Intelligent System & Knowledge Engineering (2008), pp. 319–323. Crossref, Google Scholar
17. Y. Shu, Q. Li, C. Xu, S. Liu and G. Xu, “V-SVR+: Support vector regression with variational privileged information”, IEEE Transactions on Multimedia 24 (2021) 876–889. Crossref, Google Scholar
18. U. Gupta and D. Gupta, “An improved regularization based lagrangian asymmetric-twin support vector regression using pinball loss function”, Applied Intelligence 49 (2019) 3606–3627. Crossref, Google Scholar
19. U. Gupta and D. Gupta, “Least squares large margin distribution machine for regression”, Applied Intelligence 51 (2021) 7058–7093. Crossref, Web of Science, Google Scholar
20. D. Gupta and U. Gupta, “On robust asymmetric lagrangian-twin support vector regression using pinball loss function”, Applied Soft Computing 102 (2021) 107099. Crossref, Google Scholar
21. L. Zadeh, “Fuzzy sets”, Information & Control 8 (1965) 338–353. Crossref, Google Scholar
22. L. Zadeh, “Probability measures of fuzzy events”, Journal of Mathematical Analysis and Applications 23 (1968) 421–427. Crossref, Web of Science, Google Scholar
23. C. Lin and S. Wang, “Fuzzy support vector machines”, IEEE Transactions on Neural Networks 13 (2002) 464–471. Crossref, Web of Science, Google Scholar
24. Jayadeva, R. Khemchandani and S. Chandra, “Regularized least squares fuzzy support vector regression for time series forecasting”, in The 2006 IEEE International Joint Conference on Neural Network Proceedings (2006), pp. 593–598. Google Scholar
25. Y. Zhang, H. Su, R. Liu and J. Chu, “Fuzzy support vector regression model of 4-CBA concentration for industrial PTA oxidation process”, Chinese Journal of Chemical Engineering 13 (2005) 642–648. Web of Science, Google Scholar
26. B. Liu, “Why is there a need for uncertainty theory”, Journal of Uncertain Systems 6 (2012) 3–10. Google Scholar
27. B. Liu, Uncertainty Theory, 2nd edn (Springer, Berlin, Heidelberg, 2007). Google Scholar
28. B. Liu, Uncertainty Theory: A Branch of Mathematics for Modeling Human Uncertainty (Springer, Berlin, Heidelberg, 2010). Crossref, Google Scholar
29. Y. Sheng and S. Kar, “Some results of moments of uncertain variable through inverse uncertainty distribution”, Fuzzy Optimization & Decision Making 14 (2015) 57–76. Crossref, Web of Science, Google Scholar
30. K. Yao and B. Liu, “Uncertain regression analysis: an approach for imprecise observations”, Soft Computing 22 (2018) 5579–5582. Crossref, Web of Science, Google Scholar
31. W. Lio and B. Liu, “Residual and confidence interval for uncertain regression model with imprecise observations”, Journal of Intelligent and Fuzzy Systems 35 (2018) 2573–2583. Crossref, Web of Science, Google Scholar
32. H. Zhang and Y. Sheng, “Support vector regression with imprecise observations”, Technical report, Xinjiang university, 2022. Google Scholar
33. V. Cherkassky and F. Mulier, Learning from Data: Concepts, Theory, and Methods (Wiley, 1998). Google Scholar
34. T. Runarsson and S. Sigurdsson, “Model selection for support vector machines using an asynchronous parallel evolution strategy”, in Neural Networks and Signal Processing (2004), pp. 495–498. Google Scholar
35. B. Schlkopf, J. Burges and A. Smola, Advances in Kernel Methods: Support Vector Machine (MIT Press, 1998). Google Scholar
36. S. Zheng, H. Li and X. Yang, “Uncertain threshold autoregressive model via LASSO procedure”, Journal of Uncertain Systems 15 (2022) 2243006–2243021. Link, Google Scholar