Faculty of Computer Science and Information Engineering, Hubei Key Laboratory of Big Data Intelligent Analysis, and Application (Hubei University), Hubei University, Wuhan 430062, P. R. China

E-mail Address: frangipani@hubu.edu.cn

Search for more papers by this author

, and

Jingjing Zeng

https://orcid.org/0009-0008-9212-2641

Faculty of Mathematics, Wuhan Institute of Technology, Wuhan 430205, P. R. China

E-mail Address: zengjingjing82@sina.com

Search for more papers by this author

https://doi.org/10.1142/S0219691324500309Cited by:1 (Source: Crossref)

Abstract

Functional linear regression is one of the main modeling tools for working with functional data. Since functional data are usually stream data essentially and there are some noises in functional data. Many numerical research studies of machine learning indicate that the noise samples not only increase the amount of storage space, but also affect the performance of algorithm. Therefore, in this paper we consider a new learning strategy by introducing incremental learning, Markov sampling for functional linear regression and propose a novel functional incremental linear square regression algorithm based on Markov sampling (FILSR-MS). To have a better understanding of the proposed FILSR-MS, we not only estimate the generalization bound of the proposed algorithm and establish the fast learning rate, but also present some useful discussions. The performance of the proposed algorithm is validated by the numerical experiments for benchmark repository.

Keywords:

AMSC: 22E46, 53C35, 57S20

References

1. M. Ai, F. Wang, J. Yu and H. Zhang , Optimal subsampling for large-scale quantile regression, J. Complexity 62 (2021) 101512. Crossref, Web of Science, Google Scholar
2. N. Cesa-Bianchi, A. Conconi and C. Gentile , On the generalization ability of on-line learning algorithms, IEEE Trans. Inf. Theory 50(9) (2004) 2050–2057. Crossref, Web of Science, Google Scholar
3. T. Cai and P. Hall , Prediction in functional linear regression, Ann. Stat. 34(5) (2007) 2159–2179. Google Scholar
4. T. Cai and M. Yuan , Minimax and adaptive prediction for functional linear regression, J. Am. Stat. Assoc. 107(499) (2012) 1201–1216. Crossref, Web of Science, Google Scholar
5. H. Cardot, F. Ferraty and P. Sarda , Spline estimators for the functional linear model, Stat. Sin. 3 (2003) 571–591. Google Scholar
6. D. R. Chen, Q. Wu, Y. M. Ying and D. X. Zhou , Support vector machine soft margin classifiers: Error analysis, J. Mach. Learn. Res. 5 (2004) 1143–1175. Web of Science, Google Scholar
7. F. Cucker and S. Smale , On the mathematical foundations of learning, Bull. Am. Math. Soc. 39 (2001) 1–49. Crossref, Web of Science, Google Scholar
8. F. Cucker and S. Smale , Best choices for regularization parameters in learning theory: On the bias-variance problem, Found. Comput. Math. 2(4) (2002) 413–428. Crossref, Web of Science, Google Scholar
9. Y. Duan, B. Zou, J. Xu, F. Chen, J. Wei and Y. Y. Tang , OAA-SVM-MS: A fast and efficient multi-class classification algorithm, Neurocomputing 454 (2021) 448–460. Crossref, Web of Science, Google Scholar
10. J. Demsar , Statistical comparisons of classifiers over multiple data sets, J. Mach. Learn. Res. 7 (2006) 1–30. Web of Science, Google Scholar
11. F. Ferraty and P. Vieu , Nonparametric Functional Data Analysis: Methods, Theory, Applications and Implementations (Springer, New York, 2006). Google Scholar
12. H. He, S. Chen, K. Li and X. Xu , Incremental learning from stream data, IEEE Trans. Neural Networks 39(12) (2011) 1901–1914. Google Scholar
13. T. Hsing and R. Eubank , Theoretical Foundations of Functional Data Analysis with an Introduction to Linear Operators (Wiley, New York, 2015). Crossref, Google Scholar
14. P. Lokoszka and M. Reimherr , Introduction to Functional Data Analysis (CRC Press, 2017). Crossref, Google Scholar
15. V. Paulsen and M. Raghupathi , An Introduction to the Theory of Reproducing Kernel Hilbert Spaces (Cambridge University Press, 2016). Crossref, Google Scholar
16. M. P. Qian and G. L. Gong , Applied Random Processes (Peking University Press, Beijing, 1998). Google Scholar
17. J. O. Ramsay and C. J. Dalzell , Some tools for functional data analysis, J. R. Stat. Soc.: Ser. B (Methodol.) 53(3) (1991) 539–572. Crossref, Web of Science, Google Scholar
18. J. Ramsay and B. Silverman , Functional Data Analysis (Springer, 2005). Crossref, Google Scholar
19. J. A. Rice and C. O. Wu , Nonparametric mixed effects models for unequally sampled noisy curves, Biometrics 57(1) (2001) 253–259. Crossref, Web of Science, Google Scholar
20. H. Tong , Functional linear regression with Huber loss, J. Complexity 74 (2023) 101696. Crossref, Web of Science, Google Scholar
21. H. Tong , Analysis of regularized least squares for functional linear regression model, J. Complexity 49 (2018) 85–94. Crossref, Web of Science, Google Scholar
22. M. Vidyasagar , Learning and Generalization with Applications to Neural Networks, 2nd edn. (Springer, London, 2003). Crossref, Google Scholar
23. J. Xu, C. Xu, B. Zou, Y. Y. Tang, J. T. Peng and X. G. You , New incremental learning algorithm with support vector machines, IEEE Trans. Syst. Man Cybern.: Syst. 49(11) (2019) 2230–2241. Crossref, Web of Science, Google Scholar
24. J. Yao, J. Mueller and J.-L. Wang, Deep learning for functional data analysis with adaptive basis layers, preprint (2021), arXiv:2106.10414. Google Scholar
25. M. Yuan and T. Cai , A reproducing kernel Hilbert space approach to functional linear regression, Ann. Stat. 38(6) (2010) 3412–3444. Crossref, Web of Science, Google Scholar