No Access

Website Structure Improvement Based on the Combination of Selected Web Structure and Web Usage Mining Methods

Jozef Kapusta

http://orcid.org/0000-0002-8285-2404

Constantine the Philosopher University in Nitra, Nitra, Slovakia

E-mail Address: jkapusta@ukf.sk

Search for more papers by this author

Michal Munk

Constantine the Philosopher University in Nitra, Nitra, Slovakia

E-mail Address: mmunk@ukf.sk

Search for more papers by this author

, and

Martin Drlik

Constantine the Philosopher University in Nitra, Nitra, Slovakia

E-mail Address: mdrlik@ukf.sk

Search for more papers by this author

https://doi.org/10.1142/S0219622018500402Cited by:5 (Source: Crossref)

Abstract

The different web mining methods and techniques can help to solve some typical issues of the contemporary websites, contribute to more effective personalization, improve a website structure and reorganize its web pages. However, only several papers tried to combine web structure and web usage mining (WUM) methods with this aim. The paper researches if and how the combination of selected web structure and WUM methods can identify misplaced web pages and how they can contribute to improving the website structure. The paper analyzes the relationship between the estimated importance of the web page from the web page creator’s point of view using the web structure mining method based on PageRank and visitors’ real perception of the importance of that individual web page using the WUM method based on sequence patterns analysis, which eliminates the problem with repeated visits of the same web page during one session. The results prove that the expected probability of accesses to the individual web page correlates with the observed visit rate obtained from the log files using the WUM method. Furthermore, the website can be improved based on the consequent application of the residual analysis on the obtained results. The applicability of the proposed combination of the web structure and WUM methods is presented on two case studies from different application domains of the contemporary web. As a result, the web pages, which are underestimated or overestimated by the web page creators, are successfully identified in both cases.

Keywords:

References

1. M. Chen and Y. U. Ryu , Facilitating effective user navigation through website structure improvement, IEEE Transactions on Knowledge and Data Engineering 25 (2013) 571–588. Crossref, Web of Science, Google Scholar
2. J. Srivastava, R. Cooley, M. Deshpande and P.-N. Tan , Web usage mining: Discovery and applications of usage patterns from Web data, SIGKDD Explorations Newsletter 1 (2000) 12–23. Crossref, Google Scholar
3. Z. Pabarskaite and A. Raudys , A process of knowledge discovery from web log data: Systematization and critical review, Journal of Intelligent Information Systems 28 (2007) 79–104. Crossref, Web of Science, Google Scholar
4. Y. Lili, W. Yingbin, G. Zhanji and C. Yizhuo , Research on PageRank and hyperlink-induced topic search in web structure mining, in International Conference on Internet Technology and Applications (IEEE, Wuhan, 2011), pp. 1–4. Google Scholar
5. G. Wu and Y. Wei , Arnoldi versus GMRES for computing pageRank: A theoretical contribution to google’s pageRank problem, ACM Transactions on Information Systems 28 (2010) 1–28. Crossref, Web of Science, Google Scholar
6. D. G. Lorentzen , Webometrics benefitting from web mining? An investigation of methods and applications of two research fields, Scientometrics 99 (2014) 409–445. Crossref, Web of Science, Google Scholar
7. A. Jain, R. Sharma, G. Dixit and V. Tomar , Page Ranking algorithms in web mining, limitations of existing methods and a new method for indexing web pages, in Proc. 2013 Int. Conf. Communication Systems and Network Technologies, pp. 640–645. IEEE Computer Society (2013). Google Scholar
8. Y. Liu, M. Zhang, R. Cen, L. Ru and S. Ma , Data cleansing for web information retrieval using query independent features, Journal of the American Society for Information Science and Technology 58 (2007) 1884–1898. Crossref, Web of Science, Google Scholar
9. M. Chau and H. Chen , A machine learning approach to web page filtering using content and structure analysis, Decision Support Systems 44 (2008) 482–494. Crossref, Web of Science, Google Scholar
10. I. Paparrizos, V. Koutsonikola, L. Angelis and A. Vakali , Automatic extraction of structure, content and usage data statistics of web sites, in Proc. 21st ACM Conf. Hypertext and Hypermedia, ACM, Toronto, Ontario, Canada (2010), pp. 301–302. Google Scholar
11. F. Ahmadi-Abkenari and A. Selamat , A clickstream based web page importance metric for customized search engines, in Transactions on Computational Collective Intelligence XII, ed. N. Nguyen , Vol. 8240 (Springer, Berlin Heidelberg, 2013), pp. 21–41. Crossref, Google Scholar
12. B. Zhou, J. Chen, J. Shi, H. Zhang and Q. Wu , Website link structure evaluation and improvement based on user visiting patterns, in Proc. 12th ACM Conf. Hypertext and Hypermedia, ACM, Denmark (2001), pp. 241–244. Google Scholar
13. C. Shutong, X. Congfu and D. Hongwei , Website structure optimization technology based on customer interest clustering algorithm, in Conference Website Structure Optimization Technology Based on Customer Interest Clustering Algorithm, 2008, pp. 802–804. Google Scholar
14. G. Kou, Y. Peng and G. X. Wang , Evaluation of clustering algorithms for financial risk analysis using MCDM methods, Information Sciences 275 (2014) 1–12. Crossref, Web of Science, Google Scholar
15. G. Kou, Y. Lu, Y. Peng and Y. Shi , Evaluation of classification algorithms using MCDM and rank correlation, International Journal of Information Technology & Decision Making 11 (2012) 197–225. Link, Web of Science, Google Scholar
16. J. Jeffrey, P. Karski, B. Lohrmann, K. Kianmehr and R. Alhajj , Optimizing web structures using web mining techniques, in Intelligent Data Engineering and Automated Learning — IDEAL 2007, eds H. Yin, P. Tino, E. Corchado, W. Byrne and X. Yao , Vol. 4881 (Springer, Berlin Heidelberg, 2007), pp. 653–662. Google Scholar
17. J.-H. Su, B.-W. Wang and V. S. Tseng , Effective ranking and recommendation on web page retrieval by integrating association mining and PageRank, in Proc. 2008 IEEE/WIC/ACM Int. Conf. Web Intelligence and Intelligent Agent Technology, Vol. 03 (IEEE Computer Society, 2008), pp. 455–458. Google Scholar
18. B. Poblete and R. Baeza-Yates , A content and structure website mining model, in Proc. 15th Int. Conf. World Wide Web, ACM, Edinburgh, Scotland (2006), pp. 957–958. Google Scholar
19. L. Wen-Long and L. Ye-Zheng , A novel website structure optimization model for more effective web navigation, in First International Workshop on Knowledge Discovery and Data Mining (IEEE, Adelaide, Australia, 2008), pp. 36–41. Google Scholar
20. M. Perkowitz and O. Etzioni , Towards adaptive Web sites: Conceptual framework and case study, Artificial Intelligence 118 (2000) 245–275. Crossref, Web of Science, Google Scholar
21. H. Wang and X. Liu , Adaptive site design based on web mining and topology, in WRI World Congress on Computer Science and Information Engineering (IEEE, Los Angeles, 2009), pp. 184–189. Google Scholar
22. P.-Y. Yin and Y.-M. Guo , Optimization of multi-criteria website structure based on enhanced tabu search and web usage mining, Applied Mathematics and Computation 219 (2013) 11082–11095. Crossref, Web of Science, Google Scholar
23. A. Asllani and A. Lari , Using genetic algorithm for dynamic and multiple criteria web-site optimizations, European Journal of Operational Research 176 (2007) 1767–1777. Crossref, Web of Science, Google Scholar
24. J. Han, H. Cheng, D. Xin and X. Yan , Frequent pattern mining: Current status and future directions, Data Mining and Knowledge Discovery 15 (2007) 55–86. Crossref, Web of Science, Google Scholar
25. C. Romero, S. Ventura, A. Zafra and P. D. Bra , Applying Web usage mining for personalizing hyperlinks in Web-based adaptive educational systems, Computers and Education 53 (2009) 828–840. Crossref, Web of Science, Google Scholar
26. S. Park, N. C. Suresh and B.-K. Jeong , Sequence-based clustering for Web usage mining: A new experimental framework and ANN-enhanced K-means algorithm, Data and Knowledge Engineering 65 (2008) 512–543. Crossref, Web of Science, Google Scholar
27. B. Hay, G. Wets and K. Vanhoof , Web usage mining by means of multidimensional sequence alignment methods, in WEBKDD 2002 — Mining Web Data for Discovering Usage Patterns and Profiles, eds. O. Zaïane, J. Srivastava, M. Spiliopoulou and B. Masand , Vol. 2703 (Springer, Berlin Heidelberg, 2003), pp. 50–65. Google Scholar
28. B. Hay, G. Wets and K. Vanhoof , Segmentation of visiting patterns on web sites using a sequence alignment method, Journal of Retailing and Consumer Services 10 (2003) 145–153. Crossref, Google Scholar
29. F. Masseglia, D. Tanasa and B. Trousse , Web usage mining: Sequential pattern extraction with a very low support, in Advanced Web Technologies and Applications, eds. J. Yu, X. Lin, H. Lu and Y. Zhang , Vol. 3007 (Springer, Berlin Heidelberg, 2004), pp. 513–522. Google Scholar
30. S. Oyanagi, K. Kubota and A. Nakase , Mining WWW access sequence by matrix clustering, in WEBKDD 2002 — Mining Web Data for Discovering Usage Patterns and Profiles, eds. O. Zaïane, J. Srivastava, M. Spiliopoulou and B. Masand , Vol. 2703 (Springer, Berlin Heidelberg, 2003), pp. 119–136. Google Scholar
31. R. Cooley, B. Mobasher and J. Srivastava , Data preparation for mining world wide web browsing patterns, Knowledge and Information System 1 (1999) 5–32. Crossref, Google Scholar
32. M. Spiliopoulou and L. Faulstich , WUM: A tool for web utilization analysis, in The World Wide Web and Databases, eds. P. Atzeni, A. Mendelzon and G. Mecca , Vol. 1590 (Springer, Berlin Heidelberg, 1999), pp. 184–203. Crossref, Google Scholar
33. M.-S. Chen, J. S. Park and P. S. Yu , Data mining for path traversal patterns in a Web environment, in Proceedings of 16th International Conference on Distributed Computing Systems (IEEE, Hong Kong, 1996), pp. 385–392. Google Scholar
34. B. Berendt and M. Spiliopoulou , Analysis of navigation behaviour in web sites integrating multiple information systems, The VLDB Journal 9 (2000) 56–75. Crossref, Web of Science, Google Scholar
35. A. Guerbas, O. Addam, O. Zaarour, M. Nagi, A. Elhajj, M. Ridley and R. Alhajj , Effective web log mining and online navigational pattern prediction, Knowledge-Based Systems 49 (2013) 50–62. Crossref, Web of Science, Google Scholar
36. R. W. Cooley, Web usage mining: Discovery and application of interesting patterns from web data (2000). Google Scholar
37. E. Schmitt, H. Manning, Y. Paul and J. Tong, Measuring Web Success, Forrester Report (1999). Google Scholar
38. M. Drlik, P. Svec and J. Skalka , Comparison of approaches to the data analysis in the virtual learning environments, in DIVAI2014 Conference Proceedings (Wolters Kluwer, Nitra, 2014), pp. 561–572. Google Scholar
39. D. Downey, S. Dumais and E. Horvitz , Models of searching and browsing: Languages, studies, and applications, in Proc. 20th Int. Joint Conf. Artifical Intelligence (Morgan Kaufmann Publishers Inc., Hyderabad, India, 2007), pp. 2740–2747. Google Scholar
40. S. Chien and N. Immorlica , Semantic similarity between search engine queries using temporal correlation, in Proc. 14th Int. Conf. World Wide Web (ACM, Chiba, Japan, 2005), pp. 2–11. Google Scholar
41. D. He and A. Göker , Detecting session boundaries from Web user logs, in Proceedings of the BCS-IRSG 22nd Annual Colloquium on Information Retrieval Research (Cambridge, UK, 2000), pp. 57–66. Google Scholar
42. F. Radlinski and T. Joachims , Query chains: Learning to rank from implicit feedback, in Proc. Eleventh ACM SIGKDD International Conference on Knowledge Discovery in Data Mining (ACM, Chicago, IL, USA, 2005), pp. 239–248. Google Scholar
43. J. Zhang and A. A. Ghorbani , The reconstruction of user sessions from a server log using improved time-oriented heuristics, in Proceedings. Second Annual Conference on Communication Networks and Services Research (IEEE, Fredericton, Canada, 2004), pp. 315–322. Google Scholar
44. T. Huynh and J. Miller , Empirical observations on the session timeout threshold, Information Processing & Management 45 (2009) 513–528. Crossref, Web of Science, Google Scholar
45. N. Seco and N. Cardoso, Detecting user sessions in the Tumba! Query Log. Tech. Rep. Faculdade de Ciências da Universidade de Lisboa (2006). Google Scholar
46. M. Spiliopoulou, B. Mobasher, B. Berendt and M. Nakagawa , A framework for the evaluation of session reconstruction heuristics in web-usage analysis, INFORMS Journal on Computing 15 (2003) 171–190. Crossref, Web of Science, Google Scholar
47. Y. Yang , Web user behavioral profiling for user identification, Decision Support Systems 49 (2010) 261–271. Crossref, Web of Science, Google Scholar
48. W. Gong and T. Baohui , A new path filling method on data preprocessing in web mining, in International Conference on Control Engineering and Communication Technology (IEEE, Liaoning, China, 2012), pp. 1033–1035. Google Scholar
49. S. Dhawan and M. Lathwal , Study of preprocessing methods in web server logs, International Journal of Advanced Research in Computer Science and Software Engineering, 3 (2013) 430–433. Google Scholar
50. Y. Li, B. Feng and Q. Mao , Research on path completion technique in web usage mining, in Proc. 2008 Int. Symp. Computer Science and Computational Technology, Vol. 01 (IEEE Computer Society, 2008), pp. 554–559. Google Scholar
51. L. Tauscher and S. Greenberg , Revisitation patterns in World Wide Web navigation, in Proc. ACM SIGCHI Conf. Human Factors in Computing Systems, ACM, Atlanta, Georgia, USA (1997), pp. 399–406. Google Scholar
52. V. Chitraa and A. S. Davamani , An efficient path completion technique for web log mining, in IEEE Int. Conf. Computational Intelligence and Computing Research (2010). Google Scholar
53. C. Zhang and L. Zhuang , New path filling method on data preprocessing in web mining, Proceedings of Computer and Information Science 1 (2008) 112–115. Google Scholar
54. M. Munk, J. Kapusta and P. Švec , Data preprocessing evaluation for web log mining: Reconstruction of activities of a web visitor, Procedia Computer Science 1 (2010) 2273–2280. Crossref, Google Scholar
55. T. Huynh and J. Miller , Empirical observations on the session timeout threshold, Information Processing and Management 45 (2009) 513–528. Crossref, Web of Science, Google Scholar
56. D. Mehrzadi and D. G. Feitelson , On extracting session data from activity logs, in Proc. 5th Annual Int. Systems and Storage Conference, ACM, Haifa, Israel (2012), pp. 1–7. Google Scholar
57. Y. Fang and Z. Huang , An improved algorithm for session identification on web log, in Web Information Systems and Mining, eds. F. Wang, Z. Gong, X. Luo and J. Lei , Vol. 6318 (Springer, Berlin Heidelberg, 2010), pp. 53–60. Crossref, Google Scholar
58. R. Agrawal, T. Imieli and A. Swami , Mining association rules between sets of items in large databases, in Proc. 1993 ACM SIGMOD Int. Conf. Management of Data (ACM, Washington, D.C., USA, 1993), pp. 207–216. Google Scholar
59. M. J. Berry and G. S. Lino , Data Mining Techniques: For Marketing, Sales, and Customer Relationship Management (Willey Publishing, Indianapolis, 2011), ISBN: 1118087453, 888p. Google Scholar
60. I. Stankovičová , Možnosti extrakcie asociačných pravidiel z údajov pomocou SAS Enterprise Miner, in Informační a datová bezpečnost ve vazbě na strategické rozhodování ve znalostní společnosti (UTB, Zlín, 2009), pp. 1–9. Google Scholar
61. P. Pirolli, J. Pitkow and R. Rao , Silk from a sow’s ear: Extracting usable structures from the Web, in Proc. SIGCHI Conf. Human Factors in Computing Systems, ACM, Vancouver, British Columbia, Canada (1996), pp. 118–125. Google Scholar
62. B. Liu , Web Data Mining (Springer, New York, 2007). Google Scholar
63. S. Brin and L. Page , The anatomy of a large-scale hypertextual web search engine, Computer Networks and ISDN Systems 30 (1–7) (1998) 107–117. Crossref, Web of Science, Google Scholar
64. J. Kapusta and M. Munk, Web Usage Mining: Analysis of Expected and Observed Visit Rate UKF (2014). Google Scholar
65. A. Pilkova, J. Volna, J. Papula and M. Holienka , The influence of intellectual capital on firm performance among Slovak SMEs, in Proc. 10th Int. Conf. Intellectual Capital, Knowledge Management and Organisational Learning (ICICKM-2013) (2013), pp. 329–338. Google Scholar
66. D. Munková and M. Munk , Automatic evaluation of machine translation through the residual analysis, in Advanced Intelligent Computing Theories and Applications: 11th Int. Conf., eds. D.-S. Huang and K. Han , ICIC 2015, Fuzhou, China, August 20–23, 2015, Proceedings, Part III (Springer International Publishing, Cham, 2015), pp. 481–490. Google Scholar
67. P. R. Kumar, A. K. Singh and A. Mohan , Efficient methodologies to optimize Website for link structure based search engines, in International Conference on Green Computing, Communication and Conservation of Energy (ICGCE) (IEEE, Chennai, India, 2013), pp. 719–724. Google Scholar