No Access

A Query Engine for Retrieving Information from Chinese HTML Documents

LIHUA ZHANG

Computer Science Department, Brigham Young University, Provo, UT 84602, USA

Search for more papers by this author

and

YIU-KAI NG

Computer Science Department, Brigham Young University, Provo, UT 84602, USA

Search for more papers by this author

https://doi.org/10.1142/S0219427904001085Cited by:0 (Source: Crossref)

Abstract

The amount of online information in Chinese and the number of Chinese Internet users have been increasing tremendously during the past decade. Since Chinese language is significantly different from English, techniques that have been developed for retrieving information from English Web documents cannot be directly applied to retrieve information from Chinese Web documents. In order to provide high-performance access of Chinese information on the Web, we have developed a Chinese Web query engine that (i) extracts (hierarchical) data of interest from Chinese HTML tables using an information extraction tool called semantic hierarchy, (ii) allows the user to submit queries in Chinese using a menu-driven user interface, and (iii) processes the user's queries (as Boolean expressions) to generate the correct results. Our query engine supports various groups of information that are categorized into various subject areas, such as car ads, house rentals, job ads, stocks, university catalogs, etc. We have tested our information extraction tool on two application domains, car-ads and house-rental. The average F-measure on extracting Chinese data from these two application domains is above 90%. More importantly, our query engine can easily be configured and internationalized to become a worldwide, multilingual query engine with minor changes in system settings on PCs running Windows operating systems.

Keywords:

References

S. Abiteboulet al., Digital Libraries 1(1), 68 (1997). Crossref, Google Scholar
A. M. Alashqur, S. Y. W. Su, and H. Lam, OQL: A query language for manipulating object-oriented databases, in Proc. Int. Conf. on Very Large Data Bases, 1989, pp. 433–442 . Google Scholar
E. Bruno, J. L. Maitre, and E. Murisasco, Querying XML data: the DQL language, in WWW Posters, 2001 . Google Scholar
R. Baeza-Yates and B. Ribeiro-Neto , Modern Information Retrieval ( Addison-Wesley , 1999 ) . Google Scholar
L.-F. Chien, Proc. Int. Conf. on Research and Development in Information Retrieval (SIGIR) (ACM Press, 1997) pp. 50–58. Google Scholar
W. W. Cohen, M. Hurst, and L. S. Jensen, A flexible learning system for wrapping tables and lists in HTML documents, in Proc. 7th Int. World Wide Web Conference (WWW 2002), 2002, pp. 232{241 . Google Scholar
H.-H. Chen, S.-C. Tsai, and J.-H. Tsai, Mining tables from large scale HTML texts, in Proc. 18th Int. Conf. on Computational Linguistics, July 2000, pp. 166–172 . Google Scholar
A. Deitsch and D. Czarnecki, Java Internationalization, O'Reilly, 2001 . Google Scholar
S. J. DeRose, XQuery: A unified syntax for linking and querying general XML documents, in Proc. Query Languages 1998 Conference (QL'98), 1998 . Google Scholar
N. Kando, Japanese- and Chinese–English cross-lingual information retrieval and multi-grade relevance judgments, in Proc. Cross-Language Information Retrieval and Evaluation, 2000, pp. 24–35 . Google Scholar
L. Kwong and Y.-K. Ng, Journal of the World Wide Web 6(3), 281 (2003). Crossref, Google Scholar
S. J. Lim, Semantic Hierarchies of HTML Documents and Their Applications, PhD thesis, Brigham Young University, November 2001 . Google Scholar
L. V. S. Lakshmanan, F. Sadri, and I. N. Subramanian, A declarative language for querying and restructuring the web, in Proc. 6th Int. Workshop on Research Issues in Data Engineering (RIDE'96), 1996 . Google Scholar
Sun Microsystems, JavaTM 2 SDK, Standard Edition Documentation, Version 1.3.1, 2002 . Google Scholar
G. A. Mihaila, WebSQL — An SQL-Like Query Language for the World Wide Web. Master's thesis, University of Toronto, 1996 . Google Scholar
Y. Wang and J. Hu, A machine learning based approach for table detection on the web, in Proc. 7th Int. World Wide Web Conference (WWW2002), May 2002, pp. 242–250 . Google Scholar
S. Wang, X. F. Meng, and S. Liu, Nchiql: A Chinese natural language query system to databases, in Proc. Int. Symp. on Database Applications in Non-Traditional Environments, 1999, pp. 453{460 . Google Scholar
Z. M. Wu and G. Tseng, J. Am. Soc. Inform. Sci. 44(9), 532 (1993). Crossref, Google Scholar
M. Yoshida, K. Torisawa, and J. Tsujii, A method to integrate tables of the world wide web, in Proc. First Int. Workshop on Web Document Analysis (WDA 2001), September 1999, pp. 31–34 . Google Scholar
L. Zhang, Retrieving Information from Tables in Chinese HTML Documents Using a Chinese Query Engine, Master's thesis, Brigham Young University, 2002 . Google Scholar

Vol. 17, No. 03

Metrics

Downloaded 9 times

History

Keywords

PDF download

System Upgrade on Tue, May 28th, 2024 at 2am (EDT)

A Query Engine for Retrieving Information from Chinese HTML Documents

Abstract

Recommended