Probabilistic Models of Text and Link Structure for Hypertext Classification Export

@inproceedings{citeulike:344951, abstract = {Most text classification methods treat each document as an independent instance. However, in many text domains, documents are linked and the topics of linked documents are correlated. For example, web pages of related topics are often connected by hyperlinks and scientific papers from related fields are commonly linked by citations. We propose a unified probabilistic model for both the textual content and the link structure of a document collection. Our model is based on the recently introduced framework of Probabilistic Relational Models (PRMs), which allows us to capture correlations between linked documents. We show how to learn these models from data and use them efficiently for classification. Since exact methods for classification in these large models are intractable, we utilize belief propagation, an approximate inference algorithm. Belief propagation automatically induces a very natural behavior, where our knowledge about one document helps us classify related ones, which in turn help us classify others. We present preliminary empirical results on a dataset of university web pages.}, address = {Seattle, WA}, author = {Getoor, Lise and Segal, Eran and Taskar, Ben and Koller, Daphne}, booktitle = {IJCAI Workshop on "Text Learning: Beyond Supervision"}, citeulike-article-id = {344951}, citeulike-linkout-0 = {http://ai.stanford.edu/~erans/publications/ijcai01-ws.pdf}, comment = {task: classify web pages according to student, course, faculty project using Hyperlink, Anchor text and the hub property. idea of the task: train with manually classified pages from one university and apply this to other universities. Method: PRM with existence uncertainty + Belief Propagation (partial knowledge influences its unknown environment) ---=note-separator=--- "Because instances are not independent, information about some instances can be used to reach conclusions about others." ---=note-separator=--- "Note that during classification, existence of links and anchor words in the links are used as evidence to infer categories of the web pages." ---=note-separator=--- determined classes: Page [.category, .hub, .word1, ... .wordn] undetermined: Links [.fromPage, .toPage, .anchor, .exists]; Anchor [.word]}, keywords = {mustread, relationalmodels, socialnets}, month = {August}, posted-at = {2005-10-07 17:03:10}, priority = {0}, title = {Probabilistic Models of Text and Link Structure for Hypertext Classification}, url = {http://ai.stanford.edu/~erans/publications/ijcai01-ws.pdf}, year = {2001} }

TY - CONF ID - citeulike:344951 L3 - citeulike-article-id:344951 N2 - Most text classification methods treat each document as an independent instance. However, in many text domains, documents are linked and the topics of linked documents are correlated. For example, web pages of related topics are often connected by hyperlinks and scientific papers from related fields are commonly linked by citations. We propose a unified probabilistic model for both the textual content and the link structure of a document collection. Our model is based on the recently introduced framework of Probabilistic Relational Models (PRMs), which allows us to capture correlations between linked documents. We show how to learn these models from data and use them efficiently for classification. Since exact methods for classification in these large models are intractable, we utilize belief propagation, an approximate inference algorithm. Belief propagation automatically induces a very natural behavior, where our knowledge about one document helps us classify related ones, which in turn help us classify others. We present preliminary empirical results on a dataset of university web pages. AD - Seattle, WA TI - Probabilistic Models of Text and Link Structure for Hypertext Classification T2 - IJCAI Workshop on "Text Learning: Beyond Supervision" KW - mustread KW - relationalmodels KW - socialnets N1 - task: classify web pages according to student, course, faculty project using Hyperlink, Anchor text and the hub property. idea of the task: train with manually classified pages from one university and apply this to other universities. Method: PRM with existence uncertainty + Belief Propagation (partial knowledge influences its unknown environment) N1 - "Because instances are not independent, information about some instances can be used to reach conclusions about others." N1 - "Note that during classification, existence of links and anchor words in the links are used as evidence to infer categories of the web pages." N1 - determined classes: Page [.category, .hub, .word1, ... .wordn] undetermined: Links [.fromPage, .toPage, .anchor, .exists]; Anchor [.word] AU - Getoor, Lise AU - Segal, Eran AU - Taskar, Ben AU - Koller, Daphne PY - 2001/08// UR - http://ai.stanford.edu/~erans/publications/ijcai01-ws.pdf ER -